2024-08-31T05:06:10.162 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-08-31T05:06:10.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T05:06:10.296 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881343 branch: wip-mchangir-testing-20240828.085847-main-debug description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: mchangir@redhat.com first_in_suite: false job_id: '7881343' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/squid ' name: mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing-20240828.085847-main-debug ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20240828.085847-main-debug sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 owner: scheduled_mchangir@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 5413 sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 sleep_before_teardown: 0 subset: 347/512 suite: fs suite_branch: wip-mchangir-testing-20240828.085847-main-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 targets: smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP0HJBLEFZPmHy5jgfrWfJObvnejzWv0iHa8xH8doyYNfulTAxdx6uHZdkcoeGHi9F5nbA+YJ0rBME//6gH41A4= smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHfd/i1QLq381YnksUt7coVxM/LDDIpGGIYSFtBl/3to8+eMgbdCVmZmToDO8kqqPzpNmgOWA6L6ZGBrOQR6GLg= tasks: - install: branch: squid exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: squid conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:squid roleless: true - print: '**** done end installing squid cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-08-30_08:30:37 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-08-31T05:06:10.296 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa; will attempt to use it 2024-08-31T05:06:10.297 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks 2024-08-31T05:06:10.297 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-31T05:06:10.298 INFO:teuthology.task.internal:Checking packages... 2024-08-31T05:06:10.319 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd19e6118f7015f0047264006cb0c873528eb3ae6' 2024-08-31T05:06:10.319 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T05:06:10.319 INFO:teuthology.packaging:ref: None 2024-08-31T05:06:10.319 INFO:teuthology.packaging:tag: None 2024-08-31T05:06:10.319 INFO:teuthology.packaging:branch: wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T05:06:10.319 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:06:10.320 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T05:06:10.456 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4560.gd19e6118 2024-08-31T05:06:10.457 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-31T05:06:10.464 INFO:teuthology.task.internal:no buildpackages task found 2024-08-31T05:06:10.465 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-31T05:06:10.510 INFO:teuthology.task.internal:Saving configuration 2024-08-31T05:06:10.528 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-31T05:06:10.537 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-31T05:06:10.560 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881343', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 05:01:06.945171', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP0HJBLEFZPmHy5jgfrWfJObvnejzWv0iHa8xH8doyYNfulTAxdx6uHZdkcoeGHi9F5nbA+YJ0rBME//6gH41A4='} 2024-08-31T05:06:10.581 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881343', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 05:01:06.946912', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHfd/i1QLq381YnksUt7coVxM/LDDIpGGIYSFtBl/3to8+eMgbdCVmZmToDO8kqqPzpNmgOWA6L6ZGBrOQR6GLg='} 2024-08-31T05:06:10.582 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-31T05:06:10.589 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-08-31T05:06:10.589 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-08-31T05:06:10.589 INFO:teuthology.run_tasks:Running task console_log... 2024-08-31T05:06:10.672 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f07ee12fac0>, signals=[15]) 2024-08-31T05:06:10.672 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-31T05:06:10.682 INFO:teuthology.task.internal:Opening connections... 2024-08-31T05:06:10.683 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2024-08-31T05:06:10.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:06:10.759 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-08-31T05:06:10.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:06:10.836 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-31T05:06:10.843 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-08-31T05:06:10.861 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-08-31T05:06:10.861 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-08-31T05:06:10.918 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2024-08-31T05:06:10.918 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2024-08-31T05:06:10.918 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2024-08-31T05:06:10.919 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2024-08-31T05:06:10.919 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2024-08-31T05:06:10.919 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2024-08-31T05:06:10.919 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T05:06:10.919 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-08-31T05:06:10.919 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2024-08-31T05:06:10.919 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T05:06:10.919 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2024-08-31T05:06:10.919 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T05:06:10.919 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T05:06:10.919 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T05:06:10.920 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-08-31T05:06:10.943 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-08-31T05:06:10.962 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-08-31T05:06:10.962 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-08-31T05:06:11.020 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-08-31T05:06:11.020 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-08-31T05:06:11.020 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-08-31T05:06:11.020 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-08-31T05:06:11.020 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-08-31T05:06:11.020 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-08-31T05:06:11.020 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T05:06:11.020 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-08-31T05:06:11.020 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-08-31T05:06:11.020 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T05:06:11.021 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-08-31T05:06:11.021 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T05:06:11.021 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T05:06:11.021 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T05:06:11.021 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-08-31T05:06:11.043 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-31T05:06:11.056 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-31T05:06:11.091 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-31T05:06:11.091 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2024-08-31T05:06:11.093 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-08-31T05:06:11.110 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-31T05:06:11.123 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-31T05:06:11.123 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2024-08-31T05:06:11.151 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-08-31T05:06:11.253 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-31T05:06:11.302 INFO:teuthology.run_tasks:Running task kernel... 2024-08-31T05:06:11.323 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-31T05:06:11.323 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-31T05:06:11.323 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T05:06:11.323 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T05:06:11.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:06:11.341 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-08-31T05:06:11.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:06:11.342 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-08-31T05:06:11.399 INFO:teuthology.orchestra.run.smithi067.stdout:5.14.0-503.el9.x86_64 2024-08-31T05:06:11.399 INFO:teuthology.task.kernel:Running kernel on smithi067: 5.14.0-503.el9.x86_64 2024-08-31T05:06:11.399 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum install -y kernel 2024-08-31T05:06:11.400 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-503.el9.x86_64 2024-08-31T05:06:11.400 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.14.0-503.el9.x86_64 2024-08-31T05:06:11.401 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2024-08-31T05:06:13.813 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-31T05:06:14.645 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-08-31T05:06:16.031 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-08-31T05:06:16.405 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-08-31T05:06:21.682 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.6 MB 00:01 2024-08-31T05:06:23.449 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 18 kB 00:00 2024-08-31T05:06:23.513 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 6.6 MB 00:03 2024-08-31T05:06:24.270 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 32 MB/s | 22 MB 00:00 2024-08-31T05:06:25.765 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 18 kB 00:00 2024-08-31T05:06:26.576 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 33 MB/s | 22 MB 00:00 2024-08-31T05:06:29.900 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-08-31T05:06:31.999 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-31T05:06:31.999 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-08-31T05:06:32.083 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:06:32.084 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2024-08-31T05:06:32.084 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:06:32.194 DEBUG:teuthology.orchestra.run.smithi067:> echo no | sudo yum reinstall kernel || true 2024-08-31T05:06:32.207 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-08-31T05:06:32.744 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 05:06:29 AM UTC. 2024-08-31T05:06:32.972 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:06:32.978 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:06:32.978 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2024-08-31T05:06:32.978 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:06:32.978 INFO:teuthology.orchestra.run.smithi067.stdout:Reinstalling: 2024-08-31T05:06:32.979 INFO:teuthology.orchestra.run.smithi067.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T05:06:32.979 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:06:32.979 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:06:32.979 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:06:32.979 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:06:32.979 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 1.9 M 2024-08-31T05:06:32.979 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 0 2024-08-31T05:06:32.979 INFO:teuthology.orchestra.run.smithi067.stderr:Operation aborted. 2024-08-31T05:06:33.047 INFO:teuthology.orchestra.run.smithi067.stdout:Is this ok [y/N]: 2024-08-31T05:06:33.047 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum reinstall -y kernel || true 2024-08-31T05:06:33.591 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:04 ago on Sat 31 Aug 2024 05:06:29 AM UTC. 2024-08-31T05:06:33.724 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:06:33.725 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:06:33.725 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2024-08-31T05:06:33.725 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:06:33.725 INFO:teuthology.orchestra.run.smithi067.stdout:Reinstalling: 2024-08-31T05:06:33.725 INFO:teuthology.orchestra.run.smithi067.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T05:06:33.725 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:06:33.725 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:06:33.725 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:06:33.725 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:06:33.726 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 1.9 M 2024-08-31T05:06:33.726 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 0 2024-08-31T05:06:33.726 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:06:34.246 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-31T05:06:34.247 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-08-31T05:06:34.330 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:06:34.331 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-08-31T05:06:34.331 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:06:34.449 DEBUG:teuthology.orchestra.run.smithi073:> echo no | sudo yum reinstall kernel || true 2024-08-31T05:06:34.752 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-5.14.0-503.el9.x86_64.rpm 1.9 MB/s | 1.9 MB 00:00 2024-08-31T05:06:34.753 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:06:34.753 INFO:teuthology.orchestra.run.smithi067.stdout:Total 1.8 MB/s | 1.9 MB 00:01 2024-08-31T05:06:34.788 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:06:34.987 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:02 ago on Sat 31 Aug 2024 05:06:32 AM UTC. 2024-08-31T05:06:35.035 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:06:35.035 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:06:35.067 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:06:35.068 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:06:35.126 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:06:35.135 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:06:35.135 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-08-31T05:06:35.136 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:06:35.136 INFO:teuthology.orchestra.run.smithi073.stdout:Reinstalling: 2024-08-31T05:06:35.136 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T05:06:35.136 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:06:35.136 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:06:35.136 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:06:35.136 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:06:35.136 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 1.9 M 2024-08-31T05:06:35.136 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 0 2024-08-31T05:06:35.136 INFO:teuthology.orchestra.run.smithi073.stderr:Operation aborted. 2024-08-31T05:06:35.197 INFO:teuthology.orchestra.run.smithi073.stdout:Is this ok [y/N]: 2024-08-31T05:06:35.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum reinstall -y kernel || true 2024-08-31T05:06:35.222 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:06:35.305 INFO:teuthology.orchestra.run.smithi067.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T05:06:35.305 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:06:35.740 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 05:06:32 AM UTC. 2024-08-31T05:06:35.866 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:06:35.867 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:06:35.867 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-08-31T05:06:35.867 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:06:35.867 INFO:teuthology.orchestra.run.smithi073.stdout:Reinstalling: 2024-08-31T05:06:35.867 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T05:06:35.867 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:06:35.867 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:06:35.867 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:06:35.867 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:06:35.867 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 1.9 M 2024-08-31T05:06:35.867 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 0 2024-08-31T05:06:35.868 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:06:36.020 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:06:36.020 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T05:06:36.309 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-503.el9.x86_64.rpm 4.7 MB/s | 1.9 MB 00:00 2024-08-31T05:06:36.309 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:06:36.309 INFO:teuthology.orchestra.run.smithi073.stdout:Total 4.2 MB/s | 1.9 MB 00:00 2024-08-31T05:06:36.338 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:06:36.573 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:06:36.573 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:06:36.604 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:06:36.604 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:06:36.759 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:06:36.759 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:06:36.759 INFO:teuthology.orchestra.run.smithi067.stdout:Reinstalled: 2024-08-31T05:06:36.759 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-5.14.0-503.el9.x86_64 2024-08-31T05:06:36.759 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:06:36.759 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:06:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:06:36.903 INFO:teuthology.orchestra.run.smithi073.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T05:06:36.903 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:06:36.960 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel | sort -rV | head -n 1 2024-08-31T05:06:37.019 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-5.14.0-503.el9.x86_64 2024-08-31T05:06:37.019 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-08-31T05:06:37.019 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-31T05:06:37.020 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-08-31T05:06:37.020 DEBUG:teuthology.orchestra.run.smithi067:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-31T05:06:37.056 INFO:teuthology.orchestra.run.smithi067.stdout:ttyS1 2024-08-31T05:06:37.077 DEBUG:teuthology.parallel:result is None 2024-08-31T05:06:37.736 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:06:37.736 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T05:06:38.487 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:06:38.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:06:38.487 INFO:teuthology.orchestra.run.smithi073.stdout:Reinstalled: 2024-08-31T05:06:38.487 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-5.14.0-503.el9.x86_64 2024-08-31T05:06:38.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:06:38.487 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:06:38.676 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-08-31T05:06:38.734 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-503.el9.x86_64 2024-08-31T05:06:38.735 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-08-31T05:06:38.735 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-31T05:06:38.735 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-08-31T05:06:38.735 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-31T05:06:38.764 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-08-31T05:06:38.789 DEBUG:teuthology.parallel:result is None 2024-08-31T05:06:38.789 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-31T05:06:38.795 INFO:teuthology.task.internal:Creating test directory... 2024-08-31T05:06:38.795 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T05:06:38.797 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T05:06:38.844 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-31T05:06:38.852 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-31T05:06:38.880 INFO:teuthology.task.internal:Creating archive directory... 2024-08-31T05:06:38.881 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T05:06:38.883 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T05:06:38.912 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-31T05:06:38.931 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-31T05:06:38.931 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T05:06:38.949 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T05:06:38.997 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:06:39.007 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:06:39.015 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:06:39.027 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:06:39.028 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-31T05:06:39.035 INFO:teuthology.task.internal:Configuring sudo... 2024-08-31T05:06:39.035 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T05:06:39.038 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T05:06:39.063 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-31T05:06:39.072 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-31T05:06:39.072 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T05:06:39.106 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T05:06:39.121 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:06:39.204 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:06:39.248 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:06:39.332 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:06:39.378 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:06:39.378 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T05:06:39.444 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:06:39.489 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:06:39.540 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:06:39.622 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:06:39.663 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-08-31T05:06:39.663 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T05:06:39.728 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2024-08-31T05:06:39.730 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-08-31T05:06:39.771 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T05:06:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T05:06:40.232 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-31T05:06:40.239 INFO:teuthology.task.internal:Starting timer... 2024-08-31T05:06:40.240 INFO:teuthology.run_tasks:Running task pcp... 2024-08-31T05:06:40.268 INFO:teuthology.run_tasks:Running task selinux... 2024-08-31T05:06:40.309 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-08-31T05:06:40.309 DEBUG:teuthology.orchestra.run.smithi067:> sudo service auditd rotate 2024-08-31T05:06:40.365 INFO:teuthology.orchestra.run.smithi067.stdout:Rotating logs: 2024-08-31T05:06:40.367 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-08-31T05:06:40.420 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-08-31T05:06:40.422 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-31T05:06:40.422 DEBUG:teuthology.orchestra.run.smithi067:> /usr/sbin/getenforce 2024-08-31T05:06:40.448 INFO:teuthology.orchestra.run.smithi067.stdout:Permissive 2024-08-31T05:06:40.448 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-08-31T05:06:40.465 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-08-31T05:06:40.465 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi067.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi073.front.sepia.ceph.com': 'permissive'} 2024-08-31T05:06:40.465 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T05:06:40.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:06:40.514 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T05:06:40.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:06:40.539 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-31T05:06:40.539 DEBUG:teuthology.orchestra.run.smithi067:> sudo /usr/sbin/setenforce permissive 2024-08-31T05:06:40.593 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-08-31T05:06:40.624 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-31T05:06:40.633 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-31T05:06:40.648 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-31T05:06:40.649 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi067.front.sepia.ceph.com,smithi073.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-31T05:08:24.098 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi067.front.sepia.ceph.com'), Remote(name='ubuntu@smithi073.front.sepia.ceph.com')] 2024-08-31T05:08:24.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-08-31T05:08:24.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:08:24.178 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-08-31T05:08:24.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-08-31T05:08:24.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-08-31T05:08:24.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:08:24.334 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-08-31T05:08:24.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-08-31T05:08:24.408 INFO:teuthology.run_tasks:Running task clock... 2024-08-31T05:08:24.418 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-31T05:08:24.418 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T05:08:24.419 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T05:08:24.421 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T05:08:24.421 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T05:08:24.448 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T05:08:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T05:08:24.478 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T05:08:24.486 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: ntpd: command not found 2024-08-31T05:08:24.492 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T05:08:24.497 INFO:teuthology.orchestra.run.smithi067.stdout:506 Cannot talk to daemon 2024-08-31T05:08:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T05:08:24.516 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-08-31T05:08:24.525 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T05:08:24.527 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-08-31T05:08:24.542 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T05:08:24.556 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T05:08:24.590 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-08-31T05:08:24.594 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T05:08:24.594 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-08-31T05:08:24.594 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:08:24.594 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:08:24.594 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:08:24.594 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:08:24.612 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-08-31T05:08:24.615 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T05:08:24.616 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-08-31T05:08:24.616 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:08:24.616 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:08:24.616 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:08:24.616 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:08:24.617 INFO:teuthology.run_tasks:Running task install... 2024-08-31T05:08:24.625 DEBUG:teuthology.task.install:project ceph 2024-08-31T05:08:24.625 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}} 2024-08-31T05:08:24.625 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'} 2024-08-31T05:08:24.625 INFO:teuthology.task.install:Using flavor: default 2024-08-31T05:08:24.630 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-31T05:08:24.631 INFO:teuthology.task.install:extra packages: [] 2024-08-31T05:08:24.631 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T05:08:24.631 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T05:08:24.631 INFO:teuthology.packaging:ref: None 2024-08-31T05:08:24.631 INFO:teuthology.packaging:tag: None 2024-08-31T05:08:24.632 INFO:teuthology.packaging:branch: squid 2024-08-31T05:08:24.632 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:08:24.632 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-08-31T05:08:24.634 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T05:08:24.634 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T05:08:24.634 INFO:teuthology.packaging:ref: None 2024-08-31T05:08:24.634 INFO:teuthology.packaging:tag: None 2024-08-31T05:08:24.634 INFO:teuthology.packaging:branch: squid 2024-08-31T05:08:24.635 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:08:24.635 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-08-31T05:08:24.854 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/244a32d3583bb0aa259286ff61157888a54a3ca5/centos/9/flavors/default/ 2024-08-31T05:08:24.854 INFO:teuthology.task.install.rpm:Package version is 19.1.1-242.g244a32d3 2024-08-31T05:08:24.867 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/244a32d3583bb0aa259286ff61157888a54a3ca5/centos/9/flavors/default/ 2024-08-31T05:08:24.868 INFO:teuthology.task.install.rpm:Package version is 19.1.1-242.g244a32d3 2024-08-31T05:08:25.002 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/244a32d3583bb0aa259286ff61157888a54a3ca5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/244a32d3583bb0aa259286ff61157888a54a3ca5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/244a32d3583bb0aa259286ff61157888a54a3ca5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T05:08:25.002 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-08-31T05:08:25.003 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T05:08:25.014 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/244a32d3583bb0aa259286ff61157888a54a3ca5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/244a32d3583bb0aa259286ff61157888a54a3ca5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/244a32d3583bb0aa259286ff61157888a54a3ca5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T05:08:25.014 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:08:25.015 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T05:08:25.028 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-08-31T05:08:25.028 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T05:08:25.028 INFO:teuthology.packaging:ref: None 2024-08-31T05:08:25.028 INFO:teuthology.packaging:tag: None 2024-08-31T05:08:25.028 INFO:teuthology.packaging:branch: squid 2024-08-31T05:08:25.028 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:08:25.028 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T05:08:25.040 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-08-31T05:08:25.041 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T05:08:25.041 INFO:teuthology.packaging:ref: None 2024-08-31T05:08:25.041 INFO:teuthology.packaging:tag: None 2024-08-31T05:08:25.041 INFO:teuthology.packaging:branch: squid 2024-08-31T05:08:25.041 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:08:25.041 DEBUG:teuthology.orchestra.run.smithi067:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T05:08:25.093 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T05:08:25.105 DEBUG:teuthology.orchestra.run.smithi067:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T05:08:25.168 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T05:08:25.180 DEBUG:teuthology.orchestra.run.smithi067:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T05:08:25.232 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-08-31T05:08:25.234 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-08-31T05:08:25.243 INFO:teuthology.orchestra.run.smithi067.stdout:check_obsoletes = 1 2024-08-31T05:08:25.244 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum clean all 2024-08-31T05:08:25.459 INFO:teuthology.orchestra.run.smithi073.stdout:45 files removed 2024-08-31T05:08:25.474 INFO:teuthology.orchestra.run.smithi067.stdout:45 files removed 2024-08-31T05:08:25.486 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw 2024-08-31T05:08:25.501 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-radosgw 2024-08-31T05:08:26.026 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 313 kB/s | 83 kB 00:00 2024-08-31T05:08:26.045 INFO:teuthology.orchestra.run.smithi067.stdout:ceph packages for x86_64 320 kB/s | 83 kB 00:00 2024-08-31T05:08:26.343 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 43 kB/s | 12 kB 00:00 2024-08-31T05:08:26.388 INFO:teuthology.orchestra.run.smithi067.stdout:ceph noarch packages 39 kB/s | 12 kB 00:00 2024-08-31T05:08:26.747 INFO:teuthology.orchestra.run.smithi067.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2024-08-31T05:08:26.811 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-08-31T05:08:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-08-31T05:08:27.277 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-08-31T05:08:29.340 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-08-31T05:08:29.737 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-08-31T05:08:34.083 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 6.6 MB 00:00 2024-08-31T05:08:35.592 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 18 kB 00:00 2024-08-31T05:08:36.404 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 33 MB/s | 22 MB 00:00 2024-08-31T05:08:37.087 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 1.9 MB/s | 6.6 MB 00:03 2024-08-31T05:08:38.830 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 18 kB 00:00 2024-08-31T05:08:39.634 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 33 MB/s | 22 MB 00:00 2024-08-31T05:08:42.002 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-08-31T05:08:44.449 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:08:44.451 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:08:44.451 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-08-31T05:08:44.451 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:08:44.451 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:08:44.451 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw x86_64 2:19.1.1-242.g244a32d3.el9 ceph 11 M 2024-08-31T05:08:44.451 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2024-08-31T05:08:44.452 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 x86_64 2:19.1.1-242.g244a32d3.el9 ceph 3.4 M 2024-08-31T05:08:44.452 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 x86_64 2:19.1.1-242.g244a32d3.el9 ceph 3.2 M 2024-08-31T05:08:44.452 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-08-31T05:08:44.452 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T05:08:44.452 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base x86_64 2:19.1.1-242.g244a32d3.el9 ceph 5.4 M 2024-08-31T05:08:44.452 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common x86_64 2:19.1.1-242.g244a32d3.el9 ceph 21 M 2024-08-31T05:08:44.452 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux x86_64 2:19.1.1-242.g244a32d3.el9 ceph 25 k 2024-08-31T05:08:44.452 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T05:08:44.452 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T05:08:44.452 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T05:08:44.452 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 x86_64 2:19.1.1-242.g244a32d3.el9 ceph 753 k 2024-08-31T05:08:44.453 INFO:teuthology.orchestra.run.smithi067.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T05:08:44.453 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T05:08:44.453 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T05:08:44.453 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 x86_64 2:19.1.1-242.g244a32d3.el9 ceph 506 k 2024-08-31T05:08:44.453 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T05:08:44.453 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2 x86_64 2:19.1.1-242.g244a32d3.el9 ceph 5.3 M 2024-08-31T05:08:44.453 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T05:08:44.453 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T05:08:44.453 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T05:08:44.453 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse x86_64 2:19.1.1-242.g244a32d3.el9 ceph 45 k 2024-08-31T05:08:44.453 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common x86_64 2:19.1.1-242.g244a32d3.el9 ceph 136 k 2024-08-31T05:08:44.454 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs x86_64 2:19.1.1-242.g244a32d3.el9 ceph 162 k 2024-08-31T05:08:44.454 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T05:08:44.454 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados x86_64 2:19.1.1-242.g244a32d3.el9 ceph 320 k 2024-08-31T05:08:44.454 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd x86_64 2:19.1.1-242.g244a32d3.el9 ceph 301 k 2024-08-31T05:08:44.454 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw x86_64 2:19.1.1-242.g244a32d3.el9 ceph 99 k 2024-08-31T05:08:44.454 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T05:08:44.454 INFO:teuthology.orchestra.run.smithi067.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T05:08:44.454 INFO:teuthology.orchestra.run.smithi067.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T05:08:44.454 INFO:teuthology.orchestra.run.smithi067.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T05:08:44.454 INFO:teuthology.orchestra.run.smithi067.stdout:Installing weak dependencies: 2024-08-31T05:08:44.454 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T05:08:44.454 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:08:44.455 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:08:44.455 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:08:44.455 INFO:teuthology.orchestra.run.smithi067.stdout:Install 30 Packages 2024-08-31T05:08:44.455 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 2 Packages 2024-08-31T05:08:44.455 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:08:44.455 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 60 M 2024-08-31T05:08:44.455 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:08:45.031 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-31T05:08:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:(1/32): ceph-base-19.1.1-242.g244a32d3.el9.x86_ 2.2 MB/s | 5.4 MB 00:02 2024-08-31T05:08:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:(2/32): ceph-selinux-19.1.1-242.g244a32d3.el9.x 252 kB/s | 25 kB 00:00 2024-08-31T05:08:47.324 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:08:47.326 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:08:47.326 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-08-31T05:08:47.326 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:08:47.327 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:08:47.327 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:19.1.1-242.g244a32d3.el9 ceph 11 M 2024-08-31T05:08:47.327 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-08-31T05:08:47.327 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:19.1.1-242.g244a32d3.el9 ceph 3.4 M 2024-08-31T05:08:47.327 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:19.1.1-242.g244a32d3.el9 ceph 3.2 M 2024-08-31T05:08:47.327 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-08-31T05:08:47.327 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T05:08:47.327 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:19.1.1-242.g244a32d3.el9 ceph 5.4 M 2024-08-31T05:08:47.327 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:19.1.1-242.g244a32d3.el9 ceph 21 M 2024-08-31T05:08:47.327 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:19.1.1-242.g244a32d3.el9 ceph 25 k 2024-08-31T05:08:47.327 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T05:08:47.327 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T05:08:47.327 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T05:08:47.328 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:19.1.1-242.g244a32d3.el9 ceph 753 k 2024-08-31T05:08:47.328 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T05:08:47.328 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T05:08:47.328 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T05:08:47.328 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:19.1.1-242.g244a32d3.el9 ceph 506 k 2024-08-31T05:08:47.328 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T05:08:47.328 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:19.1.1-242.g244a32d3.el9 ceph 5.3 M 2024-08-31T05:08:47.328 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T05:08:47.328 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T05:08:47.328 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T05:08:47.328 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:19.1.1-242.g244a32d3.el9 ceph 45 k 2024-08-31T05:08:47.329 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:19.1.1-242.g244a32d3.el9 ceph 136 k 2024-08-31T05:08:47.329 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:19.1.1-242.g244a32d3.el9 ceph 162 k 2024-08-31T05:08:47.329 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T05:08:47.329 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:19.1.1-242.g244a32d3.el9 ceph 320 k 2024-08-31T05:08:47.329 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:19.1.1-242.g244a32d3.el9 ceph 301 k 2024-08-31T05:08:47.329 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:19.1.1-242.g244a32d3.el9 ceph 99 k 2024-08-31T05:08:47.329 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T05:08:47.329 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T05:08:47.329 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T05:08:47.329 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T05:08:47.329 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2024-08-31T05:08:47.329 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T05:08:47.329 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:08:47.329 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:08:47.330 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:08:47.330 INFO:teuthology.orchestra.run.smithi073.stdout:Install 30 Packages 2024-08-31T05:08:47.330 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 2 Packages 2024-08-31T05:08:47.330 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:08:47.330 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 60 M 2024-08-31T05:08:47.330 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:08:47.620 INFO:teuthology.orchestra.run.smithi067.stdout:(3/32): libcephfs2-19.1.1-242.g244a32d3.el9.x86 2.2 MB/s | 753 kB 00:00 2024-08-31T05:08:47.879 INFO:teuthology.orchestra.run.smithi067.stdout:(4/32): libradosstriper1-19.1.1-242.g244a32d3.e 1.9 MB/s | 506 kB 00:00 2024-08-31T05:08:48.171 INFO:teuthology.orchestra.run.smithi067.stdout:(5/32): ceph-radosgw-19.1.1-242.g244a32d3.el9.x 3.1 MB/s | 11 MB 00:03 2024-08-31T05:08:48.279 INFO:teuthology.orchestra.run.smithi067.stdout:(6/32): python3-ceph-argparse-19.1.1-242.g244a3 417 kB/s | 45 kB 00:00 2024-08-31T05:08:48.371 INFO:teuthology.orchestra.run.smithi067.stdout:(7/32): python3-ceph-common-19.1.1-242.g244a32d 1.4 MB/s | 136 kB 00:00 2024-08-31T05:08:49.105 INFO:teuthology.orchestra.run.smithi067.stdout:(8/32): python3-cephfs-19.1.1-242.g244a32d3.el9 221 kB/s | 162 kB 00:00 2024-08-31T05:08:49.550 INFO:teuthology.orchestra.run.smithi073.stdout:(1/32): ceph-common-19.1.1-242.g244a32d3.el9.x8 11 MB/s | 21 MB 00:02 2024-08-31T05:08:49.580 INFO:teuthology.orchestra.run.smithi067.stdout:(9/32): python3-rados-19.1.1-242.g244a32d3.el9. 675 kB/s | 320 kB 00:00 2024-08-31T05:08:49.624 INFO:teuthology.orchestra.run.smithi073.stdout:(2/32): ceph-selinux-19.1.1-242.g244a32d3.el9.x 337 kB/s | 25 kB 00:00 2024-08-31T05:08:49.725 INFO:teuthology.orchestra.run.smithi073.stdout:(3/32): libcephfs2-19.1.1-242.g244a32d3.el9.x86 7.3 MB/s | 753 kB 00:00 2024-08-31T05:08:49.809 INFO:teuthology.orchestra.run.smithi073.stdout:(4/32): libradosstriper1-19.1.1-242.g244a32d3.e 5.9 MB/s | 506 kB 00:00 2024-08-31T05:08:49.864 INFO:teuthology.orchestra.run.smithi067.stdout:(10/32): python3-rbd-19.1.1-242.g244a32d3.el9.x 1.0 MB/s | 301 kB 00:00 2024-08-31T05:08:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:(11/32): python3-rgw-19.1.1-242.g244a32d3.el9.x 568 kB/s | 99 kB 00:00 2024-08-31T05:08:50.164 INFO:teuthology.orchestra.run.smithi067.stdout:(12/32): boost-program-options-1.75.0-8.el9.x86 855 kB/s | 107 kB 00:00 2024-08-31T05:08:50.167 INFO:teuthology.orchestra.run.smithi073.stdout:(5/32): librgw2-19.1.1-242.g244a32d3.el9.x86_64 15 MB/s | 5.3 MB 00:00 2024-08-31T05:08:50.222 INFO:teuthology.orchestra.run.smithi067.stdout:(13/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-08-31T05:08:50.264 INFO:teuthology.orchestra.run.smithi067.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-08-31T05:08:50.275 INFO:teuthology.orchestra.run.smithi073.stdout:(6/32): python3-ceph-argparse-19.1.1-242.g244a3 417 kB/s | 45 kB 00:00 2024-08-31T05:08:50.332 INFO:teuthology.orchestra.run.smithi067.stdout:(15/32): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-08-31T05:08:50.351 INFO:teuthology.orchestra.run.smithi073.stdout:(7/32): ceph-base-19.1.1-242.g244a32d3.el9.x86_ 1.9 MB/s | 5.4 MB 00:02 2024-08-31T05:08:50.376 INFO:teuthology.orchestra.run.smithi073.stdout:(8/32): python3-ceph-common-19.1.1-242.g244a32d 1.3 MB/s | 136 kB 00:00 2024-08-31T05:08:50.382 INFO:teuthology.orchestra.run.smithi067.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-08-31T05:08:50.435 INFO:teuthology.orchestra.run.smithi073.stdout:(9/32): python3-cephfs-19.1.1-242.g244a32d3.el9 1.9 MB/s | 162 kB 00:00 2024-08-31T05:08:50.449 INFO:teuthology.orchestra.run.smithi067.stdout:(17/32): librgw2-19.1.1-242.g244a32d3.el9.x86_6 2.1 MB/s | 5.3 MB 00:02 2024-08-31T05:08:50.460 INFO:teuthology.orchestra.run.smithi073.stdout:(10/32): python3-rados-19.1.1-242.g244a32d3.el9 3.7 MB/s | 320 kB 00:00 2024-08-31T05:08:50.474 INFO:teuthology.orchestra.run.smithi067.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 460 kB/s | 42 kB 00:00 2024-08-31T05:08:50.527 INFO:teuthology.orchestra.run.smithi073.stdout:(11/32): python3-rgw-19.1.1-242.g244a32d3.el9.x 1.5 MB/s | 99 kB 00:00 2024-08-31T05:08:50.561 INFO:teuthology.orchestra.run.smithi073.stdout:(12/32): python3-rbd-19.1.1-242.g244a32d3.el9.x 2.3 MB/s | 301 kB 00:00 2024-08-31T05:08:50.666 INFO:teuthology.orchestra.run.smithi067.stdout:(19/32): ceph-common-19.1.1-242.g244a32d3.el9.x 3.6 MB/s | 21 MB 00:05 2024-08-31T05:08:50.691 INFO:teuthology.orchestra.run.smithi067.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 165 kB/s | 36 kB 00:00 2024-08-31T05:08:50.694 INFO:teuthology.orchestra.run.smithi073.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 640 kB/s | 107 kB 00:00 2024-08-31T05:08:50.728 INFO:teuthology.orchestra.run.smithi073.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 960 kB/s | 160 kB 00:00 2024-08-31T05:08:50.741 INFO:teuthology.orchestra.run.smithi067.stdout:(21/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 6.1 MB/s | 309 kB 00:00 2024-08-31T05:08:50.753 INFO:teuthology.orchestra.run.smithi073.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-08-31T05:08:50.767 INFO:teuthology.orchestra.run.smithi067.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 695 kB/s | 221 kB 00:00 2024-08-31T05:08:50.792 INFO:teuthology.orchestra.run.smithi067.stdout:(23/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-08-31T05:08:50.835 INFO:teuthology.orchestra.run.smithi067.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 627 kB/s | 26 kB 00:00 2024-08-31T05:08:50.859 INFO:teuthology.orchestra.run.smithi067.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-08-31T05:08:50.862 INFO:teuthology.orchestra.run.smithi073.stdout:(16/32): ceph-radosgw-19.1.1-242.g244a32d3.el9. 3.2 MB/s | 11 MB 00:03 2024-08-31T05:08:50.885 INFO:teuthology.orchestra.run.smithi067.stdout:(26/32): liboath-2.6.7-2.el9.x86_64.rpm 528 kB/s | 49 kB 00:00 2024-08-31T05:08:50.912 INFO:teuthology.orchestra.run.smithi073.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-08-31T05:08:50.928 INFO:teuthology.orchestra.run.smithi067.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-08-31T05:08:50.946 INFO:teuthology.orchestra.run.smithi073.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-08-31T05:08:50.971 INFO:teuthology.orchestra.run.smithi073.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 388 kB/s | 42 kB 00:00 2024-08-31T05:08:50.985 INFO:teuthology.orchestra.run.smithi067.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-08-31T05:08:50.997 INFO:teuthology.orchestra.run.smithi073.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 714 kB/s | 36 kB 00:00 2024-08-31T05:08:51.022 INFO:teuthology.orchestra.run.smithi073.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-08-31T05:08:51.047 INFO:teuthology.orchestra.run.smithi073.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-08-31T05:08:51.061 INFO:teuthology.orchestra.run.smithi067.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-08-31T05:08:51.106 INFO:teuthology.orchestra.run.smithi073.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.8 MB/s | 309 kB 00:00 2024-08-31T05:08:51.131 INFO:teuthology.orchestra.run.smithi073.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 372 kB/s | 26 kB 00:00 2024-08-31T05:08:51.136 INFO:teuthology.orchestra.run.smithi067.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-08-31T05:08:51.157 INFO:teuthology.orchestra.run.smithi073.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-08-31T05:08:51.182 INFO:teuthology.orchestra.run.smithi073.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-08-31T05:08:51.224 INFO:teuthology.orchestra.run.smithi073.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-08-31T05:08:51.257 INFO:teuthology.orchestra.run.smithi073.stdout:(28/32): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-08-31T05:08:51.333 INFO:teuthology.orchestra.run.smithi073.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-31T05:08:51.408 INFO:teuthology.orchestra.run.smithi073.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-08-31T05:08:51.700 INFO:teuthology.orchestra.run.smithi073.stdout:(31/32): librbd1-19.1.1-242.g244a32d3.el9.x86_6 8.6 MB/s | 3.2 MB 00:00 2024-08-31T05:08:51.786 INFO:teuthology.orchestra.run.smithi067.stdout:(31/32): librbd1-19.1.1-242.g244a32d3.el9.x86_6 4.3 MB/s | 3.2 MB 00:00 2024-08-31T05:08:52.228 INFO:teuthology.orchestra.run.smithi067.stdout:(32/32): librados2-19.1.1-242.g244a32d3.el9.x86 2.8 MB/s | 3.4 MB 00:01 2024-08-31T05:08:52.234 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:08:52.234 INFO:teuthology.orchestra.run.smithi067.stdout:Total 7.8 MB/s | 60 MB 00:07 2024-08-31T05:08:52.343 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:08:52.350 INFO:teuthology.orchestra.run.smithi073.stdout:(32/32): librados2-19.1.1-242.g244a32d3.el9.x86 3.1 MB/s | 3.4 MB 00:01 2024-08-31T05:08:52.355 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:08:52.355 INFO:teuthology.orchestra.run.smithi073.stdout:Total 12 MB/s | 60 MB 00:05 2024-08-31T05:08:52.382 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:08:52.383 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:08:52.452 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:08:52.487 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:08:52.487 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:08:52.874 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:08:52.874 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:08:52.953 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:08:52.954 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:08:54.354 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:08:54.412 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:08:54.438 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-08-31T05:08:54.466 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-08-31T05:08:54.491 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-08-31T05:08:54.492 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-08-31T05:08:54.514 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-08-31T05:08:54.530 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-08-31T05:08:54.536 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-08-31T05:08:54.555 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-08-31T05:08:54.578 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-08-31T05:08:54.601 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-08-31T05:08:54.868 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-08-31T05:08:54.886 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-08-31T05:08:54.920 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-08-31T05:08:54.942 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-08-31T05:08:55.272 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-08-31T05:08:55.340 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-08-31T05:08:55.391 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:19.1.1-242.g244a32d3.el9.x86_64 7/34 2024-08-31T05:08:55.393 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librados2-2:19.1.1-242.g244a32d3.el9.x86_64 7/34 2024-08-31T05:08:55.482 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:19.1.1-242.g244a32d3.el9.x86_64 7/34 2024-08-31T05:08:55.494 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:19.1.1-242.g244a32d3.el9.x86_64 7/34 2024-08-31T05:08:55.570 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:19.1.1-242.g244a32d3.el9.x86_64 8/34 2024-08-31T05:08:55.584 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rados-2:19.1.1-242.g244a32d3.el9.x86_64 8/34 2024-08-31T05:08:55.592 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:19.1.1-242.g244a32d3.el9.x86_64 9/34 2024-08-31T05:08:55.611 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs2-2:19.1.1-242.g244a32d3.el9.x86_64 9/34 2024-08-31T05:08:55.655 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:19.1.1-242.g244a32d3.el9.x86_64 9/34 2024-08-31T05:08:55.674 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs2-2:19.1.1-242.g244a32d3.el9.x86_64 9/34 2024-08-31T05:08:55.684 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-08-31T05:08:55.712 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-08-31T05:08:55.727 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:19.1.1-242.g244a32d3.el9.x 11/34 2024-08-31T05:08:55.756 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-argparse-2:19.1.1-242.g244a32d3.el9.x 11/34 2024-08-31T05:08:55.796 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:19.1.1-242.g244a32d3.el9.x86_64 12/34 2024-08-31T05:08:55.820 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:19.1.1-242.g244a32d3.el9.x86_64 13/34 2024-08-31T05:08:55.825 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cephfs-2:19.1.1-242.g244a32d3.el9.x86_64 12/34 2024-08-31T05:08:55.847 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libradosstriper1-2:19.1.1-242.g244a32d3.el9.x86_64 13/34 2024-08-31T05:08:55.876 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:19.1.1-242.g244a32d3.el9.x86_64 13/34 2024-08-31T05:08:55.909 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-08-31T05:08:55.911 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libradosstriper1-2:19.1.1-242.g244a32d3.el9.x86_64 13/34 2024-08-31T05:08:55.945 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-08-31T05:08:56.022 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-08-31T05:08:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-08-31T05:08:56.057 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-08-31T05:08:56.093 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-08-31T05:08:56.096 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-08-31T05:08:56.127 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-08-31T05:08:56.136 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-08-31T05:08:56.164 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-08-31T05:08:56.170 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-08-31T05:08:56.208 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-08-31T05:08:56.209 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-08-31T05:08:56.240 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-08-31T05:08:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-08-31T05:08:56.566 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-08-31T05:08:56.576 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:19.1.1-242.g244a32d3.el9.x86_64 22/34 2024-08-31T05:08:56.611 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librbd1-2:19.1.1-242.g244a32d3.el9.x86_64 22/34 2024-08-31T05:08:56.672 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:19.1.1-242.g244a32d3.el9.x86_64 22/34 2024-08-31T05:08:56.685 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:19.1.1-242.g244a32d3.el9.x86_64 22/34 2024-08-31T05:08:56.703 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:19.1.1-242.g244a32d3.el9.x86_64 23/34 2024-08-31T05:08:56.716 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rbd-2:19.1.1-242.g244a32d3.el9.x86_64 23/34 2024-08-31T05:08:56.739 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-08-31T05:08:56.760 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-08-31T05:08:57.239 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-08-31T05:08:57.268 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:19.1.1-242.g244a32d3.el9.x86_64 26/34 2024-08-31T05:08:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-08-31T05:08:57.334 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:19.1.1-242.g244a32d3.el9.x86_64 26/34 2024-08-31T05:08:57.339 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librgw2-2:19.1.1-242.g244a32d3.el9.x86_64 26/34 2024-08-31T05:08:57.412 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:19.1.1-242.g244a32d3.el9.x86_64 27/34 2024-08-31T05:08:57.418 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librgw2-2:19.1.1-242.g244a32d3.el9.x86_64 26/34 2024-08-31T05:08:57.441 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:19.1.1-242.g244a32d3.el9.x86 28/34 2024-08-31T05:08:57.498 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rgw-2:19.1.1-242.g244a32d3.el9.x86_64 27/34 2024-08-31T05:08:57.533 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-common-2:19.1.1-242.g244a32d3.el9.x86 28/34 2024-08-31T05:08:59.762 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.1.1-242.g244a32d3.el9.x86_64 29/34 2024-08-31T05:08:59.804 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:19.1.1-242.g244a32d3.el9.x86_64 29/34 2024-08-31T05:08:59.914 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:19.1.1-242.g244a32d3.el9.x86_64 29/34 2024-08-31T05:09:00.039 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-common-2:19.1.1-242.g244a32d3.el9.x86_64 29/34 2024-08-31T05:09:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.1.1-242.g244a32d3.el9.x86_64 29/34 2024-08-31T05:09:00.383 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:19.1.1-242.g244a32d3.el9.x86_64 30/34 2024-08-31T05:09:00.511 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:19.1.1-242.g244a32d3.el9.x86_64 30/34 2024-08-31T05:09:00.511 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T05:09:00.511 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T05:09:00.512 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:00.614 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:19.1.1-242.g244a32d3.el9.x86_64 29/34 2024-08-31T05:09:00.659 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-base-2:19.1.1-242.g244a32d3.el9.x86_64 30/34 2024-08-31T05:09:00.726 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:19.1.1-242.g244a32d3.el9.x86_64 31/34 2024-08-31T05:09:00.735 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-base-2:19.1.1-242.g244a32d3.el9.x86_64 30/34 2024-08-31T05:09:00.735 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T05:09:00.735 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T05:09:00.735 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:00.777 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-selinux-2:19.1.1-242.g244a32d3.el9.x86_64 31/34 2024-08-31T05:09:10.456 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:19.1.1-242.g244a32d3.el9.x86_64 31/34 2024-08-31T05:09:10.456 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-08-31T05:09:10.456 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-08-31T05:09:10.456 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-08-31T05:09:10.456 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-08-31T05:09:10.457 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-08-31T05:09:10.457 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-08-31T05:09:10.457 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-08-31T05:09:10.457 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:11.294 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-selinux-2:19.1.1-242.g244a32d3.el9.x86_64 31/34 2024-08-31T05:09:11.294 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /sys 2024-08-31T05:09:11.294 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /proc 2024-08-31T05:09:11.294 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /mnt 2024-08-31T05:09:11.295 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /var/tmp 2024-08-31T05:09:11.295 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /home 2024-08-31T05:09:11.295 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /root 2024-08-31T05:09:11.295 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /tmp 2024-08-31T05:09:11.295 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:11.436 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:19.1.1-242.g244a32d3.el9.x86_64 32/34 2024-08-31T05:09:11.461 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-242.g244a32d3.el9.x86_64 32/34 2024-08-31T05:09:11.461 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:09:11.461 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T05:09:11.461 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:09:11.461 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:09:11.461 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:11.463 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-08-31T05:09:11.530 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-08-31T05:09:11.530 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-08-31T05:09:12.295 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-radosgw-2:19.1.1-242.g244a32d3.el9.x86_64 32/34 2024-08-31T05:09:12.321 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-242.g244a32d3.el9.x86_64 32/34 2024-08-31T05:09:12.321 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:09:12.321 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T05:09:12.321 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:09:12.321 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:09:12.321 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:12.323 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-08-31T05:09:12.415 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-08-31T05:09:12.415 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-08-31T05:09:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-08-31T05:09:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:19.1.1-242.g244a32d3.el9.x86_64 1/34 2024-08-31T05:09:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:19.1.1-242.g244a32d3.el9.x86_64 2/34 2024-08-31T05:09:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:19.1.1-242.g244a32d3.el9.x86_64 3/34 2024-08-31T05:09:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:19.1.1-242.g244a32d3.el9.x86_64 4/34 2024-08-31T05:09:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:19.1.1-242.g244a32d3.el9.x86_64 5/34 2024-08-31T05:09:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:19.1.1-242.g244a32d3.el9.x86_64 6/34 2024-08-31T05:09:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:19.1.1-242.g244a32d3.el9.x86_64 7/34 2024-08-31T05:09:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:19.1.1-242.g244a32d3.el9.x 8/34 2024-08-31T05:09:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:19.1.1-242.g244a32d3.el9.x86 9/34 2024-08-31T05:09:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:19.1.1-242.g244a32d3.el9.x86_64 10/34 2024-08-31T05:09:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:19.1.1-242.g244a32d3.el9.x86_64 11/34 2024-08-31T05:09:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:19.1.1-242.g244a32d3.el9.x86_64 12/34 2024-08-31T05:09:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:19.1.1-242.g244a32d3.el9.x86_64 13/34 2024-08-31T05:09:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-08-31T05:09:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-08-31T05:09:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-08-31T05:09:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-08-31T05:09:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-08-31T05:09:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-08-31T05:09:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-08-31T05:09:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-08-31T05:09:12.748 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-08-31T05:09:12.748 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-08-31T05:09:12.748 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-08-31T05:09:12.748 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-08-31T05:09:12.748 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-08-31T05:09:12.748 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-08-31T05:09:12.748 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-08-31T05:09:12.748 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-08-31T05:09:12.749 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-08-31T05:09:12.749 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:19.1.1-242.g244a32d3.el9.x86_64 31/34 2024-08-31T05:09:12.749 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-08-31T05:09:12.749 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:19.1.1-242.g244a32d3.el9.x86_64 33/34 2024-08-31T05:09:13.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-08-31T05:09:13.519 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:13.519 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-08-31T05:09:13.519 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.519 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.519 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:09:13.519 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T05:09:13.519 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.519 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.519 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.519 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.519 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T05:09:13.519 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T05:09:13.520 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T05:09:13.520 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.520 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T05:09:13.520 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T05:09:13.520 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T05:09:13.520 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.520 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T05:09:13.520 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.520 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T05:09:13.520 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T05:09:13.520 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T05:09:13.520 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.521 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.521 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.521 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T05:09:13.521 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.521 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.521 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:13.521 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T05:09:13.521 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T05:09:13.521 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T05:09:13.521 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T05:09:13.521 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T05:09:13.521 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:13.521 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:09:13.704 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-08-31T05:09:13.704 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-base-2:19.1.1-242.g244a32d3.el9.x86_64 1/34 2024-08-31T05:09:13.704 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-common-2:19.1.1-242.g244a32d3.el9.x86_64 2/34 2024-08-31T05:09:13.704 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-radosgw-2:19.1.1-242.g244a32d3.el9.x86_64 3/34 2024-08-31T05:09:13.705 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-selinux-2:19.1.1-242.g244a32d3.el9.x86_64 4/34 2024-08-31T05:09:13.705 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs2-2:19.1.1-242.g244a32d3.el9.x86_64 5/34 2024-08-31T05:09:13.705 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libradosstriper1-2:19.1.1-242.g244a32d3.el9.x86_64 6/34 2024-08-31T05:09:13.705 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librgw2-2:19.1.1-242.g244a32d3.el9.x86_64 7/34 2024-08-31T05:09:13.705 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-argparse-2:19.1.1-242.g244a32d3.el9.x 8/34 2024-08-31T05:09:13.705 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-common-2:19.1.1-242.g244a32d3.el9.x86 9/34 2024-08-31T05:09:13.705 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cephfs-2:19.1.1-242.g244a32d3.el9.x86_64 10/34 2024-08-31T05:09:13.705 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rados-2:19.1.1-242.g244a32d3.el9.x86_64 11/34 2024-08-31T05:09:13.705 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rbd-2:19.1.1-242.g244a32d3.el9.x86_64 12/34 2024-08-31T05:09:13.705 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rgw-2:19.1.1-242.g244a32d3.el9.x86_64 13/34 2024-08-31T05:09:13.705 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-08-31T05:09:13.705 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-08-31T05:09:13.705 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-08-31T05:09:13.706 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-08-31T05:09:13.706 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-08-31T05:09:13.706 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-08-31T05:09:13.706 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-08-31T05:09:13.706 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-08-31T05:09:13.706 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-08-31T05:09:13.706 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-08-31T05:09:13.706 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-08-31T05:09:13.706 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-08-31T05:09:13.706 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-08-31T05:09:13.706 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-08-31T05:09:13.707 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-08-31T05:09:13.707 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-08-31T05:09:13.707 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-08-31T05:09:13.707 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:19.1.1-242.g244a32d3.el9.x86_64 31/34 2024-08-31T05:09:13.707 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-08-31T05:09:13.707 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:19.1.1-242.g244a32d3.el9.x86_64 33/34 2024-08-31T05:09:13.814 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-test 2024-08-31T05:09:14.389 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:30 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:09:14.485 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-08-31T05:09:14.485 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:14.485 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2024-08-31T05:09:14.485 INFO:teuthology.orchestra.run.smithi067.stdout: librados2-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.485 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.485 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:09:14.485 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T05:09:14.485 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.485 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.485 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.485 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.485 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T05:09:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T05:09:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T05:09:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T05:09:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T05:09:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T05:09:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T05:09:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T05:09:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T05:09:14.486 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T05:09:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T05:09:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T05:09:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T05:09:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T05:09:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T05:09:14.487 INFO:teuthology.orchestra.run.smithi067.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T05:09:14.488 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:14.488 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:09:14.522 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:09:14.522 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:14.522 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-08-31T05:09:14.523 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:14.523 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:09:14.523 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:19.1.1-242.g244a32d3.el9 ceph 49 M 2024-08-31T05:09:14.523 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-08-31T05:09:14.523 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:19.1.1-242.g244a32d3.el9 ceph 163 k 2024-08-31T05:09:14.523 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T05:09:14.523 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T05:09:14.523 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:14.523 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:09:14.523 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:14.523 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2024-08-31T05:09:14.523 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 49 M 2024-08-31T05:09:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 209 M 2024-08-31T05:09:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:09:14.784 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-test 2024-08-31T05:09:15.328 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): libcephsqlite-19.1.1-242.g244a32d3.el9.x 233 kB/s | 163 kB 00:00 2024-08-31T05:09:15.358 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:34 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:09:15.438 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 376 kB/s | 304 kB 00:00 2024-08-31T05:09:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:09:15.505 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:15.505 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-08-31T05:09:15.505 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:15.505 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:09:15.505 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test x86_64 2:19.1.1-242.g244a32d3.el9 ceph 49 M 2024-08-31T05:09:15.505 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-08-31T05:09:15.505 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite x86_64 2:19.1.1-242.g244a32d3.el9 ceph 163 k 2024-08-31T05:09:15.505 INFO:teuthology.orchestra.run.smithi067.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T05:09:15.505 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T05:09:15.506 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:15.506 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:09:15.506 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:15.506 INFO:teuthology.orchestra.run.smithi067.stdout:Install 4 Packages 2024-08-31T05:09:15.506 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:15.506 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 49 M 2024-08-31T05:09:15.507 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 209 M 2024-08-31T05:09:15.507 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:09:15.999 INFO:teuthology.orchestra.run.smithi067.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-08-31T05:09:16.001 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 95 kB/s | 64 kB 00:00 2024-08-31T05:09:16.057 INFO:teuthology.orchestra.run.smithi067.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-08-31T05:09:16.361 INFO:teuthology.orchestra.run.smithi067.stdout:(3/4): libcephsqlite-19.1.1-242.g244a32d3.el9.x 274 kB/s | 163 kB 00:00 2024-08-31T05:09:19.609 INFO:teuthology.orchestra.run.smithi067.stdout:(4/4): ceph-test-19.1.1-242.g244a32d3.el9.x86_6 13 MB/s | 49 MB 00:03 2024-08-31T05:09:19.611 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:09:19.611 INFO:teuthology.orchestra.run.smithi067.stdout:Total 12 MB/s | 49 MB 00:04 2024-08-31T05:09:19.636 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:09:19.655 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:09:19.655 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:09:20.043 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:09:20.043 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:09:20.601 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:09:20.686 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-08-31T05:09:20.725 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-08-31T05:09:20.753 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephsqlite-2:19.1.1-242.g244a32d3.el9.x86_64 3/4 2024-08-31T05:09:23.369 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): ceph-test-19.1.1-242.g244a32d3.el9.x86_6 5.6 MB/s | 49 MB 00:08 2024-08-31T05:09:23.372 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:09:23.372 INFO:teuthology.orchestra.run.smithi073.stdout:Total 5.6 MB/s | 49 MB 00:08 2024-08-31T05:09:23.396 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:09:23.414 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:09:23.414 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:09:23.788 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:09:23.788 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:09:24.320 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:09:24.387 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-08-31T05:09:24.436 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-08-31T05:09:24.463 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:19.1.1-242.g244a32d3.el9.x86_64 3/4 2024-08-31T05:09:25.571 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephsqlite-2:19.1.1-242.g244a32d3.el9.x86_64 3/4 2024-08-31T05:09:25.644 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-test-2:19.1.1-242.g244a32d3.el9.x86_64 4/4 2024-08-31T05:09:28.199 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-test-2:19.1.1-242.g244a32d3.el9.x86_64 4/4 2024-08-31T05:09:28.200 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-test-2:19.1.1-242.g244a32d3.el9.x86_64 1/4 2024-08-31T05:09:28.200 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephsqlite-2:19.1.1-242.g244a32d3.el9.x86_64 2/4 2024-08-31T05:09:28.200 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-08-31T05:09:28.475 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-08-31T05:09:28.475 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:28.475 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:09:28.475 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:28.476 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:28.476 INFO:teuthology.orchestra.run.smithi067.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T05:09:28.476 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T05:09:28.476 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:28.476 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:09:28.772 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph 2024-08-31T05:09:29.033 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:19.1.1-242.g244a32d3.el9.x86_64 3/4 2024-08-31T05:09:29.109 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:19.1.1-242.g244a32d3.el9.x86_64 4/4 2024-08-31T05:09:29.333 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:48 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:09:29.473 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:09:29.476 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:29.476 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-08-31T05:09:29.476 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:29.476 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:09:29.476 INFO:teuthology.orchestra.run.smithi067.stdout: ceph x86_64 2:19.1.1-242.g244a32d3.el9 ceph 6.5 k 2024-08-31T05:09:29.476 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-08-31T05:09:29.476 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds x86_64 2:19.1.1-242.g244a32d3.el9 ceph 2.4 M 2024-08-31T05:09:29.476 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr x86_64 2:19.1.1-242.g244a32d3.el9 ceph 1.5 M 2024-08-31T05:09:29.476 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 249 k 2024-08-31T05:09:29.476 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon x86_64 2:19.1.1-242.g244a32d3.el9 ceph 4.7 M 2024-08-31T05:09:29.477 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd x86_64 2:19.1.1-242.g244a32d3.el9 ceph 17 M 2024-08-31T05:09:29.477 INFO:teuthology.orchestra.run.smithi067.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T05:09:29.477 INFO:teuthology.orchestra.run.smithi067.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T05:09:29.477 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T05:09:29.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T05:09:29.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T05:09:29.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T05:09:29.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T05:09:29.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T05:09:29.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T05:09:29.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T05:09:29.477 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T05:09:29.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T05:09:29.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T05:09:29.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T05:09:29.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T05:09:29.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T05:09:29.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T05:09:29.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T05:09:29.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T05:09:29.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T05:09:29.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T05:09:29.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T05:09:29.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T05:09:29.478 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T05:09:29.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T05:09:29.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T05:09:29.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T05:09:29.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T05:09:29.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T05:09:29.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T05:09:29.479 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T05:09:29.479 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:29.479 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:09:29.479 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:29.479 INFO:teuthology.orchestra.run.smithi067.stdout:Install 37 Packages 2024-08-31T05:09:29.479 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:29.480 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 30 M 2024-08-31T05:09:29.480 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 108 M 2024-08-31T05:09:29.480 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:09:30.242 INFO:teuthology.orchestra.run.smithi067.stdout:(1/37): ceph-19.1.1-242.g244a32d3.el9.x86_64.rp 27 kB/s | 6.5 kB 00:00 2024-08-31T05:09:30.651 INFO:teuthology.orchestra.run.smithi067.stdout:(2/37): ceph-mgr-19.1.1-242.g244a32d3.el9.x86_6 2.3 MB/s | 1.5 MB 00:00 2024-08-31T05:09:30.977 INFO:teuthology.orchestra.run.smithi067.stdout:(3/37): ceph-mds-19.1.1-242.g244a32d3.el9.x86_6 2.4 MB/s | 2.4 MB 00:00 2024-08-31T05:09:31.077 INFO:teuthology.orchestra.run.smithi067.stdout:(4/37): ceph-mgr-modules-core-19.1.1-242.g244a3 2.4 MB/s | 249 kB 00:00 2024-08-31T05:09:31.235 INFO:teuthology.orchestra.run.smithi067.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-08-31T05:09:31.433 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-test-2:19.1.1-242.g244a32d3.el9.x86_64 4/4 2024-08-31T05:09:31.433 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:19.1.1-242.g244a32d3.el9.x86_64 1/4 2024-08-31T05:09:31.433 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:19.1.1-242.g244a32d3.el9.x86_64 2/4 2024-08-31T05:09:31.433 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-08-31T05:09:31.519 INFO:teuthology.orchestra.run.smithi067.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 4.3 MB/s | 1.2 MB 00:00 2024-08-31T05:09:31.569 INFO:teuthology.orchestra.run.smithi067.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-08-31T05:09:31.628 INFO:teuthology.orchestra.run.smithi067.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-08-31T05:09:31.687 INFO:teuthology.orchestra.run.smithi067.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-08-31T05:09:31.732 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-08-31T05:09:31.732 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:31.732 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:09:31.732 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:31.733 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:31.733 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T05:09:31.733 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T05:09:31.733 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:31.733 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:09:31.770 INFO:teuthology.orchestra.run.smithi067.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-08-31T05:09:31.904 INFO:teuthology.orchestra.run.smithi067.stdout:(11/37): ceph-mon-19.1.1-242.g244a32d3.el9.x86_ 2.8 MB/s | 4.7 MB 00:01 2024-08-31T05:09:32.022 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph 2024-08-31T05:09:32.188 INFO:teuthology.orchestra.run.smithi067.stdout:(12/37): ceph-osd-19.1.1-242.g244a32d3.el9.x86_ 11 MB/s | 17 MB 00:01 2024-08-31T05:09:32.582 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:48 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:09:32.728 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:09:32.730 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:32.730 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-08-31T05:09:32.730 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:32.731 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:09:32.731 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:19.1.1-242.g244a32d3.el9 ceph 6.5 k 2024-08-31T05:09:32.731 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-08-31T05:09:32.731 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:19.1.1-242.g244a32d3.el9 ceph 2.4 M 2024-08-31T05:09:32.731 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:19.1.1-242.g244a32d3.el9 ceph 1.5 M 2024-08-31T05:09:32.731 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 249 k 2024-08-31T05:09:32.731 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:19.1.1-242.g244a32d3.el9 ceph 4.7 M 2024-08-31T05:09:32.731 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:19.1.1-242.g244a32d3.el9 ceph 17 M 2024-08-31T05:09:32.731 INFO:teuthology.orchestra.run.smithi073.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T05:09:32.731 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T05:09:32.731 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T05:09:32.731 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T05:09:32.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T05:09:32.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T05:09:32.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T05:09:32.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T05:09:32.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T05:09:32.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T05:09:32.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T05:09:32.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T05:09:32.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T05:09:32.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T05:09:32.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T05:09:32.732 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T05:09:32.733 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T05:09:32.733 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T05:09:32.733 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T05:09:32.733 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T05:09:32.733 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T05:09:32.733 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T05:09:32.733 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T05:09:32.733 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T05:09:32.733 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T05:09:32.733 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T05:09:32.733 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T05:09:32.733 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T05:09:32.733 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T05:09:32.734 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T05:09:32.734 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T05:09:32.734 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:32.734 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:09:32.734 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:32.734 INFO:teuthology.orchestra.run.smithi073.stdout:Install 37 Packages 2024-08-31T05:09:32.734 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:32.735 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 30 M 2024-08-31T05:09:32.735 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 108 M 2024-08-31T05:09:32.735 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:09:32.746 INFO:teuthology.orchestra.run.smithi067.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 193 kB/s | 188 kB 00:00 2024-08-31T05:09:32.771 INFO:teuthology.orchestra.run.smithi067.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 198 kB/s | 172 kB 00:00 2024-08-31T05:09:32.805 INFO:teuthology.orchestra.run.smithi067.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 57 kB/s | 35 kB 00:00 2024-08-31T05:09:33.363 INFO:teuthology.orchestra.run.smithi067.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 86 kB/s | 51 kB 00:00 2024-08-31T05:09:33.388 INFO:teuthology.orchestra.run.smithi067.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 120 kB/s | 77 kB 00:00 2024-08-31T05:09:33.414 INFO:teuthology.orchestra.run.smithi067.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 68 kB/s | 42 kB 00:00 2024-08-31T05:09:33.472 INFO:teuthology.orchestra.run.smithi067.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-08-31T05:09:33.489 INFO:teuthology.orchestra.run.smithi067.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 180 kB/s | 22 kB 00:00 2024-08-31T05:09:33.506 INFO:teuthology.orchestra.run.smithi067.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 472 kB/s | 43 kB 00:00 2024-08-31T05:09:33.540 INFO:teuthology.orchestra.run.smithi067.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-08-31T05:09:33.547 INFO:teuthology.orchestra.run.smithi073.stdout:(1/37): ceph-19.1.1-242.g244a32d3.el9.x86_64.rp 25 kB/s | 6.5 kB 00:00 2024-08-31T05:09:33.557 INFO:teuthology.orchestra.run.smithi067.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 254 kB/s | 11 kB 00:00 2024-08-31T05:09:33.574 INFO:teuthology.orchestra.run.smithi067.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 561 kB/s | 18 kB 00:00 2024-08-31T05:09:33.591 INFO:teuthology.orchestra.run.smithi067.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 693 kB/s | 23 kB 00:00 2024-08-31T05:09:33.608 INFO:teuthology.orchestra.run.smithi067.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 584 kB/s | 19 kB 00:00 2024-08-31T05:09:33.633 INFO:teuthology.orchestra.run.smithi067.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 471 kB/s | 20 kB 00:00 2024-08-31T05:09:33.658 INFO:teuthology.orchestra.run.smithi067.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-08-31T05:09:33.683 INFO:teuthology.orchestra.run.smithi067.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-08-31T05:09:33.708 INFO:teuthology.orchestra.run.smithi067.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-08-31T05:09:33.734 INFO:teuthology.orchestra.run.smithi067.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-08-31T05:09:33.768 INFO:teuthology.orchestra.run.smithi067.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-08-31T05:09:33.793 INFO:teuthology.orchestra.run.smithi067.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 612 kB/s | 36 kB 00:00 2024-08-31T05:09:33.818 INFO:teuthology.orchestra.run.smithi067.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-08-31T05:09:33.843 INFO:teuthology.orchestra.run.smithi067.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 810 kB/s | 20 kB 00:00 2024-08-31T05:09:33.869 INFO:teuthology.orchestra.run.smithi067.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-31T05:09:33.902 INFO:teuthology.orchestra.run.smithi067.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-08-31T05:09:33.909 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:09:33.909 INFO:teuthology.orchestra.run.smithi067.stdout:Total 6.8 MB/s | 30 MB 00:04 2024-08-31T05:09:34.039 INFO:teuthology.orchestra.run.smithi073.stdout:(2/37): ceph-mgr-19.1.1-242.g244a32d3.el9.x86_6 2.0 MB/s | 1.5 MB 00:00 2024-08-31T05:09:34.063 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:09:34.107 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:09:34.107 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:09:34.189 INFO:teuthology.orchestra.run.smithi073.stdout:(3/37): ceph-mds-19.1.1-242.g244a32d3.el9.x86_6 2.6 MB/s | 2.4 MB 00:00 2024-08-31T05:09:34.298 INFO:teuthology.orchestra.run.smithi073.stdout:(4/37): ceph-mgr-modules-core-19.1.1-242.g244a3 2.2 MB/s | 249 kB 00:00 2024-08-31T05:09:34.421 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:09:34.422 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:09:34.423 INFO:teuthology.orchestra.run.smithi073.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-08-31T05:09:34.673 INFO:teuthology.orchestra.run.smithi073.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 4.9 MB/s | 1.2 MB 00:00 2024-08-31T05:09:34.732 INFO:teuthology.orchestra.run.smithi073.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-08-31T05:09:34.799 INFO:teuthology.orchestra.run.smithi073.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-08-31T05:09:34.857 INFO:teuthology.orchestra.run.smithi073.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-08-31T05:09:34.941 INFO:teuthology.orchestra.run.smithi073.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-08-31T05:09:35.083 INFO:teuthology.orchestra.run.smithi073.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-08-31T05:09:35.133 INFO:teuthology.orchestra.run.smithi073.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-31T05:09:35.175 INFO:teuthology.orchestra.run.smithi073.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 836 kB/s | 35 kB 00:00 2024-08-31T05:09:35.217 INFO:teuthology.orchestra.run.smithi073.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-08-31T05:09:35.259 INFO:teuthology.orchestra.run.smithi073.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-08-31T05:09:35.301 INFO:teuthology.orchestra.run.smithi073.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 998 kB/s | 42 kB 00:00 2024-08-31T05:09:35.402 INFO:teuthology.orchestra.run.smithi073.stdout:(17/37): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-08-31T05:09:35.444 INFO:teuthology.orchestra.run.smithi073.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-08-31T05:09:35.460 INFO:teuthology.orchestra.run.smithi073.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.6 MB/s | 43 kB 00:00 2024-08-31T05:09:35.486 INFO:teuthology.orchestra.run.smithi073.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2024-08-31T05:09:35.553 INFO:teuthology.orchestra.run.smithi073.stdout:(21/37): ceph-mon-19.1.1-242.g244a32d3.el9.x86_ 2.3 MB/s | 4.7 MB 00:02 2024-08-31T05:09:35.594 INFO:teuthology.orchestra.run.smithi073.stdout:(22/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.2 MB/s | 358 kB 00:00 2024-08-31T05:09:35.620 INFO:teuthology.orchestra.run.smithi073.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 160 kB/s | 11 kB 00:00 2024-08-31T05:09:35.645 INFO:teuthology.orchestra.run.smithi073.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 364 kB/s | 18 kB 00:00 2024-08-31T05:09:35.671 INFO:teuthology.orchestra.run.smithi073.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 925 kB/s | 23 kB 00:00 2024-08-31T05:09:35.696 INFO:teuthology.orchestra.run.smithi073.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-08-31T05:09:35.721 INFO:teuthology.orchestra.run.smithi073.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-08-31T05:09:35.746 INFO:teuthology.orchestra.run.smithi073.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 916 kB/s | 46 kB 00:00 2024-08-31T05:09:35.780 INFO:teuthology.orchestra.run.smithi073.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-08-31T05:09:35.795 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:09:35.805 INFO:teuthology.orchestra.run.smithi073.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 672 kB/s | 16 kB 00:00 2024-08-31T05:09:35.863 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-08-31T05:09:35.897 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-08-31T05:09:35.924 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-08-31T05:09:35.964 INFO:teuthology.orchestra.run.smithi073.stdout:(31/37): ceph-osd-19.1.1-242.g244a32d3.el9.x86_ 8.8 MB/s | 17 MB 00:01 2024-08-31T05:09:35.989 INFO:teuthology.orchestra.run.smithi073.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 490 kB/s | 90 kB 00:00 2024-08-31T05:09:36.000 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-08-31T05:09:36.022 INFO:teuthology.orchestra.run.smithi073.stdout:(33/37): python3-pecan-1.4.2-3.el9.noarch.rpm 987 kB/s | 272 kB 00:00 2024-08-31T05:09:36.048 INFO:teuthology.orchestra.run.smithi073.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.4 MB/s | 230 kB 00:00 2024-08-31T05:09:36.049 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-08-31T05:09:36.073 INFO:teuthology.orchestra.run.smithi073.stdout:(35/37): python3-tempora-5.0.0-2.el9.noarch.rpm 329 kB/s | 36 kB 00:00 2024-08-31T05:09:36.089 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-08-31T05:09:36.098 INFO:teuthology.orchestra.run.smithi073.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 399 kB/s | 20 kB 00:00 2024-08-31T05:09:36.123 INFO:teuthology.orchestra.run.smithi073.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-08-31T05:09:36.128 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:09:36.128 INFO:teuthology.orchestra.run.smithi073.stdout:Total 8.9 MB/s | 30 MB 00:03 2024-08-31T05:09:36.186 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-08-31T05:09:36.262 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-08-31T05:09:36.274 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:09:36.309 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-08-31T05:09:36.314 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:09:36.314 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:09:36.360 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-08-31T05:09:36.390 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-08-31T05:09:36.425 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-08-31T05:09:36.466 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-08-31T05:09:36.516 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-08-31T05:09:36.559 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-08-31T05:09:36.593 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-08-31T05:09:36.614 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:09:36.615 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:09:36.642 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-08-31T05:09:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-08-31T05:09:36.758 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-08-31T05:09:36.910 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-08-31T05:09:37.001 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-08-31T05:09:37.061 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-08-31T05:09:37.098 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-08-31T05:09:37.166 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-08-31T05:09:37.229 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-08-31T05:09:37.434 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-08-31T05:09:37.485 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-08-31T05:09:37.566 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-08-31T05:09:37.665 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-08-31T05:09:37.701 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-08-31T05:09:37.832 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-08-31T05:09:37.987 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:09:38.004 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-242.g244a32d3.el9.n 32/37 2024-08-31T05:09:38.036 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-2:19.1.1-242.g244a32d3.el9.x86_64 33/37 2024-08-31T05:09:38.061 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-2:19.1.1-242.g244a32d3.el9.x86_64 33/37 2024-08-31T05:09:38.061 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:09:38.061 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T05:09:38.061 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:09:38.062 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:09:38.062 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:38.068 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-08-31T05:09:38.101 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-08-31T05:09:38.129 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-08-31T05:09:38.202 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-08-31T05:09:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-08-31T05:09:38.302 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-08-31T05:09:38.395 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-08-31T05:09:38.473 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-08-31T05:09:38.513 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-08-31T05:09:38.548 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-08-31T05:09:38.578 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-08-31T05:09:38.613 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-08-31T05:09:38.646 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-08-31T05:09:38.686 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-08-31T05:09:38.730 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-08-31T05:09:38.764 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-08-31T05:09:38.814 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-08-31T05:09:38.861 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-08-31T05:09:38.934 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-08-31T05:09:39.073 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-08-31T05:09:39.153 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-08-31T05:09:39.206 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-08-31T05:09:39.244 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-08-31T05:09:39.310 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-08-31T05:09:39.366 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-08-31T05:09:39.553 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-08-31T05:09:39.578 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-osd-2:19.1.1-242.g244a32d3.el9.x86_64 34/37 2024-08-31T05:09:39.605 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-osd-2:19.1.1-242.g244a32d3.el9.x86_64 34/37 2024-08-31T05:09:39.605 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:09:39.605 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T05:09:39.605 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:09:39.605 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:09:39.605 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:39.607 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-08-31T05:09:39.685 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-08-31T05:09:39.781 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-08-31T05:09:39.823 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-08-31T05:09:39.941 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-08-31T05:09:40.070 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mon-2:19.1.1-242.g244a32d3.el9.x86_64 35/37 2024-08-31T05:09:40.094 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mon-2:19.1.1-242.g244a32d3.el9.x86_64 35/37 2024-08-31T05:09:40.094 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:09:40.094 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T05:09:40.094 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:09:40.095 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:09:40.095 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:40.103 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-242.g244a32d3.el9.n 32/37 2024-08-31T05:09:40.150 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:19.1.1-242.g244a32d3.el9.x86_64 33/37 2024-08-31T05:09:40.175 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:19.1.1-242.g244a32d3.el9.x86_64 33/37 2024-08-31T05:09:40.176 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:09:40.176 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T05:09:40.176 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:09:40.176 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:09:40.176 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:40.329 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mds-2:19.1.1-242.g244a32d3.el9.x86_64 36/37 2024-08-31T05:09:40.353 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mds-2:19.1.1-242.g244a32d3.el9.x86_64 36/37 2024-08-31T05:09:40.353 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:09:40.353 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T05:09:40.353 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:09:40.353 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:09:40.354 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:40.427 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-2:19.1.1-242.g244a32d3.el9.x86_64 37/37 2024-08-31T05:09:41.609 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:19.1.1-242.g244a32d3.el9.x86_64 34/37 2024-08-31T05:09:41.636 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:19.1.1-242.g244a32d3.el9.x86_64 34/37 2024-08-31T05:09:41.636 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:09:41.636 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T05:09:41.636 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:09:41.636 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:09:41.636 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:42.077 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:19.1.1-242.g244a32d3.el9.x86_64 35/37 2024-08-31T05:09:42.100 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:19.1.1-242.g244a32d3.el9.x86_64 35/37 2024-08-31T05:09:42.101 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:09:42.101 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T05:09:42.101 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:09:42.101 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:09:42.101 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:42.113 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-2:19.1.1-242.g244a32d3.el9.x86_64 37/37 2024-08-31T05:09:42.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-2:19.1.1-242.g244a32d3.el9.x86_64 1/37 2024-08-31T05:09:42.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mds-2:19.1.1-242.g244a32d3.el9.x86_64 2/37 2024-08-31T05:09:42.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-2:19.1.1-242.g244a32d3.el9.x86_64 3/37 2024-08-31T05:09:42.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mon-2:19.1.1-242.g244a32d3.el9.x86_64 4/37 2024-08-31T05:09:42.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-osd-2:19.1.1-242.g244a32d3.el9.x86_64 5/37 2024-08-31T05:09:42.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-242.g244a32d3.el9.n 6/37 2024-08-31T05:09:42.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-08-31T05:09:42.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-08-31T05:09:42.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-08-31T05:09:42.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-08-31T05:09:42.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-08-31T05:09:42.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-08-31T05:09:42.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-08-31T05:09:42.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-08-31T05:09:42.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-08-31T05:09:42.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-08-31T05:09:42.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-08-31T05:09:42.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-08-31T05:09:42.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-08-31T05:09:42.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-08-31T05:09:42.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-08-31T05:09:42.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-08-31T05:09:42.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-08-31T05:09:42.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-08-31T05:09:42.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-08-31T05:09:42.116 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-08-31T05:09:42.116 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-08-31T05:09:42.116 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-08-31T05:09:42.117 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-08-31T05:09:42.117 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-08-31T05:09:42.117 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-08-31T05:09:42.117 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-08-31T05:09:42.117 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-08-31T05:09:42.117 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-08-31T05:09:42.117 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-08-31T05:09:42.117 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-08-31T05:09:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:19.1.1-242.g244a32d3.el9.x86_64 36/37 2024-08-31T05:09:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:19.1.1-242.g244a32d3.el9.x86_64 36/37 2024-08-31T05:09:42.351 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:09:42.351 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T05:09:42.351 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:09:42.351 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:09:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:42.415 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:19.1.1-242.g244a32d3.el9.x86_64 37/37 2024-08-31T05:09:43.142 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-08-31T05:09:43.142 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:43.142 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:09:43.142 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:43.142 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:43.142 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:43.142 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:09:43.143 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:43.143 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:43.143 INFO:teuthology.orchestra.run.smithi067.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T05:09:43.143 INFO:teuthology.orchestra.run.smithi067.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T05:09:43.143 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T05:09:43.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T05:09:43.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T05:09:43.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T05:09:43.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T05:09:43.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T05:09:43.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T05:09:43.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T05:09:43.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T05:09:43.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T05:09:43.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T05:09:43.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T05:09:43.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T05:09:43.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T05:09:43.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T05:09:43.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T05:09:43.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T05:09:43.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T05:09:43.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T05:09:43.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T05:09:43.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T05:09:43.145 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T05:09:43.145 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T05:09:43.145 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T05:09:43.145 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T05:09:43.145 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T05:09:43.145 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T05:09:43.145 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T05:09:43.145 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T05:09:43.145 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:43.145 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:09:43.510 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-base 2024-08-31T05:09:44.077 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:03 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:09:44.169 INFO:teuthology.orchestra.run.smithi067.stdout:Package ceph-base-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:09:44.213 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:09:44.214 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2024-08-31T05:09:44.214 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:09:44.277 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install cephadm 2024-08-31T05:09:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-2:19.1.1-242.g244a32d3.el9.x86_64 37/37 2024-08-31T05:09:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:19.1.1-242.g244a32d3.el9.x86_64 1/37 2024-08-31T05:09:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:19.1.1-242.g244a32d3.el9.x86_64 2/37 2024-08-31T05:09:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:19.1.1-242.g244a32d3.el9.x86_64 3/37 2024-08-31T05:09:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:19.1.1-242.g244a32d3.el9.x86_64 4/37 2024-08-31T05:09:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:19.1.1-242.g244a32d3.el9.x86_64 5/37 2024-08-31T05:09:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-242.g244a32d3.el9.n 6/37 2024-08-31T05:09:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-08-31T05:09:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-08-31T05:09:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-08-31T05:09:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-08-31T05:09:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-08-31T05:09:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-08-31T05:09:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-08-31T05:09:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-08-31T05:09:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-08-31T05:09:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-08-31T05:09:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-08-31T05:09:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-08-31T05:09:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-08-31T05:09:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-08-31T05:09:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-08-31T05:09:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-08-31T05:09:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-08-31T05:09:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-08-31T05:09:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-08-31T05:09:44.294 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-08-31T05:09:44.294 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-08-31T05:09:44.294 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-08-31T05:09:44.294 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-08-31T05:09:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-08-31T05:09:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-08-31T05:09:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-08-31T05:09:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-08-31T05:09:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-08-31T05:09:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-08-31T05:09:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-08-31T05:09:44.836 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:03 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:09:44.973 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:09:44.974 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:44.974 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-08-31T05:09:44.974 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:44.974 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:09:44.975 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 765 k 2024-08-31T05:09:44.975 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:44.975 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:09:44.975 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:44.975 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2024-08-31T05:09:44.975 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:44.975 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 765 k 2024-08-31T05:09:44.975 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 771 k 2024-08-31T05:09:44.975 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:09:45.330 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-08-31T05:09:45.330 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:45.330 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:09:45.330 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:45.330 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:45.330 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:45.331 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:09:45.331 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:45.331 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:45.331 INFO:teuthology.orchestra.run.smithi073.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T05:09:45.331 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T05:09:45.331 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T05:09:45.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T05:09:45.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T05:09:45.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T05:09:45.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T05:09:45.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T05:09:45.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T05:09:45.331 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T05:09:45.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T05:09:45.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T05:09:45.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T05:09:45.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T05:09:45.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T05:09:45.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T05:09:45.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T05:09:45.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T05:09:45.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T05:09:45.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T05:09:45.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T05:09:45.332 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T05:09:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T05:09:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T05:09:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T05:09:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T05:09:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T05:09:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T05:09:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T05:09:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T05:09:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T05:09:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:45.333 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:09:45.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-base 2024-08-31T05:09:46.254 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:02 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:09:46.344 INFO:teuthology.orchestra.run.smithi073.stdout:Package ceph-base-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:09:46.385 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:09:46.386 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-08-31T05:09:46.386 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:09:46.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install cephadm 2024-08-31T05:09:46.477 INFO:teuthology.orchestra.run.smithi067.stdout:cephadm-19.1.1-242.g244a32d3.el9.noarch.rpm 510 kB/s | 765 kB 00:01 2024-08-31T05:09:46.478 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:09:46.479 INFO:teuthology.orchestra.run.smithi067.stdout:Total 509 kB/s | 765 kB 00:01 2024-08-31T05:09:46.479 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:09:46.485 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:09:46.485 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:09:46.492 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:09:46.492 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:09:46.568 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:09:47.007 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:03 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:09:47.035 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:19.1.1-242.g244a32d3.el9.noarch 1/1 2024-08-31T05:09:47.135 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephadm-2:19.1.1-242.g244a32d3.el9.noarch 1/1 2024-08-31T05:09:47.138 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:09:47.138 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-08-31T05:09:47.139 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:47.139 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:09:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 765 k 2024-08-31T05:09:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:47.139 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:09:47.139 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:47.139 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-08-31T05:09:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:47.140 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 765 k 2024-08-31T05:09:47.140 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 771 k 2024-08-31T05:09:47.140 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:09:47.480 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:19.1.1-242.g244a32d3.el9.noarch 1/1 2024-08-31T05:09:47.749 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephadm-2:19.1.1-242.g244a32d3.el9.noarch 1/1 2024-08-31T05:09:47.749 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:47.749 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:09:47.750 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:09:47.750 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:47.750 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:09:47.826 INFO:teuthology.orchestra.run.smithi073.stdout:cephadm-19.1.1-242.g244a32d3.el9.noarch.rpm 1.1 MB/s | 765 kB 00:00 2024-08-31T05:09:47.827 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:09:47.827 INFO:teuthology.orchestra.run.smithi073.stdout:Total 1.1 MB/s | 765 kB 00:00 2024-08-31T05:09:47.827 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:09:47.832 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:09:47.832 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:09:47.839 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:09:47.839 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:09:47.914 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:09:47.949 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-immutable-object-cache 2024-08-31T05:09:48.299 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.1.1-242.g244a32d3.el9.noarch 1/1 2024-08-31T05:09:48.390 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:19.1.1-242.g244a32d3.el9.noarch 1/1 2024-08-31T05:09:48.508 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:07 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:09:48.648 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:09:48.648 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:48.649 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repo Size 2024-08-31T05:09:48.649 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:48.649 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:09:48.649 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-242.g244a32d3.el9 ceph 145 k 2024-08-31T05:09:48.649 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:48.649 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:09:48.649 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:48.649 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2024-08-31T05:09:48.649 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:48.649 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 145 k 2024-08-31T05:09:48.649 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 436 k 2024-08-31T05:09:48.649 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:09:48.754 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.1.1-242.g244a32d3.el9.noarch 1/1 2024-08-31T05:09:48.977 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-immutable-object-cache-19.1.1-242.g244a32d 443 kB/s | 145 kB 00:00 2024-08-31T05:09:48.978 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:09:48.978 INFO:teuthology.orchestra.run.smithi067.stdout:Total 440 kB/s | 145 kB 00:00 2024-08-31T05:09:48.978 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:09:48.986 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:09:48.986 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:09:49.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:19.1.1-242.g244a32d3.el9.noarch 1/1 2024-08-31T05:09:49.014 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:49.014 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:09:49.014 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:09:49.014 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:49.014 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:09:49.046 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:09:49.046 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:09:49.197 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:09:49.223 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-immutable-object-cache 2024-08-31T05:09:49.261 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-242.g244a32d3.e 1/1 2024-08-31T05:09:49.286 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-242.g244a32d3.e 1/1 2024-08-31T05:09:49.286 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:09:49.286 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T05:09:49.286 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:49.782 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:05 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:09:49.916 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:09:49.917 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:49.917 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-08-31T05:09:49.917 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:49.917 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:09:49.918 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-242.g244a32d3.el9 ceph 145 k 2024-08-31T05:09:49.918 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:49.918 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:09:49.918 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:49.918 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-08-31T05:09:49.918 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:49.918 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 145 k 2024-08-31T05:09:49.918 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 436 k 2024-08-31T05:09:49.918 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:09:50.168 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-immutable-object-cache-19.1.1-242.g244a32d 581 kB/s | 145 kB 00:00 2024-08-31T05:09:50.169 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:09:50.169 INFO:teuthology.orchestra.run.smithi073.stdout:Total 577 kB/s | 145 kB 00:00 2024-08-31T05:09:50.169 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:09:50.177 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:09:50.177 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:09:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-242.g244a32d3.e 1/1 2024-08-31T05:09:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:50.183 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:09:50.183 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:50.184 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:50.184 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:09:50.235 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:09:50.235 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:09:50.375 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:09:50.395 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr 2024-08-31T05:09:50.427 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-242.g244a32d3.e 1/1 2024-08-31T05:09:50.453 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-242.g244a32d3.e 1/1 2024-08-31T05:09:50.453 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:09:50.453 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T05:09:50.453 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:50.956 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:09 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:09:51.050 INFO:teuthology.orchestra.run.smithi067.stdout:Package ceph-mgr-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:09:51.094 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:09:51.095 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2024-08-31T05:09:51.095 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:09:51.156 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr-dashboard 2024-08-31T05:09:51.355 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-242.g244a32d3.e 1/1 2024-08-31T05:09:51.355 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:51.355 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:09:51.355 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:09:51.355 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:51.355 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:09:51.577 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr 2024-08-31T05:09:51.722 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:10 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:09:51.858 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:09:51.859 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:51.859 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-08-31T05:09:51.860 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:51.860 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:09:51.860 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 3.6 M 2024-08-31T05:09:51.860 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-08-31T05:09:51.860 INFO:teuthology.orchestra.run.smithi067.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T05:09:51.860 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 32 k 2024-08-31T05:09:51.860 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 16 k 2024-08-31T05:09:51.860 INFO:teuthology.orchestra.run.smithi067.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T05:09:51.860 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T05:09:51.860 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T05:09:51.860 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T05:09:51.861 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T05:09:51.861 INFO:teuthology.orchestra.run.smithi067.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T05:09:51.861 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T05:09:51.861 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T05:09:51.861 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:51.861 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:09:51.861 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:09:51.861 INFO:teuthology.orchestra.run.smithi067.stdout:Install 12 Packages 2024-08-31T05:09:51.861 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:51.862 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 8.7 M 2024-08-31T05:09:51.862 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 104 M 2024-08-31T05:09:51.862 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:09:52.138 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:08 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:09:52.232 INFO:teuthology.orchestra.run.smithi073.stdout:Package ceph-mgr-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:09:52.275 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:09:52.276 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-08-31T05:09:52.276 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:09:52.347 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-dashboard 2024-08-31T05:09:52.891 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:08 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:09:52.946 INFO:teuthology.orchestra.run.smithi067.stdout:(1/12): ceph-prometheus-alerts-19.1.1-242.g244a 36 kB/s | 16 kB 00:00 2024-08-31T05:09:52.972 INFO:teuthology.orchestra.run.smithi067.stdout:(2/12): ceph-grafana-dashboards-19.1.1-242.g244 66 kB/s | 32 kB 00:00 2024-08-31T05:09:53.022 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:09:53.023 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:53.023 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-08-31T05:09:53.023 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:53.023 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:09:53.023 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 3.6 M 2024-08-31T05:09:53.023 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-08-31T05:09:53.023 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T05:09:53.023 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 32 k 2024-08-31T05:09:53.023 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 16 k 2024-08-31T05:09:53.023 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T05:09:53.024 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T05:09:53.024 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T05:09:53.024 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T05:09:53.024 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T05:09:53.024 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T05:09:53.024 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T05:09:53.024 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T05:09:53.024 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:53.024 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:09:53.024 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:09:53.024 INFO:teuthology.orchestra.run.smithi073.stdout:Install 12 Packages 2024-08-31T05:09:53.024 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:53.025 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 8.7 M 2024-08-31T05:09:53.025 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 104 M 2024-08-31T05:09:53.025 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:09:53.189 INFO:teuthology.orchestra.run.smithi067.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.2 MB/s | 269 kB 00:00 2024-08-31T05:09:53.247 INFO:teuthology.orchestra.run.smithi067.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2024-08-31T05:09:53.297 INFO:teuthology.orchestra.run.smithi067.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-08-31T05:09:53.314 INFO:teuthology.orchestra.run.smithi067.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-08-31T05:09:53.398 INFO:teuthology.orchestra.run.smithi067.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 24 MB/s | 2.0 MB 00:00 2024-08-31T05:09:53.423 INFO:teuthology.orchestra.run.smithi067.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-08-31T05:09:53.440 INFO:teuthology.orchestra.run.smithi067.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-08-31T05:09:53.474 INFO:teuthology.orchestra.run.smithi067.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.6 MB/s | 188 kB 00:00 2024-08-31T05:09:53.541 INFO:teuthology.orchestra.run.smithi067.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.4 MB/s | 863 kB 00:00 2024-08-31T05:09:53.598 INFO:teuthology.orchestra.run.smithi073.stdout:(1/12): ceph-grafana-dashboards-19.1.1-242.g244 71 kB/s | 32 kB 00:00 2024-08-31T05:09:53.623 INFO:teuthology.orchestra.run.smithi073.stdout:(2/12): ceph-prometheus-alerts-19.1.1-242.g244a 35 kB/s | 16 kB 00:00 2024-08-31T05:09:53.765 INFO:teuthology.orchestra.run.smithi073.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.9 MB/s | 269 kB 00:00 2024-08-31T05:09:53.815 INFO:teuthology.orchestra.run.smithi073.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-08-31T05:09:53.874 INFO:teuthology.orchestra.run.smithi073.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 7.8 MB/s | 863 kB 00:00 2024-08-31T05:09:53.907 INFO:teuthology.orchestra.run.smithi073.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 5.8 MB/s | 548 kB 00:00 2024-08-31T05:09:53.916 INFO:teuthology.orchestra.run.smithi067.stdout:(12/12): ceph-mgr-dashboard-19.1.1-242.g244a32d 2.5 MB/s | 3.6 MB 00:01 2024-08-31T05:09:53.920 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:09:53.920 INFO:teuthology.orchestra.run.smithi067.stdout:Total 4.2 MB/s | 8.7 MB 00:02 2024-08-31T05:09:53.924 INFO:teuthology.orchestra.run.smithi073.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 386 kB/s | 19 kB 00:00 2024-08-31T05:09:53.972 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:09:53.976 INFO:teuthology.orchestra.run.smithi073.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.8 MB/s | 144 kB 00:00 2024-08-31T05:09:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:09:53.991 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:09:53.991 INFO:teuthology.orchestra.run.smithi073.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-08-31T05:09:54.034 INFO:teuthology.orchestra.run.smithi073.stdout:(10/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 16 MB/s | 2.0 MB 00:00 2024-08-31T05:09:54.059 INFO:teuthology.orchestra.run.smithi073.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-08-31T05:09:54.157 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:09:54.157 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:09:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:(12/12): ceph-mgr-dashboard-19.1.1-242.g244a32d 2.9 MB/s | 3.6 MB 00:01 2024-08-31T05:09:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:09:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:Total 6.3 MB/s | 8.7 MB 00:01 2024-08-31T05:09:54.445 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:09:54.462 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:09:54.462 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:09:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:09:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:09:54.697 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:09:54.767 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-08-31T05:09:54.810 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-08-31T05:09:54.858 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-08-31T05:09:54.887 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-08-31T05:09:54.967 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-08-31T05:09:55.110 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-08-31T05:09:55.143 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:09:55.212 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-08-31T05:09:55.218 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-08-31T05:09:55.253 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-08-31T05:09:55.259 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-08-31T05:09:55.287 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-08-31T05:09:55.299 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-08-31T05:09:55.319 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-242.g244a32d3.el9. 10/12 2024-08-31T05:09:55.330 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-08-31T05:09:55.405 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-08-31T05:09:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-08-31T05:09:55.649 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-08-31T05:09:55.702 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-08-31T05:09:55.730 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-08-31T05:09:55.762 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-242.g244a32d3.el9. 10/12 2024-08-31T05:09:56.431 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-242.g244a32d3.el9 11/12 2024-08-31T05:09:56.469 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-242.g244a32d3.el9.noar 12/12 2024-08-31T05:09:56.812 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-242.g244a32d3.el9 11/12 2024-08-31T05:09:56.846 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-242.g244a32d3.el9.noar 12/12 2024-08-31T05:09:57.844 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-242.g244a32d3.el9.noar 12/12 2024-08-31T05:09:57.844 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-242.g244a32d3.el9 1/12 2024-08-31T05:09:57.844 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-242.g244a32d3.el9.noar 2/12 2024-08-31T05:09:57.844 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-242.g244a32d3.el9. 3/12 2024-08-31T05:09:57.844 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-08-31T05:09:57.845 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-08-31T05:09:57.845 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-08-31T05:09:57.845 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-08-31T05:09:57.845 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-08-31T05:09:57.845 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-08-31T05:09:57.845 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-08-31T05:09:57.845 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-08-31T05:09:58.159 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-08-31T05:09:58.159 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:58.160 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:09:58.160 INFO:teuthology.orchestra.run.smithi067.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T05:09:58.160 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:09:58.160 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:09:58.160 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:09:58.160 INFO:teuthology.orchestra.run.smithi067.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T05:09:58.160 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T05:09:58.160 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T05:09:58.160 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T05:09:58.160 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T05:09:58.160 INFO:teuthology.orchestra.run.smithi067.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T05:09:58.160 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T05:09:58.160 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T05:09:58.161 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:09:58.175 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-242.g244a32d3.el9.noar 12/12 2024-08-31T05:09:58.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-242.g244a32d3.el9 1/12 2024-08-31T05:09:58.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-242.g244a32d3.el9.noar 2/12 2024-08-31T05:09:58.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-242.g244a32d3.el9. 3/12 2024-08-31T05:09:58.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-08-31T05:09:58.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-08-31T05:09:58.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-08-31T05:09:58.175 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-08-31T05:09:58.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-08-31T05:09:58.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-08-31T05:09:58.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-08-31T05:09:58.176 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-08-31T05:09:58.377 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr-diskprediction-local 2024-08-31T05:09:58.497 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-08-31T05:09:58.497 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:58.497 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:09:58.497 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T05:09:58.497 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:09:58.497 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:09:58.497 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:09:58.497 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T05:09:58.497 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T05:09:58.497 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T05:09:58.497 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T05:09:58.498 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T05:09:58.498 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T05:09:58.498 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T05:09:58.498 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T05:09:58.498 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:58.498 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:09:58.748 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-diskprediction-local 2024-08-31T05:09:58.937 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:17 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:09:59.074 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:09:59.075 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================== 2024-08-31T05:09:59.075 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-08-31T05:09:59.075 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================== 2024-08-31T05:09:59.075 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:09:59.075 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 7.4 M 2024-08-31T05:09:59.075 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-08-31T05:09:59.076 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T05:09:59.076 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T05:09:59.076 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T05:09:59.076 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T05:09:59.076 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T05:09:59.076 INFO:teuthology.orchestra.run.smithi067.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T05:09:59.076 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T05:09:59.076 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T05:09:59.076 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T05:09:59.076 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T05:09:59.076 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T05:09:59.076 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:59.076 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:09:59.077 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================== 2024-08-31T05:09:59.077 INFO:teuthology.orchestra.run.smithi067.stdout:Install 12 Packages 2024-08-31T05:09:59.077 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:09:59.077 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 38 M 2024-08-31T05:09:59.077 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 212 M 2024-08-31T05:09:59.077 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:09:59.296 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:15 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:09:59.382 INFO:teuthology.orchestra.run.smithi067.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-08-31T05:09:59.428 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:09:59.429 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================== 2024-08-31T05:09:59.429 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-08-31T05:09:59.429 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================== 2024-08-31T05:09:59.429 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:09:59.429 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 7.4 M 2024-08-31T05:09:59.429 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-08-31T05:09:59.429 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T05:09:59.429 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T05:09:59.429 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T05:09:59.429 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T05:09:59.429 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T05:09:59.429 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T05:09:59.429 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T05:09:59.430 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T05:09:59.430 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T05:09:59.430 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T05:09:59.430 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T05:09:59.430 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:59.430 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:09:59.430 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================== 2024-08-31T05:09:59.430 INFO:teuthology.orchestra.run.smithi073.stdout:Install 12 Packages 2024-08-31T05:09:59.430 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:09:59.431 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 38 M 2024-08-31T05:09:59.431 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 212 M 2024-08-31T05:09:59.431 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:09:59.508 INFO:teuthology.orchestra.run.smithi067.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-08-31T05:09:59.775 INFO:teuthology.orchestra.run.smithi067.stdout:(3/12): ceph-mgr-diskprediction-local-19.1.1-24 13 MB/s | 7.4 MB 00:00 2024-08-31T05:09:59.959 INFO:teuthology.orchestra.run.smithi073.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-08-31T05:10:00.010 INFO:teuthology.orchestra.run.smithi073.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.2 MB/s | 801 kB 00:00 2024-08-31T05:10:00.027 INFO:teuthology.orchestra.run.smithi073.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-08-31T05:10:00.033 INFO:teuthology.orchestra.run.smithi067.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 50 kB/s | 33 kB 00:00 2024-08-31T05:10:00.060 INFO:teuthology.orchestra.run.smithi073.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 546 kB/s | 18 kB 00:00 2024-08-31T05:10:00.094 INFO:teuthology.orchestra.run.smithi073.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 1.1 MB/s | 38 kB 00:00 2024-08-31T05:10:00.267 INFO:teuthology.orchestra.run.smithi067.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 38 kB/s | 18 kB 00:00 2024-08-31T05:10:00.294 INFO:teuthology.orchestra.run.smithi073.stdout:(6/12): ceph-mgr-diskprediction-local-19.1.1-24 16 MB/s | 7.4 MB 00:00 2024-08-31T05:10:00.419 INFO:teuthology.orchestra.run.smithi073.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-08-31T05:10:00.600 INFO:teuthology.orchestra.run.smithi067.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.7 MB/s | 3.0 MB 00:01 2024-08-31T05:10:00.626 INFO:teuthology.orchestra.run.smithi067.stdout:(7/12): openblas-0.3.26-2.el9.x86_64.rpm 65 kB/s | 38 kB 00:00 2024-08-31T05:10:00.778 INFO:teuthology.orchestra.run.smithi073.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.9 MB/s | 3.0 MB 00:00 2024-08-31T05:10:00.870 INFO:teuthology.orchestra.run.smithi073.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.7 MB/s | 250 kB 00:00 2024-08-31T05:10:01.278 INFO:teuthology.orchestra.run.smithi073.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.2 MB/s | 4.9 MB 00:01 2024-08-31T05:10:01.367 INFO:teuthology.orchestra.run.smithi067.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 320 kB/s | 245 kB 00:00 2024-08-31T05:10:01.434 INFO:teuthology.orchestra.run.smithi067.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 4.3 MB/s | 4.9 MB 00:01 2024-08-31T05:10:01.620 INFO:teuthology.orchestra.run.smithi073.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-08-31T05:10:01.768 INFO:teuthology.orchestra.run.smithi067.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.5 MB/s | 5.1 MB 00:01 2024-08-31T05:10:02.168 INFO:teuthology.orchestra.run.smithi067.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 313 kB/s | 250 kB 00:00 2024-08-31T05:10:02.910 INFO:teuthology.orchestra.run.smithi067.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-31T05:10:02.911 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:02.911 INFO:teuthology.orchestra.run.smithi067.stdout:Total 10 MB/s | 38 MB 00:03 2024-08-31T05:10:03.279 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:10:03.306 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:10:03.307 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:10:03.742 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:10:03.743 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:10:04.522 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:10:04.573 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-08-31T05:10:04.609 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-08-31T05:10:04.715 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-08-31T05:10:04.768 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-08-31T05:10:04.959 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-08-31T05:10:04.992 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-08-31T05:10:05.071 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-08-31T05:10:05.195 INFO:teuthology.orchestra.run.smithi073.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-08-31T05:10:05.196 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:05.196 INFO:teuthology.orchestra.run.smithi073.stdout:Total 6.6 MB/s | 38 MB 00:05 2024-08-31T05:10:05.550 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:10:05.575 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:10:05.575 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:10:05.764 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-08-31T05:10:05.893 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-08-31T05:10:05.982 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:10:05.983 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:10:06.752 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:10:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-08-31T05:10:06.860 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-08-31T05:10:06.957 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-08-31T05:10:07.011 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-08-31T05:10:07.195 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-08-31T05:10:07.198 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-08-31T05:10:07.235 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-08-31T05:10:07.310 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-08-31T05:10:07.980 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-08-31T05:10:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-08-31T05:10:08.285 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-08-31T05:10:08.309 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-242.g244a32 12/12 2024-08-31T05:10:09.352 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-08-31T05:10:10.406 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-08-31T05:10:10.443 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-242.g244a32 12/12 2024-08-31T05:10:10.796 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-242.g244a32 12/12 2024-08-31T05:10:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-242.g244a32 1/12 2024-08-31T05:10:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-08-31T05:10:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-08-31T05:10:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-08-31T05:10:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-08-31T05:10:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-08-31T05:10:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-08-31T05:10:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-08-31T05:10:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-08-31T05:10:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-08-31T05:10:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-08-31T05:10:11.200 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-08-31T05:10:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:11.201 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:10:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:10:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T05:10:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T05:10:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T05:10:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T05:10:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T05:10:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T05:10:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T05:10:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T05:10:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T05:10:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T05:10:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T05:10:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:11.202 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:11.561 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr-rook 2024-08-31T05:10:12.132 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:31 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:12.270 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:12.271 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:12.272 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-08-31T05:10:12.272 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:12.272 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:10:12.272 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 49 k 2024-08-31T05:10:12.272 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-08-31T05:10:12.272 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T05:10:12.272 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T05:10:12.272 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T05:10:12.272 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T05:10:12.272 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T05:10:12.272 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T05:10:12.272 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T05:10:12.273 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T05:10:12.273 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T05:10:12.273 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T05:10:12.273 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T05:10:12.273 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T05:10:12.273 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:12.273 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:10:12.273 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:12.273 INFO:teuthology.orchestra.run.smithi067.stdout:Install 13 Packages 2024-08-31T05:10:12.273 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:12.274 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 2.2 M 2024-08-31T05:10:12.274 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 26 M 2024-08-31T05:10:12.274 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:10:12.758 INFO:teuthology.orchestra.run.smithi067.stdout:(1/13): ceph-mgr-rook-19.1.1-242.g244a32d3.el9. 291 kB/s | 49 kB 00:00 2024-08-31T05:10:13.026 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-242.g244a32 12/12 2024-08-31T05:10:13.026 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-242.g244a32 1/12 2024-08-31T05:10:13.026 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-08-31T05:10:13.026 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-08-31T05:10:13.026 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-08-31T05:10:13.026 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-08-31T05:10:13.026 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-08-31T05:10:13.026 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-08-31T05:10:13.026 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-08-31T05:10:13.026 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-08-31T05:10:13.026 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-08-31T05:10:13.027 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-08-31T05:10:13.141 INFO:teuthology.orchestra.run.smithi067.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 35 kB/s | 19 kB 00:00 2024-08-31T05:10:13.167 INFO:teuthology.orchestra.run.smithi067.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 44 kB/s | 26 kB 00:00 2024-08-31T05:10:13.463 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-08-31T05:10:13.463 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:13.463 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:10:13.463 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:10:13.464 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T05:10:13.464 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T05:10:13.464 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T05:10:13.464 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T05:10:13.464 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T05:10:13.464 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T05:10:13.464 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T05:10:13.464 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T05:10:13.464 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T05:10:13.464 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T05:10:13.464 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T05:10:13.465 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:13.465 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:13.534 INFO:teuthology.orchestra.run.smithi067.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 286 kB/s | 222 kB 00:00 2024-08-31T05:10:13.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-rook 2024-08-31T05:10:13.934 INFO:teuthology.orchestra.run.smithi067.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 201 kB/s | 159 kB 00:00 2024-08-31T05:10:13.959 INFO:teuthology.orchestra.run.smithi067.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 352 kB/s | 279 kB 00:00 2024-08-31T05:10:14.001 INFO:teuthology.orchestra.run.smithi067.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 485 kB/s | 32 kB 00:00 2024-08-31T05:10:14.026 INFO:teuthology.orchestra.run.smithi067.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 242 kB/s | 14 kB 00:00 2024-08-31T05:10:14.052 INFO:teuthology.orchestra.run.smithi067.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.5 MB/s | 220 kB 00:00 2024-08-31T05:10:14.095 INFO:teuthology.orchestra.run.smithi067.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.3 MB/s | 59 kB 00:00 2024-08-31T05:10:14.127 INFO:teuthology.orchestra.run.smithi067.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.8 MB/s | 90 kB 00:00 2024-08-31T05:10:14.152 INFO:teuthology.orchestra.run.smithi067.stdout:(12/13): python3-requests-oauthlib-1.3.0-12.el9 87 kB/s | 54 kB 00:00 2024-08-31T05:10:14.194 INFO:teuthology.orchestra.run.smithi067.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.1 MB/s | 1.0 MB 00:00 2024-08-31T05:10:14.197 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:14.198 INFO:teuthology.orchestra.run.smithi067.stdout:Total 1.2 MB/s | 2.2 MB 00:01 2024-08-31T05:10:14.269 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:10:14.286 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:10:14.286 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:10:14.380 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:10:14.382 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:10:14.383 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:30 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:14.515 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:14.516 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:14.516 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-08-31T05:10:14.516 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:14.516 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:10:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 49 k 2024-08-31T05:10:14.517 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-08-31T05:10:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T05:10:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T05:10:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T05:10:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T05:10:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T05:10:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T05:10:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T05:10:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T05:10:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T05:10:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T05:10:14.517 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T05:10:14.518 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T05:10:14.518 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:14.518 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:10:14.518 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:14.518 INFO:teuthology.orchestra.run.smithi073.stdout:Install 13 Packages 2024-08-31T05:10:14.518 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:14.518 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 2.2 M 2024-08-31T05:10:14.518 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 26 M 2024-08-31T05:10:14.519 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:10:14.902 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:10:15.053 INFO:teuthology.orchestra.run.smithi073.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 158 kB/s | 19 kB 00:00 2024-08-31T05:10:15.076 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-08-31T05:10:15.078 INFO:teuthology.orchestra.run.smithi073.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 175 kB/s | 26 kB 00:00 2024-08-31T05:10:15.103 INFO:teuthology.orchestra.run.smithi073.stdout:(3/13): ceph-mgr-rook-19.1.1-242.g244a32d3.el9. 287 kB/s | 49 kB 00:00 2024-08-31T05:10:15.139 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-08-31T05:10:15.178 INFO:teuthology.orchestra.run.smithi073.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 222 kB 00:00 2024-08-31T05:10:15.203 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-08-31T05:10:15.204 INFO:teuthology.orchestra.run.smithi073.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-08-31T05:10:15.237 INFO:teuthology.orchestra.run.smithi073.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 917 kB/s | 54 kB 00:00 2024-08-31T05:10:15.247 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-08-31T05:10:15.271 INFO:teuthology.orchestra.run.smithi073.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-08-31T05:10:15.289 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-08-31T05:10:15.296 INFO:teuthology.orchestra.run.smithi073.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 248 kB/s | 14 kB 00:00 2024-08-31T05:10:15.321 INFO:teuthology.orchestra.run.smithi073.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.4 MB/s | 220 kB 00:00 2024-08-31T05:10:15.355 INFO:teuthology.orchestra.run.smithi073.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.1 MB/s | 279 kB 00:00 2024-08-31T05:10:15.380 INFO:teuthology.orchestra.run.smithi073.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-08-31T05:10:15.405 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-08-31T05:10:15.431 INFO:teuthology.orchestra.run.smithi073.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 7.6 MB/s | 1.0 MB 00:00 2024-08-31T05:10:15.456 INFO:teuthology.orchestra.run.smithi073.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 895 kB/s | 90 kB 00:00 2024-08-31T05:10:15.459 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:15.459 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-08-31T05:10:15.523 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-08-31T05:10:15.526 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:10:15.542 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:10:15.543 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:10:15.574 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-08-31T05:10:15.629 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:10:15.630 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:10:16.152 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:10:16.327 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-08-31T05:10:16.342 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-08-31T05:10:16.390 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-08-31T05:10:16.395 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-08-31T05:10:16.429 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-08-31T05:10:16.453 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-08-31T05:10:16.478 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-08-31T05:10:16.491 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-08-31T05:10:16.506 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-rook-2:19.1.1-242.g244a32d3.el9.noarch 13/13 2024-08-31T05:10:16.541 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-08-31T05:10:16.643 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-08-31T05:10:16.744 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-08-31T05:10:16.801 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-08-31T05:10:17.245 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-242.g244a32d3.el9.noarch 13/13 2024-08-31T05:10:17.246 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-rook-2:19.1.1-242.g244a32d3.el9.noarch 1/13 2024-08-31T05:10:17.246 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-08-31T05:10:17.246 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-08-31T05:10:17.246 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-08-31T05:10:17.246 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-08-31T05:10:17.246 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-08-31T05:10:17.246 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-08-31T05:10:17.246 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-08-31T05:10:17.246 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-08-31T05:10:17.246 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-08-31T05:10:17.246 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-08-31T05:10:17.246 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-08-31T05:10:17.524 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-08-31T05:10:17.573 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-08-31T05:10:17.573 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:17.573 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:10:17.573 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:10:17.573 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T05:10:17.574 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T05:10:17.574 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T05:10:17.574 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T05:10:17.574 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T05:10:17.574 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T05:10:17.574 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T05:10:17.574 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T05:10:17.574 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T05:10:17.574 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T05:10:17.574 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T05:10:17.574 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T05:10:17.574 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:17.574 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:17.575 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-08-31T05:10:17.607 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-08-31T05:10:17.655 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-08-31T05:10:17.678 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:19.1.1-242.g244a32d3.el9.noarch 13/13 2024-08-31T05:10:17.797 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr-cephadm 2024-08-31T05:10:18.368 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:37 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:18.377 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-242.g244a32d3.el9.noarch 13/13 2024-08-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:19.1.1-242.g244a32d3.el9.noarch 1/13 2024-08-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-08-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-08-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-08-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-08-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-08-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-08-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-08-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-08-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-08-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-08-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-08-31T05:10:18.507 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:18.507 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:18.507 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-08-31T05:10:18.507 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:18.508 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:10:18.508 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 146 k 2024-08-31T05:10:18.508 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-08-31T05:10:18.508 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T05:10:18.508 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T05:10:18.508 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T05:10:18.508 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T05:10:18.508 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T05:10:18.508 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:18.508 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:10:18.508 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:18.508 INFO:teuthology.orchestra.run.smithi067.stdout:Install 6 Packages 2024-08-31T05:10:18.508 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:18.509 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 7.0 M 2024-08-31T05:10:18.509 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 33 M 2024-08-31T05:10:18.509 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:10:18.712 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-08-31T05:10:18.712 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:18.712 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:10:18.712 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:10:18.712 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T05:10:18.712 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T05:10:18.712 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T05:10:18.713 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T05:10:18.713 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T05:10:18.713 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T05:10:18.713 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T05:10:18.713 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T05:10:18.713 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T05:10:18.713 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T05:10:18.713 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T05:10:18.713 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T05:10:18.713 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:18.713 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:18.795 INFO:teuthology.orchestra.run.smithi067.stdout:(1/6): ceph-mgr-cephadm-19.1.1-242.g244a32d3.el 714 kB/s | 146 kB 00:00 2024-08-31T05:10:18.829 INFO:teuthology.orchestra.run.smithi067.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-08-31T05:10:18.879 INFO:teuthology.orchestra.run.smithi067.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-08-31T05:10:18.905 INFO:teuthology.orchestra.run.smithi067.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 765 kB/s | 58 kB 00:00 2024-08-31T05:10:18.930 INFO:teuthology.orchestra.run.smithi067.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-08-31T05:10:18.971 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-cephadm 2024-08-31T05:10:19.089 INFO:teuthology.orchestra.run.smithi067.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-08-31T05:10:19.090 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:19.091 INFO:teuthology.orchestra.run.smithi067.stdout:Total 12 MB/s | 7.0 MB 00:00 2024-08-31T05:10:19.163 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:10:19.174 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:10:19.175 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:10:19.277 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:10:19.278 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:10:19.528 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:35 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:19.585 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:10:19.662 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:19.663 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:19.663 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-08-31T05:10:19.663 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:19.663 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:10:19.663 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:19.1.1-242.g244a32d3.el9 ceph-noarch 146 k 2024-08-31T05:10:19.663 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-08-31T05:10:19.663 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T05:10:19.663 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T05:10:19.663 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T05:10:19.663 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T05:10:19.663 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T05:10:19.663 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:19.663 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:10:19.664 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:19.664 INFO:teuthology.orchestra.run.smithi073.stdout:Install 6 Packages 2024-08-31T05:10:19.664 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:19.664 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 7.0 M 2024-08-31T05:10:19.664 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 33 M 2024-08-31T05:10:19.664 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:10:19.761 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-08-31T05:10:19.816 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-08-31T05:10:19.958 INFO:teuthology.orchestra.run.smithi073.stdout:(1/6): ceph-mgr-cephadm-19.1.1-242.g244a32d3.el 676 kB/s | 146 kB 00:00 2024-08-31T05:10:19.984 INFO:teuthology.orchestra.run.smithi073.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-08-31T05:10:20.042 INFO:teuthology.orchestra.run.smithi073.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-08-31T05:10:20.068 INFO:teuthology.orchestra.run.smithi073.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 689 kB/s | 58 kB 00:00 2024-08-31T05:10:20.093 INFO:teuthology.orchestra.run.smithi073.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-08-31T05:10:20.235 INFO:teuthology.orchestra.run.smithi073.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-08-31T05:10:20.237 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:20.237 INFO:teuthology.orchestra.run.smithi073.stdout:Total 12 MB/s | 7.0 MB 00:00 2024-08-31T05:10:20.308 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:10:20.319 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:10:20.319 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:10:20.376 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-08-31T05:10:20.417 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:10:20.419 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:10:20.470 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-08-31T05:10:20.550 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-08-31T05:10:20.577 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-242.g244a32d3.el9.noarch 6/6 2024-08-31T05:10:20.718 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:10:20.888 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-08-31T05:10:20.945 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-08-31T05:10:21.288 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-242.g244a32d3.el9.noarch 6/6 2024-08-31T05:10:21.288 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-242.g244a32d3.el9.noarch 1/6 2024-08-31T05:10:21.288 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-08-31T05:10:21.288 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-08-31T05:10:21.288 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-08-31T05:10:21.289 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-08-31T05:10:21.465 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-08-31T05:10:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-08-31T05:10:21.572 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-08-31T05:10:21.572 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:21.573 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:10:21.573 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:10:21.573 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T05:10:21.573 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T05:10:21.573 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T05:10:21.573 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T05:10:21.573 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T05:10:21.573 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:21.573 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:21.619 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-08-31T05:10:21.649 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-242.g244a32d3.el9.noarch 6/6 2024-08-31T05:10:21.844 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-fuse 2024-08-31T05:10:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-242.g244a32d3.el9.noarch 6/6 2024-08-31T05:10:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-242.g244a32d3.el9.noarch 1/6 2024-08-31T05:10:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-08-31T05:10:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-08-31T05:10:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-08-31T05:10:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-08-31T05:10:22.406 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:41 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:22.544 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:22.544 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:22.545 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-08-31T05:10:22.545 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:22.545 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:10:22.545 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse x86_64 2:19.1.1-242.g244a32d3.el9 ceph 896 k 2024-08-31T05:10:22.545 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-08-31T05:10:22.545 INFO:teuthology.orchestra.run.smithi067.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T05:10:22.545 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:22.545 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:10:22.545 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:22.545 INFO:teuthology.orchestra.run.smithi067.stdout:Install 2 Packages 2024-08-31T05:10:22.545 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:22.546 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 976 k 2024-08-31T05:10:22.546 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 2.9 M 2024-08-31T05:10:22.546 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:10:22.645 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-08-31T05:10:22.645 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:22.645 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:10:22.645 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:19.1.1-242.g244a32d3.el9.noarch 2024-08-31T05:10:22.645 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T05:10:22.646 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T05:10:22.646 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T05:10:22.646 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T05:10:22.646 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T05:10:22.646 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:22.646 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:22.898 INFO:teuthology.orchestra.run.smithi067.stdout:(1/2): ceph-fuse-19.1.1-242.g244a32d3.el9.x86_6 3.4 MB/s | 896 kB 00:00 2024-08-31T05:10:22.931 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-fuse 2024-08-31T05:10:23.365 INFO:teuthology.orchestra.run.smithi067.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 110 kB/s | 80 kB 00:00 2024-08-31T05:10:23.366 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:23.366 INFO:teuthology.orchestra.run.smithi067.stdout:Total 1.2 MB/s | 976 kB 00:00 2024-08-31T05:10:23.378 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:10:23.402 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:10:23.402 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:10:23.481 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:39 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:23.485 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:10:23.486 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:10:23.613 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:23.613 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:23.613 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-08-31T05:10:23.613 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:23.613 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:10:23.613 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:19.1.1-242.g244a32d3.el9 ceph 896 k 2024-08-31T05:10:23.613 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-08-31T05:10:23.614 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T05:10:23.614 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:23.614 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:10:23.614 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:23.614 INFO:teuthology.orchestra.run.smithi073.stdout:Install 2 Packages 2024-08-31T05:10:23.614 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:23.614 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 976 k 2024-08-31T05:10:23.615 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 2.9 M 2024-08-31T05:10:23.615 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:10:23.681 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:10:23.830 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-08-31T05:10:23.907 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 2/2 2024-08-31T05:10:24.003 INFO:teuthology.orchestra.run.smithi073.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 664 kB/s | 80 kB 00:00 2024-08-31T05:10:24.179 INFO:teuthology.orchestra.run.smithi073.stdout:(2/2): ceph-fuse-19.1.1-242.g244a32d3.el9.x86_6 3.0 MB/s | 896 kB 00:00 2024-08-31T05:10:24.179 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:24.180 INFO:teuthology.orchestra.run.smithi073.stdout:Total 1.7 MB/s | 976 kB 00:00 2024-08-31T05:10:24.191 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:10:24.213 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:10:24.214 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:10:24.294 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:10:24.294 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:10:24.486 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:10:24.582 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 2/2 2024-08-31T05:10:24.582 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 1/2 2024-08-31T05:10:24.640 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-08-31T05:10:24.710 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 2/2 2024-08-31T05:10:24.847 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-08-31T05:10:24.847 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:24.848 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:10:24.848 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-08-31T05:10:24.848 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:24.848 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:25.093 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install librados-devel 2024-08-31T05:10:25.400 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 2/2 2024-08-31T05:10:25.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 1/2 2024-08-31T05:10:25.660 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-08-31T05:10:25.660 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:25.660 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:10:25.660 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-08-31T05:10:25.660 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:25.661 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:25.664 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:44 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:25.802 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:25.803 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:25.803 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repo Size 2024-08-31T05:10:25.803 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:25.803 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:10:25.803 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel x86_64 2:19.1.1-242.g244a32d3.el9 ceph 127 k 2024-08-31T05:10:25.803 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:25.803 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:10:25.803 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:25.803 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2024-08-31T05:10:25.803 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:25.803 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 127 k 2024-08-31T05:10:25.804 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 456 k 2024-08-31T05:10:25.804 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:10:25.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados-devel 2024-08-31T05:10:26.011 INFO:teuthology.orchestra.run.smithi067.stdout:librados-devel-19.1.1-242.g244a32d3.el9.x86_64. 612 kB/s | 127 kB 00:00 2024-08-31T05:10:26.011 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:26.012 INFO:teuthology.orchestra.run.smithi067.stdout:Total 607 kB/s | 127 kB 00:00 2024-08-31T05:10:26.012 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:10:26.018 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:10:26.018 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:10:26.084 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:10:26.084 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:10:26.253 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:10:26.403 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librados-devel-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:26.493 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:42 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:26.632 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:26.632 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:26.633 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-08-31T05:10:26.633 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:26.633 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:10:26.633 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:19.1.1-242.g244a32d3.el9 ceph 127 k 2024-08-31T05:10:26.633 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:26.633 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:10:26.633 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:26.633 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-08-31T05:10:26.633 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:26.633 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 127 k 2024-08-31T05:10:26.633 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 456 k 2024-08-31T05:10:26.633 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:10:26.824 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados-devel-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:26.843 INFO:teuthology.orchestra.run.smithi073.stdout:librados-devel-19.1.1-242.g244a32d3.el9.x86_64. 604 kB/s | 127 kB 00:00 2024-08-31T05:10:26.844 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:26.844 INFO:teuthology.orchestra.run.smithi073.stdout:Total 599 kB/s | 127 kB 00:00 2024-08-31T05:10:26.844 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:10:26.850 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:10:26.850 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:10:26.917 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:10:26.917 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:10:27.071 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados-devel-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:27.071 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:27.071 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:10:27.071 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:10:27.071 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:27.072 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:27.075 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:10:27.173 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:27.298 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install libcephfs2 2024-08-31T05:10:27.638 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados-devel-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:27.869 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:46 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:27.908 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:27.908 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:27.909 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:10:27.909 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:10:27.909 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:27.909 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:27.960 INFO:teuthology.orchestra.run.smithi067.stdout:Package libcephfs2-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:10:28.006 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:28.007 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2024-08-31T05:10:28.007 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:28.072 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install libcephfs-devel 2024-08-31T05:10:28.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs2 2024-08-31T05:10:28.646 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:47 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:28.700 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:44 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:28.784 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:28.784 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:28.784 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repo Size 2024-08-31T05:10:28.784 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:28.784 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:10:28.784 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel x86_64 2:19.1.1-242.g244a32d3.el9 ceph 32 k 2024-08-31T05:10:28.784 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:28.784 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:10:28.785 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:28.785 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2024-08-31T05:10:28.785 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:28.785 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 32 k 2024-08-31T05:10:28.785 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 142 k 2024-08-31T05:10:28.785 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:10:28.792 INFO:teuthology.orchestra.run.smithi073.stdout:Package libcephfs2-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:10:28.836 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-08-31T05:10:28.837 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:28.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs-devel 2024-08-31T05:10:28.932 INFO:teuthology.orchestra.run.smithi067.stdout:libcephfs-devel-19.1.1-242.g244a32d3.el9.x86_64 217 kB/s | 32 kB 00:00 2024-08-31T05:10:28.932 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:28.932 INFO:teuthology.orchestra.run.smithi067.stdout:Total 215 kB/s | 32 kB 00:00 2024-08-31T05:10:28.932 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:10:28.936 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:10:28.936 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:10:28.940 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:10:28.941 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:10:29.030 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:10:29.146 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs-devel-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:29.463 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:45 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:29.526 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:29.596 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:29.596 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:29.596 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-08-31T05:10:29.596 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:29.596 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:10:29.596 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:19.1.1-242.g244a32d3.el9 ceph 32 k 2024-08-31T05:10:29.596 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:29.597 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:10:29.597 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:29.597 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-08-31T05:10:29.597 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:29.597 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 32 k 2024-08-31T05:10:29.597 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 142 k 2024-08-31T05:10:29.598 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:10:29.747 INFO:teuthology.orchestra.run.smithi073.stdout:libcephfs-devel-19.1.1-242.g244a32d3.el9.x86_64 213 kB/s | 32 kB 00:00 2024-08-31T05:10:29.747 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:29.747 INFO:teuthology.orchestra.run.smithi073.stdout:Total 210 kB/s | 32 kB 00:00 2024-08-31T05:10:29.748 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:10:29.751 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:10:29.751 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:10:29.753 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs-devel-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:29.754 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:29.754 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:10:29.754 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:10:29.754 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:29.754 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:29.756 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:10:29.757 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:10:29.835 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:10:29.920 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install librados2 2024-08-31T05:10:29.980 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:30.319 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:30.484 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:49 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:30.559 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:30.559 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:30.559 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:10:30.559 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:10:30.559 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:30.559 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:30.575 INFO:teuthology.orchestra.run.smithi067.stdout:Package librados2-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:10:30.621 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:30.622 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2024-08-31T05:10:30.622 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:30.681 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install librbd1 2024-08-31T05:10:30.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados2 2024-08-31T05:10:31.245 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:50 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:31.301 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:47 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:31.337 INFO:teuthology.orchestra.run.smithi067.stdout:Package librbd1-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:10:31.383 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:31.384 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2024-08-31T05:10:31.384 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:31.390 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:10:31.432 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:31.433 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-08-31T05:10:31.433 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:31.461 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install python3-rados 2024-08-31T05:10:31.503 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librbd1 2024-08-31T05:10:32.027 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:51 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:32.053 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:48 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:32.120 INFO:teuthology.orchestra.run.smithi067.stdout:Package python3-rados-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:10:32.143 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:10:32.166 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:32.167 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2024-08-31T05:10:32.167 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:32.185 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:32.186 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-08-31T05:10:32.186 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:32.233 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install python3-rgw 2024-08-31T05:10:32.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rados 2024-08-31T05:10:32.798 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:51 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:32.804 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:48 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:32.890 INFO:teuthology.orchestra.run.smithi067.stdout:Package python3-rgw-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:10:32.894 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rados-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:10:32.937 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:32.937 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:32.938 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-08-31T05:10:32.938 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:32.938 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2024-08-31T05:10:32.939 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:33.015 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rgw 2024-08-31T05:10:33.019 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install python3-cephfs 2024-08-31T05:10:33.565 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:49 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:33.587 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:52 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:33.655 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rgw-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:10:33.680 INFO:teuthology.orchestra.run.smithi067.stdout:Package python3-cephfs-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:10:33.697 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:33.698 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-08-31T05:10:33.698 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:33.726 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:33.727 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2024-08-31T05:10:33.728 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:33.774 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-cephfs 2024-08-31T05:10:33.908 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install python3-rbd 2024-08-31T05:10:34.332 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:50 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:34.422 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-cephfs-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:10:34.465 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:34.466 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-08-31T05:10:34.466 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:34.472 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:53 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:34.548 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rbd 2024-08-31T05:10:34.563 INFO:teuthology.orchestra.run.smithi067.stdout:Package python3-rbd-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:10:34.608 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:34.609 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2024-08-31T05:10:34.610 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:34.669 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install rbd-fuse 2024-08-31T05:10:35.101 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:51 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:35.189 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rbd-2:19.1.1-242.g244a32d3.el9.x86_64 is already installed. 2024-08-31T05:10:35.230 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:54 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:35.231 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:35.233 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-08-31T05:10:35.233 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:35.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-fuse 2024-08-31T05:10:35.368 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:35.368 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:35.368 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2024-08-31T05:10:35.368 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:35.369 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:10:35.369 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse x86_64 2:19.1.1-242.g244a32d3.el9 ceph 85 k 2024-08-31T05:10:35.369 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:35.369 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:10:35.369 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:35.369 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2024-08-31T05:10:35.369 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:35.369 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 85 k 2024-08-31T05:10:35.370 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 231 k 2024-08-31T05:10:35.370 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:10:35.560 INFO:teuthology.orchestra.run.smithi067.stdout:rbd-fuse-19.1.1-242.g244a32d3.el9.x86_64.rpm 449 kB/s | 85 kB 00:00 2024-08-31T05:10:35.560 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:35.560 INFO:teuthology.orchestra.run.smithi067.stdout:Total 445 kB/s | 85 kB 00:00 2024-08-31T05:10:35.561 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:10:35.568 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:10:35.568 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:10:35.633 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:10:35.634 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:10:35.778 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:10:35.859 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:51 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:35.883 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:35.991 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:35.992 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:35.992 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-08-31T05:10:35.992 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:35.992 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:10:35.992 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:19.1.1-242.g244a32d3.el9 ceph 85 k 2024-08-31T05:10:35.992 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:35.992 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:10:35.992 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:35.992 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-08-31T05:10:35.993 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:35.993 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 85 k 2024-08-31T05:10:35.993 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 231 k 2024-08-31T05:10:35.993 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:10:36.200 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-fuse-19.1.1-242.g244a32d3.el9.x86_64.rpm 410 kB/s | 85 kB 00:00 2024-08-31T05:10:36.201 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:36.201 INFO:teuthology.orchestra.run.smithi073.stdout:Total 407 kB/s | 85 kB 00:00 2024-08-31T05:10:36.201 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:10:36.208 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:10:36.208 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:10:36.254 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:36.270 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:10:36.271 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:10:36.413 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:10:36.521 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:36.521 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:36.521 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:10:36.521 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:10:36.521 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:36.521 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:36.744 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install rbd-mirror 2024-08-31T05:10:36.879 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:37.132 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:37.132 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:37.132 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:10:37.132 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:10:37.132 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:37.132 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:37.315 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:56 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:37.385 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-mirror 2024-08-31T05:10:37.463 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:37.464 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:37.464 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repo Size 2024-08-31T05:10:37.464 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:37.464 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:10:37.464 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror x86_64 2:19.1.1-242.g244a32d3.el9 ceph 3.1 M 2024-08-31T05:10:37.464 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:37.464 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:10:37.465 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:37.465 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2024-08-31T05:10:37.465 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:37.465 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 3.1 M 2024-08-31T05:10:37.465 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 13 M 2024-08-31T05:10:37.465 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:10:37.779 INFO:teuthology.orchestra.run.smithi067.stdout:rbd-mirror-19.1.1-242.g244a32d3.el9.x86_64.rpm 9.9 MB/s | 3.1 MB 00:00 2024-08-31T05:10:37.780 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:37.780 INFO:teuthology.orchestra.run.smithi067.stdout:Total 9.8 MB/s | 3.1 MB 00:00 2024-08-31T05:10:37.780 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:10:37.790 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:10:37.790 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:10:37.875 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:10:37.875 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:10:37.955 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:53 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:38.090 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:38.091 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:38.091 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-08-31T05:10:38.091 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:38.091 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:10:38.091 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:19.1.1-242.g244a32d3.el9 ceph 3.1 M 2024-08-31T05:10:38.092 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:38.092 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:10:38.092 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:38.092 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-08-31T05:10:38.092 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:38.092 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 3.1 M 2024-08-31T05:10:38.092 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 13 M 2024-08-31T05:10:38.092 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:10:38.320 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:10:38.380 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-mirror-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:38.405 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-mirror-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:38.406 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:10:38.406 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T05:10:38.406 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:10:38.406 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:10:38.406 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:38.429 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-mirror-19.1.1-242.g244a32d3.el9.x86_64.rpm 9.2 MB/s | 3.1 MB 00:00 2024-08-31T05:10:38.429 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:38.430 INFO:teuthology.orchestra.run.smithi073.stdout:Total 9.2 MB/s | 3.1 MB 00:00 2024-08-31T05:10:38.430 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:10:38.439 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:10:38.439 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:10:38.520 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:10:38.521 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:10:38.958 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:10:39.146 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:39.172 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:39.172 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:10:39.172 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T05:10:39.173 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:10:39.173 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:10:39.173 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:39.528 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-mirror-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:39.528 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:39.528 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:10:39.528 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:10:39.528 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:39.528 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:39.790 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install rbd-nbd 2024-08-31T05:10:40.142 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:40.142 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:40.143 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:10:40.143 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:10:40.143 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:40.143 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:40.366 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:59 ago on Sat 31 Aug 2024 05:08:41 AM UTC. 2024-08-31T05:10:40.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-nbd 2024-08-31T05:10:40.504 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-08-31T05:10:40.505 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:40.505 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2024-08-31T05:10:40.505 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:40.505 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-08-31T05:10:40.505 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd x86_64 2:19.1.1-242.g244a32d3.el9 ceph 170 k 2024-08-31T05:10:40.505 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:40.505 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-08-31T05:10:40.505 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-08-31T05:10:40.505 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2024-08-31T05:10:40.505 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:40.505 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 170 k 2024-08-31T05:10:40.505 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 494 k 2024-08-31T05:10:40.506 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-08-31T05:10:40.699 INFO:teuthology.orchestra.run.smithi067.stdout:rbd-nbd-19.1.1-242.g244a32d3.el9.x86_64.rpm 882 kB/s | 170 kB 00:00 2024-08-31T05:10:40.700 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:40.700 INFO:teuthology.orchestra.run.smithi067.stdout:Total 876 kB/s | 170 kB 00:00 2024-08-31T05:10:40.700 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-08-31T05:10:40.709 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-08-31T05:10:40.709 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-08-31T05:10:40.776 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-08-31T05:10:40.776 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-08-31T05:10:40.939 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-08-31T05:10:40.975 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:56 ago on Sat 31 Aug 2024 05:08:44 AM UTC. 2024-08-31T05:10:41.040 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-nbd-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:41.109 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-08-31T05:10:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:41.110 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-08-31T05:10:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-08-31T05:10:41.110 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:19.1.1-242.g244a32d3.el9 ceph 170 k 2024-08-31T05:10:41.110 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-08-31T05:10:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-08-31T05:10:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-08-31T05:10:41.111 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:41.111 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 170 k 2024-08-31T05:10:41.111 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 494 k 2024-08-31T05:10:41.111 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-08-31T05:10:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-nbd-19.1.1-242.g244a32d3.el9.x86_64.rpm 769 kB/s | 170 kB 00:00 2024-08-31T05:10:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:10:41.334 INFO:teuthology.orchestra.run.smithi073.stdout:Total 763 kB/s | 170 kB 00:00 2024-08-31T05:10:41.334 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-08-31T05:10:41.342 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-08-31T05:10:41.342 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-08-31T05:10:41.406 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-08-31T05:10:41.406 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-08-31T05:10:41.460 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-nbd-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:41.563 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-08-31T05:10:41.663 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:41.728 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-nbd-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:41.728 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:41.728 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-08-31T05:10:41.728 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:10:41.728 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:10:41.728 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-08-31T05:10:41.960 DEBUG:teuthology.parallel:result is None 2024-08-31T05:10:42.088 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-nbd-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:19.1.1-242.g244a32d3.el9.x86_64 1/1 2024-08-31T05:10:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:42.359 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-08-31T05:10:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:19.1.1-242.g244a32d3.el9.x86_64 2024-08-31T05:10:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:10:42.360 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-08-31T05:10:42.631 DEBUG:teuthology.parallel:result is None 2024-08-31T05:10:42.632 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T05:10:42.632 INFO:teuthology.packaging:ref: None 2024-08-31T05:10:42.632 INFO:teuthology.packaging:tag: None 2024-08-31T05:10:42.632 INFO:teuthology.packaging:branch: squid 2024-08-31T05:10:42.632 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:10:42.633 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-08-31T05:10:42.868 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T05:10:42.893 INFO:teuthology.orchestra.run.smithi067.stdout:19.1.1-242.g244a32d3.el9 2024-08-31T05:10:42.894 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-242.g244a32d3.el9 2024-08-31T05:10:42.894 INFO:teuthology.task.install:The correct ceph version 19.1.1-242.g244a32d3 is installed. 2024-08-31T05:10:42.895 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T05:10:42.896 INFO:teuthology.packaging:ref: None 2024-08-31T05:10:42.896 INFO:teuthology.packaging:tag: None 2024-08-31T05:10:42.896 INFO:teuthology.packaging:branch: squid 2024-08-31T05:10:42.896 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:10:42.896 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-08-31T05:10:43.126 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T05:10:43.151 INFO:teuthology.orchestra.run.smithi073.stdout:19.1.1-242.g244a32d3.el9 2024-08-31T05:10:43.151 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-242.g244a32d3.el9 2024-08-31T05:10:43.151 INFO:teuthology.task.install:The correct ceph version 19.1.1-242.g244a32d3 is installed. 2024-08-31T05:10:43.153 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-31T05:10:43.153 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:10:43.153 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T05:10:43.183 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-08-31T05:10:43.183 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T05:10:43.221 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-31T05:10:43.222 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:10:43.222 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T05:10:43.253 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T05:10:43.321 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-08-31T05:10:43.322 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T05:10:43.350 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T05:10:43.418 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-31T05:10:43.418 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:10:43.418 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T05:10:43.447 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T05:10:43.515 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-08-31T05:10:43.515 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T05:10:43.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T05:10:43.609 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-31T05:10:43.609 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:10:43.609 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T05:10:43.636 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T05:10:43.703 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-08-31T05:10:43.703 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T05:10:43.730 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T05:10:43.797 INFO:teuthology.run_tasks:Running task print... 2024-08-31T05:10:43.807 INFO:teuthology.task.print:**** done install task... 2024-08-31T05:10:43.807 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-31T05:10:43.966 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'} 2024-08-31T05:10:43.966 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-08-31T05:10:43.966 INFO:tasks.cephadm:Cluster fsid is 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:10:43.967 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-31T05:10:43.967 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-08-31T05:10:43.967 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi067': '172.21.15.67', 'mon.smithi073': '172.21.15.73'} 2024-08-31T05:10:43.967 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-31T05:10:43.967 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname $(hostname -s) 2024-08-31T05:10:43.996 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname $(hostname -s) 2024-08-31T05:10:44.023 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-08-31T05:10:44.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:10:44.166 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82586/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4560-gd19e6118', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4560.gd19e6118'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-28 11:15:32.801765', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-mchangir-testing-20240828.085847-main-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-08-31T05:10:44.395 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 244a32d3583bb0aa259286ff61157888a54a3ca5 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=squid 2024-08-31T05:10:44.396 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/244a32d3583bb0aa259286ff61157888a54a3ca5/centos/9/x86_64/flavors/default/cephadm 2024-08-31T05:10:44.396 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/244a32d3583bb0aa259286ff61157888a54a3ca5/centos/9/x86_64/flavors/default/cephadm 2024-08-31T05:10:44.396 DEBUG:teuthology.orchestra.run.smithi067:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/244a32d3583bb0aa259286ff61157888a54a3ca5/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T05:10:44.808 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r--. 1 ubuntu ubuntu 784446 Aug 31 05:10 /home/ubuntu/cephtest/cephadm 2024-08-31T05:10:44.808 DEBUG:teuthology.orchestra.run.smithi073:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/244a32d3583bb0aa259286ff61157888a54a3ca5/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T05:10:45.220 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r--. 1 ubuntu ubuntu 784446 Aug 31 05:10 /home/ubuntu/cephtest/cephadm 2024-08-31T05:10:45.220 DEBUG:teuthology.orchestra.run.smithi067:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T05:10:45.240 DEBUG:teuthology.orchestra.run.smithi073:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T05:10:45.270 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-08-31T05:10:45.271 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-08-31T05:10:45.283 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-08-31T05:10:46.770 INFO:teuthology.orchestra.run.smithi067.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-08-31T05:10:46.896 INFO:teuthology.orchestra.run.smithi073.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-08-31T05:11:32.184 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:11:32.184 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)", 2024-08-31T05:11:32.184 INFO:teuthology.orchestra.run.smithi067.stdout: "image_id": "395b9209a98089a0a9d1ab1754cc488d88f9ef293d652aedff868d7d45bee67c", 2024-08-31T05:11:32.184 INFO:teuthology.orchestra.run.smithi067.stdout: "repo_digests": [ 2024-08-31T05:11:32.185 INFO:teuthology.orchestra.run.smithi067.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a" 2024-08-31T05:11:32.185 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-08-31T05:11:32.185 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:11:36.120 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-08-31T05:11:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)", 2024-08-31T05:11:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: "image_id": "395b9209a98089a0a9d1ab1754cc488d88f9ef293d652aedff868d7d45bee67c", 2024-08-31T05:11:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: "repo_digests": [ 2024-08-31T05:11:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a" 2024-08-31T05:11:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-08-31T05:11:36.121 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-08-31T05:11:36.147 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph 2024-08-31T05:11:36.177 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph 2024-08-31T05:11:36.205 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /etc/ceph 2024-08-31T05:11:36.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /etc/ceph 2024-08-31T05:11:36.270 INFO:tasks.cephadm:Writing seed config... 2024-08-31T05:11:36.271 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-08-31T05:11:36.271 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-08-31T05:11:36.271 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-08-31T05:11:36.271 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-08-31T05:11:36.271 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-08-31T05:11:36.271 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-31T05:11:36.271 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-31T05:11:36.271 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-08-31T05:11:36.272 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-08-31T05:11:36.272 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-31T05:11:36.272 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-31T05:11:36.272 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-08-31T05:11:36.272 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-31T05:11:36.272 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-31T05:11:36.272 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-31T05:11:36.272 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-31T05:11:36.272 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-31T05:11:36.272 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-08-31T05:11:36.272 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-31T05:11:36.272 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-31T05:11:36.273 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-31T05:11:36.273 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-31T05:11:36.273 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-31T05:11:36.273 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-31T05:11:36.273 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-31T05:11:36.273 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:11:36.274 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-31T05:11:36.299 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5fd95148-6757-11ef-bcd4-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-08-31T05:11:36.299 DEBUG:teuthology.orchestra.run.smithi067:mon.smithi067> sudo journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi067.service 2024-08-31T05:11:36.341 INFO:tasks.cephadm:Bootstrapping... 2024-08-31T05:11:36.342 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.67 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:11:36.549 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:11:36.549 INFO:teuthology.orchestra.run.smithi067.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.67', '--skip-admin-label'] 2024-08-31T05:11:36.550 INFO:teuthology.orchestra.run.smithi067.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-31T05:11:36.550 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying podman|docker is present... 2024-08-31T05:11:36.574 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stdout 5.2.2 2024-08-31T05:11:36.574 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying lvm2 is present... 2024-08-31T05:11:36.574 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying time synchronization is in place... 2024-08-31T05:11:36.581 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T05:11:36.581 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T05:11:36.587 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T05:11:36.588 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2024-08-31T05:11:36.594 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout enabled 2024-08-31T05:11:36.600 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout active 2024-08-31T05:11:36.601 INFO:teuthology.orchestra.run.smithi067.stdout:Unit chronyd.service is enabled and running 2024-08-31T05:11:36.601 INFO:teuthology.orchestra.run.smithi067.stdout:Repeating the final host check... 2024-08-31T05:11:36.623 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stdout 5.2.2 2024-08-31T05:11:36.623 INFO:teuthology.orchestra.run.smithi067.stdout:podman (/bin/podman) version 5.2.2 is present 2024-08-31T05:11:36.624 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl is present 2024-08-31T05:11:36.624 INFO:teuthology.orchestra.run.smithi067.stdout:lvcreate is present 2024-08-31T05:11:36.630 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T05:11:36.630 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T05:11:36.636 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T05:11:36.636 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2024-08-31T05:11:36.642 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout enabled 2024-08-31T05:11:36.649 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout active 2024-08-31T05:11:36.649 INFO:teuthology.orchestra.run.smithi067.stdout:Unit chronyd.service is enabled and running 2024-08-31T05:11:36.649 INFO:teuthology.orchestra.run.smithi067.stdout:Host looks OK 2024-08-31T05:11:36.650 INFO:teuthology.orchestra.run.smithi067.stdout:Cluster fsid: 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:11:36.650 INFO:teuthology.orchestra.run.smithi067.stdout:Acquiring lock 139853841333552 on /run/cephadm/5fd95148-6757-11ef-bcd4-c7b262605968.lock 2024-08-31T05:11:36.650 INFO:teuthology.orchestra.run.smithi067.stdout:Lock 139853841333552 acquired on /run/cephadm/5fd95148-6757-11ef-bcd4-c7b262605968.lock 2024-08-31T05:11:36.650 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying IP 172.21.15.67 port 3300 ... 2024-08-31T05:11:36.650 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying IP 172.21.15.67 port 6789 ... 2024-08-31T05:11:36.651 INFO:teuthology.orchestra.run.smithi067.stdout:Base mon IP(s) is [172.21.15.67:3300, 172.21.15.67:6789], mon addrv is [v2:172.21.15.67:3300,v1:172.21.15.67:6789] 2024-08-31T05:11:36.653 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.67 metric 100 2024-08-31T05:11:36.653 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.67 metric 100 2024-08-31T05:11:36.655 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-31T05:11:36.656 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-08-31T05:11:36.656 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-08-31T05:11:36.659 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-31T05:11:36.659 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-31T05:11:36.659 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T05:11:36.659 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-08-31T05:11:36.659 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link noprefixroute 2024-08-31T05:11:36.659 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T05:11:36.659 INFO:teuthology.orchestra.run.smithi067.stdout:Mon IP `172.21.15.67` is in CIDR network `172.21.0.0/20` 2024-08-31T05:11:36.659 INFO:teuthology.orchestra.run.smithi067.stdout:Mon IP `172.21.15.67` is in CIDR network `172.21.0.0/20` 2024-08-31T05:11:36.659 INFO:teuthology.orchestra.run.smithi067.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-31T05:11:36.660 INFO:teuthology.orchestra.run.smithi067.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-31T05:11:36.660 INFO:teuthology.orchestra.run.smithi067.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-08-31T05:11:37.070 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stdout 395b9209a98089a0a9d1ab1754cc488d88f9ef293d652aedff868d7d45bee67c 2024-08-31T05:11:37.070 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:squid... 2024-08-31T05:11:37.070 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Getting image source signatures 2024-08-31T05:11:37.070 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Copying blob sha256:d45bd5a49424180e8a74eae92ab92bcef813a8ace57f68ed6338481a150740a7 2024-08-31T05:11:37.070 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-31T05:11:37.070 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Copying config sha256:395b9209a98089a0a9d1ab1754cc488d88f9ef293d652aedff868d7d45bee67c 2024-08-31T05:11:37.070 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-31T05:11:38.049 INFO:teuthology.orchestra.run.smithi067.stdout:ceph: stdout ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable) 2024-08-31T05:11:38.050 INFO:teuthology.orchestra.run.smithi067.stdout:Ceph version: ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable) 2024-08-31T05:11:38.050 INFO:teuthology.orchestra.run.smithi067.stdout:Extracting ceph user uid/gid from container image... 2024-08-31T05:11:39.047 INFO:teuthology.orchestra.run.smithi067.stdout:stat: stdout 167 167 2024-08-31T05:11:39.048 INFO:teuthology.orchestra.run.smithi067.stdout:Creating initial keys... 2024-08-31T05:11:39.927 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph-authtool: stdout AQALptJmd1SqFhAAj3EhI1mZjwpToELIiy7i9A== 2024-08-31T05:11:41.033 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph-authtool: stdout AQAMptJm3s/kDRAA+efnTWi+4G2VRlAjQcmrkg== 2024-08-31T05:11:41.864 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph-authtool: stdout AQANptJmzMTcEhAA8SQzIqdD3gAcqUWUU5IkJw== 2024-08-31T05:11:41.865 INFO:teuthology.orchestra.run.smithi067.stdout:Creating initial monmap... 2024-08-31T05:11:42.887 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T05:11:42.887 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-31T05:11:42.887 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:11:42.887 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T05:11:42.887 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool for smithi067 [v2:172.21.15.67:3300,v1:172.21.15.67:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T05:11:42.887 INFO:teuthology.orchestra.run.smithi067.stdout:setting min_mon_release = quincy 2024-08-31T05:11:42.887 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: set fsid to 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:11:42.887 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T05:11:42.888 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:11:42.888 INFO:teuthology.orchestra.run.smithi067.stdout:Creating mon... 2024-08-31T05:11:43.976 INFO:teuthology.orchestra.run.smithi067.stdout:create mon.smithi067 on 2024-08-31T05:11:44.184 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-31T05:11:44.333 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-31T05:11:44.605 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5fd95148-6757-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-5fd95148-6757-11ef-bcd4-c7b262605968.target. 2024-08-31T05:11:44.605 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5fd95148-6757-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-5fd95148-6757-11ef-bcd4-c7b262605968.target. 2024-08-31T05:11:44.847 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi067 2024-08-31T05:11:44.847 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi067.service: Unit ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi067.service not loaded. 2024-08-31T05:11:45.022 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5fd95148-6757-11ef-bcd4-c7b262605968.target.wants/ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi067.service → /etc/systemd/system/ceph-5fd95148-6757-11ef-bcd4-c7b262605968@.service. 2024-08-31T05:11:45.508 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T05:11:45.508 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout disabled 2024-08-31T05:11:45.515 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T05:11:45.515 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2024-08-31T05:11:45.515 INFO:teuthology.orchestra.run.smithi067.stdout:firewalld.service is not enabled 2024-08-31T05:11:45.515 INFO:teuthology.orchestra.run.smithi067.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T05:11:45.516 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mon to start... 2024-08-31T05:11:45.516 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mon... 2024-08-31T05:11:46.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:46 smithi067 ceph-mon[17065]: from='client.? 172.21.15.67:0/4289784924' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-08-31T05:11:46.572 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout cluster: 2024-08-31T05:11:46.574 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout id: 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:11:46.574 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-31T05:11:46.575 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-08-31T05:11:46.575 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout services: 2024-08-31T05:11:46.575 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi067 (age 0.535741s) 2024-08-31T05:11:46.575 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-31T05:11:46.575 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-31T05:11:46.575 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-08-31T05:11:46.575 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout data: 2024-08-31T05:11:46.575 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-31T05:11:46.575 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-31T05:11:46.575 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-31T05:11:46.575 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout pgs: 2024-08-31T05:11:46.575 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-08-31T05:11:46.575 INFO:teuthology.orchestra.run.smithi067.stdout:mon is available 2024-08-31T05:11:46.576 INFO:teuthology.orchestra.run.smithi067.stdout:Assimilating anything we can from ceph.conf... 2024-08-31T05:11:47.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:47 smithi067 ceph-mon[17065]: from='client.? 172.21.15.67:0/509849478' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-31T05:11:47.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:47 smithi067 ceph-mon[17065]: from='client.? 172.21.15.67:0/509849478' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-31T05:11:47.645 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-08-31T05:11:47.645 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T05:11:47.645 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout fsid = 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:11:47.645 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.67:3300,v1:172.21.15.67:6789] 2024-08-31T05:11:47.645 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T05:11:47.645 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T05:11:47.645 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T05:11:47.645 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T05:11:47.646 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-08-31T05:11:47.646 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T05:11:47.646 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T05:11:47.646 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-08-31T05:11:47.646 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T05:11:47.646 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-31T05:11:47.646 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-31T05:11:47.646 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-31T05:11:47.646 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T05:11:47.646 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T05:11:47.646 INFO:teuthology.orchestra.run.smithi067.stdout:Generating new minimal ceph.conf... 2024-08-31T05:11:48.650 INFO:teuthology.orchestra.run.smithi067.stdout:Restarting the monitor... 2024-08-31T05:11:48.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:48 smithi067 ceph-mon[17065]: from='client.? 172.21.15.67:0/2895407248' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:11:48.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:48 smithi067 systemd[1]: Stopping Ceph mon.smithi067 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:11:49.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:48 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067[17061]: 2024-08-31T05:11:48.931+0000 7f711f3e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi067 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:11:49.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:48 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067[17061]: 2024-08-31T05:11:48.931+0000 7f711f3e6640 -1 mon.smithi067@0(leader) e1 *** Got Signal Terminated *** 2024-08-31T05:11:49.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:49 smithi067 podman[17308]: 2024-08-31 05:11:49.064920471 +0000 UTC m=+0.248915543 container died 202183580e97e7cb1e787b853182049c103922031e6a6fe5e6ec92d93bd40093 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-244a32d, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-31T05:11:49.786 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:49 smithi067 podman[17308]: 2024-08-31 05:11:49.406597943 +0000 UTC m=+0.590593017 container cleanup 202183580e97e7cb1e787b853182049c103922031e6a6fe5e6ec92d93bd40093 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-244a32d, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:11:49.786 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:49 smithi067 bash[17308]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067 2024-08-31T05:11:49.786 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:49 smithi067 podman[17320]: 2024-08-31 05:11:49.574130342 +0000 UTC m=+0.508205294 container remove 202183580e97e7cb1e787b853182049c103922031e6a6fe5e6ec92d93bd40093 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067, RELEASE=squid-244a32d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-31T05:11:50.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:49 smithi067 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi067.service: Deactivated successfully. 2024-08-31T05:11:50.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:49 smithi067 systemd[1]: Stopped Ceph mon.smithi067 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:11:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:49 smithi067 systemd[1]: Starting Ceph mon.smithi067 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:11:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 podman[17414]: 2024-08-31 05:11:49.99971541 +0000 UTC m=+0.111706890 container create 7082a38c8108d2401e6933da8417866d80fee34e8d7876cbcf80a0c6224ae8a0 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067, RELEASE=squid-244a32d, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:11:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 podman[17414]: 2024-08-31 05:11:49.903868426 +0000 UTC m=+0.015859915 image pull 395b9209a98089a0a9d1ab1754cc488d88f9ef293d652aedff868d7d45bee67c quay.ceph.io/ceph-ci/ceph:squid 2024-08-31T05:11:50.316 INFO:teuthology.orchestra.run.smithi067.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-31T05:11:50.437 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 podman[17414]: 2024-08-31 05:11:50.227000711 +0000 UTC m=+0.338992186 container init 7082a38c8108d2401e6933da8417866d80fee34e8d7876cbcf80a0c6224ae8a0 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-244a32d, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:11:50.438 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 podman[17414]: 2024-08-31 05:11:50.22999264 +0000 UTC m=+0.341984117 container start 7082a38c8108d2401e6933da8417866d80fee34e8d7876cbcf80a0c6224ae8a0 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-244a32d, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-08-31T05:11:50.438 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T05:11:50.438 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable), process ceph-mon, pid 2 2024-08-31T05:11:50.438 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: pidfile_write: ignore empty --pid-file 2024-08-31T05:11:50.438 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: load: jerasure load: lrc 2024-08-31T05:11:50.438 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: RocksDB version: 7.9.2 2024-08-31T05:11:50.438 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Git sha 0 2024-08-31T05:11:50.438 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Compile date 2024-08-30 21:06:01 2024-08-31T05:11:50.438 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: DB SUMMARY 2024-08-31T05:11:50.439 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: DB Session ID: SCN8CVF53NN6Y9S8MLFU 2024-08-31T05:11:50.439 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: CURRENT file: CURRENT 2024-08-31T05:11:50.439 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T05:11:50.439 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-31T05:11:50.439 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi067/store.db dir, Total Num: 1, files: 000008.sst 2024-08-31T05:11:50.439 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi067/store.db: 000009.log size: 95375 ; 2024-08-31T05:11:50.439 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.error_if_exists: 0 2024-08-31T05:11:50.439 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.create_if_missing: 0 2024-08-31T05:11:50.439 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.paranoid_checks: 1 2024-08-31T05:11:50.439 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T05:11:50.439 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T05:11:50.439 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T05:11:50.439 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.env: 0x563ff7aa2940 2024-08-31T05:11:50.440 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T05:11:50.440 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.info_log: 0x563ff9761740 2024-08-31T05:11:50.440 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T05:11:50.440 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.statistics: (nil) 2024-08-31T05:11:50.440 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.use_fsync: 0 2024-08-31T05:11:50.441 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_log_file_size: 0 2024-08-31T05:11:50.442 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T05:11:50.442 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T05:11:50.442 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T05:11:50.442 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T05:11:50.442 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.allow_fallocate: 1 2024-08-31T05:11:50.442 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T05:11:50.442 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T05:11:50.442 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.use_direct_reads: 0 2024-08-31T05:11:50.442 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T05:11:50.443 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T05:11:50.443 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.db_log_dir: 2024-08-31T05:11:50.443 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.wal_dir: 2024-08-31T05:11:50.443 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T05:11:50.443 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T05:11:50.443 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T05:11:50.443 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T05:11:50.443 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T05:11:50.443 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T05:11:50.443 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T05:11:50.443 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T05:11:50.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.write_buffer_manager: 0x563ff9770dc0 2024-08-31T05:11:50.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T05:11:50.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T05:11:50.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T05:11:50.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T05:11:50.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T05:11:50.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T05:11:50.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T05:11:50.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T05:11:50.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.unordered_write: 0 2024-08-31T05:11:50.445 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T05:11:50.445 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T05:11:50.445 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T05:11:50.445 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T05:11:50.445 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.row_cache: None 2024-08-31T05:11:50.445 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.wal_filter: None 2024-08-31T05:11:50.445 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T05:11:50.445 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T05:11:50.445 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.two_write_queues: 0 2024-08-31T05:11:50.445 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T05:11:50.445 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.wal_compression: 0 2024-08-31T05:11:50.445 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.atomic_flush: 0 2024-08-31T05:11:50.445 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T05:11:50.446 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T05:11:50.446 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T05:11:50.446 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.log_readahead_size: 0 2024-08-31T05:11:50.446 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T05:11:50.446 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T05:11:50.446 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T05:11:50.446 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T05:11:50.446 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T05:11:50.446 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T05:11:50.446 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T05:11:50.446 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_background_jobs: 2 2024-08-31T05:11:50.447 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_background_compactions: -1 2024-08-31T05:11:50.447 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_subcompactions: 1 2024-08-31T05:11:50.447 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T05:11:50.447 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T05:11:50.447 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T05:11:50.447 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T05:11:50.447 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T05:11:50.447 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T05:11:50.447 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T05:11:50.447 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T05:11:50.447 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_open_files: -1 2024-08-31T05:11:50.447 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T05:11:50.448 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T05:11:50.448 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T05:11:50.448 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T05:11:50.448 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_background_flushes: -1 2024-08-31T05:11:50.448 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Compression algorithms supported: 2024-08-31T05:11:50.448 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: kZSTD supported: 0 2024-08-31T05:11:50.448 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: kXpressCompression supported: 0 2024-08-31T05:11:50.448 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: kBZip2Compression supported: 0 2024-08-31T05:11:50.448 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T05:11:50.448 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: kLZ4Compression supported: 1 2024-08-31T05:11:50.448 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: kZlibCompression supported: 1 2024-08-31T05:11:50.448 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T05:11:50.448 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: kSnappyCompression supported: 1 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi067/store.db/MANIFEST-000010 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.merge_operator: 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compaction_filter: None 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563ff97613a0) 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: cache_index_and_filter_blocks: 1 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T05:11:50.449 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: pin_top_level_index_and_filter: 1 2024-08-31T05:11:50.450 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: index_type: 0 2024-08-31T05:11:50.450 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: data_block_index_type: 0 2024-08-31T05:11:50.450 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: index_shortening: 1 2024-08-31T05:11:50.450 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T05:11:50.450 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: checksum: 4 2024-08-31T05:11:50.450 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: no_block_cache: 0 2024-08-31T05:11:50.450 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache: 0x563ff9755090 2024-08-31T05:11:50.450 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache_name: BinnedLRUCache 2024-08-31T05:11:50.450 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache_options: 2024-08-31T05:11:50.450 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: capacity : 536870912 2024-08-31T05:11:50.450 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: num_shard_bits : 4 2024-08-31T05:11:50.450 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: strict_capacity_limit : 0 2024-08-31T05:11:50.451 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: high_pri_pool_ratio: 0.000 2024-08-31T05:11:50.451 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache_compressed: (nil) 2024-08-31T05:11:50.451 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: persistent_cache: (nil) 2024-08-31T05:11:50.451 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_size: 4096 2024-08-31T05:11:50.451 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_size_deviation: 10 2024-08-31T05:11:50.451 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_restart_interval: 16 2024-08-31T05:11:50.451 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: index_block_restart_interval: 1 2024-08-31T05:11:50.451 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: metadata_block_size: 4096 2024-08-31T05:11:50.451 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: partition_filters: 0 2024-08-31T05:11:50.451 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: use_delta_encoding: 1 2024-08-31T05:11:50.451 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: filter_policy: bloomfilter 2024-08-31T05:11:50.451 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: whole_key_filtering: 1 2024-08-31T05:11:50.451 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: verify_compression: 0 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: read_amp_bytes_per_bit: 0 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: format_version: 5 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: enable_index_compression: 1 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_align: 0 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: max_auto_readahead_size: 262144 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: prepopulate_block_cache: 0 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: initial_auto_readahead_size: 8192 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compression: NoCompression 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T05:11:50.452 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.num_levels: 7 2024-08-31T05:11:50.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T05:11:50.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T05:11:50.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T05:11:50.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T05:11:50.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T05:11:50.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T05:11:50.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T05:11:50.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:11:50.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T05:11:50.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T05:11:50.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:11:50.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:11:50.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T05:11:50.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T05:11:50.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T05:11:50.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T05:11:50.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:11:50.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:11:50.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T05:11:50.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T05:11:50.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:11:50.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T05:11:50.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T05:11:50.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T05:11:50.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T05:11:50.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T05:11:50.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T05:11:50.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T05:11:50.455 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T05:11:50.455 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T05:11:50.455 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T05:11:50.455 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T05:11:50.455 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T05:11:50.455 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T05:11:50.455 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T05:11:50.455 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T05:11:50.455 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T05:11:50.455 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T05:11:50.455 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T05:11:50.455 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T05:11:50.455 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T05:11:50.455 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T05:11:50.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T05:11:50.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T05:11:50.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T05:11:50.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T05:11:50.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T05:11:50.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T05:11:50.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T05:11:50.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T05:11:50.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T05:11:50.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T05:11:50.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T05:11:50.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T05:11:50.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.inplace_update_support: 0 2024-08-31T05:11:50.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T05:11:50.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T05:11:50.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T05:11:50.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T05:11:50.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.bloom_locality: 0 2024-08-31T05:11:50.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.max_successive_merges: 0 2024-08-31T05:11:50.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T05:11:50.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T05:11:50.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T05:11:50.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T05:11:50.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.ttl: 2592000 2024-08-31T05:11:50.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T05:11:50.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T05:11:50.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T05:11:50.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.enable_blob_files: false 2024-08-31T05:11:50.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.min_blob_size: 0 2024-08-31T05:11:50.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T05:11:50.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T05:11:50.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T05:11:50.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T05:11:50.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T05:11:50.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T05:11:50.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T05:11:50.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T05:11:50.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi067/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-31T05:11:50.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-31T05:11:50.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5c78c4bf-e13b-45aa-b2e6-1d3b4e4e16e5 2024-08-31T05:11:50.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081110255428, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081110256303, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91334, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 286, "table_properties": {"data_size": 89404, "index_size": 250, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11793, "raw_average_key_size": 48, "raw_value_size": 82894, "raw_average_value_size": 338, "num_data_blocks": 11, "num_entries": 245, "num_filter_entries": 245, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725081110, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5c78c4bf-e13b-45aa-b2e6-1d3b4e4e16e5", "db_session_id": "SCN8CVF53NN6Y9S8MLFU", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081110256398, "job": 1, "event": "recovery_finished"} 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi067/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563ff9782e00 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: DB pointer 0x563ff987e000 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** DB Stats ** 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:11:50.459 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T05:11:50.460 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:11:50.460 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:11:50.460 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:11:50.460 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** Compaction Stats [default] ** 2024-08-31T05:11:50.460 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:11:50.460 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T05:11:50.460 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: L0 2/0 91.09 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 156.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:11:50.460 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Sum 2/0 91.09 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 156.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:11:50.460 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 156.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:11:50.460 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:11:50.460 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** Compaction Stats [default] ** 2024-08-31T05:11:50.460 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:11:50.460 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T05:11:50.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 156.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:11:50.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:11:50.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T05:11:50.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:11:50.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:11:50.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T05:11:50.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T05:11:50.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T05:11:50.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T05:11:50.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T05:11:50.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative compaction: 0.00 GB write, 28.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:11:50.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval compaction: 0.00 GB write, 28.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:11:50.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T05:11:50.462 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Block cache BinnedLRUCache@0x563ff9755090#2 capacity: 512.00 MB usage: 1.27 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-31T05:11:50.462 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-08-31T05:11:50.462 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:11:50.462 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T05:11:50.462 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: starting mon.smithi067 rank 0 at public addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] at bind addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi067 fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:11:50.462 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: mon.smithi067@-1(???) e1 preinit fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:11:50.462 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: mon.smithi067@-1(???).mds e1 new map 2024-08-31T05:11:50.462 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: mon.smithi067@-1(???).mds e1 print_map 2024-08-31T05:11:50.462 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: e1 2024-08-31T05:11:50.462 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: btime 2024-08-31T05:11:45:459350+0000 2024-08-31T05:11:50.462 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:11:50.462 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:11:50.462 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: legacy client fscid: -1 2024-08-31T05:11:50.462 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:11:50.463 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: No filesystems configured 2024-08-31T05:11:50.463 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: mon.smithi067@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T05:11:50.463 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: mon.smithi067@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:11:50.463 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: mon.smithi067@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:11:50.463 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: mon.smithi067@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:11:50.463 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: mon.smithi067@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-31T05:11:50.463 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 bash[17414]: 7082a38c8108d2401e6933da8417866d80fee34e8d7876cbcf80a0c6224ae8a0 2024-08-31T05:11:50.463 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 systemd[1]: Started Ceph mon.smithi067 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:11:50.463 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: mon.smithi067 is new leader, mons smithi067 in quorum (ranks 0) 2024-08-31T05:11:50.463 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: monmap epoch 1 2024-08-31T05:11:50.463 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:11:50.463 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: last_changed 2024-08-31T05:11:42.194071+0000 2024-08-31T05:11:50.463 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: created 2024-08-31T05:11:42.194071+0000 2024-08-31T05:11:50.464 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: min_mon_release 19 (squid) 2024-08-31T05:11:50.464 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: election_strategy: 1 2024-08-31T05:11:50.464 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: 0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.smithi067 2024-08-31T05:11:50.464 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: fsmap 2024-08-31T05:11:50.464 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: osdmap e1: 0 total, 0 up, 0 in 2024-08-31T05:11:50.464 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:50 smithi067 ceph-mon[17432]: mgrmap e1: no daemons active 2024-08-31T05:11:51.388 INFO:teuthology.orchestra.run.smithi067.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-31T05:11:51.409 INFO:teuthology.orchestra.run.smithi067.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:11:51.409 INFO:teuthology.orchestra.run.smithi067.stdout:Creating mgr... 2024-08-31T05:11:51.410 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-31T05:11:51.410 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-31T05:11:51.410 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying port 0.0.0.0:8443 ... 2024-08-31T05:11:51.649 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mgr.smithi067.hftacj 2024-08-31T05:11:51.649 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mgr.smithi067.hftacj.service: Unit ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mgr.smithi067.hftacj.service not loaded. 2024-08-31T05:11:51.795 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5fd95148-6757-11ef-bcd4-c7b262605968.target.wants/ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mgr.smithi067.hftacj.service → /etc/systemd/system/ceph-5fd95148-6757-11ef-bcd4-c7b262605968@.service. 2024-08-31T05:11:52.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:51 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2561550205' entity='client.admin' 2024-08-31T05:11:53.497 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T05:11:53.498 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout disabled 2024-08-31T05:11:53.505 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T05:11:53.505 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2024-08-31T05:11:53.505 INFO:teuthology.orchestra.run.smithi067.stdout:firewalld.service is not enabled 2024-08-31T05:11:53.505 INFO:teuthology.orchestra.run.smithi067.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T05:11:53.514 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T05:11:53.514 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout disabled 2024-08-31T05:11:53.522 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T05:11:53.522 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2024-08-31T05:11:53.522 INFO:teuthology.orchestra.run.smithi067.stdout:firewalld.service is not enabled 2024-08-31T05:11:53.522 INFO:teuthology.orchestra.run.smithi067.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-08-31T05:11:53.522 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mgr to start... 2024-08-31T05:11:53.522 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mgr... 2024-08-31T05:11:56.743 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:56 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/4186419019' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-31T05:11:58.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:57 smithi067 ceph-mon[17432]: Activating manager daemon smithi067.hftacj 2024-08-31T05:11:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:57 smithi067 ceph-mon[17432]: mgrmap e2: smithi067.hftacj(active, starting, since 0.00316296s) 2024-08-31T05:11:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:57 smithi067 ceph-mon[17432]: from='mgr.14100 172.21.15.67:0/3566029449' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T05:11:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:57 smithi067 ceph-mon[17432]: from='mgr.14100 172.21.15.67:0/3566029449' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T05:11:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:57 smithi067 ceph-mon[17432]: from='mgr.14100 172.21.15.67:0/3566029449' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T05:11:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:57 smithi067 ceph-mon[17432]: from='mgr.14100 172.21.15.67:0/3566029449' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:11:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:57 smithi067 ceph-mon[17432]: from='mgr.14100 172.21.15.67:0/3566029449' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr metadata", "who": "smithi067.hftacj", "id": "smithi067.hftacj"}]: dispatch 2024-08-31T05:11:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:57 smithi067 ceph-mon[17432]: Manager daemon smithi067.hftacj is now available 2024-08-31T05:11:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:57 smithi067 ceph-mon[17432]: from='mgr.14100 172.21.15.67:0/3566029449' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.hftacj/mirror_snapshot_schedule"}]: dispatch 2024-08-31T05:11:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:57 smithi067 ceph-mon[17432]: from='mgr.14100 172.21.15.67:0/3566029449' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.hftacj/trash_purge_schedule"}]: dispatch 2024-08-31T05:11:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:57 smithi067 ceph-mon[17432]: from='mgr.14100 172.21.15.67:0/3566029449' entity='mgr.smithi067.hftacj' 2024-08-31T05:11:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:57 smithi067 ceph-mon[17432]: from='mgr.14100 172.21.15.67:0/3566029449' entity='mgr.smithi067.hftacj' 2024-08-31T05:11:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:57 smithi067 ceph-mon[17432]: from='mgr.14100 172.21.15.67:0/3566029449' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:00.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:11:59 smithi067 ceph-mon[17432]: mgrmap e3: smithi067.hftacj(active, since 1.00729s) 2024-08-31T05:12:01.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:00 smithi067 ceph-mon[17432]: mgrmap e4: smithi067.hftacj(active, since 2s) 2024-08-31T05:12:02.867 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-08-31T05:12:02.867 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:12:02.867 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsid": "5fd95148-6757-11ef-bcd4-c7b262605968", 2024-08-31T05:12:02.867 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T05:12:02.867 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T05:12:02.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T05:12:02.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T05:12:02.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:12:02.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T05:12:02.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T05:12:02.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 0 2024-08-31T05:12:02.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:12:02.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T05:12:02.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "smithi067" 2024-08-31T05:12:02.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:12:02.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-08-31T05:12:02.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T05:12:02.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:12:02.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T05:12:02.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T05:12:02.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:12:02.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T05:12:02.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:12:02.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T05:12:02.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T05:12:02.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T05:12:02.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T05:12:02.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T05:12:02.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T05:12:02.872 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:12:02.872 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T05:12:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T05:12:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T05:12:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T05:12:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T05:12:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T05:12:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T05:12:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T05:12:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T05:12:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:12:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T05:12:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:12:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T05:11:45:459350+0000", 2024-08-31T05:12:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T05:12:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T05:11:45.460005+0000", 2024-08-31T05:12:02.874 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T05:12:02.875 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:12:02.875 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T05:12:02.875 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:12:02.875 INFO:teuthology.orchestra.run.smithi067.stdout:mgr not available, waiting (1/15)... 2024-08-31T05:12:05.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:05 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1117413915' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-31T05:12:06.117 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-08-31T05:12:06.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:12:06.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsid": "5fd95148-6757-11ef-bcd4-c7b262605968", 2024-08-31T05:12:06.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T05:12:06.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T05:12:06.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T05:12:06.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T05:12:06.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:12:06.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T05:12:06.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T05:12:06.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 0 2024-08-31T05:12:06.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:12:06.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T05:12:06.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "smithi067" 2024-08-31T05:12:06.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:12:06.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2024-08-31T05:12:06.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T05:12:06.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:12:06.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T05:12:06.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T05:12:06.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:12:06.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T05:12:06.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:12:06.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T05:12:06.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T05:12:06.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T05:12:06.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T05:12:06.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T05:12:06.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T05:12:06.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:12:06.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T05:12:06.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T05:12:06.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T05:12:06.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T05:12:06.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T05:12:06.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T05:12:06.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T05:12:06.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T05:12:06.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T05:12:06.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T05:11:45:459350+0000", 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:12:06.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T05:12:06.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:12:06.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T05:12:06.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:12:06.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T05:11:45.460005+0000", 2024-08-31T05:12:06.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T05:12:06.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:12:06.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T05:12:06.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:12:06.122 INFO:teuthology.orchestra.run.smithi067.stdout:mgr is available 2024-08-31T05:12:06.998 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:06 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3288595984' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-31T05:12:07.279 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-08-31T05:12:07.279 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T05:12:07.279 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout fsid = 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:12:07.279 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.67:3300,v1:172.21.15.67:6789] 2024-08-31T05:12:07.279 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T05:12:07.279 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T05:12:07.279 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T05:12:07.279 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T05:12:07.279 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-08-31T05:12:07.279 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T05:12:07.280 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T05:12:07.280 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-08-31T05:12:07.280 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T05:12:07.280 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-31T05:12:07.280 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-31T05:12:07.280 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-31T05:12:07.280 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T05:12:07.280 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T05:12:07.280 INFO:teuthology.orchestra.run.smithi067.stdout:Enabling cephadm module... 2024-08-31T05:12:08.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:08 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2763270650' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-08-31T05:12:09.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:09 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2763270650' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-31T05:12:09.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:09 smithi067 ceph-mon[17432]: mgrmap e5: smithi067.hftacj(active, since 10s) 2024-08-31T05:12:10.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:10 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3601613854' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-31T05:12:10.371 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:12:10.371 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-31T05:12:10.371 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T05:12:10.371 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "active_name": "smithi067.hftacj", 2024-08-31T05:12:10.371 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T05:12:10.371 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:12:10.371 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for the mgr to restart... 2024-08-31T05:12:10.371 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mgr epoch 5... 2024-08-31T05:12:13.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: Active manager daemon smithi067.hftacj restarted 2024-08-31T05:12:13.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: Activating manager daemon smithi067.hftacj 2024-08-31T05:12:13.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: osdmap e2: 0 total, 0 up, 0 in 2024-08-31T05:12:13.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: mgrmap e6: smithi067.hftacj(active, starting, since 0.00348585s) 2024-08-31T05:12:13.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:12:13.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr metadata", "who": "smithi067.hftacj", "id": "smithi067.hftacj"}]: dispatch 2024-08-31T05:12:13.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T05:12:13.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T05:12:13.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T05:12:13.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: Manager daemon smithi067.hftacj is now available 2024-08-31T05:12:13.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:13.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:13.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:12:13.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:12:13.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.hftacj/mirror_snapshot_schedule"}]: dispatch 2024-08-31T05:12:13.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:13 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.hftacj/trash_purge_schedule"}]: dispatch 2024-08-31T05:12:14.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:14 smithi067 ceph-mon[17432]: Found migration_current of "None". Setting to last migration. 2024-08-31T05:12:14.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:14 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:14 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:14 smithi067 ceph-mon[17432]: mgrmap e7: smithi067.hftacj(active, since 1.00532s) 2024-08-31T05:12:14.593 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:12:14.593 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-31T05:12:14.594 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T05:12:14.594 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:12:14.594 INFO:teuthology.orchestra.run.smithi067.stdout:mgr epoch 5 is available 2024-08-31T05:12:14.594 INFO:teuthology.orchestra.run.smithi067.stdout:Setting orchestrator backend to cephadm... 2024-08-31T05:12:15.248 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:15 smithi067 ceph-mon[17432]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-31T05:12:15.248 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:15 smithi067 ceph-mon[17432]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-31T05:12:16.238 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:16 smithi067 ceph-mon[17432]: mgrmap e8: smithi067.hftacj(active, since 2s) 2024-08-31T05:12:16.238 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:16 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:16.239 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:16 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:12:16.239 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:16 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:12:17.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:17 smithi067 ceph-mon[17432]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:17 smithi067 ceph-mon[17432]: [31/Aug/2024:05:12:15] ENGINE Bus STARTING 2024-08-31T05:12:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:17 smithi067 ceph-mon[17432]: [31/Aug/2024:05:12:15] ENGINE Serving on http://172.21.15.67:8765 2024-08-31T05:12:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:17 smithi067 ceph-mon[17432]: [31/Aug/2024:05:12:15] ENGINE Serving on https://172.21.15.67:7150 2024-08-31T05:12:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:17 smithi067 ceph-mon[17432]: [31/Aug/2024:05:12:15] ENGINE Bus STARTED 2024-08-31T05:12:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:17 smithi067 ceph-mon[17432]: [31/Aug/2024:05:12:15] ENGINE Error in HTTPServer.serve 2024-08-31T05:12:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Traceback (most recent call last): 2024-08-31T05:12:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:12:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:12:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:12:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._run(expiration_interval) 2024-08-31T05:12:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:12:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:12:17.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:12:17.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:12:17.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:12:17.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: s = self.context.wrap_socket( 2024-08-31T05:12:17.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:12:17.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: return self.sslsocket_class._create( 2024-08-31T05:12:17.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:12:17.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self.do_handshake() 2024-08-31T05:12:17.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:12:17.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._sslobj.do_handshake() 2024-08-31T05:12:17.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:12:17.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-31T05:12:17.405 INFO:teuthology.orchestra.run.smithi067.stdout:Generating ssh key... 2024-08-31T05:12:18.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:18 smithi067 ceph-mon[17432]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:19.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:19 smithi067 ceph-mon[17432]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:19.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:19 smithi067 ceph-mon[17432]: Generating ssh key... 2024-08-31T05:12:19.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:19 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:19.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:19 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:19.676 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAkzBDA3J1PxCofQlacGqLZt1VCotOwnu8DoSrW7c4uorLchAkNJtFuYgKHna/Kj/rFkuF4qII/k4IeJpJWK3cM+7IzzeH74hxp6CTRPN4RC1iHwokVlij3YcW011yTTb+wGm8H8U4tWxbQrkQmnoeb/otyuY7ySq/YF96gFj4qn5jtBsguA0U5jbd9vWRFpQL+qr5eRybZp7y1cLN+2Xw+ix2e2RzpiKqtXWMmlCFxCAkqFcZTzbFNnFA+MPx/3PgFHwvV7HWNqJSBHdnq6C7WmFA+cbCJyYec/wOrQ5M8qoTqeqBeofwPTsPNNfWg11Fpk8G9enRQ7OelnSoEkK/tQHqfuBnC+f51MiY0HbK3snit90Qf6CQlWLCthnlWt8MTuT7rNqPKF4cF2219taW45pvHe8KU4TDUcLjKjwrCXRiA0aXgaQ69A+qZaKqEC6H7W/u5ePECGnOZl6kH5xz45HWW5onlelxY6fl34a0+u4mciu4Pz4EKiC7XIAoiKk= ceph-5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:12:19.677 INFO:teuthology.orchestra.run.smithi067.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-31T05:12:19.677 INFO:teuthology.orchestra.run.smithi067.stdout:Adding key to root@localhost authorized_keys... 2024-08-31T05:12:19.677 INFO:teuthology.orchestra.run.smithi067.stdout:Adding host smithi067... 2024-08-31T05:12:20.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:20 smithi067 ceph-mon[17432]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:21.279 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:21 smithi067 ceph-mon[17432]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi067", "addr": "172.21.15.67", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:22.479 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:22 smithi067 ceph-mon[17432]: Deploying cephadm binary to smithi067 2024-08-31T05:12:24.692 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Added host 'smithi067' with addr '172.21.15.67' 2024-08-31T05:12:24.692 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying mon service with default placement... 2024-08-31T05:12:25.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:25 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:25.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:25 smithi067 ceph-mon[17432]: Added host smithi067 2024-08-31T05:12:25.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:25 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:12:26.536 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:26 smithi067 ceph-mon[17432]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:26.537 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:26 smithi067 ceph-mon[17432]: Saving service mon spec with placement count:5 2024-08-31T05:12:26.537 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:26 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:26.537 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:26 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:26.881 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-31T05:12:26.881 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying mgr service with default placement... 2024-08-31T05:12:27.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:27 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:27.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:27 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:28.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-31T05:12:28.567 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying crash service with default placement... 2024-08-31T05:12:28.883 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:28 smithi067 ceph-mon[17432]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:28.883 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:28 smithi067 ceph-mon[17432]: Saving service mgr spec with placement count:2 2024-08-31T05:12:29.706 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-08-31T05:12:29.706 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying ceph-exporter service with default placement... 2024-08-31T05:12:30.057 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:29 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:30.057 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:29 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:31.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:30 smithi067 ceph-mon[17432]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:31.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:30 smithi067 ceph-mon[17432]: Saving service crash spec with placement * 2024-08-31T05:12:31.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:30 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:31.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:30 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:31.880 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-08-31T05:12:31.880 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying prometheus service with default placement... 2024-08-31T05:12:32.262 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:31 smithi067 ceph-mon[17432]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:32.262 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:31 smithi067 ceph-mon[17432]: Saving service ceph-exporter spec with placement * 2024-08-31T05:12:33.059 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-08-31T05:12:33.060 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying grafana service with default placement... 2024-08-31T05:12:33.697 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:33 smithi067 ceph-mon[17432]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:33.698 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:33 smithi067 ceph-mon[17432]: Saving service prometheus spec with placement count:1 2024-08-31T05:12:33.698 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:33 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:33.698 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:33 smithi067 ceph-mon[17432]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:12:34.266 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-08-31T05:12:34.266 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying node-exporter service with default placement... 2024-08-31T05:12:34.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:34 smithi067 ceph-mon[17432]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:34.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:34 smithi067 ceph-mon[17432]: Saving service grafana spec with placement count:1 2024-08-31T05:12:34.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:34 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:35.371 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-08-31T05:12:35.371 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying alertmanager service with default placement... 2024-08-31T05:12:35.969 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:35 smithi067 ceph-mon[17432]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:35.969 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:35 smithi067 ceph-mon[17432]: Saving service node-exporter spec with placement * 2024-08-31T05:12:35.969 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:35 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:35.969 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:35 smithi067 ceph-mon[17432]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:12:36.510 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-08-31T05:12:37.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:36 smithi067 ceph-mon[17432]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:37.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:36 smithi067 ceph-mon[17432]: Saving service alertmanager spec with placement count:1 2024-08-31T05:12:37.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:36 smithi067 ceph-mon[17432]: from='mgr.14116 172.21.15.67:0/569000251' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:38.305 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:37 smithi067 ceph-mon[17432]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:12:38.305 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:37 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/773699982' entity='client.admin' 2024-08-31T05:12:38.788 INFO:teuthology.orchestra.run.smithi067.stdout:Enabling the dashboard module... 2024-08-31T05:12:39.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:39 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3722755991' entity='client.admin' 2024-08-31T05:12:39.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:39 smithi067 ceph-mon[17432]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:12:40.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:40 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1984618743' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-08-31T05:12:41.440 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:41 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1984618743' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-31T05:12:41.440 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:41 smithi067 ceph-mon[17432]: mgrmap e9: smithi067.hftacj(active, since 27s) 2024-08-31T05:12:42.160 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:12:42.160 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-31T05:12:42.160 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T05:12:42.160 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "active_name": "smithi067.hftacj", 2024-08-31T05:12:42.160 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T05:12:42.160 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:12:42.161 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for the mgr to restart... 2024-08-31T05:12:42.161 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mgr epoch 9... 2024-08-31T05:12:42.518 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:42 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3702669315' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-31T05:12:45.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:45 smithi067 ceph-mon[17432]: Active manager daemon smithi067.hftacj restarted 2024-08-31T05:12:45.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:45 smithi067 ceph-mon[17432]: Activating manager daemon smithi067.hftacj 2024-08-31T05:12:45.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:45 smithi067 ceph-mon[17432]: osdmap e3: 0 total, 0 up, 0 in 2024-08-31T05:12:45.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:45 smithi067 ceph-mon[17432]: mgrmap e10: smithi067.hftacj(active, starting, since 0.00346082s) 2024-08-31T05:12:45.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:45 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:12:45.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:45 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr metadata", "who": "smithi067.hftacj", "id": "smithi067.hftacj"}]: dispatch 2024-08-31T05:12:45.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:45 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T05:12:45.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:45 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T05:12:45.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:45 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T05:12:45.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:45 smithi067 ceph-mon[17432]: Manager daemon smithi067.hftacj is now available 2024-08-31T05:12:45.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:45 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:12:45.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:45 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.hftacj/mirror_snapshot_schedule"}]: dispatch 2024-08-31T05:12:45.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:45 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.hftacj/trash_purge_schedule"}]: dispatch 2024-08-31T05:12:47.103 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:12:47.103 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-31T05:12:47.104 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T05:12:47.104 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:12:47.104 INFO:teuthology.orchestra.run.smithi067.stdout:mgr epoch 9 is available 2024-08-31T05:12:47.104 INFO:teuthology.orchestra.run.smithi067.stdout:Generating a dashboard self-signed certificate... 2024-08-31T05:12:47.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:47 smithi067 ceph-mon[17432]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-31T05:12:47.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:47 smithi067 ceph-mon[17432]: mgrmap e11: smithi067.hftacj(active, since 1.00507s) 2024-08-31T05:12:47.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:47 smithi067 ceph-mon[17432]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-31T05:12:47.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:47 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:48.350 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-08-31T05:12:48.350 INFO:teuthology.orchestra.run.smithi067.stdout:Creating initial admin user... 2024-08-31T05:12:48.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:48 smithi067 ceph-mon[17432]: [31/Aug/2024:05:12:46] ENGINE Bus STARTING 2024-08-31T05:12:48.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:48 smithi067 ceph-mon[17432]: [31/Aug/2024:05:12:46] ENGINE Serving on http://172.21.15.67:8765 2024-08-31T05:12:48.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:48 smithi067 ceph-mon[17432]: [31/Aug/2024:05:12:46] ENGINE Serving on https://172.21.15.67:7150 2024-08-31T05:12:48.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:48 smithi067 ceph-mon[17432]: [31/Aug/2024:05:12:46] ENGINE Bus STARTED 2024-08-31T05:12:48.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:48 smithi067 ceph-mon[17432]: [31/Aug/2024:05:12:46] ENGINE Error in HTTPServer.serve 2024-08-31T05:12:48.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Traceback (most recent call last): 2024-08-31T05:12:48.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:12:48.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:12:48.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:12:48.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._run(expiration_interval) 2024-08-31T05:12:48.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:12:48.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:12:48.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:12:48.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:12:48.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:12:48.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: s = self.context.wrap_socket( 2024-08-31T05:12:48.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:12:48.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: return self.sslsocket_class._create( 2024-08-31T05:12:48.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:12:48.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self.do_handshake() 2024-08-31T05:12:48.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:12:48.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._sslobj.do_handshake() 2024-08-31T05:12:48.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:12:48.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:48 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:48.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:48 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:48.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:48 smithi067 ceph-mon[17432]: mgrmap e12: smithi067.hftacj(active, since 2s) 2024-08-31T05:12:49.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:49 smithi067 ceph-mon[17432]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:49.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:49 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:49.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:49 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:50.127 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$sB0nDVpPmGeR0w8j3DrYyOMJokGSDwSLVpzXSmfG/xMoDsDN8MKR.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725081169, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-31T05:12:50.128 INFO:teuthology.orchestra.run.smithi067.stdout:Fetching dashboard port number... 2024-08-31T05:12:50.477 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:50 smithi067 ceph-mon[17432]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:51.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:51 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3895515424' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-08-31T05:12:51.619 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 8443 2024-08-31T05:12:51.629 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T05:12:51.629 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout disabled 2024-08-31T05:12:51.637 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T05:12:51.637 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2024-08-31T05:12:51.637 INFO:teuthology.orchestra.run.smithi067.stdout:firewalld.service is not enabled 2024-08-31T05:12:51.637 INFO:teuthology.orchestra.run.smithi067.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-31T05:12:51.639 INFO:teuthology.orchestra.run.smithi067.stdout:Ceph Dashboard is now available at: 2024-08-31T05:12:51.639 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:12:51.639 INFO:teuthology.orchestra.run.smithi067.stdout: URL: https://smithi067:8443/ 2024-08-31T05:12:51.639 INFO:teuthology.orchestra.run.smithi067.stdout: User: admin 2024-08-31T05:12:51.639 INFO:teuthology.orchestra.run.smithi067.stdout: Password: i26pp5ppo1 2024-08-31T05:12:51.639 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:12:51.639 INFO:teuthology.orchestra.run.smithi067.stdout:Saving cluster configuration to /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config directory 2024-08-31T05:12:52.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:52 smithi067 ceph-mon[17432]: mgrmap e13: smithi067.hftacj(active, since 6s) 2024-08-31T05:12:52.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:52 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3950043080' entity='client.admin' 2024-08-31T05:12:52.808 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-31T05:12:52.808 INFO:teuthology.orchestra.run.smithi067.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-31T05:12:52.808 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout:Or, if you are only running a single cluster on this host: 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout: ceph telemetry on 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout:For more information see: 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:12:52.809 INFO:teuthology.orchestra.run.smithi067.stdout:Bootstrap complete. 2024-08-31T05:12:52.849 INFO:tasks.cephadm:Fetching config... 2024-08-31T05:12:52.849 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:12:52.849 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-31T05:12:52.865 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-31T05:12:52.865 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:12:52.865 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-31T05:12:52.920 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-31T05:12:52.921 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:12:52.921 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/keyring of=/dev/stdout 2024-08-31T05:12:52.984 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-31T05:12:52.985 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:12:52.985 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-31T05:12:53.041 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-31T05:12:53.041 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAkzBDA3J1PxCofQlacGqLZt1VCotOwnu8DoSrW7c4uorLchAkNJtFuYgKHna/Kj/rFkuF4qII/k4IeJpJWK3cM+7IzzeH74hxp6CTRPN4RC1iHwokVlij3YcW011yTTb+wGm8H8U4tWxbQrkQmnoeb/otyuY7ySq/YF96gFj4qn5jtBsguA0U5jbd9vWRFpQL+qr5eRybZp7y1cLN+2Xw+ix2e2RzpiKqtXWMmlCFxCAkqFcZTzbFNnFA+MPx/3PgFHwvV7HWNqJSBHdnq6C7WmFA+cbCJyYec/wOrQ5M8qoTqeqBeofwPTsPNNfWg11Fpk8G9enRQ7OelnSoEkK/tQHqfuBnC+f51MiY0HbK3snit90Qf6CQlWLCthnlWt8MTuT7rNqPKF4cF2219taW45pvHe8KU4TDUcLjKjwrCXRiA0aXgaQ69A+qZaKqEC6H7W/u5ePECGnOZl6kH5xz45HWW5onlelxY6fl34a0+u4mciu4Pz4EKiC7XIAoiKk= ceph-5fd95148-6757-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T05:12:53.114 INFO:teuthology.orchestra.run.smithi067.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAkzBDA3J1PxCofQlacGqLZt1VCotOwnu8DoSrW7c4uorLchAkNJtFuYgKHna/Kj/rFkuF4qII/k4IeJpJWK3cM+7IzzeH74hxp6CTRPN4RC1iHwokVlij3YcW011yTTb+wGm8H8U4tWxbQrkQmnoeb/otyuY7ySq/YF96gFj4qn5jtBsguA0U5jbd9vWRFpQL+qr5eRybZp7y1cLN+2Xw+ix2e2RzpiKqtXWMmlCFxCAkqFcZTzbFNnFA+MPx/3PgFHwvV7HWNqJSBHdnq6C7WmFA+cbCJyYec/wOrQ5M8qoTqeqBeofwPTsPNNfWg11Fpk8G9enRQ7OelnSoEkK/tQHqfuBnC+f51MiY0HbK3snit90Qf6CQlWLCthnlWt8MTuT7rNqPKF4cF2219taW45pvHe8KU4TDUcLjKjwrCXRiA0aXgaQ69A+qZaKqEC6H7W/u5ePECGnOZl6kH5xz45HWW5onlelxY6fl34a0+u4mciu4Pz4EKiC7XIAoiKk= ceph-5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:12:53.125 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAkzBDA3J1PxCofQlacGqLZt1VCotOwnu8DoSrW7c4uorLchAkNJtFuYgKHna/Kj/rFkuF4qII/k4IeJpJWK3cM+7IzzeH74hxp6CTRPN4RC1iHwokVlij3YcW011yTTb+wGm8H8U4tWxbQrkQmnoeb/otyuY7ySq/YF96gFj4qn5jtBsguA0U5jbd9vWRFpQL+qr5eRybZp7y1cLN+2Xw+ix2e2RzpiKqtXWMmlCFxCAkqFcZTzbFNnFA+MPx/3PgFHwvV7HWNqJSBHdnq6C7WmFA+cbCJyYec/wOrQ5M8qoTqeqBeofwPTsPNNfWg11Fpk8G9enRQ7OelnSoEkK/tQHqfuBnC+f51MiY0HbK3snit90Qf6CQlWLCthnlWt8MTuT7rNqPKF4cF2219taW45pvHe8KU4TDUcLjKjwrCXRiA0aXgaQ69A+qZaKqEC6H7W/u5ePECGnOZl6kH5xz45HWW5onlelxY6fl34a0+u4mciu4Pz4EKiC7XIAoiKk= ceph-5fd95148-6757-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T05:12:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAkzBDA3J1PxCofQlacGqLZt1VCotOwnu8DoSrW7c4uorLchAkNJtFuYgKHna/Kj/rFkuF4qII/k4IeJpJWK3cM+7IzzeH74hxp6CTRPN4RC1iHwokVlij3YcW011yTTb+wGm8H8U4tWxbQrkQmnoeb/otyuY7ySq/YF96gFj4qn5jtBsguA0U5jbd9vWRFpQL+qr5eRybZp7y1cLN+2Xw+ix2e2RzpiKqtXWMmlCFxCAkqFcZTzbFNnFA+MPx/3PgFHwvV7HWNqJSBHdnq6C7WmFA+cbCJyYec/wOrQ5M8qoTqeqBeofwPTsPNNfWg11Fpk8G9enRQ7OelnSoEkK/tQHqfuBnC+f51MiY0HbK3snit90Qf6CQlWLCthnlWt8MTuT7rNqPKF4cF2219taW45pvHe8KU4TDUcLjKjwrCXRiA0aXgaQ69A+qZaKqEC6H7W/u5ePECGnOZl6kH5xz45HWW5onlelxY6fl34a0+u4mciu4Pz4EKiC7XIAoiKk= ceph-5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:12:53.179 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-31T05:12:53.464 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:12:55.113 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-31T05:12:55.113 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-31T05:12:55.364 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:55 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3454772192' entity='client.admin' 2024-08-31T05:12:55.364 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:55 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:55.364 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:55 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:55.364 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:55 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:12:55.365 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:55 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:55.365 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:55 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi067", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:12:55.365 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:55 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi067", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-31T05:12:55.365 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:55 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:12:55.595 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:12:56.306 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:56 smithi067 ceph-mon[17432]: Deploying daemon ceph-exporter.smithi067 on smithi067 2024-08-31T05:12:57.340 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi073 2024-08-31T05:12:57.340 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-08-31T05:12:57.340 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/etc/ceph/ceph.conf 2024-08-31T05:12:57.360 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-08-31T05:12:57.360 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:12:57.418 INFO:tasks.cephadm:Adding host smithi073 to orchestrator... 2024-08-31T05:12:57.418 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph orch host add smithi073 2024-08-31T05:12:57.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:57 smithi067 ceph-mon[17432]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:57.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:57 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:12:58.412 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:12:59.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:12:59 smithi067 ceph-mon[17432]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi073", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:00 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:00 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:00 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:00 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:00 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-31T05:13:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:00 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-08-31T05:13:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:00 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:13:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:00 smithi067 ceph-mon[17432]: Deploying daemon crash.smithi067 on smithi067 2024-08-31T05:13:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:00 smithi067 ceph-mon[17432]: Deploying cephadm binary to smithi073 2024-08-31T05:13:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:00 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:03.019 INFO:teuthology.orchestra.run.smithi067.stdout:Added host 'smithi073' with addr '172.21.15.73' 2024-08-31T05:13:03.312 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:03 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:03.312 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:03 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:03.312 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:03 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:03.312 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:03 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:03.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:03 smithi067 ceph-mon[17432]: Deploying daemon node-exporter.smithi067 on smithi067 2024-08-31T05:13:03.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:03 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:03.671 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T05:13:03.923 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:13:04.310 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:04 smithi067 ceph-mon[17432]: Added host smithi073 2024-08-31T05:13:04.866 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:13:04.866 INFO:teuthology.orchestra.run.smithi067.stdout:[{"addr": "172.21.15.67", "hostname": "smithi067", "labels": [], "status": ""}, {"addr": "172.21.15.73", "hostname": "smithi073", "labels": [], "status": ""}] 2024-08-31T05:13:05.989 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-31T05:13:05.989 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd crush tunables default 2024-08-31T05:13:06.430 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:13:06.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:06 smithi067 ceph-mon[17432]: from='client.14187 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:13:06.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:06 smithi067 ceph-mon[17432]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:06.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:06 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:07.477 INFO:teuthology.orchestra.run.smithi067.stderr:adjusted tunables profile to default 2024-08-31T05:13:07.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:07 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:07.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:07 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:07.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:07 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:07.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:07 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:07.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:07 smithi067 ceph-mon[17432]: Deploying daemon alertmanager.smithi067 on smithi067 2024-08-31T05:13:07.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:07 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/4101660496' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-31T05:13:07.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:07 smithi067 ceph-mon[17432]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:08.459 INFO:tasks.cephadm:Adding mon.smithi067 on smithi067 2024-08-31T05:13:08.459 INFO:tasks.cephadm:Adding mon.smithi073 on smithi073 2024-08-31T05:13:08.459 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph orch apply mon '2;smithi067:172.21.15.67=smithi067;smithi073:172.21.15.73=smithi073' 2024-08-31T05:13:08.713 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:08.756 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:08.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:08 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/4101660496' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T05:13:08.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:08 smithi067 ceph-mon[17432]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:13:09.348 INFO:teuthology.orchestra.run.smithi073.stdout:Scheduled mon update... 2024-08-31T05:13:09.874 DEBUG:teuthology.orchestra.run.smithi073:mon.smithi073> sudo journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi073.service 2024-08-31T05:13:09.877 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:09.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:10.188 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:10.814 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:10.814 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:10.815 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:10.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:10 smithi067 ceph-mon[17432]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:10.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:10 smithi067 ceph-mon[17432]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi067:172.21.15.67=smithi067;smithi073:172.21.15.73=smithi073", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:10.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:10 smithi067 ceph-mon[17432]: Saving service mon spec with placement smithi067:172.21.15.67=smithi067;smithi073:172.21.15.73=smithi073;count:2 2024-08-31T05:13:10.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:10 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:11.551 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:11 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:11.552 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:11 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/1698020839' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:12.418 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:12.419 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:12.662 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:12.707 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:12.768 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:12 smithi067 ceph-mon[17432]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:13.328 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:13.328 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:13.681 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:13 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/352618137' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:14.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:14 smithi067 ceph-mon[17432]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:15.051 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:15.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:15.290 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:15.336 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:16.025 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:16.025 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:16.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:16.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: Regenerating cephadm self-signed grafana TLS certificates 2024-08-31T05:13:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-08-31T05:13:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-08-31T05:13:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: Deploying daemon grafana.smithi067 on smithi067 2024-08-31T05:13:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:15 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:17.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:16 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/1305459436' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:17.619 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:17.619 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:17.859 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:17.903 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:18.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:17 smithi067 ceph-mon[17432]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:18.544 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:18.544 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:18.545 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:19.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:18 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/3218498413' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:20.118 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:20.118 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:20.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:19 smithi067 ceph-mon[17432]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:20.406 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:21.126 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:21.127 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:21.127 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:21.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:21 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/235005256' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:22.492 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:22 smithi067 ceph-mon[17432]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:22.649 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:22.649 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:22.889 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:22.933 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:23.576 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:23.576 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:23.576 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:23.807 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:23 smithi067 ceph-mon[17432]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:24.509 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:24 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/3606794742' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:25.097 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:25.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:25.378 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:25.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:25 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:25 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:25 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:25 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:25 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:25 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:25 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:25 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:25 smithi067 ceph-mon[17432]: Deploying daemon prometheus.smithi067 on smithi067 2024-08-31T05:13:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:25 smithi067 ceph-mon[17432]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:25 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:26.177 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:26.177 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:26.178 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:27.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:26 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/4197502041' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:27.730 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:27.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:27.973 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:28.017 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:28.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:27 smithi067 ceph-mon[17432]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:28.722 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:28.723 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:28.723 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:29.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:28 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/1897202883' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:30.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:29 smithi067 ceph-mon[17432]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:30.283 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:30.283 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:30.569 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:31.220 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:31.221 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:31.221 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:31.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:31 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/846165884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:32.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:32 smithi067 ceph-mon[17432]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:32.810 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:32.810 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:33.046 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:33.147 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:33.510 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:33 smithi067 ceph-mon[17432]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:33.753 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:33.753 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:34.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:34 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/3133059221' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:35.341 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:35.341 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:35.580 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:35.624 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:36.475 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:36 smithi067 ceph-mon[17432]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:13:36.475 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:36 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:36.475 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:36 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:36.476 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:36 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:36.476 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:36 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-08-31T05:13:36.476 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:36 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:36.504 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:36.504 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:36.508 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:37.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:37 smithi067 ceph-mon[17432]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-08-31T05:13:37.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:37 smithi067 ceph-mon[17432]: mgrmap e14: smithi067.hftacj(active, since 51s) 2024-08-31T05:13:37.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:37 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/2746115129' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:38.091 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:38.092 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:38.335 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:38.379 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:39.107 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:39.107 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:39.108 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:39.425 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:39 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/949236898' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:40.654 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:40.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:40.897 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:40.941 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:41.563 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:41.563 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:41.563 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:41.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:41 smithi067 ceph-mon[17432]: Active manager daemon smithi067.hftacj restarted 2024-08-31T05:13:41.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:41 smithi067 ceph-mon[17432]: Activating manager daemon smithi067.hftacj 2024-08-31T05:13:41.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:41 smithi067 ceph-mon[17432]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T05:13:41.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:41 smithi067 ceph-mon[17432]: mgrmap e15: smithi067.hftacj(active, starting, since 0.00286203s) 2024-08-31T05:13:41.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:13:41.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr metadata", "who": "smithi067.hftacj", "id": "smithi067.hftacj"}]: dispatch 2024-08-31T05:13:41.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T05:13:41.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T05:13:41.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T05:13:41.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:41 smithi067 ceph-mon[17432]: Manager daemon smithi067.hftacj is now available 2024-08-31T05:13:41.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:13:41.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:41.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:13:42.612 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:42 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.hftacj/mirror_snapshot_schedule"}]: dispatch 2024-08-31T05:13:42.612 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:42 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.hftacj/trash_purge_schedule"}]: dispatch 2024-08-31T05:13:42.613 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:42 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/3605468593' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:42.613 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:42 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:42.613 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:42 smithi067 ceph-mon[17432]: mgrmap e16: smithi067.hftacj(active, since 1.00493s) 2024-08-31T05:13:43.145 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:43.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:43.402 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:43.454 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:43.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:43 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:43.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:43 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:44.135 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:44.135 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:44.719 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:44 smithi067 ceph-mon[17432]: [31/Aug/2024:05:13:43] ENGINE Bus STARTING 2024-08-31T05:13:44.719 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:44 smithi067 ceph-mon[17432]: [31/Aug/2024:05:13:43] ENGINE Serving on http://172.21.15.67:8765 2024-08-31T05:13:44.719 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:44 smithi067 ceph-mon[17432]: [31/Aug/2024:05:13:43] ENGINE Serving on https://172.21.15.67:7150 2024-08-31T05:13:44.719 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:44 smithi067 ceph-mon[17432]: [31/Aug/2024:05:13:43] ENGINE Bus STARTED 2024-08-31T05:13:44.719 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:44 smithi067 ceph-mon[17432]: [31/Aug/2024:05:13:43] ENGINE Error in HTTPServer.serve 2024-08-31T05:13:44.719 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Traceback (most recent call last): 2024-08-31T05:13:44.719 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:13:44.719 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:13:44.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:13:44.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._run(expiration_interval) 2024-08-31T05:13:44.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:13:44.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:13:44.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:13:44.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:13:44.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:13:44.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: s = self.context.wrap_socket( 2024-08-31T05:13:44.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:13:44.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: return self.sslsocket_class._create( 2024-08-31T05:13:44.721 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:13:44.721 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self.do_handshake() 2024-08-31T05:13:44.721 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:13:44.721 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._sslobj.do_handshake() 2024-08-31T05:13:44.721 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:13:44.721 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:44 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/4234275598' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:44.721 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:44 smithi067 ceph-mon[17432]: mgrmap e17: smithi067.hftacj(active, since 2s) 2024-08-31T05:13:45.778 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:45.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:46.155 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:13:46.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:46.817 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:46.818 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:47.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:46 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:47.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:46 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:47.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:46 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:47.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:46 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:47.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:46 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:13:48.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:47 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/3229402941' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:48.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:47 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:48.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:47 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:48.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:47 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:48.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:47 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:48.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:47 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd/host:smithi073", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:13:48.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:47 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:13:48.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:47 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:13:48.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:47 smithi067 ceph-mon[17432]: Updating smithi067:/etc/ceph/ceph.conf 2024-08-31T05:13:48.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:47 smithi067 ceph-mon[17432]: Updating smithi073:/etc/ceph/ceph.conf 2024-08-31T05:13:48.843 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:48.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:13:49.443 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: Updating smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:13:49.443 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: Updating smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:13:49.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:13:49.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:13:49.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: Updating smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:13:49.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: Updating smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:13:49.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:49.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:49.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:49.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:49.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:49.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:13:49.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-31T05:13:49.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:13:49.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:49 smithi067 ceph-mon[17432]: Deploying daemon ceph-exporter.smithi073 on smithi073 2024-08-31T05:13:50.233 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:50.233 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:50.234 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:50.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:50 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/2814190627' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:51.822 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:51.823 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:52.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:52.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:52.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:52.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:52.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-31T05:13:52.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-08-31T05:13:52.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:13:52.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:52 smithi067 ceph-mon[17432]: Deploying daemon crash.smithi073 on smithi073 2024-08-31T05:13:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:13:53.678 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:53.678 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:53.678 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:54.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:53 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/3123928733' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:55.261 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:55.261 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:13:55.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:55 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:55.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:55 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:55.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:55 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:55.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:55 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:55.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:55 smithi067 ceph-mon[17432]: Deploying daemon node-exporter.smithi073 on smithi073 2024-08-31T05:13:56.205 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:13:56.206 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:13:56.206 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:13:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:56 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/322697838' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:13:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:56 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:56 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:13:58.486 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:13:58.486 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:13:59.526 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:13:59.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:59 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:59.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:59 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:59.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:59 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:59.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:59 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:13:59.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:59 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.zfoyxd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T05:13:59.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:59 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.zfoyxd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T05:13:59.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:59 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T05:13:59.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:59 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:13:59.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:13:59 smithi067 ceph-mon[17432]: Deploying daemon mgr.smithi073.zfoyxd on smithi073 2024-08-31T05:14:00.281 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:14:00.281 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:14:00.282 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:14:00.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:00 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/1218750114' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:01.868 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:14:01.868 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:14:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:14:02.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:02 smithi067 ceph-mon[17432]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:02.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:02 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:02.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:02 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:02.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:02 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:02.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:02 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:02.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:02 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:02.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:02 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T05:14:02.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:02 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:02.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:02 smithi067 ceph-mon[17432]: Deploying daemon mon.smithi073 on smithi073 2024-08-31T05:14:03.095 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:14:03.095 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:11:42.194071Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:14:03.095 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-08-31T05:14:03.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:03 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/4111721056' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:04.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:04 smithi067 ceph-mon[17432]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:05.319 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-31T05:14:05.319 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:14:05.736 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:05 smithi073 podman[24684]: 2024-08-31 05:14:05.622655335 +0000 UTC m=+0.023752123 image pull 395b9209a98089a0a9d1ab1754cc488d88f9ef293d652aedff868d7d45bee67c quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a 2024-08-31T05:14:05.736 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:05 smithi073 podman[24684]: 2024-08-31 05:14:05.735009277 +0000 UTC m=+0.136106057 container create 30ccf0ed274b17bc6e7b42d1a48fb0ade077ff0e9156cfc5a5698e9f20bdf2df (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-244a32d, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:14:06.000 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:05 smithi073 podman[24684]: 2024-08-31 05:14:05.979476602 +0000 UTC m=+0.380573392 container init 30ccf0ed274b17bc6e7b42d1a48fb0ade077ff0e9156cfc5a5698e9f20bdf2df (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-244a32d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-31T05:14:06.000 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:05 smithi073 podman[24684]: 2024-08-31 05:14:05.983128657 +0000 UTC m=+0.384225434 container start 30ccf0ed274b17bc6e7b42d1a48fb0ade077ff0e9156cfc5a5698e9f20bdf2df (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-244a32d, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-31T05:14:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi073/config 2024-08-31T05:14:06.261 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T05:14:06.261 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable), process ceph-mon, pid 2 2024-08-31T05:14:06.261 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pidfile_write: ignore empty --pid-file 2024-08-31T05:14:06.261 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: load: jerasure load: lrc 2024-08-31T05:14:06.261 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: RocksDB version: 7.9.2 2024-08-31T05:14:06.261 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Git sha 0 2024-08-31T05:14:06.261 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Compile date 2024-08-30 21:06:01 2024-08-31T05:14:06.261 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: DB SUMMARY 2024-08-31T05:14:06.261 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: DB Session ID: UKTC6WVTH1UEBL8OZDCY 2024-08-31T05:14:06.261 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: CURRENT file: CURRENT 2024-08-31T05:14:06.261 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T05:14:06.262 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-31T05:14:06.262 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi073/store.db dir, Total Num: 0, files: 2024-08-31T05:14:06.262 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi073/store.db: 000004.log size: 511 ; 2024-08-31T05:14:06.262 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.error_if_exists: 0 2024-08-31T05:14:06.262 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.create_if_missing: 0 2024-08-31T05:14:06.262 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.paranoid_checks: 1 2024-08-31T05:14:06.262 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T05:14:06.262 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T05:14:06.262 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T05:14:06.262 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.env: 0x56397fd55940 2024-08-31T05:14:06.262 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T05:14:06.262 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.info_log: 0x5639822b3740 2024-08-31T05:14:06.262 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T05:14:06.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.statistics: (nil) 2024-08-31T05:14:06.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.use_fsync: 0 2024-08-31T05:14:06.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_log_file_size: 0 2024-08-31T05:14:06.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T05:14:06.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T05:14:06.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T05:14:06.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T05:14:06.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.allow_fallocate: 1 2024-08-31T05:14:06.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T05:14:06.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T05:14:06.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.use_direct_reads: 0 2024-08-31T05:14:06.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T05:14:06.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T05:14:06.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.db_log_dir: 2024-08-31T05:14:06.264 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.wal_dir: 2024-08-31T05:14:06.264 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T05:14:06.266 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T05:14:06.266 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T05:14:06.266 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T05:14:06.266 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T05:14:06.266 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T05:14:06.266 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T05:14:06.267 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T05:14:06.267 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.write_buffer_manager: 0x5639822c2dc0 2024-08-31T05:14:06.267 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T05:14:06.267 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T05:14:06.267 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T05:14:06.267 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T05:14:06.267 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T05:14:06.267 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T05:14:06.267 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T05:14:06.267 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T05:14:06.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.unordered_write: 0 2024-08-31T05:14:06.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T05:14:06.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T05:14:06.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T05:14:06.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T05:14:06.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.row_cache: None 2024-08-31T05:14:06.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.wal_filter: None 2024-08-31T05:14:06.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T05:14:06.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T05:14:06.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.two_write_queues: 0 2024-08-31T05:14:06.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T05:14:06.269 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.wal_compression: 0 2024-08-31T05:14:06.269 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.atomic_flush: 0 2024-08-31T05:14:06.269 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T05:14:06.269 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T05:14:06.269 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T05:14:06.269 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.log_readahead_size: 0 2024-08-31T05:14:06.269 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T05:14:06.269 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T05:14:06.269 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T05:14:06.269 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T05:14:06.269 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T05:14:06.269 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T05:14:06.269 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T05:14:06.269 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_background_jobs: 2 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_background_compactions: -1 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_subcompactions: 1 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_open_files: -1 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T05:14:06.270 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T05:14:06.271 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_background_flushes: -1 2024-08-31T05:14:06.271 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Compression algorithms supported: 2024-08-31T05:14:06.271 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: kZSTD supported: 0 2024-08-31T05:14:06.271 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: kXpressCompression supported: 0 2024-08-31T05:14:06.271 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: kBZip2Compression supported: 0 2024-08-31T05:14:06.271 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T05:14:06.271 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: kLZ4Compression supported: 1 2024-08-31T05:14:06.271 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: kZlibCompression supported: 1 2024-08-31T05:14:06.271 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T05:14:06.271 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: kSnappyCompression supported: 1 2024-08-31T05:14:06.271 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T05:14:06.271 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T05:14:06.271 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi073/store.db/MANIFEST-000005 2024-08-31T05:14:06.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T05:14:06.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T05:14:06.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.merge_operator: 2024-08-31T05:14:06.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compaction_filter: None 2024-08-31T05:14:06.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T05:14:06.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T05:14:06.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T05:14:06.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T05:14:06.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5639822b33a0) 2024-08-31T05:14:06.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: cache_index_and_filter_blocks: 1 2024-08-31T05:14:06.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T05:14:06.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T05:14:06.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: pin_top_level_index_and_filter: 1 2024-08-31T05:14:06.272 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_type: 0 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: data_block_index_type: 0 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_shortening: 1 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: checksum: 4 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: no_block_cache: 0 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache: 0x5639822a7090 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_name: BinnedLRUCache 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_options: 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: capacity : 536870912 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: num_shard_bits : 4 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: strict_capacity_limit : 0 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: high_pri_pool_ratio: 0.000 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_compressed: (nil) 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: persistent_cache: (nil) 2024-08-31T05:14:06.273 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_size: 4096 2024-08-31T05:14:06.274 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_size_deviation: 10 2024-08-31T05:14:06.274 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_restart_interval: 16 2024-08-31T05:14:06.274 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_block_restart_interval: 1 2024-08-31T05:14:06.274 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: metadata_block_size: 4096 2024-08-31T05:14:06.274 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: partition_filters: 0 2024-08-31T05:14:06.274 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: use_delta_encoding: 1 2024-08-31T05:14:06.274 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: filter_policy: bloomfilter 2024-08-31T05:14:06.274 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: whole_key_filtering: 1 2024-08-31T05:14:06.274 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: verify_compression: 0 2024-08-31T05:14:06.274 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: read_amp_bytes_per_bit: 0 2024-08-31T05:14:06.274 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: format_version: 5 2024-08-31T05:14:06.274 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: enable_index_compression: 1 2024-08-31T05:14:06.274 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_align: 0 2024-08-31T05:14:06.274 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: max_auto_readahead_size: 262144 2024-08-31T05:14:06.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: prepopulate_block_cache: 0 2024-08-31T05:14:06.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: initial_auto_readahead_size: 8192 2024-08-31T05:14:06.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T05:14:06.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T05:14:06.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T05:14:06.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compression: NoCompression 2024-08-31T05:14:06.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T05:14:06.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T05:14:06.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T05:14:06.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.num_levels: 7 2024-08-31T05:14:06.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T05:14:06.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T05:14:06.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T05:14:06.275 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:14:06.276 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T05:14:06.277 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T05:14:06.278 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.inplace_update_support: 0 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.bloom_locality: 0 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.max_successive_merges: 0 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T05:14:06.279 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T05:14:06.280 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T05:14:06.280 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.ttl: 2592000 2024-08-31T05:14:06.280 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T05:14:06.280 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T05:14:06.280 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T05:14:06.280 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.enable_blob_files: false 2024-08-31T05:14:06.280 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.min_blob_size: 0 2024-08-31T05:14:06.280 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T05:14:06.280 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T05:14:06.280 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T05:14:06.280 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T05:14:06.280 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T05:14:06.280 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T05:14:06.280 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T05:14:06.281 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T05:14:06.281 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi073/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-31T05:14:06.281 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-31T05:14:06.281 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7db73db2-2f92-47fb-8b99-c1878f275414 2024-08-31T05:14:06.281 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081246010810, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-31T05:14:06.281 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-31T05:14:06.281 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081246011220, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725081246, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7db73db2-2f92-47fb-8b99-c1878f275414", "db_session_id": "UKTC6WVTH1UEBL8OZDCY", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-31T05:14:06.281 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081246011316, "job": 1, "event": "recovery_finished"} 2024-08-31T05:14:06.281 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-31T05:14:06.281 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi073/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T05:14:06.281 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5639822d4e00 2024-08-31T05:14:06.281 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: DB pointer 0x5639823d0000 2024-08-31T05:14:06.281 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** DB Stats ** 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** Compaction Stats [default] ** 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T05:14:06.282 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T05:14:06.283 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T05:14:06.283 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:14:06.283 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** Compaction Stats [default] ** 2024-08-31T05:14:06.283 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:14:06.283 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T05:14:06.283 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T05:14:06.283 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:14:06.283 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T05:14:06.283 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:14:06.283 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:14:06.283 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T05:14:06.283 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T05:14:06.283 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T05:14:06.284 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T05:14:06.284 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T05:14:06.284 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:14:06.284 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:14:06.284 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T05:14:06.284 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Block cache BinnedLRUCache@0x5639822a7090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-31T05:14:06.284 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-31T05:14:06.284 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:14:06.284 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T05:14:06.284 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073 does not exist in monmap, will attempt to join an existing cluster 2024-08-31T05:14:06.284 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: using public_addr v2:172.21.15.73:0/0 -> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-08-31T05:14:06.284 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: starting mon.smithi073 rank -1 at public addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] at bind addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi073 fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:14:06.284 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(???) e0 preinit fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:14:06.284 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(synchronizing).mds e1 new map 2024-08-31T05:14:06.285 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(synchronizing).mds e1 print_map 2024-08-31T05:14:06.285 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: e1 2024-08-31T05:14:06.285 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: btime 2024-08-31T05:11:45:459350+0000 2024-08-31T05:14:06.285 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:14:06.285 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:14:06.285 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: legacy client fscid: -1 2024-08-31T05:14:06.285 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:14:06.285 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: No filesystems configured 2024-08-31T05:14:06.285 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-31T05:14:06.285 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-31T05:14:06.285 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-31T05:14:06.285 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-31T05:14:06.285 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-31T05:14:06.285 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-31T05:14:06.286 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-08-31T05:14:06.286 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T05:14:06.286 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:14:06.286 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:14:06.286 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:14:06.286 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:06.286 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.286 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi073", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:06.286 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.286 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.286 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.286 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.286 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-31T05:14:06.287 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-08-31T05:14:06.287 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:06.287 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Deploying daemon crash.smithi067 on smithi067 2024-08-31T05:14:06.287 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Deploying cephadm binary to smithi073 2024-08-31T05:14:06.287 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.287 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.287 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.287 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.287 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.287 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Deploying daemon node-exporter.smithi067 on smithi067 2024-08-31T05:14:06.287 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.287 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Added host smithi073 2024-08-31T05:14:06.287 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.14187 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:14:06.287 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.288 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.288 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.288 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.288 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.288 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.288 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Deploying daemon alertmanager.smithi067 on smithi067 2024-08-31T05:14:06.288 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/4101660496' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-31T05:14:06.288 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.288 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/4101660496' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T05:14:06.288 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:14:06.288 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.288 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi067:172.21.15.67=smithi067;smithi073:172.21.15.73=smithi073", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:06.288 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Saving service mon spec with placement smithi067:172.21.15.67=smithi067;smithi073:172.21.15.73=smithi073;count:2 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/1698020839' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/352618137' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Regenerating cephadm self-signed grafana TLS certificates 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.290 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.290 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-08-31T05:14:06.290 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-08-31T05:14:06.290 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.290 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Deploying daemon grafana.smithi067 on smithi067 2024-08-31T05:14:06.290 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.290 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.290 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/1305459436' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.290 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.290 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/3218498413' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.290 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.290 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/235005256' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.290 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.290 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/3606794742' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Deploying daemon prometheus.smithi067 on smithi067 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/4197502041' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.291 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/1897202883' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/846165884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/3133059221' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14160 172.21.15.67:0/139881169' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mgrmap e14: smithi067.hftacj(active, since 51s) 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/2746115129' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.292 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/949236898' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.293 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Active manager daemon smithi067.hftacj restarted 2024-08-31T05:14:06.293 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Activating manager daemon smithi067.hftacj 2024-08-31T05:14:06.293 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T05:14:06.293 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mgrmap e15: smithi067.hftacj(active, starting, since 0.00286203s) 2024-08-31T05:14:06.293 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:14:06.293 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr metadata", "who": "smithi067.hftacj", "id": "smithi067.hftacj"}]: dispatch 2024-08-31T05:14:06.293 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T05:14:06.293 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T05:14:06.293 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T05:14:06.293 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Manager daemon smithi067.hftacj is now available 2024-08-31T05:14:06.293 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.293 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.293 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:14:06.293 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.hftacj/mirror_snapshot_schedule"}]: dispatch 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.hftacj/trash_purge_schedule"}]: dispatch 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/3605468593' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mgrmap e16: smithi067.hftacj(active, since 1.00493s) 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: [31/Aug/2024:05:13:43] ENGINE Bus STARTING 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: [31/Aug/2024:05:13:43] ENGINE Serving on http://172.21.15.67:8765 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: [31/Aug/2024:05:13:43] ENGINE Serving on https://172.21.15.67:7150 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: [31/Aug/2024:05:13:43] ENGINE Bus STARTED 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: [31/Aug/2024:05:13:43] ENGINE Error in HTTPServer.serve 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Traceback (most recent call last): 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:14:06.294 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:14:06.295 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: self._run(expiration_interval) 2024-08-31T05:14:06.295 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:14:06.295 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:14:06.295 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:14:06.295 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:14:06.295 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:14:06.295 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: s = self.context.wrap_socket( 2024-08-31T05:14:06.295 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:14:06.295 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: return self.sslsocket_class._create( 2024-08-31T05:14:06.295 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:14:06.295 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: self.do_handshake() 2024-08-31T05:14:06.295 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:14:06.295 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: self._sslobj.do_handshake() 2024-08-31T05:14:06.296 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:14:06.296 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/4234275598' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.296 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mgrmap e17: smithi067.hftacj(active, since 2s) 2024-08-31T05:14:06.296 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.296 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.296 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.296 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.296 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:14:06.296 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/3229402941' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.296 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.296 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.296 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.296 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.296 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd/host:smithi073", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:14:06.297 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:06.297 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:14:06.297 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Updating smithi067:/etc/ceph/ceph.conf 2024-08-31T05:14:06.297 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Updating smithi073:/etc/ceph/ceph.conf 2024-08-31T05:14:06.297 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Updating smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:14:06.297 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Updating smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:14:06.297 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:14:06.297 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:14:06.297 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Updating smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:14:06.297 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Updating smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:14:06.297 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.297 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.297 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.297 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:14:06.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-31T05:14:06.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:06.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Deploying daemon ceph-exporter.smithi073 on smithi073 2024-08-31T05:14:06.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/2814190627' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-31T05:14:06.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-08-31T05:14:06.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:06.298 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Deploying daemon crash.smithi073 on smithi073 2024-08-31T05:14:06.299 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/3123928733' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.299 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.299 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.299 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.299 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.299 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Deploying daemon node-exporter.smithi073 on smithi073 2024-08-31T05:14:06.299 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/322697838' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.299 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.299 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:14:06.299 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.299 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.299 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.299 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.299 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.zfoyxd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.zfoyxd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Deploying daemon mgr.smithi073.zfoyxd on smithi073 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/1218750114' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: Deploying daemon mon.smithi073 on smithi073 2024-08-31T05:14:06.300 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/4111721056' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:06.301 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:06.301 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 ceph-mon[24726]: mon.smithi073@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-08-31T05:14:06.301 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 bash[24684]: 30ccf0ed274b17bc6e7b42d1a48fb0ade077ff0e9156cfc5a5698e9f20bdf2df 2024-08-31T05:14:06.301 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:06 smithi073 systemd[1]: Started Ceph mon.smithi073 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:14:11.356 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:14:11.356 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:14:06.043182Z","created":"2024-08-31T05:11:42.194071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi073","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T05:14:11.357 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 2 2024-08-31T05:14:11.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:14:11.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: mon.smithi067 calling monitor election 2024-08-31T05:14:11.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:14:11.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:14:11.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:11.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:14:11.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: mon.smithi073 calling monitor election 2024-08-31T05:14:11.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:14:11.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:11.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:14:11.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:14:11.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: mon.smithi067 is new leader, mons smithi067,smithi073 in quorum (ranks 0,1) 2024-08-31T05:14:11.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: monmap epoch 2 2024-08-31T05:14:11.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:14:11.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: last_changed 2024-08-31T05:14:06.043182+0000 2024-08-31T05:14:11.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: created 2024-08-31T05:11:42.194071+0000 2024-08-31T05:14:11.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: min_mon_release 19 (squid) 2024-08-31T05:14:11.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: election_strategy: 1 2024-08-31T05:14:11.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: 0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.smithi067 2024-08-31T05:14:11.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.smithi073 2024-08-31T05:14:11.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: fsmap 2024-08-31T05:14:11.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T05:14:11.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: mgrmap e17: smithi067.hftacj(active, since 29s) 2024-08-31T05:14:11.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: overall HEALTH_OK 2024-08-31T05:14:11.448 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: Standby manager daemon smithi073.zfoyxd started 2024-08-31T05:14:11.448 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:11.448 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:11.448 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:11.448 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:11.448 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:11.448 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:14:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: mon.smithi067 calling monitor election 2024-08-31T05:14:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:14:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:14:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:14:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: mon.smithi073 calling monitor election 2024-08-31T05:14:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:14:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:11.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:14:11.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:14:11.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: mon.smithi067 is new leader, mons smithi067,smithi073 in quorum (ranks 0,1) 2024-08-31T05:14:11.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: monmap epoch 2 2024-08-31T05:14:11.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:14:11.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: last_changed 2024-08-31T05:14:06.043182+0000 2024-08-31T05:14:11.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: created 2024-08-31T05:11:42.194071+0000 2024-08-31T05:14:11.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: min_mon_release 19 (squid) 2024-08-31T05:14:11.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: election_strategy: 1 2024-08-31T05:14:11.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: 0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.smithi067 2024-08-31T05:14:11.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.smithi073 2024-08-31T05:14:11.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: fsmap 2024-08-31T05:14:11.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T05:14:11.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: mgrmap e17: smithi067.hftacj(active, since 29s) 2024-08-31T05:14:11.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: overall HEALTH_OK 2024-08-31T05:14:11.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: Standby manager daemon smithi073.zfoyxd started 2024-08-31T05:14:11.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:11.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:11.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:11.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:11.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:11.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:12.165 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-31T05:14:12.166 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config generate-minimal-conf 2024-08-31T05:14:12.432 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:12.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:12 smithi073 ceph-mon[24726]: mgrmap e18: smithi067.hftacj(active, since 29s), standbys: smithi073.zfoyxd 2024-08-31T05:14:12.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:12 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr metadata", "who": "smithi073.zfoyxd", "id": "smithi073.zfoyxd"}]: dispatch 2024-08-31T05:14:12.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:12 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:14:12.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:12 smithi073 ceph-mon[24726]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:12.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:12 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:14:12.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:12 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/3982196120' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:12.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:12 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:14:12.553 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:12 smithi067 ceph-mon[17432]: mgrmap e18: smithi067.hftacj(active, since 29s), standbys: smithi073.zfoyxd 2024-08-31T05:14:12.553 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:12 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr metadata", "who": "smithi073.zfoyxd", "id": "smithi073.zfoyxd"}]: dispatch 2024-08-31T05:14:12.553 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:12 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:14:12.553 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:12 smithi067 ceph-mon[17432]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:12.553 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:12 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:14:12.553 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:12 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/3982196120' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T05:14:12.553 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:12 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:14:13.077 INFO:teuthology.orchestra.run.smithi067.stdout:# minimal ceph.conf for 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:14:13.077 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2024-08-31T05:14:13.077 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:14:13.077 INFO:teuthology.orchestra.run.smithi067.stdout: mon_host = [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-08-31T05:14:13.405 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:13 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/4271122158' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:13.434 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:13 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/4271122158' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:13.696 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-31T05:14:13.696 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:14:13.696 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T05:14:13.726 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:14:13.727 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:14:13.793 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-08-31T05:14:13.793 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T05:14:13.819 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-08-31T05:14:13.819 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:14:13.883 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-08-31T05:14:13.884 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-08-31T05:14:13.886 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-08-31T05:14:13.886 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set client debug_client 20 2024-08-31T05:14:13.929 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-08-31T05:14:13.929 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set client debug_ms 1 2024-08-31T05:14:13.972 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-08-31T05:14:13.972 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-08-31T05:14:14.015 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-08-31T05:14:14.015 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-08-31T05:14:14.058 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-08-31T05:14:14.058 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds 20 2024-08-31T05:14:14.101 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-08-31T05:14:14.102 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-08-31T05:14:14.145 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-08-31T05:14:14.146 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set mds debug_ms 2 2024-08-31T05:14:14.206 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-08-31T05:14:14.206 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-08-31T05:14:14.240 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:14 smithi067 ceph-mon[17432]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:14.240 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:14 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:14.240 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:14 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:14.240 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:14 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:14.240 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:14 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:14:14.241 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-08-31T05:14:14.241 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-08-31T05:14:14.258 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:14.260 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-08-31T05:14:14.260 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-08-31T05:14:14.304 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-08-31T05:14:14.304 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-08-31T05:14:14.348 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-08-31T05:14:14.348 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-08-31T05:14:14.390 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-08-31T05:14:14.391 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-08-31T05:14:14.433 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-08-31T05:14:14.434 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-08-31T05:14:14.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:14 smithi073 ceph-mon[24726]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:14.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:14 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:14.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:14 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:14.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:14 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:14.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:14 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:14:14.477 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-08-31T05:14:14.477 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-08-31T05:14:14.523 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-08-31T05:14:14.524 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-08-31T05:14:14.567 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-08-31T05:14:14.568 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-08-31T05:14:14.621 DEBUG:tasks.cephadm:set 18 configs 2024-08-31T05:14:14.621 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi067') 2024-08-31T05:14:14.966 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:15.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:15 smithi067 ceph-mon[17432]: Updating smithi067:/etc/ceph/ceph.conf 2024-08-31T05:14:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:15 smithi067 ceph-mon[17432]: Updating smithi073:/etc/ceph/ceph.conf 2024-08-31T05:14:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:15 smithi067 ceph-mon[17432]: Updating smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:14:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:15 smithi067 ceph-mon[17432]: Updating smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:14:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:15 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:15 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:15 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:15 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:15 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:15 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T05:14:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:15 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T05:14:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:15 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:15 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1780394282' entity='client.admin' 2024-08-31T05:14:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:15 smithi073 ceph-mon[24726]: Updating smithi067:/etc/ceph/ceph.conf 2024-08-31T05:14:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:15 smithi073 ceph-mon[24726]: Updating smithi073:/etc/ceph/ceph.conf 2024-08-31T05:14:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:15 smithi073 ceph-mon[24726]: Updating smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:14:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:15 smithi073 ceph-mon[24726]: Updating smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:14:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:15 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:15 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:15 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:15 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:15 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:15 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T05:14:15.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:15 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T05:14:15.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:15 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:15.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:15 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1780394282' entity='client.admin' 2024-08-31T05:14:15.889 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi067') 2024-08-31T05:14:16.137 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:16.140 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:16.151 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:16.161 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:16.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:16 smithi067 ceph-mon[17432]: Reconfiguring mon.smithi067 (unknown last config time)... 2024-08-31T05:14:16.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:16 smithi067 ceph-mon[17432]: Reconfiguring daemon mon.smithi067 on smithi067 2024-08-31T05:14:16.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:16 smithi067 ceph-mon[17432]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:16.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:16 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:16.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:16 smithi073 ceph-mon[24726]: Reconfiguring mon.smithi067 (unknown last config time)... 2024-08-31T05:14:16.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:16 smithi073 ceph-mon[24726]: Reconfiguring daemon mon.smithi067 on smithi067 2024-08-31T05:14:16.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:16 smithi073 ceph-mon[24726]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:16.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:16 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:17.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:17 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2561681014' entity='client.admin' 2024-08-31T05:14:17.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:17 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2657446608' entity='client.admin' 2024-08-31T05:14:17.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:17 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2561681014' entity='client.admin' 2024-08-31T05:14:17.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:17 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2657446608' entity='client.admin' 2024-08-31T05:14:18.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:18 smithi067 ceph-mon[17432]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:18.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:18 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/236839020' entity='client.admin' 2024-08-31T05:14:18.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:18 smithi073 ceph-mon[24726]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:18.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:18 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/236839020' entity='client.admin' 2024-08-31T05:14:19.279 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi067') 2024-08-31T05:14:20.149 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:20.150 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:20.151 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:20.151 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:20.151 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:20.152 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:20.152 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:20.382 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:20.382 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:20.382 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:20.383 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:20.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:20 smithi067 ceph-mon[17432]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:20.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:20 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3964120051' entity='client.admin' 2024-08-31T05:14:20.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:20 smithi073 ceph-mon[24726]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:20 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3964120051' entity='client.admin' 2024-08-31T05:14:21.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:21 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/717456612' entity='client.admin' 2024-08-31T05:14:21.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:21 smithi067 ceph-mon[17432]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:21.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:21 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/717456612' entity='client.admin' 2024-08-31T05:14:21.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:21 smithi073 ceph-mon[24726]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:22.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.263+0000 7f23ae741640 1 -- 172.21.15.67:0/4037520508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23a81002e0 msgr2=0x7f23a81006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:22.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.263+0000 7f23ae741640 1 --2- 172.21.15.67:0/4037520508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23a81002e0 0x7f23a81006e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2398009880 tx=0x7f239802a5d0 comp rx=0 tx=0).stop 2024-08-31T05:14:22.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7f23ae741640 1 -- 172.21.15.67:0/4037520508 shutdown_connections 2024-08-31T05:14:22.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7f23ae741640 1 --2- 172.21.15.67:0/4037520508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23a81002e0 0x7f23a81006e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:22.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7f23ae741640 1 -- 172.21.15.67:0/4037520508 >> 172.21.15.67:0/4037520508 conn(0x7f23a80fba70 msgr2=0x7f23a80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:22.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7f23ae741640 1 -- 172.21.15.67:0/4037520508 shutdown_connections 2024-08-31T05:14:22.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7f23ae741640 1 -- 172.21.15.67:0/4037520508 wait complete. 2024-08-31T05:14:22.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7f23ae741640 1 Processor -- start 2024-08-31T05:14:22.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7ff6a3545640 1 -- 172.21.15.67:0/386927889 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff68806df00 msgr2=0x7ff6880703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:22.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7ff6a3545640 1 --2- 172.21.15.67:0/386927889 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff68806df00 0x7ff6880703c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff69c197ce0 tx=0x7ff68c007040 comp rx=0 tx=0).stop 2024-08-31T05:14:22.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7ff6a3545640 1 -- 172.21.15.67:0/386927889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff69c1002e0 msgr2=0x7ff69c196830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:22.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7ff6a3545640 1 --2- 172.21.15.67:0/386927889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff69c1002e0 0x7ff69c196830 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff698009230 tx=0x7ff698004040 comp rx=0 tx=0).stop 2024-08-31T05:14:22.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7ff6a3545640 1 -- 172.21.15.67:0/386927889 shutdown_connections 2024-08-31T05:14:22.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7ff6a3545640 1 --2- 172.21.15.67:0/386927889 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff68806df00 0x7ff6880703c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:22.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7ff6a3545640 1 --2- 172.21.15.67:0/386927889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff69c196d70 0x7ff69c19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:22.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7ff6a3545640 1 --2- 172.21.15.67:0/386927889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff69c1002e0 0x7ff69c196830 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:22.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7ff6a3545640 1 -- 172.21.15.67:0/386927889 >> 172.21.15.67:0/386927889 conn(0x7ff69c0fba70 msgr2=0x7ff69c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7f23ae741640 1 -- start start 2024-08-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7ff6a3545640 1 -- 172.21.15.67:0/386927889 shutdown_connections 2024-08-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.264+0000 7ff6a3545640 1 -- 172.21.15.67:0/386927889 wait complete. 2024-08-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.265+0000 7f23ae741640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23a81002e0 0x7f23a81957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.265+0000 7f23ae741640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23a8195d20 0x7f23a819ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.265+0000 7f23ae741640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f23a8106200 con 0x7f23a8195d20 2024-08-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.265+0000 7f23ae741640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f23a8106080 con 0x7f23a81002e0 2024-08-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.265+0000 7f23a77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23a8195d20 0x7f23a819ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.265+0000 7f23a77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23a8195d20 0x7f23a819ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58710/0 (socket says 172.21.15.67:58710) 2024-08-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.265+0000 7f23a77fe640 1 -- 172.21.15.67:0/2537678141 learned_addr learned my addr 172.21.15.67:0/2537678141 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.265+0000 7f23a7fff640 1 --2- 172.21.15.67:0/2537678141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23a81002e0 0x7f23a81957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.265+0000 7f23a77fe640 1 -- 172.21.15.67:0/2537678141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23a81002e0 msgr2=0x7f23a81957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.265+0000 7f23a77fe640 1 --2- 172.21.15.67:0/2537678141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23a81002e0 0x7f23a81957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.265+0000 7f23a77fe640 1 -- 172.21.15.67:0/2537678141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a8196250 con 0x7f23a8195d20 2024-08-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.265+0000 7f23a7fff640 1 --2- 172.21.15.67:0/2537678141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23a81002e0 0x7f23a81957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.265+0000 7f23a77fe640 1 --2- 172.21.15.67:0/2537678141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23a8195d20 0x7f23a819ad20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f239c00b4a0 tx=0x7f239c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.266+0000 7f23a57fa640 1 -- 172.21.15.67:0/2537678141 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f239c014070 con 0x7f23a8195d20 2024-08-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.266+0000 7f23ae741640 1 -- 172.21.15.67:0/2537678141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a819b260 con 0x7f23a8195d20 2024-08-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.266+0000 7f23a57fa640 1 -- 172.21.15.67:0/2537678141 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f239c010ab0 con 0x7f23a8195d20 2024-08-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.266+0000 7f23a57fa640 1 -- 172.21.15.67:0/2537678141 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f239c017c80 con 0x7f23a8195d20 2024-08-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.266+0000 7f23ae741640 1 -- 172.21.15.67:0/2537678141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a819b7e0 con 0x7f23a8195d20 2024-08-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.267+0000 7f23ae741640 1 -- 172.21.15.67:0/2537678141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a81069a0 con 0x7f23a8195d20 2024-08-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.267+0000 7f23a57fa640 1 -- 172.21.15.67:0/2537678141 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f239c017070 con 0x7f23a8195d20 2024-08-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.267+0000 7f23a57fa640 1 --2- 172.21.15.67:0/2537678141 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f239006deb0 0x7f2390070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.268+0000 7f23a57fa640 1 -- 172.21.15.67:0/2537678141 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f239c00d040 con 0x7f23a8195d20 2024-08-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.268+0000 7f23a7fff640 1 --2- 172.21.15.67:0/2537678141 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f239006deb0 0x7f2390070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.268+0000 7f23a7fff640 1 --2- 172.21.15.67:0/2537678141 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f239006deb0 0x7f2390070370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2398005d90 tx=0x7f2398004ea0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:22.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.272+0000 7f23a57fa640 1 -- 172.21.15.67:0/2537678141 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f239c01e030 con 0x7f23a8195d20 2024-08-31T05:14:22.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.452+0000 7f23ae741640 1 -- 172.21.15.67:0/2537678141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f23a8100760 con 0x7f23a8195d20 2024-08-31T05:14:22.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.455+0000 7f23a57fa640 1 -- 172.21.15.67:0/2537678141 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v18)=0 v18) ==== 125+0+0 (secure 0 0 0) 0x7f239c05aec0 con 0x7f23a8195d20 2024-08-31T05:14:22.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.458+0000 7f23ae741640 1 -- 172.21.15.67:0/2537678141 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f239006deb0 msgr2=0x7f2390070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.458+0000 7f23ae741640 1 --2- 172.21.15.67:0/2537678141 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f239006deb0 0x7f2390070370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2398005d90 tx=0x7f2398004ea0 comp rx=0 tx=0).stop 2024-08-31T05:14:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.458+0000 7f23ae741640 1 -- 172.21.15.67:0/2537678141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23a8195d20 msgr2=0x7f23a819ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.458+0000 7f23ae741640 1 --2- 172.21.15.67:0/2537678141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23a8195d20 0x7f23a819ad20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f239c00b4a0 tx=0x7f239c00b960 comp rx=0 tx=0).stop 2024-08-31T05:14:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.458+0000 7f23ae741640 1 -- 172.21.15.67:0/2537678141 shutdown_connections 2024-08-31T05:14:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.458+0000 7f23ae741640 1 --2- 172.21.15.67:0/2537678141 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f239006deb0 0x7f2390070370 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.458+0000 7f23ae741640 1 --2- 172.21.15.67:0/2537678141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f23a8195d20 0x7f23a819ad20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.458+0000 7f23ae741640 1 --2- 172.21.15.67:0/2537678141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23a81002e0 0x7f23a81957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.458+0000 7f23ae741640 1 -- 172.21.15.67:0/2537678141 >> 172.21.15.67:0/2537678141 conn(0x7f23a80fba70 msgr2=0x7f23a80fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.458+0000 7f23ae741640 1 -- 172.21.15.67:0/2537678141 shutdown_connections 2024-08-31T05:14:22.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.458+0000 7f23ae741640 1 -- 172.21.15.67:0/2537678141 wait complete. 2024-08-31T05:14:23.413 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:23 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/386927889' entity='client.admin' 2024-08-31T05:14:23.413 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:23 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2537678141' entity='client.admin' 2024-08-31T05:14:23.413 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:23 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/566279153' entity='client.admin' 2024-08-31T05:14:23.413 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:23 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:23.413 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:23 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:23.413 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:23 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.hftacj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T05:14:23.414 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:23 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T05:14:23.414 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:23 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:23.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:23 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/386927889' entity='client.admin' 2024-08-31T05:14:23.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:23 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2537678141' entity='client.admin' 2024-08-31T05:14:23.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:23 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/566279153' entity='client.admin' 2024-08-31T05:14:23.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:23 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:23.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:23 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:23.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:23 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.hftacj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T05:14:23.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:23 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T05:14:23.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:23 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:24.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc471a8640 1 -- 172.21.15.67:0/1558154185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc40102900 msgr2=0x7efc40102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:24.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc471a8640 1 --2- 172.21.15.67:0/1558154185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc40102900 0x7efc40102d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efc28009880 tx=0x7efc2802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:14:24.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc471a8640 1 -- 172.21.15.67:0/1558154185 shutdown_connections 2024-08-31T05:14:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc471a8640 1 --2- 172.21.15.67:0/1558154185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc40102900 0x7efc40102d80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc471a8640 1 --2- 172.21.15.67:0/1558154185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc40101700 0x7efc40101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc471a8640 1 -- 172.21.15.67:0/1558154185 >> 172.21.15.67:0/1558154185 conn(0x7efc400fceb0 msgr2=0x7efc400ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc471a8640 1 -- 172.21.15.67:0/1558154185 shutdown_connections 2024-08-31T05:14:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc471a8640 1 -- 172.21.15.67:0/1558154185 wait complete. 2024-08-31T05:14:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc471a8640 1 Processor -- start 2024-08-31T05:14:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc471a8640 1 -- start start 2024-08-31T05:14:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc471a8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc40101700 0x7efc40197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc471a8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc40102900 0x7efc401976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc471a8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efc4010a400 con 0x7efc40101700 2024-08-31T05:14:24.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc471a8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efc4010a280 con 0x7efc40102900 2024-08-31T05:14:24.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc44f44640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc40101700 0x7efc40197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:24.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.052+0000 7efc44f44640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc40101700 0x7efc40197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58752/0 (socket says 172.21.15.67:58752) 2024-08-31T05:14:24.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.053+0000 7efc44f44640 1 -- 172.21.15.67:0/876151641 learned_addr learned my addr 172.21.15.67:0/876151641 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:14:24.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.053+0000 7efc3ffff640 1 --2- 172.21.15.67:0/876151641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc40102900 0x7efc401976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:24.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.053+0000 7efc44f44640 1 -- 172.21.15.67:0/876151641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc40102900 msgr2=0x7efc401976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:24.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.053+0000 7efc44f44640 1 --2- 172.21.15.67:0/876151641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc40102900 0x7efc401976c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:24.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.053+0000 7efc44f44640 1 -- 172.21.15.67:0/876151641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc40197d40 con 0x7efc40101700 2024-08-31T05:14:24.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.053+0000 7efc3ffff640 1 --2- 172.21.15.67:0/876151641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc40102900 0x7efc401976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:14:24.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.053+0000 7efc44f44640 1 --2- 172.21.15.67:0/876151641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc40101700 0x7efc40197180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efc3800e940 tx=0x7efc3800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:24.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.053+0000 7efc3dffb640 1 -- 172.21.15.67:0/876151641 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc3800cac0 con 0x7efc40101700 2024-08-31T05:14:24.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.053+0000 7efc3dffb640 1 -- 172.21.15.67:0/876151641 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7efc3800cc60 con 0x7efc40101700 2024-08-31T05:14:24.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.053+0000 7efc3dffb640 1 -- 172.21.15.67:0/876151641 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc38003d80 con 0x7efc40101700 2024-08-31T05:14:24.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.053+0000 7efc471a8640 1 -- 172.21.15.67:0/876151641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4019c780 con 0x7efc40101700 2024-08-31T05:14:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.053+0000 7efc471a8640 1 -- 172.21.15.67:0/876151641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc4019cd90 con 0x7efc40101700 2024-08-31T05:14:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.054+0000 7efc471a8640 1 -- 172.21.15.67:0/876151641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc4010abe0 con 0x7efc40101700 2024-08-31T05:14:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.055+0000 7efc3dffb640 1 -- 172.21.15.67:0/876151641 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7efc38003fc0 con 0x7efc40101700 2024-08-31T05:14:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.055+0000 7efc3dffb640 1 --2- 172.21.15.67:0/876151641 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7efc2c06dda0 0x7efc2c070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.055+0000 7efc3dffb640 1 -- 172.21.15.67:0/876151641 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7efc3808d0b0 con 0x7efc40101700 2024-08-31T05:14:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.055+0000 7efc3ffff640 1 --2- 172.21.15.67:0/876151641 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7efc2c06dda0 0x7efc2c070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.056+0000 7efc3ffff640 1 --2- 172.21.15.67:0/876151641 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7efc2c06dda0 0x7efc2c070260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efc40198630 tx=0x7efc28005d50 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:24.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.059+0000 7efc3dffb640 1 -- 172.21.15.67:0/876151641 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efc3805bd30 con 0x7efc40101700 2024-08-31T05:14:24.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.248+0000 7efc471a8640 1 -- 172.21.15.67:0/876151641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7efc40101b00 con 0x7efc40101700 2024-08-31T05:14:24.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.252+0000 7efc3dffb640 1 -- 172.21.15.67:0/876151641 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v20)=0 v20) ==== 117+0+0 (secure 0 0 0) 0x7efc3805f9e0 con 0x7efc40101700 2024-08-31T05:14:24.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.254+0000 7efc471a8640 1 -- 172.21.15.67:0/876151641 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7efc2c06dda0 msgr2=0x7efc2c070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:24.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.254+0000 7efc471a8640 1 --2- 172.21.15.67:0/876151641 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7efc2c06dda0 0x7efc2c070260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efc40198630 tx=0x7efc28005d50 comp rx=0 tx=0).stop 2024-08-31T05:14:24.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.254+0000 7efc471a8640 1 -- 172.21.15.67:0/876151641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc40101700 msgr2=0x7efc40197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:24.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.254+0000 7efc471a8640 1 --2- 172.21.15.67:0/876151641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc40101700 0x7efc40197180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efc3800e940 tx=0x7efc3800ee00 comp rx=0 tx=0).stop 2024-08-31T05:14:24.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.254+0000 7efc471a8640 1 -- 172.21.15.67:0/876151641 shutdown_connections 2024-08-31T05:14:24.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.254+0000 7efc471a8640 1 --2- 172.21.15.67:0/876151641 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7efc2c06dda0 0x7efc2c070260 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.254+0000 7efc471a8640 1 --2- 172.21.15.67:0/876151641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc40102900 0x7efc401976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.254+0000 7efc471a8640 1 --2- 172.21.15.67:0/876151641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc40101700 0x7efc40197180 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.254+0000 7efc471a8640 1 -- 172.21.15.67:0/876151641 >> 172.21.15.67:0/876151641 conn(0x7efc400fceb0 msgr2=0x7efc400ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.254+0000 7efc471a8640 1 -- 172.21.15.67:0/876151641 shutdown_connections 2024-08-31T05:14:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.254+0000 7efc471a8640 1 -- 172.21.15.67:0/876151641 wait complete. 2024-08-31T05:14:24.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.280+0000 7f609b817640 1 -- 172.21.15.67:0/2725561371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6094102190 msgr2=0x7f6094104580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:24.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.280+0000 7f609b817640 1 --2- 172.21.15.67:0/2725561371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6094102190 0x7f6094104580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f60900098b0 tx=0x7f609002a4d0 comp rx=0 tx=0).stop 2024-08-31T05:14:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.280+0000 7f609b817640 1 -- 172.21.15.67:0/2725561371 shutdown_connections 2024-08-31T05:14:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.280+0000 7f609b817640 1 --2- 172.21.15.67:0/2725561371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6094104ac0 0x7f6094106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.280+0000 7f609b817640 1 --2- 172.21.15.67:0/2725561371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6094102190 0x7f6094104580 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.280+0000 7f609b817640 1 -- 172.21.15.67:0/2725561371 >> 172.21.15.67:0/2725561371 conn(0x7f60940fbd90 msgr2=0x7f60940fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.280+0000 7f609b817640 1 -- 172.21.15.67:0/2725561371 shutdown_connections 2024-08-31T05:14:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.280+0000 7f609b817640 1 -- 172.21.15.67:0/2725561371 wait complete. 2024-08-31T05:14:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.280+0000 7f609b817640 1 Processor -- start 2024-08-31T05:14:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.280+0000 7f609b817640 1 -- start start 2024-08-31T05:14:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.281+0000 7f609b817640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6094102190 0x7f60941971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.281+0000 7f609b817640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6094104ac0 0x7f6094197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.281+0000 7f609b817640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f609410a440 con 0x7f6094102190 2024-08-31T05:14:24.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.281+0000 7f609b817640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f609410a2c0 con 0x7f6094104ac0 2024-08-31T05:14:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.281+0000 7f60995b3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6094102190 0x7f60941971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.281+0000 7f60995b3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6094102190 0x7f60941971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58774/0 (socket says 172.21.15.67:58774) 2024-08-31T05:14:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.281+0000 7f60995b3640 1 -- 172.21.15.67:0/3928880670 learned_addr learned my addr 172.21.15.67:0/3928880670 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:14:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.281+0000 7f6098db2640 1 --2- 172.21.15.67:0/3928880670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6094104ac0 0x7f6094197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.281+0000 7f60995b3640 1 -- 172.21.15.67:0/3928880670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6094104ac0 msgr2=0x7f6094197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.281+0000 7f60995b3640 1 --2- 172.21.15.67:0/3928880670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6094104ac0 0x7f6094197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.281+0000 7f60995b3640 1 -- 172.21.15.67:0/3928880670 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6094197db0 con 0x7f6094102190 2024-08-31T05:14:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.281+0000 7f6098db2640 1 --2- 172.21.15.67:0/3928880670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6094104ac0 0x7f6094197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:14:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.281+0000 7f60995b3640 1 --2- 172.21.15.67:0/3928880670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6094102190 0x7f60941971f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6090004ee0 tx=0x7f6090004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.282+0000 7f608a7fc640 1 -- 172.21.15.67:0/3928880670 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f609003f070 con 0x7f6094102190 2024-08-31T05:14:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.282+0000 7f609b817640 1 -- 172.21.15.67:0/3928880670 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609419c790 con 0x7f6094102190 2024-08-31T05:14:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.282+0000 7f608a7fc640 1 -- 172.21.15.67:0/3928880670 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f6090004950 con 0x7f6094102190 2024-08-31T05:14:24.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.282+0000 7f608a7fc640 1 -- 172.21.15.67:0/3928880670 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6090035030 con 0x7f6094102190 2024-08-31T05:14:24.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.282+0000 7f609b817640 1 -- 172.21.15.67:0/3928880670 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609419cda0 con 0x7f6094102190 2024-08-31T05:14:24.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.283+0000 7f609b817640 1 -- 172.21.15.67:0/3928880670 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f609410ac20 con 0x7f6094102190 2024-08-31T05:14:24.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.283+0000 7f608a7fc640 1 -- 172.21.15.67:0/3928880670 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f6090042070 con 0x7f6094102190 2024-08-31T05:14:24.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.284+0000 7f608a7fc640 1 --2- 172.21.15.67:0/3928880670 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f608006ddc0 0x7f6080070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:24.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.284+0000 7f608a7fc640 1 -- 172.21.15.67:0/3928880670 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f60900ad480 con 0x7f6094102190 2024-08-31T05:14:24.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.284+0000 7f6098db2640 1 --2- 172.21.15.67:0/3928880670 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f608006ddc0 0x7f6080070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:24.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.285+0000 7f6098db2640 1 --2- 172.21.15.67:0/3928880670 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f608006ddc0 0x7f6080070280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f60941986a0 tx=0x7f6084005f90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:24.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.290+0000 7f608a7fc640 1 -- 172.21.15.67:0/3928880670 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f609007fdb0 con 0x7f6094102190 2024-08-31T05:14:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.469+0000 7f609b817640 1 -- 172.21.15.67:0/3928880670 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f6094102570 con 0x7f6094102190 2024-08-31T05:14:24.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.472+0000 7f608a7fc640 1 -- 172.21.15.67:0/3928880670 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v21)=0 v21) ==== 122+0+0 (secure 0 0 0) 0x7f60900845e0 con 0x7f6094102190 2024-08-31T05:14:24.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.474+0000 7f609b817640 1 -- 172.21.15.67:0/3928880670 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f608006ddc0 msgr2=0x7f6080070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:24.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.474+0000 7f609b817640 1 --2- 172.21.15.67:0/3928880670 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f608006ddc0 0x7f6080070280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f60941986a0 tx=0x7f6084005f90 comp rx=0 tx=0).stop 2024-08-31T05:14:24.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.474+0000 7f609b817640 1 -- 172.21.15.67:0/3928880670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6094102190 msgr2=0x7f60941971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:24.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.474+0000 7f609b817640 1 --2- 172.21.15.67:0/3928880670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6094102190 0x7f60941971f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6090004ee0 tx=0x7f6090004600 comp rx=0 tx=0).stop 2024-08-31T05:14:24.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.474+0000 7f609b817640 1 -- 172.21.15.67:0/3928880670 shutdown_connections 2024-08-31T05:14:24.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.474+0000 7f609b817640 1 --2- 172.21.15.67:0/3928880670 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f608006ddc0 0x7f6080070280 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:24.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.474+0000 7f609b817640 1 --2- 172.21.15.67:0/3928880670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6094104ac0 0x7f6094197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.474+0000 7f609b817640 1 --2- 172.21.15.67:0/3928880670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6094102190 0x7f60941971f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.475+0000 7f609b817640 1 -- 172.21.15.67:0/3928880670 >> 172.21.15.67:0/3928880670 conn(0x7f60940fbd90 msgr2=0x7f60940fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.475+0000 7f609b817640 1 -- 172.21.15.67:0/3928880670 shutdown_connections 2024-08-31T05:14:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:24.475+0000 7f609b817640 1 -- 172.21.15.67:0/3928880670 wait complete. 2024-08-31T05:14:24.524 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:24 smithi067 ceph-mon[17432]: Reconfiguring mgr.smithi067.hftacj (unknown last config time)... 2024-08-31T05:14:24.524 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:24 smithi067 ceph-mon[17432]: Reconfiguring daemon mgr.smithi067.hftacj on smithi067 2024-08-31T05:14:24.524 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:24 smithi067 ceph-mon[17432]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:24.524 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:24 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/876151641' entity='client.admin' 2024-08-31T05:14:24.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:24 smithi073 ceph-mon[24726]: Reconfiguring mgr.smithi067.hftacj (unknown last config time)... 2024-08-31T05:14:24.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:24 smithi073 ceph-mon[24726]: Reconfiguring daemon mgr.smithi067.hftacj on smithi067 2024-08-31T05:14:24.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:24 smithi073 ceph-mon[24726]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:24 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/876151641' entity='client.admin' 2024-08-31T05:14:25.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:25 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3928880670' entity='client.admin' 2024-08-31T05:14:25.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:25 smithi067 ceph-mon[17432]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:25.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.706+0000 7ff575110640 1 -- 172.21.15.67:0/2756514627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff570102900 msgr2=0x7ff570102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:25.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.706+0000 7ff575110640 1 --2- 172.21.15.67:0/2756514627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff570102900 0x7ff570102d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff564009880 tx=0x7ff56402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:14:25.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.706+0000 7ff575110640 1 -- 172.21.15.67:0/2756514627 shutdown_connections 2024-08-31T05:14:25.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.706+0000 7ff575110640 1 --2- 172.21.15.67:0/2756514627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff570102900 0x7ff570102d80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:25.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.706+0000 7ff575110640 1 --2- 172.21.15.67:0/2756514627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570101700 0x7ff570101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:25.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.706+0000 7ff575110640 1 -- 172.21.15.67:0/2756514627 >> 172.21.15.67:0/2756514627 conn(0x7ff5700fce90 msgr2=0x7ff5700ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:25.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.707+0000 7ff575110640 1 -- 172.21.15.67:0/2756514627 shutdown_connections 2024-08-31T05:14:25.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.707+0000 7ff575110640 1 -- 172.21.15.67:0/2756514627 wait complete. 2024-08-31T05:14:25.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.707+0000 7ff575110640 1 Processor -- start 2024-08-31T05:14:25.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.707+0000 7ff575110640 1 -- start start 2024-08-31T05:14:25.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff575110640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff570101700 0x7ff570197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:25.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff575110640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570102900 0x7ff5701976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:25.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff575110640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff57010a3e0 con 0x7ff570101700 2024-08-31T05:14:25.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff575110640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff57010a260 con 0x7ff570102900 2024-08-31T05:14:25.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff56ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff570101700 0x7ff570197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:25.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff56ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff570101700 0x7ff570197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58798/0 (socket says 172.21.15.67:58798) 2024-08-31T05:14:25.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff56ed9d640 1 -- 172.21.15.67:0/3297626509 learned_addr learned my addr 172.21.15.67:0/3297626509 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:14:25.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff56e59c640 1 --2- 172.21.15.67:0/3297626509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570102900 0x7ff5701976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:25.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff56ed9d640 1 -- 172.21.15.67:0/3297626509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570102900 msgr2=0x7ff5701976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:25.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff56ed9d640 1 --2- 172.21.15.67:0/3297626509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570102900 0x7ff5701976c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:25.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff56ed9d640 1 -- 172.21.15.67:0/3297626509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff570197d40 con 0x7ff570101700 2024-08-31T05:14:25.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff56ed9d640 1 --2- 172.21.15.67:0/3297626509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff570101700 0x7ff570197180 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff56000d8d0 tx=0x7ff56000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:25.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff557fff640 1 -- 172.21.15.67:0/3297626509 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff560017020 con 0x7ff570101700 2024-08-31T05:14:25.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff557fff640 1 -- 172.21.15.67:0/3297626509 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7ff560010460 con 0x7ff570101700 2024-08-31T05:14:25.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff557fff640 1 -- 172.21.15.67:0/3297626509 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff56000f5f0 con 0x7ff570101700 2024-08-31T05:14:25.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff575110640 1 -- 172.21.15.67:0/3297626509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff57019c780 con 0x7ff570101700 2024-08-31T05:14:25.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.708+0000 7ff575110640 1 -- 172.21.15.67:0/3297626509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff57019cce0 con 0x7ff570101700 2024-08-31T05:14:25.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.709+0000 7ff575110640 1 -- 172.21.15.67:0/3297626509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff57010abc0 con 0x7ff570101700 2024-08-31T05:14:25.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.710+0000 7ff557fff640 1 -- 172.21.15.67:0/3297626509 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7ff56001a020 con 0x7ff570101700 2024-08-31T05:14:25.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.710+0000 7ff557fff640 1 --2- 172.21.15.67:0/3297626509 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff55806ddb0 0x7ff558070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:25.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.711+0000 7ff56e59c640 1 --2- 172.21.15.67:0/3297626509 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff55806ddb0 0x7ff558070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:25.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.711+0000 7ff557fff640 1 -- 172.21.15.67:0/3297626509 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff56008c8c0 con 0x7ff570101700 2024-08-31T05:14:25.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.711+0000 7ff56e59c640 1 --2- 172.21.15.67:0/3297626509 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff55806ddb0 0x7ff558070270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff564000c00 tx=0x7ff564005d50 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:25.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.715+0000 7ff557fff640 1 -- 172.21.15.67:0/3297626509 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff560021030 con 0x7ff570101700 2024-08-31T05:14:25.897 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:25 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3928880670' entity='client.admin' 2024-08-31T05:14:25.898 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:25 smithi073 ceph-mon[24726]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.895+0000 7ff575110640 1 -- 172.21.15.67:0/3297626509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7ff570101b00 con 0x7ff570101700 2024-08-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.904+0000 7ff557fff640 1 -- 172.21.15.67:0/3297626509 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7ff56005b540 con 0x7ff570101700 2024-08-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.907+0000 7ff575110640 1 -- 172.21.15.67:0/3297626509 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff55806ddb0 msgr2=0x7ff558070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.907+0000 7ff575110640 1 --2- 172.21.15.67:0/3297626509 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff55806ddb0 0x7ff558070270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff564000c00 tx=0x7ff564005d50 comp rx=0 tx=0).stop 2024-08-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.907+0000 7ff575110640 1 -- 172.21.15.67:0/3297626509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff570101700 msgr2=0x7ff570197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.907+0000 7ff575110640 1 --2- 172.21.15.67:0/3297626509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff570101700 0x7ff570197180 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff56000d8d0 tx=0x7ff56000dd90 comp rx=0 tx=0).stop 2024-08-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.907+0000 7ff575110640 1 -- 172.21.15.67:0/3297626509 shutdown_connections 2024-08-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.907+0000 7ff575110640 1 --2- 172.21.15.67:0/3297626509 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff55806ddb0 0x7ff558070270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.907+0000 7ff575110640 1 --2- 172.21.15.67:0/3297626509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff570102900 0x7ff5701976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.907+0000 7ff575110640 1 --2- 172.21.15.67:0/3297626509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff570101700 0x7ff570197180 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.907+0000 7ff575110640 1 -- 172.21.15.67:0/3297626509 >> 172.21.15.67:0/3297626509 conn(0x7ff5700fce90 msgr2=0x7ff570105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.907+0000 7ff575110640 1 -- 172.21.15.67:0/3297626509 shutdown_connections 2024-08-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.907+0000 7ff575110640 1 -- 172.21.15.67:0/3297626509 wait complete. 2024-08-31T05:14:26.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.892+0000 7f8f7aed0640 1 -- 172.21.15.67:0/3572085826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f74100600 msgr2=0x7f8f74100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:26.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.892+0000 7f8f7aed0640 1 --2- 172.21.15.67:0/3572085826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f74100600 0x7f8f74100a00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009880 tx=0x7f8f6802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:14:26.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.893+0000 7f8f7aed0640 1 -- 172.21.15.67:0/3572085826 shutdown_connections 2024-08-31T05:14:26.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.893+0000 7f8f7aed0640 1 --2- 172.21.15.67:0/3572085826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f74101800 0x7f8f74101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:26.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.893+0000 7f8f7aed0640 1 --2- 172.21.15.67:0/3572085826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f74100600 0x7f8f74100a00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:26.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.893+0000 7f8f7aed0640 1 -- 172.21.15.67:0/3572085826 >> 172.21.15.67:0/3572085826 conn(0x7f8f740fbdb0 msgr2=0x7f8f740fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.893+0000 7f8f7aed0640 1 -- 172.21.15.67:0/3572085826 shutdown_connections 2024-08-31T05:14:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.893+0000 7f8f7aed0640 1 -- 172.21.15.67:0/3572085826 wait complete. 2024-08-31T05:14:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.893+0000 7f8f7aed0640 1 Processor -- start 2024-08-31T05:14:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.893+0000 7f8f7aed0640 1 -- start start 2024-08-31T05:14:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.893+0000 7f8f7aed0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f74100600 0x7f8f74104520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f7aed0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f74101800 0x7f8f74102be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f7aed0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8f74109300 con 0x7f8f74101800 2024-08-31T05:14:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f7aed0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8f74109180 con 0x7f8f74100600 2024-08-31T05:14:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f73fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f74101800 0x7f8f74102be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f78c6c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f74100600 0x7f8f74104520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f73fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f74101800 0x7f8f74102be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58826/0 (socket says 172.21.15.67:58826) 2024-08-31T05:14:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f73fff640 1 -- 172.21.15.67:0/399684605 learned_addr learned my addr 172.21.15.67:0/399684605 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:14:26.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f73fff640 1 -- 172.21.15.67:0/399684605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f74100600 msgr2=0x7f8f74104520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f73fff640 1 --2- 172.21.15.67:0/399684605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f74100600 0x7f8f74104520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f73fff640 1 -- 172.21.15.67:0/399684605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f74103120 con 0x7f8f74101800 2024-08-31T05:14:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f78c6c640 1 --2- 172.21.15.67:0/399684605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f74100600 0x7f8f74104520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:14:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f73fff640 1 --2- 172.21.15.67:0/399684605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f74101800 0x7f8f74102be0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000e970 tx=0x7f8f6000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f71ffb640 1 -- 172.21.15.67:0/399684605 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f6000cac0 con 0x7f8f74101800 2024-08-31T05:14:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f71ffb640 1 -- 172.21.15.67:0/399684605 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f8f600054c0 con 0x7f8f74101800 2024-08-31T05:14:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f7aed0640 1 -- 172.21.15.67:0/399684605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f74103410 con 0x7f8f74101800 2024-08-31T05:14:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.894+0000 7f8f71ffb640 1 -- 172.21.15.67:0/399684605 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f60004dc0 con 0x7f8f74101800 2024-08-31T05:14:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.895+0000 7f8f7aed0640 1 -- 172.21.15.67:0/399684605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f74103a20 con 0x7f8f74101800 2024-08-31T05:14:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.896+0000 7f8f7aed0640 1 -- 172.21.15.67:0/399684605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f74109ae0 con 0x7f8f74101800 2024-08-31T05:14:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.896+0000 7f8f71ffb640 1 -- 172.21.15.67:0/399684605 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f8f60005020 con 0x7f8f74101800 2024-08-31T05:14:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.896+0000 7f8f71ffb640 1 --2- 172.21.15.67:0/399684605 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f8f6406dd40 0x7f8f64070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.897+0000 7f8f71ffb640 1 -- 172.21.15.67:0/399684605 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8f6008d080 con 0x7f8f74101800 2024-08-31T05:14:26.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.897+0000 7f8f78c6c640 1 --2- 172.21.15.67:0/399684605 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f8f6406dd40 0x7f8f64070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:26.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.897+0000 7f8f78c6c640 1 --2- 172.21.15.67:0/399684605 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f8f6406dd40 0x7f8f64070200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8f68006010 tx=0x7f8f68005d50 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:26.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:25.902+0000 7f8f71ffb640 1 -- 172.21.15.67:0/399684605 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8f6005bd00 con 0x7f8f74101800 2024-08-31T05:14:26.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.087+0000 7f8f7aed0640 1 -- 172.21.15.67:0/399684605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f8f7419f310 con 0x7f8f74101800 2024-08-31T05:14:26.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.090+0000 7f8f71ffb640 1 -- 172.21.15.67:0/399684605 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v23)=0 v23) ==== 106+0+0 (secure 0 0 0) 0x7f8f6007b070 con 0x7f8f74101800 2024-08-31T05:14:26.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.093+0000 7f8f7aed0640 1 -- 172.21.15.67:0/399684605 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f8f6406dd40 msgr2=0x7f8f64070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:26.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.093+0000 7f8f7aed0640 1 --2- 172.21.15.67:0/399684605 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f8f6406dd40 0x7f8f64070200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8f68006010 tx=0x7f8f68005d50 comp rx=0 tx=0).stop 2024-08-31T05:14:26.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.093+0000 7f8f7aed0640 1 -- 172.21.15.67:0/399684605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f74101800 msgr2=0x7f8f74102be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:26.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.093+0000 7f8f7aed0640 1 --2- 172.21.15.67:0/399684605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f74101800 0x7f8f74102be0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000e970 tx=0x7f8f6000ed70 comp rx=0 tx=0).stop 2024-08-31T05:14:26.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.093+0000 7f8f7aed0640 1 -- 172.21.15.67:0/399684605 shutdown_connections 2024-08-31T05:14:26.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.093+0000 7f8f7aed0640 1 --2- 172.21.15.67:0/399684605 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f8f6406dd40 0x7f8f64070200 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:26.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.093+0000 7f8f7aed0640 1 --2- 172.21.15.67:0/399684605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f74101800 0x7f8f74102be0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:26.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.093+0000 7f8f7aed0640 1 --2- 172.21.15.67:0/399684605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f74100600 0x7f8f74104520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:26.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.093+0000 7f8f7aed0640 1 -- 172.21.15.67:0/399684605 >> 172.21.15.67:0/399684605 conn(0x7f8f740fbdb0 msgr2=0x7f8f74069ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:26.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.093+0000 7f8f7aed0640 1 -- 172.21.15.67:0/399684605 shutdown_connections 2024-08-31T05:14:26.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.093+0000 7f8f7aed0640 1 -- 172.21.15.67:0/399684605 wait complete. 2024-08-31T05:14:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.985+0000 7f420932a640 1 -- 172.21.15.67:0/2567421302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4204101800 msgr2=0x7f4204101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.985+0000 7f420932a640 1 --2- 172.21.15.67:0/2567421302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4204101800 0x7f4204101c80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009880 tx=0x7f41ec02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.985+0000 7f420932a640 1 -- 172.21.15.67:0/2567421302 shutdown_connections 2024-08-31T05:14:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.985+0000 7f420932a640 1 --2- 172.21.15.67:0/2567421302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4204101800 0x7f4204101c80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.985+0000 7f420932a640 1 --2- 172.21.15.67:0/2567421302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4204100600 0x7f4204100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.985+0000 7f420932a640 1 -- 172.21.15.67:0/2567421302 >> 172.21.15.67:0/2567421302 conn(0x7f42040fbdb0 msgr2=0x7f42040fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.985+0000 7f420932a640 1 -- 172.21.15.67:0/2567421302 shutdown_connections 2024-08-31T05:14:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.985+0000 7f420932a640 1 -- 172.21.15.67:0/2567421302 wait complete. 2024-08-31T05:14:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.985+0000 7f420932a640 1 Processor -- start 2024-08-31T05:14:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.985+0000 7f420932a640 1 -- start start 2024-08-31T05:14:27.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f420932a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4204100600 0x7f420406aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f420932a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4204101800 0x7f420419bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f420932a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f42041092e0 con 0x7f4204100600 2024-08-31T05:14:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f420932a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4204109160 con 0x7f4204101800 2024-08-31T05:14:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f4202ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4204100600 0x7f420406aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f4202ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4204100600 0x7f420406aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58854/0 (socket says 172.21.15.67:58854) 2024-08-31T05:14:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f4202ffd640 1 -- 172.21.15.67:0/1662199317 learned_addr learned my addr 172.21.15.67:0/1662199317 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:14:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f41fbfff640 1 --2- 172.21.15.67:0/1662199317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4204101800 0x7f420419bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f4202ffd640 1 -- 172.21.15.67:0/1662199317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4204101800 msgr2=0x7f420419bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f4202ffd640 1 --2- 172.21.15.67:0/1662199317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4204101800 0x7f420419bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f4202ffd640 1 -- 172.21.15.67:0/1662199317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420419c410 con 0x7f4204100600 2024-08-31T05:14:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f4202ffd640 1 --2- 172.21.15.67:0/1662199317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4204100600 0x7f420406aa40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f41f400c920 tx=0x7f41f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f4200ff9640 1 -- 172.21.15.67:0/1662199317 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41f4007a10 con 0x7f4204100600 2024-08-31T05:14:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f420932a640 1 -- 172.21.15.67:0/1662199317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420419c700 con 0x7f4204100600 2024-08-31T05:14:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f4200ff9640 1 -- 172.21.15.67:0/1662199317 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f41f4007bb0 con 0x7f4204100600 2024-08-31T05:14:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f4200ff9640 1 -- 172.21.15.67:0/1662199317 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41f4003da0 con 0x7f4204100600 2024-08-31T05:14:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.986+0000 7f420932a640 1 -- 172.21.15.67:0/1662199317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f420419cd10 con 0x7f4204100600 2024-08-31T05:14:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.987+0000 7f420932a640 1 -- 172.21.15.67:0/1662199317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4204109ac0 con 0x7f4204100600 2024-08-31T05:14:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.988+0000 7f4200ff9640 1 -- 172.21.15.67:0/1662199317 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f41f4003f40 con 0x7f4204100600 2024-08-31T05:14:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.988+0000 7f4200ff9640 1 --2- 172.21.15.67:0/1662199317 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f41f006ddb0 0x7f41f0070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.988+0000 7f4200ff9640 1 -- 172.21.15.67:0/1662199317 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f41f408cc10 con 0x7f4204100600 2024-08-31T05:14:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.988+0000 7f41fbfff640 1 --2- 172.21.15.67:0/1662199317 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f41f006ddb0 0x7f41f0070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.989+0000 7f41fbfff640 1 --2- 172.21.15.67:0/1662199317 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f41f006ddb0 0x7f41f0070270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f420406a7c0 tx=0x7f41ec004ea0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:26.992+0000 7f4200ff9640 1 -- 172.21.15.67:0/1662199317 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f41f405b890 con 0x7f4204100600 2024-08-31T05:14:27.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:26 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3297626509' entity='client.admin' 2024-08-31T05:14:27.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:26 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/399684605' entity='client.admin' 2024-08-31T05:14:27.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:26 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:14:27.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.468+0000 7fa104aa3640 1 -- 172.21.15.67:0/1423267966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa100101e70 msgr2=0x7fa100104260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:27.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.468+0000 7fa104aa3640 1 --2- 172.21.15.67:0/1423267966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa100101e70 0x7fa100104260 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009880 tx=0x7fa0f002a5d0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.468+0000 7fa104aa3640 1 -- 172.21.15.67:0/1423267966 shutdown_connections 2024-08-31T05:14:27.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.468+0000 7fa104aa3640 1 --2- 172.21.15.67:0/1423267966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa100101e70 0x7fa100104260 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.468+0000 7fa104aa3640 1 -- 172.21.15.67:0/1423267966 >> 172.21.15.67:0/1423267966 conn(0x7fa1000fba70 msgr2=0x7fa1000fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:27.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.468+0000 7fa104aa3640 1 -- 172.21.15.67:0/1423267966 shutdown_connections 2024-08-31T05:14:27.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.468+0000 7fa104aa3640 1 -- 172.21.15.67:0/1423267966 wait complete. 2024-08-31T05:14:27.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.469+0000 7fa104aa3640 1 Processor -- start 2024-08-31T05:14:27.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.469+0000 7fa104aa3640 1 -- start start 2024-08-31T05:14:27.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.469+0000 7fa104aa3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa100101e70 0x7fa100196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:27.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.470+0000 7fa104aa3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa100196da0 0x7fa10019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:27.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.470+0000 7fa104aa3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa100107280 con 0x7fa100196da0 2024-08-31T05:14:27.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.470+0000 7fa104aa3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa100107100 con 0x7fa100101e70 2024-08-31T05:14:27.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.470+0000 7fa0fdd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa100196da0 0x7fa10019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:27.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.470+0000 7fa0fdd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa100196da0 0x7fa10019bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58726/0 (socket says 172.21.15.67:58726) 2024-08-31T05:14:27.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.470+0000 7fa0fdd9b640 1 -- 172.21.15.67:0/566279153 learned_addr learned my addr 172.21.15.67:0/566279153 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:14:27.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.470+0000 7fa0fe59c640 1 --2- 172.21.15.67:0/566279153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa100101e70 0x7fa100196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:27.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.470+0000 7fa0fdd9b640 1 -- 172.21.15.67:0/566279153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa100101e70 msgr2=0x7fa100196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:27.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.470+0000 7fa0fdd9b640 1 --2- 172.21.15.67:0/566279153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa100101e70 0x7fa100196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.470+0000 7fa0fdd9b640 1 -- 172.21.15.67:0/566279153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1001972d0 con 0x7fa100196da0 2024-08-31T05:14:27.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.470+0000 7fa0fdd9b640 1 --2- 172.21.15.67:0/566279153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa100196da0 0x7fa10019bda0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400b4a0 tx=0x7fa0f400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:27.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.470+0000 7fa0ef7fe640 1 -- 172.21.15.67:0/566279153 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0f4014070 con 0x7fa100196da0 2024-08-31T05:14:27.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.470+0000 7fa0ef7fe640 1 -- 172.21.15.67:0/566279153 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fa0f4010ab0 con 0x7fa100196da0 2024-08-31T05:14:27.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.471+0000 7fa104aa3640 1 -- 172.21.15.67:0/566279153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10019c2e0 con 0x7fa100196da0 2024-08-31T05:14:27.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.471+0000 7fa0ef7fe640 1 -- 172.21.15.67:0/566279153 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0f4017c80 con 0x7fa100196da0 2024-08-31T05:14:27.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.471+0000 7fa104aa3640 1 -- 172.21.15.67:0/566279153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa10019c860 con 0x7fa100196da0 2024-08-31T05:14:27.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.472+0000 7fa104aa3640 1 -- 172.21.15.67:0/566279153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa100107a20 con 0x7fa100196da0 2024-08-31T05:14:27.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.472+0000 7fa0ef7fe640 1 -- 172.21.15.67:0/566279153 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7fa0f4017070 con 0x7fa100196da0 2024-08-31T05:14:27.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.473+0000 7fa0ef7fe640 1 --2- 172.21.15.67:0/566279153 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fa0e806df00 0x7fa0e80703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:27.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.473+0000 7fa0ef7fe640 1 -- 172.21.15.67:0/566279153 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa0f400d040 con 0x7fa100196da0 2024-08-31T05:14:27.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.473+0000 7fa0fe59c640 1 --2- 172.21.15.67:0/566279153 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fa0e806df00 0x7fa0e80703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:27.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.473+0000 7fa0fe59c640 1 --2- 172.21.15.67:0/566279153 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fa0e806df00 0x7fa0e80703c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00096c0 tx=0x7fa0f0005d50 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:27.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.481+0000 7fa0ef7fe640 1 -- 172.21.15.67:0/566279153 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa0f401e030 con 0x7fa100196da0 2024-08-31T05:14:27.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.660+0000 7fa104aa3640 1 -- 172.21.15.67:0/566279153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fa10002d8e0 con 0x7fa100196da0 2024-08-31T05:14:27.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.663+0000 7fa0ef7fe640 1 -- 172.21.15.67:0/566279153 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v19)=0 v19) ==== 119+0+0 (secure 0 0 0) 0x7fa0f4056070 con 0x7fa100196da0 2024-08-31T05:14:27.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.666+0000 7fa104aa3640 1 -- 172.21.15.67:0/566279153 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fa0e806df00 msgr2=0x7fa0e80703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:27.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.666+0000 7fa104aa3640 1 --2- 172.21.15.67:0/566279153 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fa0e806df00 0x7fa0e80703c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00096c0 tx=0x7fa0f0005d50 comp rx=0 tx=0).stop 2024-08-31T05:14:27.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.666+0000 7fa104aa3640 1 -- 172.21.15.67:0/566279153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa100196da0 msgr2=0x7fa10019bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:27.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.666+0000 7fa104aa3640 1 --2- 172.21.15.67:0/566279153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa100196da0 0x7fa10019bda0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400b4a0 tx=0x7fa0f400b960 comp rx=0 tx=0).stop 2024-08-31T05:14:27.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.666+0000 7fa104aa3640 1 -- 172.21.15.67:0/566279153 shutdown_connections 2024-08-31T05:14:27.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.666+0000 7fa104aa3640 1 --2- 172.21.15.67:0/566279153 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fa0e806df00 0x7fa0e80703c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.666+0000 7fa104aa3640 1 --2- 172.21.15.67:0/566279153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa100196da0 0x7fa10019bda0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.666+0000 7fa104aa3640 1 --2- 172.21.15.67:0/566279153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa100101e70 0x7fa100196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.666+0000 7fa104aa3640 1 -- 172.21.15.67:0/566279153 >> 172.21.15.67:0/566279153 conn(0x7fa1000fba70 msgr2=0x7fa1000fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:27.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.666+0000 7fa104aa3640 1 -- 172.21.15.67:0/566279153 shutdown_connections 2024-08-31T05:14:27.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:22.666+0000 7fa104aa3640 1 -- 172.21.15.67:0/566279153 wait complete. 2024-08-31T05:14:27.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:27.171+0000 7f420932a640 1 -- 172.21.15.67:0/1662199317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f420402d8b0 con 0x7f4204100600 2024-08-31T05:14:27.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:27.176+0000 7f4200ff9640 1 -- 172.21.15.67:0/1662199317 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v24)=0 v24) ==== 120+0+0 (secure 0 0 0) 0x7f41f405f540 con 0x7f4204100600 2024-08-31T05:14:27.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:27.179+0000 7f420932a640 1 -- 172.21.15.67:0/1662199317 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f41f006ddb0 msgr2=0x7f41f0070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:27.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:27.179+0000 7f420932a640 1 --2- 172.21.15.67:0/1662199317 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f41f006ddb0 0x7f41f0070270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f420406a7c0 tx=0x7f41ec004ea0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:27.179+0000 7f420932a640 1 -- 172.21.15.67:0/1662199317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4204100600 msgr2=0x7f420406aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:27.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:27.179+0000 7f420932a640 1 --2- 172.21.15.67:0/1662199317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4204100600 0x7f420406aa40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f41f400c920 tx=0x7f41f400cde0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:27.179+0000 7f420932a640 1 -- 172.21.15.67:0/1662199317 shutdown_connections 2024-08-31T05:14:27.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:27.179+0000 7f420932a640 1 --2- 172.21.15.67:0/1662199317 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f41f006ddb0 0x7f41f0070270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:27.179+0000 7f420932a640 1 --2- 172.21.15.67:0/1662199317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4204101800 0x7f420419bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:27.179+0000 7f420932a640 1 --2- 172.21.15.67:0/1662199317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4204100600 0x7f420406aa40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:27.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:27.179+0000 7f420932a640 1 -- 172.21.15.67:0/1662199317 >> 172.21.15.67:0/1662199317 conn(0x7f42040fbdb0 msgr2=0x7f4204104d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:27.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:27.179+0000 7f420932a640 1 -- 172.21.15.67:0/1662199317 shutdown_connections 2024-08-31T05:14:27.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:27.179+0000 7f420932a640 1 -- 172.21.15.67:0/1662199317 wait complete. 2024-08-31T05:14:27.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:26 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3297626509' entity='client.admin' 2024-08-31T05:14:27.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:26 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/399684605' entity='client.admin' 2024-08-31T05:14:27.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:26 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:14:28.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:28 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1662199317' entity='client.admin' 2024-08-31T05:14:28.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:28 smithi073 ceph-mon[24726]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:28.509 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:28 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1662199317' entity='client.admin' 2024-08-31T05:14:28.509 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:28 smithi067 ceph-mon[17432]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:29.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.636+0000 7f9248025640 1 -- 172.21.15.67:0/371171102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92401008c0 msgr2=0x7f9240100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:29.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.636+0000 7f9248025640 1 --2- 172.21.15.67:0/371171102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92401008c0 0x7f9240100d20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9234009880 tx=0x7f923402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:14:29.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.636+0000 7f9248025640 1 -- 172.21.15.67:0/371171102 shutdown_connections 2024-08-31T05:14:29.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.636+0000 7f9248025640 1 --2- 172.21.15.67:0/371171102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92401008c0 0x7f9240100d20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:29.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.636+0000 7f9248025640 1 --2- 172.21.15.67:0/371171102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92400fff80 0x7f9240100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:29.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.636+0000 7f9248025640 1 -- 172.21.15.67:0/371171102 >> 172.21.15.67:0/371171102 conn(0x7f92400fbdb0 msgr2=0x7f92400fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:29.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.637+0000 7f9248025640 1 -- 172.21.15.67:0/371171102 shutdown_connections 2024-08-31T05:14:29.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.637+0000 7f9248025640 1 -- 172.21.15.67:0/371171102 wait complete. 2024-08-31T05:14:29.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.637+0000 7f9248025640 1 Processor -- start 2024-08-31T05:14:29.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.637+0000 7f9248025640 1 -- start start 2024-08-31T05:14:29.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.637+0000 7f9248025640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92400fff80 0x7f9240199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:29.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.637+0000 7f9248025640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92401008c0 0x7f92401998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:29.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.637+0000 7f9248025640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f924010c5f0 con 0x7f92401008c0 2024-08-31T05:14:29.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.637+0000 7f9248025640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f924010c470 con 0x7f92400fff80 2024-08-31T05:14:29.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.637+0000 7f92455c0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92401008c0 0x7f92401998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:29.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.637+0000 7f92455c0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92401008c0 0x7f92401998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33916/0 (socket says 172.21.15.67:33916) 2024-08-31T05:14:29.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.637+0000 7f92455c0640 1 -- 172.21.15.67:0/2921845258 learned_addr learned my addr 172.21.15.67:0/2921845258 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:14:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.638+0000 7f9245dc1640 1 --2- 172.21.15.67:0/2921845258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92400fff80 0x7f9240199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.638+0000 7f92455c0640 1 -- 172.21.15.67:0/2921845258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92400fff80 msgr2=0x7f9240199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.638+0000 7f92455c0640 1 --2- 172.21.15.67:0/2921845258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92400fff80 0x7f9240199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.638+0000 7f92455c0640 1 -- 172.21.15.67:0/2921845258 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9240199f30 con 0x7f92401008c0 2024-08-31T05:14:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.638+0000 7f92455c0640 1 --2- 172.21.15.67:0/2921845258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92401008c0 0x7f92401998b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9234009230 tx=0x7f92340048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.638+0000 7f923effd640 1 -- 172.21.15.67:0/2921845258 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f923403f070 con 0x7f92401008c0 2024-08-31T05:14:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.638+0000 7f923effd640 1 -- 172.21.15.67:0/2921845258 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f9234003a90 con 0x7f92401008c0 2024-08-31T05:14:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.638+0000 7f9248025640 1 -- 172.21.15.67:0/2921845258 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f924019e910 con 0x7f92401008c0 2024-08-31T05:14:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.638+0000 7f923effd640 1 -- 172.21.15.67:0/2921845258 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9234035030 con 0x7f92401008c0 2024-08-31T05:14:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.638+0000 7f9248025640 1 -- 172.21.15.67:0/2921845258 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f924019ef20 con 0x7f92401008c0 2024-08-31T05:14:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.639+0000 7f9248025640 1 -- 172.21.15.67:0/2921845258 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f924010cdd0 con 0x7f92401008c0 2024-08-31T05:14:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.640+0000 7f923effd640 1 -- 172.21.15.67:0/2921845258 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f9234042070 con 0x7f92401008c0 2024-08-31T05:14:29.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.640+0000 7f923effd640 1 --2- 172.21.15.67:0/2921845258 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f922806ddb0 0x7f9228070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:29.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.640+0000 7f923effd640 1 -- 172.21.15.67:0/2921845258 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f92340ad540 con 0x7f92401008c0 2024-08-31T05:14:29.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.640+0000 7f9245dc1640 1 --2- 172.21.15.67:0/2921845258 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f922806ddb0 0x7f9228070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:29.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.641+0000 7f9245dc1640 1 --2- 172.21.15.67:0/2921845258 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f922806ddb0 0x7f9228070270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9238005fd0 tx=0x7f923800b390 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:29.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.645+0000 7f923effd640 1 -- 172.21.15.67:0/2921845258 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f923407fe70 con 0x7f92401008c0 2024-08-31T05:14:29.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.822+0000 7f9248025640 1 -- 172.21.15.67:0/2921845258 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f924002d890 con 0x7f92401008c0 2024-08-31T05:14:29.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.828+0000 7f923effd640 1 -- 172.21.15.67:0/2921845258 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v25)=0 v25) ==== 123+0+0 (secure 0 0 0) 0x7f92340846a0 con 0x7f92401008c0 2024-08-31T05:14:29.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.829+0000 7f923effd640 1 -- 172.21.15.67:0/2921845258 <== mon.0 v2:172.21.15.67:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f92340054c0 con 0x7f92401008c0 2024-08-31T05:14:29.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.830+0000 7f9248025640 1 -- 172.21.15.67:0/2921845258 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f922806ddb0 msgr2=0x7f9228070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:29.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.830+0000 7f9248025640 1 --2- 172.21.15.67:0/2921845258 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f922806ddb0 0x7f9228070270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9238005fd0 tx=0x7f923800b390 comp rx=0 tx=0).stop 2024-08-31T05:14:29.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.830+0000 7f9248025640 1 -- 172.21.15.67:0/2921845258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92401008c0 msgr2=0x7f92401998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:29.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.830+0000 7f9248025640 1 --2- 172.21.15.67:0/2921845258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92401008c0 0x7f92401998b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9234009230 tx=0x7f92340048f0 comp rx=0 tx=0).stop 2024-08-31T05:14:29.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.831+0000 7f9248025640 1 -- 172.21.15.67:0/2921845258 shutdown_connections 2024-08-31T05:14:29.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.831+0000 7f9248025640 1 --2- 172.21.15.67:0/2921845258 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f922806ddb0 0x7f9228070270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:29.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.831+0000 7f9248025640 1 --2- 172.21.15.67:0/2921845258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92401008c0 0x7f92401998b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:29.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.831+0000 7f9248025640 1 --2- 172.21.15.67:0/2921845258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92400fff80 0x7f9240199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:29.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.831+0000 7f9248025640 1 -- 172.21.15.67:0/2921845258 >> 172.21.15.67:0/2921845258 conn(0x7f92400fbdb0 msgr2=0x7f9240108890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:29.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.831+0000 7f9248025640 1 -- 172.21.15.67:0/2921845258 shutdown_connections 2024-08-31T05:14:29.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:29.831+0000 7f9248025640 1 -- 172.21.15.67:0/2921845258 wait complete. 2024-08-31T05:14:30.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.052+0000 7fa01d758640 1 -- 172.21.15.67:0/244372032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa018100600 msgr2=0x7fa018100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:30.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.052+0000 7fa01d758640 1 --2- 172.21.15.67:0/244372032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa018100600 0x7fa018100a00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa008009880 tx=0x7fa00802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:14:30.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.052+0000 7fa01d758640 1 -- 172.21.15.67:0/244372032 shutdown_connections 2024-08-31T05:14:30.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.052+0000 7fa01d758640 1 --2- 172.21.15.67:0/244372032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa018101800 0x7fa018101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:30.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.052+0000 7fa01d758640 1 --2- 172.21.15.67:0/244372032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa018100600 0x7fa018100a00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:30.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.052+0000 7fa01d758640 1 -- 172.21.15.67:0/244372032 >> 172.21.15.67:0/244372032 conn(0x7fa0180fbdb0 msgr2=0x7fa0180fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:30.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.052+0000 7fa01d758640 1 -- 172.21.15.67:0/244372032 shutdown_connections 2024-08-31T05:14:30.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.052+0000 7fa01d758640 1 -- 172.21.15.67:0/244372032 wait complete. 2024-08-31T05:14:30.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.053+0000 7fa01d758640 1 Processor -- start 2024-08-31T05:14:30.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.053+0000 7fa01d758640 1 -- start start 2024-08-31T05:14:30.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.053+0000 7fa01d758640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa018100600 0x7fa01806aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:30.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.053+0000 7fa01d758640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa018101800 0x7fa01819c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.053+0000 7fa01d758640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa0181094a0 con 0x7fa018100600 2024-08-31T05:14:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.053+0000 7fa01d758640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa018109320 con 0x7fa018101800 2024-08-31T05:14:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.053+0000 7fa016ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa018100600 0x7fa01806aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.053+0000 7fa016ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa018100600 0x7fa01806aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33932/0 (socket says 172.21.15.67:33932) 2024-08-31T05:14:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.053+0000 7fa016ffd640 1 -- 172.21.15.67:0/947433363 learned_addr learned my addr 172.21.15.67:0/947433363 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:14:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.054+0000 7fa0167fc640 1 --2- 172.21.15.67:0/947433363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa018101800 0x7fa01819c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.054+0000 7fa016ffd640 1 -- 172.21.15.67:0/947433363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa018101800 msgr2=0x7fa01819c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.054+0000 7fa016ffd640 1 --2- 172.21.15.67:0/947433363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa018101800 0x7fa01819c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.054+0000 7fa016ffd640 1 -- 172.21.15.67:0/947433363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01819c5f0 con 0x7fa018100600 2024-08-31T05:14:30.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.054+0000 7fa016ffd640 1 --2- 172.21.15.67:0/947433363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa018100600 0x7fa01806aa40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa008006010 tx=0x7fa0080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.054+0000 7fa00ffff640 1 -- 172.21.15.67:0/947433363 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa00803f070 con 0x7fa018100600 2024-08-31T05:14:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.054+0000 7fa00ffff640 1 -- 172.21.15.67:0/947433363 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa0080044d0 con 0x7fa018100600 2024-08-31T05:14:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.054+0000 7fa00ffff640 1 -- 172.21.15.67:0/947433363 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa008035030 con 0x7fa018100600 2024-08-31T05:14:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.054+0000 7fa01d758640 1 -- 172.21.15.67:0/947433363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa01819c880 con 0x7fa018100600 2024-08-31T05:14:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.054+0000 7fa01d758640 1 -- 172.21.15.67:0/947433363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa01819ce30 con 0x7fa018100600 2024-08-31T05:14:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.055+0000 7fa01d758640 1 -- 172.21.15.67:0/947433363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa018100a00 con 0x7fa018100600 2024-08-31T05:14:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.056+0000 7fa00ffff640 1 -- 172.21.15.67:0/947433363 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7fa008042070 con 0x7fa018100600 2024-08-31T05:14:30.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.056+0000 7fa00ffff640 1 --2- 172.21.15.67:0/947433363 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fa00406ddb0 0x7fa004070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:30.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.056+0000 7fa00ffff640 1 -- 172.21.15.67:0/947433363 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa0080ad7c0 con 0x7fa018100600 2024-08-31T05:14:30.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.056+0000 7fa0167fc640 1 --2- 172.21.15.67:0/947433363 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fa00406ddb0 0x7fa004070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:30.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.057+0000 7fa0167fc640 1 --2- 172.21.15.67:0/947433363 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fa00406ddb0 0x7fa004070270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa01806a7c0 tx=0x7fa000008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:30.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.060+0000 7fa00ffff640 1 -- 172.21.15.67:0/947433363 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa00807c3b0 con 0x7fa018100600 2024-08-31T05:14:30.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.236+0000 7fa01d758640 1 -- 172.21.15.67:0/947433363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fa018062b90 con 0x7fa018100600 2024-08-31T05:14:30.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.239+0000 7fa00ffff640 1 -- 172.21.15.67:0/947433363 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v26)=0 v26) ==== 108+0+0 (secure 0 0 0) 0x7fa008080060 con 0x7fa018100600 2024-08-31T05:14:30.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.241+0000 7fa01d758640 1 -- 172.21.15.67:0/947433363 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fa00406ddb0 msgr2=0x7fa004070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:30.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.241+0000 7fa01d758640 1 --2- 172.21.15.67:0/947433363 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fa00406ddb0 0x7fa004070270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa01806a7c0 tx=0x7fa000008040 comp rx=0 tx=0).stop 2024-08-31T05:14:30.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.241+0000 7fa01d758640 1 -- 172.21.15.67:0/947433363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa018100600 msgr2=0x7fa01806aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:30.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.241+0000 7fa01d758640 1 --2- 172.21.15.67:0/947433363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa018100600 0x7fa01806aa40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa008006010 tx=0x7fa0080048f0 comp rx=0 tx=0).stop 2024-08-31T05:14:30.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.241+0000 7fa01d758640 1 -- 172.21.15.67:0/947433363 shutdown_connections 2024-08-31T05:14:30.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.241+0000 7fa01d758640 1 --2- 172.21.15.67:0/947433363 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fa00406ddb0 0x7fa004070270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:30.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.241+0000 7fa01d758640 1 --2- 172.21.15.67:0/947433363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa018101800 0x7fa01819c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:30.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.241+0000 7fa01d758640 1 --2- 172.21.15.67:0/947433363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa018100600 0x7fa01806aa40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:30.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.241+0000 7fa01d758640 1 -- 172.21.15.67:0/947433363 >> 172.21.15.67:0/947433363 conn(0x7fa0180fbdb0 msgr2=0x7fa018104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:30.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.242+0000 7fa01d758640 1 -- 172.21.15.67:0/947433363 shutdown_connections 2024-08-31T05:14:30.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:30.242+0000 7fa01d758640 1 -- 172.21.15.67:0/947433363 wait complete. 2024-08-31T05:14:30.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:30 smithi067 ceph-mon[17432]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:30.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:30 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2921845258' entity='client.admin' 2024-08-31T05:14:30.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:30 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/947433363' entity='client.admin' 2024-08-31T05:14:30.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:30 smithi073 ceph-mon[24726]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:30.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:30 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2921845258' entity='client.admin' 2024-08-31T05:14:30.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:30 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/947433363' entity='client.admin' 2024-08-31T05:14:31.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.854+0000 7f65d7e7d640 1 -- 172.21.15.67:0/1262228830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65d01008c0 msgr2=0x7f65d0100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:31.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.854+0000 7f65d7e7d640 1 --2- 172.21.15.67:0/1262228830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65d01008c0 0x7f65d0100d20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009880 tx=0x7f65c002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:14:31.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.854+0000 7f65d7e7d640 1 -- 172.21.15.67:0/1262228830 shutdown_connections 2024-08-31T05:14:31.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.854+0000 7f65d7e7d640 1 --2- 172.21.15.67:0/1262228830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65d01008c0 0x7f65d0100d20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:31.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.854+0000 7f65d7e7d640 1 --2- 172.21.15.67:0/1262228830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65d00fff80 0x7f65d0100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:31.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.854+0000 7f65d7e7d640 1 -- 172.21.15.67:0/1262228830 >> 172.21.15.67:0/1262228830 conn(0x7f65d00fbdb0 msgr2=0x7f65d00fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:31.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.855+0000 7f65d7e7d640 1 -- 172.21.15.67:0/1262228830 shutdown_connections 2024-08-31T05:14:31.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.855+0000 7f65d7e7d640 1 -- 172.21.15.67:0/1262228830 wait complete. 2024-08-31T05:14:31.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.855+0000 7f65d7e7d640 1 Processor -- start 2024-08-31T05:14:31.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.855+0000 7f65d7e7d640 1 -- start start 2024-08-31T05:14:31.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.855+0000 7f65d7e7d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65d00fff80 0x7f65d0199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:31.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.855+0000 7f65d7e7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65d01008c0 0x7f65d01999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:31.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.855+0000 7f65d7e7d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f65d010c790 con 0x7f65d00fff80 2024-08-31T05:14:31.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.855+0000 7f65d7e7d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f65d010c610 con 0x7f65d01008c0 2024-08-31T05:14:31.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.855+0000 7f65d5c19640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65d00fff80 0x7f65d0199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:31.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.855+0000 7f65d5c19640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65d00fff80 0x7f65d0199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33950/0 (socket says 172.21.15.67:33950) 2024-08-31T05:14:31.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.856+0000 7f65d5c19640 1 -- 172.21.15.67:0/3144670438 learned_addr learned my addr 172.21.15.67:0/3144670438 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:14:31.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.856+0000 7f65d5418640 1 --2- 172.21.15.67:0/3144670438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65d01008c0 0x7f65d01999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:31.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.856+0000 7f65d5c19640 1 -- 172.21.15.67:0/3144670438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65d01008c0 msgr2=0x7f65d01999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:31.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.856+0000 7f65d5c19640 1 --2- 172.21.15.67:0/3144670438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65d01008c0 0x7f65d01999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:31.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.856+0000 7f65d5c19640 1 -- 172.21.15.67:0/3144670438 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d019a050 con 0x7f65d00fff80 2024-08-31T05:14:31.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.856+0000 7f65d5418640 1 --2- 172.21.15.67:0/3144670438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65d01008c0 0x7f65d01999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:14:31.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.856+0000 7f65d5c19640 1 --2- 172.21.15.67:0/3144670438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65d00fff80 0x7f65d0199490 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00b420 tx=0x7f65cc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:31.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.856+0000 7f65c6ffd640 1 -- 172.21.15.67:0/3144670438 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f65cc011630 con 0x7f65d00fff80 2024-08-31T05:14:31.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.856+0000 7f65c6ffd640 1 -- 172.21.15.67:0/3144670438 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f65cc016070 con 0x7f65d00fff80 2024-08-31T05:14:31.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.856+0000 7f65c6ffd640 1 -- 172.21.15.67:0/3144670438 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f65cc010d40 con 0x7f65d00fff80 2024-08-31T05:14:31.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.856+0000 7f65d7e7d640 1 -- 172.21.15.67:0/3144670438 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d019ea90 con 0x7f65d00fff80 2024-08-31T05:14:31.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.856+0000 7f65d7e7d640 1 -- 172.21.15.67:0/3144670438 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d019f020 con 0x7f65d00fff80 2024-08-31T05:14:31.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.857+0000 7f65d7e7d640 1 -- 172.21.15.67:0/3144670438 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d0100380 con 0x7f65d00fff80 2024-08-31T05:14:31.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.858+0000 7f65c6ffd640 1 -- 172.21.15.67:0/3144670438 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f65cc01b460 con 0x7f65d00fff80 2024-08-31T05:14:31.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.858+0000 7f65c6ffd640 1 --2- 172.21.15.67:0/3144670438 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f65bc06de00 0x7f65bc0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:31.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.859+0000 7f65c6ffd640 1 -- 172.21.15.67:0/3144670438 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f65cc08c2a0 con 0x7f65d00fff80 2024-08-31T05:14:31.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.859+0000 7f65d5418640 1 --2- 172.21.15.67:0/3144670438 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f65bc06de00 0x7f65bc0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:31.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.859+0000 7f65d5418640 1 --2- 172.21.15.67:0/3144670438 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f65bc06de00 0x7f65bc0702c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f65c00096c0 tx=0x7f65c0009650 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:31.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:31.863+0000 7f65c6ffd640 1 -- 172.21.15.67:0/3144670438 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f65cc05afa0 con 0x7f65d00fff80 2024-08-31T05:14:32.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:32.041+0000 7f65d7e7d640 1 -- 172.21.15.67:0/3144670438 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f65d01935a0 con 0x7f65d00fff80 2024-08-31T05:14:32.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:32.044+0000 7f65c6ffd640 1 -- 172.21.15.67:0/3144670438 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f65cc05ec50 con 0x7f65d00fff80 2024-08-31T05:14:32.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:32.046+0000 7f65d7e7d640 1 -- 172.21.15.67:0/3144670438 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f65bc06de00 msgr2=0x7f65bc0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:32.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:32.046+0000 7f65d7e7d640 1 --2- 172.21.15.67:0/3144670438 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f65bc06de00 0x7f65bc0702c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f65c00096c0 tx=0x7f65c0009650 comp rx=0 tx=0).stop 2024-08-31T05:14:32.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:32.046+0000 7f65d7e7d640 1 -- 172.21.15.67:0/3144670438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65d00fff80 msgr2=0x7f65d0199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:32.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:32.046+0000 7f65d7e7d640 1 --2- 172.21.15.67:0/3144670438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65d00fff80 0x7f65d0199490 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00b420 tx=0x7f65cc00b8e0 comp rx=0 tx=0).stop 2024-08-31T05:14:32.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:32.046+0000 7f65d7e7d640 1 -- 172.21.15.67:0/3144670438 shutdown_connections 2024-08-31T05:14:32.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:32.046+0000 7f65d7e7d640 1 --2- 172.21.15.67:0/3144670438 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f65bc06de00 0x7f65bc0702c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:32.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:32.046+0000 7f65d7e7d640 1 --2- 172.21.15.67:0/3144670438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65d01008c0 0x7f65d01999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:32.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:32.046+0000 7f65d7e7d640 1 --2- 172.21.15.67:0/3144670438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65d00fff80 0x7f65d0199490 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:32.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:32.046+0000 7f65d7e7d640 1 -- 172.21.15.67:0/3144670438 >> 172.21.15.67:0/3144670438 conn(0x7f65d00fbdb0 msgr2=0x7f65d0108860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:32.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:32.047+0000 7f65d7e7d640 1 -- 172.21.15.67:0/3144670438 shutdown_connections 2024-08-31T05:14:32.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:32.047+0000 7f65d7e7d640 1 -- 172.21.15.67:0/3144670438 wait complete. 2024-08-31T05:14:32.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:32 smithi073 ceph-mon[24726]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:32.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:32 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3144670438' entity='client.admin' 2024-08-31T05:14:32.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:32 smithi067 ceph-mon[17432]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:32.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:32 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3144670438' entity='client.admin' 2024-08-31T05:14:33.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.089+0000 7ff419950640 1 -- 172.21.15.67:0/3453838206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4141021f0 msgr2=0x7ff4141045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:33.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.089+0000 7ff419950640 1 --2- 172.21.15.67:0/3453838206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4141021f0 0x7ff4141045e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff404009880 tx=0x7ff40402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:14:33.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.089+0000 7ff419950640 1 -- 172.21.15.67:0/3453838206 shutdown_connections 2024-08-31T05:14:33.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.089+0000 7ff419950640 1 --2- 172.21.15.67:0/3453838206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff414104b20 0x7ff414106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:33.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.089+0000 7ff419950640 1 --2- 172.21.15.67:0/3453838206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4141021f0 0x7ff4141045e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:33.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.089+0000 7ff419950640 1 -- 172.21.15.67:0/3453838206 >> 172.21.15.67:0/3453838206 conn(0x7ff4140fbdb0 msgr2=0x7ff4140fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:33.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.089+0000 7ff419950640 1 -- 172.21.15.67:0/3453838206 shutdown_connections 2024-08-31T05:14:33.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.089+0000 7ff419950640 1 -- 172.21.15.67:0/3453838206 wait complete. 2024-08-31T05:14:33.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.090+0000 7ff419950640 1 Processor -- start 2024-08-31T05:14:33.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.090+0000 7ff419950640 1 -- start start 2024-08-31T05:14:33.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.090+0000 7ff419950640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4141021f0 0x7ff4141972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:33.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.090+0000 7ff419950640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff414104b20 0x7ff4141977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.090+0000 7ff419950640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff41410a560 con 0x7ff414104b20 2024-08-31T05:14:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.090+0000 7ff419950640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff41410a3e0 con 0x7ff4141021f0 2024-08-31T05:14:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.091+0000 7ff40a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff414104b20 0x7ff4141977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.091+0000 7ff40a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff414104b20 0x7ff4141977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33970/0 (socket says 172.21.15.67:33970) 2024-08-31T05:14:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.091+0000 7ff40a7fc640 1 -- 172.21.15.67:0/878971433 learned_addr learned my addr 172.21.15.67:0/878971433 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:14:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.091+0000 7ff412ffd640 1 --2- 172.21.15.67:0/878971433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4141021f0 0x7ff4141972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.091+0000 7ff40a7fc640 1 -- 172.21.15.67:0/878971433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4141021f0 msgr2=0x7ff4141972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.091+0000 7ff40a7fc640 1 --2- 172.21.15.67:0/878971433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4141021f0 0x7ff4141972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.091+0000 7ff40a7fc640 1 -- 172.21.15.67:0/878971433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff414197e70 con 0x7ff414104b20 2024-08-31T05:14:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.091+0000 7ff40a7fc640 1 --2- 172.21.15.67:0/878971433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff414104b20 0x7ff4141977f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00b3d0 tx=0x7ff3fc00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.092+0000 7ff41894e640 1 -- 172.21.15.67:0/878971433 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff3fc015020 con 0x7ff414104b20 2024-08-31T05:14:33.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.092+0000 7ff41894e640 1 -- 172.21.15.67:0/878971433 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff3fc011af0 con 0x7ff414104b20 2024-08-31T05:14:33.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.092+0000 7ff419950640 1 -- 172.21.15.67:0/878971433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41419c8b0 con 0x7ff414104b20 2024-08-31T05:14:33.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.092+0000 7ff41894e640 1 -- 172.21.15.67:0/878971433 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff3fc015020 con 0x7ff414104b20 2024-08-31T05:14:33.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.092+0000 7ff419950640 1 -- 172.21.15.67:0/878971433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41419cec0 con 0x7ff414104b20 2024-08-31T05:14:33.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.093+0000 7ff419950640 1 -- 172.21.15.67:0/878971433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4141025d0 con 0x7ff414104b20 2024-08-31T05:14:33.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.093+0000 7ff41894e640 1 -- 172.21.15.67:0/878971433 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7ff3fc018020 con 0x7ff414104b20 2024-08-31T05:14:33.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.094+0000 7ff41894e640 1 --2- 172.21.15.67:0/878971433 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff40006dfc0 0x7ff400070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:33.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.094+0000 7ff41894e640 1 -- 172.21.15.67:0/878971433 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff3fc08c180 con 0x7ff414104b20 2024-08-31T05:14:33.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.094+0000 7ff412ffd640 1 --2- 172.21.15.67:0/878971433 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff40006dfc0 0x7ff400070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:33.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.094+0000 7ff412ffd640 1 --2- 172.21.15.67:0/878971433 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff40006dfc0 0x7ff400070480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff404000c00 tx=0x7ff4040058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:33.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.098+0000 7ff41894e640 1 -- 172.21.15.67:0/878971433 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3fc01f020 con 0x7ff414104b20 2024-08-31T05:14:33.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.274+0000 7ff419950640 1 -- 172.21.15.67:0/878971433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7ff41419d400 con 0x7ff414104b20 2024-08-31T05:14:33.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.277+0000 7ff41894e640 1 -- 172.21.15.67:0/878971433 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v28)=0 v28) ==== 120+0+0 (secure 0 0 0) 0x7ff3fc05ae00 con 0x7ff414104b20 2024-08-31T05:14:33.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.279+0000 7ff419950640 1 -- 172.21.15.67:0/878971433 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff40006dfc0 msgr2=0x7ff400070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:33.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.279+0000 7ff419950640 1 --2- 172.21.15.67:0/878971433 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff40006dfc0 0x7ff400070480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff404000c00 tx=0x7ff4040058d0 comp rx=0 tx=0).stop 2024-08-31T05:14:33.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.279+0000 7ff419950640 1 -- 172.21.15.67:0/878971433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff414104b20 msgr2=0x7ff4141977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:33.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.279+0000 7ff419950640 1 --2- 172.21.15.67:0/878971433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff414104b20 0x7ff4141977f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00b3d0 tx=0x7ff3fc00b890 comp rx=0 tx=0).stop 2024-08-31T05:14:33.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.279+0000 7ff419950640 1 -- 172.21.15.67:0/878971433 shutdown_connections 2024-08-31T05:14:33.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.279+0000 7ff419950640 1 --2- 172.21.15.67:0/878971433 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff40006dfc0 0x7ff400070480 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:33.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.279+0000 7ff419950640 1 --2- 172.21.15.67:0/878971433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff414104b20 0x7ff4141977f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:33.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.279+0000 7ff419950640 1 --2- 172.21.15.67:0/878971433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4141021f0 0x7ff4141972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:33.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.279+0000 7ff419950640 1 -- 172.21.15.67:0/878971433 >> 172.21.15.67:0/878971433 conn(0x7ff4140fbdb0 msgr2=0x7ff4140fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:33.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.279+0000 7ff419950640 1 -- 172.21.15.67:0/878971433 shutdown_connections 2024-08-31T05:14:33.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:33.280+0000 7ff419950640 1 -- 172.21.15.67:0/878971433 wait complete. 2024-08-31T05:14:33.610 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi067') 2024-08-31T05:14:33.610 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi067') 2024-08-31T05:14:33.610 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi067') 2024-08-31T05:14:34.490 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:34 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/878971433' entity='client.admin' 2024-08-31T05:14:34.490 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:34 smithi067 ceph-mon[17432]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:34.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:34 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/878971433' entity='client.admin' 2024-08-31T05:14:34.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:34 smithi073 ceph-mon[24726]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:35.098 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi067') 2024-08-31T05:14:35.098 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi067') 2024-08-31T05:14:35.098 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi067') 2024-08-31T05:14:35.099 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi067') 2024-08-31T05:14:35.099 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi067') 2024-08-31T05:14:35.099 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi067') 2024-08-31T05:14:35.099 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi067') 2024-08-31T05:14:35.099 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi067') 2024-08-31T05:14:35.099 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi067') 2024-08-31T05:14:35.099 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi067') 2024-08-31T05:14:35.099 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi067') 2024-08-31T05:14:35.099 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5fd95148-6757-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi067') 2024-08-31T05:14:35.100 INFO:tasks.cephadm:Deploying OSDs... 2024-08-31T05:14:35.100 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:14:35.100 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T05:14:35.117 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T05:14:35.118 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2024-08-31T05:14:35.173 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T05:14:35.174 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:14:35.174 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-08-31T05:14:35.174 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:14:35.174 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:14:35.174 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-08-31 05:13:34.689251786 +0000 2024-08-31T05:14:35.174 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-08-31 05:08:04.623621411 +0000 2024-08-31T05:14:35.174 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-08-31 05:08:04.623621411 +0000 2024-08-31T05:14:35.174 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-08-31 05:08:04.623621411 +0000 2024-08-31T05:14:35.174 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T05:14:35.241 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-08-31T05:14:35.241 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-08-31T05:14:35.241 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000197761 s, 2.6 MB/s 2024-08-31T05:14:35.242 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T05:14:35.300 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2024-08-31T05:14:35.356 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T05:14:35.356 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:14:35.356 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-31T05:14:35.356 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:14:35.357 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:14:35.357 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-08-31 05:13:34.689251786 +0000 2024-08-31T05:14:35.357 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-08-31 05:08:04.946614701 +0000 2024-08-31T05:14:35.357 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-08-31 05:08:04.946614701 +0000 2024-08-31T05:14:35.357 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-08-31 05:08:04.946614701 +0000 2024-08-31T05:14:35.357 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T05:14:35.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-08-31T05:14:35.420 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-08-31T05:14:35.420 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000178894 s, 2.9 MB/s 2024-08-31T05:14:35.421 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T05:14:35.477 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2024-08-31T05:14:35.533 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T05:14:35.533 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:14:35.533 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-08-31T05:14:35.533 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:14:35.533 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:14:35.533 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-08-31 05:13:34.690251765 +0000 2024-08-31T05:14:35.533 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-08-31 05:08:05.268608012 +0000 2024-08-31T05:14:35.534 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-08-31 05:08:05.268608012 +0000 2024-08-31T05:14:35.534 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-08-31 05:08:05.268608012 +0000 2024-08-31T05:14:35.534 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T05:14:35.597 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-08-31T05:14:35.597 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-08-31T05:14:35.597 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000181228 s, 2.8 MB/s 2024-08-31T05:14:35.598 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T05:14:35.655 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2024-08-31T05:14:35.712 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T05:14:35.712 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:14:35.712 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-08-31T05:14:35.712 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:14:35.795 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:14:35.795 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-08-31 05:13:34.690251765 +0000 2024-08-31T05:14:35.795 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-08-31 05:08:05.598601157 +0000 2024-08-31T05:14:35.796 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-08-31 05:08:05.598601157 +0000 2024-08-31T05:14:35.796 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-08-31 05:08:05.598601157 +0000 2024-08-31T05:14:35.796 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T05:14:35.820 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-08-31T05:14:35.820 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-08-31T05:14:35.820 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000184755 s, 2.8 MB/s 2024-08-31T05:14:35.821 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T05:14:35.877 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-08-31T05:14:35.877 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T05:14:35.898 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T05:14:35.898 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-08-31T05:14:35.957 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T05:14:35.958 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:14:35.958 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-08-31T05:14:35.958 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:14:35.958 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:14:35.958 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-08-31 05:14:05.436199030 +0000 2024-08-31T05:14:35.958 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-08-31 05:08:04.626826658 +0000 2024-08-31T05:14:35.958 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-08-31 05:08:04.626826658 +0000 2024-08-31T05:14:35.958 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-08-31 05:08:04.626826658 +0000 2024-08-31T05:14:35.958 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T05:14:36.024 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-08-31T05:14:36.024 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-08-31T05:14:36.024 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000217872 s, 2.4 MB/s 2024-08-31T05:14:36.025 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T05:14:36.082 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-08-31T05:14:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T05:14:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:14:36.138 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-31T05:14:36.138 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:14:36.138 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:14:36.138 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-08-31 05:14:05.437199006 +0000 2024-08-31T05:14:36.138 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-08-31 05:08:04.958816879 +0000 2024-08-31T05:14:36.138 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-08-31 05:08:04.958816879 +0000 2024-08-31T05:14:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-08-31 05:08:04.958816879 +0000 2024-08-31T05:14:36.139 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T05:14:36.202 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-08-31T05:14:36.203 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-08-31T05:14:36.203 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000204136 s, 2.5 MB/s 2024-08-31T05:14:36.204 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T05:14:36.262 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-08-31T05:14:36.318 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T05:14:36.318 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:14:36.318 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-08-31T05:14:36.318 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:14:36.318 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:14:36.318 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-08-31 05:14:05.437199006 +0000 2024-08-31T05:14:36.318 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-08-31 05:08:05.290807100 +0000 2024-08-31T05:14:36.318 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-08-31 05:08:05.290807100 +0000 2024-08-31T05:14:36.318 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-08-31 05:08:05.290807100 +0000 2024-08-31T05:14:36.319 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T05:14:36.382 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-08-31T05:14:36.382 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-08-31T05:14:36.382 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000170453 s, 3.0 MB/s 2024-08-31T05:14:36.383 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T05:14:36.439 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-08-31T05:14:36.494 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T05:14:36.495 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:14:36.495 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-08-31T05:14:36.495 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:14:36.495 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:14:36.495 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-08-31 05:14:05.437199006 +0000 2024-08-31T05:14:36.495 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-08-31 05:08:05.624797262 +0000 2024-08-31T05:14:36.495 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-08-31 05:08:05.624797262 +0000 2024-08-31T05:14:36.495 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-08-31 05:08:05.624797262 +0000 2024-08-31T05:14:36.495 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T05:14:36.518 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:36 smithi067 ceph-mon[17432]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:36.518 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:36 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:36.518 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:36 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:36.518 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:36 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi067", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:14:36.518 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:36 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:36.555 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:36 smithi073 ceph-mon[24726]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:36.555 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:36 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:36.555 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:36 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:36.555 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:36 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi067", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:14:36.555 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:36 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:36.557 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-08-31T05:14:36.557 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-08-31T05:14:36.558 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000229091 s, 2.2 MB/s 2024-08-31T05:14:36.559 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T05:14:36.615 INFO:tasks.cephadm:Deploying osd.0 on smithi067 with /dev/vg_nvme/lv_4... 2024-08-31T05:14:36.616 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T05:14:36.906 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:37.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:37 smithi067 ceph-mon[17432]: Reconfiguring ceph-exporter.smithi067 (monmap changed)... 2024-08-31T05:14:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:37 smithi067 ceph-mon[17432]: Reconfiguring daemon ceph-exporter.smithi067 on smithi067 2024-08-31T05:14:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:37 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:37 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:37 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-31T05:14:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:37 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:37.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:37 smithi073 ceph-mon[24726]: Reconfiguring ceph-exporter.smithi067 (monmap changed)... 2024-08-31T05:14:37.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:37 smithi073 ceph-mon[24726]: Reconfiguring daemon ceph-exporter.smithi067 on smithi067 2024-08-31T05:14:37.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:37 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:37.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:37 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:37.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:37 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-31T05:14:37.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:37 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:38.613 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:38 smithi067 ceph-mon[17432]: Reconfiguring crash.smithi067 (monmap changed)... 2024-08-31T05:14:38.616 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:38 smithi067 ceph-mon[17432]: Reconfiguring daemon crash.smithi067 on smithi067 2024-08-31T05:14:38.616 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:38 smithi067 ceph-mon[17432]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:38.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:38 smithi073 ceph-mon[24726]: Reconfiguring crash.smithi067 (monmap changed)... 2024-08-31T05:14:38.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:38 smithi073 ceph-mon[24726]: Reconfiguring daemon crash.smithi067 on smithi067 2024-08-31T05:14:38.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:38 smithi073 ceph-mon[24726]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:40.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:40 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:40.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:40 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:40.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:40 smithi067 ceph-mon[17432]: Reconfiguring alertmanager.smithi067 (dependencies changed)... 2024-08-31T05:14:40.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:40 smithi067 ceph-mon[17432]: Reconfiguring daemon alertmanager.smithi067 on smithi067 2024-08-31T05:14:40.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:40 smithi067 ceph-mon[17432]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:40.333 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:14:40.358 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi067:vg_nvme/lv_4 2024-08-31T05:14:40.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:40 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:40.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:40 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:40.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:40 smithi073 ceph-mon[24726]: Reconfiguring alertmanager.smithi067 (dependencies changed)... 2024-08-31T05:14:40.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:40 smithi073 ceph-mon[24726]: Reconfiguring daemon alertmanager.smithi067 on smithi067 2024-08-31T05:14:40.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:40 smithi073 ceph-mon[24726]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:41.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:41 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:14:41.721 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:14:42.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:42 smithi067 ceph-mon[17432]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:42.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:42 smithi073 ceph-mon[24726]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:43.122 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:14:43.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.639+0000 7f5e08ebc640 1 -- 172.21.15.67:0/2274400961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e04101800 msgr2=0x7f5e04101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:43.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.639+0000 7f5e08ebc640 1 --2- 172.21.15.67:0/2274400961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e04101800 0x7f5e04101c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5dec009880 tx=0x7f5dec02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:14:43.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.639+0000 7f5e08ebc640 1 -- 172.21.15.67:0/2274400961 shutdown_connections 2024-08-31T05:14:43.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.639+0000 7f5e08ebc640 1 --2- 172.21.15.67:0/2274400961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e04101800 0x7f5e04101c80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:43.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.639+0000 7f5e08ebc640 1 --2- 172.21.15.67:0/2274400961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e04100600 0x7f5e04100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:43.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.639+0000 7f5e08ebc640 1 -- 172.21.15.67:0/2274400961 >> 172.21.15.67:0/2274400961 conn(0x7f5e040fbdb0 msgr2=0x7f5e040fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:14:43.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.639+0000 7f5e08ebc640 1 -- 172.21.15.67:0/2274400961 shutdown_connections 2024-08-31T05:14:43.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.639+0000 7f5e08ebc640 1 -- 172.21.15.67:0/2274400961 wait complete. 2024-08-31T05:14:43.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.640+0000 7f5e08ebc640 1 Processor -- start 2024-08-31T05:14:43.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.640+0000 7f5e08ebc640 1 -- start start 2024-08-31T05:14:43.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.640+0000 7f5e08ebc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e04100600 0x7f5e04104520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:43.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.640+0000 7f5e08ebc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e04101800 0x7f5e04102be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:43.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.640+0000 7f5e08ebc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5e04109440 con 0x7f5e04101800 2024-08-31T05:14:43.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.640+0000 7f5e08ebc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041092c0 con 0x7f5e04100600 2024-08-31T05:14:43.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.641+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e04101800 0x7f5e04102be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:43.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.641+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e04101800 0x7f5e04102be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37104/0 (socket says 172.21.15.67:37104) 2024-08-31T05:14:43.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.641+0000 7f5dfbfff640 1 -- 172.21.15.67:0/3490605098 learned_addr learned my addr 172.21.15.67:0/3490605098 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:14:43.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.641+0000 7f5e0259c640 1 --2- 172.21.15.67:0/3490605098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e04100600 0x7f5e04104520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:43.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.641+0000 7f5dfbfff640 1 -- 172.21.15.67:0/3490605098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e04100600 msgr2=0x7f5e04104520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:14:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.641+0000 7f5dfbfff640 1 --2- 172.21.15.67:0/3490605098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e04100600 0x7f5e04104520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:14:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.641+0000 7f5dfbfff640 1 -- 172.21.15.67:0/3490605098 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e04103120 con 0x7f5e04101800 2024-08-31T05:14:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.641+0000 7f5dfbfff640 1 --2- 172.21.15.67:0/3490605098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e04101800 0x7f5e04102be0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5dec009230 tx=0x7f5dec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.641+0000 7f5dfb7fe640 1 -- 172.21.15.67:0/3490605098 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5dec03f070 con 0x7f5e04101800 2024-08-31T05:14:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.641+0000 7f5dfb7fe640 1 -- 172.21.15.67:0/3490605098 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5dec0044d0 con 0x7f5e04101800 2024-08-31T05:14:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.641+0000 7f5e08ebc640 1 -- 172.21.15.67:0/3490605098 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e041033b0 con 0x7f5e04101800 2024-08-31T05:14:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.641+0000 7f5dfb7fe640 1 -- 172.21.15.67:0/3490605098 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5dec035030 con 0x7f5e04101800 2024-08-31T05:14:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.641+0000 7f5e08ebc640 1 -- 172.21.15.67:0/3490605098 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e041038e0 con 0x7f5e04101800 2024-08-31T05:14:43.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.642+0000 7f5e08ebc640 1 -- 172.21.15.67:0/3490605098 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e04100a00 con 0x7f5e04101800 2024-08-31T05:14:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.643+0000 7f5dfb7fe640 1 -- 172.21.15.67:0/3490605098 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f5dec042070 con 0x7f5e04101800 2024-08-31T05:14:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.643+0000 7f5dfb7fe640 1 --2- 172.21.15.67:0/3490605098 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f5df006de00 0x7f5df00702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:14:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.643+0000 7f5dfb7fe640 1 -- 172.21.15.67:0/3490605098 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5dec0ad730 con 0x7f5e04101800 2024-08-31T05:14:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.643+0000 7f5e0259c640 1 --2- 172.21.15.67:0/3490605098 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f5df006de00 0x7f5df00702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:14:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.644+0000 7f5e0259c640 1 --2- 172.21.15.67:0/3490605098 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f5df006de00 0x7f5df00702c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5df40058c0 tx=0x7f5df400a4c0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:14:43.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.648+0000 7f5dfb7fe640 1 -- 172.21.15.67:0/3490605098 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5dec07c430 con 0x7f5e04101800 2024-08-31T05:14:43.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:14:43.838+0000 7f5e08ebc640 1 -- 172.21.15.67:0/3490605098 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5e0419f300 con 0x7f5df006de00 2024-08-31T05:14:44.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:44 smithi067 ceph-mon[17432]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:44.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:44 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T05:14:44.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:44 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T05:14:44.454 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:44 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:44.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:44 smithi073 ceph-mon[24726]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:44.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:44 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T05:14:44.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:44 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T05:14:44.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:44 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:45.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:45 smithi067 ceph-mon[17432]: from='client.14326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:45.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:45 smithi067 ceph-mon[17432]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:45.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:45 smithi073 ceph-mon[24726]: from='client.14326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:45.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:45 smithi073 ceph-mon[24726]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:47 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:47 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:47 smithi067 ceph-mon[17432]: Reconfiguring grafana.smithi067 (dependencies changed)... 2024-08-31T05:14:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:47 smithi067 ceph-mon[17432]: Reconfiguring daemon grafana.smithi067 on smithi067 2024-08-31T05:14:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:47 smithi067 ceph-mon[17432]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:47.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:47 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:47.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:47 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:47.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:47 smithi073 ceph-mon[24726]: Reconfiguring grafana.smithi067 (dependencies changed)... 2024-08-31T05:14:47.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:47 smithi073 ceph-mon[24726]: Reconfiguring daemon grafana.smithi067 on smithi067 2024-08-31T05:14:47.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:47 smithi073 ceph-mon[24726]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:48.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:48 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/4095290610' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51d7e102-32dc-423d-815b-6a09ca75345d"}]: dispatch 2024-08-31T05:14:48.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:48 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/4095290610' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "51d7e102-32dc-423d-815b-6a09ca75345d"}]': finished 2024-08-31T05:14:48.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:48 smithi067 ceph-mon[17432]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T05:14:48.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:48 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:14:48.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:48 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/4134288633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T05:14:48.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:48 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/4095290610' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51d7e102-32dc-423d-815b-6a09ca75345d"}]: dispatch 2024-08-31T05:14:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:48 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/4095290610' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "51d7e102-32dc-423d-815b-6a09ca75345d"}]': finished 2024-08-31T05:14:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:48 smithi073 ceph-mon[24726]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T05:14:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:48 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:14:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:48 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/4134288633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T05:14:49.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:49 smithi067 ceph-mon[17432]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:49.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:49 smithi073 ceph-mon[24726]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:52.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:52 smithi073 ceph-mon[24726]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:52.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:52 smithi067 ceph-mon[17432]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:54.593 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:54 smithi067 ceph-mon[17432]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:54.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:54 smithi073 ceph-mon[24726]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:56.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:56 smithi067 ceph-mon[17432]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:56.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:56 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:14:56.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:56 smithi073 ceph-mon[24726]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:56.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:56 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:14:58.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:58 smithi067 ceph-mon[17432]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:58.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:58 smithi073 ceph-mon[24726]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:59.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:59 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:59.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:59 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:59.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:59 smithi067 ceph-mon[17432]: Reconfiguring prometheus.smithi067 (dependencies changed)... 2024-08-31T05:14:59.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:59 smithi067 ceph-mon[17432]: Reconfiguring daemon prometheus.smithi067 on smithi067 2024-08-31T05:14:59.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:14:59 smithi067 ceph-mon[17432]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:14:59.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:59 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:59.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:59 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:14:59.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:59 smithi073 ceph-mon[24726]: Reconfiguring prometheus.smithi067 (dependencies changed)... 2024-08-31T05:14:59.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:59 smithi073 ceph-mon[24726]: Reconfiguring daemon prometheus.smithi067 on smithi067 2024-08-31T05:14:59.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:14:59 smithi073 ceph-mon[24726]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:00 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-31T05:15:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:00 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:00 smithi067 ceph-mon[17432]: Deploying daemon osd.0 on smithi067 2024-08-31T05:15:00.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:00 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-31T05:15:00.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:00 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:00.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:00 smithi073 ceph-mon[24726]: Deploying daemon osd.0 on smithi067 2024-08-31T05:15:01.995 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:01 smithi067 ceph-mon[17432]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:02.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:01 smithi073 ceph-mon[24726]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:04.425 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:04 smithi067 ceph-mon[17432]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:04.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:04 smithi073 ceph-mon[24726]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:05 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:05 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:05 smithi067 ceph-mon[17432]: Reconfiguring ceph-exporter.smithi073 (monmap changed)... 2024-08-31T05:15:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:05 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:15:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:05 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:05 smithi067 ceph-mon[17432]: Reconfiguring daemon ceph-exporter.smithi073 on smithi073 2024-08-31T05:15:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:05 smithi067 ceph-mon[17432]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:05.919 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:05 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:05.919 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:05 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:05.919 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:05 smithi073 ceph-mon[24726]: Reconfiguring ceph-exporter.smithi073 (monmap changed)... 2024-08-31T05:15:05.919 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:05 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:15:05.920 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:05 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:05.920 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:05 smithi073 ceph-mon[24726]: Reconfiguring daemon ceph-exporter.smithi073 on smithi073 2024-08-31T05:15:05.920 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:05 smithi073 ceph-mon[24726]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:06.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:06 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:06.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:06 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:06.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:06 smithi067 ceph-mon[17432]: Reconfiguring crash.smithi073 (monmap changed)... 2024-08-31T05:15:06.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:06 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-31T05:15:06.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:06 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:06.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:06 smithi067 ceph-mon[17432]: Reconfiguring daemon crash.smithi073 on smithi073 2024-08-31T05:15:07.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:07.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:07.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:06 smithi073 ceph-mon[24726]: Reconfiguring crash.smithi073 (monmap changed)... 2024-08-31T05:15:07.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-31T05:15:07.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:07.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:06 smithi073 ceph-mon[24726]: Reconfiguring daemon crash.smithi073 on smithi073 2024-08-31T05:15:07.942 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:07 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:07.942 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:07 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:07.942 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:07 smithi073 ceph-mon[24726]: Reconfiguring mgr.smithi073.zfoyxd (monmap changed)... 2024-08-31T05:15:07.942 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:07 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.zfoyxd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T05:15:07.942 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:07 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T05:15:07.942 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:07 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:07.943 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:07 smithi073 ceph-mon[24726]: Reconfiguring daemon mgr.smithi073.zfoyxd on smithi073 2024-08-31T05:15:07.943 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:07 smithi073 ceph-mon[24726]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:08.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:07 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:08.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:07 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:08.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:07 smithi067 ceph-mon[17432]: Reconfiguring mgr.smithi073.zfoyxd (monmap changed)... 2024-08-31T05:15:08.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:07 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.zfoyxd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T05:15:08.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:07 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T05:15:08.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:07 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:08.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:07 smithi067 ceph-mon[17432]: Reconfiguring daemon mgr.smithi073.zfoyxd on smithi073 2024-08-31T05:15:08.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:07 smithi067 ceph-mon[17432]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:09.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:09 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:09.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:09 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:09.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:09 smithi067 ceph-mon[17432]: Reconfiguring mon.smithi073 (monmap changed)... 2024-08-31T05:15:09.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:09 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T05:15:09.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:09 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T05:15:09.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:09 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:09.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:09 smithi067 ceph-mon[17432]: Reconfiguring daemon mon.smithi073 on smithi073 2024-08-31T05:15:09.607 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:09 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:09.608 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:09 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:09.608 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:09 smithi073 ceph-mon[24726]: Reconfiguring mon.smithi073 (monmap changed)... 2024-08-31T05:15:09.608 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:09 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T05:15:09.608 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:09 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T05:15:09.608 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:09 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:09.608 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:09 smithi073 ceph-mon[24726]: Reconfiguring daemon mon.smithi073 on smithi073 2024-08-31T05:15:10.482 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:10.483 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:10.483 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:10.483 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:10.483 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:10.483 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-31T05:15:10.483 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi067:9093"}]: dispatch 2024-08-31T05:15:10.483 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:10.483 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-31T05:15:10.483 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi067:3000"}]: dispatch 2024-08-31T05:15:10.483 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:10.483 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:15:10.483 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi067:9095"}]: dispatch 2024-08-31T05:15:10.484 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:10.484 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:15:10.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-31T05:15:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi067:9093"}]: dispatch 2024-08-31T05:15:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-31T05:15:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi067:3000"}]: dispatch 2024-08-31T05:15:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:15:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi067:9095"}]: dispatch 2024-08-31T05:15:10.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:10.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:15:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:11 smithi067 ceph-mon[17432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-31T05:15:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:11 smithi067 ceph-mon[17432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi067:9093"}]: dispatch 2024-08-31T05:15:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:11 smithi067 ceph-mon[17432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-31T05:15:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:11 smithi067 ceph-mon[17432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi067:3000"}]: dispatch 2024-08-31T05:15:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:11 smithi067 ceph-mon[17432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:15:11.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:11 smithi067 ceph-mon[17432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi067:9095"}]: dispatch 2024-08-31T05:15:11.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:11 smithi073 ceph-mon[24726]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-31T05:15:11.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:11 smithi073 ceph-mon[24726]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi067:9093"}]: dispatch 2024-08-31T05:15:11.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:11 smithi073 ceph-mon[24726]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-31T05:15:11.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:11 smithi073 ceph-mon[24726]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi067:3000"}]: dispatch 2024-08-31T05:15:11.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:11 smithi073 ceph-mon[24726]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:15:11.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:11 smithi073 ceph-mon[24726]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi067:9095"}]: dispatch 2024-08-31T05:15:12.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:12 smithi067 ceph-mon[17432]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:12.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:12 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:15:12.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:12 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:12.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:12 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:12.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:12 smithi073 ceph-mon[24726]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:12.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:12 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:15:12.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:12 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:12.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:12 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:13.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:13.847+0000 7f5dfb7fe640 1 -- 172.21.15.67:0/3490605098 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5e0419f300 con 0x7f5df006de00 2024-08-31T05:15:13.849 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 0 on host 'smithi067' 2024-08-31T05:15:13.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:13.849+0000 7f5e08ebc640 1 -- 172.21.15.67:0/3490605098 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f5df006de00 msgr2=0x7f5df00702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:15:13.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:13.849+0000 7f5e08ebc640 1 --2- 172.21.15.67:0/3490605098 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f5df006de00 0x7f5df00702c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5df40058c0 tx=0x7f5df400a4c0 comp rx=0 tx=0).stop 2024-08-31T05:15:13.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:13.849+0000 7f5e08ebc640 1 -- 172.21.15.67:0/3490605098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e04101800 msgr2=0x7f5e04102be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:15:13.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:13.849+0000 7f5e08ebc640 1 --2- 172.21.15.67:0/3490605098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e04101800 0x7f5e04102be0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5dec009230 tx=0x7f5dec0048f0 comp rx=0 tx=0).stop 2024-08-31T05:15:13.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:13.849+0000 7f5e08ebc640 1 -- 172.21.15.67:0/3490605098 shutdown_connections 2024-08-31T05:15:13.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:13.849+0000 7f5e08ebc640 1 --2- 172.21.15.67:0/3490605098 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f5df006de00 0x7f5df00702c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:15:13.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:13.849+0000 7f5e08ebc640 1 --2- 172.21.15.67:0/3490605098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e04101800 0x7f5e04102be0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:15:13.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:13.849+0000 7f5e08ebc640 1 --2- 172.21.15.67:0/3490605098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e04100600 0x7f5e04104520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:15:13.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:13.849+0000 7f5e08ebc640 1 -- 172.21.15.67:0/3490605098 >> 172.21.15.67:0/3490605098 conn(0x7f5e040fbdb0 msgr2=0x7f5e0406a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:15:13.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:13.849+0000 7f5e08ebc640 1 -- 172.21.15.67:0/3490605098 shutdown_connections 2024-08-31T05:15:13.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:13.849+0000 7f5e08ebc640 1 -- 172.21.15.67:0/3490605098 wait complete. 2024-08-31T05:15:14.516 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:14 smithi067 ceph-mon[17432]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:14.517 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:14 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:14.517 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:14 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:14.547 DEBUG:teuthology.orchestra.run.smithi067:osd.0> sudo journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.0.service 2024-08-31T05:15:14.549 INFO:tasks.cephadm:Deploying osd.1 on smithi067 with /dev/vg_nvme/lv_3... 2024-08-31T05:15:14.549 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T05:15:14.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:14 smithi073 ceph-mon[24726]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:14.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:14 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:14.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:14 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:14.935 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:15:15.732 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:15:15 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0[37339]: 2024-08-31T05:15:15.635+0000 7fc994a6a640 -1 osd.0 0 log_to_monitors true 2024-08-31T05:15:16.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:16 smithi067 ceph-mon[17432]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:16.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:16 smithi067 ceph-mon[17432]: from='osd.0 [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-31T05:15:16.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:16 smithi073 ceph-mon[24726]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:16.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:16 smithi073 ceph-mon[24726]: from='osd.0 [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-31T05:15:17.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:17 smithi067 ceph-mon[17432]: from='osd.0 [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T05:15:17.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:17 smithi067 ceph-mon[17432]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T05:15:17.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:17 smithi067 ceph-mon[17432]: from='osd.0 [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-08-31T05:15:17.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:17 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:15:17.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:17 smithi067 ceph-mon[17432]: from='osd.0 [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-08-31T05:15:17.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:17 smithi067 ceph-mon[17432]: osdmap e8: 1 total, 0 up, 1 in 2024-08-31T05:15:17.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:17 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:15:17.576 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:15:17 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0[37339]: 2024-08-31T05:15:17.323+0000 7fc9901ca640 -1 osd.0 0 waiting for initial osdmap 2024-08-31T05:15:17.576 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:15:17 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0[37339]: 2024-08-31T05:15:17.327+0000 7fc98c804640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:15:17.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:17 smithi073 ceph-mon[24726]: from='osd.0 [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T05:15:17.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:17 smithi073 ceph-mon[24726]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T05:15:17.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:17 smithi073 ceph-mon[24726]: from='osd.0 [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-08-31T05:15:17.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:17 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:15:17.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:17 smithi073 ceph-mon[24726]: from='osd.0 [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-08-31T05:15:17.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:17 smithi073 ceph-mon[24726]: osdmap e8: 1 total, 0 up, 1 in 2024-08-31T05:15:17.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:17 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:15:18.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:18 smithi067 ceph-mon[17432]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:18.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:18 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:15:18.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:18 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:18.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:18 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:18.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:18 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:15:18.609 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:15:18.635 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi067:vg_nvme/lv_3 2024-08-31T05:15:18.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:18 smithi073 ceph-mon[24726]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:18.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:18 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:15:18.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:18 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:18.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:18 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:18.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:18 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:15:18.920 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:15:19.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.392+0000 7fe95f023640 1 -- 172.21.15.67:0/3365666235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe958101800 msgr2=0x7fe958101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:15:19.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.392+0000 7fe95f023640 1 --2- 172.21.15.67:0/3365666235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe958101800 0x7fe958101c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe944009880 tx=0x7fe94402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:15:19.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.392+0000 7fe95f023640 1 -- 172.21.15.67:0/3365666235 shutdown_connections 2024-08-31T05:15:19.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.392+0000 7fe95f023640 1 --2- 172.21.15.67:0/3365666235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe958101800 0x7fe958101c80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:15:19.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.392+0000 7fe95f023640 1 --2- 172.21.15.67:0/3365666235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe958100600 0x7fe958100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:15:19.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.392+0000 7fe95f023640 1 -- 172.21.15.67:0/3365666235 >> 172.21.15.67:0/3365666235 conn(0x7fe9580fbdb0 msgr2=0x7fe9580fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:15:19.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.392+0000 7fe95f023640 1 -- 172.21.15.67:0/3365666235 shutdown_connections 2024-08-31T05:15:19.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.392+0000 7fe95f023640 1 -- 172.21.15.67:0/3365666235 wait complete. 2024-08-31T05:15:19.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.393+0000 7fe95f023640 1 Processor -- start 2024-08-31T05:15:19.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.393+0000 7fe95f023640 1 -- start start 2024-08-31T05:15:19.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.393+0000 7fe95f023640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe958100600 0x7fe95806aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:15:19.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.393+0000 7fe95f023640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe958101800 0x7fe95819bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:15:19.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.393+0000 7fe95f023640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe958109420 con 0x7fe958101800 2024-08-31T05:15:19.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.393+0000 7fe95f023640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe9581092a0 con 0x7fe958100600 2024-08-31T05:15:19.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.393+0000 7fe957fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe958101800 0x7fe95819bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:15:19.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.393+0000 7fe957fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe958101800 0x7fe95819bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35494/0 (socket says 172.21.15.67:35494) 2024-08-31T05:15:19.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.393+0000 7fe957fff640 1 -- 172.21.15.67:0/2321125231 learned_addr learned my addr 172.21.15.67:0/2321125231 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:15:19.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.393+0000 7fe95cdbf640 1 --2- 172.21.15.67:0/2321125231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe958100600 0x7fe95806aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:15:19.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.393+0000 7fe957fff640 1 -- 172.21.15.67:0/2321125231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe958100600 msgr2=0x7fe95806aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:15:19.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.393+0000 7fe957fff640 1 --2- 172.21.15.67:0/2321125231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe958100600 0x7fe95806aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:15:19.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.393+0000 7fe957fff640 1 -- 172.21.15.67:0/2321125231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95819c4d0 con 0x7fe958101800 2024-08-31T05:15:19.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.393+0000 7fe95cdbf640 1 --2- 172.21.15.67:0/2321125231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe958100600 0x7fe95806aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:15:19.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.394+0000 7fe957fff640 1 --2- 172.21.15.67:0/2321125231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe958101800 0x7fe95819bf60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe944006010 tx=0x7fe9440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:15:19.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.394+0000 7fe955ffb640 1 -- 172.21.15.67:0/2321125231 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe94403f070 con 0x7fe958101800 2024-08-31T05:15:19.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.394+0000 7fe955ffb640 1 -- 172.21.15.67:0/2321125231 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe9440044d0 con 0x7fe958101800 2024-08-31T05:15:19.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.394+0000 7fe95f023640 1 -- 172.21.15.67:0/2321125231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95819c760 con 0x7fe958101800 2024-08-31T05:15:19.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.394+0000 7fe955ffb640 1 -- 172.21.15.67:0/2321125231 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe944035030 con 0x7fe958101800 2024-08-31T05:15:19.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.394+0000 7fe95f023640 1 -- 172.21.15.67:0/2321125231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95819cc90 con 0x7fe958101800 2024-08-31T05:15:19.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.395+0000 7fe95f023640 1 -- 172.21.15.67:0/2321125231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe958100a00 con 0x7fe958101800 2024-08-31T05:15:19.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.396+0000 7fe955ffb640 1 -- 172.21.15.67:0/2321125231 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7fe944042070 con 0x7fe958101800 2024-08-31T05:15:19.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.396+0000 7fe955ffb640 1 --2- 172.21.15.67:0/2321125231 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe94806de00 0x7fe9480702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:15:19.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.396+0000 7fe95cdbf640 1 --2- 172.21.15.67:0/2321125231 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe94806de00 0x7fe9480702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:15:19.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.396+0000 7fe955ffb640 1 -- 172.21.15.67:0/2321125231 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7fe9440ad960 con 0x7fe958101800 2024-08-31T05:15:19.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.397+0000 7fe95cdbf640 1 --2- 172.21.15.67:0/2321125231 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe94806de00 0x7fe9480702c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe958101660 tx=0x7fe94c005db0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:15:19.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.401+0000 7fe955ffb640 1 -- 172.21.15.67:0/2321125231 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe94407c400 con 0x7fe958101800 2024-08-31T05:15:19.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:19 smithi067 ceph-mon[17432]: purged_snaps scrub starts 2024-08-31T05:15:19.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:19 smithi067 ceph-mon[17432]: purged_snaps scrub ok 2024-08-31T05:15:19.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:19 smithi067 ceph-mon[17432]: osd.0 [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825] boot 2024-08-31T05:15:19.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:19 smithi067 ceph-mon[17432]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T05:15:19.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:19 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:15:19.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:19.603+0000 7fe95f023640 1 -- 172.21.15.67:0/2321125231 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe9580623d0 con 0x7fe94806de00 2024-08-31T05:15:19.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:19 smithi073 ceph-mon[24726]: purged_snaps scrub starts 2024-08-31T05:15:19.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:19 smithi073 ceph-mon[24726]: purged_snaps scrub ok 2024-08-31T05:15:19.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:19 smithi073 ceph-mon[24726]: osd.0 [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825] boot 2024-08-31T05:15:19.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:19 smithi073 ceph-mon[24726]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T05:15:19.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:19 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:15:20.626 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:20 smithi067 ceph-mon[17432]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:20.626 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:20 smithi067 ceph-mon[17432]: osdmap e10: 1 total, 1 up, 1 in 2024-08-31T05:15:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T05:15:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T05:15:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:20.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:20 smithi073 ceph-mon[24726]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:15:20.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:20 smithi073 ceph-mon[24726]: osdmap e10: 1 total, 1 up, 1 in 2024-08-31T05:15:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T05:15:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T05:15:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:21.691 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:21 smithi067 ceph-mon[17432]: from='client.14344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:21.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:21 smithi073 ceph-mon[24726]: from='client.14344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:22.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:22 smithi067 ceph-mon[17432]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:22.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:22 smithi073 ceph-mon[24726]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:24.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:24.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: Detected new or changed devices on smithi067 2024-08-31T05:15:24.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:24.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:24.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:15:24.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: Adjusting osd_memory_target on smithi067 to 11840M 2024-08-31T05:15:24.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:24.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:24.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:15:24.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:24.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:15:24.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/685459592' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd0426c7-f84f-401b-b22f-51e7f5480c70"}]: dispatch 2024-08-31T05:15:24.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/685459592' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd0426c7-f84f-401b-b22f-51e7f5480c70"}]': finished 2024-08-31T05:15:24.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T05:15:24.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:15:24.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: Detected new or changed devices on smithi067 2024-08-31T05:15:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:15:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: Adjusting osd_memory_target on smithi067 to 11840M 2024-08-31T05:15:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:15:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:15:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/685459592' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd0426c7-f84f-401b-b22f-51e7f5480c70"}]: dispatch 2024-08-31T05:15:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/685459592' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd0426c7-f84f-401b-b22f-51e7f5480c70"}]': finished 2024-08-31T05:15:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T05:15:24.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:15:25.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:25 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2630595423' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T05:15:25.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:25 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:25.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:25 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:25.753 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:25 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2630595423' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T05:15:25.754 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:25 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:25.754 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:25 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:26.611 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:26 smithi067 ceph-mon[17432]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:26.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:26 smithi073 ceph-mon[24726]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:27.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:27 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:15:27.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:27 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:15:28.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:28 smithi073 ceph-mon[24726]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:28.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:28 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:28.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:28 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:28.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:28 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:28.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:28 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:15:28.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:28 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:28.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:28 smithi067 ceph-mon[17432]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:28.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:28 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:28.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:28 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:28.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:28 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:28.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:28 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:15:28.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:28 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:30.514 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:30 smithi067 ceph-mon[17432]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:30.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:30 smithi073 ceph-mon[24726]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:32.498 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:32 smithi067 ceph-mon[17432]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:32.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:32 smithi073 ceph-mon[24726]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:33.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:33 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-31T05:15:33.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:33 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:33.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:33 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-31T05:15:33.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:33 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:34.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:34 smithi067 ceph-mon[17432]: Deploying daemon osd.1 on smithi067 2024-08-31T05:15:34.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:34 smithi067 ceph-mon[17432]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:34.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:34 smithi073 ceph-mon[24726]: Deploying daemon osd.1 on smithi067 2024-08-31T05:15:34.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:34 smithi073 ceph-mon[24726]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:36.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:36 smithi067 ceph-mon[17432]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:36.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:36 smithi073 ceph-mon[24726]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:38.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:38 smithi073 ceph-mon[24726]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:38.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:38 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:15:38.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:38 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:38.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:38 smithi067 ceph-mon[17432]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:38.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:38 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:15:38.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:38 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:39.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:39 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:39.783 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:39 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:40.663 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:40 smithi067 ceph-mon[17432]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:40.664 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:40 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:40.664 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:40 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:40.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:40 smithi073 ceph-mon[24726]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:40.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:40 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:40.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:40 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:41.545 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:15:41.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:41 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:15:42.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:42.272+0000 7fe955ffb640 1 -- 172.21.15.67:0/2321125231 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe9580623d0 con 0x7fe94806de00 2024-08-31T05:15:42.273 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 1 on host 'smithi067' 2024-08-31T05:15:42.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:42.274+0000 7fe95f023640 1 -- 172.21.15.67:0/2321125231 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe94806de00 msgr2=0x7fe9480702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:15:42.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:42.274+0000 7fe95f023640 1 --2- 172.21.15.67:0/2321125231 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe94806de00 0x7fe9480702c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe958101660 tx=0x7fe94c005db0 comp rx=0 tx=0).stop 2024-08-31T05:15:42.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:42.274+0000 7fe95f023640 1 -- 172.21.15.67:0/2321125231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe958101800 msgr2=0x7fe95819bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:15:42.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:42.274+0000 7fe95f023640 1 --2- 172.21.15.67:0/2321125231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe958101800 0x7fe95819bf60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe944006010 tx=0x7fe9440048f0 comp rx=0 tx=0).stop 2024-08-31T05:15:42.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:42.274+0000 7fe95f023640 1 -- 172.21.15.67:0/2321125231 shutdown_connections 2024-08-31T05:15:42.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:42.274+0000 7fe95f023640 1 --2- 172.21.15.67:0/2321125231 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe94806de00 0x7fe9480702c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:15:42.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:42.274+0000 7fe95f023640 1 --2- 172.21.15.67:0/2321125231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe958101800 0x7fe95819bf60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:15:42.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:42.274+0000 7fe95f023640 1 --2- 172.21.15.67:0/2321125231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe958100600 0x7fe95806aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:15:42.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:42.274+0000 7fe95f023640 1 -- 172.21.15.67:0/2321125231 >> 172.21.15.67:0/2321125231 conn(0x7fe9580fbdb0 msgr2=0x7fe958104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:15:42.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:42.274+0000 7fe95f023640 1 -- 172.21.15.67:0/2321125231 shutdown_connections 2024-08-31T05:15:42.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:42.274+0000 7fe95f023640 1 -- 172.21.15.67:0/2321125231 wait complete. 2024-08-31T05:15:42.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:42 smithi067 ceph-mon[17432]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:42.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:42 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:42.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:42 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:42.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:42 smithi073 ceph-mon[24726]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:42.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:42 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:42.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:42 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:42.852 DEBUG:teuthology.orchestra.run.smithi067:osd.1> sudo journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.1.service 2024-08-31T05:15:42.855 INFO:tasks.cephadm:Deploying osd.2 on smithi067 with /dev/vg_nvme/lv_2... 2024-08-31T05:15:42.855 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T05:15:43.742 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:15:44.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:44 smithi067 ceph-mon[17432]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:44.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:44 smithi073 ceph-mon[24726]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:45.043 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:15:44 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1[44766]: 2024-08-31T05:15:44.636+0000 7f0e6af2a640 -1 osd.1 0 log_to_monitors true 2024-08-31T05:15:45.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:45 smithi067 ceph-mon[17432]: from='osd.1 [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-31T05:15:45.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:45 smithi073 ceph-mon[24726]: from='osd.1 [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-31T05:15:46.414 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:15:46.455 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi067:vg_nvme/lv_2 2024-08-31T05:15:46.680 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:46 smithi067 ceph-mon[17432]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:46.680 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:46 smithi067 ceph-mon[17432]: from='osd.1 [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T05:15:46.680 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:46 smithi067 ceph-mon[17432]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T05:15:46.681 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:46 smithi067 ceph-mon[17432]: from='osd.1 [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-08-31T05:15:46.681 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:46 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:15:46.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:46 smithi073 ceph-mon[24726]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:46.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:46 smithi073 ceph-mon[24726]: from='osd.1 [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T05:15:46.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:46 smithi073 ceph-mon[24726]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T05:15:46.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:46 smithi073 ceph-mon[24726]: from='osd.1 [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-08-31T05:15:46.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:46 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:15:47.216 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:15:47.479 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:15:47 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1[44766]: 2024-08-31T05:15:47.220+0000 7f0e676c1640 -1 osd.1 0 waiting for initial osdmap 2024-08-31T05:15:47.480 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:15:47 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1[44766]: 2024-08-31T05:15:47.230+0000 7f0e5ecbc640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:15:47.480 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:47 smithi067 ceph-mon[17432]: from='osd.1 [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-08-31T05:15:47.480 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:47 smithi067 ceph-mon[17432]: osdmap e13: 2 total, 1 up, 2 in 2024-08-31T05:15:47.480 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:47 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:15:47.480 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:47 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:15:47.480 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:47 smithi067 ceph-mon[17432]: from='osd.1 [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055]' entity='osd.1' 2024-08-31T05:15:47.480 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:47 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:47.480 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:47 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:47.480 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:47 smithi067 ceph-mon[17432]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:47.480 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:47 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:15:47.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.659+0000 7fbd85755640 1 -- 172.21.15.67:0/2776676280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd80100600 msgr2=0x7fbd80100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:15:47.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.659+0000 7fbd85755640 1 --2- 172.21.15.67:0/2776676280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd80100600 0x7fbd80100a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009880 tx=0x7fbd7002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:15:47.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.659+0000 7fbd85755640 1 -- 172.21.15.67:0/2776676280 shutdown_connections 2024-08-31T05:15:47.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.659+0000 7fbd85755640 1 --2- 172.21.15.67:0/2776676280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd80101800 0x7fbd80101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:15:47.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.659+0000 7fbd85755640 1 --2- 172.21.15.67:0/2776676280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd80100600 0x7fbd80100a00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:15:47.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.659+0000 7fbd85755640 1 -- 172.21.15.67:0/2776676280 >> 172.21.15.67:0/2776676280 conn(0x7fbd800fbdb0 msgr2=0x7fbd800fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:15:47.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.659+0000 7fbd85755640 1 -- 172.21.15.67:0/2776676280 shutdown_connections 2024-08-31T05:15:47.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.659+0000 7fbd85755640 1 -- 172.21.15.67:0/2776676280 wait complete. 2024-08-31T05:15:47.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.659+0000 7fbd85755640 1 Processor -- start 2024-08-31T05:15:47.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.660+0000 7fbd85755640 1 -- start start 2024-08-31T05:15:47.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.660+0000 7fbd85755640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd80100600 0x7fbd80104520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:15:47.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.660+0000 7fbd85755640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd80101800 0x7fbd80102be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:15:47.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.660+0000 7fbd85755640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbd801094a0 con 0x7fbd80101800 2024-08-31T05:15:47.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.660+0000 7fbd85755640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbd80109320 con 0x7fbd80100600 2024-08-31T05:15:47.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.660+0000 7fbd7e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd80101800 0x7fbd80102be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:15:47.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.660+0000 7fbd7e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd80101800 0x7fbd80102be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51110/0 (socket says 172.21.15.67:51110) 2024-08-31T05:15:47.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.660+0000 7fbd7e7fc640 1 -- 172.21.15.67:0/1437730965 learned_addr learned my addr 172.21.15.67:0/1437730965 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:15:47.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.660+0000 7fbd7effd640 1 --2- 172.21.15.67:0/1437730965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd80100600 0x7fbd80104520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:15:47.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.660+0000 7fbd7e7fc640 1 -- 172.21.15.67:0/1437730965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd80100600 msgr2=0x7fbd80104520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:15:47.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.660+0000 7fbd7e7fc640 1 --2- 172.21.15.67:0/1437730965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd80100600 0x7fbd80104520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:15:47.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.660+0000 7fbd7e7fc640 1 -- 172.21.15.67:0/1437730965 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd80103120 con 0x7fbd80101800 2024-08-31T05:15:47.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.661+0000 7fbd7e7fc640 1 --2- 172.21.15.67:0/1437730965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd80101800 0x7fbd80102be0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400b420 tx=0x7fbd7400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:15:47.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.661+0000 7fbd67fff640 1 -- 172.21.15.67:0/1437730965 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd74011630 con 0x7fbd80101800 2024-08-31T05:15:47.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.661+0000 7fbd85755640 1 -- 172.21.15.67:0/1437730965 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd80103410 con 0x7fbd80101800 2024-08-31T05:15:47.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.661+0000 7fbd85755640 1 -- 172.21.15.67:0/1437730965 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd80103a20 con 0x7fbd80101800 2024-08-31T05:15:47.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.661+0000 7fbd67fff640 1 -- 172.21.15.67:0/1437730965 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbd74016070 con 0x7fbd80101800 2024-08-31T05:15:47.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.661+0000 7fbd67fff640 1 -- 172.21.15.67:0/1437730965 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd74010d40 con 0x7fbd80101800 2024-08-31T05:15:47.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.662+0000 7fbd85755640 1 -- 172.21.15.67:0/1437730965 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6c005290 con 0x7fbd80101800 2024-08-31T05:15:47.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.663+0000 7fbd67fff640 1 -- 172.21.15.67:0/1437730965 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7fbd7401b460 con 0x7fbd80101800 2024-08-31T05:15:47.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.663+0000 7fbd67fff640 1 --2- 172.21.15.67:0/1437730965 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fbd6806de00 0x7fbd680702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:15:47.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.663+0000 7fbd7effd640 1 --2- 172.21.15.67:0/1437730965 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fbd6806de00 0x7fbd680702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:15:47.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.663+0000 7fbd67fff640 1 -- 172.21.15.67:0/1437730965 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2134+0+0 (secure 0 0 0) 0x7fbd7408c390 con 0x7fbd80101800 2024-08-31T05:15:47.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.664+0000 7fbd7effd640 1 --2- 172.21.15.67:0/1437730965 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fbd6806de00 0x7fbd680702c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009230 tx=0x7fbd700058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:15:47.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.672+0000 7fbd67fff640 1 -- 172.21.15.67:0/1437730965 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd7405ad90 con 0x7fbd80101800 2024-08-31T05:15:47.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:47 smithi073 ceph-mon[24726]: from='osd.1 [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-08-31T05:15:47.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:47 smithi073 ceph-mon[24726]: osdmap e13: 2 total, 1 up, 2 in 2024-08-31T05:15:47.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:47 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:15:47.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:47 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:15:47.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:47 smithi073 ceph-mon[24726]: from='osd.1 [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055]' entity='osd.1' 2024-08-31T05:15:47.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:47 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:47.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:47 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:47.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:47 smithi073 ceph-mon[24726]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:15:47.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:47 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:15:47.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:15:47.891+0000 7fbd85755640 1 -- 172.21.15.67:0/1437730965 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fbd6c000bc0 con 0x7fbd6806de00 2024-08-31T05:15:48.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:48 smithi073 ceph-mon[24726]: purged_snaps scrub starts 2024-08-31T05:15:48.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:48 smithi073 ceph-mon[24726]: purged_snaps scrub ok 2024-08-31T05:15:48.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:48 smithi073 ceph-mon[24726]: from='client.14362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:48.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:48 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T05:15:48.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:48 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T05:15:48.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:48 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:48.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:48 smithi073 ceph-mon[24726]: osd.1 [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055] boot 2024-08-31T05:15:48.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:48 smithi073 ceph-mon[24726]: osdmap e14: 2 total, 2 up, 2 in 2024-08-31T05:15:48.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:48 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:15:48.771 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:48 smithi067 ceph-mon[17432]: purged_snaps scrub starts 2024-08-31T05:15:48.771 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:48 smithi067 ceph-mon[17432]: purged_snaps scrub ok 2024-08-31T05:15:48.771 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:48 smithi067 ceph-mon[17432]: from='client.14362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:48.771 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:48 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T05:15:48.771 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:48 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T05:15:48.771 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:48 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:48.772 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:48 smithi067 ceph-mon[17432]: osd.1 [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055] boot 2024-08-31T05:15:48.772 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:48 smithi067 ceph-mon[17432]: osdmap e14: 2 total, 2 up, 2 in 2024-08-31T05:15:48.772 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:48 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:15:49.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:49 smithi067 ceph-mon[17432]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:15:49.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:49 smithi073 ceph-mon[24726]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:15:50.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:50 smithi073 ceph-mon[24726]: osdmap e15: 2 total, 2 up, 2 in 2024-08-31T05:15:50.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:50 smithi067 ceph-mon[17432]: osdmap e15: 2 total, 2 up, 2 in 2024-08-31T05:15:52.553 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:52 smithi067 ceph-mon[17432]: Detected new or changed devices on smithi067 2024-08-31T05:15:52.553 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:52.553 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:52.553 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:15:52.553 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:15:52.554 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:52 smithi067 ceph-mon[17432]: Adjusting osd_memory_target on smithi067 to 5920M 2024-08-31T05:15:52.554 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:52.554 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:52.554 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:15:52.554 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:52.554 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:52 smithi067 ceph-mon[17432]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:15:52.554 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:15:52.611 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:52 smithi073 ceph-mon[24726]: Detected new or changed devices on smithi067 2024-08-31T05:15:52.611 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:52 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:52.611 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:52 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:52.611 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:52 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:15:52.611 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:52 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:15:52.611 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:52 smithi073 ceph-mon[24726]: Adjusting osd_memory_target on smithi067 to 5920M 2024-08-31T05:15:52.611 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:52 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:52.611 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:52 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:52.611 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:52 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:15:52.611 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:52 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:52.612 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:52 smithi073 ceph-mon[24726]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:15:52.612 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:52 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:15:53.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:53 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/361838323' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f6476c9-839c-43b1-9a8e-bf77683c5a3a"}]: dispatch 2024-08-31T05:15:53.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:53 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/361838323' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f6476c9-839c-43b1-9a8e-bf77683c5a3a"}]': finished 2024-08-31T05:15:53.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:53 smithi067 ceph-mon[17432]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T05:15:53.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:53 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:15:53.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:53 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1118656248' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T05:15:53.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:53 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:53.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:53 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:53.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:53 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/361838323' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f6476c9-839c-43b1-9a8e-bf77683c5a3a"}]: dispatch 2024-08-31T05:15:53.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:53 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/361838323' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f6476c9-839c-43b1-9a8e-bf77683c5a3a"}]': finished 2024-08-31T05:15:53.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:53 smithi073 ceph-mon[24726]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T05:15:53.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:53 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:15:53.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:53 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1118656248' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T05:15:53.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:53 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:53.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:53 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:54.379 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:54 smithi067 ceph-mon[17432]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:15:54.597 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:54 smithi073 ceph-mon[24726]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:15:56.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:56 smithi073 ceph-mon[24726]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:15:56.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:56 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:56.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:56 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:56.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:56 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:56.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:56 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:15:56.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:56 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:56.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:56 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:15:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:56 smithi067 ceph-mon[17432]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:15:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:56 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:56 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:56 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:56 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:15:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:56 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:15:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:56 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:15:58.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:15:58 smithi067 ceph-mon[17432]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:15:58.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:15:58 smithi073 ceph-mon[24726]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:00.682 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:00 smithi067 ceph-mon[17432]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:00.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:00 smithi073 ceph-mon[24726]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:01.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:01 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-31T05:16:01.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:01 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:01.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:01 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-31T05:16:01.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:01 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:02.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:02 smithi067 ceph-mon[17432]: Deploying daemon osd.2 on smithi067 2024-08-31T05:16:02.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:02 smithi067 ceph-mon[17432]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:02.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:02 smithi073 ceph-mon[24726]: Deploying daemon osd.2 on smithi067 2024-08-31T05:16:02.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:02 smithi073 ceph-mon[24726]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:04.678 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:04 smithi067 ceph-mon[17432]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:04.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:04 smithi073 ceph-mon[24726]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:06.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:06 smithi073 ceph-mon[24726]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:06.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:16:06.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:06.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:06.712 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:06 smithi067 ceph-mon[17432]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:06.712 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:06 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:16:06.712 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:06 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:06.712 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:06 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:08.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:08 smithi067 ceph-mon[17432]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:08.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:08 smithi073 ceph-mon[24726]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:10.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:16:10.138+0000 7fbd67fff640 1 -- 172.21.15.67:0/1437730965 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbd6c000bc0 con 0x7fbd6806de00 2024-08-31T05:16:10.141 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 2 on host 'smithi067' 2024-08-31T05:16:10.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:16:10.140+0000 7fbd85755640 1 -- 172.21.15.67:0/1437730965 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fbd6806de00 msgr2=0x7fbd680702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:16:10.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:16:10.140+0000 7fbd85755640 1 --2- 172.21.15.67:0/1437730965 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fbd6806de00 0x7fbd680702c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009230 tx=0x7fbd700058d0 comp rx=0 tx=0).stop 2024-08-31T05:16:10.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:16:10.140+0000 7fbd85755640 1 -- 172.21.15.67:0/1437730965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd80101800 msgr2=0x7fbd80102be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:16:10.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:16:10.140+0000 7fbd85755640 1 --2- 172.21.15.67:0/1437730965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd80101800 0x7fbd80102be0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400b420 tx=0x7fbd7400b8e0 comp rx=0 tx=0).stop 2024-08-31T05:16:10.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:16:10.140+0000 7fbd85755640 1 -- 172.21.15.67:0/1437730965 shutdown_connections 2024-08-31T05:16:10.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:16:10.140+0000 7fbd85755640 1 --2- 172.21.15.67:0/1437730965 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fbd6806de00 0x7fbd680702c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:16:10.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:16:10.140+0000 7fbd85755640 1 --2- 172.21.15.67:0/1437730965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd80101800 0x7fbd80102be0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:16:10.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:16:10.140+0000 7fbd85755640 1 --2- 172.21.15.67:0/1437730965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd80100600 0x7fbd80104520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:16:10.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:16:10.140+0000 7fbd85755640 1 -- 172.21.15.67:0/1437730965 >> 172.21.15.67:0/1437730965 conn(0x7fbd800fbdb0 msgr2=0x7fbd80069ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:16:10.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:16:10.140+0000 7fbd85755640 1 -- 172.21.15.67:0/1437730965 shutdown_connections 2024-08-31T05:16:10.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:16:10.140+0000 7fbd85755640 1 -- 172.21.15.67:0/1437730965 wait complete. 2024-08-31T05:16:10.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:10 smithi073 ceph-mon[24726]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:10.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:10.719 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:10 smithi067 ceph-mon[17432]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:10.719 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:10.719 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:11.095 DEBUG:teuthology.orchestra.run.smithi067:osd.2> sudo journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.2.service 2024-08-31T05:16:11.097 INFO:tasks.cephadm:Deploying osd.3 on smithi073 with /dev/vg_nvme/lv_4... 2024-08-31T05:16:11.097 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T05:16:11.353 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi073/config 2024-08-31T05:16:11.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:16:11.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:16:12.620 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:12 smithi073 ceph-mon[24726]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:12.656 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:12 smithi067 ceph-mon[17432]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:12.656 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:16:12 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2[52254]: 2024-08-31T05:16:12.445+0000 7fb5ad54f640 -1 osd.2 0 log_to_monitors true 2024-08-31T05:16:13.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:13 smithi073 ceph-mon[24726]: from='osd.2 [v2:172.21.15.67:6818/398055695,v1:172.21.15.67:6819/398055695]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-31T05:16:13.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:13 smithi073 ceph-mon[24726]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-31T05:16:13.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:13 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:13.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:13 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:16:13.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:13 smithi067 ceph-mon[17432]: from='osd.2 [v2:172.21.15.67:6818/398055695,v1:172.21.15.67:6819/398055695]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-31T05:16:13.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:13 smithi067 ceph-mon[17432]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-31T05:16:13.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:13 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:13.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:13 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:13.744 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_4 2024-08-31T05:16:13.992 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi073/config 2024-08-31T05:16:14.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.460+0000 7f8bf214d640 1 -- 172.21.15.73:0/2214220217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0fff80 msgr2=0x7f8bec102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:16:14.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.460+0000 7f8bf214d640 1 --2- 172.21.15.73:0/2214220217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0fff80 0x7f8bec102390 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009880 tx=0x7f8bd402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:16:14.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.460+0000 7f8bf214d640 1 -- 172.21.15.73:0/2214220217 shutdown_connections 2024-08-31T05:16:14.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.460+0000 7f8bf214d640 1 --2- 172.21.15.73:0/2214220217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bec1028d0 0x7f8bec104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:16:14.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.460+0000 7f8bf214d640 1 --2- 172.21.15.73:0/2214220217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0fff80 0x7f8bec102390 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:16:14.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.460+0000 7f8bf214d640 1 -- 172.21.15.73:0/2214220217 >> 172.21.15.73:0/2214220217 conn(0x7f8bec0fbdb0 msgr2=0x7f8bec0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:16:14.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.460+0000 7f8bf214d640 1 -- 172.21.15.73:0/2214220217 shutdown_connections 2024-08-31T05:16:14.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.460+0000 7f8bf214d640 1 -- 172.21.15.73:0/2214220217 wait complete. 2024-08-31T05:16:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.461+0000 7f8bf214d640 1 Processor -- start 2024-08-31T05:16:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.461+0000 7f8bf214d640 1 -- start start 2024-08-31T05:16:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.461+0000 7f8bf214d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0fff80 0x7f8bec19d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:16:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.461+0000 7f8bf214d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bec1028d0 0x7f8bec19ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:16:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.461+0000 7f8bf214d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec110b30 con 0x7f8bec1028d0 2024-08-31T05:16:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.461+0000 7f8bf214d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec1109b0 con 0x7f8bec0fff80 2024-08-31T05:16:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.462+0000 7f8beb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0fff80 0x7f8bec19d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:16:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.462+0000 7f8beb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0fff80 0x7f8bec19d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54798/0 (socket says 172.21.15.73:54798) 2024-08-31T05:16:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.462+0000 7f8beb7fe640 1 -- 172.21.15.73:0/2074105740 learned_addr learned my addr 172.21.15.73:0/2074105740 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-08-31T05:16:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.462+0000 7f8beaffd640 1 --2- 172.21.15.73:0/2074105740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bec1028d0 0x7f8bec19ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:16:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.462+0000 7f8beaffd640 1 -- 172.21.15.73:0/2074105740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0fff80 msgr2=0x7f8bec19d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:16:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.462+0000 7f8beaffd640 1 --2- 172.21.15.73:0/2074105740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0fff80 0x7f8bec19d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:16:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.462+0000 7f8beaffd640 1 -- 172.21.15.73:0/2074105740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bec19e440 con 0x7f8bec1028d0 2024-08-31T05:16:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.462+0000 7f8beb7fe640 1 --2- 172.21.15.73:0/2074105740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0fff80 0x7f8bec19d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:16:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.462+0000 7f8beaffd640 1 --2- 172.21.15.73:0/2074105740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bec1028d0 0x7f8bec19ddc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00e970 tx=0x7f8bdc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:16:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.462+0000 7f8be8ff9640 1 -- 172.21.15.73:0/2074105740 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8bdc00cac0 con 0x7f8bec1028d0 2024-08-31T05:16:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.462+0000 7f8bf214d640 1 -- 172.21.15.73:0/2074105740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bec1a2e80 con 0x7f8bec1028d0 2024-08-31T05:16:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.462+0000 7f8be8ff9640 1 -- 172.21.15.73:0/2074105740 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8bdc00cc60 con 0x7f8bec1028d0 2024-08-31T05:16:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.462+0000 7f8be8ff9640 1 -- 172.21.15.73:0/2074105740 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8bdc0047a0 con 0x7f8bec1028d0 2024-08-31T05:16:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.462+0000 7f8bf214d640 1 -- 172.21.15.73:0/2074105740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bec1a3380 con 0x7f8bec1028d0 2024-08-31T05:16:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.463+0000 7f8bf214d640 1 -- 172.21.15.73:0/2074105740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bec100380 con 0x7f8bec1028d0 2024-08-31T05:16:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.464+0000 7f8be8ff9640 1 -- 172.21.15.73:0/2074105740 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f8bdc004a70 con 0x7f8bec1028d0 2024-08-31T05:16:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.464+0000 7f8be8ff9640 1 --2- 172.21.15.73:0/2074105740 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f8bd806ddb0 0x7f8bd8070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:16:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.464+0000 7f8be8ff9640 1 -- 172.21.15.73:0/2074105740 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2566+0+0 (secure 0 0 0) 0x7f8bdc08d390 con 0x7f8bec1028d0 2024-08-31T05:16:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.464+0000 7f8beb7fe640 1 --2- 172.21.15.73:0/2074105740 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f8bd806ddb0 0x7f8bd8070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:16:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.465+0000 7f8beb7fe640 1 --2- 172.21.15.73:0/2074105740 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f8bd806ddb0 0x7f8bd8070270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40096c0 tx=0x7f8bd4005a20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:16:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.469+0000 7f8be8ff9640 1 -- 172.21.15.73:0/2074105740 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8bdc05bb00 con 0x7f8bec1028d0 2024-08-31T05:16:14.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:14.642+0000 7f8bf214d640 1 -- 172.21.15.73:0/2074105740 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8bec103310 con 0x7f8bd806ddb0 2024-08-31T05:16:14.644 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:14 smithi073 ceph-mon[24726]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:14.645 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:14 smithi073 ceph-mon[24726]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T05:16:14.645 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:14 smithi073 ceph-mon[24726]: osdmap e17: 3 total, 2 up, 3 in 2024-08-31T05:16:14.645 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:14 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:16:14.645 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:14 smithi073 ceph-mon[24726]: from='osd.2 [v2:172.21.15.67:6818/398055695,v1:172.21.15.67:6819/398055695]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-08-31T05:16:14.645 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:14 smithi073 ceph-mon[24726]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-08-31T05:16:14.668 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:14 smithi067 ceph-mon[17432]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:14.668 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:14 smithi067 ceph-mon[17432]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T05:16:14.668 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:14 smithi067 ceph-mon[17432]: osdmap e17: 3 total, 2 up, 3 in 2024-08-31T05:16:14.668 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:14 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:16:14.668 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:14 smithi067 ceph-mon[17432]: from='osd.2 [v2:172.21.15.67:6818/398055695,v1:172.21.15.67:6819/398055695]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-08-31T05:16:14.668 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:14 smithi067 ceph-mon[17432]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-08-31T05:16:15.407 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:16:15 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2[52254]: 2024-08-31T05:16:15.296+0000 7fb5a8caf640 -1 osd.2 0 waiting for initial osdmap 2024-08-31T05:16:15.407 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:16:15 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2[52254]: 2024-08-31T05:16:15.304+0000 7fb5a12e1640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:16:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:15 smithi073 ceph-mon[24726]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-08-31T05:16:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:15 smithi073 ceph-mon[24726]: osdmap e18: 3 total, 2 up, 3 in 2024-08-31T05:16:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:15 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:16:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:15 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:16:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:15 smithi073 ceph-mon[24726]: from='client.14380 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:15 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T05:16:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:15 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T05:16:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:15 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:15 smithi073 ceph-mon[24726]: from='osd.2 ' entity='osd.2' 2024-08-31T05:16:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:15 smithi073 ceph-mon[24726]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:15.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:15 smithi067 ceph-mon[17432]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-08-31T05:16:15.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:15 smithi067 ceph-mon[17432]: osdmap e18: 3 total, 2 up, 3 in 2024-08-31T05:16:15.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:15 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:16:15.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:15 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:16:15.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:15 smithi067 ceph-mon[17432]: from='client.14380 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:15.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:15 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T05:16:15.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:15 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T05:16:15.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:15 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:15.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:15 smithi067 ceph-mon[17432]: from='osd.2 ' entity='osd.2' 2024-08-31T05:16:15.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:15 smithi067 ceph-mon[17432]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:16:16.651 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: purged_snaps scrub starts 2024-08-31T05:16:16.651 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: purged_snaps scrub ok 2024-08-31T05:16:16.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:16:16.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: Detected new or changed devices on smithi067 2024-08-31T05:16:16.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:16.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:16.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:16:16.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:16:16.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:16:16.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: Adjusting osd_memory_target on smithi067 to 3946M 2024-08-31T05:16:16.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:16.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:16.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:16:16.653 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:16.653 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:16:16.653 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: osd.2 [v2:172.21.15.67:6818/398055695,v1:172.21.15.67:6819/398055695] boot 2024-08-31T05:16:16.653 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T05:16:16.653 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:16 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:16:16.756 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: purged_snaps scrub starts 2024-08-31T05:16:16.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: purged_snaps scrub ok 2024-08-31T05:16:16.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:16:16.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: Detected new or changed devices on smithi067 2024-08-31T05:16:16.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:16.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:16.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:16:16.758 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:16:16.758 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:16:16.758 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: Adjusting osd_memory_target on smithi067 to 3946M 2024-08-31T05:16:16.758 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:16.758 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:16.759 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:16:16.759 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:16.759 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:16:16.759 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: osd.2 [v2:172.21.15.67:6818/398055695,v1:172.21.15.67:6819/398055695] boot 2024-08-31T05:16:16.759 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T05:16:16.760 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:16 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:16:17.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:17 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/1752642240' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "712d22a6-cf93-44f0-8ead-e482fd158859"}]: dispatch 2024-08-31T05:16:17.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:17 smithi073 ceph-mon[24726]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "712d22a6-cf93-44f0-8ead-e482fd158859"}]: dispatch 2024-08-31T05:16:17.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:17 smithi073 ceph-mon[24726]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "712d22a6-cf93-44f0-8ead-e482fd158859"}]': finished 2024-08-31T05:16:17.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:17 smithi073 ceph-mon[24726]: osdmap e20: 4 total, 3 up, 4 in 2024-08-31T05:16:17.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:17 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:18.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:17 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/1752642240' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "712d22a6-cf93-44f0-8ead-e482fd158859"}]: dispatch 2024-08-31T05:16:18.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:17 smithi067 ceph-mon[17432]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "712d22a6-cf93-44f0-8ead-e482fd158859"}]: dispatch 2024-08-31T05:16:18.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:17 smithi067 ceph-mon[17432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "712d22a6-cf93-44f0-8ead-e482fd158859"}]': finished 2024-08-31T05:16:18.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:17 smithi067 ceph-mon[17432]: osdmap e20: 4 total, 3 up, 4 in 2024-08-31T05:16:18.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:17 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:18.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:18 smithi073 ceph-mon[24726]: pgmap v86: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:18.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:18 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-31T05:16:18.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:18 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/2646520328' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T05:16:18.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:18 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T05:16:18.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:18 smithi073 ceph-mon[24726]: osdmap e21: 4 total, 3 up, 4 in 2024-08-31T05:16:18.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:18 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:18.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:18 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-31T05:16:18.992 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:18 smithi067 ceph-mon[17432]: pgmap v86: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:18.992 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:18 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-31T05:16:18.992 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:18 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/2646520328' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T05:16:18.992 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:18 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T05:16:18.992 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:18 smithi067 ceph-mon[17432]: osdmap e21: 4 total, 3 up, 4 in 2024-08-31T05:16:18.992 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:18 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:18.992 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:18 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-31T05:16:20.364 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[56990]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:16:20.364 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[56990]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:16:20.364 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[56990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:16:20.364 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[56990]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:16:20.364 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T05:16:20.364 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:20 smithi067 ceph-mon[17432]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T05:16:20.365 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:20.365 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:20 smithi067 ceph-mon[17432]: pgmap v89: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:20.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T05:16:20.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:20 smithi073 ceph-mon[24726]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T05:16:20.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:20.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:20 smithi073 ceph-mon[24726]: pgmap v89: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:20.667 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[57101]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:16:20.667 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[57101]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:16:20.667 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[57101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:16:20.667 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[57101]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:16:20.939 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[57167]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:16:20.939 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[57167]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:16:20.939 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[57167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:16:20.939 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[57167]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:16:21.199 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[57170]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:16:21.200 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[57170]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:16:21.200 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[57170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:16:21.200 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:16:20 smithi067 sudo[57170]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:16:21.200 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 ceph-mon[17432]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T05:16:21.200 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:21.200 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:21.200 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:21.200 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:21.200 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:21.200 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:16:21.200 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:21.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:21 smithi073 ceph-mon[24726]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T05:16:21.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:21 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:21.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:21 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:21.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:21 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:21.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:21 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:21.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:21 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:21.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:21 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:16:21.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:21 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:21.469 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57173]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:16:21.469 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57173]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:16:21.469 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:16:21.469 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57173]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:16:21.729 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57176]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:16:21.729 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57176]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:16:21.729 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:16:21.729 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57176]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:16:21.997 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57179]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:16:21.997 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57179]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:16:21.997 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:16:21.997 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57179]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:16:22.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 sudo[29811]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:16:22.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 sudo[29811]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:16:22.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 sudo[29811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:16:22.263 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 sudo[29811]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:16:22.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57182]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:16:22.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57182]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:16:22.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:16:22.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:21 smithi067 sudo[57182]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:16:22.520 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 sudo[29830]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:16:22.520 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 sudo[29830]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:16:22.520 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 sudo[29830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:16:22.520 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 sudo[29830]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:16:22.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:22.522+0000 7f8be8ff9640 1 -- 172.21.15.73:0/2074105740 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f8bdc057a70 con 0x7f8bec1028d0 2024-08-31T05:16:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:22 smithi067 ceph-mon[17432]: pgmap v91: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:22 smithi067 ceph-mon[17432]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:16:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:22 smithi067 ceph-mon[17432]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:16:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:22 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:16:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:22 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:16:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:22 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:16:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:22 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:16:22.892 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 ceph-mon[24726]: pgmap v91: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:22.893 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 ceph-mon[24726]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:16:22.893 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 ceph-mon[24726]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:16:22.893 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:16:22.893 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:16:22.893 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:16:22.893 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:22 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:16:23.654 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:23 smithi073 ceph-mon[24726]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:16:23.654 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:23 smithi073 ceph-mon[24726]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:16:23.654 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:23 smithi073 ceph-mon[24726]: mgrmap e19: smithi067.hftacj(active, since 2m), standbys: smithi073.zfoyxd 2024-08-31T05:16:23.654 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:23 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:23.654 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:23 smithi073 ceph-mon[24726]: pgmap v92: 1 pgs: 1 creating+peering; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:23.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:23 smithi067 ceph-mon[17432]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:16:23.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:23 smithi067 ceph-mon[17432]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:16:23.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:23 smithi067 ceph-mon[17432]: mgrmap e19: smithi067.hftacj(active, since 2m), standbys: smithi073.zfoyxd 2024-08-31T05:16:23.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:23 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:23.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:23 smithi067 ceph-mon[17432]: pgmap v92: 1 pgs: 1 creating+peering; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:26.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:26 smithi073 ceph-mon[24726]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:26 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-31T05:16:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:26 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:26 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:16:26.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:26 smithi067 ceph-mon[17432]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:26.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:26 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-31T05:16:26.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:26 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:26.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:26 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:16:27.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:27 smithi073 ceph-mon[24726]: Deploying daemon osd.3 on smithi073 2024-08-31T05:16:27.778 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:27 smithi067 ceph-mon[17432]: Deploying daemon osd.3 on smithi073 2024-08-31T05:16:28.637 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:28 smithi073 ceph-mon[24726]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:28.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:28 smithi067 ceph-mon[17432]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:30.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:30 smithi073 ceph-mon[24726]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:30.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:30 smithi067 ceph-mon[17432]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:31.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:31 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:16:31.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:31 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:31.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:31 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:31.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:31 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:16:31.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:31 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:31.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:31 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:32.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:32 smithi073 ceph-mon[24726]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:32.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:32 smithi067 ceph-mon[17432]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:34.691 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:34 smithi073 ceph-mon[24726]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:34.691 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:34 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:34.691 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:34 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:34.691 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:34 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:34.691 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:34 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:16:34.691 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:34 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:34.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:34.731+0000 7f8be8ff9640 1 -- 172.21.15.73:0/2074105740 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8bec103310 con 0x7f8bd806ddb0 2024-08-31T05:16:34.733 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 3 on host 'smithi073' 2024-08-31T05:16:34.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:34.734+0000 7f8bf214d640 1 -- 172.21.15.73:0/2074105740 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f8bd806ddb0 msgr2=0x7f8bd8070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:16:34.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:34.734+0000 7f8bf214d640 1 --2- 172.21.15.73:0/2074105740 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f8bd806ddb0 0x7f8bd8070270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40096c0 tx=0x7f8bd4005a20 comp rx=0 tx=0).stop 2024-08-31T05:16:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:34.734+0000 7f8bf214d640 1 -- 172.21.15.73:0/2074105740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bec1028d0 msgr2=0x7f8bec19ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:16:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:34.734+0000 7f8bf214d640 1 --2- 172.21.15.73:0/2074105740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bec1028d0 0x7f8bec19ddc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00e970 tx=0x7f8bdc00ee30 comp rx=0 tx=0).stop 2024-08-31T05:16:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:34.734+0000 7f8bf214d640 1 -- 172.21.15.73:0/2074105740 shutdown_connections 2024-08-31T05:16:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:34.734+0000 7f8bf214d640 1 --2- 172.21.15.73:0/2074105740 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f8bd806ddb0 0x7f8bd8070270 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:16:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:34.734+0000 7f8bf214d640 1 --2- 172.21.15.73:0/2074105740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bec1028d0 0x7f8bec19ddc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:16:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:34.734+0000 7f8bf214d640 1 --2- 172.21.15.73:0/2074105740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0fff80 0x7f8bec19d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:16:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:34.734+0000 7f8bf214d640 1 -- 172.21.15.73:0/2074105740 >> 172.21.15.73:0/2074105740 conn(0x7f8bec0fbdb0 msgr2=0x7f8bec0fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:16:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:34.734+0000 7f8bf214d640 1 -- 172.21.15.73:0/2074105740 shutdown_connections 2024-08-31T05:16:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:34.734+0000 7f8bf214d640 1 -- 172.21.15.73:0/2074105740 wait complete. 2024-08-31T05:16:34.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:34 smithi067 ceph-mon[17432]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:34.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:34 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:34.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:34 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:34.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:34 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:34.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:34 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:16:34.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:34 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:35.419 DEBUG:teuthology.orchestra.run.smithi073:osd.3> sudo journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.3.service 2024-08-31T05:16:35.421 INFO:tasks.cephadm:Deploying osd.4 on smithi073 with /dev/vg_nvme/lv_3... 2024-08-31T05:16:35.421 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T05:16:35.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:35 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:16:35.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:35 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:35.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:35 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:35.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:35 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:16:35.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:35 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:35.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:35 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:36.559 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:36 smithi073 ceph-mon[24726]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:36.573 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi073/config 2024-08-31T05:16:36.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:36 smithi067 ceph-mon[17432]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:37.153 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:16:36 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[30552]: 2024-08-31T05:16:36.932+0000 7f16eaf7d640 -1 osd.3 0 log_to_monitors true 2024-08-31T05:16:37.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:37 smithi073 ceph-mon[24726]: from='osd.3 [v2:172.21.15.73:6800/3773655535,v1:172.21.15.73:6801/3773655535]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-31T05:16:37.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:37 smithi073 ceph-mon[24726]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-31T05:16:37.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:37 smithi067 ceph-mon[17432]: from='osd.3 [v2:172.21.15.73:6800/3773655535,v1:172.21.15.73:6801/3773655535]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-31T05:16:37.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:37 smithi067 ceph-mon[17432]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-31T05:16:38.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:38 smithi073 ceph-mon[24726]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:38.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:38 smithi073 ceph-mon[24726]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T05:16:38.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:38 smithi073 ceph-mon[24726]: osdmap e24: 4 total, 3 up, 4 in 2024-08-31T05:16:38.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:38 smithi073 ceph-mon[24726]: from='osd.3 [v2:172.21.15.73:6800/3773655535,v1:172.21.15.73:6801/3773655535]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-08-31T05:16:38.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:38 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:38.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:38 smithi073 ceph-mon[24726]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-08-31T05:16:38.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:38 smithi067 ceph-mon[17432]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:38.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:38 smithi067 ceph-mon[17432]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T05:16:38.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:38 smithi067 ceph-mon[17432]: osdmap e24: 4 total, 3 up, 4 in 2024-08-31T05:16:38.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:38 smithi067 ceph-mon[17432]: from='osd.3 [v2:172.21.15.73:6800/3773655535,v1:172.21.15.73:6801/3773655535]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-08-31T05:16:38.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:38 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:38.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:38 smithi067 ceph-mon[17432]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-08-31T05:16:39.284 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:16:39 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[30552]: 2024-08-31T05:16:39.224+0000 7f16e7714640 -1 osd.3 0 waiting for initial osdmap 2024-08-31T05:16:39.284 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:16:39 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[30552]: 2024-08-31T05:16:39.231+0000 7f16ded0f640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:16:39.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:39 smithi073 ceph-mon[24726]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-08-31T05:16:39.636 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:39 smithi073 ceph-mon[24726]: osdmap e25: 4 total, 3 up, 4 in 2024-08-31T05:16:39.637 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:39 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:39.637 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:39 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:39.637 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:39 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:39.637 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:39 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:39.637 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:39 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:16:39.637 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:39 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:39.637 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:39 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:39.637 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:39 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:16:39.637 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:39 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:39.637 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:39 smithi073 ceph-mon[24726]: from='osd.3 ' entity='osd.3' 2024-08-31T05:16:39.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:39 smithi067 ceph-mon[17432]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-08-31T05:16:39.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:39 smithi067 ceph-mon[17432]: osdmap e25: 4 total, 3 up, 4 in 2024-08-31T05:16:39.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:39 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:39.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:39 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:39.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:39 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:39.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:39 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:39.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:39 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:16:39.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:39 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:39.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:39 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:39.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:39 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:16:39.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:39 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:39.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:39 smithi067 ceph-mon[17432]: from='osd.3 ' entity='osd.3' 2024-08-31T05:16:40.242 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:16:40.266 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_3 2024-08-31T05:16:40.513 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi073/config 2024-08-31T05:16:40.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:40 smithi073 ceph-mon[24726]: purged_snaps scrub starts 2024-08-31T05:16:40.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:40 smithi073 ceph-mon[24726]: purged_snaps scrub ok 2024-08-31T05:16:40.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:40 smithi073 ceph-mon[24726]: Detected new or changed devices on smithi073 2024-08-31T05:16:40.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:40 smithi073 ceph-mon[24726]: Adjusting osd_memory_target on smithi073 to 14912M 2024-08-31T05:16:40.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:40 smithi073 ceph-mon[24726]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:40.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:40 smithi073 ceph-mon[24726]: osd.3 [v2:172.21.15.73:6800/3773655535,v1:172.21.15.73:6801/3773655535] boot 2024-08-31T05:16:40.632 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:40 smithi073 ceph-mon[24726]: osdmap e26: 4 total, 4 up, 4 in 2024-08-31T05:16:40.632 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:40 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:40.632 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:40 smithi073 ceph-mon[24726]: osdmap e27: 4 total, 4 up, 4 in 2024-08-31T05:16:40.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:40 smithi067 ceph-mon[17432]: purged_snaps scrub starts 2024-08-31T05:16:40.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:40 smithi067 ceph-mon[17432]: purged_snaps scrub ok 2024-08-31T05:16:40.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:40 smithi067 ceph-mon[17432]: Detected new or changed devices on smithi073 2024-08-31T05:16:40.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:40 smithi067 ceph-mon[17432]: Adjusting osd_memory_target on smithi073 to 14912M 2024-08-31T05:16:40.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:40 smithi067 ceph-mon[17432]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:16:40.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:40 smithi067 ceph-mon[17432]: osd.3 [v2:172.21.15.73:6800/3773655535,v1:172.21.15.73:6801/3773655535] boot 2024-08-31T05:16:40.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:40 smithi067 ceph-mon[17432]: osdmap e26: 4 total, 4 up, 4 in 2024-08-31T05:16:40.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:40 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:16:40.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:40 smithi067 ceph-mon[17432]: osdmap e27: 4 total, 4 up, 4 in 2024-08-31T05:16:40.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.946+0000 7f9917519640 1 -- 172.21.15.73:0/2793069005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99100ff9c0 msgr2=0x7f99100ffdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:16:40.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.946+0000 7f9917519640 1 --2- 172.21.15.73:0/2793069005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99100ff9c0 0x7f99100ffdc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f990c009880 tx=0x7f990c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:16:40.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.946+0000 7f9917519640 1 -- 172.21.15.73:0/2793069005 shutdown_connections 2024-08-31T05:16:40.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.946+0000 7f9917519640 1 --2- 172.21.15.73:0/2793069005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99101029a0 0x7f9910102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:16:40.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.946+0000 7f9917519640 1 --2- 172.21.15.73:0/2793069005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99100ff9c0 0x7f99100ffdc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:16:40.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.946+0000 7f9917519640 1 -- 172.21.15.73:0/2793069005 >> 172.21.15.73:0/2793069005 conn(0x7f99100fb510 msgr2=0x7f99100fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:16:40.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.946+0000 7f9917519640 1 -- 172.21.15.73:0/2793069005 shutdown_connections 2024-08-31T05:16:40.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.946+0000 7f9917519640 1 -- 172.21.15.73:0/2793069005 wait complete. 2024-08-31T05:16:40.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.947+0000 7f9917519640 1 Processor -- start 2024-08-31T05:16:40.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.947+0000 7f9917519640 1 -- start start 2024-08-31T05:16:40.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.947+0000 7f9917519640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99100ff9c0 0x7f9910199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:16:40.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.947+0000 7f9917519640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99101029a0 0x7f99101999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:16:40.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.947+0000 7f9917519640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f991010a520 con 0x7f99100ff9c0 2024-08-31T05:16:40.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.947+0000 7f9917519640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f991010a3a0 con 0x7f99101029a0 2024-08-31T05:16:40.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.947+0000 7f9914ab4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99101029a0 0x7f99101999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:16:40.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.947+0000 7f9914ab4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99101029a0 0x7f99101999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51572/0 (socket says 172.21.15.73:51572) 2024-08-31T05:16:40.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.947+0000 7f9914ab4640 1 -- 172.21.15.73:0/1841491640 learned_addr learned my addr 172.21.15.73:0/1841491640 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-08-31T05:16:40.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.947+0000 7f99152b5640 1 --2- 172.21.15.73:0/1841491640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99100ff9c0 0x7f9910199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:16:40.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.947+0000 7f9914ab4640 1 -- 172.21.15.73:0/1841491640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99100ff9c0 msgr2=0x7f9910199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:16:40.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.947+0000 7f9914ab4640 1 --2- 172.21.15.73:0/1841491640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99100ff9c0 0x7f9910199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:16:40.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.947+0000 7f9914ab4640 1 -- 172.21.15.73:0/1841491640 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9910199f90 con 0x7f99101029a0 2024-08-31T05:16:40.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.948+0000 7f9914ab4640 1 --2- 172.21.15.73:0/1841491640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99101029a0 0x7f99101999a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f990000c8a0 tx=0x7f990000cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:16:40.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.948+0000 7f99067fc640 1 -- 172.21.15.73:0/1841491640 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f99000079b0 con 0x7f99101029a0 2024-08-31T05:16:40.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.948+0000 7f99067fc640 1 -- 172.21.15.73:0/1841491640 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9900007b50 con 0x7f99101029a0 2024-08-31T05:16:40.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.948+0000 7f99067fc640 1 -- 172.21.15.73:0/1841491640 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9900018700 con 0x7f99101029a0 2024-08-31T05:16:40.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.948+0000 7f9917519640 1 -- 172.21.15.73:0/1841491640 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f991019ea00 con 0x7f99101029a0 2024-08-31T05:16:40.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.948+0000 7f9917519640 1 -- 172.21.15.73:0/1841491640 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f991019ef60 con 0x7f99101029a0 2024-08-31T05:16:40.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.949+0000 7f9917519640 1 -- 172.21.15.73:0/1841491640 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99100ffdc0 con 0x7f99101029a0 2024-08-31T05:16:40.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.949+0000 7f99067fc640 1 -- 172.21.15.73:0/1841491640 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f9900007d00 con 0x7f99101029a0 2024-08-31T05:16:40.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.950+0000 7f99067fc640 1 --2- 172.21.15.73:0/1841491640 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f98fc06de30 0x7f98fc0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:16:40.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.950+0000 7f99067fc640 1 -- 172.21.15.73:0/1841491640 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3803+0+0 (secure 0 0 0) 0x7f990008d7f0 con 0x7f99101029a0 2024-08-31T05:16:40.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.950+0000 7f99152b5640 1 --2- 172.21.15.73:0/1841491640 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f98fc06de30 0x7f98fc0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:16:40.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.950+0000 7f99152b5640 1 --2- 172.21.15.73:0/1841491640 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f98fc06de30 0x7f98fc0702f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f990c000c00 tx=0x7f990c005a20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:16:40.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:40.954+0000 7f99067fc640 1 -- 172.21.15.73:0/1841491640 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9900014030 con 0x7f99101029a0 2024-08-31T05:16:41.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:16:41.131+0000 7f9917519640 1 -- 172.21.15.73:0/1841491640 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9910102140 con 0x7f98fc06de30 2024-08-31T05:16:41.649 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:41 smithi073 ceph-mon[24726]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:41.649 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:41 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T05:16:41.649 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:41 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T05:16:41.649 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:41 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:41.649 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:41 smithi073 ceph-mon[24726]: osdmap e28: 4 total, 4 up, 4 in 2024-08-31T05:16:41.649 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:41 smithi073 ceph-mon[24726]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:16:41.649 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:41 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:16:41.707 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:41 smithi067 ceph-mon[17432]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:41.707 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T05:16:41.707 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T05:16:41.707 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:41.708 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:41 smithi067 ceph-mon[17432]: osdmap e28: 4 total, 4 up, 4 in 2024-08-31T05:16:41.708 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:41 smithi067 ceph-mon[17432]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:16:41.708 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:16:43.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:43 smithi073 ceph-mon[24726]: osdmap e29: 4 total, 4 up, 4 in 2024-08-31T05:16:43.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:43 smithi073 ceph-mon[24726]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:16:43.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:43 smithi067 ceph-mon[17432]: osdmap e29: 4 total, 4 up, 4 in 2024-08-31T05:16:43.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:43 smithi067 ceph-mon[17432]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:16:44.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:44 smithi073 ceph-mon[24726]: osdmap e30: 4 total, 4 up, 4 in 2024-08-31T05:16:44.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:44 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/2186391483' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53d31201-7801-42d2-b4d5-cdaa89525353"}]: dispatch 2024-08-31T05:16:44.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:44 smithi073 ceph-mon[24726]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53d31201-7801-42d2-b4d5-cdaa89525353"}]: dispatch 2024-08-31T05:16:44.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:44 smithi073 ceph-mon[24726]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53d31201-7801-42d2-b4d5-cdaa89525353"}]': finished 2024-08-31T05:16:44.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:44 smithi073 ceph-mon[24726]: osdmap e31: 5 total, 4 up, 5 in 2024-08-31T05:16:44.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:44 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-31T05:16:44.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:44 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/4086140170' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T05:16:44.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:44 smithi067 ceph-mon[17432]: osdmap e30: 4 total, 4 up, 4 in 2024-08-31T05:16:44.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:44 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/2186391483' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53d31201-7801-42d2-b4d5-cdaa89525353"}]: dispatch 2024-08-31T05:16:44.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:44 smithi067 ceph-mon[17432]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53d31201-7801-42d2-b4d5-cdaa89525353"}]: dispatch 2024-08-31T05:16:44.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:44 smithi067 ceph-mon[17432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53d31201-7801-42d2-b4d5-cdaa89525353"}]': finished 2024-08-31T05:16:44.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:44 smithi067 ceph-mon[17432]: osdmap e31: 5 total, 4 up, 5 in 2024-08-31T05:16:44.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:44 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-31T05:16:44.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:44 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/4086140170' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T05:16:45.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:45 smithi073 ceph-mon[24726]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-31T05:16:45.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:45 smithi067 ceph-mon[17432]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-31T05:16:48.633 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:48 smithi073 ceph-mon[24726]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T05:16:48.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:48 smithi067 ceph-mon[17432]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T05:16:50.553 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:50 smithi073 ceph-mon[24726]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-31T05:16:50.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:50 smithi067 ceph-mon[17432]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-31T05:16:52.563 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:52 smithi073 ceph-mon[24726]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T05:16:52.563 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:52 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-31T05:16:52.563 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:52 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:52.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:52 smithi067 ceph-mon[17432]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T05:16:52.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-31T05:16:52.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:52 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:53.511 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:53 smithi073 ceph-mon[24726]: Deploying daemon osd.4 on smithi073 2024-08-31T05:16:53.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:53 smithi067 ceph-mon[17432]: Deploying daemon osd.4 on smithi073 2024-08-31T05:16:54.564 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:54 smithi073 ceph-mon[24726]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:16:54.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:54 smithi067 ceph-mon[17432]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:16:56.567 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:56 smithi073 ceph-mon[24726]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:16:56.567 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:56 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:16:56.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:56 smithi067 ceph-mon[17432]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:16:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:56 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:16:57.666 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:57 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:16:57.666 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:57 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:57.666 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:57 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:57.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:57 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:16:57.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:57 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:57.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:57 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:16:58.569 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:16:58 smithi073 ceph-mon[24726]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:16:58.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:16:58 smithi067 ceph-mon[17432]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:17:00.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:00 smithi073 ceph-mon[24726]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:17:00.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:00 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:00.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:00 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:00.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:00 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:00.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:00 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:17:00.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:00 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:00.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:00 smithi067 ceph-mon[17432]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:17:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:00 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:00 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:00 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:00 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:17:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:00 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:00.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:00.986+0000 7f99067fc640 1 -- 172.21.15.73:0/1841491640 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9910102140 con 0x7f98fc06de30 2024-08-31T05:17:00.988 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 4 on host 'smithi073' 2024-08-31T05:17:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:00.988+0000 7f9917519640 1 -- 172.21.15.73:0/1841491640 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f98fc06de30 msgr2=0x7f98fc0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:00.988+0000 7f9917519640 1 --2- 172.21.15.73:0/1841491640 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f98fc06de30 0x7f98fc0702f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f990c000c00 tx=0x7f990c005a20 comp rx=0 tx=0).stop 2024-08-31T05:17:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:00.988+0000 7f9917519640 1 -- 172.21.15.73:0/1841491640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99101029a0 msgr2=0x7f99101999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:00.988+0000 7f9917519640 1 --2- 172.21.15.73:0/1841491640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99101029a0 0x7f99101999a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f990000c8a0 tx=0x7f990000cd60 comp rx=0 tx=0).stop 2024-08-31T05:17:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:00.988+0000 7f9917519640 1 -- 172.21.15.73:0/1841491640 shutdown_connections 2024-08-31T05:17:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:00.988+0000 7f9917519640 1 --2- 172.21.15.73:0/1841491640 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f98fc06de30 0x7f98fc0702f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:00.988+0000 7f9917519640 1 --2- 172.21.15.73:0/1841491640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99101029a0 0x7f99101999a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:00.988+0000 7f9917519640 1 --2- 172.21.15.73:0/1841491640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99100ff9c0 0x7f9910199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:00.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:00.988+0000 7f9917519640 1 -- 172.21.15.73:0/1841491640 >> 172.21.15.73:0/1841491640 conn(0x7f99100fb510 msgr2=0x7f9910100a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:00.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:00.988+0000 7f9917519640 1 -- 172.21.15.73:0/1841491640 shutdown_connections 2024-08-31T05:17:00.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:00.988+0000 7f9917519640 1 -- 172.21.15.73:0/1841491640 wait complete. 2024-08-31T05:17:01.594 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:01 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:17:01.594 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:01 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:01.594 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:01 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:01.621 DEBUG:teuthology.orchestra.run.smithi073:osd.4> sudo journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.4.service 2024-08-31T05:17:01.623 INFO:tasks.cephadm:Deploying osd.5 on smithi073 with /dev/vg_nvme/lv_2... 2024-08-31T05:17:01.623 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T05:17:01.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:01 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:17:01.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:01 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:01.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:01 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:02.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:02 smithi073 ceph-mon[24726]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:17:02.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:02 smithi067 ceph-mon[17432]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:17:02.860 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi073/config 2024-08-31T05:17:03.695 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:17:03 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[37439]: 2024-08-31T05:17:03.433+0000 7f63b764a640 -1 osd.4 0 log_to_monitors true 2024-08-31T05:17:04.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:04 smithi073 ceph-mon[24726]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:17:04.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:04 smithi073 ceph-mon[24726]: from='osd.4 [v2:172.21.15.73:6808/411912217,v1:172.21.15.73:6809/411912217]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-31T05:17:04.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:04 smithi073 ceph-mon[24726]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-31T05:17:04.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:04 smithi067 ceph-mon[17432]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:17:04.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:04 smithi067 ceph-mon[17432]: from='osd.4 [v2:172.21.15.73:6808/411912217,v1:172.21.15.73:6809/411912217]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-31T05:17:04.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:04 smithi067 ceph-mon[17432]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-31T05:17:05.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:05 smithi073 ceph-mon[24726]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T05:17:05.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:05 smithi073 ceph-mon[24726]: osdmap e32: 5 total, 4 up, 5 in 2024-08-31T05:17:05.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:05 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-31T05:17:05.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:05 smithi073 ceph-mon[24726]: from='osd.4 [v2:172.21.15.73:6808/411912217,v1:172.21.15.73:6809/411912217]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-08-31T05:17:05.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:05 smithi073 ceph-mon[24726]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-08-31T05:17:05.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:05 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:05.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:05 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:05.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:05 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:17:05.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:05 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:17:05.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:05 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:05.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:05 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:05.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:05 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:17:05.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:05 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:05.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:05 smithi067 ceph-mon[17432]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T05:17:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:05 smithi067 ceph-mon[17432]: osdmap e32: 5 total, 4 up, 5 in 2024-08-31T05:17:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:05 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-31T05:17:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:05 smithi067 ceph-mon[17432]: from='osd.4 [v2:172.21.15.73:6808/411912217,v1:172.21.15.73:6809/411912217]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-08-31T05:17:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:05 smithi067 ceph-mon[17432]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-08-31T05:17:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:05 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:05 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:05 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:17:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:05 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:17:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:05 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:05 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:05 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:17:05.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:05 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:06.621 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:17:06 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[37439]: 2024-08-31T05:17:06.228+0000 7f63b2daa640 -1 osd.4 0 waiting for initial osdmap 2024-08-31T05:17:06.621 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:17:06 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[37439]: 2024-08-31T05:17:06.238+0000 7f63ab3dc640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:17:06.621 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:06 smithi073 ceph-mon[24726]: Detected new or changed devices on smithi073 2024-08-31T05:17:06.621 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:06 smithi073 ceph-mon[24726]: Adjusting osd_memory_target on smithi073 to 7456M 2024-08-31T05:17:06.621 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:06 smithi073 ceph-mon[24726]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:17:06.621 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:06 smithi073 ceph-mon[24726]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-08-31T05:17:06.621 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:06 smithi073 ceph-mon[24726]: osdmap e33: 5 total, 4 up, 5 in 2024-08-31T05:17:06.622 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-31T05:17:06.622 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:06 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-31T05:17:06.622 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:06 smithi073 ceph-mon[24726]: from='osd.4 ' entity='osd.4' 2024-08-31T05:17:06.624 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-08-31T05:17:06.649 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi073:vg_nvme/lv_2 2024-08-31T05:17:06.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:06 smithi067 ceph-mon[17432]: Detected new or changed devices on smithi073 2024-08-31T05:17:06.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:06 smithi067 ceph-mon[17432]: Adjusting osd_memory_target on smithi073 to 7456M 2024-08-31T05:17:06.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:06 smithi067 ceph-mon[17432]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:17:06.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:06 smithi067 ceph-mon[17432]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-08-31T05:17:06.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:06 smithi067 ceph-mon[17432]: osdmap e33: 5 total, 4 up, 5 in 2024-08-31T05:17:06.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:06 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-31T05:17:06.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:06 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-31T05:17:06.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:06 smithi067 ceph-mon[17432]: from='osd.4 ' entity='osd.4' 2024-08-31T05:17:06.894 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi073/config 2024-08-31T05:17:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.397+0000 7fe181783640 1 -- 172.21.15.73:0/2161484456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c101800 msgr2=0x7fe17c101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.397+0000 7fe181783640 1 --2- 172.21.15.73:0/2161484456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c101800 0x7fe17c101c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe164009880 tx=0x7fe16402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.397+0000 7fe181783640 1 -- 172.21.15.73:0/2161484456 shutdown_connections 2024-08-31T05:17:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.397+0000 7fe181783640 1 --2- 172.21.15.73:0/2161484456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c101800 0x7fe17c101c80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.397+0000 7fe181783640 1 --2- 172.21.15.73:0/2161484456 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe17c100600 0x7fe17c100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.397+0000 7fe181783640 1 -- 172.21.15.73:0/2161484456 >> 172.21.15.73:0/2161484456 conn(0x7fe17c0fbdb0 msgr2=0x7fe17c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.397+0000 7fe181783640 1 -- 172.21.15.73:0/2161484456 shutdown_connections 2024-08-31T05:17:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.397+0000 7fe181783640 1 -- 172.21.15.73:0/2161484456 wait complete. 2024-08-31T05:17:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.398+0000 7fe181783640 1 Processor -- start 2024-08-31T05:17:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.398+0000 7fe181783640 1 -- start start 2024-08-31T05:17:07.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.398+0000 7fe181783640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c100600 0x7fe17c06aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.398+0000 7fe181783640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe17c101800 0x7fe17c19bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.398+0000 7fe181783640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe17c109440 con 0x7fe17c101800 2024-08-31T05:17:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.398+0000 7fe181783640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe17c1092c0 con 0x7fe17c100600 2024-08-31T05:17:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.398+0000 7fe17affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c100600 0x7fe17c06aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.398+0000 7fe17affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c100600 0x7fe17c06aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50350/0 (socket says 172.21.15.73:50350) 2024-08-31T05:17:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.398+0000 7fe17affd640 1 -- 172.21.15.73:0/2661554515 learned_addr learned my addr 172.21.15.73:0/2661554515 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-08-31T05:17:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.398+0000 7fe17a7fc640 1 --2- 172.21.15.73:0/2661554515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe17c101800 0x7fe17c19bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.398+0000 7fe17affd640 1 -- 172.21.15.73:0/2661554515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe17c101800 msgr2=0x7fe17c19bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.398+0000 7fe17affd640 1 --2- 172.21.15.73:0/2661554515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe17c101800 0x7fe17c19bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.398+0000 7fe17affd640 1 -- 172.21.15.73:0/2661554515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17c19c5a0 con 0x7fe17c100600 2024-08-31T05:17:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.398+0000 7fe17a7fc640 1 --2- 172.21.15.73:0/2661554515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe17c101800 0x7fe17c19bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:17:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.399+0000 7fe17affd640 1 --2- 172.21.15.73:0/2661554515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c100600 0x7fe17c06aa40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00c920 tx=0x7fe16c00cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.399+0000 7fe173fff640 1 -- 172.21.15.73:0/2661554515 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe16c004020 con 0x7fe17c100600 2024-08-31T05:17:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.399+0000 7fe173fff640 1 -- 172.21.15.73:0/2661554515 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe16c0041c0 con 0x7fe17c100600 2024-08-31T05:17:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.399+0000 7fe181783640 1 -- 172.21.15.73:0/2661554515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe17c19c890 con 0x7fe17c100600 2024-08-31T05:17:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.399+0000 7fe173fff640 1 -- 172.21.15.73:0/2661554515 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe16c0047a0 con 0x7fe17c100600 2024-08-31T05:17:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.399+0000 7fe181783640 1 -- 172.21.15.73:0/2661554515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17c19ce20 con 0x7fe17c100600 2024-08-31T05:17:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.400+0000 7fe181783640 1 -- 172.21.15.73:0/2661554515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe17c100a00 con 0x7fe17c100600 2024-08-31T05:17:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.400+0000 7fe173fff640 1 -- 172.21.15.73:0/2661554515 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fe16c0079b0 con 0x7fe17c100600 2024-08-31T05:17:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.401+0000 7fe173fff640 1 --2- 172.21.15.73:0/2661554515 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe16806de30 0x7fe1680702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.401+0000 7fe173fff640 1 -- 172.21.15.73:0/2661554515 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4206+0+0 (secure 0 0 0) 0x7fe16c08d5c0 con 0x7fe17c100600 2024-08-31T05:17:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.401+0000 7fe17a7fc640 1 --2- 172.21.15.73:0/2661554515 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe16806de30 0x7fe1680702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:07.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.402+0000 7fe17a7fc640 1 --2- 172.21.15.73:0/2661554515 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe16806de30 0x7fe1680702f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1640096c0 tx=0x7fe164009650 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:07.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.405+0000 7fe173fff640 1 -- 172.21.15.73:0/2661554515 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe16c014030 con 0x7fe17c100600 2024-08-31T05:17:07.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:07.582+0000 7fe181783640 1 -- 172.21.15.73:0/2661554515 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe17c0623d0 con 0x7fe16806de30 2024-08-31T05:17:07.585 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:07 smithi073 ceph-mon[24726]: purged_snaps scrub starts 2024-08-31T05:17:07.585 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:07 smithi073 ceph-mon[24726]: purged_snaps scrub ok 2024-08-31T05:17:07.585 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:07 smithi073 ceph-mon[24726]: osd.4 [v2:172.21.15.73:6808/411912217,v1:172.21.15.73:6809/411912217] boot 2024-08-31T05:17:07.585 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:07 smithi073 ceph-mon[24726]: osdmap e34: 5 total, 5 up, 5 in 2024-08-31T05:17:07.585 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:07 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-31T05:17:07.585 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:07 smithi073 ceph-mon[24726]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:17:07.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:07 smithi067 ceph-mon[17432]: purged_snaps scrub starts 2024-08-31T05:17:07.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:07 smithi067 ceph-mon[17432]: purged_snaps scrub ok 2024-08-31T05:17:07.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:07 smithi067 ceph-mon[17432]: osd.4 [v2:172.21.15.73:6808/411912217,v1:172.21.15.73:6809/411912217] boot 2024-08-31T05:17:07.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:07 smithi067 ceph-mon[17432]: osdmap e34: 5 total, 5 up, 5 in 2024-08-31T05:17:07.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:07 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-31T05:17:07.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:07 smithi067 ceph-mon[17432]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:17:08.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:08 smithi073 ceph-mon[24726]: osdmap e35: 5 total, 5 up, 5 in 2024-08-31T05:17:08.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:08 smithi073 ceph-mon[24726]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:08.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:08 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T05:17:08.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:08 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T05:17:08.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:08 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:08.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:08 smithi067 ceph-mon[17432]: osdmap e35: 5 total, 5 up, 5 in 2024-08-31T05:17:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:08 smithi067 ceph-mon[17432]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:08 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T05:17:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:08 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T05:17:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:08 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:09.545 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:09 smithi073 ceph-mon[24726]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 551 MiB used, 446 GiB / 447 GiB avail 2024-08-31T05:17:09.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:09 smithi067 ceph-mon[17432]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 551 MiB used, 446 GiB / 447 GiB avail 2024-08-31T05:17:10.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:10 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/1198253309' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c41359a-c1da-444b-afcc-eb0d8eb017ec"}]: dispatch 2024-08-31T05:17:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:10 smithi073 ceph-mon[24726]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c41359a-c1da-444b-afcc-eb0d8eb017ec"}]: dispatch 2024-08-31T05:17:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:10 smithi073 ceph-mon[24726]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c41359a-c1da-444b-afcc-eb0d8eb017ec"}]': finished 2024-08-31T05:17:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:10 smithi073 ceph-mon[24726]: osdmap e36: 6 total, 5 up, 6 in 2024-08-31T05:17:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:10 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:17:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:10 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/839605848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T05:17:10.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:10 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/1198253309' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c41359a-c1da-444b-afcc-eb0d8eb017ec"}]: dispatch 2024-08-31T05:17:10.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:10 smithi067 ceph-mon[17432]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c41359a-c1da-444b-afcc-eb0d8eb017ec"}]: dispatch 2024-08-31T05:17:10.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:10 smithi067 ceph-mon[17432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c41359a-c1da-444b-afcc-eb0d8eb017ec"}]': finished 2024-08-31T05:17:10.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:10 smithi067 ceph-mon[17432]: osdmap e36: 6 total, 5 up, 6 in 2024-08-31T05:17:10.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:10 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:17:10.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:10 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/839605848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T05:17:11.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:11 smithi073 ceph-mon[24726]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 551 MiB used, 446 GiB / 447 GiB avail 2024-08-31T05:17:11.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:17:11.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:11 smithi067 ceph-mon[17432]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 551 MiB used, 446 GiB / 447 GiB avail 2024-08-31T05:17:11.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:17:14.679 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:14 smithi073 ceph-mon[24726]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:14.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:14 smithi067 ceph-mon[17432]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:16.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:16 smithi073 ceph-mon[24726]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:16.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:16 smithi067 ceph-mon[17432]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:18.619 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:18 smithi073 ceph-mon[24726]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:18.619 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:18 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-31T05:17:18.619 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:18 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:18.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:18 smithi067 ceph-mon[17432]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:18.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:18 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-31T05:17:18.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:18 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:19.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:19 smithi073 ceph-mon[24726]: Deploying daemon osd.5 on smithi073 2024-08-31T05:17:19.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:19 smithi067 ceph-mon[17432]: Deploying daemon osd.5 on smithi073 2024-08-31T05:17:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:20 smithi073 ceph-mon[24726]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:20.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:20 smithi067 ceph-mon[17432]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:22.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:22 smithi067 ceph-mon[17432]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:22.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:22 smithi073 ceph-mon[24726]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:24.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:24 smithi073 ceph-mon[24726]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:17:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:24.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:24.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:24 smithi067 ceph-mon[17432]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:24.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:17:24.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:24.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:26.618 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:26 smithi073 ceph-mon[24726]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:26.618 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:26 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:17:26.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:26 smithi067 ceph-mon[17432]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:26.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:26 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:17:27.694 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 5 on host 'smithi073' 2024-08-31T05:17:27.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:27.692+0000 7fe173fff640 1 -- 172.21.15.73:0/2661554515 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe17c0623d0 con 0x7fe16806de30 2024-08-31T05:17:27.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:27.694+0000 7fe181783640 1 -- 172.21.15.73:0/2661554515 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe16806de30 msgr2=0x7fe1680702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:27.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:27.694+0000 7fe181783640 1 --2- 172.21.15.73:0/2661554515 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe16806de30 0x7fe1680702f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1640096c0 tx=0x7fe164009650 comp rx=0 tx=0).stop 2024-08-31T05:17:27.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:27.694+0000 7fe181783640 1 -- 172.21.15.73:0/2661554515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c100600 msgr2=0x7fe17c06aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:27.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:27.694+0000 7fe181783640 1 --2- 172.21.15.73:0/2661554515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c100600 0x7fe17c06aa40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00c920 tx=0x7fe16c00cde0 comp rx=0 tx=0).stop 2024-08-31T05:17:27.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:27.694+0000 7fe181783640 1 -- 172.21.15.73:0/2661554515 shutdown_connections 2024-08-31T05:17:27.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:27.694+0000 7fe181783640 1 --2- 172.21.15.73:0/2661554515 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe16806de30 0x7fe1680702f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:27.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:27.694+0000 7fe181783640 1 --2- 172.21.15.73:0/2661554515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe17c101800 0x7fe17c19bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:27.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:27.694+0000 7fe181783640 1 --2- 172.21.15.73:0/2661554515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c100600 0x7fe17c06aa40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:27.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:27.694+0000 7fe181783640 1 -- 172.21.15.73:0/2661554515 >> 172.21.15.73:0/2661554515 conn(0x7fe17c0fbdb0 msgr2=0x7fe17c104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:27.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:27.694+0000 7fe181783640 1 -- 172.21.15.73:0/2661554515 shutdown_connections 2024-08-31T05:17:27.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:27.694+0000 7fe181783640 1 -- 172.21.15.73:0/2661554515 wait complete. 2024-08-31T05:17:28.296 DEBUG:teuthology.orchestra.run.smithi073:osd.5> sudo journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.5.service 2024-08-31T05:17:28.299 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-08-31T05:17:28.299 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T05:17:28.569 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:28.689 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:28 smithi067 ceph-mon[17432]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:28.689 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:28 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:28.689 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:28 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:28.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:28 smithi073 ceph-mon[24726]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:28.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:28 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:28.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:28 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:29.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.065+0000 7f448864d640 1 -- 172.21.15.67:0/3814923554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4480101800 msgr2=0x7f4480101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:29.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.065+0000 7f448864d640 1 --2- 172.21.15.67:0/3814923554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4480101800 0x7f4480101c80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4470009880 tx=0x7f447002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:29.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.065+0000 7f448864d640 1 -- 172.21.15.67:0/3814923554 shutdown_connections 2024-08-31T05:17:29.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.065+0000 7f448864d640 1 --2- 172.21.15.67:0/3814923554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4480101800 0x7f4480101c80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:29.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.065+0000 7f448864d640 1 --2- 172.21.15.67:0/3814923554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4480100600 0x7f4480100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:29.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.065+0000 7f448864d640 1 -- 172.21.15.67:0/3814923554 >> 172.21.15.67:0/3814923554 conn(0x7f44800fbdb0 msgr2=0x7f44800fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:29.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.065+0000 7f448864d640 1 -- 172.21.15.67:0/3814923554 shutdown_connections 2024-08-31T05:17:29.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.065+0000 7f448864d640 1 -- 172.21.15.67:0/3814923554 wait complete. 2024-08-31T05:17:29.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f448864d640 1 Processor -- start 2024-08-31T05:17:29.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f448864d640 1 -- start start 2024-08-31T05:17:29.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f448864d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4480100600 0x7f448006a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:29.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f448864d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4480101800 0x7f448019e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:29.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f448864d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4480109440 con 0x7f4480100600 2024-08-31T05:17:29.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f448864d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f44801092c0 con 0x7f4480101800 2024-08-31T05:17:29.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f44863e9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4480100600 0x7f448006a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:29.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f44863e9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4480100600 0x7f448006a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35692/0 (socket says 172.21.15.67:35692) 2024-08-31T05:17:29.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f44863e9640 1 -- 172.21.15.67:0/1743081994 learned_addr learned my addr 172.21.15.67:0/1743081994 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:29.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f4485be8640 1 --2- 172.21.15.67:0/1743081994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4480101800 0x7f448019e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:29.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f44863e9640 1 -- 172.21.15.67:0/1743081994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4480101800 msgr2=0x7f448019e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:29.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f44863e9640 1 --2- 172.21.15.67:0/1743081994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4480101800 0x7f448019e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:29.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f44863e9640 1 -- 172.21.15.67:0/1743081994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448019e920 con 0x7f4480100600 2024-08-31T05:17:29.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f4485be8640 1 --2- 172.21.15.67:0/1743081994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4480101800 0x7f448019e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:17:29.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.066+0000 7f44863e9640 1 --2- 172.21.15.67:0/1743081994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4480100600 0x7f448006a530 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f447c00d8d0 tx=0x7f447c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:29.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.067+0000 7f44777fe640 1 -- 172.21.15.67:0/1743081994 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f447c017070 con 0x7f4480100600 2024-08-31T05:17:29.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.067+0000 7f448864d640 1 -- 172.21.15.67:0/1743081994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448019eaf0 con 0x7f4480100600 2024-08-31T05:17:29.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.067+0000 7f44777fe640 1 -- 172.21.15.67:0/1743081994 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f447c00be10 con 0x7f4480100600 2024-08-31T05:17:29.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.067+0000 7f44777fe640 1 -- 172.21.15.67:0/1743081994 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f447c00f3c0 con 0x7f4480100600 2024-08-31T05:17:29.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.067+0000 7f448864d640 1 -- 172.21.15.67:0/1743081994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f448019f020 con 0x7f4480100600 2024-08-31T05:17:29.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.068+0000 7f448864d640 1 -- 172.21.15.67:0/1743081994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4480109c20 con 0x7f4480100600 2024-08-31T05:17:29.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.068+0000 7f44777fe640 1 -- 172.21.15.67:0/1743081994 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f447c01a070 con 0x7f4480100600 2024-08-31T05:17:29.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.069+0000 7f44777fe640 1 --2- 172.21.15.67:0/1743081994 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f446c06de80 0x7f446c070340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:29.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.069+0000 7f4485be8640 1 --2- 172.21.15.67:0/1743081994 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f446c06de80 0x7f446c070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:29.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.069+0000 7f44777fe640 1 -- 172.21.15.67:0/1743081994 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4321+0+0 (secure 0 0 0) 0x7f447c08d300 con 0x7f4480100600 2024-08-31T05:17:29.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.069+0000 7f4485be8640 1 --2- 172.21.15.67:0/1743081994 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f446c06de80 0x7f446c070340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f448006a2b0 tx=0x7f4470005a20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:29.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.074+0000 7f44777fe640 1 -- 172.21.15.67:0/1743081994 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f447c05b300 con 0x7f4480100600 2024-08-31T05:17:29.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.249+0000 7f448864d640 1 -- 172.21.15.67:0/1743081994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4480062b90 con 0x7f4480100600 2024-08-31T05:17:29.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.249+0000 7f44777fe640 1 -- 172.21.15.67:0/1743081994 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) ==== 74+0+130 (secure 0 0 0) 0x7f447c08d030 con 0x7f4480100600 2024-08-31T05:17:29.251 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:17:29.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.251+0000 7f448864d640 1 -- 172.21.15.67:0/1743081994 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f446c06de80 msgr2=0x7f446c070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:29.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.251+0000 7f448864d640 1 --2- 172.21.15.67:0/1743081994 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f446c06de80 0x7f446c070340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f448006a2b0 tx=0x7f4470005a20 comp rx=0 tx=0).stop 2024-08-31T05:17:29.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.251+0000 7f448864d640 1 -- 172.21.15.67:0/1743081994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4480100600 msgr2=0x7f448006a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:29.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.251+0000 7f448864d640 1 --2- 172.21.15.67:0/1743081994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4480100600 0x7f448006a530 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f447c00d8d0 tx=0x7f447c00dd90 comp rx=0 tx=0).stop 2024-08-31T05:17:29.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.251+0000 7f448864d640 1 -- 172.21.15.67:0/1743081994 shutdown_connections 2024-08-31T05:17:29.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.251+0000 7f448864d640 1 --2- 172.21.15.67:0/1743081994 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f446c06de80 0x7f446c070340 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:29.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.251+0000 7f448864d640 1 --2- 172.21.15.67:0/1743081994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4480101800 0x7f448019e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:29.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.251+0000 7f448864d640 1 --2- 172.21.15.67:0/1743081994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4480100600 0x7f448006a530 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:29.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.251+0000 7f448864d640 1 -- 172.21.15.67:0/1743081994 >> 172.21.15.67:0/1743081994 conn(0x7f44800fbdb0 msgr2=0x7f4480104d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:29.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.252+0000 7f448864d640 1 -- 172.21.15.67:0/1743081994 shutdown_connections 2024-08-31T05:17:29.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:29.252+0000 7f448864d640 1 -- 172.21.15.67:0/1743081994 wait complete. 2024-08-31T05:17:29.605 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:29 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:29.605 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:29 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:29.605 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:29 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1743081994' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-31T05:17:29.605 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:29 smithi073 ceph-mon[24726]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:29.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:29 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:29.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:29 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:29.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:29 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1743081994' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-31T05:17:29.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:29 smithi067 ceph-mon[17432]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:29.943 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1725081426,"num_in_osds":6,"osd_in_since":1725081429,"num_remapped_pgs":0} 2024-08-31T05:17:29.946 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:17:29 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[44370]: 2024-08-31T05:17:29.701+0000 7f28c48a8640 -1 osd.5 0 log_to_monitors true 2024-08-31T05:17:30.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:30 smithi067 ceph-mon[17432]: from='osd.5 [v2:172.21.15.73:6816/2922014039,v1:172.21.15.73:6817/2922014039]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-31T05:17:30.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:30 smithi067 ceph-mon[17432]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-31T05:17:30.945 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T05:17:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:30 smithi073 ceph-mon[24726]: from='osd.5 [v2:172.21.15.73:6816/2922014039,v1:172.21.15.73:6817/2922014039]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-31T05:17:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:30 smithi073 ceph-mon[24726]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-31T05:17:31.214 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:31.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:31 smithi067 ceph-mon[17432]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T05:17:31.642 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:31 smithi067 ceph-mon[17432]: from='osd.5 [v2:172.21.15.73:6816/2922014039,v1:172.21.15.73:6817/2922014039]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-08-31T05:17:31.642 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:31 smithi067 ceph-mon[17432]: osdmap e37: 6 total, 5 up, 6 in 2024-08-31T05:17:31.642 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:31 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:17:31.642 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:31 smithi067 ceph-mon[17432]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-08-31T05:17:31.642 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:31 smithi067 ceph-mon[17432]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:31.642 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:31 smithi067 ceph-mon[17432]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-08-31T05:17:31.642 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:31 smithi067 ceph-mon[17432]: osdmap e38: 6 total, 5 up, 6 in 2024-08-31T05:17:31.642 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:31 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:17:31.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.645+0000 7f89b8cec640 1 -- 172.21.15.67:0/2615442956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4104ac0 msgr2=0x7f89b4106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:31.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.645+0000 7f89b8cec640 1 --2- 172.21.15.67:0/2615442956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4104ac0 0x7f89b4106eb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f899c0098b0 tx=0x7f899c02a4d0 comp rx=0 tx=0).stop 2024-08-31T05:17:31.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.645+0000 7f89b8cec640 1 -- 172.21.15.67:0/2615442956 shutdown_connections 2024-08-31T05:17:31.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.645+0000 7f89b8cec640 1 --2- 172.21.15.67:0/2615442956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4104ac0 0x7f89b4106eb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:31.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.645+0000 7f89b8cec640 1 --2- 172.21.15.67:0/2615442956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89b4102190 0x7f89b4104580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:31.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.645+0000 7f89b8cec640 1 -- 172.21.15.67:0/2615442956 >> 172.21.15.67:0/2615442956 conn(0x7f89b40fbdb0 msgr2=0x7f89b40fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:31.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.645+0000 7f89b8cec640 1 -- 172.21.15.67:0/2615442956 shutdown_connections 2024-08-31T05:17:31.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.645+0000 7f89b8cec640 1 -- 172.21.15.67:0/2615442956 wait complete. 2024-08-31T05:17:31.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.646+0000 7f89b8cec640 1 Processor -- start 2024-08-31T05:17:31.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.646+0000 7f89b8cec640 1 -- start start 2024-08-31T05:17:31.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.646+0000 7f89b8cec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89b4102190 0x7f89b4101a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:31.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.646+0000 7f89b8cec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4104ac0 0x7f89b4100140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:31.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.646+0000 7f89b8cec640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f89b410a550 con 0x7f89b4104ac0 2024-08-31T05:17:31.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.646+0000 7f89b8cec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f89b410a3d0 con 0x7f89b4102190 2024-08-31T05:17:31.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.646+0000 7f89abfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4104ac0 0x7f89b4100140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:31.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.646+0000 7f89abfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4104ac0 0x7f89b4100140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35724/0 (socket says 172.21.15.67:35724) 2024-08-31T05:17:31.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.646+0000 7f89b259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89b4102190 0x7f89b4101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:31.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.646+0000 7f89abfff640 1 -- 172.21.15.67:0/2543252313 learned_addr learned my addr 172.21.15.67:0/2543252313 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:31.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.647+0000 7f89abfff640 1 -- 172.21.15.67:0/2543252313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89b4102190 msgr2=0x7f89b4101a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:31.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.647+0000 7f89abfff640 1 --2- 172.21.15.67:0/2543252313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89b4102190 0x7f89b4101a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:31.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.647+0000 7f89abfff640 1 -- 172.21.15.67:0/2543252313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b4100680 con 0x7f89b4104ac0 2024-08-31T05:17:31.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.647+0000 7f89b259c640 1 --2- 172.21.15.67:0/2543252313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89b4102190 0x7f89b4101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:17:31.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.647+0000 7f89abfff640 1 --2- 172.21.15.67:0/2543252313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4104ac0 0x7f89b4100140 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f899c009230 tx=0x7f899c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:31.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.647+0000 7f89ab7fe640 1 -- 172.21.15.67:0/2543252313 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f899c03f070 con 0x7f89b4104ac0 2024-08-31T05:17:31.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.647+0000 7f89b8cec640 1 -- 172.21.15.67:0/2543252313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89b4100910 con 0x7f89b4104ac0 2024-08-31T05:17:31.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.647+0000 7f89ab7fe640 1 -- 172.21.15.67:0/2543252313 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f899c0049d0 con 0x7f89b4104ac0 2024-08-31T05:17:31.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.647+0000 7f89ab7fe640 1 -- 172.21.15.67:0/2543252313 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f899c035030 con 0x7f89b4104ac0 2024-08-31T05:17:31.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.647+0000 7f89b8cec640 1 -- 172.21.15.67:0/2543252313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b4100e40 con 0x7f89b4104ac0 2024-08-31T05:17:31.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.648+0000 7f89b8cec640 1 -- 172.21.15.67:0/2543252313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89b4102570 con 0x7f89b4104ac0 2024-08-31T05:17:31.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.649+0000 7f89ab7fe640 1 -- 172.21.15.67:0/2543252313 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f899c042070 con 0x7f89b4104ac0 2024-08-31T05:17:31.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.649+0000 7f89ab7fe640 1 --2- 172.21.15.67:0/2543252313 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f89a006de30 0x7f89a00702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:31.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.649+0000 7f89ab7fe640 1 -- 172.21.15.67:0/2543252313 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4358+0+0 (secure 0 0 0) 0x7f899c0ae160 con 0x7f89b4104ac0 2024-08-31T05:17:31.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.649+0000 7f89b259c640 1 --2- 172.21.15.67:0/2543252313 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f89a006de30 0x7f89a00702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:31.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.650+0000 7f89b259c640 1 --2- 172.21.15.67:0/2543252313 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f89a006de30 0x7f89a00702f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009fc0 tx=0x7f89a4005f90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:31.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.654+0000 7f89ab7fe640 1 -- 172.21.15.67:0/2543252313 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f899c07fe00 con 0x7f89b4104ac0 2024-08-31T05:17:31.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.828+0000 7f89b8cec640 1 -- 172.21.15.67:0/2543252313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f89b419f920 con 0x7f89b4104ac0 2024-08-31T05:17:31.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.828+0000 7f89ab7fe640 1 -- 172.21.15.67:0/2543252313 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) ==== 74+0+130 (secure 0 0 0) 0x7f899c084630 con 0x7f89b4104ac0 2024-08-31T05:17:31.830 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:17:31.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.830+0000 7f89b8cec640 1 -- 172.21.15.67:0/2543252313 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f89a006de30 msgr2=0x7f89a00702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:31.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.830+0000 7f89b8cec640 1 --2- 172.21.15.67:0/2543252313 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f89a006de30 0x7f89a00702f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009fc0 tx=0x7f89a4005f90 comp rx=0 tx=0).stop 2024-08-31T05:17:31.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.830+0000 7f89b8cec640 1 -- 172.21.15.67:0/2543252313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4104ac0 msgr2=0x7f89b4100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:31.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.830+0000 7f89b8cec640 1 --2- 172.21.15.67:0/2543252313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4104ac0 0x7f89b4100140 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f899c009230 tx=0x7f899c0045e0 comp rx=0 tx=0).stop 2024-08-31T05:17:31.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.830+0000 7f89b8cec640 1 -- 172.21.15.67:0/2543252313 shutdown_connections 2024-08-31T05:17:31.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.830+0000 7f89b8cec640 1 --2- 172.21.15.67:0/2543252313 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f89a006de30 0x7f89a00702f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:31.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.830+0000 7f89b8cec640 1 --2- 172.21.15.67:0/2543252313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4104ac0 0x7f89b4100140 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:31.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.830+0000 7f89b8cec640 1 --2- 172.21.15.67:0/2543252313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89b4102190 0x7f89b4101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:31.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.830+0000 7f89b8cec640 1 -- 172.21.15.67:0/2543252313 >> 172.21.15.67:0/2543252313 conn(0x7f89b40fbdb0 msgr2=0x7f89b40fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:31.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.830+0000 7f89b8cec640 1 -- 172.21.15.67:0/2543252313 shutdown_connections 2024-08-31T05:17:31.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:31.830+0000 7f89b8cec640 1 -- 172.21.15.67:0/2543252313 wait complete. 2024-08-31T05:17:31.840 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:17:31 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[44370]: 2024-08-31T05:17:31.532+0000 7f28c0008640 -1 osd.5 0 waiting for initial osdmap 2024-08-31T05:17:31.840 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:17:31 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[44370]: 2024-08-31T05:17:31.540+0000 7f28bc642640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:17:31.841 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:31 smithi073 ceph-mon[24726]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T05:17:31.841 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:31 smithi073 ceph-mon[24726]: from='osd.5 [v2:172.21.15.73:6816/2922014039,v1:172.21.15.73:6817/2922014039]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-08-31T05:17:31.841 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:31 smithi073 ceph-mon[24726]: osdmap e37: 6 total, 5 up, 6 in 2024-08-31T05:17:31.841 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:31 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:17:31.841 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:31 smithi073 ceph-mon[24726]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2024-08-31T05:17:31.841 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:31 smithi073 ceph-mon[24726]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:31.841 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:31 smithi073 ceph-mon[24726]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-08-31T05:17:31.841 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:31 smithi073 ceph-mon[24726]: osdmap e38: 6 total, 5 up, 6 in 2024-08-31T05:17:31.841 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:31 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:17:32.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:17:32.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2543252313' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-31T05:17:32.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: Detected new or changed devices on smithi073 2024-08-31T05:17:32.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:32.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:32.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:17:32.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:17:32.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:17:32.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: Adjusting osd_memory_target on smithi073 to 4970M 2024-08-31T05:17:32.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:32.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:32.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:17:32.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:32.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:17:32.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:32.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:17:32.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:32.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:17:32.657 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1725081426,"num_in_osds":6,"osd_in_since":1725081429,"num_remapped_pgs":0} 2024-08-31T05:17:32.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:17:32.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2543252313' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-31T05:17:32.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: Detected new or changed devices on smithi073 2024-08-31T05:17:32.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:32.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:32.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:17:32.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:17:32.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:17:32.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: Adjusting osd_memory_target on smithi073 to 4970M 2024-08-31T05:17:32.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:32.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:32.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:17:32.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:32.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:17:32.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:32.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:17:32.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:17:32.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:17:33.658 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T05:17:33.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:33 smithi067 ceph-mon[17432]: purged_snaps scrub starts 2024-08-31T05:17:33.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:33 smithi067 ceph-mon[17432]: purged_snaps scrub ok 2024-08-31T05:17:33.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:33 smithi067 ceph-mon[17432]: osd.5 [v2:172.21.15.73:6816/2922014039,v1:172.21.15.73:6817/2922014039] boot 2024-08-31T05:17:33.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:33 smithi067 ceph-mon[17432]: osdmap e39: 6 total, 6 up, 6 in 2024-08-31T05:17:33.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:33 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:17:33.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:33 smithi067 ceph-mon[17432]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:33.923 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:33.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:33 smithi073 ceph-mon[24726]: purged_snaps scrub starts 2024-08-31T05:17:33.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:33 smithi073 ceph-mon[24726]: purged_snaps scrub ok 2024-08-31T05:17:33.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:33 smithi073 ceph-mon[24726]: osd.5 [v2:172.21.15.73:6816/2922014039,v1:172.21.15.73:6817/2922014039] boot 2024-08-31T05:17:33.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:33 smithi073 ceph-mon[24726]: osdmap e39: 6 total, 6 up, 6 in 2024-08-31T05:17:33.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:33 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:17:33.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:33 smithi073 ceph-mon[24726]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:17:34.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.362+0000 7fca1f761640 1 -- 172.21.15.67:0/1400471841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca18101700 msgr2=0x7fca18101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:34.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.362+0000 7fca1f761640 1 --2- 172.21.15.67:0/1400471841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca18101700 0x7fca18101b00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fca10009880 tx=0x7fca1002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:34.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.362+0000 7fca1f761640 1 -- 172.21.15.67:0/1400471841 shutdown_connections 2024-08-31T05:17:34.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.362+0000 7fca1f761640 1 --2- 172.21.15.67:0/1400471841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca18102900 0x7fca18102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:34.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.362+0000 7fca1f761640 1 --2- 172.21.15.67:0/1400471841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca18101700 0x7fca18101b00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.362+0000 7fca1f761640 1 -- 172.21.15.67:0/1400471841 >> 172.21.15.67:0/1400471841 conn(0x7fca180fce90 msgr2=0x7fca180ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.362+0000 7fca1f761640 1 -- 172.21.15.67:0/1400471841 shutdown_connections 2024-08-31T05:17:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.362+0000 7fca1f761640 1 -- 172.21.15.67:0/1400471841 wait complete. 2024-08-31T05:17:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.363+0000 7fca1f761640 1 Processor -- start 2024-08-31T05:17:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.363+0000 7fca1f761640 1 -- start start 2024-08-31T05:17:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.363+0000 7fca1f761640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca18101700 0x7fca181972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.363+0000 7fca1f761640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca18102900 0x7fca181977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.363+0000 7fca1f761640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fca1810a5a0 con 0x7fca18102900 2024-08-31T05:17:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.363+0000 7fca1f761640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fca1810a420 con 0x7fca18101700 2024-08-31T05:17:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.363+0000 7fca1ccfc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca18102900 0x7fca181977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.363+0000 7fca1ccfc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca18102900 0x7fca181977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35742/0 (socket says 172.21.15.67:35742) 2024-08-31T05:17:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.363+0000 7fca1ccfc640 1 -- 172.21.15.67:0/2336082369 learned_addr learned my addr 172.21.15.67:0/2336082369 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.364+0000 7fca1d4fd640 1 --2- 172.21.15.67:0/2336082369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca18101700 0x7fca181972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.364+0000 7fca1ccfc640 1 -- 172.21.15.67:0/2336082369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca18101700 msgr2=0x7fca181972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.364+0000 7fca1ccfc640 1 --2- 172.21.15.67:0/2336082369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca18101700 0x7fca181972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.364+0000 7fca1ccfc640 1 -- 172.21.15.67:0/2336082369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca18197e70 con 0x7fca18102900 2024-08-31T05:17:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.364+0000 7fca1d4fd640 1 --2- 172.21.15.67:0/2336082369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca18101700 0x7fca181972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:17:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.364+0000 7fca1ccfc640 1 --2- 172.21.15.67:0/2336082369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca18102900 0x7fca181977f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00b420 tx=0x7fca0c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.364+0000 7fca167fc640 1 -- 172.21.15.67:0/2336082369 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca0c011630 con 0x7fca18102900 2024-08-31T05:17:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.364+0000 7fca167fc640 1 -- 172.21.15.67:0/2336082369 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca0c016070 con 0x7fca18102900 2024-08-31T05:17:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.364+0000 7fca1f761640 1 -- 172.21.15.67:0/2336082369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca1819c8b0 con 0x7fca18102900 2024-08-31T05:17:34.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.364+0000 7fca167fc640 1 -- 172.21.15.67:0/2336082369 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca0c010d40 con 0x7fca18102900 2024-08-31T05:17:34.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.364+0000 7fca1f761640 1 -- 172.21.15.67:0/2336082369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca1819cec0 con 0x7fca18102900 2024-08-31T05:17:34.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.365+0000 7fca1f761640 1 -- 172.21.15.67:0/2336082369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca18101b00 con 0x7fca18102900 2024-08-31T05:17:34.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.366+0000 7fca167fc640 1 -- 172.21.15.67:0/2336082369 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fca0c01b460 con 0x7fca18102900 2024-08-31T05:17:34.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.366+0000 7fca167fc640 1 --2- 172.21.15.67:0/2336082369 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fca0006de90 0x7fca00070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:34.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.366+0000 7fca1d4fd640 1 --2- 172.21.15.67:0/2336082369 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fca0006de90 0x7fca00070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:34.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.366+0000 7fca167fc640 1 -- 172.21.15.67:0/2336082369 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fca0c08d070 con 0x7fca18102900 2024-08-31T05:17:34.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.367+0000 7fca1d4fd640 1 --2- 172.21.15.67:0/2336082369 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fca0006de90 0x7fca00070350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca100096c0 tx=0x7fca10009650 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:34.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.371+0000 7fca167fc640 1 -- 172.21.15.67:0/2336082369 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca0c05afd0 con 0x7fca18102900 2024-08-31T05:17:34.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.548+0000 7fca1f761640 1 -- 172.21.15.67:0/2336082369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fca18062b90 con 0x7fca18102900 2024-08-31T05:17:34.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.549+0000 7fca167fc640 1 -- 172.21.15.67:0/2336082369 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) ==== 74+0+130 (secure 0 0 0) 0x7fca0c05ec80 con 0x7fca18102900 2024-08-31T05:17:34.550 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:17:34.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.550+0000 7fca1f761640 1 -- 172.21.15.67:0/2336082369 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fca0006de90 msgr2=0x7fca00070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:34.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.550+0000 7fca1f761640 1 --2- 172.21.15.67:0/2336082369 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fca0006de90 0x7fca00070350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca100096c0 tx=0x7fca10009650 comp rx=0 tx=0).stop 2024-08-31T05:17:34.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.550+0000 7fca1f761640 1 -- 172.21.15.67:0/2336082369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca18102900 msgr2=0x7fca181977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:34.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.550+0000 7fca1f761640 1 --2- 172.21.15.67:0/2336082369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca18102900 0x7fca181977f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00b420 tx=0x7fca0c00b8e0 comp rx=0 tx=0).stop 2024-08-31T05:17:34.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.550+0000 7fca1f761640 1 -- 172.21.15.67:0/2336082369 shutdown_connections 2024-08-31T05:17:34.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.550+0000 7fca1f761640 1 --2- 172.21.15.67:0/2336082369 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fca0006de90 0x7fca00070350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:34.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.550+0000 7fca1f761640 1 --2- 172.21.15.67:0/2336082369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca18102900 0x7fca181977f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:34.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.550+0000 7fca1f761640 1 --2- 172.21.15.67:0/2336082369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca18101700 0x7fca181972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:34.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.550+0000 7fca1f761640 1 -- 172.21.15.67:0/2336082369 >> 172.21.15.67:0/2336082369 conn(0x7fca180fce90 msgr2=0x7fca18105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:34.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.551+0000 7fca1f761640 1 -- 172.21.15.67:0/2336082369 shutdown_connections 2024-08-31T05:17:34.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:34.551+0000 7fca1f761640 1 -- 172.21.15.67:0/2336082369 wait complete. 2024-08-31T05:17:34.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:34 smithi067 ceph-mon[17432]: osdmap e40: 6 total, 6 up, 6 in 2024-08-31T05:17:34.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:34 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2336082369' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-31T05:17:34.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:34 smithi073 ceph-mon[24726]: osdmap e40: 6 total, 6 up, 6 in 2024-08-31T05:17:34.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:34 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2336082369' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-31T05:17:35.291 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1725081452,"num_in_osds":6,"osd_in_since":1725081429,"num_remapped_pgs":0} 2024-08-31T05:17:35.292 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:17:35.547 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:35.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:35 smithi067 ceph-mon[17432]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:35.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:35 smithi073 ceph-mon[24726]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.978+0000 7f4a73399640 1 -- 172.21.15.67:0/629574601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6c1005b0 msgr2=0x7f4a6c100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.978+0000 7f4a73399640 1 --2- 172.21.15.67:0/629574601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6c1005b0 0x7f4a6c100a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009880 tx=0x7f4a6802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.978+0000 7f4a73399640 1 -- 172.21.15.67:0/629574601 shutdown_connections 2024-08-31T05:17:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.978+0000 7f4a73399640 1 --2- 172.21.15.67:0/629574601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6c1005b0 0x7f4a6c100a10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.978+0000 7f4a73399640 1 --2- 172.21.15.67:0/629574601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a6c106660 0x7f4a6c106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.978+0000 7f4a73399640 1 -- 172.21.15.67:0/629574601 >> 172.21.15.67:0/629574601 conn(0x7f4a6c0fc2f0 msgr2=0x7f4a6c0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.978+0000 7f4a73399640 1 -- 172.21.15.67:0/629574601 shutdown_connections 2024-08-31T05:17:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.978+0000 7f4a73399640 1 -- 172.21.15.67:0/629574601 wait complete. 2024-08-31T05:17:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.979+0000 7f4a73399640 1 Processor -- start 2024-08-31T05:17:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.979+0000 7f4a73399640 1 -- start start 2024-08-31T05:17:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.979+0000 7f4a73399640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a6c1005b0 0x7f4a6c197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.979+0000 7f4a73399640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6c106660 0x7f4a6c197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.979+0000 7f4a73399640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c10da50 con 0x7f4a6c106660 2024-08-31T05:17:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.979+0000 7f4a73399640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c10d8d0 con 0x7f4a6c1005b0 2024-08-31T05:17:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.979+0000 7f4a70934640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6c106660 0x7f4a6c197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.979+0000 7f4a70934640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6c106660 0x7f4a6c197bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35770/0 (socket says 172.21.15.67:35770) 2024-08-31T05:17:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.979+0000 7f4a70934640 1 -- 172.21.15.67:0/3652402731 learned_addr learned my addr 172.21.15.67:0/3652402731 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.979+0000 7f4a71135640 1 --2- 172.21.15.67:0/3652402731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a6c1005b0 0x7f4a6c197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.979+0000 7f4a70934640 1 -- 172.21.15.67:0/3652402731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a6c1005b0 msgr2=0x7f4a6c197690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.979+0000 7f4a70934640 1 --2- 172.21.15.67:0/3652402731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a6c1005b0 0x7f4a6c197690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.979+0000 7f4a70934640 1 -- 172.21.15.67:0/3652402731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6c198280 con 0x7f4a6c106660 2024-08-31T05:17:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.979+0000 7f4a70934640 1 --2- 172.21.15.67:0/3652402731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6c106660 0x7f4a6c197bd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4a68004f90 tx=0x7f4a680048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.980+0000 7f4a627fc640 1 -- 172.21.15.67:0/3652402731 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a6803f070 con 0x7f4a6c106660 2024-08-31T05:17:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.980+0000 7f4a73399640 1 -- 172.21.15.67:0/3652402731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a6c19bfc0 con 0x7f4a6c106660 2024-08-31T05:17:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.980+0000 7f4a627fc640 1 -- 172.21.15.67:0/3652402731 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4a68004cf0 con 0x7f4a6c106660 2024-08-31T05:17:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.980+0000 7f4a627fc640 1 -- 172.21.15.67:0/3652402731 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a68035030 con 0x7f4a6c106660 2024-08-31T05:17:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.980+0000 7f4a73399640 1 -- 172.21.15.67:0/3652402731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a6c19c4f0 con 0x7f4a6c106660 2024-08-31T05:17:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.981+0000 7f4a73399640 1 -- 172.21.15.67:0/3652402731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a6c101cd0 con 0x7f4a6c106660 2024-08-31T05:17:35.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.981+0000 7f4a627fc640 1 -- 172.21.15.67:0/3652402731 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f4a68042070 con 0x7f4a6c106660 2024-08-31T05:17:35.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.982+0000 7f4a627fc640 1 --2- 172.21.15.67:0/3652402731 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f4a5806de90 0x7f4a58070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:35.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.982+0000 7f4a627fc640 1 -- 172.21.15.67:0/3652402731 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f4a680ae280 con 0x7f4a6c106660 2024-08-31T05:17:35.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.982+0000 7f4a71135640 1 --2- 172.21.15.67:0/3652402731 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f4a5806de90 0x7f4a58070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:35.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.982+0000 7f4a71135640 1 --2- 172.21.15.67:0/3652402731 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f4a5806de90 0x7f4a58070350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c005e10 tx=0x7f4a5c005da0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:35.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:35.986+0000 7f4a627fc640 1 -- 172.21.15.67:0/3652402731 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a6807c1e0 con 0x7f4a6c106660 2024-08-31T05:17:36.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:36.163+0000 7f4a73399640 1 -- 172.21.15.67:0/3652402731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a6c19c860 con 0x7f4a6c106660 2024-08-31T05:17:36.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:36.164+0000 7f4a627fc640 1 -- 172.21.15.67:0/3652402731 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+11312 (secure 0 0 0) 0x7f4a6807fe90 con 0x7f4a6c106660 2024-08-31T05:17:36.166 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:17:36.166 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":40,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","created":"2024-08-31T05:11:45.459538+0000","modified":"2024-08-31T05:17:33.549471+0000","last_up_change":"2024-08-31T05:17:32.542281+0000","last_in_change":"2024-08-31T05:17:09.866654+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:16:17.608366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"51d7e102-32dc-423d-815b-6a09ca75345d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3334523825},{"type":"v1","addr":"172.21.15.67:6803","nonce":3334523825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3334523825},{"type":"v1","addr":"172.21.15.67:6805","nonce":3334523825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3334523825},{"type":"v1","addr":"172.21.15.67:6809","nonce":3334523825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3334523825},{"type":"v1","addr":"172.21.15.67:6807","nonce":3334523825}]},"public_addr":"172.21.15.67:6803/3334523825","cluster_addr":"172.21.15.67:6805/3334523825","heartbeat_back_addr":"172.21.15.67:6809/3334523825","heartbeat_front_addr":"172.21.15.67:6807/3334523825","state":["exists","up"]},{"osd":1,"uuid":"fd0426c7-f84f-401b-b22f-51e7f5480c70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":9049055},{"type":"v1","addr":"172.21.15.67:6811","nonce":9049055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":9049055},{"type":"v1","addr":"172.21.15.67:6813","nonce":9049055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":9049055},{"type":"v1","addr":"172.21.15.67:6817","nonce":9049055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":9049055},{"type":"v1","addr":"172.21.15.67:6815","nonce":9049055}]},"public_addr":"172.21.15.67:6811/9049055","cluster_addr":"172.21.15.67:6813/9049055","heartbeat_back_addr":"172.21.15.67:6817/9049055","heartbeat_front_addr":"172.21.15.67:6815/9049055","state":["exists","up"]},{"osd":2,"uuid":"9f6476c9-839c-43b1-9a8e-bf77683c5a3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":398055695},{"type":"v1","addr":"172.21.15.67:6819","nonce":398055695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":398055695},{"type":"v1","addr":"172.21.15.67:6821","nonce":398055695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":398055695},{"type":"v1","addr":"172.21.15.67:6825","nonce":398055695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":398055695},{"type":"v1","addr":"172.21.15.67:6823","nonce":398055695}]},"public_addr":"172.21.15.67:6819/398055695","cluster_addr":"172.21.15.67:6821/398055695","heartbeat_back_addr":"172.21.15.67:6825/398055695","heartbeat_front_addr":"172.21.15.67:6823/398055695","state":["exists","up"]},{"osd":3,"uuid":"712d22a6-cf93-44f0-8ead-e482fd158859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3773655535},{"type":"v1","addr":"172.21.15.73:6801","nonce":3773655535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3773655535},{"type":"v1","addr":"172.21.15.73:6803","nonce":3773655535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3773655535},{"type":"v1","addr":"172.21.15.73:6807","nonce":3773655535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3773655535},{"type":"v1","addr":"172.21.15.73:6805","nonce":3773655535}]},"public_addr":"172.21.15.73:6801/3773655535","cluster_addr":"172.21.15.73:6803/3773655535","heartbeat_back_addr":"172.21.15.73:6807/3773655535","heartbeat_front_addr":"172.21.15.73:6805/3773655535","state":["exists","up"]},{"osd":4,"uuid":"53d31201-7801-42d2-b4d5-cdaa89525353","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":411912217},{"type":"v1","addr":"172.21.15.73:6809","nonce":411912217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":411912217},{"type":"v1","addr":"172.21.15.73:6811","nonce":411912217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":411912217},{"type":"v1","addr":"172.21.15.73:6815","nonce":411912217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":411912217},{"type":"v1","addr":"172.21.15.73:6813","nonce":411912217}]},"public_addr":"172.21.15.73:6809/411912217","cluster_addr":"172.21.15.73:6811/411912217","heartbeat_back_addr":"172.21.15.73:6815/411912217","heartbeat_front_addr":"172.21.15.73:6813/411912217","state":["exists","up"]},{"osd":5,"uuid":"1c41359a-c1da-444b-afcc-eb0d8eb017ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2922014039},{"type":"v1","addr":"172.21.15.73:6817","nonce":2922014039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2922014039},{"type":"v1","addr":"172.21.15.73:6819","nonce":2922014039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2922014039},{"type":"v1","addr":"172.21.15.73:6823","nonce":2922014039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2922014039},{"type":"v1","addr":"172.21.15.73:6821","nonce":2922014039}]},"public_addr":"172.21.15.73:6817/2922014039","cluster_addr":"172.21.15.73:6819/2922014039","heartbeat_back_addr":"172.21.15.73:6823/2922014039","heartbeat_front_addr":"172.21.15.73:6821/2922014039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:15:16.610562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:15:45.628166+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:16:13.473306+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:16:37.970940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:17:04.480428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:17:30.746725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:0/3326210547":"2024-09-01T05:13:41.288702+0000","172.21.15.67:0/3782915644":"2024-09-01T05:12:13.010409+0000","172.21.15.67:6801/4159467749":"2024-09-01T05:12:13.010409+0000","172.21.15.67:0/3624769860":"2024-09-01T05:13:41.288702+0000","172.21.15.67:0/2838724829":"2024-09-01T05:12:45.310890+0000","172.21.15.67:0/743586046":"2024-09-01T05:12:13.010409+0000","172.21.15.67:0/2529430863":"2024-09-01T05:12:45.310890+0000","172.21.15.67:6800/4159467749":"2024-09-01T05:12:13.010409+0000","172.21.15.67:6801/1741828555":"2024-09-01T05:13:41.288702+0000","172.21.15.67:6801/2323558682":"2024-09-01T05:12:45.310890+0000","172.21.15.67:0/3787377150":"2024-09-01T05:13:41.288702+0000","172.21.15.67:6800/2323558682":"2024-09-01T05:12:45.310890+0000","172.21.15.67:6800/1741828555":"2024-09-01T05:13:41.288702+0000","172.21.15.67:0/3246639847":"2024-09-01T05:12:13.010409+0000","172.21.15.67:0/4268636965":"2024-09-01T05:12:45.310890+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:17:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:36.166+0000 7f4a73399640 1 -- 172.21.15.67:0/3652402731 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f4a5806de90 msgr2=0x7f4a58070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:36.166+0000 7f4a73399640 1 --2- 172.21.15.67:0/3652402731 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f4a5806de90 0x7f4a58070350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c005e10 tx=0x7f4a5c005da0 comp rx=0 tx=0).stop 2024-08-31T05:17:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:36.166+0000 7f4a73399640 1 -- 172.21.15.67:0/3652402731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6c106660 msgr2=0x7f4a6c197bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:36.166+0000 7f4a73399640 1 --2- 172.21.15.67:0/3652402731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6c106660 0x7f4a6c197bd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4a68004f90 tx=0x7f4a680048f0 comp rx=0 tx=0).stop 2024-08-31T05:17:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:36.166+0000 7f4a73399640 1 -- 172.21.15.67:0/3652402731 shutdown_connections 2024-08-31T05:17:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:36.166+0000 7f4a73399640 1 --2- 172.21.15.67:0/3652402731 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f4a5806de90 0x7f4a58070350 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:36.166+0000 7f4a73399640 1 --2- 172.21.15.67:0/3652402731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6c106660 0x7f4a6c197bd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:36.166+0000 7f4a73399640 1 --2- 172.21.15.67:0/3652402731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a6c1005b0 0x7f4a6c197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:36.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:36.166+0000 7f4a73399640 1 -- 172.21.15.67:0/3652402731 >> 172.21.15.67:0/3652402731 conn(0x7f4a6c0fc2f0 msgr2=0x7f4a6c0699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:36.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:36.166+0000 7f4a73399640 1 -- 172.21.15.67:0/3652402731 shutdown_connections 2024-08-31T05:17:36.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:36.166+0000 7f4a73399640 1 -- 172.21.15.67:0/3652402731 wait complete. 2024-08-31T05:17:36.771 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:36 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3652402731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T05:17:36.801 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T05:16:17.608366+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T05:17:36.802 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-31T05:17:36.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:36 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3652402731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T05:17:37.057 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:37.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.504+0000 7fd3fdd90640 1 -- 172.21.15.67:0/2842574741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3f81031e0 msgr2=0x7fd3f810b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:37.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.504+0000 7fd3fdd90640 1 --2- 172.21.15.67:0/2842574741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3f81031e0 0x7fd3f810b6d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec0098b0 tx=0x7fd3ec02a560 comp rx=0 tx=0).stop 2024-08-31T05:17:37.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.504+0000 7fd3fdd90640 1 -- 172.21.15.67:0/2842574741 shutdown_connections 2024-08-31T05:17:37.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.504+0000 7fd3fdd90640 1 --2- 172.21.15.67:0/2842574741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3f81031e0 0x7fd3f810b6d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:37.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.504+0000 7fd3fdd90640 1 --2- 172.21.15.67:0/2842574741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f81028c0 0x7fd3f8102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:37.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.504+0000 7fd3fdd90640 1 -- 172.21.15.67:0/2842574741 >> 172.21.15.67:0/2842574741 conn(0x7fd3f80fc2c0 msgr2=0x7fd3f80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:37.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.505+0000 7fd3fdd90640 1 -- 172.21.15.67:0/2842574741 shutdown_connections 2024-08-31T05:17:37.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.505+0000 7fd3fdd90640 1 -- 172.21.15.67:0/2842574741 wait complete. 2024-08-31T05:17:37.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.505+0000 7fd3fdd90640 1 Processor -- start 2024-08-31T05:17:37.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.506+0000 7fd3fdd90640 1 -- start start 2024-08-31T05:17:37.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.506+0000 7fd3fdd90640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3f81028c0 0x7fd3f819d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:37.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.506+0000 7fd3fdd90640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f81031e0 0x7fd3f819dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.506+0000 7fd3fdd90640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f810eb90 con 0x7fd3f81028c0 2024-08-31T05:17:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.506+0000 7fd3fdd90640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f810ea10 con 0x7fd3f81031e0 2024-08-31T05:17:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.506+0000 7fd3f77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3f81028c0 0x7fd3f819d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.506+0000 7fd3f77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3f81028c0 0x7fd3f819d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35786/0 (socket says 172.21.15.67:35786) 2024-08-31T05:17:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.506+0000 7fd3f77fe640 1 -- 172.21.15.67:0/1557160983 learned_addr learned my addr 172.21.15.67:0/1557160983 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.506+0000 7fd3f6ffd640 1 --2- 172.21.15.67:0/1557160983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f81031e0 0x7fd3f819dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.506+0000 7fd3f77fe640 1 -- 172.21.15.67:0/1557160983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f81031e0 msgr2=0x7fd3f819dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.506+0000 7fd3f77fe640 1 --2- 172.21.15.67:0/1557160983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f81031e0 0x7fd3f819dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.506+0000 7fd3f77fe640 1 -- 172.21.15.67:0/1557160983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f8197640 con 0x7fd3f81028c0 2024-08-31T05:17:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.506+0000 7fd3f77fe640 1 --2- 172.21.15.67:0/1557160983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3f81028c0 0x7fd3f819d570 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800d6f0 tx=0x7fd3e800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.507+0000 7fd3f4ff9640 1 -- 172.21.15.67:0/1557160983 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3e8017070 con 0x7fd3f81028c0 2024-08-31T05:17:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.507+0000 7fd3f4ff9640 1 -- 172.21.15.67:0/1557160983 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd3e800de00 con 0x7fd3f81028c0 2024-08-31T05:17:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.507+0000 7fd3fdd90640 1 -- 172.21.15.67:0/1557160983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f8197930 con 0x7fd3f81028c0 2024-08-31T05:17:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.507+0000 7fd3f4ff9640 1 -- 172.21.15.67:0/1557160983 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3e8004bb0 con 0x7fd3f81028c0 2024-08-31T05:17:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.507+0000 7fd3fdd90640 1 -- 172.21.15.67:0/1557160983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f8197e90 con 0x7fd3f81028c0 2024-08-31T05:17:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.508+0000 7fd3fdd90640 1 -- 172.21.15.67:0/1557160983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f806a7d0 con 0x7fd3f81028c0 2024-08-31T05:17:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.508+0000 7fd3f4ff9640 1 -- 172.21.15.67:0/1557160983 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fd3e8010460 con 0x7fd3f81028c0 2024-08-31T05:17:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.509+0000 7fd3f4ff9640 1 --2- 172.21.15.67:0/1557160983 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd3e006de30 0x7fd3e00702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.509+0000 7fd3f6ffd640 1 --2- 172.21.15.67:0/1557160983 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd3e006de30 0x7fd3e00702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.509+0000 7fd3f4ff9640 1 -- 172.21.15.67:0/1557160983 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fd3e808d440 con 0x7fd3f81028c0 2024-08-31T05:17:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.509+0000 7fd3f6ffd640 1 --2- 172.21.15.67:0/1557160983 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd3e006de30 0x7fd3e00702f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec031460 tx=0x7fd3ec009560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.513+0000 7fd3f4ff9640 1 -- 172.21.15.67:0/1557160983 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd3e805b320 con 0x7fd3f81028c0 2024-08-31T05:17:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.690+0000 7fd3fdd90640 1 -- 172.21.15.67:0/1557160983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd3f8102ca0 con 0x7fd3f81028c0 2024-08-31T05:17:37.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.690+0000 7fd3f4ff9640 1 -- 172.21.15.67:0/1557160983 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7fd3e805efd0 con 0x7fd3f81028c0 2024-08-31T05:17:37.692 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-08-31T05:17:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.692+0000 7fd3fdd90640 1 -- 172.21.15.67:0/1557160983 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd3e006de30 msgr2=0x7fd3e00702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.692+0000 7fd3fdd90640 1 --2- 172.21.15.67:0/1557160983 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd3e006de30 0x7fd3e00702f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec031460 tx=0x7fd3ec009560 comp rx=0 tx=0).stop 2024-08-31T05:17:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.692+0000 7fd3fdd90640 1 -- 172.21.15.67:0/1557160983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3f81028c0 msgr2=0x7fd3f819d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.692+0000 7fd3fdd90640 1 --2- 172.21.15.67:0/1557160983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3f81028c0 0x7fd3f819d570 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800d6f0 tx=0x7fd3e800dbb0 comp rx=0 tx=0).stop 2024-08-31T05:17:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.692+0000 7fd3fdd90640 1 -- 172.21.15.67:0/1557160983 shutdown_connections 2024-08-31T05:17:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.692+0000 7fd3fdd90640 1 --2- 172.21.15.67:0/1557160983 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd3e006de30 0x7fd3e00702f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.692+0000 7fd3fdd90640 1 --2- 172.21.15.67:0/1557160983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f81031e0 0x7fd3f819dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:37.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.692+0000 7fd3fdd90640 1 --2- 172.21.15.67:0/1557160983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3f81028c0 0x7fd3f819d570 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:37.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.692+0000 7fd3fdd90640 1 -- 172.21.15.67:0/1557160983 >> 172.21.15.67:0/1557160983 conn(0x7fd3f80fc2c0 msgr2=0x7fd3f8103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:37.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.692+0000 7fd3fdd90640 1 -- 172.21.15.67:0/1557160983 shutdown_connections 2024-08-31T05:17:37.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:37.693+0000 7fd3fdd90640 1 -- 172.21.15.67:0/1557160983 wait complete. 2024-08-31T05:17:37.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:37 smithi067 ceph-mon[17432]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:37.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:37 smithi073 ceph-mon[24726]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:38.462 INFO:tasks.cephadm:Setting up client nodes... 2024-08-31T05:17:38.463 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-31T05:17:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:38.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:38 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1557160983' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-31T05:17:38.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:38 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1557160983' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-31T05:17:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.126+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/2711163977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4101800 msgr2=0x7fe2f4101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.126+0000 7fe2fc2e6640 1 --2- 172.21.15.67:0/2711163977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4101800 0x7fe2f4101c80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009880 tx=0x7fe2e402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.126+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/2711163977 shutdown_connections 2024-08-31T05:17:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.126+0000 7fe2fc2e6640 1 --2- 172.21.15.67:0/2711163977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4101800 0x7fe2f4101c80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.126+0000 7fe2fc2e6640 1 --2- 172.21.15.67:0/2711163977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f4100600 0x7fe2f4100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.126+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/2711163977 >> 172.21.15.67:0/2711163977 conn(0x7fe2f40fbdb0 msgr2=0x7fe2f40fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.126+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/2711163977 shutdown_connections 2024-08-31T05:17:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.126+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/2711163977 wait complete. 2024-08-31T05:17:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.127+0000 7fe2fc2e6640 1 Processor -- start 2024-08-31T05:17:39.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.127+0000 7fe2fc2e6640 1 -- start start 2024-08-31T05:17:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2fc2e6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4100600 0x7fe2f4197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2fc2e6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f4101800 0x7fe2f41977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2fc2e6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f4109440 con 0x7fe2f4100600 2024-08-31T05:17:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2fc2e6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f41092c0 con 0x7fe2f4101800 2024-08-31T05:17:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2fa082640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4100600 0x7fe2f4197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2fa082640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4100600 0x7fe2f4197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55266/0 (socket says 172.21.15.67:55266) 2024-08-31T05:17:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2fa082640 1 -- 172.21.15.67:0/1688304715 learned_addr learned my addr 172.21.15.67:0/1688304715 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2f9881640 1 --2- 172.21.15.67:0/1688304715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f4101800 0x7fe2f41977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2fa082640 1 -- 172.21.15.67:0/1688304715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f4101800 msgr2=0x7fe2f41977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2fa082640 1 --2- 172.21.15.67:0/1688304715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f4101800 0x7fe2f41977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2fa082640 1 -- 172.21.15.67:0/1688304715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f4197e20 con 0x7fe2f4100600 2024-08-31T05:17:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2fa082640 1 --2- 172.21.15.67:0/1688304715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4100600 0x7fe2f4197260 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000d8d0 tx=0x7fe2f000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:39.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2eb7fe640 1 -- 172.21.15.67:0/1688304715 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2f0017070 con 0x7fe2f4100600 2024-08-31T05:17:39.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2eb7fe640 1 -- 172.21.15.67:0/1688304715 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2f000be10 con 0x7fe2f4100600 2024-08-31T05:17:39.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/1688304715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f419c860 con 0x7fe2f4100600 2024-08-31T05:17:39.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2eb7fe640 1 -- 172.21.15.67:0/1688304715 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2f000f3c0 con 0x7fe2f4100600 2024-08-31T05:17:39.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.128+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/1688304715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f419cdc0 con 0x7fe2f4100600 2024-08-31T05:17:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.130+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/1688304715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f4109c20 con 0x7fe2f4100600 2024-08-31T05:17:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.130+0000 7fe2eb7fe640 1 -- 172.21.15.67:0/1688304715 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fe2f001a070 con 0x7fe2f4100600 2024-08-31T05:17:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.130+0000 7fe2eb7fe640 1 --2- 172.21.15.67:0/1688304715 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe2e006de90 0x7fe2e0070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.130+0000 7fe2eb7fe640 1 -- 172.21.15.67:0/1688304715 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fe2f008d2f0 con 0x7fe2f4100600 2024-08-31T05:17:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.130+0000 7fe2f9881640 1 --2- 172.21.15.67:0/1688304715 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe2e006de90 0x7fe2e0070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:39.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.131+0000 7fe2f9881640 1 --2- 172.21.15.67:0/1688304715 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe2e006de90 0x7fe2e0070350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4000c00 tx=0x7fe2e40058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:39.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.135+0000 7fe2eb7fe640 1 -- 172.21.15.67:0/1688304715 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe2f005ef00 con 0x7fe2f4100600 2024-08-31T05:17:39.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.376+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/1688304715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fe2f4100a00 con 0x7fe2f4100600 2024-08-31T05:17:39.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.377+0000 7fe2eb7fe640 1 -- 172.21.15.67:0/1688304715 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7fe2f008d110 con 0x7fe2f4100600 2024-08-31T05:17:39.380 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-08-31T05:17:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBzp9JmgTiLFhAAwkWnN1uoUal20P2DrDX2SQ== 2024-08-31T05:17:39.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.380+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/1688304715 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe2e006de90 msgr2=0x7fe2e0070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:39.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.380+0000 7fe2fc2e6640 1 --2- 172.21.15.67:0/1688304715 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe2e006de90 0x7fe2e0070350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4000c00 tx=0x7fe2e40058d0 comp rx=0 tx=0).stop 2024-08-31T05:17:39.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.380+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/1688304715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4100600 msgr2=0x7fe2f4197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:39.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.380+0000 7fe2fc2e6640 1 --2- 172.21.15.67:0/1688304715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4100600 0x7fe2f4197260 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000d8d0 tx=0x7fe2f000dd90 comp rx=0 tx=0).stop 2024-08-31T05:17:39.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.380+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/1688304715 shutdown_connections 2024-08-31T05:17:39.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.380+0000 7fe2fc2e6640 1 --2- 172.21.15.67:0/1688304715 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe2e006de90 0x7fe2e0070350 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:39.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.380+0000 7fe2fc2e6640 1 --2- 172.21.15.67:0/1688304715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f4101800 0x7fe2f41977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:39.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.380+0000 7fe2fc2e6640 1 --2- 172.21.15.67:0/1688304715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4100600 0x7fe2f4197260 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:39.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.380+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/1688304715 >> 172.21.15.67:0/1688304715 conn(0x7fe2f40fbdb0 msgr2=0x7fe2f40fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:39.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.381+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/1688304715 shutdown_connections 2024-08-31T05:17:39.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:39.381+0000 7fe2fc2e6640 1 -- 172.21.15.67:0/1688304715 wait complete. 2024-08-31T05:17:39.702 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:39 smithi067 ceph-mon[17432]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:39.702 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:39 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1688304715' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-31T05:17:39.702 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:39 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1688304715' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T05:17:39.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:39 smithi073 ceph-mon[24726]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:39.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:39 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1688304715' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-31T05:17:39.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:39 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1688304715' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T05:17:40.026 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:17:40.026 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-31T05:17:40.026 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-31T05:17:40.063 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-31T05:17:40.324 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi073/config 2024-08-31T05:17:40.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.812+0000 7f3b77a59640 1 -- 172.21.15.73:0/221041468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b701017d0 msgr2=0x7f3b70101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:40.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.812+0000 7f3b77a59640 1 --2- 172.21.15.73:0/221041468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b701017d0 0x7f3b70101c50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009880 tx=0x7f3b6002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:40.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.813+0000 7f3b77a59640 1 -- 172.21.15.73:0/221041468 shutdown_connections 2024-08-31T05:17:40.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.813+0000 7f3b77a59640 1 --2- 172.21.15.73:0/221041468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b701017d0 0x7f3b70101c50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:40.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.813+0000 7f3b77a59640 1 --2- 172.21.15.73:0/221041468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b701005d0 0x7f3b701009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:40.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.813+0000 7f3b77a59640 1 -- 172.21.15.73:0/221041468 >> 172.21.15.73:0/221041468 conn(0x7f3b700fbd40 msgr2=0x7f3b700fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:40.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.813+0000 7f3b77a59640 1 -- 172.21.15.73:0/221041468 shutdown_connections 2024-08-31T05:17:40.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.813+0000 7f3b77a59640 1 -- 172.21.15.73:0/221041468 wait complete. 2024-08-31T05:17:40.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.813+0000 7f3b77a59640 1 Processor -- start 2024-08-31T05:17:40.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.813+0000 7f3b77a59640 1 -- start start 2024-08-31T05:17:40.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.813+0000 7f3b77a59640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b701005d0 0x7f3b70196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:40.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.813+0000 7f3b77a59640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b701017d0 0x7f3b701966b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:40.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.813+0000 7f3b77a59640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701093f0 con 0x7f3b701017d0 2024-08-31T05:17:40.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.813+0000 7f3b77a59640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3b70109270 con 0x7f3b701005d0 2024-08-31T05:17:40.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.814+0000 7f3b757f5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b701005d0 0x7f3b70196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:40.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.814+0000 7f3b757f5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b701005d0 0x7f3b70196170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56880/0 (socket says 172.21.15.73:56880) 2024-08-31T05:17:40.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.814+0000 7f3b757f5640 1 -- 172.21.15.73:0/4060886866 learned_addr learned my addr 172.21.15.73:0/4060886866 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-08-31T05:17:40.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.814+0000 7f3b74ff4640 1 --2- 172.21.15.73:0/4060886866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b701017d0 0x7f3b701966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:40.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.814+0000 7f3b757f5640 1 -- 172.21.15.73:0/4060886866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b701017d0 msgr2=0x7f3b701966b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:40.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.814+0000 7f3b757f5640 1 --2- 172.21.15.73:0/4060886866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b701017d0 0x7f3b701966b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:40.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.814+0000 7f3b757f5640 1 -- 172.21.15.73:0/4060886866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b70196ca0 con 0x7f3b701005d0 2024-08-31T05:17:40.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.814+0000 7f3b757f5640 1 --2- 172.21.15.73:0/4060886866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b701005d0 0x7f3b70196170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c007b50 tx=0x7f3b6c00e420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:40.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.814+0000 7f3b667fc640 1 -- 172.21.15.73:0/4060886866 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b6c019020 con 0x7f3b701005d0 2024-08-31T05:17:40.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.814+0000 7f3b667fc640 1 -- 172.21.15.73:0/4060886866 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3b6c007c40 con 0x7f3b701005d0 2024-08-31T05:17:40.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.814+0000 7f3b77a59640 1 -- 172.21.15.73:0/4060886866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b70069aa0 con 0x7f3b701005d0 2024-08-31T05:17:40.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.814+0000 7f3b667fc640 1 -- 172.21.15.73:0/4060886866 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b6c003820 con 0x7f3b701005d0 2024-08-31T05:17:40.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.814+0000 7f3b77a59640 1 -- 172.21.15.73:0/4060886866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7006a000 con 0x7f3b701005d0 2024-08-31T05:17:40.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.815+0000 7f3b77a59640 1 -- 172.21.15.73:0/4060886866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b70109bd0 con 0x7f3b701005d0 2024-08-31T05:17:40.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.816+0000 7f3b667fc640 1 -- 172.21.15.73:0/4060886866 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f3b6c00eab0 con 0x7f3b701005d0 2024-08-31T05:17:40.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.816+0000 7f3b667fc640 1 --2- 172.21.15.73:0/4060886866 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3b5c06de30 0x7f3b5c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:40.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.817+0000 7f3b667fc640 1 -- 172.21.15.73:0/4060886866 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f3b6c012050 con 0x7f3b701005d0 2024-08-31T05:17:40.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.817+0000 7f3b74ff4640 1 --2- 172.21.15.73:0/4060886866 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3b5c06de30 0x7f3b5c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:40.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.817+0000 7f3b74ff4640 1 --2- 172.21.15.73:0/4060886866 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3b5c06de30 0x7f3b5c0702f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b60000c00 tx=0x7f3b600058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:40.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:40.821+0000 7f3b667fc640 1 -- 172.21.15.73:0/4060886866 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b6c023020 con 0x7f3b701005d0 2024-08-31T05:17:41.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:41.051+0000 7f3b77a59640 1 -- 172.21.15.73:0/4060886866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f3b70190170 con 0x7f3b701005d0 2024-08-31T05:17:41.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:41.056+0000 7f3b667fc640 1 -- 172.21.15.73:0/4060886866 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7f3b6c05d260 con 0x7f3b701005d0 2024-08-31T05:17:41.057 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2024-08-31T05:17:41.058 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB1p9Jmwq0xAxAAIJkWo9mDAhK+6B2YOER6Ig== 2024-08-31T05:17:41.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:41.058+0000 7f3b77a59640 1 -- 172.21.15.73:0/4060886866 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3b5c06de30 msgr2=0x7f3b5c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:41.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:41.058+0000 7f3b77a59640 1 --2- 172.21.15.73:0/4060886866 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3b5c06de30 0x7f3b5c0702f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b60000c00 tx=0x7f3b600058d0 comp rx=0 tx=0).stop 2024-08-31T05:17:41.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:41.058+0000 7f3b77a59640 1 -- 172.21.15.73:0/4060886866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b701005d0 msgr2=0x7f3b70196170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:41.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:41.058+0000 7f3b77a59640 1 --2- 172.21.15.73:0/4060886866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b701005d0 0x7f3b70196170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c007b50 tx=0x7f3b6c00e420 comp rx=0 tx=0).stop 2024-08-31T05:17:41.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:41.058+0000 7f3b77a59640 1 -- 172.21.15.73:0/4060886866 shutdown_connections 2024-08-31T05:17:41.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:41.058+0000 7f3b77a59640 1 --2- 172.21.15.73:0/4060886866 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3b5c06de30 0x7f3b5c0702f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:41.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:41.058+0000 7f3b77a59640 1 --2- 172.21.15.73:0/4060886866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b701017d0 0x7f3b701966b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:41.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:41.058+0000 7f3b77a59640 1 --2- 172.21.15.73:0/4060886866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b701005d0 0x7f3b70196170 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:41.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:41.058+0000 7f3b77a59640 1 -- 172.21.15.73:0/4060886866 >> 172.21.15.73:0/4060886866 conn(0x7f3b700fbd40 msgr2=0x7f3b70104d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:41.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:41.058+0000 7f3b77a59640 1 -- 172.21.15.73:0/4060886866 shutdown_connections 2024-08-31T05:17:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:17:41.058+0000 7f3b77a59640 1 -- 172.21.15.73:0/4060886866 wait complete. 2024-08-31T05:17:41.314 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:41 smithi073 ceph-mon[24726]: from='client.? 172.21.15.73:0/4060886866' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-31T05:17:41.314 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:41 smithi073 ceph-mon[24726]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-31T05:17:41.314 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:41 smithi073 ceph-mon[24726]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T05:17:41.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:41 smithi067 ceph-mon[17432]: from='client.? 172.21.15.73:0/4060886866' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-31T05:17:41.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:41 smithi067 ceph-mon[17432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-31T05:17:41.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:41 smithi067 ceph-mon[17432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T05:17:41.640 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-08-31T05:17:41.641 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-08-31T05:17:41.641 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-31T05:17:41.678 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph config log 1 --format=json 2024-08-31T05:17:41.942 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:42.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:42 smithi067 ceph-mon[17432]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:42.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:42 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:17:42.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.401+0000 7f5b7ea77640 1 -- 172.21.15.67:0/3834258440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b781016a0 msgr2=0x7f5b78101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:42.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.401+0000 7f5b7ea77640 1 --2- 172.21.15.67:0/3834258440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b781016a0 0x7f5b78101b00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009880 tx=0x7f5b6002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:42.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.401+0000 7f5b7ea77640 1 -- 172.21.15.67:0/3834258440 shutdown_connections 2024-08-31T05:17:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.401+0000 7f5b7ea77640 1 --2- 172.21.15.67:0/3834258440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b781016a0 0x7f5b78101b00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.401+0000 7f5b7ea77640 1 --2- 172.21.15.67:0/3834258440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b781076a0 0x7f5b78107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.401+0000 7f5b7ea77640 1 -- 172.21.15.67:0/3834258440 >> 172.21.15.67:0/3834258440 conn(0x7f5b780fd3a0 msgr2=0x7f5b780ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.401+0000 7f5b7ea77640 1 -- 172.21.15.67:0/3834258440 shutdown_connections 2024-08-31T05:17:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.401+0000 7f5b7ea77640 1 -- 172.21.15.67:0/3834258440 wait complete. 2024-08-31T05:17:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.401+0000 7f5b7ea77640 1 Processor -- start 2024-08-31T05:17:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.401+0000 7f5b7ea77640 1 -- start start 2024-08-31T05:17:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.401+0000 7f5b7ea77640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b781016a0 0x7f5b78074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.401+0000 7f5b7ea77640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b781076a0 0x7f5b780747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b7ea77640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7810eb50 con 0x7f5b781016a0 2024-08-31T05:17:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b7ea77640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7810e9d0 con 0x7f5b781076a0 2024-08-31T05:17:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b7c813640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b781016a0 0x7f5b78074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:42.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b7c813640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b781016a0 0x7f5b78074290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55282/0 (socket says 172.21.15.67:55282) 2024-08-31T05:17:42.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b7c813640 1 -- 172.21.15.67:0/1435398495 learned_addr learned my addr 172.21.15.67:0/1435398495 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:42.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b77fff640 1 --2- 172.21.15.67:0/1435398495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b781076a0 0x7f5b780747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:42.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b7c813640 1 -- 172.21.15.67:0/1435398495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b781076a0 msgr2=0x7f5b780747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:42.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b7c813640 1 --2- 172.21.15.67:0/1435398495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b781076a0 0x7f5b780747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:42.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b7c813640 1 -- 172.21.15.67:0/1435398495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b78074d10 con 0x7f5b781016a0 2024-08-31T05:17:42.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b7c813640 1 --2- 172.21.15.67:0/1435398495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b781016a0 0x7f5b78074290 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c810 tx=0x7f5b6800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:42.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b75ffb640 1 -- 172.21.15.67:0/1435398495 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b68004020 con 0x7f5b781016a0 2024-08-31T05:17:42.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b7ea77640 1 -- 172.21.15.67:0/1435398495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b78075000 con 0x7f5b781016a0 2024-08-31T05:17:42.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b75ffb640 1 -- 172.21.15.67:0/1435398495 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b680041c0 con 0x7f5b781016a0 2024-08-31T05:17:42.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b75ffb640 1 -- 172.21.15.67:0/1435398495 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b680047a0 con 0x7f5b781016a0 2024-08-31T05:17:42.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.402+0000 7f5b7ea77640 1 -- 172.21.15.67:0/1435398495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b781a3bf0 con 0x7f5b781016a0 2024-08-31T05:17:42.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.404+0000 7f5b7ea77640 1 -- 172.21.15.67:0/1435398495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b78102de0 con 0x7f5b781016a0 2024-08-31T05:17:42.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.404+0000 7f5b75ffb640 1 -- 172.21.15.67:0/1435398495 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f5b680079b0 con 0x7f5b781016a0 2024-08-31T05:17:42.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.404+0000 7f5b75ffb640 1 --2- 172.21.15.67:0/1435398495 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f5b6406de30 0x7f5b640702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:42.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.405+0000 7f5b75ffb640 1 -- 172.21.15.67:0/1435398495 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f5b6808d730 con 0x7f5b781016a0 2024-08-31T05:17:42.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.405+0000 7f5b77fff640 1 --2- 172.21.15.67:0/1435398495 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f5b6406de30 0x7f5b640702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:42.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.405+0000 7f5b77fff640 1 --2- 172.21.15.67:0/1435398495 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f5b6406de30 0x7f5b640702f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b60031460 tx=0x7f5b60009560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:42.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.409+0000 7f5b75ffb640 1 -- 172.21.15.67:0/1435398495 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5b68014030 con 0x7f5b781016a0 2024-08-31T05:17:42.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:42 smithi073 ceph-mon[24726]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:42.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:42 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:17:42.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.587+0000 7f5b7ea77640 1 -- 172.21.15.67:0/1435398495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f5b78101b00 con 0x7f5b781016a0 2024-08-31T05:17:42.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.588+0000 7f5b75ffb640 1 -- 172.21.15.67:0/1435398495 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v41) ==== 86+0+187 (secure 0 0 0) 0x7f5b6805b610 con 0x7f5b781016a0 2024-08-31T05:17:42.590 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:17:42.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.590+0000 7f5b7ea77640 1 -- 172.21.15.67:0/1435398495 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f5b6406de30 msgr2=0x7f5b640702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:42.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.590+0000 7f5b7ea77640 1 --2- 172.21.15.67:0/1435398495 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f5b6406de30 0x7f5b640702f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b60031460 tx=0x7f5b60009560 comp rx=0 tx=0).stop 2024-08-31T05:17:42.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.590+0000 7f5b7ea77640 1 -- 172.21.15.67:0/1435398495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b781016a0 msgr2=0x7f5b78074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:42.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.590+0000 7f5b7ea77640 1 --2- 172.21.15.67:0/1435398495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b781016a0 0x7f5b78074290 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c810 tx=0x7f5b6800ccd0 comp rx=0 tx=0).stop 2024-08-31T05:17:42.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.590+0000 7f5b7ea77640 1 -- 172.21.15.67:0/1435398495 shutdown_connections 2024-08-31T05:17:42.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.590+0000 7f5b7ea77640 1 --2- 172.21.15.67:0/1435398495 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f5b6406de30 0x7f5b640702f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:42.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.590+0000 7f5b7ea77640 1 --2- 172.21.15.67:0/1435398495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b781076a0 0x7f5b780747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:42.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.590+0000 7f5b7ea77640 1 --2- 172.21.15.67:0/1435398495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b781016a0 0x7f5b78074290 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:42.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.590+0000 7f5b7ea77640 1 -- 172.21.15.67:0/1435398495 >> 172.21.15.67:0/1435398495 conn(0x7f5b780fd3a0 msgr2=0x7f5b780fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:42.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.590+0000 7f5b7ea77640 1 -- 172.21.15.67:0/1435398495 shutdown_connections 2024-08-31T05:17:42.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:42.590+0000 7f5b7ea77640 1 -- 172.21.15.67:0/1435398495 wait complete. 2024-08-31T05:17:43.286 INFO:teuthology.orchestra.run.smithi067.stdout:[{"version":41,"timestamp":"2024-08-31T05:17:31.882204+0000","name":"","changes":[{"name":"osd/host:smithi073/osd_memory_target","previous_value":"7818220134","new_value":"5212146756"}]}] 2024-08-31T05:17:43.286 INFO:tasks.ceph_manager:config epoch is 41 2024-08-31T05:17:43.286 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-31T05:17:43.287 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-31T05:17:43.287 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph mgr dump --format=json 2024-08-31T05:17:43.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:43 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1435398495' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-08-31T05:17:43.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:43 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1435398495' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-08-31T05:17:43.537 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:43.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.931+0000 7fc8ce75f640 1 -- 172.21.15.67:0/1210667874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8c8102860 msgr2=0x7fc8c8102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:43.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.931+0000 7fc8ce75f640 1 --2- 172.21.15.67:0/1210667874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8c8102860 0x7fc8c8102c40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009880 tx=0x7fc8b802a530 comp rx=0 tx=0).stop 2024-08-31T05:17:43.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.931+0000 7fc8ce75f640 1 -- 172.21.15.67:0/1210667874 shutdown_connections 2024-08-31T05:17:43.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.931+0000 7fc8ce75f640 1 --2- 172.21.15.67:0/1210667874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c8103180 0x7fc8c810b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:43.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.931+0000 7fc8ce75f640 1 --2- 172.21.15.67:0/1210667874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8c8102860 0x7fc8c8102c40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:43.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.931+0000 7fc8ce75f640 1 -- 172.21.15.67:0/1210667874 >> 172.21.15.67:0/1210667874 conn(0x7fc8c80fc2c0 msgr2=0x7fc8c80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:43.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.931+0000 7fc8ce75f640 1 -- 172.21.15.67:0/1210667874 shutdown_connections 2024-08-31T05:17:43.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.931+0000 7fc8ce75f640 1 -- 172.21.15.67:0/1210667874 wait complete. 2024-08-31T05:17:43.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.932+0000 7fc8ce75f640 1 Processor -- start 2024-08-31T05:17:43.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.932+0000 7fc8ce75f640 1 -- start start 2024-08-31T05:17:43.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.932+0000 7fc8ce75f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8c8102860 0x7fc8c819f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:43.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.932+0000 7fc8ce75f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c8103180 0x7fc8c819fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:43.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.932+0000 7fc8ce75f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c810eb70 con 0x7fc8c8102860 2024-08-31T05:17:43.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.932+0000 7fc8ce75f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c810e9f0 con 0x7fc8c8103180 2024-08-31T05:17:43.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.932+0000 7fc8c7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8c8102860 0x7fc8c819f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:43.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.932+0000 7fc8c7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8c8102860 0x7fc8c819f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55292/0 (socket says 172.21.15.67:55292) 2024-08-31T05:17:43.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.932+0000 7fc8c7fff640 1 -- 172.21.15.67:0/3111473315 learned_addr learned my addr 172.21.15.67:0/3111473315 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:43.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.932+0000 7fc8c77fe640 1 --2- 172.21.15.67:0/3111473315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c8103180 0x7fc8c819fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:43.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.933+0000 7fc8c7fff640 1 -- 172.21.15.67:0/3111473315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c8103180 msgr2=0x7fc8c819fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:43.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.933+0000 7fc8c7fff640 1 --2- 172.21.15.67:0/3111473315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c8103180 0x7fc8c819fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:43.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.933+0000 7fc8c7fff640 1 -- 172.21.15.67:0/3111473315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c8199770 con 0x7fc8c8102860 2024-08-31T05:17:43.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.933+0000 7fc8c7fff640 1 --2- 172.21.15.67:0/3111473315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8c8102860 0x7fc8c819f6a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8031460 tx=0x7fc8b80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:43.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.933+0000 7fc8c57fa640 1 -- 172.21.15.67:0/3111473315 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8b803f070 con 0x7fc8c8102860 2024-08-31T05:17:43.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.933+0000 7fc8ce75f640 1 -- 172.21.15.67:0/3111473315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c8199a00 con 0x7fc8c8102860 2024-08-31T05:17:43.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.933+0000 7fc8c57fa640 1 -- 172.21.15.67:0/3111473315 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc8b80035f0 con 0x7fc8c8102860 2024-08-31T05:17:43.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.933+0000 7fc8c57fa640 1 -- 172.21.15.67:0/3111473315 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8b8035030 con 0x7fc8c8102860 2024-08-31T05:17:43.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.933+0000 7fc8ce75f640 1 -- 172.21.15.67:0/3111473315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c8199f00 con 0x7fc8c8102860 2024-08-31T05:17:43.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.934+0000 7fc8ce75f640 1 -- 172.21.15.67:0/3111473315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c806a830 con 0x7fc8c8102860 2024-08-31T05:17:43.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.935+0000 7fc8c57fa640 1 -- 172.21.15.67:0/3111473315 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fc8b8042070 con 0x7fc8c8102860 2024-08-31T05:17:43.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.935+0000 7fc8c57fa640 1 --2- 172.21.15.67:0/3111473315 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fc8b006de30 0x7fc8b00702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:43.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.935+0000 7fc8c57fa640 1 -- 172.21.15.67:0/3111473315 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fc8b8079a90 con 0x7fc8c8102860 2024-08-31T05:17:43.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.935+0000 7fc8c77fe640 1 --2- 172.21.15.67:0/3111473315 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fc8b006de30 0x7fc8b00702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:43.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.936+0000 7fc8c77fe640 1 --2- 172.21.15.67:0/3111473315 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fc8b006de30 0x7fc8b00702f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0058c0 tx=0x7fc8bc005850 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:43.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:43.940+0000 7fc8c57fa640 1 -- 172.21.15.67:0/3111473315 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc8b807fda0 con 0x7fc8c8102860 2024-08-31T05:17:44.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:44.163+0000 7fc8ce75f640 1 -- 172.21.15.67:0/3111473315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc8c810b140 con 0x7fc8c8102860 2024-08-31T05:17:44.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:44.166+0000 7fc8c57fa640 1 -- 172.21.15.67:0/3111473315 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+175998 (secure 0 0 0) 0x7fc8b80845d0 con 0x7fc8c8102860 2024-08-31T05:17:44.171 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:17:44.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:44.170+0000 7fc8ce75f640 1 -- 172.21.15.67:0/3111473315 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fc8b006de30 msgr2=0x7fc8b00702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:44.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:44.170+0000 7fc8ce75f640 1 --2- 172.21.15.67:0/3111473315 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fc8b006de30 0x7fc8b00702f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0058c0 tx=0x7fc8bc005850 comp rx=0 tx=0).stop 2024-08-31T05:17:44.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:44.170+0000 7fc8ce75f640 1 -- 172.21.15.67:0/3111473315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8c8102860 msgr2=0x7fc8c819f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:44.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:44.170+0000 7fc8ce75f640 1 --2- 172.21.15.67:0/3111473315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8c8102860 0x7fc8c819f6a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8031460 tx=0x7fc8b80045e0 comp rx=0 tx=0).stop 2024-08-31T05:17:44.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:44.170+0000 7fc8ce75f640 1 -- 172.21.15.67:0/3111473315 shutdown_connections 2024-08-31T05:17:44.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:44.170+0000 7fc8ce75f640 1 --2- 172.21.15.67:0/3111473315 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fc8b006de30 0x7fc8b00702f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:44.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:44.170+0000 7fc8ce75f640 1 --2- 172.21.15.67:0/3111473315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8c8103180 0x7fc8c819fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:44.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:44.170+0000 7fc8ce75f640 1 --2- 172.21.15.67:0/3111473315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8c8102860 0x7fc8c819f6a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:44.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:44.170+0000 7fc8ce75f640 1 -- 172.21.15.67:0/3111473315 >> 172.21.15.67:0/3111473315 conn(0x7fc8c80fc2c0 msgr2=0x7fc8c81008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:44.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:44.170+0000 7fc8ce75f640 1 -- 172.21.15.67:0/3111473315 shutdown_connections 2024-08-31T05:17:44.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:44.170+0000 7fc8ce75f640 1 -- 172.21.15.67:0/3111473315 wait complete. 2024-08-31T05:17:44.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:44 smithi067 ceph-mon[17432]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:44.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:44 smithi073 ceph-mon[24726]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:44.794 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":19,"flags":0,"active_gid":14215,"active_name":"smithi067.hftacj","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2090251560},{"type":"v1","addr":"172.21.15.67:6801","nonce":2090251560}]},"active_addr":"172.21.15.67:6801/2090251560","active_change":"2024-08-31T05:13:41.288821+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14240,"name":"smithi073.zfoyxd","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.67:8443/","prometheus":"http://172.21.15.67:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":298845382}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":683720860}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":3820732856}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":1438563298}]}]} 2024-08-31T05:17:44.800 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-31T05:17:44.801 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-31T05:17:44.801 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:17:45.084 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:45.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:45 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3111473315' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-31T05:17:45.453 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:45 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3111473315' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-31T05:17:45.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.532+0000 7f40426fe640 1 -- 172.21.15.67:0/3493042163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f403c1005b0 msgr2=0x7f403c100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:45.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.532+0000 7f40426fe640 1 --2- 172.21.15.67:0/3493042163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f403c1005b0 0x7f403c100a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4024009880 tx=0x7f402402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:45.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.532+0000 7f40426fe640 1 -- 172.21.15.67:0/3493042163 shutdown_connections 2024-08-31T05:17:45.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.532+0000 7f40426fe640 1 --2- 172.21.15.67:0/3493042163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f403c1005b0 0x7f403c100a10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:45.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.532+0000 7f40426fe640 1 --2- 172.21.15.67:0/3493042163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f403c106660 0x7f403c106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:45.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.532+0000 7f40426fe640 1 -- 172.21.15.67:0/3493042163 >> 172.21.15.67:0/3493042163 conn(0x7f403c0fc2f0 msgr2=0x7f403c0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:45.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.532+0000 7f40426fe640 1 -- 172.21.15.67:0/3493042163 shutdown_connections 2024-08-31T05:17:45.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.532+0000 7f40426fe640 1 -- 172.21.15.67:0/3493042163 wait complete. 2024-08-31T05:17:45.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f40426fe640 1 Processor -- start 2024-08-31T05:17:45.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f40426fe640 1 -- start start 2024-08-31T05:17:45.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f40426fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f403c1005b0 0x7f403c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:45.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f40426fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f403c106660 0x7f403c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:45.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f40426fe640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f403c10dad0 con 0x7f403c1005b0 2024-08-31T05:17:45.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f40426fe640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f403c10d950 con 0x7f403c106660 2024-08-31T05:17:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f403bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f403c1005b0 0x7f403c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f403bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f403c1005b0 0x7f403c198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55316/0 (socket says 172.21.15.67:55316) 2024-08-31T05:17:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f403bfff640 1 -- 172.21.15.67:0/3656718474 learned_addr learned my addr 172.21.15.67:0/3656718474 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f403bfff640 1 -- 172.21.15.67:0/3656718474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f403c106660 msgr2=0x7f403c198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f4033fff640 1 --2- 172.21.15.67:0/3656718474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f403c106660 0x7f403c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f403bfff640 1 --2- 172.21.15.67:0/3656718474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f403c106660 0x7f403c198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f403bfff640 1 -- 172.21.15.67:0/3656718474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403c1990c0 con 0x7f403c1005b0 2024-08-31T05:17:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f403bfff640 1 --2- 172.21.15.67:0/3656718474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f403c1005b0 0x7f403c198580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f402c00b420 tx=0x7f402c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.533+0000 7f4039ffb640 1 -- 172.21.15.67:0/3656718474 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f402c011630 con 0x7f403c1005b0 2024-08-31T05:17:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.534+0000 7f4039ffb640 1 -- 172.21.15.67:0/3656718474 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f402c016070 con 0x7f403c1005b0 2024-08-31T05:17:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.534+0000 7f40426fe640 1 -- 172.21.15.67:0/3656718474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f403c1993b0 con 0x7f403c1005b0 2024-08-31T05:17:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.534+0000 7f4039ffb640 1 -- 172.21.15.67:0/3656718474 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f402c010d40 con 0x7f403c1005b0 2024-08-31T05:17:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.534+0000 7f40426fe640 1 -- 172.21.15.67:0/3656718474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f403c1a19b0 con 0x7f403c1005b0 2024-08-31T05:17:45.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.534+0000 7f40426fe640 1 -- 172.21.15.67:0/3656718474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f403c101cd0 con 0x7f403c1005b0 2024-08-31T05:17:45.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.535+0000 7f4039ffb640 1 -- 172.21.15.67:0/3656718474 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f402c01b460 con 0x7f403c1005b0 2024-08-31T05:17:45.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.535+0000 7f4039ffb640 1 --2- 172.21.15.67:0/3656718474 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f402806de90 0x7f4028070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:45.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.536+0000 7f4039ffb640 1 -- 172.21.15.67:0/3656718474 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f402c08d010 con 0x7f403c1005b0 2024-08-31T05:17:45.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.536+0000 7f4033fff640 1 --2- 172.21.15.67:0/3656718474 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f402806de90 0x7f4028070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:45.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.536+0000 7f4033fff640 1 --2- 172.21.15.67:0/3656718474 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f402806de90 0x7f4028070350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4024004f90 tx=0x7f4024009560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:45.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.540+0000 7f4039ffb640 1 -- 172.21.15.67:0/3656718474 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f403c1993b0 con 0x7f403c1005b0 2024-08-31T05:17:45.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.715+0000 7f40426fe640 1 -- 172.21.15.67:0/3656718474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f403c108a80 con 0x7f403c1005b0 2024-08-31T05:17:45.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.716+0000 7f4039ffb640 1 -- 172.21.15.67:0/3656718474 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+11312 (secure 0 0 0) 0x7f402c05af70 con 0x7f403c1005b0 2024-08-31T05:17:45.719 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:17:45.719 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":40,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","created":"2024-08-31T05:11:45.459538+0000","modified":"2024-08-31T05:17:33.549471+0000","last_up_change":"2024-08-31T05:17:32.542281+0000","last_in_change":"2024-08-31T05:17:09.866654+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:16:17.608366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"51d7e102-32dc-423d-815b-6a09ca75345d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3334523825},{"type":"v1","addr":"172.21.15.67:6803","nonce":3334523825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3334523825},{"type":"v1","addr":"172.21.15.67:6805","nonce":3334523825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3334523825},{"type":"v1","addr":"172.21.15.67:6809","nonce":3334523825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3334523825},{"type":"v1","addr":"172.21.15.67:6807","nonce":3334523825}]},"public_addr":"172.21.15.67:6803/3334523825","cluster_addr":"172.21.15.67:6805/3334523825","heartbeat_back_addr":"172.21.15.67:6809/3334523825","heartbeat_front_addr":"172.21.15.67:6807/3334523825","state":["exists","up"]},{"osd":1,"uuid":"fd0426c7-f84f-401b-b22f-51e7f5480c70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":9049055},{"type":"v1","addr":"172.21.15.67:6811","nonce":9049055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":9049055},{"type":"v1","addr":"172.21.15.67:6813","nonce":9049055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":9049055},{"type":"v1","addr":"172.21.15.67:6817","nonce":9049055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":9049055},{"type":"v1","addr":"172.21.15.67:6815","nonce":9049055}]},"public_addr":"172.21.15.67:6811/9049055","cluster_addr":"172.21.15.67:6813/9049055","heartbeat_back_addr":"172.21.15.67:6817/9049055","heartbeat_front_addr":"172.21.15.67:6815/9049055","state":["exists","up"]},{"osd":2,"uuid":"9f6476c9-839c-43b1-9a8e-bf77683c5a3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":398055695},{"type":"v1","addr":"172.21.15.67:6819","nonce":398055695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":398055695},{"type":"v1","addr":"172.21.15.67:6821","nonce":398055695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":398055695},{"type":"v1","addr":"172.21.15.67:6825","nonce":398055695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":398055695},{"type":"v1","addr":"172.21.15.67:6823","nonce":398055695}]},"public_addr":"172.21.15.67:6819/398055695","cluster_addr":"172.21.15.67:6821/398055695","heartbeat_back_addr":"172.21.15.67:6825/398055695","heartbeat_front_addr":"172.21.15.67:6823/398055695","state":["exists","up"]},{"osd":3,"uuid":"712d22a6-cf93-44f0-8ead-e482fd158859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3773655535},{"type":"v1","addr":"172.21.15.73:6801","nonce":3773655535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3773655535},{"type":"v1","addr":"172.21.15.73:6803","nonce":3773655535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3773655535},{"type":"v1","addr":"172.21.15.73:6807","nonce":3773655535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3773655535},{"type":"v1","addr":"172.21.15.73:6805","nonce":3773655535}]},"public_addr":"172.21.15.73:6801/3773655535","cluster_addr":"172.21.15.73:6803/3773655535","heartbeat_back_addr":"172.21.15.73:6807/3773655535","heartbeat_front_addr":"172.21.15.73:6805/3773655535","state":["exists","up"]},{"osd":4,"uuid":"53d31201-7801-42d2-b4d5-cdaa89525353","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":411912217},{"type":"v1","addr":"172.21.15.73:6809","nonce":411912217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":411912217},{"type":"v1","addr":"172.21.15.73:6811","nonce":411912217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":411912217},{"type":"v1","addr":"172.21.15.73:6815","nonce":411912217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":411912217},{"type":"v1","addr":"172.21.15.73:6813","nonce":411912217}]},"public_addr":"172.21.15.73:6809/411912217","cluster_addr":"172.21.15.73:6811/411912217","heartbeat_back_addr":"172.21.15.73:6815/411912217","heartbeat_front_addr":"172.21.15.73:6813/411912217","state":["exists","up"]},{"osd":5,"uuid":"1c41359a-c1da-444b-afcc-eb0d8eb017ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2922014039},{"type":"v1","addr":"172.21.15.73:6817","nonce":2922014039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2922014039},{"type":"v1","addr":"172.21.15.73:6819","nonce":2922014039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2922014039},{"type":"v1","addr":"172.21.15.73:6823","nonce":2922014039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2922014039},{"type":"v1","addr":"172.21.15.73:6821","nonce":2922014039}]},"public_addr":"172.21.15.73:6817/2922014039","cluster_addr":"172.21.15.73:6819/2922014039","heartbeat_back_addr":"172.21.15.73:6823/2922014039","heartbeat_front_addr":"172.21.15.73:6821/2922014039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:15:16.610562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:15:45.628166+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:16:13.473306+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:16:37.970940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:17:04.480428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:17:30.746725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:0/3326210547":"2024-09-01T05:13:41.288702+0000","172.21.15.67:0/3782915644":"2024-09-01T05:12:13.010409+0000","172.21.15.67:6801/4159467749":"2024-09-01T05:12:13.010409+0000","172.21.15.67:0/3624769860":"2024-09-01T05:13:41.288702+0000","172.21.15.67:0/2838724829":"2024-09-01T05:12:45.310890+0000","172.21.15.67:0/743586046":"2024-09-01T05:12:13.010409+0000","172.21.15.67:0/2529430863":"2024-09-01T05:12:45.310890+0000","172.21.15.67:6800/4159467749":"2024-09-01T05:12:13.010409+0000","172.21.15.67:6801/1741828555":"2024-09-01T05:13:41.288702+0000","172.21.15.67:6801/2323558682":"2024-09-01T05:12:45.310890+0000","172.21.15.67:0/3787377150":"2024-09-01T05:13:41.288702+0000","172.21.15.67:6800/2323558682":"2024-09-01T05:12:45.310890+0000","172.21.15.67:6800/1741828555":"2024-09-01T05:13:41.288702+0000","172.21.15.67:0/3246639847":"2024-09-01T05:12:13.010409+0000","172.21.15.67:0/4268636965":"2024-09-01T05:12:45.310890+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:17:45.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.718+0000 7f40426fe640 1 -- 172.21.15.67:0/3656718474 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f402806de90 msgr2=0x7f4028070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:45.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.718+0000 7f40426fe640 1 --2- 172.21.15.67:0/3656718474 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f402806de90 0x7f4028070350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4024004f90 tx=0x7f4024009560 comp rx=0 tx=0).stop 2024-08-31T05:17:45.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.718+0000 7f40426fe640 1 -- 172.21.15.67:0/3656718474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f403c1005b0 msgr2=0x7f403c198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:45.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.718+0000 7f40426fe640 1 --2- 172.21.15.67:0/3656718474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f403c1005b0 0x7f403c198580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f402c00b420 tx=0x7f402c00b8e0 comp rx=0 tx=0).stop 2024-08-31T05:17:45.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.718+0000 7f40426fe640 1 -- 172.21.15.67:0/3656718474 shutdown_connections 2024-08-31T05:17:45.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.718+0000 7f40426fe640 1 --2- 172.21.15.67:0/3656718474 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f402806de90 0x7f4028070350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:45.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.718+0000 7f40426fe640 1 --2- 172.21.15.67:0/3656718474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f403c106660 0x7f403c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:45.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.718+0000 7f40426fe640 1 --2- 172.21.15.67:0/3656718474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f403c1005b0 0x7f403c198580 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:45.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.718+0000 7f40426fe640 1 -- 172.21.15.67:0/3656718474 >> 172.21.15.67:0/3656718474 conn(0x7f403c0fc2f0 msgr2=0x7f403c0fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:45.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.718+0000 7f40426fe640 1 -- 172.21.15.67:0/3656718474 shutdown_connections 2024-08-31T05:17:45.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:45.718+0000 7f40426fe640 1 -- 172.21.15.67:0/3656718474 wait complete. 2024-08-31T05:17:46.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:46 smithi067 ceph-mon[17432]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:46.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:46 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3656718474' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T05:17:46.436 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-31T05:17:46.437 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:17:46.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:46 smithi073 ceph-mon[24726]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:46.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:46 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3656718474' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T05:17:46.687 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:47.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.087+0000 7f7db473c640 1 -- 172.21.15.67:0/640728619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dac1076a0 msgr2=0x7f7dac107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:47.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.087+0000 7f7db473c640 1 --2- 172.21.15.67:0/640728619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dac1076a0 0x7f7dac107a80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009880 tx=0x7f7da002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:47.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.088+0000 7f7db473c640 1 -- 172.21.15.67:0/640728619 shutdown_connections 2024-08-31T05:17:47.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.088+0000 7f7db473c640 1 --2- 172.21.15.67:0/640728619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dac1016a0 0x7f7dac101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:47.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.088+0000 7f7db473c640 1 --2- 172.21.15.67:0/640728619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dac1076a0 0x7f7dac107a80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:47.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.088+0000 7f7db473c640 1 -- 172.21.15.67:0/640728619 >> 172.21.15.67:0/640728619 conn(0x7f7dac0fd380 msgr2=0x7f7dac0ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:47.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.088+0000 7f7db473c640 1 -- 172.21.15.67:0/640728619 shutdown_connections 2024-08-31T05:17:47.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.088+0000 7f7db473c640 1 -- 172.21.15.67:0/640728619 wait complete. 2024-08-31T05:17:47.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.088+0000 7f7db473c640 1 Processor -- start 2024-08-31T05:17:47.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.088+0000 7f7db473c640 1 -- start start 2024-08-31T05:17:47.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db473c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dac1016a0 0x7f7dac19d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:47.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db473c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dac1076a0 0x7f7dac19d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:47.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db473c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac10ebd0 con 0x7f7dac1076a0 2024-08-31T05:17:47.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db473c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac10ea50 con 0x7f7dac1016a0 2024-08-31T05:17:47.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db1cd7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dac1076a0 0x7f7dac19d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:47.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db1cd7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dac1076a0 0x7f7dac19d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55334/0 (socket says 172.21.15.67:55334) 2024-08-31T05:17:47.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db1cd7640 1 -- 172.21.15.67:0/569069981 learned_addr learned my addr 172.21.15.67:0/569069981 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:47.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db24d8640 1 --2- 172.21.15.67:0/569069981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dac1016a0 0x7f7dac19d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:47.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db1cd7640 1 -- 172.21.15.67:0/569069981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dac1016a0 msgr2=0x7f7dac19d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:47.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db1cd7640 1 --2- 172.21.15.67:0/569069981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dac1016a0 0x7f7dac19d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:47.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db1cd7640 1 -- 172.21.15.67:0/569069981 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac1975a0 con 0x7f7dac1076a0 2024-08-31T05:17:47.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db24d8640 1 --2- 172.21.15.67:0/569069981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dac1016a0 0x7f7dac19d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:17:47.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db1cd7640 1 --2- 172.21.15.67:0/569069981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dac1076a0 0x7f7dac19d920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7da800b420 tx=0x7f7da800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:47.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7d9f7fe640 1 -- 172.21.15.67:0/569069981 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7da8011630 con 0x7f7dac1076a0 2024-08-31T05:17:47.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db473c640 1 -- 172.21.15.67:0/569069981 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dac197890 con 0x7f7dac1076a0 2024-08-31T05:17:47.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7d9f7fe640 1 -- 172.21.15.67:0/569069981 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7da8016070 con 0x7f7dac1076a0 2024-08-31T05:17:47.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7d9f7fe640 1 -- 172.21.15.67:0/569069981 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7da8010d40 con 0x7f7dac1076a0 2024-08-31T05:17:47.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.089+0000 7f7db473c640 1 -- 172.21.15.67:0/569069981 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dac197e20 con 0x7f7dac1076a0 2024-08-31T05:17:47.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.090+0000 7f7db473c640 1 -- 172.21.15.67:0/569069981 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dac102de0 con 0x7f7dac1076a0 2024-08-31T05:17:47.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.091+0000 7f7d9f7fe640 1 -- 172.21.15.67:0/569069981 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f7da801b460 con 0x7f7dac1076a0 2024-08-31T05:17:47.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.091+0000 7f7d9f7fe640 1 --2- 172.21.15.67:0/569069981 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f7d9806de30 0x7f7d980702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:47.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.091+0000 7f7d9f7fe640 1 -- 172.21.15.67:0/569069981 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f7da808d0a0 con 0x7f7dac1076a0 2024-08-31T05:17:47.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.091+0000 7f7db24d8640 1 --2- 172.21.15.67:0/569069981 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f7d9806de30 0x7f7d980702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:47.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.092+0000 7f7db24d8640 1 --2- 172.21.15.67:0/569069981 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f7d9806de30 0x7f7d980702f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7da0000c00 tx=0x7f7da0031400 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:47.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.096+0000 7f7d9f7fe640 1 -- 172.21.15.67:0/569069981 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7da805af80 con 0x7f7dac1076a0 2024-08-31T05:17:47.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.272+0000 7f7db473c640 1 -- 172.21.15.67:0/569069981 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7dac198ad0 con 0x7f7dac1076a0 2024-08-31T05:17:47.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.273+0000 7f7d9f7fe640 1 -- 172.21.15.67:0/569069981 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+11312 (secure 0 0 0) 0x7f7da808be20 con 0x7f7dac1076a0 2024-08-31T05:17:47.276 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:17:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":40,"fsid":"5fd95148-6757-11ef-bcd4-c7b262605968","created":"2024-08-31T05:11:45.459538+0000","modified":"2024-08-31T05:17:33.549471+0000","last_up_change":"2024-08-31T05:17:32.542281+0000","last_in_change":"2024-08-31T05:17:09.866654+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:16:17.608366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"51d7e102-32dc-423d-815b-6a09ca75345d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3334523825},{"type":"v1","addr":"172.21.15.67:6803","nonce":3334523825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3334523825},{"type":"v1","addr":"172.21.15.67:6805","nonce":3334523825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3334523825},{"type":"v1","addr":"172.21.15.67:6809","nonce":3334523825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3334523825},{"type":"v1","addr":"172.21.15.67:6807","nonce":3334523825}]},"public_addr":"172.21.15.67:6803/3334523825","cluster_addr":"172.21.15.67:6805/3334523825","heartbeat_back_addr":"172.21.15.67:6809/3334523825","heartbeat_front_addr":"172.21.15.67:6807/3334523825","state":["exists","up"]},{"osd":1,"uuid":"fd0426c7-f84f-401b-b22f-51e7f5480c70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":9049055},{"type":"v1","addr":"172.21.15.67:6811","nonce":9049055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":9049055},{"type":"v1","addr":"172.21.15.67:6813","nonce":9049055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":9049055},{"type":"v1","addr":"172.21.15.67:6817","nonce":9049055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":9049055},{"type":"v1","addr":"172.21.15.67:6815","nonce":9049055}]},"public_addr":"172.21.15.67:6811/9049055","cluster_addr":"172.21.15.67:6813/9049055","heartbeat_back_addr":"172.21.15.67:6817/9049055","heartbeat_front_addr":"172.21.15.67:6815/9049055","state":["exists","up"]},{"osd":2,"uuid":"9f6476c9-839c-43b1-9a8e-bf77683c5a3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":398055695},{"type":"v1","addr":"172.21.15.67:6819","nonce":398055695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":398055695},{"type":"v1","addr":"172.21.15.67:6821","nonce":398055695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":398055695},{"type":"v1","addr":"172.21.15.67:6825","nonce":398055695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":398055695},{"type":"v1","addr":"172.21.15.67:6823","nonce":398055695}]},"public_addr":"172.21.15.67:6819/398055695","cluster_addr":"172.21.15.67:6821/398055695","heartbeat_back_addr":"172.21.15.67:6825/398055695","heartbeat_front_addr":"172.21.15.67:6823/398055695","state":["exists","up"]},{"osd":3,"uuid":"712d22a6-cf93-44f0-8ead-e482fd158859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3773655535},{"type":"v1","addr":"172.21.15.73:6801","nonce":3773655535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3773655535},{"type":"v1","addr":"172.21.15.73:6803","nonce":3773655535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3773655535},{"type":"v1","addr":"172.21.15.73:6807","nonce":3773655535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3773655535},{"type":"v1","addr":"172.21.15.73:6805","nonce":3773655535}]},"public_addr":"172.21.15.73:6801/3773655535","cluster_addr":"172.21.15.73:6803/3773655535","heartbeat_back_addr":"172.21.15.73:6807/3773655535","heartbeat_front_addr":"172.21.15.73:6805/3773655535","state":["exists","up"]},{"osd":4,"uuid":"53d31201-7801-42d2-b4d5-cdaa89525353","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":411912217},{"type":"v1","addr":"172.21.15.73:6809","nonce":411912217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":411912217},{"type":"v1","addr":"172.21.15.73:6811","nonce":411912217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":411912217},{"type":"v1","addr":"172.21.15.73:6815","nonce":411912217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":411912217},{"type":"v1","addr":"172.21.15.73:6813","nonce":411912217}]},"public_addr":"172.21.15.73:6809/411912217","cluster_addr":"172.21.15.73:6811/411912217","heartbeat_back_addr":"172.21.15.73:6815/411912217","heartbeat_front_addr":"172.21.15.73:6813/411912217","state":["exists","up"]},{"osd":5,"uuid":"1c41359a-c1da-444b-afcc-eb0d8eb017ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":2922014039},{"type":"v1","addr":"172.21.15.73:6817","nonce":2922014039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2922014039},{"type":"v1","addr":"172.21.15.73:6819","nonce":2922014039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2922014039},{"type":"v1","addr":"172.21.15.73:6823","nonce":2922014039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2922014039},{"type":"v1","addr":"172.21.15.73:6821","nonce":2922014039}]},"public_addr":"172.21.15.73:6817/2922014039","cluster_addr":"172.21.15.73:6819/2922014039","heartbeat_back_addr":"172.21.15.73:6823/2922014039","heartbeat_front_addr":"172.21.15.73:6821/2922014039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:15:16.610562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:15:45.628166+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:16:13.473306+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:16:37.970940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:17:04.480428+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:17:30.746725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:0/3326210547":"2024-09-01T05:13:41.288702+0000","172.21.15.67:0/3782915644":"2024-09-01T05:12:13.010409+0000","172.21.15.67:6801/4159467749":"2024-09-01T05:12:13.010409+0000","172.21.15.67:0/3624769860":"2024-09-01T05:13:41.288702+0000","172.21.15.67:0/2838724829":"2024-09-01T05:12:45.310890+0000","172.21.15.67:0/743586046":"2024-09-01T05:12:13.010409+0000","172.21.15.67:0/2529430863":"2024-09-01T05:12:45.310890+0000","172.21.15.67:6800/4159467749":"2024-09-01T05:12:13.010409+0000","172.21.15.67:6801/1741828555":"2024-09-01T05:13:41.288702+0000","172.21.15.67:6801/2323558682":"2024-09-01T05:12:45.310890+0000","172.21.15.67:0/3787377150":"2024-09-01T05:13:41.288702+0000","172.21.15.67:6800/2323558682":"2024-09-01T05:12:45.310890+0000","172.21.15.67:6800/1741828555":"2024-09-01T05:13:41.288702+0000","172.21.15.67:0/3246639847":"2024-09-01T05:12:13.010409+0000","172.21.15.67:0/4268636965":"2024-09-01T05:12:45.310890+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:17:47.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.275+0000 7f7db473c640 1 -- 172.21.15.67:0/569069981 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f7d9806de30 msgr2=0x7f7d980702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:47.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.275+0000 7f7db473c640 1 --2- 172.21.15.67:0/569069981 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f7d9806de30 0x7f7d980702f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7da0000c00 tx=0x7f7da0031400 comp rx=0 tx=0).stop 2024-08-31T05:17:47.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.275+0000 7f7db473c640 1 -- 172.21.15.67:0/569069981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dac1076a0 msgr2=0x7f7dac19d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:47.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.275+0000 7f7db473c640 1 --2- 172.21.15.67:0/569069981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dac1076a0 0x7f7dac19d920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7da800b420 tx=0x7f7da800b8e0 comp rx=0 tx=0).stop 2024-08-31T05:17:47.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.275+0000 7f7db473c640 1 -- 172.21.15.67:0/569069981 shutdown_connections 2024-08-31T05:17:47.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.275+0000 7f7db473c640 1 --2- 172.21.15.67:0/569069981 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f7d9806de30 0x7f7d980702f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:47.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.275+0000 7f7db473c640 1 --2- 172.21.15.67:0/569069981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dac1076a0 0x7f7dac19d920 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:47.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.275+0000 7f7db473c640 1 --2- 172.21.15.67:0/569069981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7dac1016a0 0x7f7dac19d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:47.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.275+0000 7f7db473c640 1 -- 172.21.15.67:0/569069981 >> 172.21.15.67:0/569069981 conn(0x7f7dac0fd380 msgr2=0x7f7dac0fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:47.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.275+0000 7f7db473c640 1 -- 172.21.15.67:0/569069981 shutdown_connections 2024-08-31T05:17:47.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:47.275+0000 7f7db473c640 1 -- 172.21.15.67:0/569069981 wait complete. 2024-08-31T05:17:47.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:47 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/569069981' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T05:17:47.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:47 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/569069981' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T05:17:48.027 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-31T05:17:48.028 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-31T05:17:48.028 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-31T05:17:48.028 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-31T05:17:48.029 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-31T05:17:48.029 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-31T05:17:48.323 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:48.329 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:48.602 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:48 smithi067 ceph-mon[17432]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:48.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:48 smithi073 ceph-mon[24726]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:49.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.100+0000 7f2ff9a35640 1 -- 172.21.15.67:0/1268115183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff41005c0 msgr2=0x7f2ff4100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:49.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.100+0000 7f2ff9a35640 1 --2- 172.21.15.67:0/1268115183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff41005c0 0x7f2ff4100a20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009880 tx=0x7f2fe402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.101+0000 7f2ff9a35640 1 -- 172.21.15.67:0/1268115183 shutdown_connections 2024-08-31T05:17:49.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.101+0000 7f2ff9a35640 1 --2- 172.21.15.67:0/1268115183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff41005c0 0x7f2ff4100a20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.101+0000 7f2ff9a35640 1 --2- 172.21.15.67:0/1268115183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff4106670 0x7f2ff4106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.101+0000 7f2ff9a35640 1 -- 172.21.15.67:0/1268115183 >> 172.21.15.67:0/1268115183 conn(0x7f2ff40fc2c0 msgr2=0x7f2ff40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:49.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.101+0000 7f2ff9a35640 1 -- 172.21.15.67:0/1268115183 shutdown_connections 2024-08-31T05:17:49.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.101+0000 7f2ff9a35640 1 -- 172.21.15.67:0/1268115183 wait complete. 2024-08-31T05:17:49.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.101+0000 7f2ff9a35640 1 Processor -- start 2024-08-31T05:17:49.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.101+0000 7f2ff9a35640 1 -- start start 2024-08-31T05:17:49.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff9a35640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff41005c0 0x7f2ff4197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:49.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff9a35640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff4106670 0x7f2ff4197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff9a35640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff410dae0 con 0x7f2ff4106670 2024-08-31T05:17:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff9a35640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff410d960 con 0x7f2ff41005c0 2024-08-31T05:17:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff27fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff4106670 0x7f2ff4197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff27fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff4106670 0x7f2ff4197c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39052/0 (socket says 172.21.15.67:39052) 2024-08-31T05:17:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff27fc640 1 -- 172.21.15.67:0/4074842907 learned_addr learned my addr 172.21.15.67:0/4074842907 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff2ffd640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff41005c0 0x7f2ff4197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff27fc640 1 -- 172.21.15.67:0/4074842907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff41005c0 msgr2=0x7f2ff4197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff27fc640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff41005c0 0x7f2ff4197710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff27fc640 1 -- 172.21.15.67:0/4074842907 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff419bfe0 con 0x7f2ff4106670 2024-08-31T05:17:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff27fc640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff4106670 0x7f2ff4197c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4004f90 tx=0x7f2fe40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff8a33640 1 -- 172.21.15.67:0/4074842907 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fe403f070 con 0x7f2ff4106670 2024-08-31T05:17:49.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff8a33640 1 -- 172.21.15.67:0/4074842907 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2fe4004cf0 con 0x7f2ff4106670 2024-08-31T05:17:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff9a35640 1 -- 172.21.15.67:0/4074842907 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff419c270 con 0x7f2ff4106670 2024-08-31T05:17:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff8a33640 1 -- 172.21.15.67:0/4074842907 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fe4035030 con 0x7f2ff4106670 2024-08-31T05:17:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.102+0000 7f2ff9a35640 1 -- 172.21.15.67:0/4074842907 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff419c820 con 0x7f2ff4106670 2024-08-31T05:17:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.103+0000 7f2ff9a35640 1 -- 172.21.15.67:0/4074842907 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ff419cde0 con 0x7f2ff4106670 2024-08-31T05:17:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.104+0000 7f2ff8a33640 1 -- 172.21.15.67:0/4074842907 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f2fe4042070 con 0x7f2ff4106670 2024-08-31T05:17:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.104+0000 7f2ff8a33640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f2fe006de30 0x7f2fe00702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.104+0000 7f2ff8a33640 1 -- 172.21.15.67:0/4074842907 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f2fe40ae2b0 con 0x7f2ff4106670 2024-08-31T05:17:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.104+0000 7f2ff2ffd640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f2fe006de30 0x7f2fe00702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.105+0000 7f2ff8a33640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.73:6808/411912217,v1:172.21.15.73:6809/411912217] conn(0x7f2fe0073c20 0x7f2fe0076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.105+0000 7f2ff8a33640 1 -- 172.21.15.67:0/4074842907 --> [v2:172.21.15.73:6808/411912217,v1:172.21.15.73:6809/411912217] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fe40054e0 con 0x7f2fe0073c20 2024-08-31T05:17:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.105+0000 7f2ff8a33640 1 -- 172.21.15.67:0/4074842907 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2fe40b5050 con 0x7f2ff4106670 2024-08-31T05:17:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.105+0000 7f2ff2ffd640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f2fe006de30 0x7f2fe00702f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009990 tx=0x7f2fdc009110 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:49.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.105+0000 7f2ff37fe640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.73:6808/411912217,v1:172.21.15.73:6809/411912217] conn(0x7f2fe0073c20 0x7f2fe0076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.105+0000 7f2ff37fe640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.73:6808/411912217,v1:172.21.15.73:6809/411912217] conn(0x7f2fe0073c20 0x7f2fe0076040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.106+0000 7f2ff8a33640 1 -- 172.21.15.67:0/4074842907 <== osd.4 v2:172.21.15.73:6808/411912217 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2fe40054e0 con 0x7f2fe0073c20 2024-08-31T05:17:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.120+0000 7f2ff9a35640 1 -- 172.21.15.67:0/4074842907 --> [v2:172.21.15.73:6808/411912217,v1:172.21.15.73:6809/411912217] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2ff406a220 con 0x7f2fe0073c20 2024-08-31T05:17:49.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.120+0000 7f2ff8a33640 1 -- 172.21.15.67:0/4074842907 <== osd.4 v2:172.21.15.73:6808/411912217 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2ff406a220 con 0x7f2fe0073c20 2024-08-31T05:17:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.120+0000 7f2ff9a35640 1 -- 172.21.15.67:0/4074842907 >> [v2:172.21.15.73:6808/411912217,v1:172.21.15.73:6809/411912217] conn(0x7f2fe0073c20 msgr2=0x7f2fe0076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.120+0000 7f2ff9a35640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.73:6808/411912217,v1:172.21.15.73:6809/411912217] conn(0x7f2fe0073c20 0x7f2fe0076040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.120+0000 7f2ff9a35640 1 -- 172.21.15.67:0/4074842907 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f2fe006de30 msgr2=0x7f2fe00702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.120+0000 7f2ff9a35640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f2fe006de30 0x7f2fe00702f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009990 tx=0x7f2fdc009110 comp rx=0 tx=0).stop 2024-08-31T05:17:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.120+0000 7f2ff9a35640 1 -- 172.21.15.67:0/4074842907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff4106670 msgr2=0x7f2ff4197c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.120+0000 7f2ff9a35640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff4106670 0x7f2ff4197c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4004f90 tx=0x7f2fe40048f0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.121+0000 7f2ff9a35640 1 -- 172.21.15.67:0/4074842907 shutdown_connections 2024-08-31T05:17:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.121+0000 7f2ff9a35640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.73:6808/411912217,v1:172.21.15.73:6809/411912217] conn(0x7f2fe0073c20 0x7f2fe0076040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.121+0000 7f2ff9a35640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f2fe006de30 0x7f2fe00702f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.121+0000 7f2ff9a35640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ff4106670 0x7f2ff4197c50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.121+0000 7f2ff9a35640 1 --2- 172.21.15.67:0/4074842907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff41005c0 0x7f2ff4197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.121+0000 7f2ff9a35640 1 -- 172.21.15.67:0/4074842907 >> 172.21.15.67:0/4074842907 conn(0x7f2ff40fc2c0 msgr2=0x7f2ff41048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.121+0000 7f2ff9a35640 1 -- 172.21.15.67:0/4074842907 shutdown_connections 2024-08-31T05:17:49.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.121+0000 7f2ff9a35640 1 -- 172.21.15.67:0/4074842907 wait complete. 2024-08-31T05:17:49.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.562+0000 7f85411c1640 1 -- 172.21.15.67:0/4248560528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f853c1005c0 msgr2=0x7f853c100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:49.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.562+0000 7f85411c1640 1 --2- 172.21.15.67:0/4248560528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f853c1005c0 0x7f853c100a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f852c009880 tx=0x7f852c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.562+0000 7f85411c1640 1 -- 172.21.15.67:0/4248560528 shutdown_connections 2024-08-31T05:17:49.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.562+0000 7f85411c1640 1 --2- 172.21.15.67:0/4248560528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f853c1005c0 0x7f853c100a20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.562+0000 7f85411c1640 1 --2- 172.21.15.67:0/4248560528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f853c106670 0x7f853c106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.562+0000 7f85411c1640 1 -- 172.21.15.67:0/4248560528 >> 172.21.15.67:0/4248560528 conn(0x7f853c0fc2c0 msgr2=0x7f853c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:49.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.562+0000 7f85411c1640 1 -- 172.21.15.67:0/4248560528 shutdown_connections 2024-08-31T05:17:49.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.562+0000 7f85411c1640 1 -- 172.21.15.67:0/4248560528 wait complete. 2024-08-31T05:17:49.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.563+0000 7f85411c1640 1 Processor -- start 2024-08-31T05:17:49.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.563+0000 7f85411c1640 1 -- start start 2024-08-31T05:17:49.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f85411c1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f853c1005c0 0x7f853c196640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:49.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f85411c1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f853c106670 0x7f853c196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:49.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f85411c1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f853c10dae0 con 0x7f853c1005c0 2024-08-31T05:17:49.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f85411c1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f853c10d960 con 0x7f853c106670 2024-08-31T05:17:49.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f853ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f853c1005c0 0x7f853c196640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:49.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f853ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f853c1005c0 0x7f853c196640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39080/0 (socket says 172.21.15.67:39080) 2024-08-31T05:17:49.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f853ad9d640 1 -- 172.21.15.67:0/1613997943 learned_addr learned my addr 172.21.15.67:0/1613997943 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:49.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f853a59c640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f853c106670 0x7f853c196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:49.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f853ad9d640 1 -- 172.21.15.67:0/1613997943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f853c106670 msgr2=0x7f853c196b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:49.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f853ad9d640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f853c106670 0x7f853c196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f853ad9d640 1 -- 172.21.15.67:0/1613997943 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f853c19af10 con 0x7f853c1005c0 2024-08-31T05:17:49.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f853ad9d640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f853c1005c0 0x7f853c196640 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f852400b420 tx=0x7f852400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:49.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f8533fff640 1 -- 172.21.15.67:0/1613997943 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8524011630 con 0x7f853c1005c0 2024-08-31T05:17:49.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f85411c1640 1 -- 172.21.15.67:0/1613997943 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f853c19b200 con 0x7f853c1005c0 2024-08-31T05:17:49.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f8533fff640 1 -- 172.21.15.67:0/1613997943 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8524016070 con 0x7f853c1005c0 2024-08-31T05:17:49.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f8533fff640 1 -- 172.21.15.67:0/1613997943 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8524010d40 con 0x7f853c1005c0 2024-08-31T05:17:49.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.564+0000 7f85411c1640 1 -- 172.21.15.67:0/1613997943 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f853c19b810 con 0x7f853c1005c0 2024-08-31T05:17:49.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.565+0000 7f85411c1640 1 -- 172.21.15.67:0/1613997943 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f853c1972c0 con 0x7f853c1005c0 2024-08-31T05:17:49.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.566+0000 7f8533fff640 1 -- 172.21.15.67:0/1613997943 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f852401b460 con 0x7f853c1005c0 2024-08-31T05:17:49.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.566+0000 7f8533fff640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f852806de30 0x7f85280702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:49.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.567+0000 7f8533fff640 1 -- 172.21.15.67:0/1613997943 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f852408d0a0 con 0x7f853c1005c0 2024-08-31T05:17:49.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.567+0000 7f853a59c640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f852806de30 0x7f85280702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:49.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.567+0000 7f8533fff640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.73:6816/2922014039,v1:172.21.15.73:6817/2922014039] conn(0x7f8528073c20 0x7f8528076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:49.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.567+0000 7f8533fff640 1 -- 172.21.15.67:0/1613997943 --> [v2:172.21.15.73:6816/2922014039,v1:172.21.15.73:6817/2922014039] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85280766f0 con 0x7f8528073c20 2024-08-31T05:17:49.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.567+0000 7f8533fff640 1 -- 172.21.15.67:0/1613997943 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f8524094050 con 0x7f853c1005c0 2024-08-31T05:17:49.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.567+0000 7f853b59e640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.73:6816/2922014039,v1:172.21.15.73:6817/2922014039] conn(0x7f8528073c20 0x7f8528076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:49.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.567+0000 7f853a59c640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f852806de30 0x7f85280702f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f852c004f90 tx=0x7f852c009560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:49.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.567+0000 7f853b59e640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.73:6816/2922014039,v1:172.21.15.73:6817/2922014039] conn(0x7f8528073c20 0x7f8528076040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:49.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.568+0000 7f8533fff640 1 -- 172.21.15.67:0/1613997943 <== osd.5 v2:172.21.15.73:6816/2922014039 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85280766f0 con 0x7f8528073c20 2024-08-31T05:17:49.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.593+0000 7f85411c1640 1 -- 172.21.15.67:0/1613997943 --> [v2:172.21.15.73:6816/2922014039,v1:172.21.15.73:6817/2922014039] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f853c062620 con 0x7f8528073c20 2024-08-31T05:17:49.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.594+0000 7f8533fff640 1 -- 172.21.15.67:0/1613997943 <== osd.5 v2:172.21.15.73:6816/2922014039 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f853c062620 con 0x7f8528073c20 2024-08-31T05:17:49.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.595+0000 7f85411c1640 1 -- 172.21.15.67:0/1613997943 >> [v2:172.21.15.73:6816/2922014039,v1:172.21.15.73:6817/2922014039] conn(0x7f8528073c20 msgr2=0x7f8528076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:49.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.595+0000 7f85411c1640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.73:6816/2922014039,v1:172.21.15.73:6817/2922014039] conn(0x7f8528073c20 0x7f8528076040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.595+0000 7f85411c1640 1 -- 172.21.15.67:0/1613997943 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f852806de30 msgr2=0x7f85280702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:49.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.595+0000 7f85411c1640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f852806de30 0x7f85280702f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f852c004f90 tx=0x7f852c009560 comp rx=0 tx=0).stop 2024-08-31T05:17:49.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.595+0000 7f85411c1640 1 -- 172.21.15.67:0/1613997943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f853c1005c0 msgr2=0x7f853c196640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:49.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.595+0000 7f85411c1640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f853c1005c0 0x7f853c196640 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f852400b420 tx=0x7f852400b8e0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.595+0000 7f85411c1640 1 -- 172.21.15.67:0/1613997943 shutdown_connections 2024-08-31T05:17:49.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.595+0000 7f85411c1640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.73:6816/2922014039,v1:172.21.15.73:6817/2922014039] conn(0x7f8528073c20 0x7f8528076040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.595+0000 7f85411c1640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f852806de30 0x7f85280702f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.595+0000 7f85411c1640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f853c106670 0x7f853c196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.595+0000 7f85411c1640 1 --2- 172.21.15.67:0/1613997943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f853c1005c0 0x7f853c196640 secure :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f852400b420 tx=0x7f852400b8e0 comp rx=0 tx=0).stop 2024-08-31T05:17:49.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.595+0000 7f85411c1640 1 -- 172.21.15.67:0/1613997943 >> 172.21.15.67:0/1613997943 conn(0x7f853c0fc2c0 msgr2=0x7f853c0fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:49.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.596+0000 7f85411c1640 1 -- 172.21.15.67:0/1613997943 shutdown_connections 2024-08-31T05:17:49.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:49.596+0000 7f85411c1640 1 -- 172.21.15.67:0/1613997943 wait complete. 2024-08-31T05:17:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:146028888076 2024-08-31T05:17:50.014 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-31T05:17:50.347 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:50.347 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:50.348 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:50.439 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:50 smithi067 ceph-mon[17432]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:50.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:50 smithi073 ceph-mon[24726]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:50.843 INFO:teuthology.orchestra.run.smithi067.stdout:167503724550 2024-08-31T05:17:50.843 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-31T05:17:50.881 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.603+0000 7f6f8521a640 1 -- 172.21.15.67:0/782959036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f801028a0 msgr2=0x7f6f80102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.603+0000 7f6f8521a640 1 --2- 172.21.15.67:0/782959036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f801028a0 0x7f6f80102c80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6f700098b0 tx=0x7f6f7002a560 comp rx=0 tx=0).stop 2024-08-31T05:17:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.603+0000 7f6f8521a640 1 -- 172.21.15.67:0/782959036 shutdown_connections 2024-08-31T05:17:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.603+0000 7f6f8521a640 1 --2- 172.21.15.67:0/782959036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f801031c0 0x7f6f8010b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.603+0000 7f6f8521a640 1 --2- 172.21.15.67:0/782959036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f801028a0 0x7f6f80102c80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.603+0000 7f6f8521a640 1 -- 172.21.15.67:0/782959036 >> 172.21.15.67:0/782959036 conn(0x7f6f800fc2c0 msgr2=0x7f6f800fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:51.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.603+0000 7f6f8521a640 1 -- 172.21.15.67:0/782959036 shutdown_connections 2024-08-31T05:17:51.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.603+0000 7f6f8521a640 1 -- 172.21.15.67:0/782959036 wait complete. 2024-08-31T05:17:51.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.604+0000 7f6f8521a640 1 Processor -- start 2024-08-31T05:17:51.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.604+0000 7f6f8521a640 1 -- start start 2024-08-31T05:17:51.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.604+0000 7f6f8521a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f801028a0 0x7f6f80100500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:51.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.604+0000 7f6f8521a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f801031c0 0x7f6f80100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:51.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.604+0000 7f6f8521a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8010eb90 con 0x7f6f801031c0 2024-08-31T05:17:51.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.604+0000 7f6f8521a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8010ea10 con 0x7f6f801028a0 2024-08-31T05:17:51.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.604+0000 7f6f7e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f801031c0 0x7f6f80100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:51.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.605+0000 7f6f7e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f801031c0 0x7f6f80100a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39108/0 (socket says 172.21.15.67:39108) 2024-08-31T05:17:51.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.605+0000 7f6f7e59c640 1 -- 172.21.15.67:0/1947096145 learned_addr learned my addr 172.21.15.67:0/1947096145 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:51.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.605+0000 7f6f7ed9d640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f801028a0 0x7f6f80100500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:51.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.605+0000 7f6f7e59c640 1 -- 172.21.15.67:0/1947096145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f801028a0 msgr2=0x7f6f80100500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:51.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.605+0000 7f6f7e59c640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f801028a0 0x7f6f80100500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:51.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.605+0000 7f6f7e59c640 1 -- 172.21.15.67:0/1947096145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f80100f80 con 0x7f6f801031c0 2024-08-31T05:17:51.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.605+0000 7f6f7e59c640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f801031c0 0x7f6f80100a40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c8f0 tx=0x7f6f7400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:51.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.605+0000 7f6f67fff640 1 -- 172.21.15.67:0/1947096145 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f740079b0 con 0x7f6f801031c0 2024-08-31T05:17:51.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.605+0000 7f6f67fff640 1 -- 172.21.15.67:0/1947096145 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f740054e0 con 0x7f6f801031c0 2024-08-31T05:17:51.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.606+0000 7f6f8521a640 1 -- 172.21.15.67:0/1947096145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f80101270 con 0x7f6f801031c0 2024-08-31T05:17:51.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.606+0000 7f6f67fff640 1 -- 172.21.15.67:0/1947096145 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f74004dd0 con 0x7f6f801031c0 2024-08-31T05:17:51.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.606+0000 7f6f8521a640 1 -- 172.21.15.67:0/1947096145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f801a3c20 con 0x7f6f801031c0 2024-08-31T05:17:51.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.607+0000 7f6f8521a640 1 -- 172.21.15.67:0/1947096145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f80062660 con 0x7f6f801031c0 2024-08-31T05:17:51.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.607+0000 7f6f67fff640 1 -- 172.21.15.67:0/1947096145 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f6f7400f450 con 0x7f6f801031c0 2024-08-31T05:17:51.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.608+0000 7f6f67fff640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f6f6806de30 0x7f6f680702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:51.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.608+0000 7f6f67fff640 1 -- 172.21.15.67:0/1947096145 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f6f7408d7a0 con 0x7f6f801031c0 2024-08-31T05:17:51.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.608+0000 7f6f7ed9d640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f6f6806de30 0x7f6f680702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:51.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.608+0000 7f6f67fff640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.73:6800/3773655535,v1:172.21.15.73:6801/3773655535] conn(0x7f6f68073c20 0x7f6f68076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:51.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.608+0000 7f6f67fff640 1 -- 172.21.15.67:0/1947096145 --> [v2:172.21.15.73:6800/3773655535,v1:172.21.15.73:6801/3773655535] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f74004490 con 0x7f6f68073c20 2024-08-31T05:17:51.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.608+0000 7f6f67fff640 1 -- 172.21.15.67:0/1947096145 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6f740922a0 con 0x7f6f801031c0 2024-08-31T05:17:51.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.608+0000 7f6f7f59e640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.73:6800/3773655535,v1:172.21.15.73:6801/3773655535] conn(0x7f6f68073c20 0x7f6f68076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:51.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.608+0000 7f6f7ed9d640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f6f6806de30 0x7f6f680702f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6f70000c00 tx=0x7f6f70031420 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:51.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.609+0000 7f6f7f59e640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.73:6800/3773655535,v1:172.21.15.73:6801/3773655535] conn(0x7f6f68073c20 0x7f6f68076040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:51.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.609+0000 7f6f67fff640 1 -- 172.21.15.67:0/1947096145 <== osd.3 v2:172.21.15.73:6800/3773655535 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f74004490 con 0x7f6f68073c20 2024-08-31T05:17:51.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.624+0000 7f6f8521a640 1 -- 172.21.15.67:0/1947096145 --> [v2:172.21.15.73:6800/3773655535,v1:172.21.15.73:6801/3773655535] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6f80062ab0 con 0x7f6f68073c20 2024-08-31T05:17:51.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.624+0000 7f6f67fff640 1 -- 172.21.15.67:0/1947096145 <== osd.3 v2:172.21.15.73:6800/3773655535 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6f80062ab0 con 0x7f6f68073c20 2024-08-31T05:17:51.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.624+0000 7f6f8521a640 1 -- 172.21.15.67:0/1947096145 >> [v2:172.21.15.73:6800/3773655535,v1:172.21.15.73:6801/3773655535] conn(0x7f6f68073c20 msgr2=0x7f6f68076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:51.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.625+0000 7f6f8521a640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.73:6800/3773655535,v1:172.21.15.73:6801/3773655535] conn(0x7f6f68073c20 0x7f6f68076040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:51.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.625+0000 7f6f8521a640 1 -- 172.21.15.67:0/1947096145 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f6f6806de30 msgr2=0x7f6f680702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.625+0000 7f6f8521a640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f6f6806de30 0x7f6f680702f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6f70000c00 tx=0x7f6f70031420 comp rx=0 tx=0).stop 2024-08-31T05:17:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.625+0000 7f6f8521a640 1 -- 172.21.15.67:0/1947096145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f801031c0 msgr2=0x7f6f80100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.625+0000 7f6f8521a640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f801031c0 0x7f6f80100a40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c8f0 tx=0x7f6f7400cdb0 comp rx=0 tx=0).stop 2024-08-31T05:17:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.625+0000 7f6f8521a640 1 -- 172.21.15.67:0/1947096145 shutdown_connections 2024-08-31T05:17:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.625+0000 7f6f8521a640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.73:6800/3773655535,v1:172.21.15.73:6801/3773655535] conn(0x7f6f68073c20 0x7f6f68076040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.625+0000 7f6f8521a640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f6f6806de30 0x7f6f680702f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.625+0000 7f6f8521a640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f801031c0 0x7f6f80100a40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.625+0000 7f6f8521a640 1 --2- 172.21.15.67:0/1947096145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f801028a0 0x7f6f80100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.625+0000 7f6f8521a640 1 -- 172.21.15.67:0/1947096145 >> 172.21.15.67:0/1947096145 conn(0x7f6f800fc2c0 msgr2=0x7f6f80103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.625+0000 7f6f8521a640 1 -- 172.21.15.67:0/1947096145 shutdown_connections 2024-08-31T05:17:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:51.625+0000 7f6f8521a640 1 -- 172.21.15.67:0/1947096145 wait complete. 2024-08-31T05:17:52.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.231+0000 7f3e6e325640 1 -- 172.21.15.67:0/4276050047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e68106660 msgr2=0x7f3e68106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:52.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.231+0000 7f3e6e325640 1 --2- 172.21.15.67:0/4276050047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e68106660 0x7f3e68106a40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009880 tx=0x7f3e5802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.231+0000 7f3e6e325640 1 -- 172.21.15.67:0/4276050047 shutdown_connections 2024-08-31T05:17:52.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.231+0000 7f3e6e325640 1 --2- 172.21.15.67:0/4276050047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e681005b0 0x7f3e68100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.231+0000 7f3e6e325640 1 --2- 172.21.15.67:0/4276050047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e68106660 0x7f3e68106a40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.231+0000 7f3e6e325640 1 -- 172.21.15.67:0/4276050047 >> 172.21.15.67:0/4276050047 conn(0x7f3e680fc2f0 msgr2=0x7f3e680fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:52.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.231+0000 7f3e6e325640 1 -- 172.21.15.67:0/4276050047 shutdown_connections 2024-08-31T05:17:52.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.231+0000 7f3e6e325640 1 -- 172.21.15.67:0/4276050047 wait complete. 2024-08-31T05:17:52.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.231+0000 7f3e6e325640 1 Processor -- start 2024-08-31T05:17:52.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.231+0000 7f3e6e325640 1 -- start start 2024-08-31T05:17:52.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e6e325640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e681005b0 0x7f3e6819f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:52.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e6e325640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e68106660 0x7f3e6819fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:52.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e6e325640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6810dad0 con 0x7f3e681005b0 2024-08-31T05:17:52.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e6e325640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6810d950 con 0x7f3e68106660 2024-08-31T05:17:52.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e67fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e681005b0 0x7f3e6819f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:52.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e67fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e681005b0 0x7f3e6819f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39124/0 (socket says 172.21.15.67:39124) 2024-08-31T05:17:52.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e67fff640 1 -- 172.21.15.67:0/2520852522 learned_addr learned my addr 172.21.15.67:0/2520852522 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:52.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e677fe640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e68106660 0x7f3e6819fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:52.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e67fff640 1 -- 172.21.15.67:0/2520852522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e68106660 msgr2=0x7f3e6819fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:52.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e67fff640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e68106660 0x7f3e6819fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e67fff640 1 -- 172.21.15.67:0/2520852522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e68199760 con 0x7f3e681005b0 2024-08-31T05:17:52.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e67fff640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e681005b0 0x7f3e6819f690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3e58004f90 tx=0x7f3e580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:52.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e657fa640 1 -- 172.21.15.67:0/2520852522 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e5803f070 con 0x7f3e681005b0 2024-08-31T05:17:52.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e657fa640 1 -- 172.21.15.67:0/2520852522 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e58004cf0 con 0x7f3e681005b0 2024-08-31T05:17:52.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e6e325640 1 -- 172.21.15.67:0/2520852522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e681999f0 con 0x7f3e681005b0 2024-08-31T05:17:52.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.232+0000 7f3e657fa640 1 -- 172.21.15.67:0/2520852522 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e58035030 con 0x7f3e681005b0 2024-08-31T05:17:52.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.233+0000 7f3e6e325640 1 -- 172.21.15.67:0/2520852522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e68199f70 con 0x7f3e681005b0 2024-08-31T05:17:52.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.233+0000 7f3e6e325640 1 -- 172.21.15.67:0/2520852522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e6819a5f0 con 0x7f3e681005b0 2024-08-31T05:17:52.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.234+0000 7f3e657fa640 1 -- 172.21.15.67:0/2520852522 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f3e58042070 con 0x7f3e681005b0 2024-08-31T05:17:52.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.234+0000 7f3e657fa640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3e5006de30 0x7f3e500702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:52.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.235+0000 7f3e657fa640 1 -- 172.21.15.67:0/2520852522 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f3e580ae3a0 con 0x7f3e681005b0 2024-08-31T05:17:52.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.235+0000 7f3e677fe640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3e5006de30 0x7f3e500702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:52.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.235+0000 7f3e657fa640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055] conn(0x7f3e50073c20 0x7f3e50076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:52.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.235+0000 7f3e657fa640 1 -- 172.21.15.67:0/2520852522 --> [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e500766f0 con 0x7f3e50073c20 2024-08-31T05:17:52.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.235+0000 7f3e657fa640 1 -- 172.21.15.67:0/2520852522 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f3e580b5050 con 0x7f3e681005b0 2024-08-31T05:17:52.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.235+0000 7f3e6c8c2640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055] conn(0x7f3e50073c20 0x7f3e50076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:52.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.235+0000 7f3e677fe640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3e5006de30 0x7f3e500702f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3e6819afb0 tx=0x7f3e5c009110 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:52.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.235+0000 7f3e6c8c2640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055] conn(0x7f3e50073c20 0x7f3e50076040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:52.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.236+0000 7f3e657fa640 1 -- 172.21.15.67:0/2520852522 <== osd.1 v2:172.21.15.67:6810/9049055 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e500766f0 con 0x7f3e50073c20 2024-08-31T05:17:52.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.249+0000 7f3e6e325640 1 -- 172.21.15.67:0/2520852522 --> [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3e6806a3c0 con 0x7f3e50073c20 2024-08-31T05:17:52.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.249+0000 7f3e657fa640 1 -- 172.21.15.67:0/2520852522 <== osd.1 v2:172.21.15.67:6810/9049055 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3e6806a3c0 con 0x7f3e50073c20 2024-08-31T05:17:52.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.250+0000 7f3e6e325640 1 -- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055] conn(0x7f3e50073c20 msgr2=0x7f3e50076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:52.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.250+0000 7f3e6e325640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055] conn(0x7f3e50073c20 0x7f3e50076040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.250+0000 7f3e6e325640 1 -- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3e5006de30 msgr2=0x7f3e500702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:52.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.250+0000 7f3e6e325640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3e5006de30 0x7f3e500702f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3e6819afb0 tx=0x7f3e5c009110 comp rx=0 tx=0).stop 2024-08-31T05:17:52.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.250+0000 7f3e6e325640 1 -- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e681005b0 msgr2=0x7f3e6819f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:52.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.250+0000 7f3e6e325640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e681005b0 0x7f3e6819f690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3e58004f90 tx=0x7f3e580048f0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.250+0000 7f3e6e325640 1 -- 172.21.15.67:0/2520852522 shutdown_connections 2024-08-31T05:17:52.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.250+0000 7f3e6e325640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:6810/9049055,v1:172.21.15.67:6811/9049055] conn(0x7f3e50073c20 0x7f3e50076040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.250+0000 7f3e6e325640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3e5006de30 0x7f3e500702f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.250+0000 7f3e6e325640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e68106660 0x7f3e6819fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.250+0000 7f3e6e325640 1 --2- 172.21.15.67:0/2520852522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e681005b0 0x7f3e6819f690 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.250+0000 7f3e6e325640 1 -- 172.21.15.67:0/2520852522 >> 172.21.15.67:0/2520852522 conn(0x7f3e680fc2f0 msgr2=0x7f3e68069a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.250+0000 7f3e6e325640 1 -- 172.21.15.67:0/2520852522 shutdown_connections 2024-08-31T05:17:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.250+0000 7f3e6e325640 1 -- 172.21.15.67:0/2520852522 wait complete. 2024-08-31T05:17:52.434 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:52 smithi067 ceph-mon[17432]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:52.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.432+0000 7f798adc8640 1 -- 172.21.15.67:0/1424575880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79841016a0 msgr2=0x7f7984101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:52.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.432+0000 7f798adc8640 1 --2- 172.21.15.67:0/1424575880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79841016a0 0x7f7984101b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7970009880 tx=0x7f797002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.432+0000 7f798adc8640 1 -- 172.21.15.67:0/1424575880 shutdown_connections 2024-08-31T05:17:52.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.432+0000 7f798adc8640 1 --2- 172.21.15.67:0/1424575880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79841016a0 0x7f7984101b00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.432+0000 7f798adc8640 1 --2- 172.21.15.67:0/1424575880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79841076a0 0x7f7984107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.432+0000 7f798adc8640 1 -- 172.21.15.67:0/1424575880 >> 172.21.15.67:0/1424575880 conn(0x7f79840fd380 msgr2=0x7f79840ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:52.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.432+0000 7f798adc8640 1 -- 172.21.15.67:0/1424575880 shutdown_connections 2024-08-31T05:17:52.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.432+0000 7f798adc8640 1 -- 172.21.15.67:0/1424575880 wait complete. 2024-08-31T05:17:52.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.433+0000 7f798adc8640 1 Processor -- start 2024-08-31T05:17:52.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.433+0000 7f798adc8640 1 -- start start 2024-08-31T05:17:52.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.433+0000 7f798adc8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79841016a0 0x7f798419d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:52.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.433+0000 7f798adc8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79841076a0 0x7f798419d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:52.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.433+0000 7f798adc8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f798410ebd0 con 0x7f79841016a0 2024-08-31T05:17:52.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.433+0000 7f798adc8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f798410ea50 con 0x7f79841076a0 2024-08-31T05:17:52.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.434+0000 7f7988b64640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79841016a0 0x7f798419d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:52.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.434+0000 7f7988b64640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79841016a0 0x7f798419d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39144/0 (socket says 172.21.15.67:39144) 2024-08-31T05:17:52.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.434+0000 7f7988b64640 1 -- 172.21.15.67:0/472872638 learned_addr learned my addr 172.21.15.67:0/472872638 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:52.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.434+0000 7f7983fff640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79841076a0 0x7f798419d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:52.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.434+0000 7f7988b64640 1 -- 172.21.15.67:0/472872638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79841076a0 msgr2=0x7f798419d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:52.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.434+0000 7f7988b64640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79841076a0 0x7f798419d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.434+0000 7f7988b64640 1 -- 172.21.15.67:0/472872638 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7984197620 con 0x7f79841016a0 2024-08-31T05:17:52.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.434+0000 7f7983fff640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79841076a0 0x7f798419d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:17:52.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.434+0000 7f7988b64640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79841016a0 0x7f798419d460 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f797800b420 tx=0x7f797800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:52.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.434+0000 7f7981ffb640 1 -- 172.21.15.67:0/472872638 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7978011630 con 0x7f79841016a0 2024-08-31T05:17:52.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.434+0000 7f798adc8640 1 -- 172.21.15.67:0/472872638 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7984197910 con 0x7f79841016a0 2024-08-31T05:17:52.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.434+0000 7f7981ffb640 1 -- 172.21.15.67:0/472872638 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7978016070 con 0x7f79841016a0 2024-08-31T05:17:52.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.434+0000 7f7981ffb640 1 -- 172.21.15.67:0/472872638 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7978010d40 con 0x7f79841016a0 2024-08-31T05:17:52.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.434+0000 7f798adc8640 1 -- 172.21.15.67:0/472872638 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7984197ea0 con 0x7f79841016a0 2024-08-31T05:17:52.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.435+0000 7f798adc8640 1 -- 172.21.15.67:0/472872638 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7984102de0 con 0x7f79841016a0 2024-08-31T05:17:52.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.436+0000 7f7981ffb640 1 -- 172.21.15.67:0/472872638 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f797801b460 con 0x7f79841016a0 2024-08-31T05:17:52.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.436+0000 7f7981ffb640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f797406de30 0x7f79740702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:52.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.436+0000 7f7981ffb640 1 -- 172.21.15.67:0/472872638 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f797808d0b0 con 0x7f79841016a0 2024-08-31T05:17:52.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.436+0000 7f7983fff640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f797406de30 0x7f79740702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:52.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.437+0000 7f7981ffb640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825] conn(0x7f7974073c20 0x7f7974076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:52.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.437+0000 7f7981ffb640 1 -- 172.21.15.67:0/472872638 --> [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79740766f0 con 0x7f7974073c20 2024-08-31T05:17:52.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.437+0000 7f7981ffb640 1 -- 172.21.15.67:0/472872638 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f7978094050 con 0x7f79841016a0 2024-08-31T05:17:52.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.437+0000 7f7989365640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825] conn(0x7f7974073c20 0x7f7974076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:52.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.437+0000 7f7983fff640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f797406de30 0x7f79740702f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7970031460 tx=0x7f79700095f0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:52.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.437+0000 7f7989365640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825] conn(0x7f7974073c20 0x7f7974076040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:52.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.438+0000 7f7981ffb640 1 -- 172.21.15.67:0/472872638 <== osd.0 v2:172.21.15.67:6802/3334523825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f79740766f0 con 0x7f7974073c20 2024-08-31T05:17:52.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.452+0000 7f798adc8640 1 -- 172.21.15.67:0/472872638 --> [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7984062620 con 0x7f7974073c20 2024-08-31T05:17:52.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.452+0000 7f7981ffb640 1 -- 172.21.15.67:0/472872638 <== osd.0 v2:172.21.15.67:6802/3334523825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7984062620 con 0x7f7974073c20 2024-08-31T05:17:52.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.452+0000 7f798adc8640 1 -- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825] conn(0x7f7974073c20 msgr2=0x7f7974076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:52.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.452+0000 7f798adc8640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825] conn(0x7f7974073c20 0x7f7974076040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.452+0000 7f798adc8640 1 -- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f797406de30 msgr2=0x7f79740702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:52.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.452+0000 7f798adc8640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f797406de30 0x7f79740702f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7970031460 tx=0x7f79700095f0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.453+0000 7f798adc8640 1 -- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79841016a0 msgr2=0x7f798419d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:52.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.453+0000 7f798adc8640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79841016a0 0x7f798419d460 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f797800b420 tx=0x7f797800b8e0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.453+0000 7f798adc8640 1 -- 172.21.15.67:0/472872638 shutdown_connections 2024-08-31T05:17:52.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.453+0000 7f798adc8640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:6802/3334523825,v1:172.21.15.67:6803/3334523825] conn(0x7f7974073c20 0x7f7974076040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.453+0000 7f798adc8640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f797406de30 0x7f79740702f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.453+0000 7f798adc8640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79841076a0 0x7f798419d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.453+0000 7f798adc8640 1 --2- 172.21.15.67:0/472872638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79841016a0 0x7f798419d460 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:52.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.453+0000 7f798adc8640 1 -- 172.21.15.67:0/472872638 >> 172.21.15.67:0/472872638 conn(0x7f79840fd380 msgr2=0x7f79840fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:52.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.453+0000 7f798adc8640 1 -- 172.21.15.67:0/472872638 shutdown_connections 2024-08-31T05:17:52.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:52.453+0000 7f798adc8640 1 -- 172.21.15.67:0/472872638 wait complete. 2024-08-31T05:17:52.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:52 smithi073 ceph-mon[24726]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:53.571 INFO:teuthology.orchestra.run.smithi067.stdout:111669149713 2024-08-31T05:17:53.571 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-31T05:17:54.097 INFO:teuthology.orchestra.run.smithi067.stdout:38654705698 2024-08-31T05:17:54.097 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-31T05:17:54.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.270+0000 7ff891b73640 1 -- 172.21.15.67:0/1115770429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88c102910 msgr2=0x7ff88c102cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:54.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.270+0000 7ff891b73640 1 --2- 172.21.15.67:0/1115770429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88c102910 0x7ff88c102cf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009880 tx=0x7ff87c02a530 comp rx=0 tx=0).stop 2024-08-31T05:17:54.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.270+0000 7ff891b73640 1 -- 172.21.15.67:0/1115770429 shutdown_connections 2024-08-31T05:17:54.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.270+0000 7ff891b73640 1 --2- 172.21.15.67:0/1115770429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c103230 0x7ff88c10b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:54.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.270+0000 7ff891b73640 1 --2- 172.21.15.67:0/1115770429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88c102910 0x7ff88c102cf0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:54.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.270+0000 7ff891b73640 1 -- 172.21.15.67:0/1115770429 >> 172.21.15.67:0/1115770429 conn(0x7ff88c0fc2f0 msgr2=0x7ff88c0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:54.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.270+0000 7ff891b73640 1 -- 172.21.15.67:0/1115770429 shutdown_connections 2024-08-31T05:17:54.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.270+0000 7ff891b73640 1 -- 172.21.15.67:0/1115770429 wait complete. 2024-08-31T05:17:54.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.271+0000 7ff891b73640 1 Processor -- start 2024-08-31T05:17:54.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.271+0000 7ff891b73640 1 -- start start 2024-08-31T05:17:54.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.271+0000 7ff891b73640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c102910 0x7ff88c19d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:54.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.271+0000 7ff891b73640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88c103230 0x7ff88c19dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:54.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.271+0000 7ff891b73640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c10ebe0 con 0x7ff88c103230 2024-08-31T05:17:54.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.271+0000 7ff891b73640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c10ea60 con 0x7ff88c102910 2024-08-31T05:17:54.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.271+0000 7ff882ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88c103230 0x7ff88c19dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:54.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.271+0000 7ff882ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88c103230 0x7ff88c19dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39174/0 (socket says 172.21.15.67:39174) 2024-08-31T05:17:54.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.271+0000 7ff882ffd640 1 -- 172.21.15.67:0/3746564675 learned_addr learned my addr 172.21.15.67:0/3746564675 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:54.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.272+0000 7ff88b7fe640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c102910 0x7ff88c19d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:54.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.272+0000 7ff882ffd640 1 -- 172.21.15.67:0/3746564675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c102910 msgr2=0x7ff88c19d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:54.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.272+0000 7ff882ffd640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c102910 0x7ff88c19d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:54.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.272+0000 7ff882ffd640 1 -- 172.21.15.67:0/3746564675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c197670 con 0x7ff88c103230 2024-08-31T05:17:54.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.272+0000 7ff88b7fe640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c102910 0x7ff88c19d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:17:54.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.272+0000 7ff882ffd640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88c103230 0x7ff88c19dae0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff87400b420 tx=0x7ff87400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:54.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.272+0000 7ff8897fa640 1 -- 172.21.15.67:0/3746564675 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff874011630 con 0x7ff88c103230 2024-08-31T05:17:54.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.272+0000 7ff891b73640 1 -- 172.21.15.67:0/3746564675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88c197960 con 0x7ff88c103230 2024-08-31T05:17:54.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.272+0000 7ff8897fa640 1 -- 172.21.15.67:0/3746564675 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff874016070 con 0x7ff88c103230 2024-08-31T05:17:54.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.272+0000 7ff891b73640 1 -- 172.21.15.67:0/3746564675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88c197ec0 con 0x7ff88c103230 2024-08-31T05:17:54.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.272+0000 7ff8897fa640 1 -- 172.21.15.67:0/3746564675 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff874010b30 con 0x7ff88c103230 2024-08-31T05:17:54.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.273+0000 7ff891b73640 1 -- 172.21.15.67:0/3746564675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff88c198460 con 0x7ff88c103230 2024-08-31T05:17:54.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.274+0000 7ff8897fa640 1 -- 172.21.15.67:0/3746564675 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7ff874010cd0 con 0x7ff88c103230 2024-08-31T05:17:54.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.274+0000 7ff8897fa640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff87806de30 0x7ff8780702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:54.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.275+0000 7ff8897fa640 1 -- 172.21.15.67:0/3746564675 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7ff87408ceb0 con 0x7ff88c103230 2024-08-31T05:17:54.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.275+0000 7ff88b7fe640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff87806de30 0x7ff8780702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:54.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.275+0000 7ff8897fa640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:6818/398055695,v1:172.21.15.67:6819/398055695] conn(0x7ff878073c20 0x7ff878076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:54.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.275+0000 7ff8897fa640 1 -- 172.21.15.67:0/3746564675 --> [v2:172.21.15.67:6818/398055695,v1:172.21.15.67:6819/398055695] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff874013e50 con 0x7ff878073c20 2024-08-31T05:17:54.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.275+0000 7ff8897fa640 1 -- 172.21.15.67:0/3746564675 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7ff87408f5c0 con 0x7ff88c103230 2024-08-31T05:17:54.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.275+0000 7ff88bfff640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:6818/398055695,v1:172.21.15.67:6819/398055695] conn(0x7ff878073c20 0x7ff878076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:54.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.275+0000 7ff88b7fe640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff87806de30 0x7ff8780702f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff87c000c00 tx=0x7ff87c004f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:54.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.275+0000 7ff88bfff640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:6818/398055695,v1:172.21.15.67:6819/398055695] conn(0x7ff878073c20 0x7ff878076040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:54.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.276+0000 7ff8897fa640 1 -- 172.21.15.67:0/3746564675 <== osd.2 v2:172.21.15.67:6818/398055695 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff874013e50 con 0x7ff878073c20 2024-08-31T05:17:54.279 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:54.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.291+0000 7ff891b73640 1 -- 172.21.15.67:0/3746564675 --> [v2:172.21.15.67:6818/398055695,v1:172.21.15.67:6819/398055695] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff88c062650 con 0x7ff878073c20 2024-08-31T05:17:54.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.292+0000 7ff8897fa640 1 -- 172.21.15.67:0/3746564675 <== osd.2 v2:172.21.15.67:6818/398055695 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff88c062650 con 0x7ff878073c20 2024-08-31T05:17:54.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.292+0000 7ff891b73640 1 -- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:6818/398055695,v1:172.21.15.67:6819/398055695] conn(0x7ff878073c20 msgr2=0x7ff878076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:54.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.292+0000 7ff891b73640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:6818/398055695,v1:172.21.15.67:6819/398055695] conn(0x7ff878073c20 0x7ff878076040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:54.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.292+0000 7ff891b73640 1 -- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff87806de30 msgr2=0x7ff8780702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:54.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.292+0000 7ff891b73640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff87806de30 0x7ff8780702f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff87c000c00 tx=0x7ff87c004f30 comp rx=0 tx=0).stop 2024-08-31T05:17:54.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.292+0000 7ff891b73640 1 -- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88c103230 msgr2=0x7ff88c19dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:54.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.292+0000 7ff891b73640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88c103230 0x7ff88c19dae0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff87400b420 tx=0x7ff87400b8e0 comp rx=0 tx=0).stop 2024-08-31T05:17:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.293+0000 7ff891b73640 1 -- 172.21.15.67:0/3746564675 shutdown_connections 2024-08-31T05:17:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.293+0000 7ff891b73640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:6818/398055695,v1:172.21.15.67:6819/398055695] conn(0x7ff878073c20 0x7ff878076040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.293+0000 7ff891b73640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff87806de30 0x7ff8780702f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.293+0000 7ff891b73640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff88c103230 0x7ff88c19dae0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.293+0000 7ff891b73640 1 --2- 172.21.15.67:0/3746564675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff88c102910 0x7ff88c19d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.293+0000 7ff891b73640 1 -- 172.21.15.67:0/3746564675 >> 172.21.15.67:0/3746564675 conn(0x7ff88c0fc2f0 msgr2=0x7ff88c107c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.293+0000 7ff891b73640 1 -- 172.21.15.67:0/3746564675 shutdown_connections 2024-08-31T05:17:54.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:54.293+0000 7ff891b73640 1 -- 172.21.15.67:0/3746564675 wait complete. 2024-08-31T05:17:54.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:54 smithi067 ceph-mon[17432]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:54.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:54 smithi073 ceph-mon[24726]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:54.987 INFO:teuthology.orchestra.run.smithi067.stdout:81604378647 2024-08-31T05:17:54.987 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-31T05:17:55.871 INFO:teuthology.orchestra.run.smithi067.stdout:60129542172 2024-08-31T05:17:55.872 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-31T05:17:56.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.153+0000 7f90d94fa640 1 -- 172.21.15.67:0/1951634746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d41076a0 msgr2=0x7f90d4107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:56.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.153+0000 7f90d94fa640 1 --2- 172.21.15.67:0/1951634746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d41076a0 0x7f90d4107a80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009880 tx=0x7f90c402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:56.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.153+0000 7f90d94fa640 1 -- 172.21.15.67:0/1951634746 shutdown_connections 2024-08-31T05:17:56.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.153+0000 7f90d94fa640 1 --2- 172.21.15.67:0/1951634746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d41016a0 0x7f90d4101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:56.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.153+0000 7f90d94fa640 1 --2- 172.21.15.67:0/1951634746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d41076a0 0x7f90d4107a80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:56.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.153+0000 7f90d94fa640 1 -- 172.21.15.67:0/1951634746 >> 172.21.15.67:0/1951634746 conn(0x7f90d40fd3a0 msgr2=0x7f90d40ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:56.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.153+0000 7f90d94fa640 1 -- 172.21.15.67:0/1951634746 shutdown_connections 2024-08-31T05:17:56.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.153+0000 7f90d94fa640 1 -- 172.21.15.67:0/1951634746 wait complete. 2024-08-31T05:17:56.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.154+0000 7f90d94fa640 1 Processor -- start 2024-08-31T05:17:56.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.154+0000 7f90d94fa640 1 -- start start 2024-08-31T05:17:56.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.154+0000 7f90d94fa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d41016a0 0x7f90d419d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:56.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.154+0000 7f90d94fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d41076a0 0x7f90d419d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:56.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.154+0000 7f90d94fa640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f90d410ebd0 con 0x7f90d41076a0 2024-08-31T05:17:56.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.154+0000 7f90d94fa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f90d410ea50 con 0x7f90d41016a0 2024-08-31T05:17:56.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.154+0000 7f90d27fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d41076a0 0x7f90d419d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:56.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.154+0000 7f90d27fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d41076a0 0x7f90d419d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39194/0 (socket says 172.21.15.67:39194) 2024-08-31T05:17:56.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.154+0000 7f90d27fc640 1 -- 172.21.15.67:0/1699810348 learned_addr learned my addr 172.21.15.67:0/1699810348 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:56.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.154+0000 7f90d2ffd640 1 --2- 172.21.15.67:0/1699810348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d41016a0 0x7f90d419d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:56.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.155+0000 7f90d27fc640 1 -- 172.21.15.67:0/1699810348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d41016a0 msgr2=0x7f90d419d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:56.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.155+0000 7f90d27fc640 1 --2- 172.21.15.67:0/1699810348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d41016a0 0x7f90d419d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:56.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.155+0000 7f90d27fc640 1 -- 172.21.15.67:0/1699810348 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d41975c0 con 0x7f90d41076a0 2024-08-31T05:17:56.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.155+0000 7f90d27fc640 1 --2- 172.21.15.67:0/1699810348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d41076a0 0x7f90d419d940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f90c800b420 tx=0x7f90c800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:56.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.155+0000 7f90bbfff640 1 -- 172.21.15.67:0/1699810348 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90c8011630 con 0x7f90d41076a0 2024-08-31T05:17:56.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.155+0000 7f90d94fa640 1 -- 172.21.15.67:0/1699810348 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d41978b0 con 0x7f90d41076a0 2024-08-31T05:17:56.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.155+0000 7f90bbfff640 1 -- 172.21.15.67:0/1699810348 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f90c8016070 con 0x7f90d41076a0 2024-08-31T05:17:56.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.155+0000 7f90bbfff640 1 -- 172.21.15.67:0/1699810348 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90c8010d40 con 0x7f90d41076a0 2024-08-31T05:17:56.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.155+0000 7f90d94fa640 1 -- 172.21.15.67:0/1699810348 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d4197e40 con 0x7f90d41076a0 2024-08-31T05:17:56.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.156+0000 7f90d94fa640 1 -- 172.21.15.67:0/1699810348 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90d4102de0 con 0x7f90d41076a0 2024-08-31T05:17:56.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.157+0000 7f90bbfff640 1 -- 172.21.15.67:0/1699810348 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f90c801b460 con 0x7f90d41076a0 2024-08-31T05:17:56.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.157+0000 7f90bbfff640 1 --2- 172.21.15.67:0/1699810348 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f90bc06de30 0x7f90bc0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:56.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.157+0000 7f90bbfff640 1 -- 172.21.15.67:0/1699810348 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f90c808d010 con 0x7f90d41076a0 2024-08-31T05:17:56.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.157+0000 7f90d2ffd640 1 --2- 172.21.15.67:0/1699810348 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f90bc06de30 0x7f90bc0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:56.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.158+0000 7f90d2ffd640 1 --2- 172.21.15.67:0/1699810348 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f90bc06de30 0x7f90bc0702f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f90c40096c0 tx=0x7f90c4031400 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:56.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.162+0000 7f90bbfff640 1 -- 172.21.15.67:0/1699810348 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f90c805aef0 con 0x7f90d41076a0 2024-08-31T05:17:56.227 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:56.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.373+0000 7f90d94fa640 1 -- 172.21.15.67:0/1699810348 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f90d4198af0 con 0x7f90d41076a0 2024-08-31T05:17:56.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.373+0000 7f90bbfff640 1 -- 172.21.15.67:0/1699810348 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f90c805eba0 con 0x7f90d41076a0 2024-08-31T05:17:56.375 INFO:teuthology.orchestra.run.smithi067.stdout:146028888077 2024-08-31T05:17:56.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.375+0000 7f90d94fa640 1 -- 172.21.15.67:0/1699810348 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f90bc06de30 msgr2=0x7f90bc0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:56.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.375+0000 7f90d94fa640 1 --2- 172.21.15.67:0/1699810348 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f90bc06de30 0x7f90bc0702f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f90c40096c0 tx=0x7f90c4031400 comp rx=0 tx=0).stop 2024-08-31T05:17:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.375+0000 7f90d94fa640 1 -- 172.21.15.67:0/1699810348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d41076a0 msgr2=0x7f90d419d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.375+0000 7f90d94fa640 1 --2- 172.21.15.67:0/1699810348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d41076a0 0x7f90d419d940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f90c800b420 tx=0x7f90c800b8e0 comp rx=0 tx=0).stop 2024-08-31T05:17:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.376+0000 7f90d94fa640 1 -- 172.21.15.67:0/1699810348 shutdown_connections 2024-08-31T05:17:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.376+0000 7f90d94fa640 1 --2- 172.21.15.67:0/1699810348 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f90bc06de30 0x7f90bc0702f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.376+0000 7f90d94fa640 1 --2- 172.21.15.67:0/1699810348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d41076a0 0x7f90d419d940 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.376+0000 7f90d94fa640 1 --2- 172.21.15.67:0/1699810348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d41016a0 0x7f90d419d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.376+0000 7f90d94fa640 1 -- 172.21.15.67:0/1699810348 >> 172.21.15.67:0/1699810348 conn(0x7f90d40fd3a0 msgr2=0x7f90d40fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.376+0000 7f90d94fa640 1 -- 172.21.15.67:0/1699810348 shutdown_connections 2024-08-31T05:17:56.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:56.376+0000 7f90d94fa640 1 -- 172.21.15.67:0/1699810348 wait complete. 2024-08-31T05:17:56.407 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:56 smithi067 ceph-mon[17432]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:56.407 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:56 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:17:56.407 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:56 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1699810348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-31T05:17:56.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:56 smithi073 ceph-mon[24726]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:56.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:56 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:17:56.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:56 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1699810348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-31T05:17:57.348 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888076 got 146028888077 for osd.4 2024-08-31T05:17:57.348 DEBUG:teuthology.parallel:result is None 2024-08-31T05:17:57.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.561+0000 7fe59d3bd640 1 -- 172.21.15.67:0/1967287676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5981028c0 msgr2=0x7fe598102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:57.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.561+0000 7fe59d3bd640 1 --2- 172.21.15.67:0/1967287676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5981028c0 0x7fe598102ca0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe580009880 tx=0x7fe58002a530 comp rx=0 tx=0).stop 2024-08-31T05:17:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.561+0000 7fe59d3bd640 1 -- 172.21.15.67:0/1967287676 shutdown_connections 2024-08-31T05:17:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.561+0000 7fe59d3bd640 1 --2- 172.21.15.67:0/1967287676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5981031e0 0x7fe59810b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.561+0000 7fe59d3bd640 1 --2- 172.21.15.67:0/1967287676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5981028c0 0x7fe598102ca0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.561+0000 7fe59d3bd640 1 -- 172.21.15.67:0/1967287676 >> 172.21.15.67:0/1967287676 conn(0x7fe5980fc320 msgr2=0x7fe5980fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.561+0000 7fe59d3bd640 1 -- 172.21.15.67:0/1967287676 shutdown_connections 2024-08-31T05:17:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.561+0000 7fe59d3bd640 1 -- 172.21.15.67:0/1967287676 wait complete. 2024-08-31T05:17:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.562+0000 7fe59d3bd640 1 Processor -- start 2024-08-31T05:17:57.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.562+0000 7fe59d3bd640 1 -- start start 2024-08-31T05:17:57.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.562+0000 7fe59d3bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5981028c0 0x7fe59819f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:57.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.562+0000 7fe59d3bd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5981031e0 0x7fe59819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:57.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.562+0000 7fe59d3bd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe59810ec50 con 0x7fe5981028c0 2024-08-31T05:17:57.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.562+0000 7fe59d3bd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe59810ead0 con 0x7fe5981031e0 2024-08-31T05:17:57.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.563+0000 7fe596ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5981028c0 0x7fe59819f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.563+0000 7fe596ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5981028c0 0x7fe59819f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39214/0 (socket says 172.21.15.67:39214) 2024-08-31T05:17:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.563+0000 7fe596ffd640 1 -- 172.21.15.67:0/3453488672 learned_addr learned my addr 172.21.15.67:0/3453488672 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.563+0000 7fe5967fc640 1 --2- 172.21.15.67:0/3453488672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5981031e0 0x7fe59819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.563+0000 7fe596ffd640 1 -- 172.21.15.67:0/3453488672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5981031e0 msgr2=0x7fe59819fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.563+0000 7fe596ffd640 1 --2- 172.21.15.67:0/3453488672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5981031e0 0x7fe59819fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.563+0000 7fe596ffd640 1 -- 172.21.15.67:0/3453488672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5981998a0 con 0x7fe5981028c0 2024-08-31T05:17:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.563+0000 7fe596ffd640 1 --2- 172.21.15.67:0/3453488672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5981028c0 0x7fe59819f6e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe580031460 tx=0x7fe5800048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.563+0000 7fe58ffff640 1 -- 172.21.15.67:0/3453488672 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe58003f070 con 0x7fe5981028c0 2024-08-31T05:17:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.563+0000 7fe59d3bd640 1 -- 172.21.15.67:0/3453488672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe598199b30 con 0x7fe5981028c0 2024-08-31T05:17:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.563+0000 7fe58ffff640 1 -- 172.21.15.67:0/3453488672 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe5800044d0 con 0x7fe5981028c0 2024-08-31T05:17:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.563+0000 7fe58ffff640 1 -- 172.21.15.67:0/3453488672 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe580035030 con 0x7fe5981028c0 2024-08-31T05:17:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.563+0000 7fe59d3bd640 1 -- 172.21.15.67:0/3453488672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe59819a060 con 0x7fe5981028c0 2024-08-31T05:17:57.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.565+0000 7fe59d3bd640 1 -- 172.21.15.67:0/3453488672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe59806ab40 con 0x7fe5981028c0 2024-08-31T05:17:57.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.565+0000 7fe58ffff640 1 -- 172.21.15.67:0/3453488672 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fe580042070 con 0x7fe5981028c0 2024-08-31T05:17:57.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.565+0000 7fe58ffff640 1 --2- 172.21.15.67:0/3453488672 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe58406de30 0x7fe5840702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:57.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.565+0000 7fe58ffff640 1 -- 172.21.15.67:0/3453488672 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fe5800ae3c0 con 0x7fe5981028c0 2024-08-31T05:17:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.566+0000 7fe5967fc640 1 --2- 172.21.15.67:0/3453488672 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe58406de30 0x7fe5840702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.566+0000 7fe5967fc640 1 --2- 172.21.15.67:0/3453488672 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe58406de30 0x7fe5840702f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5980feca0 tx=0x7fe588008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:57.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.570+0000 7fe58ffff640 1 -- 172.21.15.67:0/3453488672 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe58007c2a0 con 0x7fe5981028c0 2024-08-31T05:17:57.624 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:57.624 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:57.626 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:57.628 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:17:57.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.793+0000 7fe59d3bd640 1 -- 172.21.15.67:0/3453488672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe59810b1a0 con 0x7fe5981028c0 2024-08-31T05:17:57.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.794+0000 7fe58ffff640 1 -- 172.21.15.67:0/3453488672 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe580004cf0 con 0x7fe5981028c0 2024-08-31T05:17:57.796 INFO:teuthology.orchestra.run.smithi067.stdout:167503724551 2024-08-31T05:17:57.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.796+0000 7fe59d3bd640 1 -- 172.21.15.67:0/3453488672 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe58406de30 msgr2=0x7fe5840702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:57.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.796+0000 7fe59d3bd640 1 --2- 172.21.15.67:0/3453488672 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe58406de30 0x7fe5840702f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5980feca0 tx=0x7fe588008040 comp rx=0 tx=0).stop 2024-08-31T05:17:57.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.796+0000 7fe59d3bd640 1 -- 172.21.15.67:0/3453488672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5981028c0 msgr2=0x7fe59819f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:57.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.796+0000 7fe59d3bd640 1 --2- 172.21.15.67:0/3453488672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5981028c0 0x7fe59819f6e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe580031460 tx=0x7fe5800048f0 comp rx=0 tx=0).stop 2024-08-31T05:17:57.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.796+0000 7fe59d3bd640 1 -- 172.21.15.67:0/3453488672 shutdown_connections 2024-08-31T05:17:57.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.796+0000 7fe59d3bd640 1 --2- 172.21.15.67:0/3453488672 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe58406de30 0x7fe5840702f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:57.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.796+0000 7fe59d3bd640 1 --2- 172.21.15.67:0/3453488672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5981031e0 0x7fe59819fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:57.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.796+0000 7fe59d3bd640 1 --2- 172.21.15.67:0/3453488672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5981028c0 0x7fe59819f6e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:57.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.796+0000 7fe59d3bd640 1 -- 172.21.15.67:0/3453488672 >> 172.21.15.67:0/3453488672 conn(0x7fe5980fc320 msgr2=0x7fe598100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:57.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.796+0000 7fe59d3bd640 1 -- 172.21.15.67:0/3453488672 shutdown_connections 2024-08-31T05:17:57.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:57.796+0000 7fe59d3bd640 1 -- 172.21.15.67:0/3453488672 wait complete. 2024-08-31T05:17:58.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:58 smithi073 ceph-mon[24726]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:58.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:58 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3453488672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-31T05:17:58.713 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:58 smithi067 ceph-mon[17432]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:17:58.713 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:58 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3453488672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-31T05:17:58.739 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724550 got 167503724551 for osd.5 2024-08-31T05:17:58.740 DEBUG:teuthology.parallel:result is None 2024-08-31T05:17:59.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.165+0000 7f1e71370640 1 -- 172.21.15.67:0/2436600788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e6c106670 msgr2=0x7f1e6c106a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:59.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.165+0000 7f1e71370640 1 --2- 172.21.15.67:0/2436600788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e6c106670 0x7f1e6c106a50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009880 tx=0x7f1e5c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.165+0000 7f1e71370640 1 -- 172.21.15.67:0/2436600788 shutdown_connections 2024-08-31T05:17:59.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.165+0000 7f1e71370640 1 --2- 172.21.15.67:0/2436600788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e6c1005c0 0x7f1e6c100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.165+0000 7f1e71370640 1 --2- 172.21.15.67:0/2436600788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e6c106670 0x7f1e6c106a50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.165+0000 7f1e71370640 1 -- 172.21.15.67:0/2436600788 >> 172.21.15.67:0/2436600788 conn(0x7f1e6c0fc2c0 msgr2=0x7f1e6c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:59.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.165+0000 7f1e71370640 1 -- 172.21.15.67:0/2436600788 shutdown_connections 2024-08-31T05:17:59.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.165+0000 7f1e71370640 1 -- 172.21.15.67:0/2436600788 wait complete. 2024-08-31T05:17:59.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.166+0000 7f1e71370640 1 Processor -- start 2024-08-31T05:17:59.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.166+0000 7f1e71370640 1 -- start start 2024-08-31T05:17:59.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.166+0000 7f1e71370640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e6c1005c0 0x7f1e6c197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:59.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.166+0000 7f1e71370640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e6c106670 0x7f1e6c197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:59.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.166+0000 7f1e71370640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6c10dae0 con 0x7f1e6c106670 2024-08-31T05:17:59.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.166+0000 7f1e71370640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6c10d960 con 0x7f1e6c1005c0 2024-08-31T05:17:59.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.166+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e6c106670 0x7f1e6c197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:59.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.166+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e6c106670 0x7f1e6c197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59606/0 (socket says 172.21.15.67:59606) 2024-08-31T05:17:59.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.166+0000 7f1e63fff640 1 -- 172.21.15.67:0/404101876 learned_addr learned my addr 172.21.15.67:0/404101876 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:59.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.167+0000 7f1e63fff640 1 -- 172.21.15.67:0/404101876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e6c1005c0 msgr2=0x7f1e6c197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:59.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.167+0000 7f1e63fff640 1 --2- 172.21.15.67:0/404101876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e6c1005c0 0x7f1e6c197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.167+0000 7f1e63fff640 1 -- 172.21.15.67:0/404101876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6c19bff0 con 0x7f1e6c106670 2024-08-31T05:17:59.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.167+0000 7f1e63fff640 1 --2- 172.21.15.67:0/404101876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e6c106670 0x7f1e6c197c60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400b420 tx=0x7f1e5400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:59.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.167+0000 7f1e68ff9640 1 -- 172.21.15.67:0/404101876 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e54011630 con 0x7f1e6c106670 2024-08-31T05:17:59.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.167+0000 7f1e68ff9640 1 -- 172.21.15.67:0/404101876 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e54016070 con 0x7f1e6c106670 2024-08-31T05:17:59.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.167+0000 7f1e71370640 1 -- 172.21.15.67:0/404101876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e6c19c2e0 con 0x7f1e6c106670 2024-08-31T05:17:59.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.167+0000 7f1e68ff9640 1 -- 172.21.15.67:0/404101876 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e54010d40 con 0x7f1e6c106670 2024-08-31T05:17:59.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.167+0000 7f1e71370640 1 -- 172.21.15.67:0/404101876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e6c19c8f0 con 0x7f1e6c106670 2024-08-31T05:17:59.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.168+0000 7f1e71370640 1 -- 172.21.15.67:0/404101876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e6c101ce0 con 0x7f1e6c106670 2024-08-31T05:17:59.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.168+0000 7f1e68ff9640 1 -- 172.21.15.67:0/404101876 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f1e5401b460 con 0x7f1e6c106670 2024-08-31T05:17:59.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.169+0000 7f1e68ff9640 1 --2- 172.21.15.67:0/404101876 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f1e5806de90 0x7f1e58070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:59.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.169+0000 7f1e68ff9640 1 -- 172.21.15.67:0/404101876 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f1e5408d010 con 0x7f1e6c106670 2024-08-31T05:17:59.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.169+0000 7f1e6affd640 1 --2- 172.21.15.67:0/404101876 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f1e5806de90 0x7f1e58070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:59.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.169+0000 7f1e6affd640 1 --2- 172.21.15.67:0/404101876 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f1e5806de90 0x7f1e58070350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c0096c0 tx=0x7f1e5c000bc0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:59.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.173+0000 7f1e68ff9640 1 -- 172.21.15.67:0/404101876 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e5405af70 con 0x7f1e6c106670 2024-08-31T05:17:59.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.351+0000 7f1e71370640 1 -- 172.21.15.67:0/404101876 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1e6c198ab0 con 0x7f1e6c106670 2024-08-31T05:17:59.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.351+0000 7f1e68ff9640 1 -- 172.21.15.67:0/404101876 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e6c198ab0 con 0x7f1e6c106670 2024-08-31T05:17:59.353 INFO:teuthology.orchestra.run.smithi067.stdout:38654705699 2024-08-31T05:17:59.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.353+0000 7f1e71370640 1 -- 172.21.15.67:0/404101876 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f1e5806de90 msgr2=0x7f1e58070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:59.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.353+0000 7f1e71370640 1 --2- 172.21.15.67:0/404101876 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f1e5806de90 0x7f1e58070350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c0096c0 tx=0x7f1e5c000bc0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.353+0000 7f1e71370640 1 -- 172.21.15.67:0/404101876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e6c106670 msgr2=0x7f1e6c197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:59.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.353+0000 7f1e71370640 1 --2- 172.21.15.67:0/404101876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e6c106670 0x7f1e6c197c60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400b420 tx=0x7f1e5400b8e0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.353+0000 7f1e71370640 1 -- 172.21.15.67:0/404101876 shutdown_connections 2024-08-31T05:17:59.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.353+0000 7f1e71370640 1 --2- 172.21.15.67:0/404101876 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f1e5806de90 0x7f1e58070350 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.353+0000 7f1e71370640 1 --2- 172.21.15.67:0/404101876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e6c106670 0x7f1e6c197c60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.353+0000 7f1e71370640 1 --2- 172.21.15.67:0/404101876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e6c1005c0 0x7f1e6c197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.353+0000 7f1e71370640 1 -- 172.21.15.67:0/404101876 >> 172.21.15.67:0/404101876 conn(0x7f1e6c0fc2c0 msgr2=0x7f1e6c069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:59.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.353+0000 7f1e71370640 1 -- 172.21.15.67:0/404101876 shutdown_connections 2024-08-31T05:17:59.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.353+0000 7f1e71370640 1 -- 172.21.15.67:0/404101876 wait complete. 2024-08-31T05:17:59.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.357+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/1025497538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb4102870 msgr2=0x7f3bb4102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:59.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.357+0000 7f3bbc1ac640 1 --2- 172.21.15.67:0/1025497538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb4102870 0x7f3bb4102c50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009880 tx=0x7f3bb002a530 comp rx=0 tx=0).stop 2024-08-31T05:17:59.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.357+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/1025497538 shutdown_connections 2024-08-31T05:17:59.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.358+0000 7f3bbc1ac640 1 --2- 172.21.15.67:0/1025497538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bb4103190 0x7f3bb410b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.358+0000 7f3bbc1ac640 1 --2- 172.21.15.67:0/1025497538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb4102870 0x7f3bb4102c50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.358+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/1025497538 >> 172.21.15.67:0/1025497538 conn(0x7f3bb40fc2b0 msgr2=0x7f3bb40fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:59.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.358+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/1025497538 shutdown_connections 2024-08-31T05:17:59.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.358+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/1025497538 wait complete. 2024-08-31T05:17:59.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.358+0000 7f3bbc1ac640 1 Processor -- start 2024-08-31T05:17:59.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.358+0000 7f3bbc1ac640 1 -- start start 2024-08-31T05:17:59.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.358+0000 7f3bbc1ac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bb4102870 0x7f3bb41004d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:59.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.358+0000 7f3bbc1ac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb4103190 0x7f3bb4100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:59.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.358+0000 7f3bbc1ac640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb410eba0 con 0x7f3bb4103190 2024-08-31T05:17:59.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.358+0000 7f3bbc1ac640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb410ea20 con 0x7f3bb4102870 2024-08-31T05:17:59.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.359+0000 7f3bb9747640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb4103190 0x7f3bb4100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:59.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.359+0000 7f3bb9747640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb4103190 0x7f3bb4100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59616/0 (socket says 172.21.15.67:59616) 2024-08-31T05:17:59.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.359+0000 7f3bb9747640 1 -- 172.21.15.67:0/2361142566 learned_addr learned my addr 172.21.15.67:0/2361142566 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:17:59.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.359+0000 7f3bb9f48640 1 --2- 172.21.15.67:0/2361142566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bb4102870 0x7f3bb41004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:59.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.359+0000 7f3bb9747640 1 -- 172.21.15.67:0/2361142566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bb4102870 msgr2=0x7f3bb41004d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:59.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.359+0000 7f3bb9747640 1 --2- 172.21.15.67:0/2361142566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bb4102870 0x7f3bb41004d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.359+0000 7f3bb9747640 1 -- 172.21.15.67:0/2361142566 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb4100f50 con 0x7f3bb4103190 2024-08-31T05:17:59.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.359+0000 7f3bb9747640 1 --2- 172.21.15.67:0/2361142566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb4103190 0x7f3bb4100a10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c8f0 tx=0x7f3ba400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:59.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.359+0000 7f3baaffd640 1 -- 172.21.15.67:0/2361142566 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ba400ae50 con 0x7f3bb4103190 2024-08-31T05:17:59.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.359+0000 7f3baaffd640 1 -- 172.21.15.67:0/2361142566 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ba4005020 con 0x7f3bb4103190 2024-08-31T05:17:59.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.359+0000 7f3baaffd640 1 -- 172.21.15.67:0/2361142566 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ba4004d70 con 0x7f3bb4103190 2024-08-31T05:17:59.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.359+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/2361142566 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb4101240 con 0x7f3bb4103190 2024-08-31T05:17:59.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.359+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/2361142566 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb41a3c30 con 0x7f3bb4103190 2024-08-31T05:17:59.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.360+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/2361142566 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bb406ab40 con 0x7f3bb4103190 2024-08-31T05:17:59.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.361+0000 7f3baaffd640 1 -- 172.21.15.67:0/2361142566 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f3ba40051d0 con 0x7f3bb4103190 2024-08-31T05:17:59.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.361+0000 7f3baaffd640 1 --2- 172.21.15.67:0/2361142566 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3ba006dfd0 0x7f3ba0070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:17:59.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.361+0000 7f3baaffd640 1 -- 172.21.15.67:0/2361142566 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f3ba408d630 con 0x7f3bb4103190 2024-08-31T05:17:59.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.362+0000 7f3bb9f48640 1 --2- 172.21.15.67:0/2361142566 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3ba006dfd0 0x7f3ba0070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:17:59.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.362+0000 7f3bb9f48640 1 --2- 172.21.15.67:0/2361142566 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3ba006dfd0 0x7f3ba0070490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0031460 tx=0x7f3bb0009560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:17:59.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.366+0000 7f3baaffd640 1 -- 172.21.15.67:0/2361142566 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ba4014030 con 0x7f3bb4103190 2024-08-31T05:17:59.550 INFO:teuthology.orchestra.run.smithi067.stdout:60129542174 2024-08-31T05:17:59.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.548+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/2361142566 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3bb4105d40 con 0x7f3bb4103190 2024-08-31T05:17:59.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.548+0000 7f3baaffd640 1 -- 172.21.15.67:0/2361142566 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ba405b510 con 0x7f3bb4103190 2024-08-31T05:17:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.550+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/2361142566 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3ba006dfd0 msgr2=0x7f3ba0070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.550+0000 7f3bbc1ac640 1 --2- 172.21.15.67:0/2361142566 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3ba006dfd0 0x7f3ba0070490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0031460 tx=0x7f3bb0009560 comp rx=0 tx=0).stop 2024-08-31T05:17:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.550+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/2361142566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb4103190 msgr2=0x7f3bb4100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:17:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.550+0000 7f3bbc1ac640 1 --2- 172.21.15.67:0/2361142566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb4103190 0x7f3bb4100a10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c8f0 tx=0x7f3ba400cdb0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.550+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/2361142566 shutdown_connections 2024-08-31T05:17:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.550+0000 7f3bbc1ac640 1 --2- 172.21.15.67:0/2361142566 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f3ba006dfd0 0x7f3ba0070490 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.550+0000 7f3bbc1ac640 1 --2- 172.21.15.67:0/2361142566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb4103190 0x7f3bb4100a10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.550+0000 7f3bbc1ac640 1 --2- 172.21.15.67:0/2361142566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bb4102870 0x7f3bb41004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:17:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.550+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/2361142566 >> 172.21.15.67:0/2361142566 conn(0x7f3bb40fc2b0 msgr2=0x7f3bb4108cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:17:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.550+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/2361142566 shutdown_connections 2024-08-31T05:17:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:17:59.550+0000 7f3bbc1ac640 1 -- 172.21.15.67:0/2361142566 wait complete. 2024-08-31T05:17:59.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:17:59 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/404101876' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-31T05:17:59.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:17:59 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/404101876' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-31T05:18:00.154 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542172 got 60129542174 for osd.1 2024-08-31T05:18:00.154 DEBUG:teuthology.parallel:result is None 2024-08-31T05:18:00.660 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:00 smithi067 ceph-mon[17432]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:00.660 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:00 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2361142566' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-31T05:18:00.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.659+0000 7fef3b692640 1 -- 172.21.15.67:0/1624560003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef341016a0 msgr2=0x7fef34101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:00.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.659+0000 7fef3b692640 1 --2- 172.21.15.67:0/1624560003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef341016a0 0x7fef34101b00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fef28009880 tx=0x7fef2802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:00.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.659+0000 7fef3b692640 1 -- 172.21.15.67:0/1624560003 shutdown_connections 2024-08-31T05:18:00.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.659+0000 7fef3b692640 1 --2- 172.21.15.67:0/1624560003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef341016a0 0x7fef34101b00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:00.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.659+0000 7fef3b692640 1 --2- 172.21.15.67:0/1624560003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef341076a0 0x7fef34107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:00.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.659+0000 7fef3b692640 1 -- 172.21.15.67:0/1624560003 >> 172.21.15.67:0/1624560003 conn(0x7fef340fd3a0 msgr2=0x7fef340ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:00.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.659+0000 7fef3b692640 1 -- 172.21.15.67:0/1624560003 shutdown_connections 2024-08-31T05:18:00.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.659+0000 7fef3b692640 1 -- 172.21.15.67:0/1624560003 wait complete. 2024-08-31T05:18:00.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef3b692640 1 Processor -- start 2024-08-31T05:18:00.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef3b692640 1 -- start start 2024-08-31T05:18:00.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef3b692640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef341016a0 0x7fef3419d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:00.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef3b692640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef341076a0 0x7fef3419d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:00.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef3b692640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fef3410ebd0 con 0x7fef341016a0 2024-08-31T05:18:00.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef3b692640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fef3410ea50 con 0x7fef341076a0 2024-08-31T05:18:00.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef3942e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef341016a0 0x7fef3419d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:00.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef3942e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef341016a0 0x7fef3419d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59620/0 (socket says 172.21.15.67:59620) 2024-08-31T05:18:00.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef3942e640 1 -- 172.21.15.67:0/1314285597 learned_addr learned my addr 172.21.15.67:0/1314285597 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:00.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef38c2d640 1 --2- 172.21.15.67:0/1314285597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef341076a0 0x7fef3419d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:00.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef3942e640 1 -- 172.21.15.67:0/1314285597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef341076a0 msgr2=0x7fef3419d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:00.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef3942e640 1 --2- 172.21.15.67:0/1314285597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef341076a0 0x7fef3419d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:00.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef3942e640 1 -- 172.21.15.67:0/1314285597 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef341975e0 con 0x7fef341016a0 2024-08-31T05:18:00.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef38c2d640 1 --2- 172.21.15.67:0/1314285597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef341076a0 0x7fef3419d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:18:00.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.660+0000 7fef3942e640 1 --2- 172.21.15.67:0/1314285597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef341016a0 0x7fef3419d420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fef3000b420 tx=0x7fef3000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:00.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.661+0000 7fef267fc640 1 -- 172.21.15.67:0/1314285597 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef30011630 con 0x7fef341016a0 2024-08-31T05:18:00.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.661+0000 7fef267fc640 1 -- 172.21.15.67:0/1314285597 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef30016070 con 0x7fef341016a0 2024-08-31T05:18:00.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.661+0000 7fef3b692640 1 -- 172.21.15.67:0/1314285597 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef341978d0 con 0x7fef341016a0 2024-08-31T05:18:00.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.661+0000 7fef267fc640 1 -- 172.21.15.67:0/1314285597 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef30010d40 con 0x7fef341016a0 2024-08-31T05:18:00.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.661+0000 7fef3b692640 1 -- 172.21.15.67:0/1314285597 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef34197e60 con 0x7fef341016a0 2024-08-31T05:18:00.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.662+0000 7fef3b692640 1 -- 172.21.15.67:0/1314285597 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef34102de0 con 0x7fef341016a0 2024-08-31T05:18:00.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.662+0000 7fef267fc640 1 -- 172.21.15.67:0/1314285597 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fef3001b460 con 0x7fef341016a0 2024-08-31T05:18:00.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.663+0000 7fef267fc640 1 --2- 172.21.15.67:0/1314285597 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fef2006de30 0x7fef200702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:00.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.663+0000 7fef38c2d640 1 --2- 172.21.15.67:0/1314285597 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fef2006de30 0x7fef200702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:00.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.663+0000 7fef267fc640 1 -- 172.21.15.67:0/1314285597 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fef3008d0b0 con 0x7fef341016a0 2024-08-31T05:18:00.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.663+0000 7fef38c2d640 1 --2- 172.21.15.67:0/1314285597 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fef2006de30 0x7fef200702f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fef28031460 tx=0x7fef280095f0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:00.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.668+0000 7fef267fc640 1 -- 172.21.15.67:0/1314285597 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef3005af90 con 0x7fef341016a0 2024-08-31T05:18:00.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:00 smithi073 ceph-mon[24726]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:00.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:00 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2361142566' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-31T05:18:00.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.844+0000 7fef3b692640 1 -- 172.21.15.67:0/1314285597 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fef34109c30 con 0x7fef341016a0 2024-08-31T05:18:00.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.844+0000 7fef267fc640 1 -- 172.21.15.67:0/1314285597 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fef3005ec40 con 0x7fef341016a0 2024-08-31T05:18:00.846 INFO:teuthology.orchestra.run.smithi067.stdout:111669149714 2024-08-31T05:18:00.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.846+0000 7fef3b692640 1 -- 172.21.15.67:0/1314285597 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fef2006de30 msgr2=0x7fef200702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:00.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.846+0000 7fef3b692640 1 --2- 172.21.15.67:0/1314285597 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fef2006de30 0x7fef200702f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fef28031460 tx=0x7fef280095f0 comp rx=0 tx=0).stop 2024-08-31T05:18:00.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.846+0000 7fef3b692640 1 -- 172.21.15.67:0/1314285597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef341016a0 msgr2=0x7fef3419d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:00.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.846+0000 7fef3b692640 1 --2- 172.21.15.67:0/1314285597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef341016a0 0x7fef3419d420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fef3000b420 tx=0x7fef3000b8e0 comp rx=0 tx=0).stop 2024-08-31T05:18:00.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.846+0000 7fef3b692640 1 -- 172.21.15.67:0/1314285597 shutdown_connections 2024-08-31T05:18:00.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.846+0000 7fef3b692640 1 --2- 172.21.15.67:0/1314285597 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fef2006de30 0x7fef200702f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:00.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.846+0000 7fef3b692640 1 --2- 172.21.15.67:0/1314285597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef341076a0 0x7fef3419d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:00.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.846+0000 7fef3b692640 1 --2- 172.21.15.67:0/1314285597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef341016a0 0x7fef3419d420 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:00.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.846+0000 7fef3b692640 1 -- 172.21.15.67:0/1314285597 >> 172.21.15.67:0/1314285597 conn(0x7fef340fd3a0 msgr2=0x7fef340fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:00.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.847+0000 7fef3b692640 1 -- 172.21.15.67:0/1314285597 shutdown_connections 2024-08-31T05:18:00.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.847+0000 7fef3b692640 1 -- 172.21.15.67:0/1314285597 wait complete. 2024-08-31T05:18:00.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.901+0000 7fdee6e8d640 1 -- 172.21.15.67:0/986963373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdee01031d0 msgr2=0x7fdee010b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:00.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.901+0000 7fdee6e8d640 1 --2- 172.21.15.67:0/986963373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdee01031d0 0x7fdee010b6c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdecc0098b0 tx=0x7fdecc02a560 comp rx=0 tx=0).stop 2024-08-31T05:18:00.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.901+0000 7fdee6e8d640 1 -- 172.21.15.67:0/986963373 shutdown_connections 2024-08-31T05:18:00.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.901+0000 7fdee6e8d640 1 --2- 172.21.15.67:0/986963373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdee01031d0 0x7fdee010b6c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:00.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.901+0000 7fdee6e8d640 1 --2- 172.21.15.67:0/986963373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdee01028b0 0x7fdee0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:00.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.901+0000 7fdee6e8d640 1 -- 172.21.15.67:0/986963373 >> 172.21.15.67:0/986963373 conn(0x7fdee00fc2f0 msgr2=0x7fdee00fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:00.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.901+0000 7fdee6e8d640 1 -- 172.21.15.67:0/986963373 shutdown_connections 2024-08-31T05:18:00.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.901+0000 7fdee6e8d640 1 -- 172.21.15.67:0/986963373 wait complete. 2024-08-31T05:18:00.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.901+0000 7fdee6e8d640 1 Processor -- start 2024-08-31T05:18:00.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.901+0000 7fdee6e8d640 1 -- start start 2024-08-31T05:18:00.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.902+0000 7fdee6e8d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdee01028b0 0x7fdee0100510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:00.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.902+0000 7fdee6e8d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdee01031d0 0x7fdee0100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:00.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.902+0000 7fdee6e8d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdee010eb60 con 0x7fdee01028b0 2024-08-31T05:18:00.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.902+0000 7fdee6e8d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdee010e9e0 con 0x7fdee01031d0 2024-08-31T05:18:00.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.902+0000 7fdee4c29640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdee01028b0 0x7fdee0100510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:00.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.902+0000 7fdedffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdee01031d0 0x7fdee0100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:00.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.902+0000 7fdedffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdee01031d0 0x7fdee0100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:53536/0 (socket says 172.21.15.67:53536) 2024-08-31T05:18:00.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.902+0000 7fdedffff640 1 -- 172.21.15.67:0/2397197182 learned_addr learned my addr 172.21.15.67:0/2397197182 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:00.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.902+0000 7fdee4c29640 1 -- 172.21.15.67:0/2397197182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdee01031d0 msgr2=0x7fdee0100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:00.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.902+0000 7fdee4c29640 1 --2- 172.21.15.67:0/2397197182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdee01031d0 0x7fdee0100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:00.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.902+0000 7fdee4c29640 1 -- 172.21.15.67:0/2397197182 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee0100f90 con 0x7fdee01028b0 2024-08-31T05:18:00.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.902+0000 7fdee4c29640 1 --2- 172.21.15.67:0/2397197182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdee01028b0 0x7fdee0100510 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fded400c8f0 tx=0x7fded400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:00.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.903+0000 7fdeddffb640 1 -- 172.21.15.67:0/2397197182 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fded40079b0 con 0x7fdee01028b0 2024-08-31T05:18:00.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.903+0000 7fdeddffb640 1 -- 172.21.15.67:0/2397197182 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fded4007b50 con 0x7fdee01028b0 2024-08-31T05:18:00.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.903+0000 7fdeddffb640 1 -- 172.21.15.67:0/2397197182 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fded4018630 con 0x7fdee01028b0 2024-08-31T05:18:00.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.903+0000 7fdee6e8d640 1 -- 172.21.15.67:0/2397197182 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee0101280 con 0x7fdee01028b0 2024-08-31T05:18:00.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.903+0000 7fdee6e8d640 1 -- 172.21.15.67:0/2397197182 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee01a3b50 con 0x7fdee01028b0 2024-08-31T05:18:00.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.904+0000 7fdee6e8d640 1 -- 172.21.15.67:0/2397197182 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee006a2c0 con 0x7fdee01028b0 2024-08-31T05:18:00.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.904+0000 7fdeddffb640 1 -- 172.21.15.67:0/2397197182 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fded40187d0 con 0x7fdee01028b0 2024-08-31T05:18:00.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.905+0000 7fdeddffb640 1 --2- 172.21.15.67:0/2397197182 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fded006de90 0x7fded0070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:00.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.905+0000 7fdeddffb640 1 -- 172.21.15.67:0/2397197182 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fded408d8e0 con 0x7fdee01028b0 2024-08-31T05:18:00.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.905+0000 7fdedffff640 1 --2- 172.21.15.67:0/2397197182 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fded006de90 0x7fded0070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:00.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.906+0000 7fdedffff640 1 --2- 172.21.15.67:0/2397197182 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fded006de90 0x7fded0070350 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009230 tx=0x7fdecc0058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:00.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:00.909+0000 7fdeddffb640 1 -- 172.21.15.67:0/2397197182 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fded4014030 con 0x7fdee01028b0 2024-08-31T05:18:01.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:01.089+0000 7fdee6e8d640 1 -- 172.21.15.67:0/2397197182 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fdee0102c90 con 0x7fdee01028b0 2024-08-31T05:18:01.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:01.090+0000 7fdeddffb640 1 -- 172.21.15.67:0/2397197182 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fded405c8a0 con 0x7fdee01028b0 2024-08-31T05:18:01.091 INFO:teuthology.orchestra.run.smithi067.stdout:81604378648 2024-08-31T05:18:01.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:01.091+0000 7fdee6e8d640 1 -- 172.21.15.67:0/2397197182 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fded006de90 msgr2=0x7fded0070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:01.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:01.091+0000 7fdee6e8d640 1 --2- 172.21.15.67:0/2397197182 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fded006de90 0x7fded0070350 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009230 tx=0x7fdecc0058d0 comp rx=0 tx=0).stop 2024-08-31T05:18:01.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:01.091+0000 7fdee6e8d640 1 -- 172.21.15.67:0/2397197182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdee01028b0 msgr2=0x7fdee0100510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:01.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:01.091+0000 7fdee6e8d640 1 --2- 172.21.15.67:0/2397197182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdee01028b0 0x7fdee0100510 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fded400c8f0 tx=0x7fded400cdb0 comp rx=0 tx=0).stop 2024-08-31T05:18:01.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:01.092+0000 7fdee6e8d640 1 -- 172.21.15.67:0/2397197182 shutdown_connections 2024-08-31T05:18:01.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:01.092+0000 7fdee6e8d640 1 --2- 172.21.15.67:0/2397197182 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fded006de90 0x7fded0070350 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:01.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:01.092+0000 7fdee6e8d640 1 --2- 172.21.15.67:0/2397197182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdee01031d0 0x7fdee0100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:01.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:01.092+0000 7fdee6e8d640 1 --2- 172.21.15.67:0/2397197182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdee01028b0 0x7fdee0100510 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:01.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:01.092+0000 7fdee6e8d640 1 -- 172.21.15.67:0/2397197182 >> 172.21.15.67:0/2397197182 conn(0x7fdee00fc2f0 msgr2=0x7fdee0103af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:01.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:01.092+0000 7fdee6e8d640 1 -- 172.21.15.67:0/2397197182 shutdown_connections 2024-08-31T05:18:01.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:01.092+0000 7fdee6e8d640 1 -- 172.21.15.67:0/2397197182 wait complete. 2024-08-31T05:18:01.426 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705698 got 38654705699 for osd.0 2024-08-31T05:18:01.426 DEBUG:teuthology.parallel:result is None 2024-08-31T05:18:01.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:01 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1314285597' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-31T05:18:01.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:01 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2397197182' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-31T05:18:01.736 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:01 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1314285597' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-31T05:18:01.736 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:01 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2397197182' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-31T05:18:02.047 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378648 for osd.2 2024-08-31T05:18:02.047 DEBUG:teuthology.parallel:result is None 2024-08-31T05:18:02.658 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:02 smithi067 ceph-mon[17432]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:02.689 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149713 got 111669149714 for osd.3 2024-08-31T05:18:02.689 DEBUG:teuthology.parallel:result is None 2024-08-31T05:18:02.689 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T05:18:02.690 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T05:18:02.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:02 smithi073 ceph-mon[24726]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:03.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.464+0000 7fb571520640 1 -- 172.21.15.67:0/891196510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56c1076a0 msgr2=0x7fb56c107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:03.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.464+0000 7fb571520640 1 --2- 172.21.15.67:0/891196510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56c1076a0 0x7fb56c107a80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009880 tx=0x7fb55c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:03.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.464+0000 7fb571520640 1 -- 172.21.15.67:0/891196510 shutdown_connections 2024-08-31T05:18:03.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.464+0000 7fb571520640 1 --2- 172.21.15.67:0/891196510 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb56c1016a0 0x7fb56c101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:03.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.464+0000 7fb571520640 1 --2- 172.21.15.67:0/891196510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56c1076a0 0x7fb56c107a80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:03.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.464+0000 7fb571520640 1 -- 172.21.15.67:0/891196510 >> 172.21.15.67:0/891196510 conn(0x7fb56c0fd3a0 msgr2=0x7fb56c0ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:03.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.464+0000 7fb571520640 1 -- 172.21.15.67:0/891196510 shutdown_connections 2024-08-31T05:18:03.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.464+0000 7fb571520640 1 -- 172.21.15.67:0/891196510 wait complete. 2024-08-31T05:18:03.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.465+0000 7fb571520640 1 Processor -- start 2024-08-31T05:18:03.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.465+0000 7fb571520640 1 -- start start 2024-08-31T05:18:03.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.465+0000 7fb571520640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb56c1016a0 0x7fb56c19d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:03.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.465+0000 7fb571520640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56c1076a0 0x7fb56c19d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:03.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.465+0000 7fb571520640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c10ebd0 con 0x7fb56c1076a0 2024-08-31T05:18:03.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.465+0000 7fb571520640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c10ea50 con 0x7fb56c1016a0 2024-08-31T05:18:03.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.465+0000 7fb56a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56c1076a0 0x7fb56c19d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:03.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.465+0000 7fb56a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56c1076a0 0x7fb56c19d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59648/0 (socket says 172.21.15.67:59648) 2024-08-31T05:18:03.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.465+0000 7fb56a7fc640 1 -- 172.21.15.67:0/1120097256 learned_addr learned my addr 172.21.15.67:0/1120097256 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.465+0000 7fb56affd640 1 --2- 172.21.15.67:0/1120097256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb56c1016a0 0x7fb56c19d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.465+0000 7fb56a7fc640 1 -- 172.21.15.67:0/1120097256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb56c1016a0 msgr2=0x7fb56c19d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.465+0000 7fb56a7fc640 1 --2- 172.21.15.67:0/1120097256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb56c1016a0 0x7fb56c19d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.465+0000 7fb56a7fc640 1 -- 172.21.15.67:0/1120097256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c197600 con 0x7fb56c1076a0 2024-08-31T05:18:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.465+0000 7fb56affd640 1 --2- 172.21.15.67:0/1120097256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb56c1016a0 0x7fb56c19d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:18:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.466+0000 7fb56a7fc640 1 --2- 172.21.15.67:0/1120097256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56c1076a0 0x7fb56c19d980 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb55400b420 tx=0x7fb55400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.466+0000 7fb563fff640 1 -- 172.21.15.67:0/1120097256 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb554011630 con 0x7fb56c1076a0 2024-08-31T05:18:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.466+0000 7fb563fff640 1 -- 172.21.15.67:0/1120097256 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb554016070 con 0x7fb56c1076a0 2024-08-31T05:18:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.466+0000 7fb571520640 1 -- 172.21.15.67:0/1120097256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56c1978f0 con 0x7fb56c1076a0 2024-08-31T05:18:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.466+0000 7fb563fff640 1 -- 172.21.15.67:0/1120097256 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb554010d40 con 0x7fb56c1076a0 2024-08-31T05:18:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.466+0000 7fb571520640 1 -- 172.21.15.67:0/1120097256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb56c197e80 con 0x7fb56c1076a0 2024-08-31T05:18:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.467+0000 7fb571520640 1 -- 172.21.15.67:0/1120097256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb56c102de0 con 0x7fb56c1076a0 2024-08-31T05:18:03.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.467+0000 7fb563fff640 1 -- 172.21.15.67:0/1120097256 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fb55401b460 con 0x7fb56c1076a0 2024-08-31T05:18:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.468+0000 7fb563fff640 1 --2- 172.21.15.67:0/1120097256 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb55806de30 0x7fb5580702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.468+0000 7fb563fff640 1 -- 172.21.15.67:0/1120097256 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fb55408d0a0 con 0x7fb56c1076a0 2024-08-31T05:18:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.468+0000 7fb56affd640 1 --2- 172.21.15.67:0/1120097256 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb55806de30 0x7fb5580702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.468+0000 7fb56affd640 1 --2- 172.21.15.67:0/1120097256 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb55806de30 0x7fb5580702f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb55c000c00 tx=0x7fb55c031400 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:03.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.472+0000 7fb563fff640 1 -- 172.21.15.67:0/1120097256 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb55405af80 con 0x7fb56c1076a0 2024-08-31T05:18:03.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.644+0000 7fb571520640 1 -- 172.21.15.67:0/1120097256 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb56c198190 con 0x7fb55806de30 2024-08-31T05:18:03.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.645+0000 7fb563fff640 1 -- 172.21.15.67:0/1120097256 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7fb56c198190 con 0x7fb55806de30 2024-08-31T05:18:03.647 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:18:03.647 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-08-31T05:18:03.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.647+0000 7fb571520640 1 -- 172.21.15.67:0/1120097256 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb55806de30 msgr2=0x7fb5580702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:03.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.647+0000 7fb571520640 1 --2- 172.21.15.67:0/1120097256 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb55806de30 0x7fb5580702f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb55c000c00 tx=0x7fb55c031400 comp rx=0 tx=0).stop 2024-08-31T05:18:03.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.647+0000 7fb571520640 1 -- 172.21.15.67:0/1120097256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56c1076a0 msgr2=0x7fb56c19d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:03.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.647+0000 7fb571520640 1 --2- 172.21.15.67:0/1120097256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56c1076a0 0x7fb56c19d980 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb55400b420 tx=0x7fb55400b8e0 comp rx=0 tx=0).stop 2024-08-31T05:18:03.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.647+0000 7fb571520640 1 -- 172.21.15.67:0/1120097256 shutdown_connections 2024-08-31T05:18:03.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.647+0000 7fb571520640 1 --2- 172.21.15.67:0/1120097256 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb55806de30 0x7fb5580702f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:03.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.647+0000 7fb571520640 1 --2- 172.21.15.67:0/1120097256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56c1076a0 0x7fb56c19d980 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:03.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.647+0000 7fb571520640 1 --2- 172.21.15.67:0/1120097256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb56c1016a0 0x7fb56c19d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:03.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.647+0000 7fb571520640 1 -- 172.21.15.67:0/1120097256 >> 172.21.15.67:0/1120097256 conn(0x7fb56c0fd3a0 msgr2=0x7fb56c0fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:03.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.647+0000 7fb571520640 1 -- 172.21.15.67:0/1120097256 shutdown_connections 2024-08-31T05:18:03.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:03.647+0000 7fb571520640 1 -- 172.21.15.67:0/1120097256 wait complete. 2024-08-31T05:18:04.343 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-08-31T05:18:03.336041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":182692,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":178678,"kb_avail":562288220,"statfs":{"total":575970213888,"available":575783137280,"internally_reserved":0,"allocated":3969024,"data_stored":2609616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":182966944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002328"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":192,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-31T05:17:35.142195+0000","last_change":"2024-08-31T05:17:06.425401+0000","last_active":"2024-08-31T05:17:35.142195+0000","last_peered":"2024-08-31T05:17:35.142195+0000","last_clean":"2024-08-31T05:17:35.142195+0000","last_became_active":"2024-08-31T05:17:06.425101+0000","last_became_peered":"2024-08-31T05:17:06.425101+0000","last_unstale":"2024-08-31T05:17:35.142195+0000","last_undegraded":"2024-08-31T05:17:35.142195+0000","last_fullsized":"2024-08-31T05:17:35.142195+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:16:17.981048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:16:17.981048+0000","last_clean_scrub_stamp":"2024-08-31T05:16:17.981048+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:30.342882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":364544,"data_stored":139752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31548,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713604,"statfs":{"total":95995035648,"available":95962730496,"internally_reserved":0,"allocated":364544,"data_stored":139752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":730120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31544,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713608,"statfs":{"total":95995035648,"available":95962734592,"internally_reserved":0,"allocated":364544,"data_stored":139752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":730120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":958464,"data_stored":730120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T05:18:04.344 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T05:18:04.600 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:04.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:04 smithi073 ceph-mon[24726]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:04.705 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:04 smithi067 ceph-mon[17432]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:04.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.995+0000 7f0a52c89640 1 -- 172.21.15.67:0/3768389979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a4c1005c0 msgr2=0x7f0a4c100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:04.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.995+0000 7f0a52c89640 1 --2- 172.21.15.67:0/3768389979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a4c1005c0 0x7f0a4c100a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009880 tx=0x7f0a3802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:05.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.995+0000 7f0a52c89640 1 -- 172.21.15.67:0/3768389979 shutdown_connections 2024-08-31T05:18:05.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.995+0000 7f0a52c89640 1 --2- 172.21.15.67:0/3768389979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a4c1005c0 0x7f0a4c100a20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:05.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.995+0000 7f0a52c89640 1 --2- 172.21.15.67:0/3768389979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a4c106670 0x7f0a4c106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:05.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.995+0000 7f0a52c89640 1 -- 172.21.15.67:0/3768389979 >> 172.21.15.67:0/3768389979 conn(0x7f0a4c0fc2c0 msgr2=0x7f0a4c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:05.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.995+0000 7f0a52c89640 1 -- 172.21.15.67:0/3768389979 shutdown_connections 2024-08-31T05:18:05.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.995+0000 7f0a52c89640 1 -- 172.21.15.67:0/3768389979 wait complete. 2024-08-31T05:18:05.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.995+0000 7f0a52c89640 1 Processor -- start 2024-08-31T05:18:05.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.996+0000 7f0a52c89640 1 -- start start 2024-08-31T05:18:05.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.996+0000 7f0a52c89640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a4c1005c0 0x7f0a4c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:05.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.996+0000 7f0a52c89640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a4c106670 0x7f0a4c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:05.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.996+0000 7f0a52c89640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4c10dae0 con 0x7f0a4c106670 2024-08-31T05:18:05.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.996+0000 7f0a52c89640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4c10d960 con 0x7f0a4c1005c0 2024-08-31T05:18:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.996+0000 7f0a4bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a4c106670 0x7f0a4c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.996+0000 7f0a4bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a4c106670 0x7f0a4c198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59658/0 (socket says 172.21.15.67:59658) 2024-08-31T05:18:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.996+0000 7f0a4bfff640 1 -- 172.21.15.67:0/1466250900 learned_addr learned my addr 172.21.15.67:0/1466250900 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.996+0000 7f0a50a25640 1 --2- 172.21.15.67:0/1466250900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a4c1005c0 0x7f0a4c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.996+0000 7f0a4bfff640 1 -- 172.21.15.67:0/1466250900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a4c1005c0 msgr2=0x7f0a4c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.996+0000 7f0a4bfff640 1 --2- 172.21.15.67:0/1466250900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a4c1005c0 0x7f0a4c1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.996+0000 7f0a4bfff640 1 -- 172.21.15.67:0/1466250900 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4c199130 con 0x7f0a4c106670 2024-08-31T05:18:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.996+0000 7f0a50a25640 1 --2- 172.21.15.67:0/1466250900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a4c1005c0 0x7f0a4c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:18:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.996+0000 7f0a4bfff640 1 --2- 172.21.15.67:0/1466250900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a4c106670 0x7f0a4c198ae0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0a38004f90 tx=0x7f0a380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.997+0000 7f0a49ffb640 1 -- 172.21.15.67:0/1466250900 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a3803f070 con 0x7f0a4c106670 2024-08-31T05:18:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.997+0000 7f0a52c89640 1 -- 172.21.15.67:0/1466250900 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a4c1993c0 con 0x7f0a4c106670 2024-08-31T05:18:05.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.997+0000 7f0a49ffb640 1 -- 172.21.15.67:0/1466250900 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a38004cf0 con 0x7f0a4c106670 2024-08-31T05:18:05.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.997+0000 7f0a49ffb640 1 -- 172.21.15.67:0/1466250900 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a38035030 con 0x7f0a4c106670 2024-08-31T05:18:05.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.997+0000 7f0a52c89640 1 -- 172.21.15.67:0/1466250900 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a4c1a1970 con 0x7f0a4c106670 2024-08-31T05:18:05.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.998+0000 7f0a52c89640 1 -- 172.21.15.67:0/1466250900 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a4c101ce0 con 0x7f0a4c106670 2024-08-31T05:18:05.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.998+0000 7f0a49ffb640 1 -- 172.21.15.67:0/1466250900 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f0a38042070 con 0x7f0a4c106670 2024-08-31T05:18:05.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.999+0000 7f0a49ffb640 1 --2- 172.21.15.67:0/1466250900 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f0a3c06de30 0x7f0a3c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:05.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.999+0000 7f0a49ffb640 1 -- 172.21.15.67:0/1466250900 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f0a380ae320 con 0x7f0a4c106670 2024-08-31T05:18:05.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:04.999+0000 7f0a50a25640 1 --2- 172.21.15.67:0/1466250900 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f0a3c06de30 0x7f0a3c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:05.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.000+0000 7f0a50a25640 1 --2- 172.21.15.67:0/1466250900 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f0a3c06de30 0x7f0a3c0702f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0a40006fd0 tx=0x7f0a40008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:05.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.004+0000 7f0a49ffb640 1 -- 172.21.15.67:0/1466250900 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a3807c200 con 0x7f0a4c106670 2024-08-31T05:18:05.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.177+0000 7f0a52c89640 1 -- 172.21.15.67:0/1466250900 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a4c0623d0 con 0x7f0a3c06de30 2024-08-31T05:18:05.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.178+0000 7f0a49ffb640 1 -- 172.21.15.67:0/1466250900 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f0a4c0623d0 con 0x7f0a3c06de30 2024-08-31T05:18:05.180 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:18:05.180 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-08-31T05:18:05.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.180+0000 7f0a52c89640 1 -- 172.21.15.67:0/1466250900 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f0a3c06de30 msgr2=0x7f0a3c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:05.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.180+0000 7f0a52c89640 1 --2- 172.21.15.67:0/1466250900 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f0a3c06de30 0x7f0a3c0702f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0a40006fd0 tx=0x7f0a40008040 comp rx=0 tx=0).stop 2024-08-31T05:18:05.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.180+0000 7f0a52c89640 1 -- 172.21.15.67:0/1466250900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a4c106670 msgr2=0x7f0a4c198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:05.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.180+0000 7f0a52c89640 1 --2- 172.21.15.67:0/1466250900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a4c106670 0x7f0a4c198ae0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0a38004f90 tx=0x7f0a380048f0 comp rx=0 tx=0).stop 2024-08-31T05:18:05.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.180+0000 7f0a52c89640 1 -- 172.21.15.67:0/1466250900 shutdown_connections 2024-08-31T05:18:05.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.180+0000 7f0a52c89640 1 --2- 172.21.15.67:0/1466250900 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f0a3c06de30 0x7f0a3c0702f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:05.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.180+0000 7f0a52c89640 1 --2- 172.21.15.67:0/1466250900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a4c106670 0x7f0a4c198ae0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:05.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.180+0000 7f0a52c89640 1 --2- 172.21.15.67:0/1466250900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a4c1005c0 0x7f0a4c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:05.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.180+0000 7f0a52c89640 1 -- 172.21.15.67:0/1466250900 >> 172.21.15.67:0/1466250900 conn(0x7f0a4c0fc2c0 msgr2=0x7f0a4c0fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:05.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.180+0000 7f0a52c89640 1 -- 172.21.15.67:0/1466250900 shutdown_connections 2024-08-31T05:18:05.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:05.180+0000 7f0a52c89640 1 -- 172.21.15.67:0/1466250900 wait complete. 2024-08-31T05:18:05.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:05 smithi073 ceph-mon[24726]: from='client.14510 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:18:05.795 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:05 smithi067 ceph-mon[17432]: from='client.14510 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:18:05.822 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-08-31T05:18:03.336041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":182692,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":178678,"kb_avail":562288220,"statfs":{"total":575970213888,"available":575783137280,"internally_reserved":0,"allocated":3969024,"data_stored":2609616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":182966944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002328"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":192,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-31T05:17:35.142195+0000","last_change":"2024-08-31T05:17:06.425401+0000","last_active":"2024-08-31T05:17:35.142195+0000","last_peered":"2024-08-31T05:17:35.142195+0000","last_clean":"2024-08-31T05:17:35.142195+0000","last_became_active":"2024-08-31T05:17:06.425101+0000","last_became_peered":"2024-08-31T05:17:06.425101+0000","last_unstale":"2024-08-31T05:17:35.142195+0000","last_undegraded":"2024-08-31T05:17:35.142195+0000","last_fullsized":"2024-08-31T05:17:35.142195+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:16:17.981048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:16:17.981048+0000","last_clean_scrub_stamp":"2024-08-31T05:16:17.981048+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:30.342882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":364544,"data_stored":139752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31548,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713604,"statfs":{"total":95995035648,"available":95962730496,"internally_reserved":0,"allocated":364544,"data_stored":139752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":730120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31544,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713608,"statfs":{"total":95995035648,"available":95962734592,"internally_reserved":0,"allocated":364544,"data_stored":139752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":730120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":958464,"data_stored":730120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T05:18:05.823 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T05:18:05.823 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-31T05:18:05.823 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-31T05:18:05.823 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph health --format=json 2024-08-31T05:18:06.073 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:06.506 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:06 smithi067 ceph-mon[17432]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:18:06.506 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:06 smithi067 ceph-mon[17432]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:06.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.583+0000 7fd71d533640 1 -- 172.21.15.67:0/1965416864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd718103170 msgr2=0x7fd71810b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:06.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.583+0000 7fd71d533640 1 --2- 172.21.15.67:0/1965416864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd718103170 0x7fd71810b660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd700009880 tx=0x7fd70002a530 comp rx=0 tx=0).stop 2024-08-31T05:18:06.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.583+0000 7fd71d533640 1 -- 172.21.15.67:0/1965416864 shutdown_connections 2024-08-31T05:18:06.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.583+0000 7fd71d533640 1 --2- 172.21.15.67:0/1965416864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd718103170 0x7fd71810b660 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:06.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.583+0000 7fd71d533640 1 --2- 172.21.15.67:0/1965416864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd718102850 0x7fd718102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:06.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.584+0000 7fd71d533640 1 -- 172.21.15.67:0/1965416864 >> 172.21.15.67:0/1965416864 conn(0x7fd7180fc2f0 msgr2=0x7fd7180fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.584+0000 7fd71d533640 1 -- 172.21.15.67:0/1965416864 shutdown_connections 2024-08-31T05:18:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.584+0000 7fd71d533640 1 -- 172.21.15.67:0/1965416864 wait complete. 2024-08-31T05:18:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.584+0000 7fd71d533640 1 Processor -- start 2024-08-31T05:18:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.584+0000 7fd71d533640 1 -- start start 2024-08-31T05:18:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.585+0000 7fd71d533640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd718102850 0x7fd718197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.585+0000 7fd71d533640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd718103170 0x7fd718197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.585+0000 7fd71d533640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd71810eb60 con 0x7fd718103170 2024-08-31T05:18:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.585+0000 7fd71d533640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd71810e9e0 con 0x7fd718102850 2024-08-31T05:18:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.585+0000 7fd7167fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd718103170 0x7fd718197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.585+0000 7fd7167fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd718103170 0x7fd718197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59686/0 (socket says 172.21.15.67:59686) 2024-08-31T05:18:06.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.585+0000 7fd7167fc640 1 -- 172.21.15.67:0/1999381650 learned_addr learned my addr 172.21.15.67:0/1999381650 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:06.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.585+0000 7fd716ffd640 1 --2- 172.21.15.67:0/1999381650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd718102850 0x7fd718197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:06.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.585+0000 7fd7167fc640 1 -- 172.21.15.67:0/1999381650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd718102850 msgr2=0x7fd718197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:06.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.585+0000 7fd7167fc640 1 --2- 172.21.15.67:0/1999381650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd718102850 0x7fd718197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:06.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.585+0000 7fd7167fc640 1 -- 172.21.15.67:0/1999381650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71819bfd0 con 0x7fd718103170 2024-08-31T05:18:06.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.585+0000 7fd7167fc640 1 --2- 172.21.15.67:0/1999381650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd718103170 0x7fd718197c40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd700031460 tx=0x7fd7000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:06.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.585+0000 7fd70ffff640 1 -- 172.21.15.67:0/1999381650 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd70003f070 con 0x7fd718103170 2024-08-31T05:18:06.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.585+0000 7fd70ffff640 1 -- 172.21.15.67:0/1999381650 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd700004ac0 con 0x7fd718103170 2024-08-31T05:18:06.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.586+0000 7fd71d533640 1 -- 172.21.15.67:0/1999381650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd71819c260 con 0x7fd718103170 2024-08-31T05:18:06.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.586+0000 7fd70ffff640 1 -- 172.21.15.67:0/1999381650 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd700035030 con 0x7fd718103170 2024-08-31T05:18:06.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.586+0000 7fd71d533640 1 -- 172.21.15.67:0/1999381650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd71819c790 con 0x7fd718103170 2024-08-31T05:18:06.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.587+0000 7fd71d533640 1 -- 172.21.15.67:0/1999381650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd71806a320 con 0x7fd718103170 2024-08-31T05:18:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.587+0000 7fd70ffff640 1 -- 172.21.15.67:0/1999381650 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fd700042070 con 0x7fd718103170 2024-08-31T05:18:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.587+0000 7fd70ffff640 1 --2- 172.21.15.67:0/1999381650 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd70406de30 0x7fd7040702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.588+0000 7fd716ffd640 1 --2- 172.21.15.67:0/1999381650 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd70406de30 0x7fd7040702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.588+0000 7fd70ffff640 1 -- 172.21.15.67:0/1999381650 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fd7000ae240 con 0x7fd718103170 2024-08-31T05:18:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.588+0000 7fd716ffd640 1 --2- 172.21.15.67:0/1999381650 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd70406de30 0x7fd7040702f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd7100058c0 tx=0x7fd71000a4c0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.592+0000 7fd70ffff640 1 -- 172.21.15.67:0/1999381650 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd70007c120 con 0x7fd718103170 2024-08-31T05:18:06.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:06 smithi073 ceph-mon[24726]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:18:06.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:06 smithi073 ceph-mon[24726]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:06.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.806+0000 7fd71d533640 1 -- 172.21.15.67:0/1999381650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd718198a60 con 0x7fd718103170 2024-08-31T05:18:06.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.806+0000 7fd70ffff640 1 -- 172.21.15.67:0/1999381650 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd70007fdd0 con 0x7fd718103170 2024-08-31T05:18:06.808 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:18:06.808 INFO:teuthology.orchestra.run.smithi067.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-31T05:18:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.808+0000 7fd71d533640 1 -- 172.21.15.67:0/1999381650 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd70406de30 msgr2=0x7fd7040702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.808+0000 7fd71d533640 1 --2- 172.21.15.67:0/1999381650 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd70406de30 0x7fd7040702f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd7100058c0 tx=0x7fd71000a4c0 comp rx=0 tx=0).stop 2024-08-31T05:18:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.808+0000 7fd71d533640 1 -- 172.21.15.67:0/1999381650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd718103170 msgr2=0x7fd718197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.808+0000 7fd71d533640 1 --2- 172.21.15.67:0/1999381650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd718103170 0x7fd718197c40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd700031460 tx=0x7fd7000046c0 comp rx=0 tx=0).stop 2024-08-31T05:18:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.808+0000 7fd71d533640 1 -- 172.21.15.67:0/1999381650 shutdown_connections 2024-08-31T05:18:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.808+0000 7fd71d533640 1 --2- 172.21.15.67:0/1999381650 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd70406de30 0x7fd7040702f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.808+0000 7fd71d533640 1 --2- 172.21.15.67:0/1999381650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd718103170 0x7fd718197c40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.808+0000 7fd71d533640 1 --2- 172.21.15.67:0/1999381650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd718102850 0x7fd718197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.808+0000 7fd71d533640 1 -- 172.21.15.67:0/1999381650 >> 172.21.15.67:0/1999381650 conn(0x7fd7180fc2f0 msgr2=0x7fd71810ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.809+0000 7fd71d533640 1 -- 172.21.15.67:0/1999381650 shutdown_connections 2024-08-31T05:18:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:06.809+0000 7fd71d533640 1 -- 172.21.15.67:0/1999381650 wait complete. 2024-08-31T05:18:07.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:07 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1999381650' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-31T05:18:07.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:07 smithi067 ceph-mon[17432]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:07.629 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-31T05:18:07.630 INFO:tasks.cephadm:Setup complete, yielding 2024-08-31T05:18:07.630 INFO:teuthology.run_tasks:Running task print... 2024-08-31T05:18:07.637 INFO:teuthology.task.print:**** done end installing squid cephadm ... 2024-08-31T05:18:07.638 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T05:18:07.677 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2024-08-31T05:18:07.677 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-08-31T05:18:07.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:07 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1999381650' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-31T05:18:07.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:07 smithi073 ceph-mon[24726]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:07.944 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:08.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.423+0000 7f0d5e97a640 1 -- 172.21.15.67:0/382590267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d58100600 msgr2=0x7f0d58100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:08.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.423+0000 7f0d5e97a640 1 --2- 172.21.15.67:0/382590267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d58100600 0x7f0d58100a00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009880 tx=0x7f0d4802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:08.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.423+0000 7f0d5e97a640 1 -- 172.21.15.67:0/382590267 shutdown_connections 2024-08-31T05:18:08.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.423+0000 7f0d5e97a640 1 --2- 172.21.15.67:0/382590267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58101800 0x7f0d58101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:08.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.423+0000 7f0d5e97a640 1 --2- 172.21.15.67:0/382590267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d58100600 0x7f0d58100a00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:08.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.423+0000 7f0d5e97a640 1 -- 172.21.15.67:0/382590267 >> 172.21.15.67:0/382590267 conn(0x7f0d580fbdb0 msgr2=0x7f0d580fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:08.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.424+0000 7f0d5e97a640 1 -- 172.21.15.67:0/382590267 shutdown_connections 2024-08-31T05:18:08.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.424+0000 7f0d5e97a640 1 -- 172.21.15.67:0/382590267 wait complete. 2024-08-31T05:18:08.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.424+0000 7f0d5e97a640 1 Processor -- start 2024-08-31T05:18:08.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.424+0000 7f0d5e97a640 1 -- start start 2024-08-31T05:18:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d5e97a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58100600 0x7f0d5806aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d5e97a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d58101800 0x7f0d5819e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d5e97a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0d581094a0 con 0x7f0d58101800 2024-08-31T05:18:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d5e97a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0d58109320 con 0x7f0d58100600 2024-08-31T05:18:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d4ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d58101800 0x7f0d5819e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d4ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d58101800 0x7f0d5819e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47066/0 (socket says 172.21.15.67:47066) 2024-08-31T05:18:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d4ffff640 1 -- 172.21.15.67:0/2501326451 learned_addr learned my addr 172.21.15.67:0/2501326451 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d57fff640 1 --2- 172.21.15.67:0/2501326451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58100600 0x7f0d5806aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d4ffff640 1 -- 172.21.15.67:0/2501326451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58100600 msgr2=0x7f0d5806aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d4ffff640 1 --2- 172.21.15.67:0/2501326451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58100600 0x7f0d5806aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d4ffff640 1 -- 172.21.15.67:0/2501326451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5819e940 con 0x7f0d58101800 2024-08-31T05:18:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d4ffff640 1 --2- 172.21.15.67:0/2501326451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d58101800 0x7f0d5819e400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000b420 tx=0x7f0d4000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d55ffb640 1 -- 172.21.15.67:0/2501326451 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d40011630 con 0x7f0d58101800 2024-08-31T05:18:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d55ffb640 1 -- 172.21.15.67:0/2501326451 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d40016070 con 0x7f0d58101800 2024-08-31T05:18:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d5e97a640 1 -- 172.21.15.67:0/2501326451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5819eb10 con 0x7f0d58101800 2024-08-31T05:18:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d55ffb640 1 -- 172.21.15.67:0/2501326451 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d40010d30 con 0x7f0d58101800 2024-08-31T05:18:08.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.425+0000 7f0d5e97a640 1 -- 172.21.15.67:0/2501326451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5819f0c0 con 0x7f0d58101800 2024-08-31T05:18:08.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.426+0000 7f0d5e97a640 1 -- 172.21.15.67:0/2501326451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d58100a00 con 0x7f0d58101800 2024-08-31T05:18:08.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.427+0000 7f0d55ffb640 1 -- 172.21.15.67:0/2501326451 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f0d4001b460 con 0x7f0d58101800 2024-08-31T05:18:08.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.427+0000 7f0d55ffb640 1 --2- 172.21.15.67:0/2501326451 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f0d4406de90 0x7f0d44070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.428+0000 7f0d55ffb640 1 -- 172.21.15.67:0/2501326451 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f0d4008d000 con 0x7f0d58101800 2024-08-31T05:18:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.428+0000 7f0d57fff640 1 --2- 172.21.15.67:0/2501326451 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f0d4406de90 0x7f0d44070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.428+0000 7f0d57fff640 1 --2- 172.21.15.67:0/2501326451 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f0d4406de90 0x7f0d44070350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009230 tx=0x7f0d480058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:08.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.432+0000 7f0d55ffb640 1 -- 172.21.15.67:0/2501326451 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d4005aed0 con 0x7f0d58101800 2024-08-31T05:18:08.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.611+0000 7f0d5e97a640 1 -- 172.21.15.67:0/2501326451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) -- 0x7f0d58062b90 con 0x7f0d58101800 2024-08-31T05:18:08.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.614+0000 7f0d55ffb640 1 -- 172.21.15.67:0/2501326451 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v42)=0 v42) ==== 143+0+0 (secure 0 0 0) 0x7f0d4005eb80 con 0x7f0d58101800 2024-08-31T05:18:08.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.616+0000 7f0d5e97a640 1 -- 172.21.15.67:0/2501326451 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f0d4406de90 msgr2=0x7f0d44070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:08.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.616+0000 7f0d5e97a640 1 --2- 172.21.15.67:0/2501326451 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f0d4406de90 0x7f0d44070350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009230 tx=0x7f0d480058d0 comp rx=0 tx=0).stop 2024-08-31T05:18:08.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.616+0000 7f0d5e97a640 1 -- 172.21.15.67:0/2501326451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d58101800 msgr2=0x7f0d5819e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:08.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.616+0000 7f0d5e97a640 1 --2- 172.21.15.67:0/2501326451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d58101800 0x7f0d5819e400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000b420 tx=0x7f0d4000b8e0 comp rx=0 tx=0).stop 2024-08-31T05:18:08.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.616+0000 7f0d5e97a640 1 -- 172.21.15.67:0/2501326451 shutdown_connections 2024-08-31T05:18:08.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.616+0000 7f0d5e97a640 1 --2- 172.21.15.67:0/2501326451 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f0d4406de90 0x7f0d44070350 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:08.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.616+0000 7f0d5e97a640 1 --2- 172.21.15.67:0/2501326451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d58101800 0x7f0d5819e400 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:08.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.616+0000 7f0d5e97a640 1 --2- 172.21.15.67:0/2501326451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58100600 0x7f0d5806aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:08.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.616+0000 7f0d5e97a640 1 -- 172.21.15.67:0/2501326451 >> 172.21.15.67:0/2501326451 conn(0x7f0d580fbdb0 msgr2=0x7f0d58104d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:08.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.616+0000 7f0d5e97a640 1 -- 172.21.15.67:0/2501326451 shutdown_connections 2024-08-31T05:18:08.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:08.616+0000 7f0d5e97a640 1 -- 172.21.15.67:0/2501326451 wait complete. 2024-08-31T05:18:09.311 INFO:teuthology.run_tasks:Running task print... 2024-08-31T05:18:09.320 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-08-31T05:18:09.320 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T05:18:09.369 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2024-08-31T05:18:09.369 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch status' 2024-08-31T05:18:09.628 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:09.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:09 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2501326451' entity='client.admin' 2024-08-31T05:18:09.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:09 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:18:09.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:09 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:09.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:09 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:18:09.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:09 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:09.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:09 smithi067 ceph-mon[17432]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:09.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:09 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2501326451' entity='client.admin' 2024-08-31T05:18:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:09 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:18:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:09 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:09 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:18:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:09 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:09 smithi073 ceph-mon[24726]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:10.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.060+0000 7f44fa328640 1 -- 172.21.15.67:0/1411946880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f4101800 msgr2=0x7f44f4101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:10.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.060+0000 7f44fa328640 1 --2- 172.21.15.67:0/1411946880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f4101800 0x7f44f4101c80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f44e8009880 tx=0x7f44e802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:10.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.060+0000 7f44fa328640 1 -- 172.21.15.67:0/1411946880 shutdown_connections 2024-08-31T05:18:10.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.060+0000 7f44fa328640 1 --2- 172.21.15.67:0/1411946880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f4101800 0x7f44f4101c80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:10.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.060+0000 7f44fa328640 1 --2- 172.21.15.67:0/1411946880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f4100600 0x7f44f4100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:10.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.060+0000 7f44fa328640 1 -- 172.21.15.67:0/1411946880 >> 172.21.15.67:0/1411946880 conn(0x7f44f40fbdb0 msgr2=0x7f44f40fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:10.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.060+0000 7f44fa328640 1 -- 172.21.15.67:0/1411946880 shutdown_connections 2024-08-31T05:18:10.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.060+0000 7f44fa328640 1 -- 172.21.15.67:0/1411946880 wait complete. 2024-08-31T05:18:10.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.061+0000 7f44fa328640 1 Processor -- start 2024-08-31T05:18:10.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.061+0000 7f44fa328640 1 -- start start 2024-08-31T05:18:10.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.061+0000 7f44fa328640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f4100600 0x7f44f4104520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:10.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.061+0000 7f44fa328640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f4101800 0x7f44f4102be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.061+0000 7f44fa328640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f44f4109420 con 0x7f44f4100600 2024-08-31T05:18:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.061+0000 7f44fa328640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41092a0 con 0x7f44f4101800 2024-08-31T05:18:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.061+0000 7f44f3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f4100600 0x7f44f4104520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.061+0000 7f44f3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f4100600 0x7f44f4104520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47096/0 (socket says 172.21.15.67:47096) 2024-08-31T05:18:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.061+0000 7f44f3fff640 1 -- 172.21.15.67:0/4070414955 learned_addr learned my addr 172.21.15.67:0/4070414955 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.061+0000 7f44f37fe640 1 --2- 172.21.15.67:0/4070414955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f4101800 0x7f44f4102be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.061+0000 7f44f3fff640 1 -- 172.21.15.67:0/4070414955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f4101800 msgr2=0x7f44f4102be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.061+0000 7f44f3fff640 1 --2- 172.21.15.67:0/4070414955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f4101800 0x7f44f4102be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.061+0000 7f44f3fff640 1 -- 172.21.15.67:0/4070414955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f4103120 con 0x7f44f4100600 2024-08-31T05:18:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.062+0000 7f44f3fff640 1 --2- 172.21.15.67:0/4070414955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f4100600 0x7f44f4104520 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f44e400c8f0 tx=0x7f44e400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.062+0000 7f44f17fa640 1 -- 172.21.15.67:0/4070414955 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f44e4004020 con 0x7f44f4100600 2024-08-31T05:18:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.062+0000 7f44f17fa640 1 -- 172.21.15.67:0/4070414955 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f44e4007e10 con 0x7f44f4100600 2024-08-31T05:18:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.062+0000 7f44fa328640 1 -- 172.21.15.67:0/4070414955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f4103410 con 0x7f44f4100600 2024-08-31T05:18:10.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.062+0000 7f44f17fa640 1 -- 172.21.15.67:0/4070414955 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f44e4003e10 con 0x7f44f4100600 2024-08-31T05:18:10.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.062+0000 7f44fa328640 1 -- 172.21.15.67:0/4070414955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f41039a0 con 0x7f44f4100600 2024-08-31T05:18:10.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.063+0000 7f44fa328640 1 -- 172.21.15.67:0/4070414955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f4100a00 con 0x7f44f4100600 2024-08-31T05:18:10.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.063+0000 7f44f17fa640 1 -- 172.21.15.67:0/4070414955 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f44e40041c0 con 0x7f44f4100600 2024-08-31T05:18:10.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.064+0000 7f44f17fa640 1 --2- 172.21.15.67:0/4070414955 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f44dc06de30 0x7f44dc0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:10.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.064+0000 7f44f37fe640 1 --2- 172.21.15.67:0/4070414955 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f44dc06de30 0x7f44dc0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:10.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.064+0000 7f44f17fa640 1 -- 172.21.15.67:0/4070414955 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f44e408d960 con 0x7f44f4100600 2024-08-31T05:18:10.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.064+0000 7f44f37fe640 1 --2- 172.21.15.67:0/4070414955 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f44dc06de30 0x7f44dc0702f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f44f41042a0 tx=0x7f44e8005a20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:10.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.068+0000 7f44f17fa640 1 -- 172.21.15.67:0/4070414955 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f44e405f570 con 0x7f44f4100600 2024-08-31T05:18:10.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.260+0000 7f44fa328640 1 -- 172.21.15.67:0/4070414955 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f44f419f2e0 con 0x7f44dc06de30 2024-08-31T05:18:10.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.261+0000 7f44f17fa640 1 -- 172.21.15.67:0/4070414955 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f44f419f2e0 con 0x7f44dc06de30 2024-08-31T05:18:10.262 INFO:teuthology.orchestra.run.smithi067.stdout:Backend: cephadm 2024-08-31T05:18:10.263 INFO:teuthology.orchestra.run.smithi067.stdout:Available: Yes 2024-08-31T05:18:10.263 INFO:teuthology.orchestra.run.smithi067.stdout:Paused: No 2024-08-31T05:18:10.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.263+0000 7f44fa328640 1 -- 172.21.15.67:0/4070414955 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f44dc06de30 msgr2=0x7f44dc0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:10.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.263+0000 7f44fa328640 1 --2- 172.21.15.67:0/4070414955 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f44dc06de30 0x7f44dc0702f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f44f41042a0 tx=0x7f44e8005a20 comp rx=0 tx=0).stop 2024-08-31T05:18:10.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.263+0000 7f44fa328640 1 -- 172.21.15.67:0/4070414955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f4100600 msgr2=0x7f44f4104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:10.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.263+0000 7f44fa328640 1 --2- 172.21.15.67:0/4070414955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f4100600 0x7f44f4104520 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f44e400c8f0 tx=0x7f44e400cdb0 comp rx=0 tx=0).stop 2024-08-31T05:18:10.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.263+0000 7f44fa328640 1 -- 172.21.15.67:0/4070414955 shutdown_connections 2024-08-31T05:18:10.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.263+0000 7f44fa328640 1 --2- 172.21.15.67:0/4070414955 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f44dc06de30 0x7f44dc0702f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:10.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.263+0000 7f44fa328640 1 --2- 172.21.15.67:0/4070414955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f4101800 0x7f44f4102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:10.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.263+0000 7f44fa328640 1 --2- 172.21.15.67:0/4070414955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f44f4100600 0x7f44f4104520 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:10.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.263+0000 7f44fa328640 1 -- 172.21.15.67:0/4070414955 >> 172.21.15.67:0/4070414955 conn(0x7f44f40fbdb0 msgr2=0x7f44f406a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:10.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.263+0000 7f44fa328640 1 -- 172.21.15.67:0/4070414955 shutdown_connections 2024-08-31T05:18:10.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:10.263+0000 7f44fa328640 1 -- 172.21.15.67:0/4070414955 wait complete. 2024-08-31T05:18:10.852 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-31T05:18:10.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:10 smithi073 ceph-mon[24726]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:11.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:10 smithi067 ceph-mon[17432]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:11.104 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:11.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.543+0000 7f9fa709b640 1 -- 172.21.15.67:0/4289794786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fa0101820 msgr2=0x7f9fa0101ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:11.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.543+0000 7f9fa709b640 1 --2- 172.21.15.67:0/4289794786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fa0101820 0x7f9fa0101ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009880 tx=0x7f9f9402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.543+0000 7f9fa709b640 1 -- 172.21.15.67:0/4289794786 shutdown_connections 2024-08-31T05:18:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.543+0000 7f9fa709b640 1 --2- 172.21.15.67:0/4289794786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fa0101820 0x7f9fa0101ca0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.543+0000 7f9fa709b640 1 --2- 172.21.15.67:0/4289794786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fa0100620 0x7f9fa0100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.543+0000 7f9fa709b640 1 -- 172.21.15.67:0/4289794786 >> 172.21.15.67:0/4289794786 conn(0x7f9fa00fbdb0 msgr2=0x7f9fa00fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.543+0000 7f9fa709b640 1 -- 172.21.15.67:0/4289794786 shutdown_connections 2024-08-31T05:18:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.543+0000 7f9fa709b640 1 -- 172.21.15.67:0/4289794786 wait complete. 2024-08-31T05:18:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.544+0000 7f9fa709b640 1 Processor -- start 2024-08-31T05:18:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.544+0000 7f9fa709b640 1 -- start start 2024-08-31T05:18:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.544+0000 7f9fa709b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fa0100620 0x7f9fa006aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.544+0000 7f9fa709b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fa0101820 0x7f9fa019c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.544+0000 7f9fa709b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa01094e0 con 0x7f9fa0100620 2024-08-31T05:18:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.544+0000 7f9fa709b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa0109360 con 0x7f9fa0101820 2024-08-31T05:18:11.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.544+0000 7f9fa4e37640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fa0100620 0x7f9fa006aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:11.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.544+0000 7f9fa4e37640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fa0100620 0x7f9fa006aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47106/0 (socket says 172.21.15.67:47106) 2024-08-31T05:18:11.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.544+0000 7f9fa4e37640 1 -- 172.21.15.67:0/3014384847 learned_addr learned my addr 172.21.15.67:0/3014384847 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:11.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.544+0000 7f9f9ffff640 1 --2- 172.21.15.67:0/3014384847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fa0101820 0x7f9fa019c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:11.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.544+0000 7f9fa4e37640 1 -- 172.21.15.67:0/3014384847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fa0101820 msgr2=0x7f9fa019c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:11.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.544+0000 7f9fa4e37640 1 --2- 172.21.15.67:0/3014384847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fa0101820 0x7f9fa019c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:11.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.544+0000 7f9fa4e37640 1 -- 172.21.15.67:0/3014384847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa019c6b0 con 0x7f9fa0100620 2024-08-31T05:18:11.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.544+0000 7f9fa4e37640 1 --2- 172.21.15.67:0/3014384847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fa0100620 0x7f9fa006aa40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000b9c0 tx=0x7f9f9000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:11.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.545+0000 7f9f9dffb640 1 -- 172.21.15.67:0/3014384847 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f90019070 con 0x7f9fa0100620 2024-08-31T05:18:11.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.545+0000 7f9fa709b640 1 -- 172.21.15.67:0/3014384847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa019c9a0 con 0x7f9fa0100620 2024-08-31T05:18:11.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.545+0000 7f9f9dffb640 1 -- 172.21.15.67:0/3014384847 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f9000cde0 con 0x7f9fa0100620 2024-08-31T05:18:11.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.545+0000 7f9f9dffb640 1 -- 172.21.15.67:0/3014384847 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f90012570 con 0x7f9fa0100620 2024-08-31T05:18:11.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.545+0000 7f9fa709b640 1 -- 172.21.15.67:0/3014384847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa019cfb0 con 0x7f9fa0100620 2024-08-31T05:18:11.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.546+0000 7f9fa709b640 1 -- 172.21.15.67:0/3014384847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa0100a20 con 0x7f9fa0100620 2024-08-31T05:18:11.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.546+0000 7f9f9dffb640 1 -- 172.21.15.67:0/3014384847 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f9f9001c070 con 0x7f9fa0100620 2024-08-31T05:18:11.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.547+0000 7f9f9dffb640 1 --2- 172.21.15.67:0/3014384847 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f9f8806de30 0x7f9f880702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:11.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.547+0000 7f9f9ffff640 1 --2- 172.21.15.67:0/3014384847 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f9f8806de30 0x7f9f880702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:11.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.547+0000 7f9f9dffb640 1 -- 172.21.15.67:0/3014384847 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f9f9008d230 con 0x7f9fa0100620 2024-08-31T05:18:11.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.547+0000 7f9f9ffff640 1 --2- 172.21.15.67:0/3014384847 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f9f8806de30 0x7f9f880702f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9fa006a7c0 tx=0x7f9f94005a20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:11.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.551+0000 7f9f9dffb640 1 -- 172.21.15.67:0/3014384847 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9f9005b080 con 0x7f9fa0100620 2024-08-31T05:18:11.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.739+0000 7f9fa709b640 1 -- 172.21.15.67:0/3014384847 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9fa00623d0 con 0x7f9f8806de30 2024-08-31T05:18:11.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.747+0000 7f9f9dffb640 1 -- 172.21.15.67:0/3014384847 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3120 (secure 0 0 0) 0x7f9fa00623d0 con 0x7f9f8806de30 2024-08-31T05:18:11.749 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:18:11.749 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (3m) 111s ago 4m 26.4M - 0.25.0 c8568f914cd2 cad2b6757f0e 2024-08-31T05:18:11.749 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (5m) 111s ago 5m 7796k - 19.1.1-242-g244a32d3 395b9209a980 87adb449d2b7 2024-08-31T05:18:11.749 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (4m) 43s ago 4m 5263k - 19.1.1-242-g244a32d3 395b9209a980 d95ba11fe269 2024-08-31T05:18:11.749 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (5m) 111s ago 5m 6895k - 19.1.1-242-g244a32d3 395b9209a980 a47c71179c57 2024-08-31T05:18:11.749 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (4m) 43s ago 4m 6895k - 19.1.1-242-g244a32d3 395b9209a980 5f2ce08c4451 2024-08-31T05:18:11.749 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (3m) 111s ago 4m 72.8M - 9.4.12 2bacad6d85d8 ac51e53c0deb 2024-08-31T05:18:11.749 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:9283,8765,8443 running (6m) 111s ago 6m 489M - 19.1.1-242-g244a32d3 395b9209a980 436d56f83ade 2024-08-31T05:18:11.750 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (4m) 43s ago 4m 441M - 19.1.1-242-g244a32d3 395b9209a980 17ece75df6a0 2024-08-31T05:18:11.750 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (6m) 111s ago 6m 46.2M 2048M 19.1.1-242-g244a32d3 395b9209a980 7082a38c8108 2024-08-31T05:18:11.750 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (4m) 43s ago 4m 40.6M 2048M 19.1.1-242-g244a32d3 395b9209a980 30ccf0ed274b 2024-08-31T05:18:11.750 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (5m) 111s ago 5m 15.5M - 1.5.0 0da6a335fe13 d7c795c5bd95 2024-08-31T05:18:11.750 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (4m) 43s ago 4m 15.8M - 1.5.0 0da6a335fe13 f718603a0e92 2024-08-31T05:18:11.750 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (3m) 111s ago 3m 38.4M 3946M 19.1.1-242-g244a32d3 395b9209a980 b9f3f60b65f9 2024-08-31T05:18:11.750 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (2m) 111s ago 2m 46.1M 3946M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:18:11.750 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (2m) 111s ago 2m 45.6M 3946M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:18:11.750 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (101s) 43s ago 101s 48.0M 4970M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:18:11.750 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (75s) 43s ago 74s 45.5M 4970M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:18:11.750 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (48s) 43s ago 48s 11.0M 4970M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:18:11.750 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (3m) 111s ago 4m 43.8M - 2.43.0 a07b618ecd1d 9a2383a57b2c 2024-08-31T05:18:11.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.749+0000 7f9fa709b640 1 -- 172.21.15.67:0/3014384847 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f9f8806de30 msgr2=0x7f9f880702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:11.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.749+0000 7f9fa709b640 1 --2- 172.21.15.67:0/3014384847 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f9f8806de30 0x7f9f880702f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9fa006a7c0 tx=0x7f9f94005a20 comp rx=0 tx=0).stop 2024-08-31T05:18:11.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.749+0000 7f9fa709b640 1 -- 172.21.15.67:0/3014384847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fa0100620 msgr2=0x7f9fa006aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:11.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.749+0000 7f9fa709b640 1 --2- 172.21.15.67:0/3014384847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fa0100620 0x7f9fa006aa40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000b9c0 tx=0x7f9f9000be80 comp rx=0 tx=0).stop 2024-08-31T05:18:11.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.749+0000 7f9fa709b640 1 -- 172.21.15.67:0/3014384847 shutdown_connections 2024-08-31T05:18:11.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.749+0000 7f9fa709b640 1 --2- 172.21.15.67:0/3014384847 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f9f8806de30 0x7f9f880702f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:11.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.749+0000 7f9fa709b640 1 --2- 172.21.15.67:0/3014384847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fa0101820 0x7f9fa019c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:11.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.749+0000 7f9fa709b640 1 --2- 172.21.15.67:0/3014384847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fa0100620 0x7f9fa006aa40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:11.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.749+0000 7f9fa709b640 1 -- 172.21.15.67:0/3014384847 >> 172.21.15.67:0/3014384847 conn(0x7f9fa00fbdb0 msgr2=0x7f9fa0104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:11.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.749+0000 7f9fa709b640 1 -- 172.21.15.67:0/3014384847 shutdown_connections 2024-08-31T05:18:11.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:11.749+0000 7f9fa709b640 1 -- 172.21.15.67:0/3014384847 wait complete. 2024-08-31T05:18:11.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:11 smithi067 ceph-mon[17432]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:11.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:18:11.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:11 smithi073 ceph-mon[24726]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:11.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:18:12.483 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-31T05:18:12.742 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:12.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:12 smithi067 ceph-mon[17432]: from='client.14530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:12.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:12 smithi073 ceph-mon[24726]: from='client.14530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:13.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.223+0000 7fdace48a640 1 -- 172.21.15.67:0/3576361606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac8102190 msgr2=0x7fdac8104580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:13.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.223+0000 7fdace48a640 1 --2- 172.21.15.67:0/3576361606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac8102190 0x7fdac8104580 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdab80098b0 tx=0x7fdab802a4d0 comp rx=0 tx=0).stop 2024-08-31T05:18:13.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.223+0000 7fdace48a640 1 -- 172.21.15.67:0/3576361606 shutdown_connections 2024-08-31T05:18:13.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.223+0000 7fdace48a640 1 --2- 172.21.15.67:0/3576361606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac8104ac0 0x7fdac8106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:13.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.223+0000 7fdace48a640 1 --2- 172.21.15.67:0/3576361606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac8102190 0x7fdac8104580 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:13.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.223+0000 7fdace48a640 1 -- 172.21.15.67:0/3576361606 >> 172.21.15.67:0/3576361606 conn(0x7fdac80fbdb0 msgr2=0x7fdac80fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:13.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.223+0000 7fdace48a640 1 -- 172.21.15.67:0/3576361606 shutdown_connections 2024-08-31T05:18:13.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.223+0000 7fdace48a640 1 -- 172.21.15.67:0/3576361606 wait complete. 2024-08-31T05:18:13.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.224+0000 7fdace48a640 1 Processor -- start 2024-08-31T05:18:13.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.224+0000 7fdace48a640 1 -- start start 2024-08-31T05:18:13.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.224+0000 7fdace48a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac8102190 0x7fdac8101a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.224+0000 7fdace48a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac8104ac0 0x7fdac8100140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.224+0000 7fdace48a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdac810a5d0 con 0x7fdac8102190 2024-08-31T05:18:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.224+0000 7fdace48a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdac810a450 con 0x7fdac8104ac0 2024-08-31T05:18:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.225+0000 7fdac7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac8102190 0x7fdac8101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.225+0000 7fdac7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac8102190 0x7fdac8101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47122/0 (socket says 172.21.15.67:47122) 2024-08-31T05:18:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.225+0000 7fdac7fff640 1 -- 172.21.15.67:0/544379904 learned_addr learned my addr 172.21.15.67:0/544379904 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.225+0000 7fdac77fe640 1 --2- 172.21.15.67:0/544379904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac8104ac0 0x7fdac8100140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.225+0000 7fdac7fff640 1 -- 172.21.15.67:0/544379904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac8104ac0 msgr2=0x7fdac8100140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.225+0000 7fdac7fff640 1 --2- 172.21.15.67:0/544379904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac8104ac0 0x7fdac8100140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.225+0000 7fdac7fff640 1 -- 172.21.15.67:0/544379904 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac8100680 con 0x7fdac8102190 2024-08-31T05:18:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.225+0000 7fdac7fff640 1 --2- 172.21.15.67:0/544379904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac8102190 0x7fdac8101a80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdab80099d0 tx=0x7fdab80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.225+0000 7fdac57fa640 1 -- 172.21.15.67:0/544379904 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdab803f070 con 0x7fdac8102190 2024-08-31T05:18:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.225+0000 7fdac57fa640 1 -- 172.21.15.67:0/544379904 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdab8004c70 con 0x7fdac8102190 2024-08-31T05:18:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.225+0000 7fdace48a640 1 -- 172.21.15.67:0/544379904 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac8100910 con 0x7fdac8102190 2024-08-31T05:18:13.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.225+0000 7fdac57fa640 1 -- 172.21.15.67:0/544379904 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdab8035030 con 0x7fdac8102190 2024-08-31T05:18:13.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.225+0000 7fdace48a640 1 -- 172.21.15.67:0/544379904 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac8100ec0 con 0x7fdac8102190 2024-08-31T05:18:13.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.226+0000 7fdace48a640 1 -- 172.21.15.67:0/544379904 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac8102570 con 0x7fdac8102190 2024-08-31T05:18:13.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.227+0000 7fdac57fa640 1 -- 172.21.15.67:0/544379904 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fdab8042070 con 0x7fdac8102190 2024-08-31T05:18:13.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.227+0000 7fdac57fa640 1 --2- 172.21.15.67:0/544379904 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fdab006de90 0x7fdab0070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:13.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.227+0000 7fdac57fa640 1 -- 172.21.15.67:0/544379904 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fdab80ae410 con 0x7fdac8102190 2024-08-31T05:18:13.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.227+0000 7fdac77fe640 1 --2- 172.21.15.67:0/544379904 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fdab006de90 0x7fdab0070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:13.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.228+0000 7fdac77fe640 1 --2- 172.21.15.67:0/544379904 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fdab006de90 0x7fdab0070350 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdac8101800 tx=0x7fdabc008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:13.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.231+0000 7fdac57fa640 1 -- 172.21.15.67:0/544379904 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdab807c370 con 0x7fdac8102190 2024-08-31T05:18:13.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.415+0000 7fdace48a640 1 -- 172.21.15.67:0/544379904 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fdac81054a0 con 0x7fdab006de90 2024-08-31T05:18:13.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.420+0000 7fdac57fa640 1 -- 172.21.15.67:0/544379904 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1290 (secure 0 0 0) 0x7fdac81054a0 con 0x7fdab006de90 2024-08-31T05:18:13.422 INFO:teuthology.orchestra.run.smithi067.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-31T05:18:13.422 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager ?:9093,9094 1/1 113s ago 5m count:1 2024-08-31T05:18:13.422 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter 2/2 113s ago 5m * 2024-08-31T05:18:13.422 INFO:teuthology.orchestra.run.smithi067.stdout:crash 2/2 113s ago 5m * 2024-08-31T05:18:13.422 INFO:teuthology.orchestra.run.smithi067.stdout:grafana ?:3000 1/1 113s ago 5m count:1 2024-08-31T05:18:13.422 INFO:teuthology.orchestra.run.smithi067.stdout:mgr 2/2 113s ago 5m count:2 2024-08-31T05:18:13.422 INFO:teuthology.orchestra.run.smithi067.stdout:mon 2/2 113s ago 5m smithi067:172.21.15.67=smithi067;smithi073:172.21.15.73=smithi073;count:2 2024-08-31T05:18:13.422 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter ?:9100 2/2 113s ago 5m * 2024-08-31T05:18:13.422 INFO:teuthology.orchestra.run.smithi067.stdout:osd 6 113s ago - 2024-08-31T05:18:13.423 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus ?:9095 1/1 113s ago 5m count:1 2024-08-31T05:18:13.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.422+0000 7fdace48a640 1 -- 172.21.15.67:0/544379904 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fdab006de90 msgr2=0x7fdab0070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:13.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.422+0000 7fdace48a640 1 --2- 172.21.15.67:0/544379904 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fdab006de90 0x7fdab0070350 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdac8101800 tx=0x7fdabc008040 comp rx=0 tx=0).stop 2024-08-31T05:18:13.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.422+0000 7fdace48a640 1 -- 172.21.15.67:0/544379904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac8102190 msgr2=0x7fdac8101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:13.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.422+0000 7fdace48a640 1 --2- 172.21.15.67:0/544379904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac8102190 0x7fdac8101a80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdab80099d0 tx=0x7fdab80048f0 comp rx=0 tx=0).stop 2024-08-31T05:18:13.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.422+0000 7fdace48a640 1 -- 172.21.15.67:0/544379904 shutdown_connections 2024-08-31T05:18:13.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.422+0000 7fdace48a640 1 --2- 172.21.15.67:0/544379904 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fdab006de90 0x7fdab0070350 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:13.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.422+0000 7fdace48a640 1 --2- 172.21.15.67:0/544379904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac8104ac0 0x7fdac8100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:13.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.422+0000 7fdace48a640 1 --2- 172.21.15.67:0/544379904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac8102190 0x7fdac8101a80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:13.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.422+0000 7fdace48a640 1 -- 172.21.15.67:0/544379904 >> 172.21.15.67:0/544379904 conn(0x7fdac80fbdb0 msgr2=0x7fdac80fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:13.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.422+0000 7fdace48a640 1 -- 172.21.15.67:0/544379904 shutdown_connections 2024-08-31T05:18:13.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:13.423+0000 7fdace48a640 1 -- 172.21.15.67:0/544379904 wait complete. 2024-08-31T05:18:13.730 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:13 smithi067 ceph-mon[17432]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:13.730 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:13 smithi067 ceph-mon[17432]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:13.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:13 smithi073 ceph-mon[24726]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:13.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:13 smithi073 ceph-mon[24726]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:14.074 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-31T05:18:14.325 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:14.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.789+0000 7feaa3c5a640 1 -- 172.21.15.67:0/4279195176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea9c100600 msgr2=0x7fea9c100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:14.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.789+0000 7feaa3c5a640 1 --2- 172.21.15.67:0/4279195176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea9c100600 0x7fea9c100a00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fea98009880 tx=0x7fea9802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:14.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.789+0000 7feaa3c5a640 1 -- 172.21.15.67:0/4279195176 shutdown_connections 2024-08-31T05:18:14.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.789+0000 7feaa3c5a640 1 --2- 172.21.15.67:0/4279195176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea9c101800 0x7fea9c101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.789+0000 7feaa3c5a640 1 --2- 172.21.15.67:0/4279195176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea9c100600 0x7fea9c100a00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.789+0000 7feaa3c5a640 1 -- 172.21.15.67:0/4279195176 >> 172.21.15.67:0/4279195176 conn(0x7fea9c0fbdb0 msgr2=0x7fea9c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.789+0000 7feaa3c5a640 1 -- 172.21.15.67:0/4279195176 shutdown_connections 2024-08-31T05:18:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.789+0000 7feaa3c5a640 1 -- 172.21.15.67:0/4279195176 wait complete. 2024-08-31T05:18:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.789+0000 7feaa3c5a640 1 Processor -- start 2024-08-31T05:18:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.789+0000 7feaa3c5a640 1 -- start start 2024-08-31T05:18:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa3c5a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea9c100600 0x7fea9c104520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa3c5a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea9c101800 0x7fea9c102be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa3c5a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c109420 con 0x7fea9c100600 2024-08-31T05:18:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa3c5a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c1092a0 con 0x7fea9c101800 2024-08-31T05:18:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa19f6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea9c100600 0x7fea9c104520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:14.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa19f6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea9c100600 0x7fea9c104520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47146/0 (socket says 172.21.15.67:47146) 2024-08-31T05:18:14.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa19f6640 1 -- 172.21.15.67:0/1352158893 learned_addr learned my addr 172.21.15.67:0/1352158893 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:14.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa11f5640 1 --2- 172.21.15.67:0/1352158893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea9c101800 0x7fea9c102be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:14.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa19f6640 1 -- 172.21.15.67:0/1352158893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea9c101800 msgr2=0x7fea9c102be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:14.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa19f6640 1 --2- 172.21.15.67:0/1352158893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea9c101800 0x7fea9c102be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:14.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa19f6640 1 -- 172.21.15.67:0/1352158893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9c103120 con 0x7fea9c100600 2024-08-31T05:18:14.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa11f5640 1 --2- 172.21.15.67:0/1352158893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea9c101800 0x7fea9c102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:18:14.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa19f6640 1 --2- 172.21.15.67:0/1352158893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea9c100600 0x7fea9c104520 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fea98006010 tx=0x7fea980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:14.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7fea92ffd640 1 -- 172.21.15.67:0/1352158893 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea9803f070 con 0x7fea9c100600 2024-08-31T05:18:14.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7fea92ffd640 1 -- 172.21.15.67:0/1352158893 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea980044d0 con 0x7fea9c100600 2024-08-31T05:18:14.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa3c5a640 1 -- 172.21.15.67:0/1352158893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9c1033b0 con 0x7fea9c100600 2024-08-31T05:18:14.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7fea92ffd640 1 -- 172.21.15.67:0/1352158893 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea98035030 con 0x7fea9c100600 2024-08-31T05:18:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.790+0000 7feaa3c5a640 1 -- 172.21.15.67:0/1352158893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea9c1038e0 con 0x7fea9c100600 2024-08-31T05:18:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.791+0000 7feaa3c5a640 1 -- 172.21.15.67:0/1352158893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9c100a00 con 0x7fea9c100600 2024-08-31T05:18:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.792+0000 7fea92ffd640 1 -- 172.21.15.67:0/1352158893 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fea98042070 con 0x7fea9c100600 2024-08-31T05:18:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.792+0000 7fea92ffd640 1 --2- 172.21.15.67:0/1352158893 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fea8806de90 0x7fea88070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.793+0000 7fea92ffd640 1 -- 172.21.15.67:0/1352158893 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fea980ae430 con 0x7fea9c100600 2024-08-31T05:18:14.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.793+0000 7feaa11f5640 1 --2- 172.21.15.67:0/1352158893 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fea8806de90 0x7fea88070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:14.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.793+0000 7feaa11f5640 1 --2- 172.21.15.67:0/1352158893 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fea8806de90 0x7fea88070350 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fea9c1042a0 tx=0x7fea8c00a5c0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.797+0000 7fea92ffd640 1 -- 172.21.15.67:0/1352158893 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea9807c390 con 0x7fea9c100600 2024-08-31T05:18:14.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.980+0000 7feaa3c5a640 1 -- 172.21.15.67:0/1352158893 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fea9c06a1a0 con 0x7fea8806de90 2024-08-31T05:18:14.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.981+0000 7fea92ffd640 1 -- 172.21.15.67:0/1352158893 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+145 (secure 0 0 0) 0x7fea9c06a1a0 con 0x7fea8806de90 2024-08-31T05:18:14.983 INFO:teuthology.orchestra.run.smithi067.stdout:HOST ADDR LABELS STATUS 2024-08-31T05:18:14.983 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067 172.21.15.67 2024-08-31T05:18:14.983 INFO:teuthology.orchestra.run.smithi067.stdout:smithi073 172.21.15.73 2024-08-31T05:18:14.983 INFO:teuthology.orchestra.run.smithi067.stdout:2 hosts in cluster 2024-08-31T05:18:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.983+0000 7feaa3c5a640 1 -- 172.21.15.67:0/1352158893 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fea8806de90 msgr2=0x7fea88070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.983+0000 7feaa3c5a640 1 --2- 172.21.15.67:0/1352158893 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fea8806de90 0x7fea88070350 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fea9c1042a0 tx=0x7fea8c00a5c0 comp rx=0 tx=0).stop 2024-08-31T05:18:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.983+0000 7feaa3c5a640 1 -- 172.21.15.67:0/1352158893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea9c100600 msgr2=0x7fea9c104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.983+0000 7feaa3c5a640 1 --2- 172.21.15.67:0/1352158893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea9c100600 0x7fea9c104520 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fea98006010 tx=0x7fea980048f0 comp rx=0 tx=0).stop 2024-08-31T05:18:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.984+0000 7feaa3c5a640 1 -- 172.21.15.67:0/1352158893 shutdown_connections 2024-08-31T05:18:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.984+0000 7feaa3c5a640 1 --2- 172.21.15.67:0/1352158893 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fea8806de90 0x7fea88070350 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.984+0000 7feaa3c5a640 1 --2- 172.21.15.67:0/1352158893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea9c101800 0x7fea9c102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.984+0000 7feaa3c5a640 1 --2- 172.21.15.67:0/1352158893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea9c100600 0x7fea9c104520 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.984+0000 7feaa3c5a640 1 -- 172.21.15.67:0/1352158893 >> 172.21.15.67:0/1352158893 conn(0x7fea9c0fbdb0 msgr2=0x7fea9c069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.984+0000 7feaa3c5a640 1 -- 172.21.15.67:0/1352158893 shutdown_connections 2024-08-31T05:18:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:14.984+0000 7feaa3c5a640 1 -- 172.21.15.67:0/1352158893 wait complete. 2024-08-31T05:18:15.541 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-31T05:18:15.792 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:16.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.270+0000 7f012f54d640 1 -- 172.21.15.67:0/1808040331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0128102900 msgr2=0x7f0128102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.270+0000 7f012f54d640 1 --2- 172.21.15.67:0/1808040331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0128102900 0x7f0128102d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0118009880 tx=0x7f011802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.270+0000 7f012f54d640 1 -- 172.21.15.67:0/1808040331 shutdown_connections 2024-08-31T05:18:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.270+0000 7f012f54d640 1 --2- 172.21.15.67:0/1808040331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0128102900 0x7f0128102d80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.270+0000 7f012f54d640 1 --2- 172.21.15.67:0/1808040331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0128101700 0x7f0128101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.270+0000 7f012f54d640 1 -- 172.21.15.67:0/1808040331 >> 172.21.15.67:0/1808040331 conn(0x7f01280fce90 msgr2=0x7f01280ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.270+0000 7f012f54d640 1 -- 172.21.15.67:0/1808040331 shutdown_connections 2024-08-31T05:18:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.270+0000 7f012f54d640 1 -- 172.21.15.67:0/1808040331 wait complete. 2024-08-31T05:18:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.270+0000 7f012f54d640 1 Processor -- start 2024-08-31T05:18:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.270+0000 7f012f54d640 1 -- start start 2024-08-31T05:18:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f012f54d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0128101700 0x7f0128199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:16.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f012f54d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0128102900 0x7f0128199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:16.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f012f54d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f012810a520 con 0x7f0128101700 2024-08-31T05:18:16.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f012f54d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f012810a3a0 con 0x7f0128102900 2024-08-31T05:18:16.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f012cae8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0128102900 0x7f0128199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:16.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f012cae8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0128102900 0x7f0128199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:45166/0 (socket says 172.21.15.67:45166) 2024-08-31T05:18:16.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f012cae8640 1 -- 172.21.15.67:0/99689681 learned_addr learned my addr 172.21.15.67:0/99689681 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:16.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f012d2e9640 1 --2- 172.21.15.67:0/99689681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0128101700 0x7f0128199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:16.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f012d2e9640 1 -- 172.21.15.67:0/99689681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0128102900 msgr2=0x7f0128199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:16.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f012d2e9640 1 --2- 172.21.15.67:0/99689681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0128102900 0x7f0128199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:16.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f012d2e9640 1 -- 172.21.15.67:0/99689681 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0128199ff0 con 0x7f0128101700 2024-08-31T05:18:16.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f012d2e9640 1 --2- 172.21.15.67:0/99689681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0128101700 0x7f0128199430 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f012400c8c0 tx=0x7f012400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:16.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f011e7fc640 1 -- 172.21.15.67:0/99689681 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01240079b0 con 0x7f0128101700 2024-08-31T05:18:16.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f012f54d640 1 -- 172.21.15.67:0/99689681 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f012819ea30 con 0x7f0128101700 2024-08-31T05:18:16.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f011e7fc640 1 -- 172.21.15.67:0/99689681 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0124007b50 con 0x7f0128101700 2024-08-31T05:18:16.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f011e7fc640 1 -- 172.21.15.67:0/99689681 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0124018630 con 0x7f0128101700 2024-08-31T05:18:16.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.271+0000 7f012f54d640 1 -- 172.21.15.67:0/99689681 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012819efc0 con 0x7f0128101700 2024-08-31T05:18:16.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.272+0000 7f012f54d640 1 -- 172.21.15.67:0/99689681 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0128101b00 con 0x7f0128101700 2024-08-31T05:18:16.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.273+0000 7f011e7fc640 1 -- 172.21.15.67:0/99689681 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f012400f450 con 0x7f0128101700 2024-08-31T05:18:16.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.273+0000 7f011e7fc640 1 --2- 172.21.15.67:0/99689681 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f011406de30 0x7f01140702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:16.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.273+0000 7f011e7fc640 1 -- 172.21.15.67:0/99689681 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f012408d9f0 con 0x7f0128101700 2024-08-31T05:18:16.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.274+0000 7f012cae8640 1 --2- 172.21.15.67:0/99689681 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f011406de30 0x7f01140702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:16.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.274+0000 7f012cae8640 1 --2- 172.21.15.67:0/99689681 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f011406de30 0x7f01140702f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f01180096c0 tx=0x7f0118005a20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:16.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.278+0000 7f011e7fc640 1 -- 172.21.15.67:0/99689681 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0124014030 con 0x7f0128101700 2024-08-31T05:18:16.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.466+0000 7f012f54d640 1 -- 172.21.15.67:0/99689681 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f0128075b70 con 0x7f011406de30 2024-08-31T05:18:16.468 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:16 smithi067 ceph-mon[17432]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:16.469 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:16 smithi067 ceph-mon[17432]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:16.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.468+0000 7f011e7fc640 1 -- 172.21.15.67:0/99689681 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7f0128075b70 con 0x7f011406de30 2024-08-31T05:18:16.470 INFO:teuthology.orchestra.run.smithi067.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-31T05:18:16.470 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53440042400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-31T05:18:16.470 INFO:teuthology.orchestra.run.smithi067.stdout:smithi073 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040115400BGN 372G No 44s ago Has a FileSystem, LVM detected 2024-08-31T05:18:16.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.470+0000 7f012f54d640 1 -- 172.21.15.67:0/99689681 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f011406de30 msgr2=0x7f01140702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:16.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.470+0000 7f012f54d640 1 --2- 172.21.15.67:0/99689681 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f011406de30 0x7f01140702f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f01180096c0 tx=0x7f0118005a20 comp rx=0 tx=0).stop 2024-08-31T05:18:16.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.470+0000 7f012f54d640 1 -- 172.21.15.67:0/99689681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0128101700 msgr2=0x7f0128199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:16.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.470+0000 7f012f54d640 1 --2- 172.21.15.67:0/99689681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0128101700 0x7f0128199430 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f012400c8c0 tx=0x7f012400cd80 comp rx=0 tx=0).stop 2024-08-31T05:18:16.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.470+0000 7f012f54d640 1 -- 172.21.15.67:0/99689681 shutdown_connections 2024-08-31T05:18:16.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.470+0000 7f012f54d640 1 --2- 172.21.15.67:0/99689681 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f011406de30 0x7f01140702f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:16.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.470+0000 7f012f54d640 1 --2- 172.21.15.67:0/99689681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0128102900 0x7f0128199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:16.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.470+0000 7f012f54d640 1 --2- 172.21.15.67:0/99689681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0128101700 0x7f0128199430 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:16.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.470+0000 7f012f54d640 1 -- 172.21.15.67:0/99689681 >> 172.21.15.67:0/99689681 conn(0x7f01280fce90 msgr2=0x7f0128074450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:16.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.470+0000 7f012f54d640 1 -- 172.21.15.67:0/99689681 shutdown_connections 2024-08-31T05:18:16.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:16.471+0000 7f012f54d640 1 -- 172.21.15.67:0/99689681 wait complete. 2024-08-31T05:18:16.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:16 smithi073 ceph-mon[24726]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:16.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:16 smithi073 ceph-mon[24726]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:17.022 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T05:18:17.032 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2024-08-31T05:18:17.032 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-08-31T05:18:17.284 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.765+0000 7f024f935640 1 -- 172.21.15.67:0/1286654568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02480fff80 msgr2=0x7f0248100380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.765+0000 7f024f935640 1 --2- 172.21.15.67:0/1286654568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02480fff80 0x7f0248100380 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f023c009880 tx=0x7f023c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.765+0000 7f024f935640 1 -- 172.21.15.67:0/1286654568 shutdown_connections 2024-08-31T05:18:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.765+0000 7f024f935640 1 --2- 172.21.15.67:0/1286654568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02481008c0 0x7f0248100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.765+0000 7f024f935640 1 --2- 172.21.15.67:0/1286654568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02480fff80 0x7f0248100380 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:17.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.765+0000 7f024f935640 1 -- 172.21.15.67:0/1286654568 >> 172.21.15.67:0/1286654568 conn(0x7f02480fbdb0 msgr2=0x7f02480fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.765+0000 7f024f935640 1 -- 172.21.15.67:0/1286654568 shutdown_connections 2024-08-31T05:18:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.765+0000 7f024f935640 1 -- 172.21.15.67:0/1286654568 wait complete. 2024-08-31T05:18:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.766+0000 7f024f935640 1 Processor -- start 2024-08-31T05:18:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.766+0000 7f024f935640 1 -- start start 2024-08-31T05:18:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.766+0000 7f024f935640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02480fff80 0x7f0248199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.766+0000 7f024f935640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02481008c0 0x7f02481999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.766+0000 7f024f935640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f024810c790 con 0x7f02480fff80 2024-08-31T05:18:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.766+0000 7f024f935640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f024810c610 con 0x7f02481008c0 2024-08-31T05:18:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.766+0000 7f024d6d1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02480fff80 0x7f0248199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.766+0000 7f024d6d1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02480fff80 0x7f0248199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47180/0 (socket says 172.21.15.67:47180) 2024-08-31T05:18:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.766+0000 7f024d6d1640 1 -- 172.21.15.67:0/2449280964 learned_addr learned my addr 172.21.15.67:0/2449280964 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:17.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.766+0000 7f024d6d1640 1 -- 172.21.15.67:0/2449280964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02481008c0 msgr2=0x7f02481999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.766+0000 7f024d6d1640 1 --2- 172.21.15.67:0/2449280964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02481008c0 0x7f02481999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.766+0000 7f024d6d1640 1 -- 172.21.15.67:0/2449280964 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024819a050 con 0x7f02480fff80 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.766+0000 7f024d6d1640 1 --2- 172.21.15.67:0/2449280964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02480fff80 0x7f0248199490 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f023c006010 tx=0x7f023c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.767+0000 7f023a7fc640 1 -- 172.21.15.67:0/2449280964 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f023c03f070 con 0x7f02480fff80 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.767+0000 7f023a7fc640 1 -- 172.21.15.67:0/2449280964 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f023c0044d0 con 0x7f02480fff80 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.767+0000 7f024f935640 1 -- 172.21.15.67:0/2449280964 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024819ea30 con 0x7f02480fff80 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.767+0000 7f023a7fc640 1 -- 172.21.15.67:0/2449280964 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f023c035030 con 0x7f02480fff80 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.767+0000 7f024f935640 1 -- 172.21.15.67:0/2449280964 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f024819f040 con 0x7f02480fff80 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.768+0000 7f024f935640 1 -- 172.21.15.67:0/2449280964 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0248100380 con 0x7f02480fff80 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.768+0000 7f023a7fc640 1 -- 172.21.15.67:0/2449280964 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f023c042070 con 0x7f02480fff80 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.769+0000 7f023a7fc640 1 --2- 172.21.15.67:0/2449280964 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f023406de30 0x7f02340702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.769+0000 7f024ced0640 1 --2- 172.21.15.67:0/2449280964 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f023406de30 0x7f02340702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.769+0000 7f023a7fc640 1 -- 172.21.15.67:0/2449280964 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f023c0ae5f0 con 0x7f02480fff80 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.769+0000 7f024ced0640 1 --2- 172.21.15.67:0/2449280964 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f023406de30 0x7f02340702f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f024819a940 tx=0x7f0244006c90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:17.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.773+0000 7f023a7fc640 1 -- 172.21.15.67:0/2449280964 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f023c07c4d0 con 0x7f02480fff80 2024-08-31T05:18:17.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:17.972+0000 7f024f935640 1 -- 172.21.15.67:0/2449280964 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) -- 0x7f0248109920 con 0x7f023406de30 2024-08-31T05:18:18.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:18 smithi073 ceph-mon[24726]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:18.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:18 smithi073 ceph-mon[24726]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:18.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:18 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-08-31T05:18:18.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:18 smithi067 ceph-mon[17432]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:18.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:18 smithi067 ceph-mon[17432]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:18.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:18 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-08-31T05:18:19.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:19.446+0000 7f023a7fc640 1 -- 172.21.15.67:0/2449280964 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0248109920 con 0x7f023406de30 2024-08-31T05:18:19.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:19.448+0000 7f024f935640 1 -- 172.21.15.67:0/2449280964 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f023406de30 msgr2=0x7f02340702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:19.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:19.448+0000 7f024f935640 1 --2- 172.21.15.67:0/2449280964 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f023406de30 0x7f02340702f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f024819a940 tx=0x7f0244006c90 comp rx=0 tx=0).stop 2024-08-31T05:18:19.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:19.448+0000 7f024f935640 1 -- 172.21.15.67:0/2449280964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02480fff80 msgr2=0x7f0248199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:19.448+0000 7f024f935640 1 --2- 172.21.15.67:0/2449280964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02480fff80 0x7f0248199490 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f023c006010 tx=0x7f023c0048f0 comp rx=0 tx=0).stop 2024-08-31T05:18:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:19.449+0000 7f024f935640 1 -- 172.21.15.67:0/2449280964 shutdown_connections 2024-08-31T05:18:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:19.449+0000 7f024f935640 1 --2- 172.21.15.67:0/2449280964 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f023406de30 0x7f02340702f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:19.449+0000 7f024f935640 1 --2- 172.21.15.67:0/2449280964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02481008c0 0x7f02481999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:19.449+0000 7f024f935640 1 --2- 172.21.15.67:0/2449280964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02480fff80 0x7f0248199490 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:19.449+0000 7f024f935640 1 -- 172.21.15.67:0/2449280964 >> 172.21.15.67:0/2449280964 conn(0x7f02480fbdb0 msgr2=0x7f02480fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:19.449+0000 7f024f935640 1 -- 172.21.15.67:0/2449280964 shutdown_connections 2024-08-31T05:18:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:19.449+0000 7f024f935640 1 -- 172.21.15.67:0/2449280964 wait complete. 2024-08-31T05:18:19.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:19 smithi073 ceph-mon[24726]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:19.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:19 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-08-31T05:18:19.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:19 smithi073 ceph-mon[24726]: osdmap e41: 6 total, 6 up, 6 in 2024-08-31T05:18:19.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:19 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-08-31T05:18:19.780 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:19 smithi067 ceph-mon[17432]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:19.780 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:19 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-08-31T05:18:19.780 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:19 smithi067 ceph-mon[17432]: osdmap e41: 6 total, 6 up, 6 in 2024-08-31T05:18:19.780 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:19 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-08-31T05:18:19.780 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:19 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067[17428]: 2024-08-31T05:18:19.419+0000 7fc748c10640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T05:18:20.080 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-31T05:18:20.649 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: pgmap v168: 33 pgs: 15 creating+peering, 17 unknown, 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:20.649 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T05:18:20.649 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-08-31T05:18:20.649 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: osdmap e42: 6 total, 6 up, 6 in 2024-08-31T05:18:20.650 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-08-31T05:18:20.650 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T05:18:20.650 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T05:18:20.650 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-08-31T05:18:20.650 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: osdmap e43: 6 total, 6 up, 6 in 2024-08-31T05:18:20.650 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: fsmap cephfs:0 2024-08-31T05:18:20.650 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:20.651 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:18:20.651 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:20.651 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:18:20.651 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:20.651 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.tskvpt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-31T05:18:20.651 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.tskvpt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:18:20.651 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: pgmap v168: 33 pgs: 15 creating+peering, 17 unknown, 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T05:18:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-08-31T05:18:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: osdmap e42: 6 total, 6 up, 6 in 2024-08-31T05:18:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-08-31T05:18:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T05:18:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T05:18:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-08-31T05:18:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: osdmap e43: 6 total, 6 up, 6 in 2024-08-31T05:18:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: fsmap cephfs:0 2024-08-31T05:18:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:20.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:18:20.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:20.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:18:20.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:20.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.tskvpt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-31T05:18:20.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.tskvpt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:18:20.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:21.654 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:21 smithi067 ceph-mon[17432]: Saving service mds.cephfs spec with placement count:4 2024-08-31T05:18:21.655 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:21 smithi067 ceph-mon[17432]: Deploying daemon mds.cephfs.smithi067.tskvpt on smithi067 2024-08-31T05:18:21.655 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:21 smithi067 ceph-mon[17432]: osdmap e44: 6 total, 6 up, 6 in 2024-08-31T05:18:21.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:21 smithi073 ceph-mon[24726]: Saving service mds.cephfs spec with placement count:4 2024-08-31T05:18:21.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:21 smithi073 ceph-mon[24726]: Deploying daemon mds.cephfs.smithi067.tskvpt on smithi067 2024-08-31T05:18:21.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:21 smithi073 ceph-mon[24726]: osdmap e44: 6 total, 6 up, 6 in 2024-08-31T05:18:22.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.089+0000 7f93dad64640 1 -- 172.21.15.67:0/3044614679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93d4100600 msgr2=0x7f93d4100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:22.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.089+0000 7f93dad64640 1 --2- 172.21.15.67:0/3044614679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93d4100600 0x7f93d4100a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009880 tx=0x7f93c802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:22.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.089+0000 7f93dad64640 1 -- 172.21.15.67:0/3044614679 shutdown_connections 2024-08-31T05:18:22.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.089+0000 7f93dad64640 1 --2- 172.21.15.67:0/3044614679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d4101800 0x7f93d4101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.089+0000 7f93dad64640 1 --2- 172.21.15.67:0/3044614679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93d4100600 0x7f93d4100a00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.089+0000 7f93dad64640 1 -- 172.21.15.67:0/3044614679 >> 172.21.15.67:0/3044614679 conn(0x7f93d40fbdb0 msgr2=0x7f93d40fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.089+0000 7f93dad64640 1 -- 172.21.15.67:0/3044614679 shutdown_connections 2024-08-31T05:18:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.089+0000 7f93dad64640 1 -- 172.21.15.67:0/3044614679 wait complete. 2024-08-31T05:18:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.090+0000 7f93dad64640 1 Processor -- start 2024-08-31T05:18:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.090+0000 7f93dad64640 1 -- start start 2024-08-31T05:18:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.090+0000 7f93dad64640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93d4100600 0x7f93d41972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.090+0000 7f93dad64640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d4101800 0x7f93d4197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.090+0000 7f93dad64640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f93d4109440 con 0x7f93d4100600 2024-08-31T05:18:22.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.090+0000 7f93dad64640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f93d41092c0 con 0x7f93d4101800 2024-08-31T05:18:22.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.090+0000 7f93d8b00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93d4100600 0x7f93d41972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:22.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.090+0000 7f93d8b00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93d4100600 0x7f93d41972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33554/0 (socket says 172.21.15.67:33554) 2024-08-31T05:18:22.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.090+0000 7f93d8b00640 1 -- 172.21.15.67:0/4093892846 learned_addr learned my addr 172.21.15.67:0/4093892846 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:22.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.090+0000 7f93d3fff640 1 --2- 172.21.15.67:0/4093892846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d4101800 0x7f93d4197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:22.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.090+0000 7f93d8b00640 1 -- 172.21.15.67:0/4093892846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d4101800 msgr2=0x7f93d4197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:22.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.090+0000 7f93d8b00640 1 --2- 172.21.15.67:0/4093892846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d4101800 0x7f93d4197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:22.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.090+0000 7f93d8b00640 1 -- 172.21.15.67:0/4093892846 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d4197e80 con 0x7f93d4100600 2024-08-31T05:18:22.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.091+0000 7f93d8b00640 1 --2- 172.21.15.67:0/4093892846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93d4100600 0x7f93d41972c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006010 tx=0x7f93c80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:22.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.091+0000 7f93d1ffb640 1 -- 172.21.15.67:0/4093892846 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93c803f070 con 0x7f93d4100600 2024-08-31T05:18:22.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.091+0000 7f93dad64640 1 -- 172.21.15.67:0/4093892846 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d419c860 con 0x7f93d4100600 2024-08-31T05:18:22.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.091+0000 7f93d1ffb640 1 -- 172.21.15.67:0/4093892846 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f93c80049d0 con 0x7f93d4100600 2024-08-31T05:18:22.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.091+0000 7f93d1ffb640 1 -- 172.21.15.67:0/4093892846 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93c8035030 con 0x7f93d4100600 2024-08-31T05:18:22.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.091+0000 7f93dad64640 1 -- 172.21.15.67:0/4093892846 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d419cdf0 con 0x7f93d4100600 2024-08-31T05:18:22.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.092+0000 7f93dad64640 1 -- 172.21.15.67:0/4093892846 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93d4100a00 con 0x7f93d4100600 2024-08-31T05:18:22.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.093+0000 7f93d1ffb640 1 -- 172.21.15.67:0/4093892846 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f93c8042070 con 0x7f93d4100600 2024-08-31T05:18:22.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.093+0000 7f93d1ffb640 1 --2- 172.21.15.67:0/4093892846 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f93c406de30 0x7f93c40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:22.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.093+0000 7f93d1ffb640 1 -- 172.21.15.67:0/4093892846 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f93c80ae690 con 0x7f93d4100600 2024-08-31T05:18:22.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.093+0000 7f93d3fff640 1 --2- 172.21.15.67:0/4093892846 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f93c406de30 0x7f93c40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:22.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.093+0000 7f93d3fff640 1 --2- 172.21.15.67:0/4093892846 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f93c406de30 0x7f93c40702f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f93d4198770 tx=0x7f93c0005f90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:22.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.098+0000 7f93d1ffb640 1 -- 172.21.15.67:0/4093892846 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93c807c230 con 0x7f93d4100600 2024-08-31T05:18:22.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.322+0000 7f93dad64640 1 -- 172.21.15.67:0/4093892846 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f93d419d760 con 0x7f93d4100600 2024-08-31T05:18:22.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.323+0000 7f93d1ffb640 1 -- 172.21.15.67:0/4093892846 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) ==== 75+0+1272 (secure 0 0 0) 0x7f93c807fee0 con 0x7f93d4100600 2024-08-31T05:18:22.325 INFO:teuthology.orchestra.run.smithi067.stdout:e2 2024-08-31T05:18:22.325 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-08-31T05:18:19:420035+0000 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 2 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-08-31T05:18:19.419969+0000 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-08-31T05:18:22.326 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 0 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:in 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:up {} 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data disabled 2024-08-31T05:18:22.327 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-08-31T05:18:22.328 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-08-31T05:18:22.328 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 0 2024-08-31T05:18:22.328 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 0 members: 2024-08-31T05:18:22.328 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:18:22.328 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:18:22.328 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 2 2024-08-31T05:18:22.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.325+0000 7f93dad64640 1 -- 172.21.15.67:0/4093892846 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f93c406de30 msgr2=0x7f93c40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:22.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.325+0000 7f93dad64640 1 --2- 172.21.15.67:0/4093892846 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f93c406de30 0x7f93c40702f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f93d4198770 tx=0x7f93c0005f90 comp rx=0 tx=0).stop 2024-08-31T05:18:22.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.325+0000 7f93dad64640 1 -- 172.21.15.67:0/4093892846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93d4100600 msgr2=0x7f93d41972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:22.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.325+0000 7f93dad64640 1 --2- 172.21.15.67:0/4093892846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93d4100600 0x7f93d41972c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006010 tx=0x7f93c80045e0 comp rx=0 tx=0).stop 2024-08-31T05:18:22.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.325+0000 7f93dad64640 1 -- 172.21.15.67:0/4093892846 shutdown_connections 2024-08-31T05:18:22.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.325+0000 7f93dad64640 1 --2- 172.21.15.67:0/4093892846 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f93c406de30 0x7f93c40702f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:22.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.325+0000 7f93dad64640 1 --2- 172.21.15.67:0/4093892846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d4101800 0x7f93d4197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:22.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.325+0000 7f93dad64640 1 --2- 172.21.15.67:0/4093892846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93d4100600 0x7f93d41972c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:22.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.325+0000 7f93dad64640 1 -- 172.21.15.67:0/4093892846 >> 172.21.15.67:0/4093892846 conn(0x7f93d40fbdb0 msgr2=0x7f93d4069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:22.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.325+0000 7f93dad64640 1 -- 172.21.15.67:0/4093892846 shutdown_connections 2024-08-31T05:18:22.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:22.325+0000 7f93dad64640 1 -- 172.21.15.67:0/4093892846 wait complete. 2024-08-31T05:18:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:22 smithi067 ceph-mon[17432]: pgmap v172: 65 pgs: 10 active+clean, 21 creating+peering, 34 unknown; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:22 smithi067 ceph-mon[17432]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-31T05:18:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:22 smithi067 ceph-mon[17432]: osdmap e45: 6 total, 6 up, 6 in 2024-08-31T05:18:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:22 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/4093892846' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-31T05:18:22.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:22 smithi073 ceph-mon[24726]: pgmap v172: 65 pgs: 10 active+clean, 21 creating+peering, 34 unknown; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:22.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:22 smithi073 ceph-mon[24726]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-31T05:18:22.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:22 smithi073 ceph-mon[24726]: osdmap e45: 6 total, 6 up, 6 in 2024-08-31T05:18:22.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:22 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/4093892846' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-31T05:18:23.530 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T05:18:23.539 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2024-08-31T05:18:23.539 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-08-31T05:18:23.793 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:24.203 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:24.203 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:24.203 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:24.203 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.gsnhxi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-31T05:18:24.203 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.gsnhxi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:18:24.203 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:24.203 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: Deploying daemon mds.cephfs.smithi073.gsnhxi on smithi073 2024-08-31T05:18:24.203 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: pgmap v174: 65 pgs: 25 active+clean, 21 creating+peering, 19 unknown; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:24.203 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: mds.? [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] up:boot 2024-08-31T05:18:24.203 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: daemon mds.cephfs.smithi067.tskvpt assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-08-31T05:18:24.203 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T05:18:24.203 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T05:18:24.204 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: Cluster is now healthy 2024-08-31T05:18:24.204 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: fsmap cephfs:0 1 up:standby 2024-08-31T05:18:24.204 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.tskvpt"}]: dispatch 2024-08-31T05:18:24.204 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:creating} 2024-08-31T05:18:24.204 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:23 smithi067 ceph-mon[17432]: daemon mds.cephfs.smithi067.tskvpt is now active in filesystem cephfs as rank 0 2024-08-31T05:18:24.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.211+0000 7fc20a521640 1 -- 172.21.15.67:0/3041904913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204100600 msgr2=0x7fc204100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:24.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.211+0000 7fc20a521640 1 --2- 172.21.15.67:0/3041904913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204100600 0x7fc204100a00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4009880 tx=0x7fc1f402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:24.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.211+0000 7fc20a521640 1 -- 172.21.15.67:0/3041904913 shutdown_connections 2024-08-31T05:18:24.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.211+0000 7fc20a521640 1 --2- 172.21.15.67:0/3041904913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc204101800 0x7fc204101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:24.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.211+0000 7fc20a521640 1 --2- 172.21.15.67:0/3041904913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204100600 0x7fc204100a00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:24.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.211+0000 7fc20a521640 1 -- 172.21.15.67:0/3041904913 >> 172.21.15.67:0/3041904913 conn(0x7fc2040fbdb0 msgr2=0x7fc2040fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:24.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.211+0000 7fc20a521640 1 -- 172.21.15.67:0/3041904913 shutdown_connections 2024-08-31T05:18:24.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.211+0000 7fc20a521640 1 -- 172.21.15.67:0/3041904913 wait complete. 2024-08-31T05:18:24.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.212+0000 7fc20a521640 1 Processor -- start 2024-08-31T05:18:24.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.212+0000 7fc20a521640 1 -- start start 2024-08-31T05:18:24.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.212+0000 7fc20a521640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204100600 0x7fc2041972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:24.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.212+0000 7fc20a521640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc204101800 0x7fc204197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:24.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.212+0000 7fc20a521640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc204109440 con 0x7fc204100600 2024-08-31T05:18:24.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.212+0000 7fc20a521640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc2041092c0 con 0x7fc204101800 2024-08-31T05:18:24.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.212+0000 7fc203fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204100600 0x7fc2041972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:24.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.212+0000 7fc203fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204100600 0x7fc2041972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33578/0 (socket says 172.21.15.67:33578) 2024-08-31T05:18:24.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.212+0000 7fc203fff640 1 -- 172.21.15.67:0/1159511650 learned_addr learned my addr 172.21.15.67:0/1159511650 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:24.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.213+0000 7fc2037fe640 1 --2- 172.21.15.67:0/1159511650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc204101800 0x7fc204197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:24.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.213+0000 7fc203fff640 1 -- 172.21.15.67:0/1159511650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc204101800 msgr2=0x7fc204197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:24.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.213+0000 7fc203fff640 1 --2- 172.21.15.67:0/1159511650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc204101800 0x7fc204197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:24.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.213+0000 7fc203fff640 1 -- 172.21.15.67:0/1159511650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc204197e80 con 0x7fc204100600 2024-08-31T05:18:24.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.213+0000 7fc203fff640 1 --2- 172.21.15.67:0/1159511650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204100600 0x7fc2041972c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4006010 tx=0x7fc1f40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:24.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.213+0000 7fc2017fa640 1 -- 172.21.15.67:0/1159511650 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1f403f070 con 0x7fc204100600 2024-08-31T05:18:24.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.213+0000 7fc2017fa640 1 -- 172.21.15.67:0/1159511650 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1f4004a50 con 0x7fc204100600 2024-08-31T05:18:24.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.213+0000 7fc20a521640 1 -- 172.21.15.67:0/1159511650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20419c860 con 0x7fc204100600 2024-08-31T05:18:24.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.213+0000 7fc2017fa640 1 -- 172.21.15.67:0/1159511650 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1f4035030 con 0x7fc204100600 2024-08-31T05:18:24.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.213+0000 7fc20a521640 1 -- 172.21.15.67:0/1159511650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc20419cdf0 con 0x7fc204100600 2024-08-31T05:18:24.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.214+0000 7fc20a521640 1 -- 172.21.15.67:0/1159511650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc204100a00 con 0x7fc204100600 2024-08-31T05:18:24.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.215+0000 7fc2017fa640 1 -- 172.21.15.67:0/1159511650 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fc1f4042070 con 0x7fc204100600 2024-08-31T05:18:24.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.215+0000 7fc2017fa640 1 --2- 172.21.15.67:0/1159511650 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fc1ec06de90 0x7fc1ec070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:24.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.215+0000 7fc2017fa640 1 -- 172.21.15.67:0/1159511650 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fc1f40ae680 con 0x7fc204100600 2024-08-31T05:18:24.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.215+0000 7fc2037fe640 1 --2- 172.21.15.67:0/1159511650 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fc1ec06de90 0x7fc1ec070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:24.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.216+0000 7fc2037fe640 1 --2- 172.21.15.67:0/1159511650 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fc1ec06de90 0x7fc1ec070350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8005fd0 tx=0x7fc1f8005850 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:24.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.219+0000 7fc2017fa640 1 -- 172.21.15.67:0/1159511650 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1f4004c00 con 0x7fc204100600 2024-08-31T05:18:24.422 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:24.422 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:24.422 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:24.422 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.gsnhxi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-31T05:18:24.422 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.gsnhxi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:18:24.422 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:24.422 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: Deploying daemon mds.cephfs.smithi073.gsnhxi on smithi073 2024-08-31T05:18:24.423 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: pgmap v174: 65 pgs: 25 active+clean, 21 creating+peering, 19 unknown; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:18:24.423 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: mds.? [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] up:boot 2024-08-31T05:18:24.423 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: daemon mds.cephfs.smithi067.tskvpt assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-08-31T05:18:24.423 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T05:18:24.423 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T05:18:24.423 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: Cluster is now healthy 2024-08-31T05:18:24.423 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: fsmap cephfs:0 1 up:standby 2024-08-31T05:18:24.423 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.tskvpt"}]: dispatch 2024-08-31T05:18:24.423 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:creating} 2024-08-31T05:18:24.423 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:23 smithi073 ceph-mon[24726]: daemon mds.cephfs.smithi067.tskvpt is now active in filesystem cephfs as rank 0 2024-08-31T05:18:24.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:24.432+0000 7fc20a521640 1 -- 172.21.15.67:0/1159511650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7fc20419d050 con 0x7fc204100600 2024-08-31T05:18:25.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:25.425+0000 7fc2017fa640 1 -- 172.21.15.67:0/1159511650 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) ==== 105+0+0 (secure 0 0 0) 0x7fc1f407c2a0 con 0x7fc204100600 2024-08-31T05:18:25.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:25.428+0000 7fc20a521640 1 -- 172.21.15.67:0/1159511650 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fc1ec06de90 msgr2=0x7fc1ec070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:25.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:25.428+0000 7fc20a521640 1 --2- 172.21.15.67:0/1159511650 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fc1ec06de90 0x7fc1ec070350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8005fd0 tx=0x7fc1f8005850 comp rx=0 tx=0).stop 2024-08-31T05:18:25.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:25.428+0000 7fc20a521640 1 -- 172.21.15.67:0/1159511650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204100600 msgr2=0x7fc2041972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:25.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:25.428+0000 7fc20a521640 1 --2- 172.21.15.67:0/1159511650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204100600 0x7fc2041972c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4006010 tx=0x7fc1f40045e0 comp rx=0 tx=0).stop 2024-08-31T05:18:25.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:25.428+0000 7fc20a521640 1 -- 172.21.15.67:0/1159511650 shutdown_connections 2024-08-31T05:18:25.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:25.428+0000 7fc20a521640 1 --2- 172.21.15.67:0/1159511650 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fc1ec06de90 0x7fc1ec070350 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:25.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:25.428+0000 7fc20a521640 1 --2- 172.21.15.67:0/1159511650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc204101800 0x7fc204197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:25.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:25.428+0000 7fc20a521640 1 --2- 172.21.15.67:0/1159511650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc204100600 0x7fc2041972c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:25.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:25.428+0000 7fc20a521640 1 -- 172.21.15.67:0/1159511650 >> 172.21.15.67:0/1159511650 conn(0x7fc2040fbdb0 msgr2=0x7fc204069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:25.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:25.429+0000 7fc20a521640 1 -- 172.21.15.67:0/1159511650 shutdown_connections 2024-08-31T05:18:25.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:25.429+0000 7fc20a521640 1 -- 172.21.15.67:0/1159511650 wait complete. 2024-08-31T05:18:25.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:25 smithi073 ceph-mon[24726]: mds.? [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] up:active 2024-08-31T05:18:25.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:25 smithi073 ceph-mon[24726]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 2024-08-31T05:18:25.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:25 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1159511650' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-08-31T05:18:25.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:25 smithi073 ceph-mon[24726]: pgmap v175: 65 pgs: 59 active+clean, 6 creating+peering; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 1 op/s 2024-08-31T05:18:25.740 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:25 smithi067 ceph-mon[17432]: mds.? [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] up:active 2024-08-31T05:18:25.740 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:25 smithi067 ceph-mon[17432]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 2024-08-31T05:18:25.740 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:25 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1159511650' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-08-31T05:18:25.740 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:25 smithi067 ceph-mon[17432]: pgmap v175: 65 pgs: 59 active+clean, 6 creating+peering; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 1 op/s 2024-08-31T05:18:26.004 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T05:18:26.014 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2024-08-31T05:18:26.014 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-08-31T05:18:26.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:26 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1159511650' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-08-31T05:18:26.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:26 smithi067 ceph-mon[17432]: mds.? [v2:172.21.15.73:6824/2512059873,v1:172.21.15.73:6825/2512059873] up:boot 2024-08-31T05:18:26.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:26 smithi067 ceph-mon[17432]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby 2024-08-31T05:18:26.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:26 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.gsnhxi"}]: dispatch 2024-08-31T05:18:26.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:26 smithi067 ceph-mon[17432]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby 2024-08-31T05:18:26.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:26 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:26.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:26 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:26.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:26 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:26.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:26 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.beqeql", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-31T05:18:26.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:26 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.beqeql", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:18:26.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:26 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:26.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:26 smithi067 ceph-mon[17432]: Deploying daemon mds.cephfs.smithi067.beqeql on smithi067 2024-08-31T05:18:26.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:26 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:18:26.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:26 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1159511650' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-08-31T05:18:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:26 smithi073 ceph-mon[24726]: mds.? [v2:172.21.15.73:6824/2512059873,v1:172.21.15.73:6825/2512059873] up:boot 2024-08-31T05:18:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:26 smithi073 ceph-mon[24726]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby 2024-08-31T05:18:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:26 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.gsnhxi"}]: dispatch 2024-08-31T05:18:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:26 smithi073 ceph-mon[24726]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby 2024-08-31T05:18:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:26 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:26 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:26 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:26 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.beqeql", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-31T05:18:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:26 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.beqeql", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:18:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:26 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:26.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:26 smithi073 ceph-mon[24726]: Deploying daemon mds.cephfs.smithi067.beqeql on smithi067 2024-08-31T05:18:26.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:26 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:18:27.129 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:27.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.621+0000 7fb1bacef640 1 -- 172.21.15.67:0/260400921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1b4101710 msgr2=0x7fb1b4101b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:27.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.621+0000 7fb1bacef640 1 --2- 172.21.15.67:0/260400921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1b4101710 0x7fb1b4101b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009880 tx=0x7fb1a802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:27.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.621+0000 7fb1bacef640 1 -- 172.21.15.67:0/260400921 shutdown_connections 2024-08-31T05:18:27.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.621+0000 7fb1bacef640 1 --2- 172.21.15.67:0/260400921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b4102910 0x7fb1b4102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:27.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.621+0000 7fb1bacef640 1 --2- 172.21.15.67:0/260400921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1b4101710 0x7fb1b4101b10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:27.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.621+0000 7fb1bacef640 1 -- 172.21.15.67:0/260400921 >> 172.21.15.67:0/260400921 conn(0x7fb1b40fcee0 msgr2=0x7fb1b40ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:27.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.621+0000 7fb1bacef640 1 -- 172.21.15.67:0/260400921 shutdown_connections 2024-08-31T05:18:27.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.621+0000 7fb1bacef640 1 -- 172.21.15.67:0/260400921 wait complete. 2024-08-31T05:18:27.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.622+0000 7fb1bacef640 1 Processor -- start 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.622+0000 7fb1bacef640 1 -- start start 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.622+0000 7fb1bacef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b4101710 0x7fb1b41994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.622+0000 7fb1bacef640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1b4102910 0x7fb1b41999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.622+0000 7fb1bacef640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b410a530 con 0x7fb1b4102910 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.622+0000 7fb1bacef640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b410a3b0 con 0x7fb1b4101710 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.623+0000 7fb1b3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1b4102910 0x7fb1b41999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.623+0000 7fb1b3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1b4102910 0x7fb1b41999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33590/0 (socket says 172.21.15.67:33590) 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.623+0000 7fb1b8a8b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b4101710 0x7fb1b41994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.623+0000 7fb1b3fff640 1 -- 172.21.15.67:0/2220630783 learned_addr learned my addr 172.21.15.67:0/2220630783 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.623+0000 7fb1b8a8b640 1 -- 172.21.15.67:0/2220630783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1b4102910 msgr2=0x7fb1b41999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.623+0000 7fb1b8a8b640 1 --2- 172.21.15.67:0/2220630783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1b4102910 0x7fb1b41999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.623+0000 7fb1b8a8b640 1 -- 172.21.15.67:0/2220630783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b419a060 con 0x7fb1b4101710 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.623+0000 7fb1b8a8b640 1 --2- 172.21.15.67:0/2220630783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b4101710 0x7fb1b41994a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8006010 tx=0x7fb1a80045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.623+0000 7fb1b1ffb640 1 -- 172.21.15.67:0/2220630783 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1a803f070 con 0x7fb1b4101710 2024-08-31T05:18:27.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.623+0000 7fb1bacef640 1 -- 172.21.15.67:0/2220630783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b419ea40 con 0x7fb1b4101710 2024-08-31T05:18:27.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.623+0000 7fb1b1ffb640 1 -- 172.21.15.67:0/2220630783 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb1a80049d0 con 0x7fb1b4101710 2024-08-31T05:18:27.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.623+0000 7fb1b1ffb640 1 -- 172.21.15.67:0/2220630783 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1a8035030 con 0x7fb1b4101710 2024-08-31T05:18:27.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.624+0000 7fb1bacef640 1 -- 172.21.15.67:0/2220630783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b419efd0 con 0x7fb1b4101710 2024-08-31T05:18:27.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.625+0000 7fb1bacef640 1 -- 172.21.15.67:0/2220630783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1b4101b10 con 0x7fb1b4101710 2024-08-31T05:18:27.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.625+0000 7fb1b1ffb640 1 -- 172.21.15.67:0/2220630783 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fb1a8042070 con 0x7fb1b4101710 2024-08-31T05:18:27.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.625+0000 7fb1b1ffb640 1 --2- 172.21.15.67:0/2220630783 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb1a406de30 0x7fb1a40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:27.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.626+0000 7fb1b1ffb640 1 -- 172.21.15.67:0/2220630783 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fb1a80ae5c0 con 0x7fb1b4101710 2024-08-31T05:18:27.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.626+0000 7fb1b3fff640 1 --2- 172.21.15.67:0/2220630783 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb1a406de30 0x7fb1a40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:27.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.626+0000 7fb1b3fff640 1 --2- 172.21.15.67:0/2220630783 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb1a406de30 0x7fb1a40702f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb1b419a950 tx=0x7fb1a0005f90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:27.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.630+0000 7fb1b1ffb640 1 -- 172.21.15.67:0/2220630783 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb1a80845a0 con 0x7fb1b4101710 2024-08-31T05:18:27.728 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:27 smithi073 ceph-mon[24726]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-08-31T05:18:27.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:27 smithi067 ceph-mon[17432]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-08-31T05:18:27.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:27.867+0000 7fb1bacef640 1 -- 172.21.15.67:0/2220630783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fb1b419f930 con 0x7fb1b4101710 2024-08-31T05:18:28.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:28.455+0000 7fb1b1ffb640 1 -- 172.21.15.67:0/2220630783 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v8) ==== 121+0+0 (secure 0 0 0) 0x7fb1a8079cd0 con 0x7fb1b4101710 2024-08-31T05:18:28.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:28.458+0000 7fb1bacef640 1 -- 172.21.15.67:0/2220630783 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb1a406de30 msgr2=0x7fb1a40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:28.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:28.458+0000 7fb1bacef640 1 --2- 172.21.15.67:0/2220630783 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb1a406de30 0x7fb1a40702f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb1b419a950 tx=0x7fb1a0005f90 comp rx=0 tx=0).stop 2024-08-31T05:18:28.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:28.458+0000 7fb1bacef640 1 -- 172.21.15.67:0/2220630783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b4101710 msgr2=0x7fb1b41994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:28.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:28.458+0000 7fb1bacef640 1 --2- 172.21.15.67:0/2220630783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b4101710 0x7fb1b41994a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8006010 tx=0x7fb1a80045e0 comp rx=0 tx=0).stop 2024-08-31T05:18:28.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:28.458+0000 7fb1bacef640 1 -- 172.21.15.67:0/2220630783 shutdown_connections 2024-08-31T05:18:28.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:28.458+0000 7fb1bacef640 1 --2- 172.21.15.67:0/2220630783 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb1a406de30 0x7fb1a40702f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:28.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:28.458+0000 7fb1bacef640 1 --2- 172.21.15.67:0/2220630783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1b4102910 0x7fb1b41999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:28.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:28.458+0000 7fb1bacef640 1 --2- 172.21.15.67:0/2220630783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b4101710 0x7fb1b41994a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:28.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:28.458+0000 7fb1bacef640 1 -- 172.21.15.67:0/2220630783 >> 172.21.15.67:0/2220630783 conn(0x7fb1b40fcee0 msgr2=0x7fb1b4074450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:28.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:28.458+0000 7fb1bacef640 1 -- 172.21.15.67:0/2220630783 shutdown_connections 2024-08-31T05:18:28.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:28.458+0000 7fb1bacef640 1 -- 172.21.15.67:0/2220630783 wait complete. 2024-08-31T05:18:28.695 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:28 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2220630783' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-31T05:18:28.695 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:28 smithi067 ceph-mon[17432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-31T05:18:28.695 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:28 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:28.695 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:28 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:28.695 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:28 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:28.695 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:28 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.kfbmeo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-31T05:18:28.695 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:28 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.kfbmeo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:18:28.695 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:28 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:28.695 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:28 smithi067 ceph-mon[17432]: Deploying daemon mds.cephfs.smithi073.kfbmeo on smithi073 2024-08-31T05:18:28.742 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:28 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2220630783' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-31T05:18:28.742 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:28 smithi073 ceph-mon[24726]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-31T05:18:28.742 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:28 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:28.742 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:28 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:28.742 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:28 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:28.742 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:28 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.kfbmeo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-31T05:18:28.742 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:28 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.kfbmeo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:18:28.742 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:28 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:28.742 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:28 smithi073 ceph-mon[24726]: Deploying daemon mds.cephfs.smithi073.kfbmeo on smithi073 2024-08-31T05:18:29.021 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T05:18:29.031 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2024-08-31T05:18:29.031 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-08-31T05:18:29.287 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:29.723 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:29 smithi067 ceph-mon[17432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T05:18:29.724 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:29 smithi067 ceph-mon[17432]: mds.? [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] up:boot 2024-08-31T05:18:29.724 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:29 smithi067 ceph-mon[17432]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 2 up:standby 2024-08-31T05:18:29.724 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:29 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.beqeql"}]: dispatch 2024-08-31T05:18:29.724 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:29 smithi067 ceph-mon[17432]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 1 up:standby 2024-08-31T05:18:29.724 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:29 smithi067 ceph-mon[17432]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 229 B/s rd, 1.6 KiB/s wr, 5 op/s 2024-08-31T05:18:29.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.733+0000 7f2d97e2c640 1 -- 172.21.15.67:0/1792664288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d90100600 msgr2=0x7f2d90100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:29.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.733+0000 7f2d97e2c640 1 --2- 172.21.15.67:0/1792664288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d90100600 0x7f2d90100a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009880 tx=0x7f2d8c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:29.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.733+0000 7f2d97e2c640 1 -- 172.21.15.67:0/1792664288 shutdown_connections 2024-08-31T05:18:29.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.733+0000 7f2d97e2c640 1 --2- 172.21.15.67:0/1792664288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d90101800 0x7f2d90101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:29.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.733+0000 7f2d97e2c640 1 --2- 172.21.15.67:0/1792664288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d90100600 0x7f2d90100a00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:29.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.733+0000 7f2d97e2c640 1 -- 172.21.15.67:0/1792664288 >> 172.21.15.67:0/1792664288 conn(0x7f2d900fbdb0 msgr2=0x7f2d900fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:29.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.733+0000 7f2d97e2c640 1 -- 172.21.15.67:0/1792664288 shutdown_connections 2024-08-31T05:18:29.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.733+0000 7f2d97e2c640 1 -- 172.21.15.67:0/1792664288 wait complete. 2024-08-31T05:18:29.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.734+0000 7f2d97e2c640 1 Processor -- start 2024-08-31T05:18:29.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.734+0000 7f2d97e2c640 1 -- start start 2024-08-31T05:18:29.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.734+0000 7f2d97e2c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d90100600 0x7f2d90196190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.734+0000 7f2d97e2c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d90101800 0x7f2d901966d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.734+0000 7f2d97e2c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2d90109440 con 0x7f2d90101800 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.734+0000 7f2d97e2c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2d901092c0 con 0x7f2d90100600 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.734+0000 7f2d953c7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d90101800 0x7f2d901966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.734+0000 7f2d953c7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d90101800 0x7f2d901966d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37018/0 (socket says 172.21.15.67:37018) 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.734+0000 7f2d953c7640 1 -- 172.21.15.67:0/3505837026 learned_addr learned my addr 172.21.15.67:0/3505837026 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.734+0000 7f2d95bc8640 1 --2- 172.21.15.67:0/3505837026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d90100600 0x7f2d90196190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.734+0000 7f2d953c7640 1 -- 172.21.15.67:0/3505837026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d90100600 msgr2=0x7f2d90196190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.734+0000 7f2d953c7640 1 --2- 172.21.15.67:0/3505837026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d90100600 0x7f2d90196190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.734+0000 7f2d953c7640 1 -- 172.21.15.67:0/3505837026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d90196d50 con 0x7f2d90101800 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.735+0000 7f2d953c7640 1 --2- 172.21.15.67:0/3505837026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d90101800 0x7f2d901966d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000d6f0 tx=0x7f2d8000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.735+0000 7f2d86ffd640 1 -- 172.21.15.67:0/3505837026 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d80017070 con 0x7f2d90101800 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.735+0000 7f2d86ffd640 1 -- 172.21.15.67:0/3505837026 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2d8000de00 con 0x7f2d90101800 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.735+0000 7f2d97e2c640 1 -- 172.21.15.67:0/3505837026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d9019b790 con 0x7f2d90101800 2024-08-31T05:18:29.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.735+0000 7f2d86ffd640 1 -- 172.21.15.67:0/3505837026 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d80004bb0 con 0x7f2d90101800 2024-08-31T05:18:29.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.735+0000 7f2d97e2c640 1 -- 172.21.15.67:0/3505837026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d9019bd20 con 0x7f2d90101800 2024-08-31T05:18:29.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.736+0000 7f2d97e2c640 1 -- 172.21.15.67:0/3505837026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d90100a00 con 0x7f2d90101800 2024-08-31T05:18:29.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.737+0000 7f2d86ffd640 1 -- 172.21.15.67:0/3505837026 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f2d80004e60 con 0x7f2d90101800 2024-08-31T05:18:29.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.737+0000 7f2d86ffd640 1 --2- 172.21.15.67:0/3505837026 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f2d7c06de30 0x7f2d7c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:29.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.737+0000 7f2d86ffd640 1 -- 172.21.15.67:0/3505837026 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f2d8008d6d0 con 0x7f2d90101800 2024-08-31T05:18:29.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.737+0000 7f2d95bc8640 1 --2- 172.21.15.67:0/3505837026 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f2d7c06de30 0x7f2d7c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:29.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.738+0000 7f2d95bc8640 1 --2- 172.21.15.67:0/3505837026 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f2d7c06de30 0x7f2d7c0702f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009230 tx=0x7f2d8c0058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:29.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.742+0000 7f2d86ffd640 1 -- 172.21.15.67:0/3505837026 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d8005ef20 con 0x7f2d90101800 2024-08-31T05:18:29.821 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:29 smithi073 ceph-mon[24726]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T05:18:29.821 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:29 smithi073 ceph-mon[24726]: mds.? [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] up:boot 2024-08-31T05:18:29.821 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:29 smithi073 ceph-mon[24726]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 2 up:standby 2024-08-31T05:18:29.821 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:29 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.beqeql"}]: dispatch 2024-08-31T05:18:29.822 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:29 smithi073 ceph-mon[24726]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 1 up:standby 2024-08-31T05:18:29.822 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:29 smithi073 ceph-mon[24726]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 229 B/s rd, 1.6 KiB/s wr, 5 op/s 2024-08-31T05:18:29.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:29.954+0000 7f2d97e2c640 1 -- 172.21.15.67:0/3505837026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2d90062b90 con 0x7f2d90101800 2024-08-31T05:18:30.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:30.465+0000 7f2d86ffd640 1 -- 172.21.15.67:0/3505837026 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v10) ==== 168+0+0 (secure 0 0 0) 0x7f2d80063750 con 0x7f2d90101800 2024-08-31T05:18:30.468 INFO:teuthology.orchestra.run.smithi067.stderr:inline data enabled 2024-08-31T05:18:30.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:30.467+0000 7f2d97e2c640 1 -- 172.21.15.67:0/3505837026 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f2d7c06de30 msgr2=0x7f2d7c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:30.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:30.467+0000 7f2d97e2c640 1 --2- 172.21.15.67:0/3505837026 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f2d7c06de30 0x7f2d7c0702f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009230 tx=0x7f2d8c0058d0 comp rx=0 tx=0).stop 2024-08-31T05:18:30.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:30.467+0000 7f2d97e2c640 1 -- 172.21.15.67:0/3505837026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d90101800 msgr2=0x7f2d901966d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:30.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:30.467+0000 7f2d97e2c640 1 --2- 172.21.15.67:0/3505837026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d90101800 0x7f2d901966d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000d6f0 tx=0x7f2d8000dbb0 comp rx=0 tx=0).stop 2024-08-31T05:18:30.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:30.467+0000 7f2d97e2c640 1 -- 172.21.15.67:0/3505837026 shutdown_connections 2024-08-31T05:18:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:30.467+0000 7f2d97e2c640 1 --2- 172.21.15.67:0/3505837026 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f2d7c06de30 0x7f2d7c0702f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:30.467+0000 7f2d97e2c640 1 --2- 172.21.15.67:0/3505837026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d90101800 0x7f2d901966d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:30.467+0000 7f2d97e2c640 1 --2- 172.21.15.67:0/3505837026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d90100600 0x7f2d90196190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:30.467+0000 7f2d97e2c640 1 -- 172.21.15.67:0/3505837026 >> 172.21.15.67:0/3505837026 conn(0x7f2d900fbdb0 msgr2=0x7f2d90104d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:30.467+0000 7f2d97e2c640 1 -- 172.21.15.67:0/3505837026 shutdown_connections 2024-08-31T05:18:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:30.467+0000 7f2d97e2c640 1 -- 172.21.15.67:0/3505837026 wait complete. 2024-08-31T05:18:30.623 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:30 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3505837026' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-31T05:18:30.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:30 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3505837026' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-31T05:18:31.133 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T05:18:31.145 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2024-08-31T05:18:31.145 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-31T05:18:31.414 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:31.630 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:31 smithi073 ceph-mon[24726]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-08-31T05:18:31.630 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:31 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3505837026' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T05:18:31.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:31 smithi073 ceph-mon[24726]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 1 up:standby 2024-08-31T05:18:31.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:31 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:31.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:31 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:31.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:31 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:31.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:31 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:31.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:31 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:31.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:31 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:18:31.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:31 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:31.631 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:31 smithi073 ceph-mon[24726]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 819 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-08-31T05:18:31.782 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:31 smithi067 ceph-mon[17432]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-08-31T05:18:31.782 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:31 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3505837026' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T05:18:31.783 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:31 smithi067 ceph-mon[17432]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 1 up:standby 2024-08-31T05:18:31.783 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:31 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:31.783 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:31 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:31.783 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:31 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:31.783 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:31 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:31.783 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:31 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:31.783 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:31 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:18:31.783 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:31 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:31.783 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:31 smithi067 ceph-mon[17432]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 819 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-08-31T05:18:31.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.861+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/676124612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac1021f0 msgr2=0x7fb6ac1045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:31.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.861+0000 7fb6b0ca8640 1 --2- 172.21.15.67:0/676124612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac1021f0 0x7fb6ac1045e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009880 tx=0x7fb6a402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:31.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.861+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/676124612 shutdown_connections 2024-08-31T05:18:31.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.861+0000 7fb6b0ca8640 1 --2- 172.21.15.67:0/676124612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac104b20 0x7fb6ac106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:31.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.861+0000 7fb6b0ca8640 1 --2- 172.21.15.67:0/676124612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac1021f0 0x7fb6ac1045e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:31.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.861+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/676124612 >> 172.21.15.67:0/676124612 conn(0x7fb6ac0fbdb0 msgr2=0x7fb6ac0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:31.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.861+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/676124612 shutdown_connections 2024-08-31T05:18:31.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.861+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/676124612 wait complete. 2024-08-31T05:18:31.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.862+0000 7fb6b0ca8640 1 Processor -- start 2024-08-31T05:18:31.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.862+0000 7fb6b0ca8640 1 -- start start 2024-08-31T05:18:31.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.862+0000 7fb6b0ca8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac1021f0 0x7fb6ac199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:31.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.862+0000 7fb6b0ca8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac104b20 0x7fb6ac1999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:31.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.862+0000 7fb6b0ca8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ac10a510 con 0x7fb6ac1021f0 2024-08-31T05:18:31.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.862+0000 7fb6b0ca8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ac10a390 con 0x7fb6ac104b20 2024-08-31T05:18:31.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.862+0000 7fb6aa59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac1021f0 0x7fb6ac199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:31.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.862+0000 7fb6aa59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac1021f0 0x7fb6ac199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37042/0 (socket says 172.21.15.67:37042) 2024-08-31T05:18:31.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.862+0000 7fb6aa59c640 1 -- 172.21.15.67:0/1108585216 learned_addr learned my addr 172.21.15.67:0/1108585216 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:31.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.862+0000 7fb6a9d9b640 1 --2- 172.21.15.67:0/1108585216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac104b20 0x7fb6ac1999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:31.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.862+0000 7fb6aa59c640 1 -- 172.21.15.67:0/1108585216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac104b20 msgr2=0x7fb6ac1999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:31.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.862+0000 7fb6aa59c640 1 --2- 172.21.15.67:0/1108585216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac104b20 0x7fb6ac1999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:31.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.862+0000 7fb6aa59c640 1 -- 172.21.15.67:0/1108585216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6ac19a020 con 0x7fb6ac1021f0 2024-08-31T05:18:31.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.863+0000 7fb6aa59c640 1 --2- 172.21.15.67:0/1108585216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac1021f0 0x7fb6ac199460 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4006010 tx=0x7fb6a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:31.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.863+0000 7fb6a37fe640 1 -- 172.21.15.67:0/1108585216 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb6a403f070 con 0x7fb6ac1021f0 2024-08-31T05:18:31.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.863+0000 7fb6a37fe640 1 -- 172.21.15.67:0/1108585216 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb6a4004ac0 con 0x7fb6ac1021f0 2024-08-31T05:18:31.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.863+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/1108585216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6ac19ea60 con 0x7fb6ac1021f0 2024-08-31T05:18:31.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.863+0000 7fb6a37fe640 1 -- 172.21.15.67:0/1108585216 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb6a4035030 con 0x7fb6ac1021f0 2024-08-31T05:18:31.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.863+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/1108585216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6ac19eff0 con 0x7fb6ac1021f0 2024-08-31T05:18:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.864+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/1108585216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6ac1025d0 con 0x7fb6ac1021f0 2024-08-31T05:18:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.864+0000 7fb6a37fe640 1 -- 172.21.15.67:0/1108585216 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fb6a4042070 con 0x7fb6ac1021f0 2024-08-31T05:18:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.865+0000 7fb6a37fe640 1 --2- 172.21.15.67:0/1108585216 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb69806de90 0x7fb698070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.865+0000 7fb6a37fe640 1 -- 172.21.15.67:0/1108585216 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fb6a40ae610 con 0x7fb6ac1021f0 2024-08-31T05:18:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.865+0000 7fb6a9d9b640 1 --2- 172.21.15.67:0/1108585216 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb69806de90 0x7fb698070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.866+0000 7fb6a9d9b640 1 --2- 172.21.15.67:0/1108585216 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb69806de90 0x7fb698070350 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac19a910 tx=0x7fb69400b390 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:31.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:31.870+0000 7fb6a37fe640 1 -- 172.21.15.67:0/1108585216 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb6a407fee0 con 0x7fb6ac1021f0 2024-08-31T05:18:32.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:32.084+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/1108585216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb6ac062b90 con 0x7fb6ac1021f0 2024-08-31T05:18:32.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:32.085+0000 7fb6a37fe640 1 -- 172.21.15.67:0/1108585216 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) ==== 76+0+2003 (secure 0 0 0) 0x7fb6a4084710 con 0x7fb6ac1021f0 2024-08-31T05:18:32.088 INFO:teuthology.orchestra.run.smithi067.stdout:e11 2024-08-31T05:18:32.088 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-08-31T05:18:31:467304+0000 2024-08-31T05:18:32.088 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:18:32.088 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:18:32.088 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-08-31T05:18:32.088 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:18:32.088 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:18:32.088 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-08-31T05:18:32.089 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 11 2024-08-31T05:18:32.089 INFO:teuthology.orchestra.run.smithi067.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T05:18:32.089 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:18:32.089 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-08-31T05:18:31.431417+0000 2024-08-31T05:18:32.089 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-08-31T05:18:32.089 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-08-31T05:18:32.089 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2024-08-31T05:18:32.089 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-08-31T05:18:32.089 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-08-31T05:18:32.089 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-08-31T05:18:32.089 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-08-31T05:18:32.089 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-08-31T05:18:32.089 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 0 2024-08-31T05:18:32.089 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:18:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2024-08-31T05:18:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:in 0 2024-08-31T05:18:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14554} 2024-08-31T05:18:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-08-31T05:18:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-08-31T05:18:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-08-31T05:18:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-08-31T05:18:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-08-31T05:18:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data enabled 2024-08-31T05:18:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-08-31T05:18:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-08-31T05:18:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2024-08-31T05:18:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 14554 members: 14554 2024-08-31T05:18:32.090 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.tskvpt{0:14554} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:18:32.091 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.gsnhxi{0:24283} state up:standby-replay seq 1 addr [v2:172.21.15.73:6824/2512059873,v1:172.21.15.73:6825/2512059873] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:18:32.091 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:18:32.091 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:18:32.091 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2024-08-31T05:18:32.091 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:18:32.091 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.beqeql{-1:14566} state up:standby seq 1 addr [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:18:32.091 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.kfbmeo{-1:24299} state up:standby seq 1 addr [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:18:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 11 2024-08-31T05:18:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:32.087+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/1108585216 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb69806de90 msgr2=0x7fb698070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:32.087+0000 7fb6b0ca8640 1 --2- 172.21.15.67:0/1108585216 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb69806de90 0x7fb698070350 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac19a910 tx=0x7fb69400b390 comp rx=0 tx=0).stop 2024-08-31T05:18:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:32.087+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/1108585216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac1021f0 msgr2=0x7fb6ac199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:32.087+0000 7fb6b0ca8640 1 --2- 172.21.15.67:0/1108585216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac1021f0 0x7fb6ac199460 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4006010 tx=0x7fb6a40046c0 comp rx=0 tx=0).stop 2024-08-31T05:18:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:32.087+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/1108585216 shutdown_connections 2024-08-31T05:18:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:32.087+0000 7fb6b0ca8640 1 --2- 172.21.15.67:0/1108585216 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb69806de90 0x7fb698070350 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:32.087+0000 7fb6b0ca8640 1 --2- 172.21.15.67:0/1108585216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac104b20 0x7fb6ac1999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:32.087+0000 7fb6b0ca8640 1 --2- 172.21.15.67:0/1108585216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac1021f0 0x7fb6ac199460 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:32.087+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/1108585216 >> 172.21.15.67:0/1108585216 conn(0x7fb6ac0fbdb0 msgr2=0x7fb6ac1018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:32.087+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/1108585216 shutdown_connections 2024-08-31T05:18:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:32.087+0000 7fb6b0ca8640 1 -- 172.21.15.67:0/1108585216 wait complete. 2024-08-31T05:18:32.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:32 smithi073 ceph-mon[24726]: mds.? [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] up:boot 2024-08-31T05:18:32.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:32 smithi073 ceph-mon[24726]: mds.? [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] up:active 2024-08-31T05:18:32.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:32 smithi073 ceph-mon[24726]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:18:32.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:32 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.kfbmeo"}]: dispatch 2024-08-31T05:18:32.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:32 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1108585216' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-31T05:18:32.714 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:32 smithi067 ceph-mon[17432]: mds.? [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] up:boot 2024-08-31T05:18:32.715 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:32 smithi067 ceph-mon[17432]: mds.? [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] up:active 2024-08-31T05:18:32.715 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:32 smithi067 ceph-mon[17432]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:18:32.715 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:32 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.kfbmeo"}]: dispatch 2024-08-31T05:18:32.715 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:32 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1108585216' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-31T05:18:33.138 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-08-31T05:18:34.346 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:34 smithi067 ceph-mon[17432]: mds.? [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] up:standby 2024-08-31T05:18:34.346 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:34 smithi067 ceph-mon[17432]: Dropping low affinity standby-replay daemon mds.cephfs.smithi073.gsnhxi in favor of higher affinity standby. 2024-08-31T05:18:34.346 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:34 smithi067 ceph-mon[17432]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:18:34.346 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:34 smithi067 ceph-mon[17432]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 1 up:standby 2024-08-31T05:18:34.346 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:34 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:34.346 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:34 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:34.346 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:34 smithi067 ceph-mon[17432]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 773 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-08-31T05:18:34.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:34 smithi073 ceph-mon[24726]: mds.? [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] up:standby 2024-08-31T05:18:34.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:34 smithi073 ceph-mon[24726]: Dropping low affinity standby-replay daemon mds.cephfs.smithi073.gsnhxi in favor of higher affinity standby. 2024-08-31T05:18:34.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:34 smithi073 ceph-mon[24726]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:18:34.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:34 smithi073 ceph-mon[24726]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 1 up:standby 2024-08-31T05:18:34.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:34 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:34.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:34 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:34.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:34 smithi073 ceph-mon[24726]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 773 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-08-31T05:18:34.684 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:35.382 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:35 smithi067 ceph-mon[17432]: mds.? [v2:172.21.15.73:6824/2383176383,v1:172.21.15.73:6825/2383176383] up:boot 2024-08-31T05:18:35.382 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:35 smithi067 ceph-mon[17432]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:18:35.382 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:35 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.gsnhxi"}]: dispatch 2024-08-31T05:18:35.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:35 smithi073 ceph-mon[24726]: mds.? [v2:172.21.15.73:6824/2383176383,v1:172.21.15.73:6825/2383176383] up:boot 2024-08-31T05:18:35.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:35 smithi073 ceph-mon[24726]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:18:35.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:35 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.gsnhxi"}]: dispatch 2024-08-31T05:18:35.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.463+0000 7f9d0748f640 1 -- 172.21.15.67:0/784267544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d00102900 msgr2=0x7f9d00102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:35.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.463+0000 7f9d0748f640 1 --2- 172.21.15.67:0/784267544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d00102900 0x7f9d00102d80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009880 tx=0x7f9cf402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:35.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.463+0000 7f9d0748f640 1 -- 172.21.15.67:0/784267544 shutdown_connections 2024-08-31T05:18:35.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.463+0000 7f9d0748f640 1 --2- 172.21.15.67:0/784267544 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d00102900 0x7f9d00102d80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:35.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.463+0000 7f9d0748f640 1 --2- 172.21.15.67:0/784267544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d00101700 0x7f9d00101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:35.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.463+0000 7f9d0748f640 1 -- 172.21.15.67:0/784267544 >> 172.21.15.67:0/784267544 conn(0x7f9d000fce90 msgr2=0x7f9d000ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:35.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.463+0000 7f9d0748f640 1 -- 172.21.15.67:0/784267544 shutdown_connections 2024-08-31T05:18:35.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.463+0000 7f9d0748f640 1 -- 172.21.15.67:0/784267544 wait complete. 2024-08-31T05:18:35.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.463+0000 7f9d0748f640 1 Processor -- start 2024-08-31T05:18:35.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.464+0000 7f9d0748f640 1 -- start start 2024-08-31T05:18:35.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.464+0000 7f9d0748f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d00101700 0x7f9d00197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:35.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.464+0000 7f9d0748f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d00102900 0x7f9d00197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:35.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.464+0000 7f9d0748f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0010a540 con 0x7f9d00102900 2024-08-31T05:18:35.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.464+0000 7f9d0748f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0010a3c0 con 0x7f9d00101700 2024-08-31T05:18:35.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.464+0000 7f9d04a2a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d00102900 0x7f9d00197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:35.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.464+0000 7f9d04a2a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d00102900 0x7f9d00197770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37064/0 (socket says 172.21.15.67:37064) 2024-08-31T05:18:35.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.464+0000 7f9d04a2a640 1 -- 172.21.15.67:0/2156957135 learned_addr learned my addr 172.21.15.67:0/2156957135 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:35.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.464+0000 7f9d0522b640 1 --2- 172.21.15.67:0/2156957135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d00101700 0x7f9d00197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:35.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.464+0000 7f9d04a2a640 1 -- 172.21.15.67:0/2156957135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d00101700 msgr2=0x7f9d00197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:35.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.464+0000 7f9d04a2a640 1 --2- 172.21.15.67:0/2156957135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d00101700 0x7f9d00197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:35.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.464+0000 7f9d04a2a640 1 -- 172.21.15.67:0/2156957135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d00197df0 con 0x7f9d00102900 2024-08-31T05:18:35.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.464+0000 7f9d04a2a640 1 --2- 172.21.15.67:0/2156957135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d00102900 0x7f9d00197770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4006010 tx=0x7f9cf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:35.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.465+0000 7f9cf27fc640 1 -- 172.21.15.67:0/2156957135 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9cf403f070 con 0x7f9d00102900 2024-08-31T05:18:35.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.465+0000 7f9cf27fc640 1 -- 172.21.15.67:0/2156957135 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9cf4004ac0 con 0x7f9d00102900 2024-08-31T05:18:35.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.465+0000 7f9d0748f640 1 -- 172.21.15.67:0/2156957135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d0019c7d0 con 0x7f9d00102900 2024-08-31T05:18:35.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.465+0000 7f9cf27fc640 1 -- 172.21.15.67:0/2156957135 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9cf4035030 con 0x7f9d00102900 2024-08-31T05:18:35.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.465+0000 7f9d0748f640 1 -- 172.21.15.67:0/2156957135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0019cd60 con 0x7f9d00102900 2024-08-31T05:18:35.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.466+0000 7f9d0748f640 1 -- 172.21.15.67:0/2156957135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d00101b00 con 0x7f9d00102900 2024-08-31T05:18:35.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.466+0000 7f9cf27fc640 1 -- 172.21.15.67:0/2156957135 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f9cf4042070 con 0x7f9d00102900 2024-08-31T05:18:35.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.467+0000 7f9cf27fc640 1 --2- 172.21.15.67:0/2156957135 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f9cec06de90 0x7f9cec070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:35.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.467+0000 7f9cf27fc640 1 -- 172.21.15.67:0/2156957135 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f9cf40ae670 con 0x7f9d00102900 2024-08-31T05:18:35.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.467+0000 7f9d0522b640 1 --2- 172.21.15.67:0/2156957135 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f9cec06de90 0x7f9cec070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:35.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.467+0000 7f9d0522b640 1 --2- 172.21.15.67:0/2156957135 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f9cec06de90 0x7f9cec070350 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc005fd0 tx=0x7f9cfc00b390 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:35.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.471+0000 7f9cf27fc640 1 -- 172.21.15.67:0/2156957135 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9cf407ff40 con 0x7f9d00102900 2024-08-31T05:18:35.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.685+0000 7f9d0748f640 1 -- 172.21.15.67:0/2156957135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d00062b90 con 0x7f9d00102900 2024-08-31T05:18:35.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.686+0000 7f9cf27fc640 1 -- 172.21.15.67:0/2156957135 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5322 (secure 0 0 0) 0x7f9cf4084770 con 0x7f9d00102900 2024-08-31T05:18:35.689 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-08-31T05:18:35.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.688+0000 7f9d0748f640 1 -- 172.21.15.67:0/2156957135 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f9cec06de90 msgr2=0x7f9cec070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:35.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.688+0000 7f9d0748f640 1 --2- 172.21.15.67:0/2156957135 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f9cec06de90 0x7f9cec070350 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc005fd0 tx=0x7f9cfc00b390 comp rx=0 tx=0).stop 2024-08-31T05:18:35.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.688+0000 7f9d0748f640 1 -- 172.21.15.67:0/2156957135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d00102900 msgr2=0x7f9d00197770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:35.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.688+0000 7f9d0748f640 1 --2- 172.21.15.67:0/2156957135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d00102900 0x7f9d00197770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4006010 tx=0x7f9cf40046c0 comp rx=0 tx=0).stop 2024-08-31T05:18:35.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.688+0000 7f9d0748f640 1 -- 172.21.15.67:0/2156957135 shutdown_connections 2024-08-31T05:18:35.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.688+0000 7f9d0748f640 1 --2- 172.21.15.67:0/2156957135 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f9cec06de90 0x7f9cec070350 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:35.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.688+0000 7f9d0748f640 1 --2- 172.21.15.67:0/2156957135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d00102900 0x7f9d00197770 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:35.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.688+0000 7f9d0748f640 1 --2- 172.21.15.67:0/2156957135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d00101700 0x7f9d00197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:35.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.688+0000 7f9d0748f640 1 -- 172.21.15.67:0/2156957135 >> 172.21.15.67:0/2156957135 conn(0x7f9d000fce90 msgr2=0x7f9d00105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:35.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.688+0000 7f9d0748f640 1 -- 172.21.15.67:0/2156957135 shutdown_connections 2024-08-31T05:18:35.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:35.688+0000 7f9d0748f640 1 -- 172.21.15.67:0/2156957135 wait complete. 2024-08-31T05:18:35.699 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:18:36.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:36 smithi073 ceph-mon[24726]: mds.? [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] up:standby 2024-08-31T05:18:36.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:36 smithi073 ceph-mon[24726]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:18:36.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:36 smithi073 ceph-mon[24726]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-08-31T05:18:36.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:36 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2156957135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-31T05:18:36.514 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:36 smithi067 ceph-mon[17432]: mds.? [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] up:standby 2024-08-31T05:18:36.515 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:36 smithi067 ceph-mon[17432]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:18:36.515 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:36 smithi067 ceph-mon[17432]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-08-31T05:18:36.515 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:36 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2156957135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-31T05:18:36.546 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-08-31T05:18:37.359 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.818+0000 7f3a0fc08640 1 -- 172.21.15.67:0/103818153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a08100600 msgr2=0x7f3a08100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.818+0000 7f3a0fc08640 1 --2- 172.21.15.67:0/103818153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a08100600 0x7f3a08100a00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009880 tx=0x7f3a0402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.818+0000 7f3a0fc08640 1 -- 172.21.15.67:0/103818153 shutdown_connections 2024-08-31T05:18:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.818+0000 7f3a0fc08640 1 --2- 172.21.15.67:0/103818153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a08101800 0x7f3a08101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.818+0000 7f3a0fc08640 1 --2- 172.21.15.67:0/103818153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a08100600 0x7f3a08100a00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.818+0000 7f3a0fc08640 1 -- 172.21.15.67:0/103818153 >> 172.21.15.67:0/103818153 conn(0x7f3a080fbdb0 msgr2=0x7f3a080fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.818+0000 7f3a0fc08640 1 -- 172.21.15.67:0/103818153 shutdown_connections 2024-08-31T05:18:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.818+0000 7f3a0fc08640 1 -- 172.21.15.67:0/103818153 wait complete. 2024-08-31T05:18:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.819+0000 7f3a0fc08640 1 Processor -- start 2024-08-31T05:18:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.819+0000 7f3a0fc08640 1 -- start start 2024-08-31T05:18:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.819+0000 7f3a0fc08640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a08100600 0x7f3a08197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.819+0000 7f3a0fc08640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a08101800 0x7f3a081977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.819+0000 7f3a0fc08640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3a08109420 con 0x7f3a08101800 2024-08-31T05:18:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.819+0000 7f3a0fc08640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3a081092a0 con 0x7f3a08100600 2024-08-31T05:18:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.819+0000 7f3a0d1a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a08101800 0x7f3a081977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.819+0000 7f3a0d1a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a08101800 0x7f3a081977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37078/0 (socket says 172.21.15.67:37078) 2024-08-31T05:18:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.819+0000 7f3a0d1a3640 1 -- 172.21.15.67:0/2987590065 learned_addr learned my addr 172.21.15.67:0/2987590065 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.819+0000 7f3a0d9a4640 1 --2- 172.21.15.67:0/2987590065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a08100600 0x7f3a08197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.819+0000 7f3a0d1a3640 1 -- 172.21.15.67:0/2987590065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a08100600 msgr2=0x7f3a08197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.819+0000 7f3a0d1a3640 1 --2- 172.21.15.67:0/2987590065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a08100600 0x7f3a08197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.819+0000 7f3a0d1a3640 1 -- 172.21.15.67:0/2987590065 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a08197e20 con 0x7f3a08101800 2024-08-31T05:18:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.820+0000 7f3a0d1a3640 1 --2- 172.21.15.67:0/2987590065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a08101800 0x7f3a081977a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f39f800d8d0 tx=0x7f39f800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:37.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.820+0000 7f39feffd640 1 -- 172.21.15.67:0/2987590065 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39f8017070 con 0x7f3a08101800 2024-08-31T05:18:37.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.820+0000 7f3a0fc08640 1 -- 172.21.15.67:0/2987590065 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0819c860 con 0x7f3a08101800 2024-08-31T05:18:37.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.820+0000 7f39feffd640 1 -- 172.21.15.67:0/2987590065 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39f8010460 con 0x7f3a08101800 2024-08-31T05:18:37.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.820+0000 7f39feffd640 1 -- 172.21.15.67:0/2987590065 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39f800f5f0 con 0x7f3a08101800 2024-08-31T05:18:37.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.820+0000 7f3a0fc08640 1 -- 172.21.15.67:0/2987590065 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a0819cdf0 con 0x7f3a08101800 2024-08-31T05:18:37.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.821+0000 7f3a0fc08640 1 -- 172.21.15.67:0/2987590065 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a08100a00 con 0x7f3a08101800 2024-08-31T05:18:37.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.821+0000 7f39feffd640 1 -- 172.21.15.67:0/2987590065 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f39f8009a30 con 0x7f3a08101800 2024-08-31T05:18:37.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.822+0000 7f39feffd640 1 --2- 172.21.15.67:0/2987590065 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f39f406de30 0x7f39f40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:37.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.822+0000 7f39feffd640 1 -- 172.21.15.67:0/2987590065 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f39f808da60 con 0x7f3a08101800 2024-08-31T05:18:37.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.822+0000 7f3a0d9a4640 1 --2- 172.21.15.67:0/2987590065 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f39f406de30 0x7f39f40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:37.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.822+0000 7f3a0d9a4640 1 --2- 172.21.15.67:0/2987590065 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f39f406de30 0x7f39f40702f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a04000c00 tx=0x7f3a04009620 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:37.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:37.826+0000 7f39feffd640 1 -- 172.21.15.67:0/2987590065 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39f805b600 con 0x7f3a08101800 2024-08-31T05:18:38.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:38.089+0000 7f3a0fc08640 1 -- 172.21.15.67:0/2987590065 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) -- 0x7f3a08106670 con 0x7f3a08101800 2024-08-31T05:18:38.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:38.089+0000 7f39feffd640 1 -- 172.21.15.67:0/2987590065 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) ==== 78+0+98 (secure 0 0 0) 0x7f39f805f2b0 con 0x7f3a08101800 2024-08-31T05:18:38.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:38.092+0000 7f3a0fc08640 1 -- 172.21.15.67:0/2987590065 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f39f406de30 msgr2=0x7f39f40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:38.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:38.092+0000 7f3a0fc08640 1 --2- 172.21.15.67:0/2987590065 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f39f406de30 0x7f39f40702f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a04000c00 tx=0x7f3a04009620 comp rx=0 tx=0).stop 2024-08-31T05:18:38.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:38.092+0000 7f3a0fc08640 1 -- 172.21.15.67:0/2987590065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a08101800 msgr2=0x7f3a081977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:38.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:38.092+0000 7f3a0fc08640 1 --2- 172.21.15.67:0/2987590065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a08101800 0x7f3a081977a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f39f800d8d0 tx=0x7f39f800dd90 comp rx=0 tx=0).stop 2024-08-31T05:18:38.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:38.093+0000 7f3a0fc08640 1 -- 172.21.15.67:0/2987590065 shutdown_connections 2024-08-31T05:18:38.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:38.093+0000 7f3a0fc08640 1 --2- 172.21.15.67:0/2987590065 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f39f406de30 0x7f39f40702f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:38.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:38.093+0000 7f3a0fc08640 1 --2- 172.21.15.67:0/2987590065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a08101800 0x7f3a081977a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:38.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:38.093+0000 7f3a0fc08640 1 --2- 172.21.15.67:0/2987590065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a08100600 0x7f3a08197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:38.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:38.093+0000 7f3a0fc08640 1 -- 172.21.15.67:0/2987590065 >> 172.21.15.67:0/2987590065 conn(0x7f3a080fbdb0 msgr2=0x7f3a080fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:38.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:38.093+0000 7f3a0fc08640 1 -- 172.21.15.67:0/2987590065 shutdown_connections 2024-08-31T05:18:38.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:38.093+0000 7f3a0fc08640 1 -- 172.21.15.67:0/2987590065 wait complete. 2024-08-31T05:18:38.107 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:18:38.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:38 smithi073 ceph-mon[24726]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-31T05:18:38.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:38 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:38.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:38 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:38.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:38 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2987590065' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-08-31T05:18:38.709 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:38 smithi067 ceph-mon[17432]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-31T05:18:38.710 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:38 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:38.710 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:38 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:38.710 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:38 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2987590065' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-08-31T05:18:38.735 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-08-31T05:18:38.748 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:18:39.022 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:39.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.493+0000 7ff4a83bb640 1 -- 172.21.15.67:0/911423005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4a01016a0 msgr2=0x7ff4a0101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:39.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.493+0000 7ff4a83bb640 1 --2- 172.21.15.67:0/911423005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4a01016a0 0x7ff4a0101b00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff490009880 tx=0x7ff49002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:39.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.493+0000 7ff4a83bb640 1 -- 172.21.15.67:0/911423005 shutdown_connections 2024-08-31T05:18:39.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.493+0000 7ff4a83bb640 1 --2- 172.21.15.67:0/911423005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4a01016a0 0x7ff4a0101b00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:39.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.493+0000 7ff4a83bb640 1 --2- 172.21.15.67:0/911423005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4a01076a0 0x7ff4a0107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:39.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.493+0000 7ff4a83bb640 1 -- 172.21.15.67:0/911423005 >> 172.21.15.67:0/911423005 conn(0x7ff4a00fd3a0 msgr2=0x7ff4a00ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:39.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.493+0000 7ff4a83bb640 1 -- 172.21.15.67:0/911423005 shutdown_connections 2024-08-31T05:18:39.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.493+0000 7ff4a83bb640 1 -- 172.21.15.67:0/911423005 wait complete. 2024-08-31T05:18:39.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.494+0000 7ff4a83bb640 1 Processor -- start 2024-08-31T05:18:39.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.494+0000 7ff4a83bb640 1 -- start start 2024-08-31T05:18:39.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.494+0000 7ff4a83bb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4a01016a0 0x7ff4a0074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:39.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.494+0000 7ff4a83bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4a01076a0 0x7ff4a00747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:39.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.494+0000 7ff4a83bb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a010eb50 con 0x7ff4a01016a0 2024-08-31T05:18:39.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.494+0000 7ff4a83bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a010e9d0 con 0x7ff4a01076a0 2024-08-31T05:18:39.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.494+0000 7ff4a6157640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4a01016a0 0x7ff4a0074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:39.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.494+0000 7ff4a6157640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4a01016a0 0x7ff4a0074290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46514/0 (socket says 172.21.15.67:46514) 2024-08-31T05:18:39.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.494+0000 7ff4a6157640 1 -- 172.21.15.67:0/2323951862 learned_addr learned my addr 172.21.15.67:0/2323951862 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:39.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.495+0000 7ff4a5956640 1 --2- 172.21.15.67:0/2323951862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4a01076a0 0x7ff4a00747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:39.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.495+0000 7ff4a6157640 1 -- 172.21.15.67:0/2323951862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4a01076a0 msgr2=0x7ff4a00747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:39.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.495+0000 7ff4a6157640 1 --2- 172.21.15.67:0/2323951862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4a01076a0 0x7ff4a00747d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:39.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.495+0000 7ff4a6157640 1 -- 172.21.15.67:0/2323951862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a0074d10 con 0x7ff4a01016a0 2024-08-31T05:18:39.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.495+0000 7ff4a6157640 1 --2- 172.21.15.67:0/2323951862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4a01016a0 0x7ff4a0074290 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00d8d0 tx=0x7ff49c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:39.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.495+0000 7ff4977fe640 1 -- 172.21.15.67:0/2323951862 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff49c017070 con 0x7ff4a01016a0 2024-08-31T05:18:39.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.495+0000 7ff4977fe640 1 -- 172.21.15.67:0/2323951862 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff49c010460 con 0x7ff4a01016a0 2024-08-31T05:18:39.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.495+0000 7ff4a83bb640 1 -- 172.21.15.67:0/2323951862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a0075000 con 0x7ff4a01016a0 2024-08-31T05:18:39.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.495+0000 7ff4977fe640 1 -- 172.21.15.67:0/2323951862 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff49c00f5f0 con 0x7ff4a01016a0 2024-08-31T05:18:39.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.495+0000 7ff4a83bb640 1 -- 172.21.15.67:0/2323951862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a01a3c00 con 0x7ff4a01016a0 2024-08-31T05:18:39.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.496+0000 7ff4a83bb640 1 -- 172.21.15.67:0/2323951862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a0102de0 con 0x7ff4a01016a0 2024-08-31T05:18:39.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.497+0000 7ff4977fe640 1 -- 172.21.15.67:0/2323951862 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7ff49c009a30 con 0x7ff4a01016a0 2024-08-31T05:18:39.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.497+0000 7ff4977fe640 1 --2- 172.21.15.67:0/2323951862 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff48c06de30 0x7ff48c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:39.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.497+0000 7ff4a5956640 1 --2- 172.21.15.67:0/2323951862 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff48c06de30 0x7ff48c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:39.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.497+0000 7ff4977fe640 1 -- 172.21.15.67:0/2323951862 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7ff49c08da90 con 0x7ff4a01016a0 2024-08-31T05:18:39.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.498+0000 7ff4a5956640 1 --2- 172.21.15.67:0/2323951862 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff48c06de30 0x7ff48c0702f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0075d20 tx=0x7ff490031400 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:39.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.502+0000 7ff4977fe640 1 -- 172.21.15.67:0/2323951862 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff49c05b630 con 0x7ff4a01016a0 2024-08-31T05:18:39.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:39 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:39.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:39 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:18:39.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:39 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:39.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:39 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:18:39.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.724+0000 7ff4a83bb640 1 -- 172.21.15.67:0/2323951862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4a0101b00 con 0x7ff4a01016a0 2024-08-31T05:18:39.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:39 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:39.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:39 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:18:39.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:39 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:39.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:39 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:18:39.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.724+0000 7ff4977fe640 1 -- 172.21.15.67:0/2323951862 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5322 (secure 0 0 0) 0x7ff49c05f2e0 con 0x7ff4a01016a0 2024-08-31T05:18:39.727 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:18:39.727 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":15,"btime":"2024-08-31T05:18:35:124059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":24307,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2383176383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2383176383},{"type":"v1","addr":"172.21.15.73:6825","nonce":2383176383}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:18:33.086400+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14554},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14554":{"gid":14554,"name":"cephfs.smithi067.tskvpt","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6827/2961844124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2961844124},{"type":"v1","addr":"172.21.15.67:6827","nonce":2961844124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14566":{"gid":14566,"name":"cephfs.smithi067.beqeql","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.67:6829/1181644963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":1181644963},{"type":"v1","addr":"172.21.15.67:6829","nonce":1181644963}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14554,"qdb_cluster":[14554]},"id":1}]} 2024-08-31T05:18:39.727 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-08-31T05:18:39.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.727+0000 7ff4a83bb640 1 -- 172.21.15.67:0/2323951862 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff48c06de30 msgr2=0x7ff48c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:39.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.727+0000 7ff4a83bb640 1 --2- 172.21.15.67:0/2323951862 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff48c06de30 0x7ff48c0702f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0075d20 tx=0x7ff490031400 comp rx=0 tx=0).stop 2024-08-31T05:18:39.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.727+0000 7ff4a83bb640 1 -- 172.21.15.67:0/2323951862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4a01016a0 msgr2=0x7ff4a0074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:39.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.727+0000 7ff4a83bb640 1 --2- 172.21.15.67:0/2323951862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4a01016a0 0x7ff4a0074290 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00d8d0 tx=0x7ff49c00dd90 comp rx=0 tx=0).stop 2024-08-31T05:18:39.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.727+0000 7ff4a83bb640 1 -- 172.21.15.67:0/2323951862 shutdown_connections 2024-08-31T05:18:39.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.727+0000 7ff4a83bb640 1 --2- 172.21.15.67:0/2323951862 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff48c06de30 0x7ff48c0702f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:39.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.727+0000 7ff4a83bb640 1 --2- 172.21.15.67:0/2323951862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4a01076a0 0x7ff4a00747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:39.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.727+0000 7ff4a83bb640 1 --2- 172.21.15.67:0/2323951862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff4a01016a0 0x7ff4a0074290 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:39.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.727+0000 7ff4a83bb640 1 -- 172.21.15.67:0/2323951862 >> 172.21.15.67:0/2323951862 conn(0x7ff4a00fd3a0 msgr2=0x7ff4a00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:39.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.727+0000 7ff4a83bb640 1 -- 172.21.15.67:0/2323951862 shutdown_connections 2024-08-31T05:18:39.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:39.727+0000 7ff4a83bb640 1 -- 172.21.15.67:0/2323951862 wait complete. 2024-08-31T05:18:40.435 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 1, 'flags': 50} 2024-08-31T05:18:40.435 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-31T05:18:40.463 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-31T05:18:40.463 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-08-31T05:18:40.463 INFO:tasks.ceph_fuse:client.0 config is {} 2024-08-31T05:18:40.463 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-31T05:18:40.463 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T05:18:40.463 INFO:tasks.ceph_fuse:client.1 config is {} 2024-08-31T05:18:40.463 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-31T05:18:40.463 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-31T05:18:40.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:40.464 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-08-31T05:18:40.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:40.481 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-08-31T05:18:40.548 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2024-08-31T05:18:40.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:18:40.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:40.550 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-08-31T05:18:40.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:40.567 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-08-31T05:18:40.628 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:40 smithi073 ceph-mon[24726]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:18:40.628 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:40 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2323951862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-31T05:18:40.635 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2024-08-31T05:18:40.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:18:40.637 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-31T05:18:40.637 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-31T05:18:40.637 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs ls 2024-08-31T05:18:40.659 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:40 smithi067 ceph-mon[17432]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:18:40.659 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:40 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2323951862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-31T05:18:40.931 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:41.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.380+0000 7f461af82640 1 -- 172.21.15.67:0/2249232169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4614106660 msgr2=0x7f4614106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:41.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.380+0000 7f461af82640 1 --2- 172.21.15.67:0/2249232169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4614106660 0x7f4614106a40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4604009c20 tx=0x7f460402a970 comp rx=0 tx=0).stop 2024-08-31T05:18:41.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.381+0000 7f461af82640 1 -- 172.21.15.67:0/2249232169 shutdown_connections 2024-08-31T05:18:41.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.381+0000 7f461af82640 1 --2- 172.21.15.67:0/2249232169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46141005b0 0x7f4614100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:41.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.381+0000 7f461af82640 1 --2- 172.21.15.67:0/2249232169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4614106660 0x7f4614106a40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:41.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.381+0000 7f461af82640 1 -- 172.21.15.67:0/2249232169 >> 172.21.15.67:0/2249232169 conn(0x7f46140fc2f0 msgr2=0x7f46140fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:41.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.381+0000 7f461af82640 1 -- 172.21.15.67:0/2249232169 shutdown_connections 2024-08-31T05:18:41.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.381+0000 7f461af82640 1 -- 172.21.15.67:0/2249232169 wait complete. 2024-08-31T05:18:41.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.381+0000 7f461af82640 1 Processor -- start 2024-08-31T05:18:41.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.381+0000 7f461af82640 1 -- start start 2024-08-31T05:18:41.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f461af82640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46141005b0 0x7f46141965a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:41.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f461af82640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4614106660 0x7f4614196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:41.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f461af82640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f461410da50 con 0x7f4614106660 2024-08-31T05:18:41.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f461af82640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f461410d8d0 con 0x7f46141005b0 2024-08-31T05:18:41.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f4613fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4614106660 0x7f4614196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:41.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f4618d1e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46141005b0 0x7f46141965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:41.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f4618d1e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46141005b0 0x7f46141965a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:33528/0 (socket says 172.21.15.67:33528) 2024-08-31T05:18:41.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f4613fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4614106660 0x7f4614196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46528/0 (socket says 172.21.15.67:46528) 2024-08-31T05:18:41.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f4618d1e640 1 -- 172.21.15.67:0/2561143126 learned_addr learned my addr 172.21.15.67:0/2561143126 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:41.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f4618d1e640 1 -- 172.21.15.67:0/2561143126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4614106660 msgr2=0x7f4614196ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:41.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f4618d1e640 1 --2- 172.21.15.67:0/2561143126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4614106660 0x7f4614196ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:41.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f4618d1e640 1 -- 172.21.15.67:0/2561143126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461419ae70 con 0x7f46141005b0 2024-08-31T05:18:41.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f4613fff640 1 --2- 172.21.15.67:0/2561143126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4614106660 0x7f4614196ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:18:41.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f4618d1e640 1 --2- 172.21.15.67:0/2561143126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46141005b0 0x7f46141965a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4604005cc0 tx=0x7f460402f5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:41.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f4611ffb640 1 -- 172.21.15.67:0/2561143126 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4604047070 con 0x7f46141005b0 2024-08-31T05:18:41.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.382+0000 7f461af82640 1 -- 172.21.15.67:0/2561143126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461419b100 con 0x7f46141005b0 2024-08-31T05:18:41.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.383+0000 7f4611ffb640 1 -- 172.21.15.67:0/2561143126 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f460402f7e0 con 0x7f46141005b0 2024-08-31T05:18:41.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.383+0000 7f4611ffb640 1 -- 172.21.15.67:0/2561143126 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4604034070 con 0x7f46141005b0 2024-08-31T05:18:41.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.383+0000 7f461af82640 1 -- 172.21.15.67:0/2561143126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461419b6b0 con 0x7f46141005b0 2024-08-31T05:18:41.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.384+0000 7f461af82640 1 -- 172.21.15.67:0/2561143126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4614101cd0 con 0x7f46141005b0 2024-08-31T05:18:41.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.384+0000 7f4611ffb640 1 -- 172.21.15.67:0/2561143126 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f460404a070 con 0x7f46141005b0 2024-08-31T05:18:41.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.384+0000 7f4611ffb640 1 --2- 172.21.15.67:0/2561143126 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f460006de30 0x7f46000702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:41.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.384+0000 7f4611ffb640 1 -- 172.21.15.67:0/2561143126 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f46040ae9b0 con 0x7f46141005b0 2024-08-31T05:18:41.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.384+0000 7f4613fff640 1 --2- 172.21.15.67:0/2561143126 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f460006de30 0x7f46000702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:41.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.385+0000 7f4613fff640 1 --2- 172.21.15.67:0/2561143126 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f460006de30 0x7f46000702f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f46140ffa00 tx=0x7f45fc00a2d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:41.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.389+0000 7f4611ffb640 1 -- 172.21.15.67:0/2561143126 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f460403f070 con 0x7f46141005b0 2024-08-31T05:18:41.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.613+0000 7f461af82640 1 -- 172.21.15.67:0/2561143126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4614108a80 con 0x7f46141005b0 2024-08-31T05:18:41.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.613+0000 7f4611ffb640 1 -- 172.21.15.67:0/2561143126 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+83 (secure 0 0 0) 0x7f4604080200 con 0x7f46141005b0 2024-08-31T05:18:41.615 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-08-31T05:18:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.615+0000 7f461af82640 1 -- 172.21.15.67:0/2561143126 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f460006de30 msgr2=0x7f46000702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.615+0000 7f461af82640 1 --2- 172.21.15.67:0/2561143126 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f460006de30 0x7f46000702f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f46140ffa00 tx=0x7f45fc00a2d0 comp rx=0 tx=0).stop 2024-08-31T05:18:41.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.615+0000 7f461af82640 1 -- 172.21.15.67:0/2561143126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46141005b0 msgr2=0x7f46141965a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.615+0000 7f461af82640 1 --2- 172.21.15.67:0/2561143126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46141005b0 0x7f46141965a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4604005cc0 tx=0x7f460402f5f0 comp rx=0 tx=0).stop 2024-08-31T05:18:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.615+0000 7f461af82640 1 -- 172.21.15.67:0/2561143126 shutdown_connections 2024-08-31T05:18:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.615+0000 7f461af82640 1 --2- 172.21.15.67:0/2561143126 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f460006de30 0x7f46000702f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.615+0000 7f461af82640 1 --2- 172.21.15.67:0/2561143126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4614106660 0x7f4614196ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.615+0000 7f461af82640 1 --2- 172.21.15.67:0/2561143126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46141005b0 0x7f46141965a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.615+0000 7f461af82640 1 -- 172.21.15.67:0/2561143126 >> 172.21.15.67:0/2561143126 conn(0x7f46140fc2f0 msgr2=0x7f46140fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.616+0000 7f461af82640 1 -- 172.21.15.67:0/2561143126 shutdown_connections 2024-08-31T05:18:41.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:41.616+0000 7f461af82640 1 -- 172.21.15.67:0/2561143126 wait complete. 2024-08-31T05:18:42.310 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:42 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:42.310 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:42 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:42.310 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:42 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:42.310 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:42 smithi067 ceph-mon[17432]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-08-31T05:18:42.310 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:42 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:18:42.310 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:42 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2561143126' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-31T05:18:42.337 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-31T05:18:42.337 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-31T05:18:42.337 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-08-31T05:18:42.337 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-31T05:18:42.338 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T05:18:42.338 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-31T05:18:42.338 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-31T05:18:42.338 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-31T05:18:42.338 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-31T05:18:42.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:42.338 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-08-31T05:18:42.393 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-31T05:18:42.394 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-31T05:18:42.394 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-08-31T05:18:42.394 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-08-31T05:18:42.394 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-08-31T05:18:42.394 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-08-31T05:18:42.394 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T05:18:42.394 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-08-31T05:18:42.394 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-08-31T05:18:42.394 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T05:18:42.394 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-08-31T05:18:42.394 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-08-31T05:18:42.394 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T05:18:42.394 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-08-31T05:18:42.395 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-31T05:18:42.395 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-08-31T05:18:42.395 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-31T05:18:42.395 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42410sec preferred_lft 42410sec 2024-08-31T05:18:42.395 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link noprefixroute 2024-08-31T05:18:42.395 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-08-31T05:18:42.395 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-31T05:18:42.396 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:18:42.396 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-08-31T05:18:42.396 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add name ceph-brx type bridge 2024-08-31T05:18:42.396 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr flush dev ceph-brx 2024-08-31T05:18:42.396 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set ceph-brx up 2024-08-31T05:18:42.396 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-31T05:18:42.396 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-08-31T05:18:42.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:42 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:42.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:42 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:42.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:42 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:42.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:42 smithi073 ceph-mon[24726]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-08-31T05:18:42.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:42 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:18:42.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:42 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2561143126' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-31T05:18:42.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:18:42.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:18:42.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:42.631 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-31T05:18:42.656 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-08-31T05:18:42.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:42.657 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-08-31T05:18:42.736 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-08-31T05:18:42.736 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-31T05:18:42.737 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-31T05:18:42.737 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-31T05:18:42.737 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-31T05:18:42.737 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:18:42.737 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-08-31T05:18:42.737 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-31T05:18:42.737 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-31T05:18:42.737 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-31T05:18:42.738 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-08-31T05:18:42.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:18:43.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:18:43.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:43.214 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-08-31T05:18:43.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:43.231 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2024-08-31T05:18:43.286 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:18:43.286 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-08-31T05:18:43.286 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T05:18:43.286 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-31T05:18:43.286 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-08-31T05:18:43.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:18:43.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:18:43.403 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-31T05:18:43.403 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:18:43.403 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-08-31T05:18:43.403 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-31T05:18:43.403 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-31T05:18:43.403 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-31T05:18:43.404 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-31T05:18:43.404 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-31T05:18:43.404 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-08-31T05:18:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:18:43.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:18:43.551 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:18:43.551 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-08-31T05:18:43.551 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-08-31T05:18:43.551 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.0 master ceph-brx 2024-08-31T05:18:43.551 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-08-31T05:18:43.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:18:43.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:18:43.634 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-31T05:18:43.634 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T05:18:43.634 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-31T05:18:43.661 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-31T05:18:43.661 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T05:18:43.661 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-31T05:18:43.716 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-08-31T05:18:43.783 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T05:18:43.839 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-08-31T05:18:43.840 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-08-31T05:18:43.840 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-08-31T05:18:43.840 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-08-31T05:18:43.840 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-08-31T05:18:43.840 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-08-31T05:18:43.840 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-08-31T05:18:43.840 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-08-31T05:18:43.840 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-08-31T05:18:43.840 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-08-31T05:18:43.840 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-08-31T05:18:43.840 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/selinux 2024-08-31T05:18:43.840 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:18:43.841 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-08-31T05:18:43.841 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-08-31T05:18:43.841 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-08-31T05:18:43.841 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-08-31T05:18:43.841 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-08-31T05:18:43.841 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T05:18:43.841 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-08-31T05:18:43.841 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T05:18:43.841 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T05:18:43.841 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T05:18:43.841 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T05:18:43.841 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-08-31T05:18:43.841 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-08-31T05:18:43.842 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay 2024-08-31T05:18:43.842 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/efc12159f640267725d5ba4fac9706ffcecd2fe3399de786b711a00746de863d/merged 2024-08-31T05:18:43.842 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/b2fd753fe7703e0c00bb607eb0e5b4862953551798d4bb373c7a2f8481209319/merged 2024-08-31T05:18:43.842 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/0 2024-08-31T05:18:43.842 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:18:43.842 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/3bd3f04d2701301172afe6e91c37ddd31871fb0cbc4639163cdd1319608b18fd/merged 2024-08-31T05:18:43.842 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/ba5facc515c6c2efee5679f367ca6e23cc5c1f6af0bcdbb737f08c0dc68d1fe9/merged 2024-08-31T05:18:43.842 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/158d8563f131a3942b3d612bcf78a4c1c12d3b9dfcb40124d47bff0c693920a1/merged 2024-08-31T05:18:43.842 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/3eeacb875e6835d8bc44a246cb7837bda7b589b3d3eaeb607866c988b820daab/merged 2024-08-31T05:18:43.842 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/44d499024633c300d0a2ae6771c63934c94a27c1519d30734134bebbde27f20b/merged 2024-08-31T05:18:43.842 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/7101baa1f7a2393a1de5581d298abce57da14cff5f0363140b4ecf1e1743cc09/merged 2024-08-31T05:18:43.842 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/81d0b7049261ab21527733e8503211056720ec5bf6e3e515dc929e32b2f46b07/merged 2024-08-31T05:18:43.842 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/294b048fdbe3c4f6c3f50d34f547afc8302faacb9d841591e911b6ecc39a46aa/merged 2024-08-31T05:18:43.843 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/774768991c08be2e06a5274e5cdff093870b798c18392b6c31f2930a13215ce2/merged 2024-08-31T05:18:43.843 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/c03996918da366c4658c29df9d2b292d9761f8fd8e490af2d293bf082e93c4f5/merged 2024-08-31T05:18:43.843 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/bf3dbd4cb52bc6adc8a2703a110f8d2a29c3608af7b00dc5b5b3b94aba6ca966/merged 2024-08-31T05:18:43.843 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-08-31T05:18:43.843 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T05:18:43.843 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T05:18:43.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:43.843 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-08-31T05:18:43.895 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-31T05:18:43.895 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-31T05:18:43.938 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-08-31T05:18:43.963 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T05:18:44.019 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-08-31T05:18:44.020 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-08-31T05:18:44.020 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-08-31T05:18:44.020 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-08-31T05:18:44.020 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-08-31T05:18:44.020 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-08-31T05:18:44.020 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-08-31T05:18:44.020 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-08-31T05:18:44.020 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-08-31T05:18:44.020 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-08-31T05:18:44.020 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-08-31T05:18:44.020 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/selinux 2024-08-31T05:18:44.021 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:18:44.021 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-08-31T05:18:44.021 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-08-31T05:18:44.021 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-08-31T05:18:44.021 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-08-31T05:18:44.021 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-08-31T05:18:44.021 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T05:18:44.021 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-08-31T05:18:44.021 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T05:18:44.021 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T05:18:44.021 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T05:18:44.021 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T05:18:44.021 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-08-31T05:18:44.021 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/efc12159f640267725d5ba4fac9706ffcecd2fe3399de786b711a00746de863d/merged 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/b2fd753fe7703e0c00bb607eb0e5b4862953551798d4bb373c7a2f8481209319/merged 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/0 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/3bd3f04d2701301172afe6e91c37ddd31871fb0cbc4639163cdd1319608b18fd/merged 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/ba5facc515c6c2efee5679f367ca6e23cc5c1f6af0bcdbb737f08c0dc68d1fe9/merged 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/158d8563f131a3942b3d612bcf78a4c1c12d3b9dfcb40124d47bff0c693920a1/merged 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/3eeacb875e6835d8bc44a246cb7837bda7b589b3d3eaeb607866c988b820daab/merged 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/44d499024633c300d0a2ae6771c63934c94a27c1519d30734134bebbde27f20b/merged 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/7101baa1f7a2393a1de5581d298abce57da14cff5f0363140b4ecf1e1743cc09/merged 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/81d0b7049261ab21527733e8503211056720ec5bf6e3e515dc929e32b2f46b07/merged 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/294b048fdbe3c4f6c3f50d34f547afc8302faacb9d841591e911b6ecc39a46aa/merged 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/774768991c08be2e06a5274e5cdff093870b798c18392b6c31f2930a13215ce2/merged 2024-08-31T05:18:44.022 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/c03996918da366c4658c29df9d2b292d9761f8fd8e490af2d293bf082e93c4f5/merged 2024-08-31T05:18:44.023 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/bf3dbd4cb52bc6adc8a2703a110f8d2a29c3608af7b00dc5b5b3b94aba6ca966/merged 2024-08-31T05:18:44.023 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-08-31T05:18:44.023 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T05:18:44.023 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T05:18:44.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:44.023 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-08-31T05:18:44.082 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:2024-08-31T05:18:44.081+0000 7f9d8e874480 -1 init, newargv = 0x55db9babf2f0 newargc=15 2024-08-31T05:18:44.083 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[64465]: starting ceph client 2024-08-31T05:18:44.088 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[64465]: starting fuse 2024-08-31T05:18:44.664 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:44 smithi067 ceph-mon[17432]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-08-31T05:18:44.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:44 smithi073 ceph-mon[24726]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-08-31T05:18:45.178 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-08-31T05:18:45.206 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T05:18:45.266 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-08-31T05:18:45.266 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-08-31T05:18:45.266 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-08-31T05:18:45.266 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-08-31T05:18:45.266 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-08-31T05:18:45.266 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-08-31T05:18:45.266 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-08-31T05:18:45.266 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-08-31T05:18:45.266 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-08-31T05:18:45.266 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-08-31T05:18:45.267 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-08-31T05:18:45.267 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/selinux 2024-08-31T05:18:45.267 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:18:45.267 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-08-31T05:18:45.267 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-08-31T05:18:45.267 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-08-31T05:18:45.267 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-08-31T05:18:45.267 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-08-31T05:18:45.267 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T05:18:45.267 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-08-31T05:18:45.267 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T05:18:45.267 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T05:18:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T05:18:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T05:18:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-08-31T05:18:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-08-31T05:18:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay 2024-08-31T05:18:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/efc12159f640267725d5ba4fac9706ffcecd2fe3399de786b711a00746de863d/merged 2024-08-31T05:18:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/b2fd753fe7703e0c00bb607eb0e5b4862953551798d4bb373c7a2f8481209319/merged 2024-08-31T05:18:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/0 2024-08-31T05:18:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:18:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/3bd3f04d2701301172afe6e91c37ddd31871fb0cbc4639163cdd1319608b18fd/merged 2024-08-31T05:18:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/ba5facc515c6c2efee5679f367ca6e23cc5c1f6af0bcdbb737f08c0dc68d1fe9/merged 2024-08-31T05:18:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/158d8563f131a3942b3d612bcf78a4c1c12d3b9dfcb40124d47bff0c693920a1/merged 2024-08-31T05:18:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/3eeacb875e6835d8bc44a246cb7837bda7b589b3d3eaeb607866c988b820daab/merged 2024-08-31T05:18:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/44d499024633c300d0a2ae6771c63934c94a27c1519d30734134bebbde27f20b/merged 2024-08-31T05:18:45.269 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/7101baa1f7a2393a1de5581d298abce57da14cff5f0363140b4ecf1e1743cc09/merged 2024-08-31T05:18:45.269 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/81d0b7049261ab21527733e8503211056720ec5bf6e3e515dc929e32b2f46b07/merged 2024-08-31T05:18:45.269 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/294b048fdbe3c4f6c3f50d34f547afc8302faacb9d841591e911b6ecc39a46aa/merged 2024-08-31T05:18:45.269 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/774768991c08be2e06a5274e5cdff093870b798c18392b6c31f2930a13215ce2/merged 2024-08-31T05:18:45.269 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/c03996918da366c4658c29df9d2b292d9761f8fd8e490af2d293bf082e93c4f5/merged 2024-08-31T05:18:45.269 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/containers/storage/overlay/bf3dbd4cb52bc6adc8a2703a110f8d2a29c3608af7b00dc5b5b3b94aba6ca966/merged 2024-08-31T05:18:45.269 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-08-31T05:18:45.269 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T05:18:45.269 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T05:18:45.269 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.0 2024-08-31T05:18:45.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:45.269 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-08-31T05:18:45.322 INFO:teuthology.orchestra.run.smithi067.stdout:133 2024-08-31T05:18:45.322 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [133] 2024-08-31T05:18:45.322 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-08-31T05:18:45.322 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-08-31T05:18:45.322 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-08-31T05:18:45.323 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-31T05:18:45.324 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-31T05:18:45.324 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-31T05:18:45.324 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-08-31T05:18:45.324 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-08-31T05:18:45.324 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-08-31T05:18:45.324 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-31T05:18:45.324 DEBUG:teuthology.orchestra.run.smithi067:> 2024-08-31T05:18:45.324 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.0")) 2024-08-31T05:18:45.324 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-08-31T05:18:45.442 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.0.64465.asok 2024-08-31T05:18:45.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:18:45.452 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.64465.asok 2024-08-31T05:18:45.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:45.453 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.64465.asok status 2024-08-31T05:18:45.587 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:18:45.587 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-08-31T05:18:45.588 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "244a32d3583bb0aa259286ff61157888a54a3ca5", 2024-08-31T05:18:45.588 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)", 2024-08-31T05:18:45.588 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "0", 2024-08-31T05:18:45.588 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-08-31T05:18:45.588 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-31T05:18:45.588 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "64465", 2024-08-31T05:18:45.588 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-08-31T05:18:45.588 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:18:45.588 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-08-31T05:18:45.588 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-08-31T05:18:45.588 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 14600, 2024-08-31T05:18:45.588 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-08-31T05:18:45.589 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-08-31T05:18:45.589 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-08-31T05:18:45.589 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 14600 2024-08-31T05:18:45.589 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:18:45.589 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-08-31T05:18:45.589 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-08-31T05:18:45.589 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-08-31T05:18:45.589 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3622886171 2024-08-31T05:18:45.589 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:18:45.589 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:18:45.589 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-08-31T05:18:45.589 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-08-31T05:18:45.589 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-08-31T05:18:45.590 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3622886171 2024-08-31T05:18:45.590 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:18:45.590 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.14600 192.168.0.1:0/3622886171", 2024-08-31T05:18:45.590 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/3622886171", 2024-08-31T05:18:45.590 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-08-31T05:18:45.590 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 13, 2024-08-31T05:18:45.590 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 45, 2024-08-31T05:18:45.590 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-08-31T05:18:45.590 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-08-31T05:18:45.590 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-08-31T05:18:45.590 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:18:45.596 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-31T05:18:45.596 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs ls 2024-08-31T05:18:45.844 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.273+0000 7fd53090f640 1 -- 172.21.15.67:0/3367698568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c0ffc80 msgr2=0x7fd52c1000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.273+0000 7fd53090f640 1 --2- 172.21.15.67:0/3367698568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c0ffc80 0x7fd52c1000e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd520009880 tx=0x7fd52002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.273+0000 7fd53090f640 1 -- 172.21.15.67:0/3367698568 shutdown_connections 2024-08-31T05:18:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.273+0000 7fd53090f640 1 --2- 172.21.15.67:0/3367698568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c0ffc80 0x7fd52c1000e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.273+0000 7fd53090f640 1 --2- 172.21.15.67:0/3367698568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd52c107790 0x7fd52c107b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.273+0000 7fd53090f640 1 -- 172.21.15.67:0/3367698568 >> 172.21.15.67:0/3367698568 conn(0x7fd52c0fba30 msgr2=0x7fd52c0fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.273+0000 7fd53090f640 1 -- 172.21.15.67:0/3367698568 shutdown_connections 2024-08-31T05:18:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.273+0000 7fd53090f640 1 -- 172.21.15.67:0/3367698568 wait complete. 2024-08-31T05:18:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.274+0000 7fd53090f640 1 Processor -- start 2024-08-31T05:18:46.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.274+0000 7fd53090f640 1 -- start start 2024-08-31T05:18:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.274+0000 7fd53090f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c0ffc80 0x7fd52c19f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.274+0000 7fd53090f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd52c107790 0x7fd52c19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.274+0000 7fd53090f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c10ec60 con 0x7fd52c0ffc80 2024-08-31T05:18:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.274+0000 7fd53090f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c10eae0 con 0x7fd52c107790 2024-08-31T05:18:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.275+0000 7fd52a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c0ffc80 0x7fd52c19f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.275+0000 7fd52a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c0ffc80 0x7fd52c19f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46538/0 (socket says 172.21.15.67:46538) 2024-08-31T05:18:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.275+0000 7fd52a59c640 1 -- 172.21.15.67:0/515728426 learned_addr learned my addr 172.21.15.67:0/515728426 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.275+0000 7fd529d9b640 1 --2- 172.21.15.67:0/515728426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd52c107790 0x7fd52c19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.275+0000 7fd52a59c640 1 -- 172.21.15.67:0/515728426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd52c107790 msgr2=0x7fd52c19fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.275+0000 7fd52a59c640 1 --2- 172.21.15.67:0/515728426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd52c107790 0x7fd52c19fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.275+0000 7fd52a59c640 1 -- 172.21.15.67:0/515728426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd52c199880 con 0x7fd52c0ffc80 2024-08-31T05:18:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.275+0000 7fd529d9b640 1 --2- 172.21.15.67:0/515728426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd52c107790 0x7fd52c19fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:18:46.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.275+0000 7fd52a59c640 1 --2- 172.21.15.67:0/515728426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c0ffc80 0x7fd52c19f6c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00d6f0 tx=0x7fd51c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:46.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.275+0000 7fd51b7fe640 1 -- 172.21.15.67:0/515728426 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd51c017070 con 0x7fd52c0ffc80 2024-08-31T05:18:46.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.275+0000 7fd53090f640 1 -- 172.21.15.67:0/515728426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd52c199b70 con 0x7fd52c0ffc80 2024-08-31T05:18:46.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.275+0000 7fd51b7fe640 1 -- 172.21.15.67:0/515728426 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd51c00de00 con 0x7fd52c0ffc80 2024-08-31T05:18:46.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.275+0000 7fd51b7fe640 1 -- 172.21.15.67:0/515728426 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd51c004bb0 con 0x7fd52c0ffc80 2024-08-31T05:18:46.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.276+0000 7fd53090f640 1 -- 172.21.15.67:0/515728426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd52c19a100 con 0x7fd52c0ffc80 2024-08-31T05:18:46.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.276+0000 7fd53090f640 1 -- 172.21.15.67:0/515728426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd52c102fa0 con 0x7fd52c0ffc80 2024-08-31T05:18:46.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.277+0000 7fd51b7fe640 1 -- 172.21.15.67:0/515728426 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fd51c004e60 con 0x7fd52c0ffc80 2024-08-31T05:18:46.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.278+0000 7fd51b7fe640 1 --2- 172.21.15.67:0/515728426 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd51406de30 0x7fd5140702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:46.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.278+0000 7fd51b7fe640 1 -- 172.21.15.67:0/515728426 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fd51c08db90 con 0x7fd52c0ffc80 2024-08-31T05:18:46.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.278+0000 7fd529d9b640 1 --2- 172.21.15.67:0/515728426 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd51406de30 0x7fd5140702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:46.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.278+0000 7fd529d9b640 1 --2- 172.21.15.67:0/515728426 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd51406de30 0x7fd5140702f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd520031460 tx=0x7fd5200095f0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:46.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.282+0000 7fd51b7fe640 1 -- 172.21.15.67:0/515728426 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd51c05b850 con 0x7fd52c0ffc80 2024-08-31T05:18:46.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.494+0000 7fd53090f640 1 -- 172.21.15.67:0/515728426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd52c19ae80 con 0x7fd52c0ffc80 2024-08-31T05:18:46.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.494+0000 7fd51b7fe640 1 -- 172.21.15.67:0/515728426 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+83 (secure 0 0 0) 0x7fd51c05f500 con 0x7fd52c0ffc80 2024-08-31T05:18:46.496 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-08-31T05:18:46.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.496+0000 7fd53090f640 1 -- 172.21.15.67:0/515728426 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd51406de30 msgr2=0x7fd5140702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:46.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.496+0000 7fd53090f640 1 --2- 172.21.15.67:0/515728426 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd51406de30 0x7fd5140702f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd520031460 tx=0x7fd5200095f0 comp rx=0 tx=0).stop 2024-08-31T05:18:46.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.496+0000 7fd53090f640 1 -- 172.21.15.67:0/515728426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c0ffc80 msgr2=0x7fd52c19f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:46.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.496+0000 7fd53090f640 1 --2- 172.21.15.67:0/515728426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c0ffc80 0x7fd52c19f6c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00d6f0 tx=0x7fd51c00dbb0 comp rx=0 tx=0).stop 2024-08-31T05:18:46.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.496+0000 7fd53090f640 1 -- 172.21.15.67:0/515728426 shutdown_connections 2024-08-31T05:18:46.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.496+0000 7fd53090f640 1 --2- 172.21.15.67:0/515728426 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fd51406de30 0x7fd5140702f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:46.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.496+0000 7fd53090f640 1 --2- 172.21.15.67:0/515728426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd52c107790 0x7fd52c19fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:46.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.496+0000 7fd53090f640 1 --2- 172.21.15.67:0/515728426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd52c0ffc80 0x7fd52c19f6c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:46.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.496+0000 7fd53090f640 1 -- 172.21.15.67:0/515728426 >> 172.21.15.67:0/515728426 conn(0x7fd52c0fba30 msgr2=0x7fd52c100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:46.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.497+0000 7fd53090f640 1 -- 172.21.15.67:0/515728426 shutdown_connections 2024-08-31T05:18:46.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:46.497+0000 7fd53090f640 1 -- 172.21.15.67:0/515728426 wait complete. 2024-08-31T05:18:46.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:46 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:46.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:46 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:46.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:46 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:46.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:46 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:18:46.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:46 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:46.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:46 smithi067 ceph-mon[17432]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-08-31T05:18:46.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:46 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:46.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:46 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:46.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:46 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:46.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:46 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:18:46.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:46 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:18:46.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:46 smithi073 ceph-mon[24726]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-08-31T05:18:47.039 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-31T05:18:47.040 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-31T05:18:47.040 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-08-31T05:18:47.040 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-31T05:18:47.040 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-31T05:18:47.040 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-31T05:18:47.040 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-31T05:18:47.040 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-31T05:18:47.040 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-31T05:18:47.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:47.040 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-08-31T05:18:47.060 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-31T05:18:47.060 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-31T05:18:47.060 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-08-31T05:18:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-08-31T05:18:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-08-31T05:18:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-08-31T05:18:47.061 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T05:18:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-08-31T05:18:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-08-31T05:18:47.061 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T05:18:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-08-31T05:18:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-08-31T05:18:47.061 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T05:18:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-08-31T05:18:47.061 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-31T05:18:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-08-31T05:18:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-31T05:18:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42404sec preferred_lft 42404sec 2024-08-31T05:18:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link noprefixroute 2024-08-31T05:18:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-08-31T05:18:47.062 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-31T05:18:47.062 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:18:47.062 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-08-31T05:18:47.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-08-31T05:18:47.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-08-31T05:18:47.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-08-31T05:18:47.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-31T05:18:47.063 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-08-31T05:18:47.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:18:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:18:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:18:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:18:47.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:47.276 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-31T05:18:47.302 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-08-31T05:18:47.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:47.304 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-08-31T05:18:47.378 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-08-31T05:18:47.378 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-31T05:18:47.378 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-31T05:18:47.378 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-31T05:18:47.378 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-31T05:18:47.379 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:18:47.379 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-08-31T05:18:47.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-31T05:18:47.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-31T05:18:47.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-31T05:18:47.379 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-08-31T05:18:47.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:47 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/515728426' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-31T05:18:47.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:18:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:18:47.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:47 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/515728426' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-31T05:18:47.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:18:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:18:47.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:47.643 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-08-31T05:18:47.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:47.700 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-08-31T05:18:47.755 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:18:47.755 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-08-31T05:18:47.755 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-31T05:18:47.755 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-31T05:18:47.755 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-08-31T05:18:47.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:18:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:18:47.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:18:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:18:47.871 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-31T05:18:47.871 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:18:47.871 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-08-31T05:18:47.871 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-31T05:18:47.871 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-31T05:18:47.872 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-31T05:18:47.872 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-31T05:18:47.872 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-31T05:18:47.872 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-08-31T05:18:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:18:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:18:48.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:18:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:18:48.021 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:18:48.022 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-08-31T05:18:48.022 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-08-31T05:18:48.022 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-08-31T05:18:48.022 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-08-31T05:18:48.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:18:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:18:48.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:18:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:18:48.099 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-31T05:18:48.099 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T05:18:48.099 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-31T05:18:48.114 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-31T05:18:48.114 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T05:18:48.114 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-31T05:18:48.169 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-08-31T05:18:48.234 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T05:18:48.290 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-08-31T05:18:48.290 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-08-31T05:18:48.291 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-08-31T05:18:48.291 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-08-31T05:18:48.291 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-08-31T05:18:48.291 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-08-31T05:18:48.291 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-08-31T05:18:48.291 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-08-31T05:18:48.291 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-08-31T05:18:48.291 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-08-31T05:18:48.291 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-08-31T05:18:48.291 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/selinux 2024-08-31T05:18:48.291 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:18:48.291 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-08-31T05:18:48.292 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-08-31T05:18:48.292 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-08-31T05:18:48.292 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-08-31T05:18:48.292 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-08-31T05:18:48.292 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T05:18:48.292 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-08-31T05:18:48.292 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T05:18:48.292 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T05:18:48.292 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T05:18:48.292 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T05:18:48.292 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-08-31T05:18:48.292 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-08-31T05:18:48.293 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/0 2024-08-31T05:18:48.293 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:18:48.293 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay 2024-08-31T05:18:48.293 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/249294edf961f58bb1fc47a00b7f3b48d6d5fa0a4fcafa1e5c2a6e7dfe5237f4/merged 2024-08-31T05:18:48.293 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/5ececc7c679f2782db2b721f314ef42c6ca6f356bc2ef1f32737483dcb1c915b/merged 2024-08-31T05:18:48.293 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/ecb76ef66d06882f6514797793f9ed05219ca322283a53ca2716bd3b1057b758/merged 2024-08-31T05:18:48.293 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/a2d2112b49549d2662af75d02532a07405ee719d28adbd5379b97d9b83f0e16a/merged 2024-08-31T05:18:48.293 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/e260f0ac993e3b5e3ce7add36b751defefd1ee61e27acd9999ac103f4386b0b2/merged 2024-08-31T05:18:48.293 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/69b918d96bed2a50edf67a2ad26c6f6bafe48c80c29c99417201ba6ff486c2f3/merged 2024-08-31T05:18:48.293 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/e84e200992da95fdc503cb3898dc28d50418250f9423cae63f5bf83ec86ea319/merged 2024-08-31T05:18:48.293 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/59ba5e2a6aff9ad8329aab721ce7ab453d7ecfff5375df421a3477455d740cd6/merged 2024-08-31T05:18:48.293 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/0616b5ff850ed781ac6b68763760668f97ece79a8c398414129fb0bf3122e76b/merged 2024-08-31T05:18:48.293 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/3971cf0b4d48ffe4230809d3ee3d0dec3e8c542070b46dc61ace399be9ff6687/merged 2024-08-31T05:18:48.293 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-08-31T05:18:48.294 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-31T05:18:48.294 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-31T05:18:48.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:48.294 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-08-31T05:18:48.346 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-31T05:18:48.346 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-31T05:18:48.388 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-08-31T05:18:48.411 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T05:18:48.467 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-08-31T05:18:48.467 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-08-31T05:18:48.467 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-08-31T05:18:48.467 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-08-31T05:18:48.467 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-08-31T05:18:48.467 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-08-31T05:18:48.467 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-08-31T05:18:48.467 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-08-31T05:18:48.467 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-08-31T05:18:48.468 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-08-31T05:18:48.468 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-08-31T05:18:48.468 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/selinux 2024-08-31T05:18:48.468 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:18:48.468 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-08-31T05:18:48.468 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-08-31T05:18:48.468 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-08-31T05:18:48.468 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-08-31T05:18:48.468 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-08-31T05:18:48.468 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T05:18:48.468 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-08-31T05:18:48.468 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T05:18:48.468 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T05:18:48.468 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/0 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/249294edf961f58bb1fc47a00b7f3b48d6d5fa0a4fcafa1e5c2a6e7dfe5237f4/merged 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/5ececc7c679f2782db2b721f314ef42c6ca6f356bc2ef1f32737483dcb1c915b/merged 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/ecb76ef66d06882f6514797793f9ed05219ca322283a53ca2716bd3b1057b758/merged 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/a2d2112b49549d2662af75d02532a07405ee719d28adbd5379b97d9b83f0e16a/merged 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/e260f0ac993e3b5e3ce7add36b751defefd1ee61e27acd9999ac103f4386b0b2/merged 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/69b918d96bed2a50edf67a2ad26c6f6bafe48c80c29c99417201ba6ff486c2f3/merged 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/e84e200992da95fdc503cb3898dc28d50418250f9423cae63f5bf83ec86ea319/merged 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/59ba5e2a6aff9ad8329aab721ce7ab453d7ecfff5375df421a3477455d740cd6/merged 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/0616b5ff850ed781ac6b68763760668f97ece79a8c398414129fb0bf3122e76b/merged 2024-08-31T05:18:48.469 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/containers/storage/overlay/3971cf0b4d48ffe4230809d3ee3d0dec3e8c542070b46dc61ace399be9ff6687/merged 2024-08-31T05:18:48.470 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-08-31T05:18:48.470 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-31T05:18:48.470 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-31T05:18:48.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:48.471 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-08-31T05:18:48.481 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi073.stderr:2024-08-31T05:18:48.479+0000 7f65bf3ef480 -1 init, newargv = 0x55955303f200 newargc=15 2024-08-31T05:18:48.481 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi073.stderr:ceph-fuse[50890]: starting ceph client 2024-08-31T05:18:48.485 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi073.stderr:ceph-fuse[50890]: starting fuse 2024-08-31T05:18:48.496 INFO:teuthology.orchestra.run.smithi073.stdout:130 2024-08-31T05:18:48.496 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [130] 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo stdin-killer -- python3 -c ' 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-08-31T05:18:48.497 DEBUG:teuthology.orchestra.run.smithi073:> 2024-08-31T05:18:48.498 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-08-31T05:18:48.498 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-31T05:18:48.498 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-31T05:18:48.498 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-31T05:18:48.498 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-08-31T05:18:48.498 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-08-31T05:18:48.498 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-08-31T05:18:48.498 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-31T05:18:48.498 DEBUG:teuthology.orchestra.run.smithi073:> 2024-08-31T05:18:48.498 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.1")) 2024-08-31T05:18:48.498 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-08-31T05:18:48.557 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:48 smithi073 ceph-mon[24726]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T05:18:48.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:48 smithi067 ceph-mon[17432]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T05:18:48.613 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.1.50890.asok 2024-08-31T05:18:48.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-08-31T05:18:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:18:48.623 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.50890.asok 2024-08-31T05:18:48.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:48.624 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.50890.asok status 2024-08-31T05:18:48.756 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-08-31T05:18:48.757 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-08-31T05:18:48.757 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "244a32d3583bb0aa259286ff61157888a54a3ca5", 2024-08-31T05:18:48.757 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)", 2024-08-31T05:18:48.757 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "1", 2024-08-31T05:18:48.757 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-08-31T05:18:48.757 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-31T05:18:48.757 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "50890", 2024-08-31T05:18:48.757 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-08-31T05:18:48.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-08-31T05:18:48.757 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-08-31T05:18:48.757 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-08-31T05:18:48.757 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24329, 2024-08-31T05:18:48.757 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-08-31T05:18:48.757 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-08-31T05:18:48.758 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-08-31T05:18:48.758 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 24329 2024-08-31T05:18:48.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-08-31T05:18:48.758 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-08-31T05:18:48.758 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-08-31T05:18:48.758 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-08-31T05:18:48.758 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1177961946 2024-08-31T05:18:48.758 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-08-31T05:18:48.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-08-31T05:18:48.758 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-08-31T05:18:48.758 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-08-31T05:18:48.758 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-08-31T05:18:48.758 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1177961946 2024-08-31T05:18:48.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-08-31T05:18:48.759 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.24329 192.168.0.1:0/1177961946", 2024-08-31T05:18:48.759 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/1177961946", 2024-08-31T05:18:48.759 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-08-31T05:18:48.759 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 13, 2024-08-31T05:18:48.759 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 45, 2024-08-31T05:18:48.759 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-08-31T05:18:48.759 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-08-31T05:18:48.759 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-08-31T05:18:48.759 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-08-31T05:18:48.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:48.765 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-08-31T05:18:48.765 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-31T05:18:48.783 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-08-31T05:18:48.783 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-31T05:18:48.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:48.783 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-31T05:18:48.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:48.853 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-08-31T05:18:48.853 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-31T05:18:48.869 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-08-31T05:18:48.870 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-31T05:18:48.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:18:48.870 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-31T05:18:48.941 INFO:teuthology.run_tasks:Running task print... 2024-08-31T05:18:48.951 INFO:teuthology.task.print:**** done client 2024-08-31T05:18:48.951 INFO:teuthology.run_tasks:Running task parallel... 2024-08-31T05:18:48.991 INFO:teuthology.task.parallel:starting parallel... 2024-08-31T05:18:48.992 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-08-31T05:18:49.002 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-08-31T05:18:49.002 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2024-08-31T05:18:49.002 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-08-31T05:18:49.003 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-08-31T05:18:49.003 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-08-31T05:18:49.008 INFO:tasks.workunit:Pulling workunits from ref d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:18:49.008 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-31T05:18:49.008 INFO:tasks.workunit:timeout=3h 2024-08-31T05:18:49.008 INFO:tasks.workunit:cleanup=True 2024-08-31T05:18:49.008 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-31T05:18:49.026 INFO:teuthology.orchestra.run.smithi067.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-31T05:18:49.026 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-08-31T05:18:49.026 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 85h/133d Inode: 1 Links: 2 2024-08-31T05:18:49.026 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:18:49.026 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:fusefs_t:s0 2024-08-31T05:18:49.026 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-08-31T05:18:49.026 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-08-31 05:18:23.420802361 +0000 2024-08-31T05:18:49.026 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-08-31 05:18:48.849751804 +0000 2024-08-31T05:18:49.026 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2024-08-31T05:18:49.026 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-31T05:18:49.027 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-31T05:18:49.095 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.1 2024-08-31T05:18:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-08-31T05:18:49.111 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-08-31T05:18:49.111 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 82h/130d Inode: 1 Links: 3 2024-08-31T05:18:49.111 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:18:49.112 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:fusefs_t:s0 2024-08-31T05:18:49.112 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-08-31T05:18:49.112 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-08-31 05:18:49.089651057 +0000 2024-08-31T05:18:49.112 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-08-31 05:18:49.089651057 +0000 2024-08-31T05:18:49.112 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-08-31T05:18:49.112 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-08-31T05:18:49.112 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-08-31T05:18:49.181 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:18:49.182 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:18:49.198 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-31T05:18:49.238 INFO:tasks.workunit.client.1.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-08-31T05:18:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:49.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.770+0000 7fec298a9640 1 -- 172.21.15.67:0/3786991204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec24101800 msgr2=0x7fec24101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:49.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.770+0000 7fec298a9640 1 --2- 172.21.15.67:0/3786991204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec24101800 0x7fec24101c80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009880 tx=0x7fec0c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:49.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.770+0000 7fec298a9640 1 -- 172.21.15.67:0/3786991204 shutdown_connections 2024-08-31T05:18:49.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.770+0000 7fec298a9640 1 --2- 172.21.15.67:0/3786991204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec24101800 0x7fec24101c80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:49.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.770+0000 7fec298a9640 1 --2- 172.21.15.67:0/3786991204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec24100600 0x7fec24100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:49.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.770+0000 7fec298a9640 1 -- 172.21.15.67:0/3786991204 >> 172.21.15.67:0/3786991204 conn(0x7fec240fbdb0 msgr2=0x7fec240fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:49.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.770+0000 7fec298a9640 1 -- 172.21.15.67:0/3786991204 shutdown_connections 2024-08-31T05:18:49.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.770+0000 7fec298a9640 1 -- 172.21.15.67:0/3786991204 wait complete. 2024-08-31T05:18:49.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.770+0000 7fec298a9640 1 Processor -- start 2024-08-31T05:18:49.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.771+0000 7fec298a9640 1 -- start start 2024-08-31T05:18:49.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.771+0000 7fec298a9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec24100600 0x7fec24104520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:49.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.771+0000 7fec298a9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec24101800 0x7fec24102be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:49.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.771+0000 7fec298a9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fec24109420 con 0x7fec24100600 2024-08-31T05:18:49.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.771+0000 7fec298a9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fec241092a0 con 0x7fec24101800 2024-08-31T05:18:49.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.771+0000 7fec22ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec24100600 0x7fec24104520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:49.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.771+0000 7fec22ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec24100600 0x7fec24104520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52722/0 (socket says 172.21.15.67:52722) 2024-08-31T05:18:49.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.771+0000 7fec22ffd640 1 -- 172.21.15.67:0/3395946545 learned_addr learned my addr 172.21.15.67:0/3395946545 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:49.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.771+0000 7fec227fc640 1 --2- 172.21.15.67:0/3395946545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec24101800 0x7fec24102be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:49.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.771+0000 7fec22ffd640 1 -- 172.21.15.67:0/3395946545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec24101800 msgr2=0x7fec24102be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:49.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.771+0000 7fec22ffd640 1 --2- 172.21.15.67:0/3395946545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec24101800 0x7fec24102be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:49.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.771+0000 7fec22ffd640 1 -- 172.21.15.67:0/3395946545 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec24103120 con 0x7fec24100600 2024-08-31T05:18:49.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.771+0000 7fec227fc640 1 --2- 172.21.15.67:0/3395946545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec24101800 0x7fec24102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:18:49.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.771+0000 7fec22ffd640 1 --2- 172.21.15.67:0/3395946545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec24100600 0x7fec24104520 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fec1400c8f0 tx=0x7fec1400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:49.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.772+0000 7fec288a7640 1 -- 172.21.15.67:0/3395946545 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec14004020 con 0x7fec24100600 2024-08-31T05:18:49.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.772+0000 7fec288a7640 1 -- 172.21.15.67:0/3395946545 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fec14007e10 con 0x7fec24100600 2024-08-31T05:18:49.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.772+0000 7fec298a9640 1 -- 172.21.15.67:0/3395946545 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec24103410 con 0x7fec24100600 2024-08-31T05:18:49.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.772+0000 7fec288a7640 1 -- 172.21.15.67:0/3395946545 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec14003e10 con 0x7fec24100600 2024-08-31T05:18:49.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.772+0000 7fec298a9640 1 -- 172.21.15.67:0/3395946545 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec241039a0 con 0x7fec24100600 2024-08-31T05:18:49.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.773+0000 7fec298a9640 1 -- 172.21.15.67:0/3395946545 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec24100a00 con 0x7fec24100600 2024-08-31T05:18:49.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.773+0000 7fec288a7640 1 -- 172.21.15.67:0/3395946545 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fec140041c0 con 0x7fec24100600 2024-08-31T05:18:49.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.774+0000 7fec288a7640 1 --2- 172.21.15.67:0/3395946545 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fec1006de30 0x7fec100702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:49.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.774+0000 7fec288a7640 1 -- 172.21.15.67:0/3395946545 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fec1408dd10 con 0x7fec24100600 2024-08-31T05:18:49.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.774+0000 7fec227fc640 1 --2- 172.21.15.67:0/3395946545 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fec1006de30 0x7fec100702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:49.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.774+0000 7fec227fc640 1 --2- 172.21.15.67:0/3395946545 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fec1006de30 0x7fec100702f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec241042a0 tx=0x7fec0c005a20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:49.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.778+0000 7fec288a7640 1 -- 172.21.15.67:0/3395946545 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec14015330 con 0x7fec24100600 2024-08-31T05:18:49.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.953+0000 7fec298a9640 1 -- 172.21.15.67:0/3395946545 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7fec2419f2c0 con 0x7fec24100600 2024-08-31T05:18:49.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.954+0000 7fec288a7640 1 -- 172.21.15.67:0/3395946545 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v43)=0 v43) ==== 155+0+0 (secure 0 0 0) 0x7fec1405b8b0 con 0x7fec24100600 2024-08-31T05:18:49.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.956+0000 7fec298a9640 1 -- 172.21.15.67:0/3395946545 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fec1006de30 msgr2=0x7fec100702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:49.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.956+0000 7fec298a9640 1 --2- 172.21.15.67:0/3395946545 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fec1006de30 0x7fec100702f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec241042a0 tx=0x7fec0c005a20 comp rx=0 tx=0).stop 2024-08-31T05:18:49.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.956+0000 7fec298a9640 1 -- 172.21.15.67:0/3395946545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec24100600 msgr2=0x7fec24104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:49.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.956+0000 7fec298a9640 1 --2- 172.21.15.67:0/3395946545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec24100600 0x7fec24104520 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fec1400c8f0 tx=0x7fec1400cdb0 comp rx=0 tx=0).stop 2024-08-31T05:18:49.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.956+0000 7fec298a9640 1 -- 172.21.15.67:0/3395946545 shutdown_connections 2024-08-31T05:18:49.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.956+0000 7fec298a9640 1 --2- 172.21.15.67:0/3395946545 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fec1006de30 0x7fec100702f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:49.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.956+0000 7fec298a9640 1 --2- 172.21.15.67:0/3395946545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec24101800 0x7fec24102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:49.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.956+0000 7fec298a9640 1 --2- 172.21.15.67:0/3395946545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec24100600 0x7fec24104520 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:49.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.956+0000 7fec298a9640 1 -- 172.21.15.67:0/3395946545 >> 172.21.15.67:0/3395946545 conn(0x7fec240fbdb0 msgr2=0x7fec24069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:49.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.957+0000 7fec298a9640 1 -- 172.21.15.67:0/3395946545 shutdown_connections 2024-08-31T05:18:49.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:49.957+0000 7fec298a9640 1 -- 172.21.15.67:0/3395946545 wait complete. 2024-08-31T05:18:50.655 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:50 smithi067 ceph-mon[17432]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-08-31T05:18:50.684 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-08-31T05:18:50.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:50 smithi073 ceph-mon[24726]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-08-31T05:18:50.980 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:51.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.412+0000 7f63d62f4640 1 -- 172.21.15.67:0/749211309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63d0101800 msgr2=0x7f63d0101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:51.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.412+0000 7f63d62f4640 1 --2- 172.21.15.67:0/749211309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63d0101800 0x7f63d0101c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009880 tx=0x7f63b802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:51.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.412+0000 7f63d62f4640 1 -- 172.21.15.67:0/749211309 shutdown_connections 2024-08-31T05:18:51.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.412+0000 7f63d62f4640 1 --2- 172.21.15.67:0/749211309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63d0101800 0x7f63d0101c80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:51.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.412+0000 7f63d62f4640 1 --2- 172.21.15.67:0/749211309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63d0100600 0x7f63d0100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:51.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.412+0000 7f63d62f4640 1 -- 172.21.15.67:0/749211309 >> 172.21.15.67:0/749211309 conn(0x7f63d00fbdb0 msgr2=0x7f63d00fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.412+0000 7f63d62f4640 1 -- 172.21.15.67:0/749211309 shutdown_connections 2024-08-31T05:18:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.412+0000 7f63d62f4640 1 -- 172.21.15.67:0/749211309 wait complete. 2024-08-31T05:18:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.412+0000 7f63d62f4640 1 Processor -- start 2024-08-31T05:18:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.412+0000 7f63d62f4640 1 -- start start 2024-08-31T05:18:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.412+0000 7f63d62f4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63d0100600 0x7f63d0197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.412+0000 7f63d62f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63d0101800 0x7f63d0197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63d62f4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f63d0109440 con 0x7f63d0100600 2024-08-31T05:18:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63d62f4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f63d01092c0 con 0x7f63d0101800 2024-08-31T05:18:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63cffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63d0100600 0x7f63d0197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63cffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63d0100600 0x7f63d0197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52738/0 (socket says 172.21.15.67:52738) 2024-08-31T05:18:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63cffff640 1 -- 172.21.15.67:0/4285251364 learned_addr learned my addr 172.21.15.67:0/4285251364 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63c7fff640 1 --2- 172.21.15.67:0/4285251364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63d0101800 0x7f63d0197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63cffff640 1 -- 172.21.15.67:0/4285251364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63d0101800 msgr2=0x7f63d0197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63cffff640 1 --2- 172.21.15.67:0/4285251364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63d0101800 0x7f63d0197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63cffff640 1 -- 172.21.15.67:0/4285251364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d0197ed0 con 0x7f63d0100600 2024-08-31T05:18:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63c7fff640 1 --2- 172.21.15.67:0/4285251364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63d0101800 0x7f63d0197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:18:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63cffff640 1 --2- 172.21.15.67:0/4285251364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63d0100600 0x7f63d0197310 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f63c000d8d0 tx=0x7f63c000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63cdffb640 1 -- 172.21.15.67:0/4285251364 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f63c0017070 con 0x7f63d0100600 2024-08-31T05:18:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63cdffb640 1 -- 172.21.15.67:0/4285251364 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63c000be10 con 0x7f63d0100600 2024-08-31T05:18:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63d62f4640 1 -- 172.21.15.67:0/4285251364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d019c910 con 0x7f63d0100600 2024-08-31T05:18:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63cdffb640 1 -- 172.21.15.67:0/4285251364 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f63c000f3c0 con 0x7f63d0100600 2024-08-31T05:18:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.413+0000 7f63d62f4640 1 -- 172.21.15.67:0/4285251364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d019ce70 con 0x7f63d0100600 2024-08-31T05:18:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.414+0000 7f63d62f4640 1 -- 172.21.15.67:0/4285251364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d0109c20 con 0x7f63d0100600 2024-08-31T05:18:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.415+0000 7f63cdffb640 1 -- 172.21.15.67:0/4285251364 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f63c001a070 con 0x7f63d0100600 2024-08-31T05:18:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.415+0000 7f63cdffb640 1 --2- 172.21.15.67:0/4285251364 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f63bc06de90 0x7f63bc070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:51.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.415+0000 7f63cdffb640 1 -- 172.21.15.67:0/4285251364 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f63c008d6c0 con 0x7f63d0100600 2024-08-31T05:18:51.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.415+0000 7f63c7fff640 1 --2- 172.21.15.67:0/4285251364 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f63bc06de90 0x7f63bc070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:51.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.416+0000 7f63c7fff640 1 --2- 172.21.15.67:0/4285251364 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f63bc06de90 0x7f63bc070350 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f63b8004ee0 tx=0x7f63b8005a20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:51.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.420+0000 7f63cdffb640 1 -- 172.21.15.67:0/4285251364 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f63c005b2e0 con 0x7f63d0100600 2024-08-31T05:18:51.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.601+0000 7f63d62f4640 1 -- 172.21.15.67:0/4285251364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7f63d0100a00 con 0x7f63d0100600 2024-08-31T05:18:51.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.601+0000 7f63cdffb640 1 -- 172.21.15.67:0/4285251364 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v43)=0 v43) ==== 163+0+0 (secure 0 0 0) 0x7f63c005ef90 con 0x7f63d0100600 2024-08-31T05:18:51.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.603+0000 7f63d62f4640 1 -- 172.21.15.67:0/4285251364 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f63bc06de90 msgr2=0x7f63bc070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:51.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.603+0000 7f63d62f4640 1 --2- 172.21.15.67:0/4285251364 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f63bc06de90 0x7f63bc070350 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f63b8004ee0 tx=0x7f63b8005a20 comp rx=0 tx=0).stop 2024-08-31T05:18:51.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.603+0000 7f63d62f4640 1 -- 172.21.15.67:0/4285251364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63d0100600 msgr2=0x7f63d0197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.603+0000 7f63d62f4640 1 --2- 172.21.15.67:0/4285251364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63d0100600 0x7f63d0197310 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f63c000d8d0 tx=0x7f63c000dd90 comp rx=0 tx=0).stop 2024-08-31T05:18:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.604+0000 7f63d62f4640 1 -- 172.21.15.67:0/4285251364 shutdown_connections 2024-08-31T05:18:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.604+0000 7f63d62f4640 1 --2- 172.21.15.67:0/4285251364 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f63bc06de90 0x7f63bc070350 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.604+0000 7f63d62f4640 1 --2- 172.21.15.67:0/4285251364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63d0101800 0x7f63d0197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.604+0000 7f63d62f4640 1 --2- 172.21.15.67:0/4285251364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63d0100600 0x7f63d0197310 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.604+0000 7f63d62f4640 1 -- 172.21.15.67:0/4285251364 >> 172.21.15.67:0/4285251364 conn(0x7f63d00fbdb0 msgr2=0x7f63d0069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.604+0000 7f63d62f4640 1 -- 172.21.15.67:0/4285251364 shutdown_connections 2024-08-31T05:18:51.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:51.604+0000 7f63d62f4640 1 -- 172.21.15.67:0/4285251364 wait complete. 2024-08-31T05:18:52.236 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph config set global log_to_journald false --force' 2024-08-31T05:18:52.495 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:52.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:52 smithi067 ceph-mon[17432]: pgmap v188: 65 pgs: 65 active+clean; 585 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-08-31T05:18:52.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:52 smithi073 ceph-mon[24726]: pgmap v188: 65 pgs: 65 active+clean; 585 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-08-31T05:18:52.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.912+0000 7fb1d0748640 1 -- 172.21.15.67:0/2702495339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1c8100620 msgr2=0x7fb1c8100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:52.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.912+0000 7fb1d0748640 1 --2- 172.21.15.67:0/2702495339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1c8100620 0x7fb1c8100a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009880 tx=0x7fb1c402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:52.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.912+0000 7fb1d0748640 1 -- 172.21.15.67:0/2702495339 shutdown_connections 2024-08-31T05:18:52.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.912+0000 7fb1d0748640 1 --2- 172.21.15.67:0/2702495339 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c8101820 0x7fb1c8101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:52.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.912+0000 7fb1d0748640 1 --2- 172.21.15.67:0/2702495339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1c8100620 0x7fb1c8100a20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:52.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.912+0000 7fb1d0748640 1 -- 172.21.15.67:0/2702495339 >> 172.21.15.67:0/2702495339 conn(0x7fb1c80fbdb0 msgr2=0x7fb1c80fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:52.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.912+0000 7fb1d0748640 1 -- 172.21.15.67:0/2702495339 shutdown_connections 2024-08-31T05:18:52.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.912+0000 7fb1d0748640 1 -- 172.21.15.67:0/2702495339 wait complete. 2024-08-31T05:18:52.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.912+0000 7fb1d0748640 1 Processor -- start 2024-08-31T05:18:52.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.912+0000 7fb1d0748640 1 -- start start 2024-08-31T05:18:52.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1d0748640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1c8100620 0x7fb1c8197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:52.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1d0748640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c8101820 0x7fb1c8197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:52.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1d0748640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c8109440 con 0x7fb1c8100620 2024-08-31T05:18:52.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1d0748640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c81092c0 con 0x7fb1c8101820 2024-08-31T05:18:52.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1ce4e4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1c8100620 0x7fb1c8197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:52.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1ce4e4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1c8100620 0x7fb1c8197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52762/0 (socket says 172.21.15.67:52762) 2024-08-31T05:18:52.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1ce4e4640 1 -- 172.21.15.67:0/3816499429 learned_addr learned my addr 172.21.15.67:0/3816499429 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:52.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1cdce3640 1 --2- 172.21.15.67:0/3816499429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c8101820 0x7fb1c8197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:52.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1ce4e4640 1 -- 172.21.15.67:0/3816499429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c8101820 msgr2=0x7fb1c8197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:52.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1ce4e4640 1 --2- 172.21.15.67:0/3816499429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c8101820 0x7fb1c8197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:52.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1ce4e4640 1 -- 172.21.15.67:0/3816499429 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c8197f00 con 0x7fb1c8100620 2024-08-31T05:18:52.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1ce4e4640 1 --2- 172.21.15.67:0/3816499429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1c8100620 0x7fb1c8197340 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40048f0 tx=0x7fb1c4004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:52.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1bf7fe640 1 -- 172.21.15.67:0/3816499429 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1c403f070 con 0x7fb1c8100620 2024-08-31T05:18:52.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1bf7fe640 1 -- 172.21.15.67:0/3816499429 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb1c4003ab0 con 0x7fb1c8100620 2024-08-31T05:18:52.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1d0748640 1 -- 172.21.15.67:0/3816499429 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c819c8e0 con 0x7fb1c8100620 2024-08-31T05:18:52.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.913+0000 7fb1bf7fe640 1 -- 172.21.15.67:0/3816499429 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1c4035030 con 0x7fb1c8100620 2024-08-31T05:18:52.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.914+0000 7fb1d0748640 1 -- 172.21.15.67:0/3816499429 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c819ce70 con 0x7fb1c8100620 2024-08-31T05:18:52.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.914+0000 7fb1d0748640 1 -- 172.21.15.67:0/3816499429 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c8100a20 con 0x7fb1c8100620 2024-08-31T05:18:52.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.915+0000 7fb1bf7fe640 1 -- 172.21.15.67:0/3816499429 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fb1c4042070 con 0x7fb1c8100620 2024-08-31T05:18:52.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.915+0000 7fb1bf7fe640 1 --2- 172.21.15.67:0/3816499429 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb1b406de90 0x7fb1b4070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:52.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.916+0000 7fb1bf7fe640 1 -- 172.21.15.67:0/3816499429 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fb1c40ae6c0 con 0x7fb1c8100620 2024-08-31T05:18:52.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.916+0000 7fb1cdce3640 1 --2- 172.21.15.67:0/3816499429 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb1b406de90 0x7fb1b4070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:52.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.916+0000 7fb1cdce3640 1 --2- 172.21.15.67:0/3816499429 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb1b406de90 0x7fb1b4070350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb1c81987f0 tx=0x7fb1b800a2d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:52.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:52.920+0000 7fb1bf7fe640 1 -- 172.21.15.67:0/3816499429 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb1c407ff90 con 0x7fb1c8100620 2024-08-31T05:18:53.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:53.095+0000 7fb1d0748640 1 -- 172.21.15.67:0/3816499429 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7fb1c819d190 con 0x7fb1c8100620 2024-08-31T05:18:53.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:53.096+0000 7fb1bf7fe640 1 -- 172.21.15.67:0/3816499429 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v43)=0 v43) ==== 135+0+0 (secure 0 0 0) 0x7fb1c40847c0 con 0x7fb1c8100620 2024-08-31T05:18:53.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:53.098+0000 7fb1d0748640 1 -- 172.21.15.67:0/3816499429 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb1b406de90 msgr2=0x7fb1b4070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:53.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:53.098+0000 7fb1d0748640 1 --2- 172.21.15.67:0/3816499429 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb1b406de90 0x7fb1b4070350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb1c81987f0 tx=0x7fb1b800a2d0 comp rx=0 tx=0).stop 2024-08-31T05:18:53.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:53.098+0000 7fb1d0748640 1 -- 172.21.15.67:0/3816499429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1c8100620 msgr2=0x7fb1c8197340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:53.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:53.098+0000 7fb1d0748640 1 --2- 172.21.15.67:0/3816499429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1c8100620 0x7fb1c8197340 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40048f0 tx=0x7fb1c4004920 comp rx=0 tx=0).stop 2024-08-31T05:18:53.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:53.098+0000 7fb1d0748640 1 -- 172.21.15.67:0/3816499429 shutdown_connections 2024-08-31T05:18:53.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:53.098+0000 7fb1d0748640 1 --2- 172.21.15.67:0/3816499429 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fb1b406de90 0x7fb1b4070350 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:53.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:53.098+0000 7fb1d0748640 1 --2- 172.21.15.67:0/3816499429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c8101820 0x7fb1c8197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:53.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:53.098+0000 7fb1d0748640 1 --2- 172.21.15.67:0/3816499429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1c8100620 0x7fb1c8197340 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:53.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:53.098+0000 7fb1d0748640 1 -- 172.21.15.67:0/3816499429 >> 172.21.15.67:0/3816499429 conn(0x7fb1c80fbdb0 msgr2=0x7fb1c806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:53.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:53.098+0000 7fb1d0748640 1 -- 172.21.15.67:0/3816499429 shutdown_connections 2024-08-31T05:18:53.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:53.098+0000 7fb1d0748640 1 -- 172.21.15.67:0/3816499429 wait complete. 2024-08-31T05:18:53.742 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-08-31T05:18:53.994 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:18:54.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.487+0000 7fcffa4ba640 1 -- 172.21.15.67:0/3649947875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcff4102900 msgr2=0x7fcff4102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:54.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.487+0000 7fcffa4ba640 1 --2- 172.21.15.67:0/3649947875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcff4102900 0x7fcff4102d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009880 tx=0x7fcfdc02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:18:54.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.487+0000 7fcffa4ba640 1 -- 172.21.15.67:0/3649947875 shutdown_connections 2024-08-31T05:18:54.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.487+0000 7fcffa4ba640 1 --2- 172.21.15.67:0/3649947875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcff4102900 0x7fcff4102d80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:54.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.487+0000 7fcffa4ba640 1 --2- 172.21.15.67:0/3649947875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcff4101700 0x7fcff4101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:54.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.487+0000 7fcffa4ba640 1 -- 172.21.15.67:0/3649947875 >> 172.21.15.67:0/3649947875 conn(0x7fcff40fce90 msgr2=0x7fcff40ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:18:54.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.487+0000 7fcffa4ba640 1 -- 172.21.15.67:0/3649947875 shutdown_connections 2024-08-31T05:18:54.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.487+0000 7fcffa4ba640 1 -- 172.21.15.67:0/3649947875 wait complete. 2024-08-31T05:18:54.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.488+0000 7fcffa4ba640 1 Processor -- start 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.488+0000 7fcffa4ba640 1 -- start start 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.488+0000 7fcffa4ba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcff4101700 0x7fcff4197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.488+0000 7fcffa4ba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcff4102900 0x7fcff4197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.488+0000 7fcffa4ba640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcff410a520 con 0x7fcff4101700 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.488+0000 7fcffa4ba640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcff410a3a0 con 0x7fcff4102900 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.488+0000 7fcff3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcff4101700 0x7fcff4197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.488+0000 7fcff3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcff4101700 0x7fcff4197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52776/0 (socket says 172.21.15.67:52776) 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.488+0000 7fcff3fff640 1 -- 172.21.15.67:0/1707710369 learned_addr learned my addr 172.21.15.67:0/1707710369 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.488+0000 7fcff3fff640 1 -- 172.21.15.67:0/1707710369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcff4102900 msgr2=0x7fcff4197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.488+0000 7fcff3fff640 1 --2- 172.21.15.67:0/1707710369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcff4102900 0x7fcff4197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.488+0000 7fcff3fff640 1 -- 172.21.15.67:0/1707710369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff4197dd0 con 0x7fcff4101700 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.488+0000 7fcff3fff640 1 --2- 172.21.15.67:0/1707710369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcff4101700 0x7fcff4197210 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400d6f0 tx=0x7fcfe400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.489+0000 7fcff1ffb640 1 -- 172.21.15.67:0/1707710369 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcfe4017070 con 0x7fcff4101700 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.489+0000 7fcff1ffb640 1 -- 172.21.15.67:0/1707710369 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcfe400de00 con 0x7fcff4101700 2024-08-31T05:18:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.489+0000 7fcffa4ba640 1 -- 172.21.15.67:0/1707710369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff419c810 con 0x7fcff4101700 2024-08-31T05:18:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.489+0000 7fcff1ffb640 1 -- 172.21.15.67:0/1707710369 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcfe4003bc0 con 0x7fcff4101700 2024-08-31T05:18:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.489+0000 7fcffa4ba640 1 -- 172.21.15.67:0/1707710369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff419cda0 con 0x7fcff4101700 2024-08-31T05:18:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.490+0000 7fcffa4ba640 1 -- 172.21.15.67:0/1707710369 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff4101b00 con 0x7fcff4101700 2024-08-31T05:18:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.490+0000 7fcff1ffb640 1 -- 172.21.15.67:0/1707710369 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fcfe4003e70 con 0x7fcff4101700 2024-08-31T05:18:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.491+0000 7fcff1ffb640 1 --2- 172.21.15.67:0/1707710369 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fcfe006de30 0x7fcfe00702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:18:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.491+0000 7fcff1ffb640 1 -- 172.21.15.67:0/1707710369 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fcfe408d780 con 0x7fcff4101700 2024-08-31T05:18:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.491+0000 7fcfebfff640 1 --2- 172.21.15.67:0/1707710369 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fcfe006de30 0x7fcfe00702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:18:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.491+0000 7fcfebfff640 1 --2- 172.21.15.67:0/1707710369 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fcfe006de30 0x7fcfe00702f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0096c0 tx=0x7fcfdc000bc0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:18:54.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.495+0000 7fcff1ffb640 1 -- 172.21.15.67:0/1707710369 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcfe405b320 con 0x7fcff4101700 2024-08-31T05:18:54.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:18:54.687+0000 7fcffa4ba640 1 -- 172.21.15.67:0/1707710369 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) -- 0x7fcff40625f0 con 0x7fcfe006de30 2024-08-31T05:18:54.689 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:54 smithi067 ceph-mon[17432]: pgmap v189: 65 pgs: 65 active+clean; 585 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-08-31T05:18:54.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:54 smithi073 ceph-mon[24726]: pgmap v189: 65 pgs: 65 active+clean; 585 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-08-31T05:18:56.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:56 smithi073 ceph-mon[24726]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:56.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:56 smithi073 ceph-mon[24726]: pgmap v190: 65 pgs: 65 active+clean; 585 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-08-31T05:18:56.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:56 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:18:56.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:56 smithi067 ceph-mon[17432]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:56 smithi067 ceph-mon[17432]: pgmap v190: 65 pgs: 65 active+clean; 585 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-08-31T05:18:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:56 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:18:58.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:18:58 smithi067 ceph-mon[17432]: pgmap v191: 65 pgs: 65 active+clean; 585 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-08-31T05:18:58.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:18:58 smithi073 ceph-mon[24726]: pgmap v191: 65 pgs: 65 active+clean; 585 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-08-31T05:19:00.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:00 smithi073 ceph-mon[24726]: pgmap v192: 65 pgs: 65 active+clean; 585 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-08-31T05:19:00.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:00 smithi067 ceph-mon[17432]: pgmap v192: 65 pgs: 65 active+clean; 585 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-08-31T05:19:02.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:02 smithi073 ceph-mon[24726]: pgmap v193: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1023 B/s wr, 3 op/s 2024-08-31T05:19:02.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:02 smithi067 ceph-mon[17432]: pgmap v193: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1023 B/s wr, 3 op/s 2024-08-31T05:19:04.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:04 smithi073 ceph-mon[24726]: pgmap v194: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-08-31T05:19:04.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:04 smithi067 ceph-mon[17432]: pgmap v194: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-08-31T05:19:06.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:06 smithi073 ceph-mon[24726]: pgmap v195: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-08-31T05:19:06.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:06 smithi067 ceph-mon[17432]: pgmap v195: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-08-31T05:19:08.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:08 smithi067 ceph-mon[17432]: pgmap v196: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-08-31T05:19:08.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:08 smithi073 ceph-mon[24726]: pgmap v196: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-08-31T05:19:10.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:10 smithi073 ceph-mon[24726]: pgmap v197: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-08-31T05:19:10.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:10 smithi067 ceph-mon[17432]: pgmap v197: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-08-31T05:19:11.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:19:11.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:19:12.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:12 smithi073 ceph-mon[24726]: pgmap v198: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 341 B/s wr, 2 op/s 2024-08-31T05:19:12.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:12 smithi067 ceph-mon[17432]: pgmap v198: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 341 B/s wr, 2 op/s 2024-08-31T05:19:13.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:13 smithi073 ceph-mon[24726]: pgmap v199: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:13.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:13 smithi067 ceph-mon[17432]: pgmap v199: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:16.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:16 smithi073 ceph-mon[24726]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:16.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:16 smithi067 ceph-mon[17432]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:18.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:18 smithi073 ceph-mon[24726]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:18.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:18 smithi067 ceph-mon[17432]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:20.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:20 smithi073 ceph-mon[24726]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:20.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:20 smithi067 ceph-mon[17432]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:22.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:22 smithi073 ceph-mon[24726]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:22.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:22 smithi067 ceph-mon[17432]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:24.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:24 smithi073 ceph-mon[24726]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:24.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:24 smithi067 ceph-mon[17432]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:24.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:24.961+0000 7fcff1ffb640 1 -- 172.21.15.67:0/1707710369 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7fcff40625f0 con 0x7fcfe006de30 2024-08-31T05:19:24.963 INFO:teuthology.orchestra.run.smithi067.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:19:24.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:24.963+0000 7fcffa4ba640 1 -- 172.21.15.67:0/1707710369 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fcfe006de30 msgr2=0x7fcfe00702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:24.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:24.963+0000 7fcffa4ba640 1 --2- 172.21.15.67:0/1707710369 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fcfe006de30 0x7fcfe00702f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0096c0 tx=0x7fcfdc000bc0 comp rx=0 tx=0).stop 2024-08-31T05:19:24.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:24.964+0000 7fcffa4ba640 1 -- 172.21.15.67:0/1707710369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcff4101700 msgr2=0x7fcff4197210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:24.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:24.964+0000 7fcffa4ba640 1 --2- 172.21.15.67:0/1707710369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcff4101700 0x7fcff4197210 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400d6f0 tx=0x7fcfe400dbb0 comp rx=0 tx=0).stop 2024-08-31T05:19:24.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:24.964+0000 7fcffa4ba640 1 -- 172.21.15.67:0/1707710369 shutdown_connections 2024-08-31T05:19:24.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:24.964+0000 7fcffa4ba640 1 --2- 172.21.15.67:0/1707710369 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fcfe006de30 0x7fcfe00702f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:24.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:24.964+0000 7fcffa4ba640 1 --2- 172.21.15.67:0/1707710369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcff4102900 0x7fcff4197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:24.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:24.964+0000 7fcffa4ba640 1 --2- 172.21.15.67:0/1707710369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcff4101700 0x7fcff4197210 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:24.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:24.964+0000 7fcffa4ba640 1 -- 172.21.15.67:0/1707710369 >> 172.21.15.67:0/1707710369 conn(0x7fcff40fce90 msgr2=0x7fcff4105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:24.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:24.964+0000 7fcffa4ba640 1 -- 172.21.15.67:0/1707710369 shutdown_connections 2024-08-31T05:19:24.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:24.964+0000 7fcffa4ba640 1 -- 172.21.15.67:0/1707710369 wait complete. 2024-08-31T05:19:25.684 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-08-31T05:19:25.966 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:25 smithi067 ceph-mon[17432]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:19:25.967 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:25 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:19:25.967 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:25 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:19:25.967 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:25 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:19:25.967 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:25 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:19:25.967 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:25 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:19:25.967 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:25 smithi067 ceph-mon[17432]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:19:25.967 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:25 smithi067 ceph-mon[17432]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:25.995 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:19:26.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:25 smithi073 ceph-mon[24726]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:19:26.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:25 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:19:26.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:25 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:19:26.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:25 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:19:26.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:25 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:19:26.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:25 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:19:26.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:25 smithi073 ceph-mon[24726]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:19:26.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:25 smithi073 ceph-mon[24726]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:26.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.633+0000 7fe1b99b4640 1 -- 172.21.15.67:0/1995447662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b40ff9b0 msgr2=0x7fe1b40ffdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:26.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.633+0000 7fe1b99b4640 1 --2- 172.21.15.67:0/1995447662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b40ff9b0 0x7fe1b40ffdb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009880 tx=0x7fe1a402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:19:26.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.633+0000 7fe1b99b4640 1 -- 172.21.15.67:0/1995447662 shutdown_connections 2024-08-31T05:19:26.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.633+0000 7fe1b99b4640 1 --2- 172.21.15.67:0/1995447662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1b4102990 0x7fe1b4102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:26.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.634+0000 7fe1b99b4640 1 --2- 172.21.15.67:0/1995447662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b40ff9b0 0x7fe1b40ffdb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:26.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.634+0000 7fe1b99b4640 1 -- 172.21.15.67:0/1995447662 >> 172.21.15.67:0/1995447662 conn(0x7fe1b40fb500 msgr2=0x7fe1b40fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:26.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.634+0000 7fe1b99b4640 1 -- 172.21.15.67:0/1995447662 shutdown_connections 2024-08-31T05:19:26.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.634+0000 7fe1b99b4640 1 -- 172.21.15.67:0/1995447662 wait complete. 2024-08-31T05:19:26.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.635+0000 7fe1b99b4640 1 Processor -- start 2024-08-31T05:19:26.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.635+0000 7fe1b99b4640 1 -- start start 2024-08-31T05:19:26.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.636+0000 7fe1b99b4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1b40ff9b0 0x7fe1b4197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:26.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.636+0000 7fe1b99b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b4102990 0x7fe1b4197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:26.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.636+0000 7fe1b99b4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b410a510 con 0x7fe1b4102990 2024-08-31T05:19:26.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.636+0000 7fe1b2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1b40ff9b0 0x7fe1b4197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:26.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.636+0000 7fe1b2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1b40ff9b0 0x7fe1b4197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:53228/0 (socket says 172.21.15.67:53228) 2024-08-31T05:19:26.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.636+0000 7fe1b2ffd640 1 -- 172.21.15.67:0/3339211107 learned_addr learned my addr 172.21.15.67:0/3339211107 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:19:26.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.636+0000 7fe1b27fc640 1 --2- 172.21.15.67:0/3339211107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b4102990 0x7fe1b4197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:26.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.636+0000 7fe1b99b4640 1 -- 172.21.15.67:0/3339211107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b410a390 con 0x7fe1b40ff9b0 2024-08-31T05:19:26.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.636+0000 7fe1b2ffd640 1 -- 172.21.15.67:0/3339211107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b4102990 msgr2=0x7fe1b4197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:26.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.636+0000 7fe1b2ffd640 1 --2- 172.21.15.67:0/3339211107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b4102990 0x7fe1b4197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:26.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.636+0000 7fe1b2ffd640 1 -- 172.21.15.67:0/3339211107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b4197bf0 con 0x7fe1b40ff9b0 2024-08-31T05:19:26.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.636+0000 7fe1b27fc640 1 --2- 172.21.15.67:0/3339211107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b4102990 0x7fe1b4197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:19:26.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.637+0000 7fe1b2ffd640 1 --2- 172.21.15.67:0/3339211107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1b40ff9b0 0x7fe1b4197030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009230 tx=0x7fe1a4005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:26.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.637+0000 7fe1b89b2640 1 -- 172.21.15.67:0/3339211107 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1a403f030 con 0x7fe1b40ff9b0 2024-08-31T05:19:26.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.637+0000 7fe1b99b4640 1 -- 172.21.15.67:0/3339211107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b419c5d0 con 0x7fe1b40ff9b0 2024-08-31T05:19:26.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.637+0000 7fe1b89b2640 1 -- 172.21.15.67:0/3339211107 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1a4004b80 con 0x7fe1b40ff9b0 2024-08-31T05:19:26.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.637+0000 7fe1b89b2640 1 -- 172.21.15.67:0/3339211107 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1a4035070 con 0x7fe1b40ff9b0 2024-08-31T05:19:26.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.637+0000 7fe1b99b4640 1 -- 172.21.15.67:0/3339211107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b419cb60 con 0x7fe1b40ff9b0 2024-08-31T05:19:26.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.638+0000 7fe19a7fc640 1 -- 172.21.15.67:0/3339211107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b4062b90 con 0x7fe1b40ff9b0 2024-08-31T05:19:26.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.639+0000 7fe1b89b2640 1 -- 172.21.15.67:0/3339211107 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fe1a4042030 con 0x7fe1b40ff9b0 2024-08-31T05:19:26.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.640+0000 7fe1b89b2640 1 --2- 172.21.15.67:0/3339211107 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe19c06de80 0x7fe19c070340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:26.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.640+0000 7fe1b89b2640 1 -- 172.21.15.67:0/3339211107 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fe1a4040070 con 0x7fe1b40ff9b0 2024-08-31T05:19:26.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.640+0000 7fe1b27fc640 1 --2- 172.21.15.67:0/3339211107 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe19c06de80 0x7fe19c070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:26.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.641+0000 7fe1b27fc640 1 --2- 172.21.15.67:0/3339211107 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe19c06de80 0x7fe19c070340 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe1b41984e0 tx=0x7fe1a8005f90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:26.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.649+0000 7fe1b89b2640 1 -- 172.21.15.67:0/3339211107 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe1a407fc50 con 0x7fe1b40ff9b0 2024-08-31T05:19:26.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.876+0000 7fe19a7fc640 1 -- 172.21.15.67:0/3339211107 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe1b4062d60 con 0x7fe19c06de80 2024-08-31T05:19:26.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.878+0000 7fe1b89b2640 1 -- 172.21.15.67:0/3339211107 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7fe1b4062d60 con 0x7fe19c06de80 2024-08-31T05:19:26.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.881+0000 7fe19a7fc640 1 -- 172.21.15.67:0/3339211107 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe19c06de80 msgr2=0x7fe19c070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:26.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.881+0000 7fe19a7fc640 1 --2- 172.21.15.67:0/3339211107 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe19c06de80 0x7fe19c070340 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe1b41984e0 tx=0x7fe1a8005f90 comp rx=0 tx=0).stop 2024-08-31T05:19:26.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.881+0000 7fe19a7fc640 1 -- 172.21.15.67:0/3339211107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1b40ff9b0 msgr2=0x7fe1b4197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:26.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.881+0000 7fe19a7fc640 1 --2- 172.21.15.67:0/3339211107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1b40ff9b0 0x7fe1b4197030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009230 tx=0x7fe1a4005d50 comp rx=0 tx=0).stop 2024-08-31T05:19:26.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.881+0000 7fe19a7fc640 1 -- 172.21.15.67:0/3339211107 shutdown_connections 2024-08-31T05:19:26.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.881+0000 7fe19a7fc640 1 --2- 172.21.15.67:0/3339211107 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fe19c06de80 0x7fe19c070340 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.881+0000 7fe19a7fc640 1 --2- 172.21.15.67:0/3339211107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1b4102990 0x7fe1b4197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.881+0000 7fe19a7fc640 1 --2- 172.21.15.67:0/3339211107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1b40ff9b0 0x7fe1b4197030 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.882+0000 7fe19a7fc640 1 -- 172.21.15.67:0/3339211107 >> 172.21.15.67:0/3339211107 conn(0x7fe1b40fb500 msgr2=0x7fe1b4105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.882+0000 7fe19a7fc640 1 -- 172.21.15.67:0/3339211107 shutdown_connections 2024-08-31T05:19:26.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:26.882+0000 7fe19a7fc640 1 -- 172.21.15.67:0/3339211107 wait complete. 2024-08-31T05:19:26.897 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:19:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.016+0000 7f470fb51640 1 -- 172.21.15.67:0/966674594 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4708100600 msgr2=0x7f4708100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.016+0000 7f470fb51640 1 --2- 172.21.15.67:0/966674594 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4708100600 0x7f4708100a00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4704009880 tx=0x7f470402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.017+0000 7f470fb51640 1 -- 172.21.15.67:0/966674594 shutdown_connections 2024-08-31T05:19:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.017+0000 7f470fb51640 1 --2- 172.21.15.67:0/966674594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4708101800 0x7f4708101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.017+0000 7f470fb51640 1 --2- 172.21.15.67:0/966674594 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4708100600 0x7f4708100a00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.017+0000 7f470fb51640 1 -- 172.21.15.67:0/966674594 >> 172.21.15.67:0/966674594 conn(0x7f47080fbd90 msgr2=0x7f47080fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.017+0000 7f470fb51640 1 -- 172.21.15.67:0/966674594 shutdown_connections 2024-08-31T05:19:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.017+0000 7f470fb51640 1 -- 172.21.15.67:0/966674594 wait complete. 2024-08-31T05:19:27.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.018+0000 7f470fb51640 1 Processor -- start 2024-08-31T05:19:27.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.018+0000 7f470fb51640 1 -- start start 2024-08-31T05:19:27.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.019+0000 7f470fb51640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4708100600 0x7f4708197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:27.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.019+0000 7f470fb51640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4708101800 0x7f4708197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:27.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.019+0000 7f470d8ed640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4708100600 0x7f4708197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:27.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.019+0000 7f470d8ed640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4708100600 0x7f4708197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:53252/0 (socket says 172.21.15.67:53252) 2024-08-31T05:19:27.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.019+0000 7f470d0ec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4708101800 0x7f4708197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:27.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.019+0000 7f470d0ec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4708101800 0x7f4708197790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58190/0 (socket says 172.21.15.67:58190) 2024-08-31T05:19:27.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.019+0000 7f470d8ed640 1 -- 172.21.15.67:0/3271672013 learned_addr learned my addr 172.21.15.67:0/3271672013 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:19:27.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.019+0000 7f470fb51640 1 -- 172.21.15.67:0/3271672013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f470810a520 con 0x7f4708101800 2024-08-31T05:19:27.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.019+0000 7f470fb51640 1 -- 172.21.15.67:0/3271672013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f470810a3a0 con 0x7f4708100600 2024-08-31T05:19:27.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.020+0000 7f470d8ed640 1 -- 172.21.15.67:0/3271672013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4708101800 msgr2=0x7f4708197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:27.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.020+0000 7f470d8ed640 1 --2- 172.21.15.67:0/3271672013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4708101800 0x7f4708197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.020+0000 7f470d8ed640 1 -- 172.21.15.67:0/3271672013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4708197e10 con 0x7f4708100600 2024-08-31T05:19:27.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.020+0000 7f470d8ed640 1 --2- 172.21.15.67:0/3271672013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4708100600 0x7f4708197250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4704006010 tx=0x7f47040045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:27.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.021+0000 7f46feffd640 1 -- 172.21.15.67:0/3271672013 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f470403f070 con 0x7f4708100600 2024-08-31T05:19:27.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.021+0000 7f46feffd640 1 -- 172.21.15.67:0/3271672013 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47040049d0 con 0x7f4708100600 2024-08-31T05:19:27.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.021+0000 7f470fb51640 1 -- 172.21.15.67:0/3271672013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f470819c7f0 con 0x7f4708100600 2024-08-31T05:19:27.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.021+0000 7f470fb51640 1 -- 172.21.15.67:0/3271672013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f470819cd80 con 0x7f4708100600 2024-08-31T05:19:27.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.021+0000 7f46feffd640 1 -- 172.21.15.67:0/3271672013 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4704035030 con 0x7f4708100600 2024-08-31T05:19:27.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.022+0000 7f470fb51640 1 -- 172.21.15.67:0/3271672013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46ec0052c0 con 0x7f4708100600 2024-08-31T05:19:27.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.023+0000 7f46feffd640 1 -- 172.21.15.67:0/3271672013 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f4704042070 con 0x7f4708100600 2024-08-31T05:19:27.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.024+0000 7f46feffd640 1 --2- 172.21.15.67:0/3271672013 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f46f406dee0 0x7f46f40703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:27.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.024+0000 7f46feffd640 1 -- 172.21.15.67:0/3271672013 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f47040ae620 con 0x7f4708100600 2024-08-31T05:19:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.024+0000 7f470d0ec640 1 --2- 172.21.15.67:0/3271672013 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f46f406dee0 0x7f46f40703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:27.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.025+0000 7f470d0ec640 1 --2- 172.21.15.67:0/3271672013 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f46f406dee0 0x7f46f40703a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4708198700 tx=0x7f46f8005f90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:27.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.032+0000 7f46feffd640 1 -- 172.21.15.67:0/3271672013 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f470407fe50 con 0x7f4708100600 2024-08-31T05:19:27.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:26 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:19:27.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.416+0000 7f470fb51640 1 -- 172.21.15.67:0/3271672013 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f46ec000bf0 con 0x7f46f406dee0 2024-08-31T05:19:27.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.417+0000 7f46feffd640 1 -- 172.21.15.67:0/3271672013 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f46ec000bf0 con 0x7f46f406dee0 2024-08-31T05:19:27.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.420+0000 7f470fb51640 1 -- 172.21.15.67:0/3271672013 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f46f406dee0 msgr2=0x7f46f40703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:27.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.420+0000 7f470fb51640 1 --2- 172.21.15.67:0/3271672013 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f46f406dee0 0x7f46f40703a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4708198700 tx=0x7f46f8005f90 comp rx=0 tx=0).stop 2024-08-31T05:19:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.420+0000 7f470fb51640 1 -- 172.21.15.67:0/3271672013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4708100600 msgr2=0x7f4708197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.420+0000 7f470fb51640 1 --2- 172.21.15.67:0/3271672013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4708100600 0x7f4708197250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4704006010 tx=0x7f47040045e0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.420+0000 7f470fb51640 1 -- 172.21.15.67:0/3271672013 shutdown_connections 2024-08-31T05:19:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.420+0000 7f470fb51640 1 --2- 172.21.15.67:0/3271672013 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f46f406dee0 0x7f46f40703a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.420+0000 7f470fb51640 1 --2- 172.21.15.67:0/3271672013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4708101800 0x7f4708197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.420+0000 7f470fb51640 1 --2- 172.21.15.67:0/3271672013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4708100600 0x7f4708197250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.420+0000 7f470fb51640 1 -- 172.21.15.67:0/3271672013 >> 172.21.15.67:0/3271672013 conn(0x7f47080fbd90 msgr2=0x7f4708104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.420+0000 7f470fb51640 1 -- 172.21.15.67:0/3271672013 shutdown_connections 2024-08-31T05:19:27.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.420+0000 7f470fb51640 1 -- 172.21.15.67:0/3271672013 wait complete. 2024-08-31T05:19:27.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:26 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:19:27.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.509+0000 7f1880f11640 1 -- 172.21.15.67:0/29608589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f187c100600 msgr2=0x7f187c100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:27.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.509+0000 7f1880f11640 1 --2- 172.21.15.67:0/29608589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f187c100600 0x7f187c100a00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f186c009880 tx=0x7f186c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.509+0000 7f1880f11640 1 -- 172.21.15.67:0/29608589 shutdown_connections 2024-08-31T05:19:27.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.509+0000 7f1880f11640 1 --2- 172.21.15.67:0/29608589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f187c101800 0x7f187c101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.509+0000 7f1880f11640 1 --2- 172.21.15.67:0/29608589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f187c100600 0x7f187c100a00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.509+0000 7f1880f11640 1 -- 172.21.15.67:0/29608589 >> 172.21.15.67:0/29608589 conn(0x7f187c0fbdb0 msgr2=0x7f187c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:27.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.509+0000 7f1880f11640 1 -- 172.21.15.67:0/29608589 shutdown_connections 2024-08-31T05:19:27.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.509+0000 7f1880f11640 1 -- 172.21.15.67:0/29608589 wait complete. 2024-08-31T05:19:27.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.510+0000 7f1880f11640 1 Processor -- start 2024-08-31T05:19:27.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.510+0000 7f1880f11640 1 -- start start 2024-08-31T05:19:27.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.511+0000 7f1880f11640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f187c100600 0x7f187c196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:27.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.511+0000 7f1880f11640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f187c101800 0x7f187c1966b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:27.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.511+0000 7f1880f11640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f187c109440 con 0x7f187c100600 2024-08-31T05:19:27.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.511+0000 7f1880f11640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f187c1092c0 con 0x7f187c101800 2024-08-31T05:19:27.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.511+0000 7f187a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f187c100600 0x7f187c196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:27.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.511+0000 7f187a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f187c100600 0x7f187c196170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58202/0 (socket says 172.21.15.67:58202) 2024-08-31T05:19:27.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.511+0000 7f187a59c640 1 -- 172.21.15.67:0/3453617847 learned_addr learned my addr 172.21.15.67:0/3453617847 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:19:27.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.511+0000 7f1879d9b640 1 --2- 172.21.15.67:0/3453617847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f187c101800 0x7f187c1966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:27.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.511+0000 7f187a59c640 1 -- 172.21.15.67:0/3453617847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f187c101800 msgr2=0x7f187c1966b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:27.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.511+0000 7f187a59c640 1 --2- 172.21.15.67:0/3453617847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f187c101800 0x7f187c1966b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.511+0000 7f187a59c640 1 -- 172.21.15.67:0/3453617847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187c196d30 con 0x7f187c100600 2024-08-31T05:19:27.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.511+0000 7f1879d9b640 1 --2- 172.21.15.67:0/3453617847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f187c101800 0x7f187c1966b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:19:27.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.512+0000 7f187a59c640 1 --2- 172.21.15.67:0/3453617847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f187c100600 0x7f187c196170 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f186c006010 tx=0x7f186c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:27.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.512+0000 7f186b7fe640 1 -- 172.21.15.67:0/3453617847 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f186c03f070 con 0x7f187c100600 2024-08-31T05:19:27.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.512+0000 7f1880f11640 1 -- 172.21.15.67:0/3453617847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f187c069b80 con 0x7f187c100600 2024-08-31T05:19:27.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.512+0000 7f186b7fe640 1 -- 172.21.15.67:0/3453617847 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f186c0049d0 con 0x7f187c100600 2024-08-31T05:19:27.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.512+0000 7f1880f11640 1 -- 172.21.15.67:0/3453617847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f187c06a110 con 0x7f187c100600 2024-08-31T05:19:27.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.512+0000 7f186b7fe640 1 -- 172.21.15.67:0/3453617847 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f186c035030 con 0x7f187c100600 2024-08-31T05:19:27.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.513+0000 7f1880f11640 1 -- 172.21.15.67:0/3453617847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f187c100a00 con 0x7f187c100600 2024-08-31T05:19:27.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.515+0000 7f186b7fe640 1 -- 172.21.15.67:0/3453617847 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f186c042070 con 0x7f187c100600 2024-08-31T05:19:27.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.516+0000 7f186b7fe640 1 --2- 172.21.15.67:0/3453617847 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f186406de30 0x7f18640702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:27.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.516+0000 7f1879d9b640 1 --2- 172.21.15.67:0/3453617847 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f186406de30 0x7f18640702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:27.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.516+0000 7f186b7fe640 1 -- 172.21.15.67:0/3453617847 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f186c0ae6b0 con 0x7f187c100600 2024-08-31T05:19:27.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.517+0000 7f1879d9b640 1 --2- 172.21.15.67:0/3453617847 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f186406de30 0x7f18640702f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f187c069ab0 tx=0x7f1870005f90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:27.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.524+0000 7f186b7fe640 1 -- 172.21.15.67:0/3453617847 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f186c07fe60 con 0x7f187c100600 2024-08-31T05:19:27.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.711+0000 7f1880f11640 1 -- 172.21.15.67:0/3453617847 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f187c06a480 con 0x7f186406de30 2024-08-31T05:19:27.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.722+0000 7f186b7fe640 1 -- 172.21.15.67:0/3453617847 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7f187c06a480 con 0x7f186406de30 2024-08-31T05:19:27.724 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:19:27.724 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (4m) 42s ago 6m 26.4M - 0.25.0 c8568f914cd2 cad2b6757f0e 2024-08-31T05:19:27.724 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (6m) 42s ago 6m 8388k - 19.1.1-242-g244a32d3 395b9209a980 87adb449d2b7 2024-08-31T05:19:27.724 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (5m) 46s ago 5m 5263k - 19.1.1-242-g244a32d3 395b9209a980 d95ba11fe269 2024-08-31T05:19:27.724 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (6m) 42s ago 6m 6895k - 19.1.1-242-g244a32d3 395b9209a980 a47c71179c57 2024-08-31T05:19:27.724 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (5m) 46s ago 5m 6895k - 19.1.1-242-g244a32d3 395b9209a980 5f2ce08c4451 2024-08-31T05:19:27.724 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (4m) 42s ago 6m 76.9M - 9.4.12 2bacad6d85d8 ac51e53c0deb 2024-08-31T05:19:27.724 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (59s) 42s ago 59s 15.7M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:19:27.724 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (65s) 42s ago 64s 17.2M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:19:27.724 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (62s) 46s ago 62s 11.3M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:19:27.724 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (57s) 46s ago 56s 13.0M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:19:27.724 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:9283,8765,8443 running (7m) 42s ago 7m 498M - 19.1.1-242-g244a32d3 395b9209a980 436d56f83ade 2024-08-31T05:19:27.724 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (5m) 46s ago 5m 442M - 19.1.1-242-g244a32d3 395b9209a980 17ece75df6a0 2024-08-31T05:19:27.725 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (7m) 42s ago 7m 47.9M 2048M 19.1.1-242-g244a32d3 395b9209a980 7082a38c8108 2024-08-31T05:19:27.725 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (5m) 46s ago 5m 35.3M 2048M 19.1.1-242-g244a32d3 395b9209a980 30ccf0ed274b 2024-08-31T05:19:27.725 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (6m) 42s ago 6m 16.1M - 1.5.0 0da6a335fe13 d7c795c5bd95 2024-08-31T05:19:27.725 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (5m) 46s ago 5m 15.7M - 1.5.0 0da6a335fe13 f718603a0e92 2024-08-31T05:19:27.725 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (4m) 42s ago 4m 47.0M 3946M 19.1.1-242-g244a32d3 395b9209a980 b9f3f60b65f9 2024-08-31T05:19:27.725 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (3m) 42s ago 3m 54.9M 3946M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:19:27.725 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (3m) 42s ago 3m 52.9M 3946M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:19:27.725 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (2m) 46s ago 2m 52.3M 4970M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:19:27.725 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (2m) 46s ago 2m 50.4M 4970M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:19:27.725 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (2m) 46s ago 2m 41.3M 4970M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:19:27.725 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (4m) 42s ago 5m 58.3M - 2.43.0 a07b618ecd1d 9a2383a57b2c 2024-08-31T05:19:27.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.724+0000 7f1880f11640 1 -- 172.21.15.67:0/3453617847 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f186406de30 msgr2=0x7f18640702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:27.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.724+0000 7f1880f11640 1 --2- 172.21.15.67:0/3453617847 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f186406de30 0x7f18640702f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f187c069ab0 tx=0x7f1870005f90 comp rx=0 tx=0).stop 2024-08-31T05:19:27.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.724+0000 7f1880f11640 1 -- 172.21.15.67:0/3453617847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f187c100600 msgr2=0x7f187c196170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:27.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.724+0000 7f1880f11640 1 --2- 172.21.15.67:0/3453617847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f187c100600 0x7f187c196170 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f186c006010 tx=0x7f186c0045e0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.724+0000 7f1880f11640 1 -- 172.21.15.67:0/3453617847 shutdown_connections 2024-08-31T05:19:27.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.724+0000 7f1880f11640 1 --2- 172.21.15.67:0/3453617847 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f186406de30 0x7f18640702f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.724+0000 7f1880f11640 1 --2- 172.21.15.67:0/3453617847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f187c101800 0x7f187c1966b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.724+0000 7f1880f11640 1 --2- 172.21.15.67:0/3453617847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f187c100600 0x7f187c196170 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.724+0000 7f1880f11640 1 -- 172.21.15.67:0/3453617847 >> 172.21.15.67:0/3453617847 conn(0x7f187c0fbdb0 msgr2=0x7f187c104d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:27.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.724+0000 7f1880f11640 1 -- 172.21.15.67:0/3453617847 shutdown_connections 2024-08-31T05:19:27.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.724+0000 7f1880f11640 1 -- 172.21.15.67:0/3453617847 wait complete. 2024-08-31T05:19:27.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.809+0000 7f7a11851640 1 -- 172.21.15.67:0/182560600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c104ac0 msgr2=0x7f7a0c106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:27.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.809+0000 7f7a11851640 1 --2- 172.21.15.67:0/182560600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c104ac0 0x7f7a0c106eb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7a000098b0 tx=0x7f7a0002a4d0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.809+0000 7f7a11851640 1 -- 172.21.15.67:0/182560600 shutdown_connections 2024-08-31T05:19:27.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.809+0000 7f7a11851640 1 --2- 172.21.15.67:0/182560600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c104ac0 0x7f7a0c106eb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.809+0000 7f7a11851640 1 --2- 172.21.15.67:0/182560600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a0c102190 0x7f7a0c104580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.809+0000 7f7a11851640 1 -- 172.21.15.67:0/182560600 >> 172.21.15.67:0/182560600 conn(0x7f7a0c0fbdb0 msgr2=0x7f7a0c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:27.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.809+0000 7f7a11851640 1 -- 172.21.15.67:0/182560600 shutdown_connections 2024-08-31T05:19:27.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.810+0000 7f7a11851640 1 -- 172.21.15.67:0/182560600 wait complete. 2024-08-31T05:19:27.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.810+0000 7f7a11851640 1 Processor -- start 2024-08-31T05:19:27.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.810+0000 7f7a11851640 1 -- start start 2024-08-31T05:19:27.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.811+0000 7f7a11851640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c102190 0x7f7a0c1972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:27.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.811+0000 7f7a11851640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a0c104ac0 0x7f7a0c197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:27.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.811+0000 7f7a11851640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0c10a550 con 0x7f7a0c102190 2024-08-31T05:19:27.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.811+0000 7f7a11851640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0c10a3d0 con 0x7f7a0c104ac0 2024-08-31T05:19:27.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.811+0000 7f7a0affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c102190 0x7f7a0c1972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:27.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.811+0000 7f7a0affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c102190 0x7f7a0c1972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58218/0 (socket says 172.21.15.67:58218) 2024-08-31T05:19:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.811+0000 7f7a0affd640 1 -- 172.21.15.67:0/392282315 learned_addr learned my addr 172.21.15.67:0/392282315 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:19:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.811+0000 7f7a0a7fc640 1 --2- 172.21.15.67:0/392282315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a0c104ac0 0x7f7a0c197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.811+0000 7f7a0affd640 1 -- 172.21.15.67:0/392282315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a0c104ac0 msgr2=0x7f7a0c197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.811+0000 7f7a0affd640 1 --2- 172.21.15.67:0/392282315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a0c104ac0 0x7f7a0c197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.811+0000 7f7a0affd640 1 -- 172.21.15.67:0/392282315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0c197e90 con 0x7f7a0c102190 2024-08-31T05:19:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.811+0000 7f7a0affd640 1 --2- 172.21.15.67:0/392282315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c102190 0x7f7a0c1972d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00e970 tx=0x7f79fc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.812+0000 7f7a1084f640 1 -- 172.21.15.67:0/392282315 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79fc00cac0 con 0x7f7a0c102190 2024-08-31T05:19:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.812+0000 7f7a1084f640 1 -- 172.21.15.67:0/392282315 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79fc0054e0 con 0x7f7a0c102190 2024-08-31T05:19:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.812+0000 7f7a1084f640 1 -- 172.21.15.67:0/392282315 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79fc010430 con 0x7f7a0c102190 2024-08-31T05:19:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.812+0000 7f7a11851640 1 -- 172.21.15.67:0/392282315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a0c0fffe0 con 0x7f7a0c102190 2024-08-31T05:19:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.812+0000 7f7a11851640 1 -- 172.21.15.67:0/392282315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a0c100490 con 0x7f7a0c102190 2024-08-31T05:19:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.813+0000 7f7a11851640 1 -- 172.21.15.67:0/392282315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a0c102570 con 0x7f7a0c102190 2024-08-31T05:19:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.814+0000 7f7a1084f640 1 -- 172.21.15.67:0/392282315 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f79fc004f00 con 0x7f7a0c102190 2024-08-31T05:19:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.815+0000 7f7a1084f640 1 --2- 172.21.15.67:0/392282315 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f79f406de90 0x7f79f4070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.815+0000 7f7a1084f640 1 -- 172.21.15.67:0/392282315 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f79fc08e130 con 0x7f7a0c102190 2024-08-31T05:19:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.815+0000 7f7a0a7fc640 1 --2- 172.21.15.67:0/392282315 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f79f406de90 0x7f79f4070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.815+0000 7f7a0a7fc640 1 --2- 172.21.15.67:0/392282315 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f79f406de90 0x7f79f4070350 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009880 tx=0x7f7a000058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:27.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:27.819+0000 7f7a1084f640 1 -- 172.21.15.67:0/392282315 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79fc05bd50 con 0x7f7a0c102190 2024-08-31T05:19:28.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.092+0000 7f7a11851640 1 -- 172.21.15.67:0/392282315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7a0c100e70 con 0x7f7a0c102190 2024-08-31T05:19:28.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.093+0000 7f7a1084f640 1 -- 172.21.15.67:0/392282315 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f79fc05fa00 con 0x7f7a0c102190 2024-08-31T05:19:28.095 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:19:28.095 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:19:28.095 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2 2024-08-31T05:19:28.095 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:19:28.095 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:19:28.095 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2 2024-08-31T05:19:28.095 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:19:28.095 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:19:28.096 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 6 2024-08-31T05:19:28.096 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:19:28.096 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:19:28.096 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:19:28.096 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:19:28.096 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:19:28.096 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 14 2024-08-31T05:19:28.097 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:19:28.097 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:19:28.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.095+0000 7f7a11851640 1 -- 172.21.15.67:0/392282315 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f79f406de90 msgr2=0x7f79f4070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:28.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.095+0000 7f7a11851640 1 --2- 172.21.15.67:0/392282315 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f79f406de90 0x7f79f4070350 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009880 tx=0x7f7a000058d0 comp rx=0 tx=0).stop 2024-08-31T05:19:28.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.095+0000 7f7a11851640 1 -- 172.21.15.67:0/392282315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c102190 msgr2=0x7f7a0c1972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:28.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.095+0000 7f7a11851640 1 --2- 172.21.15.67:0/392282315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c102190 0x7f7a0c1972d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00e970 tx=0x7f79fc00ed70 comp rx=0 tx=0).stop 2024-08-31T05:19:28.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.095+0000 7f7a11851640 1 -- 172.21.15.67:0/392282315 shutdown_connections 2024-08-31T05:19:28.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.095+0000 7f7a11851640 1 --2- 172.21.15.67:0/392282315 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f79f406de90 0x7f79f4070350 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:28.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.095+0000 7f7a11851640 1 --2- 172.21.15.67:0/392282315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a0c104ac0 0x7f7a0c197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:28.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.095+0000 7f7a11851640 1 --2- 172.21.15.67:0/392282315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a0c102190 0x7f7a0c1972d0 secure :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00e970 tx=0x7f79fc00ed70 comp rx=0 tx=0).stop 2024-08-31T05:19:28.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.095+0000 7f7a11851640 1 -- 172.21.15.67:0/392282315 >> 172.21.15.67:0/392282315 conn(0x7f7a0c0fbdb0 msgr2=0x7f7a0c0fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:28.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.095+0000 7f7a11851640 1 -- 172.21.15.67:0/392282315 shutdown_connections 2024-08-31T05:19:28.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.095+0000 7f7a11851640 1 -- 172.21.15.67:0/392282315 wait complete. 2024-08-31T05:19:28.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.181+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1729926316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feaa0104b80 msgr2=0x7feaa0106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:28.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.181+0000 7feaa7fd7640 1 --2- 172.21.15.67:0/1729926316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feaa0104b80 0x7feaa0106f70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fea90009880 tx=0x7fea9002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:19:28.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.181+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1729926316 shutdown_connections 2024-08-31T05:19:28.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.181+0000 7feaa7fd7640 1 --2- 172.21.15.67:0/1729926316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feaa0104b80 0x7feaa0106f70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:28.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.181+0000 7feaa7fd7640 1 --2- 172.21.15.67:0/1729926316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa0102250 0x7feaa0104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:28.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.181+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1729926316 >> 172.21.15.67:0/1729926316 conn(0x7feaa00fbdb0 msgr2=0x7feaa00fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:28.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.181+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1729926316 shutdown_connections 2024-08-31T05:19:28.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.181+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1729926316 wait complete. 2024-08-31T05:19:28.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.183+0000 7feaa7fd7640 1 Processor -- start 2024-08-31T05:19:28.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.183+0000 7feaa7fd7640 1 -- start start 2024-08-31T05:19:28.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.184+0000 7feaa7fd7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa0102250 0x7feaa0197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:28.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.184+0000 7feaa7fd7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feaa0104b80 0x7feaa01977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:28.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.184+0000 7feaa5d73640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa0102250 0x7feaa0197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:28.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.184+0000 7feaa5d73640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa0102250 0x7feaa0197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:55188/0 (socket says 172.21.15.67:55188) 2024-08-31T05:19:28.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.185+0000 7feaa5d73640 1 -- 172.21.15.67:0/1806495323 learned_addr learned my addr 172.21.15.67:0/1806495323 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:19:28.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.185+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1806495323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7feaa010a540 con 0x7feaa0104b80 2024-08-31T05:19:28.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.185+0000 7feaa5572640 1 --2- 172.21.15.67:0/1806495323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feaa0104b80 0x7feaa01977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:28.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.185+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1806495323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7feaa010a3c0 con 0x7feaa0102250 2024-08-31T05:19:28.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.185+0000 7feaa5572640 1 -- 172.21.15.67:0/1806495323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa0102250 msgr2=0x7feaa0197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:28.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.185+0000 7feaa5572640 1 --2- 172.21.15.67:0/1806495323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa0102250 0x7feaa0197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:28.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.185+0000 7feaa5572640 1 -- 172.21.15.67:0/1806495323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa0197e50 con 0x7feaa0104b80 2024-08-31T05:19:28.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.186+0000 7feaa5572640 1 --2- 172.21.15.67:0/1806495323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feaa0104b80 0x7feaa01977d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fea90009230 tx=0x7fea900045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:28.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.186+0000 7feaa5d73640 1 --2- 172.21.15.67:0/1806495323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa0102250 0x7feaa0197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:19:28.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.186+0000 7fea96ffd640 1 -- 172.21.15.67:0/1806495323 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea9003f070 con 0x7feaa0104b80 2024-08-31T05:19:28.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.186+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1806495323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa019c830 con 0x7feaa0104b80 2024-08-31T05:19:28.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.186+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1806495323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa019cdc0 con 0x7feaa0104b80 2024-08-31T05:19:28.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.186+0000 7fea96ffd640 1 -- 172.21.15.67:0/1806495323 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea900049d0 con 0x7feaa0104b80 2024-08-31T05:19:28.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.186+0000 7fea96ffd640 1 -- 172.21.15.67:0/1806495323 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea90035030 con 0x7feaa0104b80 2024-08-31T05:19:28.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.187+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1806495323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea840052c0 con 0x7feaa0104b80 2024-08-31T05:19:28.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.190+0000 7fea96ffd640 1 -- 172.21.15.67:0/1806495323 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fea90042070 con 0x7feaa0104b80 2024-08-31T05:19:28.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.190+0000 7fea96ffd640 1 --2- 172.21.15.67:0/1806495323 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fea8c06de80 0x7fea8c070340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:28.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.190+0000 7fea96ffd640 1 -- 172.21.15.67:0/1806495323 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fea900ae7c0 con 0x7feaa0104b80 2024-08-31T05:19:28.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.190+0000 7feaa5d73640 1 --2- 172.21.15.67:0/1806495323 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fea8c06de80 0x7fea8c070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:28.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.191+0000 7feaa5d73640 1 --2- 172.21.15.67:0/1806495323 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fea8c06de80 0x7fea8c070340 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea9c011550 tx=0x7fea9c005f90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:28.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.197+0000 7fea96ffd640 1 -- 172.21.15.67:0/1806495323 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea900800b0 con 0x7feaa0104b80 2024-08-31T05:19:28.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:27 smithi067 ceph-mon[17432]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:28.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:27 smithi067 ceph-mon[17432]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:28.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:27 smithi067 ceph-mon[17432]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:28.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:27 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:19:28.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:27 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:19:28.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:27 smithi073 ceph-mon[24726]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:28.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:27 smithi073 ceph-mon[24726]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:28.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:27 smithi073 ceph-mon[24726]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:28.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:27 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:19:28.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:27 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:19:28.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.485+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1806495323 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fea84000bf0 con 0x7fea8c06de80 2024-08-31T05:19:28.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.486+0000 7fea96ffd640 1 -- 172.21.15.67:0/1806495323 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7fea84000bf0 con 0x7fea8c06de80 2024-08-31T05:19:28.488 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:19:28.488 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:19:28.488 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:19:28.488 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-31T05:19:28.488 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [], 2024-08-31T05:19:28.489 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "0/2 daemons upgraded", 2024-08-31T05:19:28.489 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 image on host smithi073", 2024-08-31T05:19:28.489 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:19:28.489 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:19:28.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.488+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1806495323 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fea8c06de80 msgr2=0x7fea8c070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:28.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.488+0000 7feaa7fd7640 1 --2- 172.21.15.67:0/1806495323 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fea8c06de80 0x7fea8c070340 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea9c011550 tx=0x7fea9c005f90 comp rx=0 tx=0).stop 2024-08-31T05:19:28.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.488+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1806495323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feaa0104b80 msgr2=0x7feaa01977d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:28.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.488+0000 7feaa7fd7640 1 --2- 172.21.15.67:0/1806495323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feaa0104b80 0x7feaa01977d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fea90009230 tx=0x7fea900045e0 comp rx=0 tx=0).stop 2024-08-31T05:19:28.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.489+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1806495323 shutdown_connections 2024-08-31T05:19:28.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.489+0000 7feaa7fd7640 1 --2- 172.21.15.67:0/1806495323 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fea8c06de80 0x7fea8c070340 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:28.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.489+0000 7feaa7fd7640 1 --2- 172.21.15.67:0/1806495323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feaa0104b80 0x7feaa01977d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:28.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.489+0000 7feaa7fd7640 1 --2- 172.21.15.67:0/1806495323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa0102250 0x7feaa0197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:28.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.489+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1806495323 >> 172.21.15.67:0/1806495323 conn(0x7feaa00fbdb0 msgr2=0x7feaa00fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:28.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.489+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1806495323 shutdown_connections 2024-08-31T05:19:28.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:28.489+0000 7feaa7fd7640 1 -- 172.21.15.67:0/1806495323 wait complete. 2024-08-31T05:19:29.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:28 smithi067 ceph-mon[17432]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:29.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:28 smithi067 ceph-mon[17432]: Upgrade: Target is version 19.3.0-4560-gd19e6118 (squid) 2024-08-31T05:19:29.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:28 smithi067 ceph-mon[17432]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, digests ['quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61'] 2024-08-31T05:19:29.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:28 smithi067 ceph-mon[17432]: Upgrade: Need to upgrade myself (mgr.smithi067.hftacj) 2024-08-31T05:19:29.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:28 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/392282315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:19:29.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:28 smithi067 ceph-mon[17432]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 on smithi073 2024-08-31T05:19:29.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:28 smithi073 ceph-mon[24726]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:29.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:28 smithi073 ceph-mon[24726]: Upgrade: Target is version 19.3.0-4560-gd19e6118 (squid) 2024-08-31T05:19:29.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:28 smithi073 ceph-mon[24726]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, digests ['quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61'] 2024-08-31T05:19:29.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:28 smithi073 ceph-mon[24726]: Upgrade: Need to upgrade myself (mgr.smithi067.hftacj) 2024-08-31T05:19:29.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:28 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/392282315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:19:29.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:28 smithi073 ceph-mon[24726]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 on smithi073 2024-08-31T05:19:30.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:29 smithi067 ceph-mon[17432]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:30.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:29 smithi067 ceph-mon[17432]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:30.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:29 smithi073 ceph-mon[24726]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:30.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:29 smithi073 ceph-mon[24726]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:32.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:32 smithi073 ceph-mon[24726]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:32.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:32 smithi067 ceph-mon[17432]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:34.673 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:34 smithi067 ceph-mon[17432]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:34.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:34 smithi073 ceph-mon[24726]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:36.683 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:36 smithi073 ceph-mon[24726]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:36.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:36 smithi067 ceph-mon[17432]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:38.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:38 smithi073 ceph-mon[24726]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:38.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:38 smithi067 ceph-mon[17432]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:40.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:40 smithi073 ceph-mon[24726]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:40.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:40 smithi067 ceph-mon[17432]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:41.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:41 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:19:41.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:41 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:19:42.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:42 smithi073 ceph-mon[24726]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:42.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:42 smithi067 ceph-mon[17432]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:44.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:44 smithi073 ceph-mon[24726]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-08-31T05:19:44.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:44 smithi067 ceph-mon[17432]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-08-31T05:19:46.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:46 smithi073 ceph-mon[24726]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-08-31T05:19:46.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:46 smithi067 ceph-mon[17432]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-08-31T05:19:48.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:48 smithi073 ceph-mon[24726]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:48.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:48 smithi067 ceph-mon[17432]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:49.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:49 smithi073 ceph-mon[24726]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-08-31T05:19:49.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:49 smithi067 ceph-mon[17432]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-08-31T05:19:51.637 INFO:tasks.workunit.client.0.smithi067.stderr:Updating files: 94% (11970/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-08-31T05:19:52.477 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to 'd19e6118f7015f0047264006cb0c873528eb3ae6'. 2024-08-31T05:19:52.477 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-08-31T05:19:52.477 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-31T05:19:52.477 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-31T05:19:52.477 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2024-08-31T05:19:52.477 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-08-31T05:19:52.478 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-31T05:19:52.478 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-31T05:19:52.478 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-08-31T05:19:52.478 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2024-08-31T05:19:52.478 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-08-31T05:19:52.478 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2024-08-31T05:19:52.478 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-08-31T05:19:52.478 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2024-08-31T05:19:52.478 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-08-31T05:19:52.478 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-31T05:19:52.478 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-08-31T05:19:52.478 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at d19e6118f70 Merge PR #44359 into wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T05:19:52.482 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-31T05:19:52.553 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-31T05:19:52.555 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T05:19:52.556 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-31T05:19:52.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:52 smithi073 ceph-mon[24726]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:52.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:52 smithi067 ceph-mon[17432]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:54.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:54 smithi073 ceph-mon[24726]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-08-31T05:19:54.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:54 smithi067 ceph-mon[17432]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-08-31T05:19:55.106 INFO:tasks.workunit.client.1.smithi073.stderr:Updating files: 79% (10107/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-08-31T05:19:55.511 INFO:tasks.workunit.client.1.smithi073.stderr:Note: switching to 'd19e6118f7015f0047264006cb0c873528eb3ae6'. 2024-08-31T05:19:55.511 INFO:tasks.workunit.client.1.smithi073.stderr: 2024-08-31T05:19:55.511 INFO:tasks.workunit.client.1.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-31T05:19:55.511 INFO:tasks.workunit.client.1.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-31T05:19:55.511 INFO:tasks.workunit.client.1.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-08-31T05:19:55.511 INFO:tasks.workunit.client.1.smithi073.stderr: 2024-08-31T05:19:55.512 INFO:tasks.workunit.client.1.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-31T05:19:55.512 INFO:tasks.workunit.client.1.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-31T05:19:55.512 INFO:tasks.workunit.client.1.smithi073.stderr: 2024-08-31T05:19:55.512 INFO:tasks.workunit.client.1.smithi073.stderr: git switch -c 2024-08-31T05:19:55.512 INFO:tasks.workunit.client.1.smithi073.stderr: 2024-08-31T05:19:55.512 INFO:tasks.workunit.client.1.smithi073.stderr:Or undo this operation with: 2024-08-31T05:19:55.512 INFO:tasks.workunit.client.1.smithi073.stderr: 2024-08-31T05:19:55.512 INFO:tasks.workunit.client.1.smithi073.stderr: git switch - 2024-08-31T05:19:55.512 INFO:tasks.workunit.client.1.smithi073.stderr: 2024-08-31T05:19:55.512 INFO:tasks.workunit.client.1.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-31T05:19:55.512 INFO:tasks.workunit.client.1.smithi073.stderr: 2024-08-31T05:19:55.512 INFO:tasks.workunit.client.1.smithi073.stderr:HEAD is now at d19e6118f70 Merge PR #44359 into wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T05:19:55.516 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-08-31T05:19:55.585 INFO:tasks.workunit.client.1.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-31T05:19:55.587 INFO:tasks.workunit.client.1.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-08-31T05:19:55.588 INFO:tasks.workunit.client.1.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-31T05:19:56.671 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:56 smithi073 ceph-mon[24726]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:56.671 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:56 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:19:56.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:56 smithi067 ceph-mon[17432]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:19:56.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:56 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:19:57.676 INFO:tasks.workunit.client.1.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-31T05:19:57.806 INFO:tasks.workunit.client.1.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-31T05:19:57.863 INFO:tasks.workunit.client.1.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-08-31T05:19:57.865 INFO:tasks.workunit.client.1.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-08-31T05:19:57.865 INFO:tasks.workunit.client.1.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-31T05:19:57.906 INFO:tasks.workunit.client.1.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-08-31T05:19:57.909 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-08-31T05:19:57.909 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-08-31T05:19:57.966 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-08-31T05:19:57.967 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-08-31T05:19:57.968 DEBUG:teuthology.orchestra.run.smithi073:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-08-31T05:19:58.033 INFO:tasks.workunit.client.1.smithi073.stderr:+ mkdir -p fsstress 2024-08-31T05:19:58.035 INFO:tasks.workunit.client.1.smithi073.stderr:+ pushd fsstress 2024-08-31T05:19:58.036 INFO:tasks.workunit.client.1.smithi073.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-08-31T05:19:58.036 INFO:tasks.workunit.client.1.smithi073.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-08-31T05:19:58.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.577+0000 7f43f8b75640 1 -- 172.21.15.67:0/1956824581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43f4101700 msgr2=0x7f43f4101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.577+0000 7f43f8b75640 1 --2- 172.21.15.67:0/1956824581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43f4101700 0x7f43f4101b00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009c20 tx=0x7f43ec02a970 comp rx=0 tx=0).stop 2024-08-31T05:19:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.578+0000 7f43f8b75640 1 -- 172.21.15.67:0/1956824581 shutdown_connections 2024-08-31T05:19:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.578+0000 7f43f8b75640 1 --2- 172.21.15.67:0/1956824581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43f4102900 0x7f43f4102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.578+0000 7f43f8b75640 1 --2- 172.21.15.67:0/1956824581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43f4101700 0x7f43f4101b00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.578+0000 7f43f8b75640 1 -- 172.21.15.67:0/1956824581 >> 172.21.15.67:0/1956824581 conn(0x7f43f40fce90 msgr2=0x7f43f40ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.578+0000 7f43f8b75640 1 -- 172.21.15.67:0/1956824581 shutdown_connections 2024-08-31T05:19:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.578+0000 7f43f8b75640 1 -- 172.21.15.67:0/1956824581 wait complete. 2024-08-31T05:19:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.578+0000 7f43f8b75640 1 Processor -- start 2024-08-31T05:19:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.578+0000 7f43f8b75640 1 -- start start 2024-08-31T05:19:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43f8b75640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43f4101700 0x7f43f4075cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43f8b75640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43f4102900 0x7f43f4074380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43f8b75640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f43f410a520 con 0x7f43f4102900 2024-08-31T05:19:58.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43f8b75640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f43f410a3a0 con 0x7f43f4101700 2024-08-31T05:19:58.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43f1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43f4102900 0x7f43f4074380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:58.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43f1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43f4102900 0x7f43f4074380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33722/0 (socket says 172.21.15.67:33722) 2024-08-31T05:19:58.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43f259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43f4101700 0x7f43f4075cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:58.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43f1d9b640 1 -- 172.21.15.67:0/1490369450 learned_addr learned my addr 172.21.15.67:0/1490369450 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:19:58.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43f1d9b640 1 -- 172.21.15.67:0/1490369450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43f4101700 msgr2=0x7f43f4075cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:58.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43f1d9b640 1 --2- 172.21.15.67:0/1490369450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43f4101700 0x7f43f4075cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:58.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43f1d9b640 1 -- 172.21.15.67:0/1490369450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f40748c0 con 0x7f43f4102900 2024-08-31T05:19:58.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43f1d9b640 1 --2- 172.21.15.67:0/1490369450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43f4102900 0x7f43f4074380 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00d8d0 tx=0x7f43dc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:58.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43eb7fe640 1 -- 172.21.15.67:0/1490369450 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f43dc017030 con 0x7f43f4102900 2024-08-31T05:19:58.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43eb7fe640 1 -- 172.21.15.67:0/1490369450 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f43dc004020 con 0x7f43f4102900 2024-08-31T05:19:58.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.579+0000 7f43f8b75640 1 -- 172.21.15.67:0/1490369450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f4074bb0 con 0x7f43f4102900 2024-08-31T05:19:58.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.580+0000 7f43eb7fe640 1 -- 172.21.15.67:0/1490369450 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f43dc0047a0 con 0x7f43f4102900 2024-08-31T05:19:58.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.580+0000 7f43f8b75640 1 -- 172.21.15.67:0/1490369450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f4075140 con 0x7f43f4102900 2024-08-31T05:19:58.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.581+0000 7f43f8b75640 1 -- 172.21.15.67:0/1490369450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f4101b00 con 0x7f43f4102900 2024-08-31T05:19:58.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.581+0000 7f43eb7fe640 1 -- 172.21.15.67:0/1490369450 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f43dc0041d0 con 0x7f43f4102900 2024-08-31T05:19:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.582+0000 7f43eb7fe640 1 --2- 172.21.15.67:0/1490369450 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f43e006de90 0x7f43e0070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.582+0000 7f43eb7fe640 1 -- 172.21.15.67:0/1490369450 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f43dc018070 con 0x7f43f4102900 2024-08-31T05:19:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.582+0000 7f43f259c640 1 --2- 172.21.15.67:0/1490369450 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f43e006de90 0x7f43e0070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.583+0000 7f43f259c640 1 --2- 172.21.15.67:0/1490369450 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f43e006de90 0x7f43e0070350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f43ec000f80 tx=0x7f43ec03c040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:58.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.586+0000 7f43eb7fe640 1 -- 172.21.15.67:0/1490369450 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43dc05b4e0 con 0x7f43f4102900 2024-08-31T05:19:58.600 INFO:tasks.workunit.client.1.smithi073.stderr:+ tar xzf ltp-full.tgz 2024-08-31T05:19:58.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:58 smithi073 ceph-mon[24726]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:58.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:58 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:19:58.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:58 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.zfoyxd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T05:19:58.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:58 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T05:19:58.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:58 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:19:58.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.791+0000 7f43f8b75640 1 -- 172.21.15.67:0/1490369450 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f43f419f300 con 0x7f43e006de90 2024-08-31T05:19:58.794 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:58 smithi067 ceph-mon[17432]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:19:58.794 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:58 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:19:58.794 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:58 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.zfoyxd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T05:19:58.794 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:58 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T05:19:58.794 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:58 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:19:58.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.792+0000 7f43eb7fe640 1 -- 172.21.15.67:0/1490369450 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f43f419f300 con 0x7f43e006de90 2024-08-31T05:19:58.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.795+0000 7f43f8b75640 1 -- 172.21.15.67:0/1490369450 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f43e006de90 msgr2=0x7f43e0070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:58.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.795+0000 7f43f8b75640 1 --2- 172.21.15.67:0/1490369450 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f43e006de90 0x7f43e0070350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f43ec000f80 tx=0x7f43ec03c040 comp rx=0 tx=0).stop 2024-08-31T05:19:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.795+0000 7f43f8b75640 1 -- 172.21.15.67:0/1490369450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43f4102900 msgr2=0x7f43f4074380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.795+0000 7f43f8b75640 1 --2- 172.21.15.67:0/1490369450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43f4102900 0x7f43f4074380 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00d8d0 tx=0x7f43dc00dd90 comp rx=0 tx=0).stop 2024-08-31T05:19:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.795+0000 7f43f8b75640 1 -- 172.21.15.67:0/1490369450 shutdown_connections 2024-08-31T05:19:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.795+0000 7f43f8b75640 1 --2- 172.21.15.67:0/1490369450 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f43e006de90 0x7f43e0070350 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.795+0000 7f43f8b75640 1 --2- 172.21.15.67:0/1490369450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43f4102900 0x7f43f4074380 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.795+0000 7f43f8b75640 1 --2- 172.21.15.67:0/1490369450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43f4101700 0x7f43f4075cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.795+0000 7f43f8b75640 1 -- 172.21.15.67:0/1490369450 >> 172.21.15.67:0/1490369450 conn(0x7f43f40fce90 msgr2=0x7f43f40ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.795+0000 7f43f8b75640 1 -- 172.21.15.67:0/1490369450 shutdown_connections 2024-08-31T05:19:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.795+0000 7f43f8b75640 1 -- 172.21.15.67:0/1490369450 wait complete. 2024-08-31T05:19:58.809 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:19:58.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.890+0000 7fbf06342640 1 -- 172.21.15.67:0/887573514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf00100600 msgr2=0x7fbf00100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:58.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.890+0000 7fbf06342640 1 --2- 172.21.15.67:0/887573514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf00100600 0x7fbf00100a00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009880 tx=0x7fbef002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:19:58.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.890+0000 7fbf06342640 1 -- 172.21.15.67:0/887573514 shutdown_connections 2024-08-31T05:19:58.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.890+0000 7fbf06342640 1 --2- 172.21.15.67:0/887573514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf00101800 0x7fbf00101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:58.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.890+0000 7fbf06342640 1 --2- 172.21.15.67:0/887573514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf00100600 0x7fbf00100a00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:58.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.890+0000 7fbf06342640 1 -- 172.21.15.67:0/887573514 >> 172.21.15.67:0/887573514 conn(0x7fbf000fbdb0 msgr2=0x7fbf000fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:58.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.890+0000 7fbf06342640 1 -- 172.21.15.67:0/887573514 shutdown_connections 2024-08-31T05:19:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.890+0000 7fbf06342640 1 -- 172.21.15.67:0/887573514 wait complete. 2024-08-31T05:19:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.891+0000 7fbf06342640 1 Processor -- start 2024-08-31T05:19:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.891+0000 7fbf06342640 1 -- start start 2024-08-31T05:19:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.891+0000 7fbf06342640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf00100600 0x7fbf001972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.891+0000 7fbf06342640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf00101800 0x7fbf00197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.891+0000 7fbf06342640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbf00109440 con 0x7fbf00101800 2024-08-31T05:19:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.891+0000 7fbf06342640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbf001092c0 con 0x7fbf00100600 2024-08-31T05:19:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.892+0000 7fbefffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf00100600 0x7fbf001972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.892+0000 7fbeff7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf00101800 0x7fbf00197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.892+0000 7fbefffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf00100600 0x7fbf001972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:38480/0 (socket says 172.21.15.67:38480) 2024-08-31T05:19:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.892+0000 7fbefffff640 1 -- 172.21.15.67:0/1612613910 learned_addr learned my addr 172.21.15.67:0/1612613910 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:19:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.892+0000 7fbefffff640 1 -- 172.21.15.67:0/1612613910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf00101800 msgr2=0x7fbf00197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:58.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.892+0000 7fbefffff640 1 --2- 172.21.15.67:0/1612613910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf00101800 0x7fbf00197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.892+0000 7fbefffff640 1 -- 172.21.15.67:0/1612613910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf00197eb0 con 0x7fbf00100600 2024-08-31T05:19:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.892+0000 7fbefffff640 1 --2- 172.21.15.67:0/1612613910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf00100600 0x7fbf001972f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbef0006010 tx=0x7fbef00045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.892+0000 7fbefd7fa640 1 -- 172.21.15.67:0/1612613910 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbef003f070 con 0x7fbf00100600 2024-08-31T05:19:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.892+0000 7fbefd7fa640 1 -- 172.21.15.67:0/1612613910 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbef00049d0 con 0x7fbf00100600 2024-08-31T05:19:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.892+0000 7fbf06342640 1 -- 172.21.15.67:0/1612613910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0019c820 con 0x7fbf00100600 2024-08-31T05:19:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.892+0000 7fbefd7fa640 1 -- 172.21.15.67:0/1612613910 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbef0035030 con 0x7fbf00100600 2024-08-31T05:19:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.892+0000 7fbf06342640 1 -- 172.21.15.67:0/1612613910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf0019cdb0 con 0x7fbf00100600 2024-08-31T05:19:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.894+0000 7fbf06342640 1 -- 172.21.15.67:0/1612613910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf00100a00 con 0x7fbf00100600 2024-08-31T05:19:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.894+0000 7fbefd7fa640 1 -- 172.21.15.67:0/1612613910 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fbef0042070 con 0x7fbf00100600 2024-08-31T05:19:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.895+0000 7fbefd7fa640 1 --2- 172.21.15.67:0/1612613910 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fbee806de90 0x7fbee8070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.895+0000 7fbefd7fa640 1 -- 172.21.15.67:0/1612613910 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fbef00ae5f0 con 0x7fbf00100600 2024-08-31T05:19:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.895+0000 7fbeff7fe640 1 --2- 172.21.15.67:0/1612613910 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fbee806de90 0x7fbee8070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:58.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.895+0000 7fbeff7fe640 1 --2- 172.21.15.67:0/1612613910 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fbee806de90 0x7fbee8070350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbf00198730 tx=0x7fbef4005f90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:58.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:58.899+0000 7fbefd7fa640 1 -- 172.21.15.67:0/1612613910 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbef007fe20 con 0x7fbf00100600 2024-08-31T05:19:58.941 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-31T05:19:59.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.135+0000 7fbf06342640 1 -- 172.21.15.67:0/1612613910 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbf000623d0 con 0x7fbee806de90 2024-08-31T05:19:59.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.136+0000 7fbefd7fa640 1 -- 172.21.15.67:0/1612613910 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7fbf000623d0 con 0x7fbee806de90 2024-08-31T05:19:59.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.138+0000 7fbf06342640 1 -- 172.21.15.67:0/1612613910 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fbee806de90 msgr2=0x7fbee8070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:59.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.138+0000 7fbf06342640 1 --2- 172.21.15.67:0/1612613910 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fbee806de90 0x7fbee8070350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbf00198730 tx=0x7fbef4005f90 comp rx=0 tx=0).stop 2024-08-31T05:19:59.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.138+0000 7fbf06342640 1 -- 172.21.15.67:0/1612613910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf00100600 msgr2=0x7fbf001972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:59.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.138+0000 7fbf06342640 1 --2- 172.21.15.67:0/1612613910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf00100600 0x7fbf001972f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbef0006010 tx=0x7fbef00045e0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.139+0000 7fbf06342640 1 -- 172.21.15.67:0/1612613910 shutdown_connections 2024-08-31T05:19:59.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.139+0000 7fbf06342640 1 --2- 172.21.15.67:0/1612613910 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7fbee806de90 0x7fbee8070350 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.139+0000 7fbf06342640 1 --2- 172.21.15.67:0/1612613910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbf00101800 0x7fbf00197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.139+0000 7fbf06342640 1 --2- 172.21.15.67:0/1612613910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf00100600 0x7fbf001972f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.139+0000 7fbf06342640 1 -- 172.21.15.67:0/1612613910 >> 172.21.15.67:0/1612613910 conn(0x7fbf000fbdb0 msgr2=0x7fbf000fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:59.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.139+0000 7fbf06342640 1 -- 172.21.15.67:0/1612613910 shutdown_connections 2024-08-31T05:19:59.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.139+0000 7fbf06342640 1 -- 172.21.15.67:0/1612613910 wait complete. 2024-08-31T05:19:59.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.235+0000 7f451adb9640 1 -- 172.21.15.67:0/4010508667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4514102190 msgr2=0x7f4514104580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:59.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.235+0000 7f451adb9640 1 --2- 172.21.15.67:0/4010508667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4514102190 0x7f4514104580 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f45080098b0 tx=0x7f450802a4d0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.235+0000 7f451adb9640 1 -- 172.21.15.67:0/4010508667 shutdown_connections 2024-08-31T05:19:59.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.235+0000 7f451adb9640 1 --2- 172.21.15.67:0/4010508667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4514104ac0 0x7f4514106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.235+0000 7f451adb9640 1 --2- 172.21.15.67:0/4010508667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4514102190 0x7f4514104580 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.235+0000 7f451adb9640 1 -- 172.21.15.67:0/4010508667 >> 172.21.15.67:0/4010508667 conn(0x7f45140fbdb0 msgr2=0x7f45140fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:59.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.235+0000 7f451adb9640 1 -- 172.21.15.67:0/4010508667 shutdown_connections 2024-08-31T05:19:59.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.236+0000 7f451adb9640 1 -- 172.21.15.67:0/4010508667 wait complete. 2024-08-31T05:19:59.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.236+0000 7f451adb9640 1 Processor -- start 2024-08-31T05:19:59.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.236+0000 7f451adb9640 1 -- start start 2024-08-31T05:19:59.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.236+0000 7f451adb9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4514102190 0x7f4514101a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.236+0000 7f451adb9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4514104ac0 0x7f4514100140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.236+0000 7f451adb9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f451410a560 con 0x7f4514102190 2024-08-31T05:19:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.236+0000 7f451adb9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f451410a3e0 con 0x7f4514104ac0 2024-08-31T05:19:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.236+0000 7f4518b55640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4514102190 0x7f4514101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.237+0000 7f4518b55640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4514102190 0x7f4514101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33766/0 (socket says 172.21.15.67:33766) 2024-08-31T05:19:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.237+0000 7f4518b55640 1 -- 172.21.15.67:0/4022265686 learned_addr learned my addr 172.21.15.67:0/4022265686 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:19:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.237+0000 7f4513fff640 1 --2- 172.21.15.67:0/4022265686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4514104ac0 0x7f4514100140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.237+0000 7f4518b55640 1 -- 172.21.15.67:0/4022265686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4514104ac0 msgr2=0x7f4514100140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.237+0000 7f4518b55640 1 --2- 172.21.15.67:0/4022265686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4514104ac0 0x7f4514100140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.237+0000 7f4518b55640 1 -- 172.21.15.67:0/4022265686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4514100680 con 0x7f4514102190 2024-08-31T05:19:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.237+0000 7f4518b55640 1 --2- 172.21.15.67:0/4022265686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4514102190 0x7f4514101a80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f45080099d0 tx=0x7f45080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.237+0000 7f4511ffb640 1 -- 172.21.15.67:0/4022265686 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f450803f070 con 0x7f4514102190 2024-08-31T05:19:59.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.237+0000 7f4511ffb640 1 -- 172.21.15.67:0/4022265686 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45080049d0 con 0x7f4514102190 2024-08-31T05:19:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.237+0000 7f451adb9640 1 -- 172.21.15.67:0/4022265686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4514100910 con 0x7f4514102190 2024-08-31T05:19:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.237+0000 7f4511ffb640 1 -- 172.21.15.67:0/4022265686 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4508035030 con 0x7f4514102190 2024-08-31T05:19:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.237+0000 7f451adb9640 1 -- 172.21.15.67:0/4022265686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4514100e40 con 0x7f4514102190 2024-08-31T05:19:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.239+0000 7f451adb9640 1 -- 172.21.15.67:0/4022265686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4514102570 con 0x7f4514102190 2024-08-31T05:19:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.239+0000 7f4511ffb640 1 -- 172.21.15.67:0/4022265686 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f4508042070 con 0x7f4514102190 2024-08-31T05:19:59.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.240+0000 7f4511ffb640 1 --2- 172.21.15.67:0/4022265686 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f450406de90 0x7f4504070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.240+0000 7f4511ffb640 1 -- 172.21.15.67:0/4022265686 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f45080ae5d0 con 0x7f4514102190 2024-08-31T05:19:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.240+0000 7f4513fff640 1 --2- 172.21.15.67:0/4022265686 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f450406de90 0x7f4504070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:59.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.241+0000 7f4513fff640 1 --2- 172.21.15.67:0/4022265686 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f450406de90 0x7f4504070350 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4514101800 tx=0x7f4500005f90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:59.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.245+0000 7f4511ffb640 1 -- 172.21.15.67:0/4022265686 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f450807fea0 con 0x7f4514102190 2024-08-31T05:19:59.278 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-31T05:19:59.413 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T05:19:59.414 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T05:19:59.414 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-31T05:19:59.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.462+0000 7f451adb9640 1 -- 172.21.15.67:0/4022265686 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4514105420 con 0x7f450406de90 2024-08-31T05:19:59.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.472+0000 7f4511ffb640 1 -- 172.21.15.67:0/4022265686 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7f4514105420 con 0x7f450406de90 2024-08-31T05:19:59.475 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:19:59.475 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (5m) 74s ago 6m 26.4M - 0.25.0 c8568f914cd2 cad2b6757f0e 2024-08-31T05:19:59.475 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (7m) 74s ago 7m 8388k - 19.1.1-242-g244a32d3 395b9209a980 87adb449d2b7 2024-08-31T05:19:59.475 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (6m) 78s ago 6m 5263k - 19.1.1-242-g244a32d3 395b9209a980 d95ba11fe269 2024-08-31T05:19:59.475 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (6m) 74s ago 6m 6895k - 19.1.1-242-g244a32d3 395b9209a980 a47c71179c57 2024-08-31T05:19:59.475 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (6m) 78s ago 6m 6895k - 19.1.1-242-g244a32d3 395b9209a980 5f2ce08c4451 2024-08-31T05:19:59.475 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (5m) 74s ago 6m 76.9M - 9.4.12 2bacad6d85d8 ac51e53c0deb 2024-08-31T05:19:59.475 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (91s) 74s ago 91s 15.7M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:19:59.475 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (97s) 74s ago 96s 17.2M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:19:59.476 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (94s) 78s ago 94s 11.3M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:19:59.476 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (88s) 78s ago 88s 13.0M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:19:59.476 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:9283,8765,8443 running (8m) 74s ago 8m 498M - 19.1.1-242-g244a32d3 395b9209a980 436d56f83ade 2024-08-31T05:19:59.476 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (5m) 78s ago 5m 442M - 19.1.1-242-g244a32d3 395b9209a980 17ece75df6a0 2024-08-31T05:19:59.476 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (8m) 74s ago 8m 47.9M 2048M 19.1.1-242-g244a32d3 395b9209a980 7082a38c8108 2024-08-31T05:19:59.476 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (5m) 78s ago 5m 35.3M 2048M 19.1.1-242-g244a32d3 395b9209a980 30ccf0ed274b 2024-08-31T05:19:59.476 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (6m) 74s ago 6m 16.1M - 1.5.0 0da6a335fe13 d7c795c5bd95 2024-08-31T05:19:59.476 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (6m) 78s ago 6m 15.7M - 1.5.0 0da6a335fe13 f718603a0e92 2024-08-31T05:19:59.476 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (4m) 74s ago 4m 47.0M 3946M 19.1.1-242-g244a32d3 395b9209a980 b9f3f60b65f9 2024-08-31T05:19:59.476 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (4m) 74s ago 4m 54.9M 3946M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:19:59.476 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (3m) 74s ago 3m 52.9M 3946M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:19:59.476 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (3m) 78s ago 3m 52.3M 4970M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:19:59.476 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (3m) 78s ago 3m 50.4M 4970M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:19:59.477 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (2m) 78s ago 2m 41.3M 4970M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:19:59.477 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (4m) 74s ago 6m 58.3M - 2.43.0 a07b618ecd1d 9a2383a57b2c 2024-08-31T05:19:59.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.474+0000 7f451adb9640 1 -- 172.21.15.67:0/4022265686 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f450406de90 msgr2=0x7f4504070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:59.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.474+0000 7f451adb9640 1 --2- 172.21.15.67:0/4022265686 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f450406de90 0x7f4504070350 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4514101800 tx=0x7f4500005f90 comp rx=0 tx=0).stop 2024-08-31T05:19:59.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.474+0000 7f451adb9640 1 -- 172.21.15.67:0/4022265686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4514102190 msgr2=0x7f4514101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:59.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.474+0000 7f451adb9640 1 --2- 172.21.15.67:0/4022265686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4514102190 0x7f4514101a80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f45080099d0 tx=0x7f45080045e0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.474+0000 7f451adb9640 1 -- 172.21.15.67:0/4022265686 shutdown_connections 2024-08-31T05:19:59.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.474+0000 7f451adb9640 1 --2- 172.21.15.67:0/4022265686 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f450406de90 0x7f4504070350 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.474+0000 7f451adb9640 1 --2- 172.21.15.67:0/4022265686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4514104ac0 0x7f4514100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.474+0000 7f451adb9640 1 --2- 172.21.15.67:0/4022265686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4514102190 0x7f4514101a80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.475+0000 7f451adb9640 1 -- 172.21.15.67:0/4022265686 >> 172.21.15.67:0/4022265686 conn(0x7f45140fbdb0 msgr2=0x7f45140fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:59.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.475+0000 7f451adb9640 1 -- 172.21.15.67:0/4022265686 shutdown_connections 2024-08-31T05:19:59.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.475+0000 7f451adb9640 1 -- 172.21.15.67:0/4022265686 wait complete. 2024-08-31T05:19:59.531 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T05:19:59.534 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:19:59.534 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-31T05:19:59.552 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-08-31T05:19:59.553 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-08-31T05:19:59.553 DEBUG:teuthology.orchestra.run.smithi067:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-08-31T05:19:59.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.564+0000 7ff9fca11640 1 -- 172.21.15.67:0/2972694916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f8104ac0 msgr2=0x7ff9f8106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:59.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.564+0000 7ff9fca11640 1 --2- 172.21.15.67:0/2972694916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f8104ac0 0x7ff9f8106eb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0098b0 tx=0x7ff9ec02a4d0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.564+0000 7ff9fca11640 1 -- 172.21.15.67:0/2972694916 shutdown_connections 2024-08-31T05:19:59.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.564+0000 7ff9fca11640 1 --2- 172.21.15.67:0/2972694916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f8104ac0 0x7ff9f8106eb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.564+0000 7ff9fca11640 1 --2- 172.21.15.67:0/2972694916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f8102190 0x7ff9f8104580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.564+0000 7ff9fca11640 1 -- 172.21.15.67:0/2972694916 >> 172.21.15.67:0/2972694916 conn(0x7ff9f80fbdb0 msgr2=0x7ff9f80fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:59.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.564+0000 7ff9fca11640 1 -- 172.21.15.67:0/2972694916 shutdown_connections 2024-08-31T05:19:59.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.564+0000 7ff9fca11640 1 -- 172.21.15.67:0/2972694916 wait complete. 2024-08-31T05:19:59.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.565+0000 7ff9fca11640 1 Processor -- start 2024-08-31T05:19:59.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.565+0000 7ff9fca11640 1 -- start start 2024-08-31T05:19:59.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.565+0000 7ff9fca11640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f8102190 0x7ff9f8101a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:59.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.565+0000 7ff9fca11640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f8104ac0 0x7ff9f8100140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:59.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.565+0000 7ff9fca11640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f810a530 con 0x7ff9f8102190 2024-08-31T05:19:59.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.565+0000 7ff9fca11640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f810a3b0 con 0x7ff9f8104ac0 2024-08-31T05:19:59.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.565+0000 7ff9f659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f8102190 0x7ff9f8101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:59.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.565+0000 7ff9f659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f8102190 0x7ff9f8101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33772/0 (socket says 172.21.15.67:33772) 2024-08-31T05:19:59.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.565+0000 7ff9f659c640 1 -- 172.21.15.67:0/3226551201 learned_addr learned my addr 172.21.15.67:0/3226551201 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:19:59.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.565+0000 7ff9f5d9b640 1 --2- 172.21.15.67:0/3226551201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f8104ac0 0x7ff9f8100140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:59.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.566+0000 7ff9f659c640 1 -- 172.21.15.67:0/3226551201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f8104ac0 msgr2=0x7ff9f8100140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:59.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.566+0000 7ff9f659c640 1 --2- 172.21.15.67:0/3226551201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f8104ac0 0x7ff9f8100140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.566+0000 7ff9f659c640 1 -- 172.21.15.67:0/3226551201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f8100680 con 0x7ff9f8102190 2024-08-31T05:19:59.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.566+0000 7ff9f5d9b640 1 --2- 172.21.15.67:0/3226551201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f8104ac0 0x7ff9f8100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:19:59.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.566+0000 7ff9f659c640 1 --2- 172.21.15.67:0/3226551201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f8102190 0x7ff9f8101a80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800e970 tx=0x7ff9e800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:59.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.566+0000 7ff9e77fe640 1 -- 172.21.15.67:0/3226551201 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9e800cac0 con 0x7ff9f8102190 2024-08-31T05:19:59.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.566+0000 7ff9e77fe640 1 -- 172.21.15.67:0/3226551201 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9e800cc60 con 0x7ff9f8102190 2024-08-31T05:19:59.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.567+0000 7ff9e77fe640 1 -- 172.21.15.67:0/3226551201 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9e8018720 con 0x7ff9f8102190 2024-08-31T05:19:59.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.567+0000 7ff9fca11640 1 -- 172.21.15.67:0/3226551201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f8100970 con 0x7ff9f8102190 2024-08-31T05:19:59.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.567+0000 7ff9fca11640 1 -- 172.21.15.67:0/3226551201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f8100ed0 con 0x7ff9f8102190 2024-08-31T05:19:59.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.568+0000 7ff9fca11640 1 -- 172.21.15.67:0/3226551201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f810ad10 con 0x7ff9f8102190 2024-08-31T05:19:59.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.568+0000 7ff9e77fe640 1 -- 172.21.15.67:0/3226551201 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7ff9e8010430 con 0x7ff9f8102190 2024-08-31T05:19:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.569+0000 7ff9e77fe640 1 --2- 172.21.15.67:0/3226551201 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff9e006de90 0x7ff9e0070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.569+0000 7ff9e77fe640 1 -- 172.21.15.67:0/3226551201 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7ff9e808e1b0 con 0x7ff9f8102190 2024-08-31T05:19:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.569+0000 7ff9f5d9b640 1 --2- 172.21.15.67:0/3226551201 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff9e006de90 0x7ff9e0070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.570+0000 7ff9f5d9b640 1 --2- 172.21.15.67:0/3226551201 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff9e006de90 0x7ff9e0070350 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009880 tx=0x7ff9ec0058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:59.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.575+0000 7ff9e77fe640 1 -- 172.21.15.67:0/3226551201 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9e80541b0 con 0x7ff9f8102190 2024-08-31T05:19:59.595 INFO:tasks.workunit.client.0.smithi067.stderr:+ mkdir -p fsstress 2024-08-31T05:19:59.597 INFO:tasks.workunit.client.0.smithi067.stderr:+ pushd fsstress 2024-08-31T05:19:59.599 INFO:tasks.workunit.client.0.smithi067.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-08-31T05:19:59.599 INFO:tasks.workunit.client.0.smithi067.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-08-31T05:19:59.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:59 smithi073 ceph-mon[24726]: Upgrade: Updating mgr.smithi073.zfoyxd 2024-08-31T05:19:59.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:19:59 smithi073 ceph-mon[24726]: Deploying daemon mgr.smithi073.zfoyxd on smithi073 2024-08-31T05:19:59.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:59 smithi067 ceph-mon[17432]: Upgrade: Updating mgr.smithi073.zfoyxd 2024-08-31T05:19:59.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:19:59 smithi067 ceph-mon[17432]: Deploying daemon mgr.smithi073.zfoyxd on smithi073 2024-08-31T05:19:59.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.850+0000 7ff9fca11640 1 -- 172.21.15.67:0/3226551201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff9f819f470 con 0x7ff9f8102190 2024-08-31T05:19:59.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.850+0000 7ff9e77fe640 1 -- 172.21.15.67:0/3226551201 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7ff9e805bdd0 con 0x7ff9f8102190 2024-08-31T05:19:59.853 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:19:59.853 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:19:59.853 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2 2024-08-31T05:19:59.853 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:19:59.854 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:19:59.854 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2 2024-08-31T05:19:59.854 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:19:59.854 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:19:59.854 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 6 2024-08-31T05:19:59.854 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:19:59.854 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:19:59.854 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:19:59.854 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:19:59.854 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:19:59.854 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 14 2024-08-31T05:19:59.854 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:19:59.855 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:19:59.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.852+0000 7ff9fca11640 1 -- 172.21.15.67:0/3226551201 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff9e006de90 msgr2=0x7ff9e0070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:59.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.852+0000 7ff9fca11640 1 --2- 172.21.15.67:0/3226551201 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff9e006de90 0x7ff9e0070350 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009880 tx=0x7ff9ec0058d0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.852+0000 7ff9fca11640 1 -- 172.21.15.67:0/3226551201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f8102190 msgr2=0x7ff9f8101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:59.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.852+0000 7ff9fca11640 1 --2- 172.21.15.67:0/3226551201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f8102190 0x7ff9f8101a80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800e970 tx=0x7ff9e800ee30 comp rx=0 tx=0).stop 2024-08-31T05:19:59.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.852+0000 7ff9fca11640 1 -- 172.21.15.67:0/3226551201 shutdown_connections 2024-08-31T05:19:59.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.852+0000 7ff9fca11640 1 --2- 172.21.15.67:0/3226551201 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7ff9e006de90 0x7ff9e0070350 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.852+0000 7ff9fca11640 1 --2- 172.21.15.67:0/3226551201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f8104ac0 0x7ff9f8100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.852+0000 7ff9fca11640 1 --2- 172.21.15.67:0/3226551201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9f8102190 0x7ff9f8101a80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.852+0000 7ff9fca11640 1 -- 172.21.15.67:0/3226551201 >> 172.21.15.67:0/3226551201 conn(0x7ff9f80fbdb0 msgr2=0x7ff9f80fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:59.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.853+0000 7ff9fca11640 1 -- 172.21.15.67:0/3226551201 shutdown_connections 2024-08-31T05:19:59.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.853+0000 7ff9fca11640 1 -- 172.21.15.67:0/3226551201 wait complete. 2024-08-31T05:19:59.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.948+0000 7f11a175a640 1 -- 172.21.15.67:0/1329017441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c100600 msgr2=0x7f119c100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:59.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.948+0000 7f11a175a640 1 --2- 172.21.15.67:0/1329017441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c100600 0x7f119c100a00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f118c009880 tx=0x7f118c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.948+0000 7f11a175a640 1 -- 172.21.15.67:0/1329017441 shutdown_connections 2024-08-31T05:19:59.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.948+0000 7f11a175a640 1 --2- 172.21.15.67:0/1329017441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f119c101800 0x7f119c101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.948+0000 7f11a175a640 1 --2- 172.21.15.67:0/1329017441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c100600 0x7f119c100a00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.948+0000 7f11a175a640 1 -- 172.21.15.67:0/1329017441 >> 172.21.15.67:0/1329017441 conn(0x7f119c0fbdb0 msgr2=0x7f119c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:19:59.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.948+0000 7f11a175a640 1 -- 172.21.15.67:0/1329017441 shutdown_connections 2024-08-31T05:19:59.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.948+0000 7f11a175a640 1 -- 172.21.15.67:0/1329017441 wait complete. 2024-08-31T05:19:59.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.949+0000 7f11a175a640 1 Processor -- start 2024-08-31T05:19:59.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.949+0000 7f11a175a640 1 -- start start 2024-08-31T05:19:59.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.949+0000 7f11a175a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c100600 0x7f119c06a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:59.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.949+0000 7f11a175a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f119c101800 0x7f119c19bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:59.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.949+0000 7f11a175a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f119c109420 con 0x7f119c100600 2024-08-31T05:19:59.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.949+0000 7f11a175a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f119c1092a0 con 0x7f119c101800 2024-08-31T05:19:59.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.949+0000 7f119affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c100600 0x7f119c06a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:59.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.949+0000 7f119affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c100600 0x7f119c06a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33794/0 (socket says 172.21.15.67:33794) 2024-08-31T05:19:59.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.949+0000 7f119affd640 1 -- 172.21.15.67:0/1952439871 learned_addr learned my addr 172.21.15.67:0/1952439871 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:19:59.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.949+0000 7f1193fff640 1 --2- 172.21.15.67:0/1952439871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f119c101800 0x7f119c19bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:59.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.950+0000 7f119affd640 1 -- 172.21.15.67:0/1952439871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f119c101800 msgr2=0x7f119c19bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:19:59.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.950+0000 7f119affd640 1 --2- 172.21.15.67:0/1952439871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f119c101800 0x7f119c19bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:19:59.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.950+0000 7f119affd640 1 -- 172.21.15.67:0/1952439871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c19c560 con 0x7f119c100600 2024-08-31T05:19:59.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.950+0000 7f119affd640 1 --2- 172.21.15.67:0/1952439871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c100600 0x7f119c06a530 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f118c006010 tx=0x7f118c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:59.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.950+0000 7f1198ff9640 1 -- 172.21.15.67:0/1952439871 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f118c03f070 con 0x7f119c100600 2024-08-31T05:19:59.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.950+0000 7f1198ff9640 1 -- 172.21.15.67:0/1952439871 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f118c004a50 con 0x7f119c100600 2024-08-31T05:19:59.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.950+0000 7f11a175a640 1 -- 172.21.15.67:0/1952439871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119c19c7f0 con 0x7f119c100600 2024-08-31T05:19:59.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.950+0000 7f1198ff9640 1 -- 172.21.15.67:0/1952439871 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f118c035030 con 0x7f119c100600 2024-08-31T05:19:59.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.950+0000 7f11a175a640 1 -- 172.21.15.67:0/1952439871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119c19cd20 con 0x7f119c100600 2024-08-31T05:19:59.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.951+0000 7f11a175a640 1 -- 172.21.15.67:0/1952439871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f119c100a00 con 0x7f119c100600 2024-08-31T05:19:59.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.952+0000 7f1198ff9640 1 -- 172.21.15.67:0/1952439871 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f118c042070 con 0x7f119c100600 2024-08-31T05:19:59.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.953+0000 7f1198ff9640 1 --2- 172.21.15.67:0/1952439871 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f118806de30 0x7f11880702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:19:59.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.953+0000 7f1198ff9640 1 -- 172.21.15.67:0/1952439871 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f118c0ae740 con 0x7f119c100600 2024-08-31T05:19:59.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.953+0000 7f1193fff640 1 --2- 172.21.15.67:0/1952439871 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f118806de30 0x7f11880702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:19:59.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.953+0000 7f1193fff640 1 --2- 172.21.15.67:0/1952439871 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f118806de30 0x7f11880702f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f119c06a2b0 tx=0x7f118400b390 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:19:59.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:19:59.962+0000 7f1198ff9640 1 -- 172.21.15.67:0/1952439871 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f118c004c00 con 0x7f119c100600 2024-08-31T05:20:00.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:00.234+0000 7f11a175a640 1 -- 172.21.15.67:0/1952439871 --> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f119c105db0 con 0x7f118806de30 2024-08-31T05:20:00.239 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:20:00.239 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:20:00.239 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:20:00.239 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-31T05:20:00.239 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [], 2024-08-31T05:20:00.239 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "0/2 daemons upgraded", 2024-08-31T05:20:00.239 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading mgr daemons", 2024-08-31T05:20:00.239 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:20:00.239 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:20:00.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:00.236+0000 7f1198ff9640 1 -- 172.21.15.67:0/1952439871 <== mgr.14215 v2:172.21.15.67:6800/2090251560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f119c105db0 con 0x7f118806de30 2024-08-31T05:20:00.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:00.239+0000 7f11a175a640 1 -- 172.21.15.67:0/1952439871 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f118806de30 msgr2=0x7f11880702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:00.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:00.239+0000 7f11a175a640 1 --2- 172.21.15.67:0/1952439871 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f118806de30 0x7f11880702f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f119c06a2b0 tx=0x7f118400b390 comp rx=0 tx=0).stop 2024-08-31T05:20:00.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:00.239+0000 7f11a175a640 1 -- 172.21.15.67:0/1952439871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c100600 msgr2=0x7f119c06a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:00.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:00.239+0000 7f11a175a640 1 --2- 172.21.15.67:0/1952439871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c100600 0x7f119c06a530 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f118c006010 tx=0x7f118c0045e0 comp rx=0 tx=0).stop 2024-08-31T05:20:00.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:00.239+0000 7f11a175a640 1 -- 172.21.15.67:0/1952439871 shutdown_connections 2024-08-31T05:20:00.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:00.239+0000 7f11a175a640 1 --2- 172.21.15.67:0/1952439871 >> [v2:172.21.15.67:6800/2090251560,v1:172.21.15.67:6801/2090251560] conn(0x7f118806de30 0x7f11880702f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:00.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:00.239+0000 7f11a175a640 1 --2- 172.21.15.67:0/1952439871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f119c101800 0x7f119c19bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:00.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:00.239+0000 7f11a175a640 1 --2- 172.21.15.67:0/1952439871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c100600 0x7f119c06a530 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:00.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:00.239+0000 7f11a175a640 1 -- 172.21.15.67:0/1952439871 >> 172.21.15.67:0/1952439871 conn(0x7f119c0fbdb0 msgr2=0x7f119c0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:20:00.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:00.239+0000 7f11a175a640 1 -- 172.21.15.67:0/1952439871 shutdown_connections 2024-08-31T05:20:00.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:00.239+0000 7f11a175a640 1 -- 172.21.15.67:0/1952439871 wait complete. 2024-08-31T05:20:00.409 INFO:tasks.workunit.client.0.smithi067.stderr:+ tar xzf ltp-full.tgz 2024-08-31T05:20:00.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:00 smithi067 ceph-mon[17432]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:00.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:00 smithi067 ceph-mon[17432]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:00.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:00 smithi067 ceph-mon[17432]: pgmap v222: 65 pgs: 65 active+clean; 824 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 20 KiB/s wr, 3 op/s 2024-08-31T05:20:00.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:00 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3226551201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:20:00.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:00 smithi067 ceph-mon[17432]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-31T05:20:00.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:00 smithi067 ceph-mon[17432]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:20:00.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:00 smithi067 ceph-mon[17432]: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:20:00.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:00 smithi073 ceph-mon[24726]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:00.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:00 smithi073 ceph-mon[24726]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:00.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:00 smithi073 ceph-mon[24726]: pgmap v222: 65 pgs: 65 active+clean; 824 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 20 KiB/s wr, 3 op/s 2024-08-31T05:20:00.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:00 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3226551201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:20:00.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:00 smithi073 ceph-mon[24726]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-31T05:20:00.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:00 smithi073 ceph-mon[24726]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:20:00.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:00 smithi073 ceph-mon[24726]: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:20:01.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:01 smithi073 ceph-mon[24726]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:01.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:01 smithi073 ceph-mon[24726]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:01.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:01 smithi073 ceph-mon[24726]: pgmap v223: 65 pgs: 65 active+clean; 4.3 MiB data, 187 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s rd, 322 KiB/s wr, 7 op/s 2024-08-31T05:20:01.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:01 smithi067 ceph-mon[17432]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:01.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:01 smithi067 ceph-mon[17432]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:01.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:01 smithi067 ceph-mon[17432]: pgmap v223: 65 pgs: 65 active+clean; 4.3 MiB data, 187 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s rd, 322 KiB/s wr, 7 op/s 2024-08-31T05:20:04.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:04 smithi073 ceph-mon[24726]: pgmap v224: 65 pgs: 65 active+clean; 5.1 MiB data, 202 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s rd, 391 KiB/s wr, 15 op/s 2024-08-31T05:20:04.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:04 smithi067 ceph-mon[17432]: pgmap v224: 65 pgs: 65 active+clean; 5.1 MiB data, 202 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s rd, 391 KiB/s wr, 15 op/s 2024-08-31T05:20:06.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:06 smithi073 ceph-mon[24726]: pgmap v225: 65 pgs: 65 active+clean; 26 MiB data, 260 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s rd, 2.1 MiB/s wr, 60 op/s 2024-08-31T05:20:06.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:06 smithi067 ceph-mon[17432]: pgmap v225: 65 pgs: 65 active+clean; 26 MiB data, 260 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s rd, 2.1 MiB/s wr, 60 op/s 2024-08-31T05:20:08.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:08 smithi073 ceph-mon[24726]: pgmap v226: 65 pgs: 65 active+clean; 30 MiB data, 278 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 2.5 MiB/s wr, 82 op/s 2024-08-31T05:20:08.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:08 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:08.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:08 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:08.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:08 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:20:08.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:08 smithi067 ceph-mon[17432]: pgmap v226: 65 pgs: 65 active+clean; 30 MiB data, 278 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 2.5 MiB/s wr, 82 op/s 2024-08-31T05:20:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:08 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:08 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:08 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:20:10.678 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:10 smithi067 ceph-mon[17432]: pgmap v227: 65 pgs: 65 active+clean; 41 MiB data, 317 MiB used, 536 GiB / 536 GiB avail; 983 KiB/s rd, 3.4 MiB/s wr, 133 op/s 2024-08-31T05:20:10.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:10 smithi073 ceph-mon[24726]: pgmap v227: 65 pgs: 65 active+clean; 41 MiB data, 317 MiB used, 536 GiB / 536 GiB avail; 983 KiB/s rd, 3.4 MiB/s wr, 133 op/s 2024-08-31T05:20:11.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:11 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:20:11.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:11 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:20:12.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:12 smithi073 ceph-mon[24726]: pgmap v228: 65 pgs: 65 active+clean; 49 MiB data, 329 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 147 op/s 2024-08-31T05:20:12.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:12 smithi067 ceph-mon[17432]: pgmap v228: 65 pgs: 65 active+clean; 49 MiB data, 329 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 147 op/s 2024-08-31T05:20:13.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:13 smithi073 ceph-mon[24726]: Standby manager daemon smithi073.zfoyxd restarted 2024-08-31T05:20:13.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:13 smithi073 ceph-mon[24726]: Standby manager daemon smithi073.zfoyxd started 2024-08-31T05:20:13.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:13 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.zfoyxd/crt"}]: dispatch 2024-08-31T05:20:13.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:13 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T05:20:13.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:13 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.zfoyxd/key"}]: dispatch 2024-08-31T05:20:13.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:13 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T05:20:13.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:13 smithi067 ceph-mon[17432]: Standby manager daemon smithi073.zfoyxd restarted 2024-08-31T05:20:13.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:13 smithi067 ceph-mon[17432]: Standby manager daemon smithi073.zfoyxd started 2024-08-31T05:20:13.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:13 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.zfoyxd/crt"}]: dispatch 2024-08-31T05:20:13.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:13 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T05:20:13.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:13 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.zfoyxd/key"}]: dispatch 2024-08-31T05:20:13.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:13 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T05:20:14.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:14 smithi073 ceph-mon[24726]: pgmap v229: 65 pgs: 65 active+clean; 51 MiB data, 348 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 152 op/s 2024-08-31T05:20:14.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:14 smithi073 ceph-mon[24726]: mgrmap e20: smithi067.hftacj(active, since 6m), standbys: smithi073.zfoyxd 2024-08-31T05:20:14.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:14 smithi067 ceph-mon[17432]: pgmap v229: 65 pgs: 65 active+clean; 51 MiB data, 348 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 152 op/s 2024-08-31T05:20:14.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:14 smithi067 ceph-mon[17432]: mgrmap e20: smithi067.hftacj(active, since 6m), standbys: smithi073.zfoyxd 2024-08-31T05:20:15.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:15 smithi073 ceph-mon[24726]: pgmap v230: 65 pgs: 65 active+clean; 58 MiB data, 390 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 179 op/s 2024-08-31T05:20:15.807 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:15 smithi067 ceph-mon[17432]: pgmap v230: 65 pgs: 65 active+clean; 58 MiB data, 390 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 179 op/s 2024-08-31T05:20:18.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:18 smithi073 ceph-mon[24726]: pgmap v231: 65 pgs: 65 active+clean; 74 MiB data, 422 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.1 MiB/s wr, 170 op/s 2024-08-31T05:20:18.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:18 smithi067 ceph-mon[17432]: pgmap v231: 65 pgs: 65 active+clean; 74 MiB data, 422 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.1 MiB/s wr, 170 op/s 2024-08-31T05:20:20.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:20.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:20.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:20 smithi067 ceph-mon[17432]: pgmap v232: 65 pgs: 65 active+clean; 88 MiB data, 483 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 210 op/s 2024-08-31T05:20:20.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:20.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:20 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:20.388 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:20.388 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:20.388 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:20 smithi073 ceph-mon[24726]: pgmap v232: 65 pgs: 65 active+clean; 88 MiB data, 483 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 210 op/s 2024-08-31T05:20:20.388 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:20.388 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:20 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:22.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:22 smithi073 ceph-mon[24726]: pgmap v233: 65 pgs: 65 active+clean; 94 MiB data, 494 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 175 op/s 2024-08-31T05:20:22.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:22 smithi067 ceph-mon[17432]: pgmap v233: 65 pgs: 65 active+clean; 94 MiB data, 494 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 175 op/s 2024-08-31T05:20:24.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:24.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:24.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:20:24.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:20:24.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:24.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: pgmap v234: 65 pgs: 65 active+clean; 94 MiB data, 512 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 175 op/s 2024-08-31T05:20:24.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:20:24.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr fail", "who": "smithi067.hftacj"}]: dispatch 2024-08-31T05:20:24.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: Activating manager daemon smithi073.zfoyxd 2024-08-31T05:20:24.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "mgr fail", "who": "smithi067.hftacj"}]': finished 2024-08-31T05:20:24.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:20:24.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:20:24.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.tskvpt"}]: dispatch 2024-08-31T05:20:24.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.beqeql"}]: dispatch 2024-08-31T05:20:24.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.kfbmeo"}]: dispatch 2024-08-31T05:20:24.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.gsnhxi"}]: dispatch 2024-08-31T05:20:24.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mgr metadata", "who": "smithi073.zfoyxd", "id": "smithi073.zfoyxd"}]: dispatch 2024-08-31T05:20:24.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:20:24.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:20:24.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:20:24.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:20:24.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-31T05:20:24.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:20:24.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: osdmap e46: 6 total, 6 up, 6 in 2024-08-31T05:20:24.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: mgrmap e21: smithi073.zfoyxd(active, starting, since 0.0114495s) 2024-08-31T05:20:24.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T05:20:24.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T05:20:24.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T05:20:24.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:24 smithi067 ceph-mon[17432]: Manager daemon smithi073.zfoyxd is now available 2024-08-31T05:20:24.484 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:24.484 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:24.484 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:20:24.484 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:20:24.485 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' 2024-08-31T05:20:24.485 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: pgmap v234: 65 pgs: 65 active+clean; 94 MiB data, 512 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 175 op/s 2024-08-31T05:20:24.485 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:20:24.485 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr fail", "who": "smithi067.hftacj"}]: dispatch 2024-08-31T05:20:24.485 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: Activating manager daemon smithi073.zfoyxd 2024-08-31T05:20:24.485 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.14215 172.21.15.67:0/321135946' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "mgr fail", "who": "smithi067.hftacj"}]': finished 2024-08-31T05:20:24.485 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:20:24.485 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:20:24.485 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.tskvpt"}]: dispatch 2024-08-31T05:20:24.485 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.beqeql"}]: dispatch 2024-08-31T05:20:24.485 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.kfbmeo"}]: dispatch 2024-08-31T05:20:24.485 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.gsnhxi"}]: dispatch 2024-08-31T05:20:24.485 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mgr metadata", "who": "smithi073.zfoyxd", "id": "smithi073.zfoyxd"}]: dispatch 2024-08-31T05:20:24.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:20:24.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:20:24.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:20:24.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:20:24.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-31T05:20:24.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:20:24.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: osdmap e46: 6 total, 6 up, 6 in 2024-08-31T05:20:24.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: mgrmap e21: smithi073.zfoyxd(active, starting, since 0.0114495s) 2024-08-31T05:20:24.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T05:20:24.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T05:20:24.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T05:20:24.486 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:24 smithi073 ceph-mon[24726]: Manager daemon smithi073.zfoyxd is now available 2024-08-31T05:20:25.651 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:25 smithi073 ceph-mon[24726]: mgrmap e22: smithi073.zfoyxd(active, since 1.00979s) 2024-08-31T05:20:25.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:25 smithi073 ceph-mon[24726]: pgmap v3: 65 pgs: 65 active+clean; 108 MiB data, 558 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:20:25.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:25 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:25.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:25 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:25.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:25 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:25.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:25 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:20:25.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:25 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:20:25.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:25 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:20:25.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:25 smithi073 ceph-mon[24726]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:20:25.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:25 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.zfoyxd/mirror_snapshot_schedule"}]: dispatch 2024-08-31T05:20:25.652 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:25 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.zfoyxd/mirror_snapshot_schedule"}]: dispatch 2024-08-31T05:20:25.653 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:25 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.zfoyxd/trash_purge_schedule"}]: dispatch 2024-08-31T05:20:25.653 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:25 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.zfoyxd/trash_purge_schedule"}]: dispatch 2024-08-31T05:20:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:25 smithi067 ceph-mon[17432]: mgrmap e22: smithi073.zfoyxd(active, since 1.00979s) 2024-08-31T05:20:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:25 smithi067 ceph-mon[17432]: pgmap v3: 65 pgs: 65 active+clean; 108 MiB data, 558 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:20:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:25 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:25 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:25 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:25 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:20:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:25 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:20:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:25 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:20:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:25 smithi067 ceph-mon[17432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:20:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:25 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.zfoyxd/mirror_snapshot_schedule"}]: dispatch 2024-08-31T05:20:25.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:25 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.zfoyxd/mirror_snapshot_schedule"}]: dispatch 2024-08-31T05:20:25.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:25 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.zfoyxd/trash_purge_schedule"}]: dispatch 2024-08-31T05:20:25.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:25 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi073.zfoyxd/trash_purge_schedule"}]: dispatch 2024-08-31T05:20:26.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:26 smithi073 ceph-mon[24726]: Deploying cephadm binary to smithi067 2024-08-31T05:20:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:26 smithi073 ceph-mon[24726]: Deploying cephadm binary to smithi073 2024-08-31T05:20:26.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:26 smithi067 ceph-mon[17432]: Deploying cephadm binary to smithi067 2024-08-31T05:20:26.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:26 smithi067 ceph-mon[17432]: Deploying cephadm binary to smithi073 2024-08-31T05:20:27.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:27 smithi067 ceph-mon[17432]: [31/Aug/2024:05:20:26] ENGINE Bus STARTING 2024-08-31T05:20:27.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:27 smithi067 ceph-mon[17432]: [31/Aug/2024:05:20:26] ENGINE Serving on http://172.21.15.73:8765 2024-08-31T05:20:27.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:27 smithi067 ceph-mon[17432]: [31/Aug/2024:05:20:26] ENGINE Serving on https://172.21.15.73:7150 2024-08-31T05:20:27.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:27 smithi067 ceph-mon[17432]: [31/Aug/2024:05:20:26] ENGINE Bus STARTED 2024-08-31T05:20:27.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:27 smithi067 ceph-mon[17432]: [31/Aug/2024:05:20:26] ENGINE Error in HTTPServer.serve 2024-08-31T05:20:27.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Traceback (most recent call last): 2024-08-31T05:20:27.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:20:27.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:20:27.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:20:27.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._run(expiration_interval) 2024-08-31T05:20:27.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:20:27.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:20:27.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:20:27.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:20:27.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:20:27.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: s = self.context.wrap_socket( 2024-08-31T05:20:27.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:20:27.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: return self.sslsocket_class._create( 2024-08-31T05:20:27.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:20:27.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self.do_handshake() 2024-08-31T05:20:27.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:20:27.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._sslobj.do_handshake() 2024-08-31T05:20:27.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:20:27.902 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:27 smithi073 ceph-mon[24726]: [31/Aug/2024:05:20:26] ENGINE Bus STARTING 2024-08-31T05:20:27.902 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:27 smithi073 ceph-mon[24726]: [31/Aug/2024:05:20:26] ENGINE Serving on http://172.21.15.73:8765 2024-08-31T05:20:27.902 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:27 smithi073 ceph-mon[24726]: [31/Aug/2024:05:20:26] ENGINE Serving on https://172.21.15.73:7150 2024-08-31T05:20:27.902 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:27 smithi073 ceph-mon[24726]: [31/Aug/2024:05:20:26] ENGINE Bus STARTED 2024-08-31T05:20:27.902 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:27 smithi073 ceph-mon[24726]: [31/Aug/2024:05:20:26] ENGINE Error in HTTPServer.serve 2024-08-31T05:20:27.902 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Traceback (most recent call last): 2024-08-31T05:20:27.902 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:20:27.902 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:20:27.902 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:20:27.902 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: self._run(expiration_interval) 2024-08-31T05:20:27.903 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:20:27.903 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:20:27.903 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:20:27.903 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:20:27.903 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:20:27.903 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: s = self.context.wrap_socket( 2024-08-31T05:20:27.903 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:20:27.903 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: return self.sslsocket_class._create( 2024-08-31T05:20:27.903 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:20:27.903 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: self.do_handshake() 2024-08-31T05:20:27.903 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:20:27.903 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: self._sslobj.do_handshake() 2024-08-31T05:20:27.903 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:20:28.759 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:28 smithi067 ceph-mon[17432]: pgmap v5: 65 pgs: 65 active+clean; 108 MiB data, 558 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:20:28.759 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:28 smithi067 ceph-mon[17432]: mgrmap e23: smithi073.zfoyxd(active, since 4s) 2024-08-31T05:20:28.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:28 smithi073 ceph-mon[24726]: pgmap v5: 65 pgs: 65 active+clean; 108 MiB data, 558 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:20:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:28 smithi073 ceph-mon[24726]: mgrmap e23: smithi073.zfoyxd(active, since 4s) 2024-08-31T05:20:30.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.364+0000 7f4ae54df640 1 -- 172.21.15.67:0/4010438257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae0103910 msgr2=0x7f4ae0103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.364+0000 7f4ae54df640 1 --2- 172.21.15.67:0/4010438257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae0103910 0x7f4ae0103d10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009880 tx=0x7f4ad002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:20:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.364+0000 7f4ae54df640 1 -- 172.21.15.67:0/4010438257 shutdown_connections 2024-08-31T05:20:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.364+0000 7f4ae54df640 1 --2- 172.21.15.67:0/4010438257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae0104b10 0x7f4ae0104f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.364+0000 7f4ae54df640 1 --2- 172.21.15.67:0/4010438257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae0103910 0x7f4ae0103d10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.365+0000 7f4ae54df640 1 -- 172.21.15.67:0/4010438257 >> 172.21.15.67:0/4010438257 conn(0x7f4ae00ff0c0 msgr2=0x7f4ae01014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:20:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.365+0000 7f4ae54df640 1 -- 172.21.15.67:0/4010438257 shutdown_connections 2024-08-31T05:20:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.365+0000 7f4ae54df640 1 -- 172.21.15.67:0/4010438257 wait complete. 2024-08-31T05:20:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.366+0000 7f4ae54df640 1 Processor -- start 2024-08-31T05:20:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.366+0000 7f4ae54df640 1 -- start start 2024-08-31T05:20:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.366+0000 7f4ae54df640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae0103910 0x7f4ae0199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.366+0000 7f4ae54df640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae0104b10 0x7f4ae01999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.366+0000 7f4ae54df640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae010c730 con 0x7f4ae0103910 2024-08-31T05:20:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.366+0000 7f4ae54df640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae010c5b0 con 0x7f4ae0104b10 2024-08-31T05:20:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.366+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae0103910 0x7f4ae0199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.366+0000 7f4ade7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae0104b10 0x7f4ae01999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.366+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae0103910 0x7f4ae0199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58082/0 (socket says 172.21.15.67:58082) 2024-08-31T05:20:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.366+0000 7f4adeffd640 1 -- 172.21.15.67:0/4272832415 learned_addr learned my addr 172.21.15.67:0/4272832415 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:20:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.367+0000 7f4ade7fc640 1 -- 172.21.15.67:0/4272832415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae0103910 msgr2=0x7f4ae0199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.367+0000 7f4ade7fc640 1 --2- 172.21.15.67:0/4272832415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae0103910 0x7f4ae0199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.367+0000 7f4ade7fc640 1 -- 172.21.15.67:0/4272832415 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae019a030 con 0x7f4ae0104b10 2024-08-31T05:20:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.367+0000 7f4adeffd640 1 --2- 172.21.15.67:0/4272832415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae0103910 0x7f4ae0199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:20:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.367+0000 7f4ade7fc640 1 --2- 172.21.15.67:0/4272832415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae0104b10 0x7f4ae01999b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400e970 tx=0x7f4ad400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:20:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.367+0000 7f4ac7fff640 1 -- 172.21.15.67:0/4272832415 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ad400cac0 con 0x7f4ae0104b10 2024-08-31T05:20:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.367+0000 7f4ae54df640 1 -- 172.21.15.67:0/4272832415 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae019ea70 con 0x7f4ae0104b10 2024-08-31T05:20:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.367+0000 7f4ac7fff640 1 -- 172.21.15.67:0/4272832415 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ad400cc60 con 0x7f4ae0104b10 2024-08-31T05:20:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.367+0000 7f4ac7fff640 1 -- 172.21.15.67:0/4272832415 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ad4018720 con 0x7f4ae0104b10 2024-08-31T05:20:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.368+0000 7f4ae54df640 1 -- 172.21.15.67:0/4272832415 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae019f000 con 0x7f4ae0104b10 2024-08-31T05:20:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.368+0000 7f4ae54df640 1 -- 172.21.15.67:0/4272832415 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae0103d10 con 0x7f4ae0104b10 2024-08-31T05:20:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.369+0000 7f4ac7fff640 1 -- 172.21.15.67:0/4272832415 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) ==== 51483+0+0 (secure 0 0 0) 0x7f4ad40189d0 con 0x7f4ae0104b10 2024-08-31T05:20:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.369+0000 7f4ac7fff640 1 --2- 172.21.15.67:0/4272832415 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f4ac803f2f0 0x7f4ac80417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.369+0000 7f4ac7fff640 1 -- 172.21.15.67:0/4272832415 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f4ad4055330 con 0x7f4ae0104b10 2024-08-31T05:20:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.369+0000 7f4adeffd640 1 --2- 172.21.15.67:0/4272832415 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f4ac803f2f0 0x7f4ac80417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.370+0000 7f4adeffd640 1 --2- 172.21.15.67:0/4272832415 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f4ac803f2f0 0x7f4ac80417b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00096c0 tx=0x7f4ad0005a20 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:20:30.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.375+0000 7f4ac7fff640 1 -- 172.21.15.67:0/4272832415 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f4ad4010a80 con 0x7f4ae0104b10 2024-08-31T05:20:30.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.507+0000 7f4ac7fff640 1 -- 172.21.15.67:0/4272832415 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7f4ad4016a20 con 0x7f4ae0104b10 2024-08-31T05:20:30.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.648+0000 7f4ae54df640 1 -- 172.21.15.67:0/4272832415 --> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4ae0062490 con 0x7f4ac803f2f0 2024-08-31T05:20:30.650 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:30 smithi067 ceph-mon[17432]: pgmap v6: 65 pgs: 65 active+clean; 112 MiB data, 562 MiB used, 536 GiB / 536 GiB avail; 490 KiB/s rd, 826 KiB/s wr, 35 op/s 2024-08-31T05:20:30.650 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:30 smithi067 ceph-mon[17432]: mgrmap e24: smithi073.zfoyxd(active, since 6s) 2024-08-31T05:20:30.650 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:30 smithi067 ceph-mon[17432]: Standby manager daemon smithi067.hftacj started 2024-08-31T05:20:30.650 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:30 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.67:0/100519581' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.hftacj/crt"}]: dispatch 2024-08-31T05:20:30.650 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:30 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.67:0/100519581' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T05:20:30.650 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:30 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.67:0/100519581' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.hftacj/key"}]: dispatch 2024-08-31T05:20:30.651 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:30 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.67:0/100519581' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T05:20:30.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.649+0000 7f4ac7fff640 1 -- 172.21.15.67:0/4272832415 <== mgr.24383 v2:172.21.15.73:6828/1567621854 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f4ae0062490 con 0x7f4ac803f2f0 2024-08-31T05:20:30.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.652+0000 7f4ae54df640 1 -- 172.21.15.67:0/4272832415 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f4ac803f2f0 msgr2=0x7f4ac80417b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:30.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.652+0000 7f4ae54df640 1 --2- 172.21.15.67:0/4272832415 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f4ac803f2f0 0x7f4ac80417b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00096c0 tx=0x7f4ad0005a20 comp rx=0 tx=0).stop 2024-08-31T05:20:30.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.652+0000 7f4ae54df640 1 -- 172.21.15.67:0/4272832415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae0104b10 msgr2=0x7f4ae01999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:30.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.652+0000 7f4ae54df640 1 --2- 172.21.15.67:0/4272832415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae0104b10 0x7f4ae01999b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400e970 tx=0x7f4ad400ee30 comp rx=0 tx=0).stop 2024-08-31T05:20:30.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.653+0000 7f4ae54df640 1 -- 172.21.15.67:0/4272832415 shutdown_connections 2024-08-31T05:20:30.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.653+0000 7f4ae54df640 1 --2- 172.21.15.67:0/4272832415 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f4ac803f2f0 0x7f4ac80417b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:30.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.653+0000 7f4ae54df640 1 --2- 172.21.15.67:0/4272832415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ae0104b10 0x7f4ae01999b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:30.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.653+0000 7f4ae54df640 1 --2- 172.21.15.67:0/4272832415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae0103910 0x7f4ae0199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:30.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.653+0000 7f4ae54df640 1 -- 172.21.15.67:0/4272832415 >> 172.21.15.67:0/4272832415 conn(0x7f4ae00ff0c0 msgr2=0x7f4ae0107fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:20:30.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.653+0000 7f4ae54df640 1 -- 172.21.15.67:0/4272832415 shutdown_connections 2024-08-31T05:20:30.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.653+0000 7f4ae54df640 1 -- 172.21.15.67:0/4272832415 wait complete. 2024-08-31T05:20:30.666 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:20:30.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.764+0000 7fefd178b640 1 -- 172.21.15.67:0/1016410250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc0ffd70 msgr2=0x7fefcc100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:30.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.764+0000 7fefd178b640 1 --2- 172.21.15.67:0/1016410250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc0ffd70 0x7fefcc100170 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0097e0 tx=0x7fefbc02a3f0 comp rx=0 tx=0).stop 2024-08-31T05:20:30.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.765+0000 7fefd178b640 1 -- 172.21.15.67:0/1016410250 shutdown_connections 2024-08-31T05:20:30.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.765+0000 7fefd178b640 1 --2- 172.21.15.67:0/1016410250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefcc100f70 0x7fefcc1013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:30.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.765+0000 7fefd178b640 1 --2- 172.21.15.67:0/1016410250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc0ffd70 0x7fefcc100170 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:30.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.765+0000 7fefd178b640 1 -- 172.21.15.67:0/1016410250 >> 172.21.15.67:0/1016410250 conn(0x7fefcc0fb500 msgr2=0x7fefcc0fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:20:30.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.765+0000 7fefd178b640 1 -- 172.21.15.67:0/1016410250 shutdown_connections 2024-08-31T05:20:30.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.765+0000 7fefd178b640 1 -- 172.21.15.67:0/1016410250 wait complete. 2024-08-31T05:20:30.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.766+0000 7fefd178b640 1 Processor -- start 2024-08-31T05:20:30.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.766+0000 7fefd178b640 1 -- start start 2024-08-31T05:20:30.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.767+0000 7fefd178b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc0ffd70 0x7fefcc195060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:30.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.767+0000 7fefd178b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefcc100f70 0x7fefcc1955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:30.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.767+0000 7fefd178b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc108300 con 0x7fefcc100f70 2024-08-31T05:20:30.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.767+0000 7fefd178b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc108180 con 0x7fefcc0ffd70 2024-08-31T05:20:30.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.767+0000 7fefca7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefcc100f70 0x7fefcc1955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:30.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.767+0000 7fefca7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefcc100f70 0x7fefcc1955a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58112/0 (socket says 172.21.15.67:58112) 2024-08-31T05:20:30.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.767+0000 7fefcaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc0ffd70 0x7fefcc195060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:30.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.767+0000 7fefca7fc640 1 -- 172.21.15.67:0/2361167804 learned_addr learned my addr 172.21.15.67:0/2361167804 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:20:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.767+0000 7fefcaffd640 1 -- 172.21.15.67:0/2361167804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefcc100f70 msgr2=0x7fefcc1955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.767+0000 7fefcaffd640 1 --2- 172.21.15.67:0/2361167804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefcc100f70 0x7fefcc1955a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.767+0000 7fefcaffd640 1 -- 172.21.15.67:0/2361167804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefcc195c20 con 0x7fefcc0ffd70 2024-08-31T05:20:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.767+0000 7fefca7fc640 1 --2- 172.21.15.67:0/2361167804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefcc100f70 0x7fefcc1955a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:20:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.768+0000 7fefcaffd640 1 --2- 172.21.15.67:0/2361167804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc0ffd70 0x7fefcc195060 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fefbc02a910 tx=0x7fefbc0043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:20:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.768+0000 7fefb3fff640 1 -- 172.21.15.67:0/2361167804 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fefbc040070 con 0x7fefcc0ffd70 2024-08-31T05:20:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.768+0000 7fefd178b640 1 -- 172.21.15.67:0/2361167804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefcc19a600 con 0x7fefcc0ffd70 2024-08-31T05:20:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.768+0000 7fefb3fff640 1 -- 172.21.15.67:0/2361167804 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fefbc030c00 con 0x7fefcc0ffd70 2024-08-31T05:20:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.768+0000 7fefb3fff640 1 -- 172.21.15.67:0/2361167804 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fefbc003d20 con 0x7fefcc0ffd70 2024-08-31T05:20:30.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.769+0000 7fefd178b640 1 -- 172.21.15.67:0/2361167804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefcc19aad0 con 0x7fefcc0ffd70 2024-08-31T05:20:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.770+0000 7fefb3fff640 1 -- 172.21.15.67:0/2361167804 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7fefbc039040 con 0x7fefcc0ffd70 2024-08-31T05:20:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.770+0000 7fefd178b640 1 -- 172.21.15.67:0/2361167804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefcc100170 con 0x7fefcc0ffd70 2024-08-31T05:20:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.771+0000 7fefb3fff640 1 --2- 172.21.15.67:0/2361167804 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fefb40761b0 0x7fefb4078670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.771+0000 7fefb3fff640 1 -- 172.21.15.67:0/2361167804 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7fefbc0b5ea0 con 0x7fefcc0ffd70 2024-08-31T05:20:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.771+0000 7fefca7fc640 1 --2- 172.21.15.67:0/2361167804 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fefb40761b0 0x7fefb4078670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.772+0000 7fefca7fc640 1 --2- 172.21.15.67:0/2361167804 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fefb40761b0 0x7fefb4078670 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fefc000a7d0 tx=0x7fefc000a370 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:20:30.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:30.776+0000 7fefb3fff640 1 -- 172.21.15.67:0/2361167804 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fefbc061e20 con 0x7fefcc0ffd70 2024-08-31T05:20:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:30 smithi073 ceph-mon[24726]: pgmap v6: 65 pgs: 65 active+clean; 112 MiB data, 562 MiB used, 536 GiB / 536 GiB avail; 490 KiB/s rd, 826 KiB/s wr, 35 op/s 2024-08-31T05:20:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:30 smithi073 ceph-mon[24726]: mgrmap e24: smithi073.zfoyxd(active, since 6s) 2024-08-31T05:20:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:30 smithi073 ceph-mon[24726]: Standby manager daemon smithi067.hftacj started 2024-08-31T05:20:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:30 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.67:0/100519581' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.hftacj/crt"}]: dispatch 2024-08-31T05:20:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:30 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.67:0/100519581' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T05:20:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:30 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.67:0/100519581' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.hftacj/key"}]: dispatch 2024-08-31T05:20:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:30 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.67:0/100519581' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T05:20:31.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.063+0000 7fefd178b640 1 -- 172.21.15.67:0/2361167804 --> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fefcc105570 con 0x7fefb40761b0 2024-08-31T05:20:31.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.065+0000 7fefb3fff640 1 -- 172.21.15.67:0/2361167804 <== mgr.24383 v2:172.21.15.73:6828/1567621854 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fefcc105570 con 0x7fefb40761b0 2024-08-31T05:20:31.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.067+0000 7fefd178b640 1 -- 172.21.15.67:0/2361167804 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fefb40761b0 msgr2=0x7fefb4078670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:31.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.067+0000 7fefd178b640 1 --2- 172.21.15.67:0/2361167804 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fefb40761b0 0x7fefb4078670 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fefc000a7d0 tx=0x7fefc000a370 comp rx=0 tx=0).stop 2024-08-31T05:20:31.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.067+0000 7fefd178b640 1 -- 172.21.15.67:0/2361167804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc0ffd70 msgr2=0x7fefcc195060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:31.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.067+0000 7fefd178b640 1 --2- 172.21.15.67:0/2361167804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc0ffd70 0x7fefcc195060 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fefbc02a910 tx=0x7fefbc0043b0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.068+0000 7fefd178b640 1 -- 172.21.15.67:0/2361167804 shutdown_connections 2024-08-31T05:20:31.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.068+0000 7fefd178b640 1 --2- 172.21.15.67:0/2361167804 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fefb40761b0 0x7fefb4078670 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.068+0000 7fefd178b640 1 --2- 172.21.15.67:0/2361167804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefcc100f70 0x7fefcc1955a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.068+0000 7fefd178b640 1 --2- 172.21.15.67:0/2361167804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc0ffd70 0x7fefcc195060 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.068+0000 7fefd178b640 1 -- 172.21.15.67:0/2361167804 >> 172.21.15.67:0/2361167804 conn(0x7fefcc0fb500 msgr2=0x7fefcc0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:20:31.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.068+0000 7fefd178b640 1 -- 172.21.15.67:0/2361167804 shutdown_connections 2024-08-31T05:20:31.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.068+0000 7fefd178b640 1 -- 172.21.15.67:0/2361167804 wait complete. 2024-08-31T05:20:31.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.190+0000 7f366bb18640 1 -- 172.21.15.67:0/3289265122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3664100620 msgr2=0x7f3664100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:31.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.190+0000 7f366bb18640 1 --2- 172.21.15.67:0/3289265122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3664100620 0x7f3664100a20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3660009880 tx=0x7f366002a4b0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.190+0000 7f366bb18640 1 -- 172.21.15.67:0/3289265122 shutdown_connections 2024-08-31T05:20:31.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.190+0000 7f366bb18640 1 --2- 172.21.15.67:0/3289265122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3664101820 0x7f3664101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.190+0000 7f366bb18640 1 --2- 172.21.15.67:0/3289265122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3664100620 0x7f3664100a20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.190+0000 7f366bb18640 1 -- 172.21.15.67:0/3289265122 >> 172.21.15.67:0/3289265122 conn(0x7f36640fbdb0 msgr2=0x7f36640fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:20:31.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.190+0000 7f366bb18640 1 -- 172.21.15.67:0/3289265122 shutdown_connections 2024-08-31T05:20:31.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.190+0000 7f366bb18640 1 -- 172.21.15.67:0/3289265122 wait complete. 2024-08-31T05:20:31.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.191+0000 7f366bb18640 1 Processor -- start 2024-08-31T05:20:31.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.191+0000 7f366bb18640 1 -- start start 2024-08-31T05:20:31.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.191+0000 7f366bb18640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3664100620 0x7f3664199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:31.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.191+0000 7f366bb18640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3664101820 0x7f36641999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:31.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.191+0000 7f366bb18640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3664109440 con 0x7f3664100620 2024-08-31T05:20:31.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.191+0000 7f366bb18640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f36641092c0 con 0x7f3664101820 2024-08-31T05:20:31.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.191+0000 7f36698b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3664100620 0x7f3664199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:31.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.191+0000 7f36698b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3664100620 0x7f3664199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58138/0 (socket says 172.21.15.67:58138) 2024-08-31T05:20:31.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.191+0000 7f36698b4640 1 -- 172.21.15.67:0/2060758477 learned_addr learned my addr 172.21.15.67:0/2060758477 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:20:31.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.191+0000 7f36690b3640 1 --2- 172.21.15.67:0/2060758477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3664101820 0x7f36641999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:31.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.192+0000 7f36698b4640 1 -- 172.21.15.67:0/2060758477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3664101820 msgr2=0x7f36641999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:31.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.192+0000 7f36698b4640 1 --2- 172.21.15.67:0/2060758477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3664101820 0x7f36641999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.192+0000 7f36698b4640 1 -- 172.21.15.67:0/2060758477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366419a030 con 0x7f3664100620 2024-08-31T05:20:31.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.192+0000 7f36698b4640 1 --2- 172.21.15.67:0/2060758477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3664100620 0x7f3664199470 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3660009230 tx=0x7f36600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:20:31.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.192+0000 7f365affd640 1 -- 172.21.15.67:0/2060758477 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f366003f070 con 0x7f3664100620 2024-08-31T05:20:31.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.192+0000 7f365affd640 1 -- 172.21.15.67:0/2060758477 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36600049d0 con 0x7f3664100620 2024-08-31T05:20:31.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.192+0000 7f366bb18640 1 -- 172.21.15.67:0/2060758477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366419ea10 con 0x7f3664100620 2024-08-31T05:20:31.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.192+0000 7f365affd640 1 -- 172.21.15.67:0/2060758477 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3660035030 con 0x7f3664100620 2024-08-31T05:20:31.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.193+0000 7f366bb18640 1 -- 172.21.15.67:0/2060758477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f366419efa0 con 0x7f3664100620 2024-08-31T05:20:31.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.194+0000 7f366bb18640 1 -- 172.21.15.67:0/2060758477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3664100a20 con 0x7f3664100620 2024-08-31T05:20:31.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.195+0000 7f365affd640 1 -- 172.21.15.67:0/2060758477 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7f3660042070 con 0x7f3664100620 2024-08-31T05:20:31.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.195+0000 7f365affd640 1 --2- 172.21.15.67:0/2060758477 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f3650073fa0 0x7f3650076460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:31.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.195+0000 7f365affd640 1 -- 172.21.15.67:0/2060758477 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f36600b5b90 con 0x7f3664100620 2024-08-31T05:20:31.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.196+0000 7f36690b3640 1 --2- 172.21.15.67:0/2060758477 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f3650073fa0 0x7f3650076460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:31.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.196+0000 7f36690b3640 1 --2- 172.21.15.67:0/2060758477 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f3650073fa0 0x7f3650076460 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f366419a920 tx=0x7f3654005f90 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:20:31.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.201+0000 7f365affd640 1 -- 172.21.15.67:0/2060758477 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f366007d660 con 0x7f3664100620 2024-08-31T05:20:31.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.491+0000 7f366bb18640 1 -- 172.21.15.67:0/2060758477 --> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3664104d00 con 0x7f3650073fa0 2024-08-31T05:20:31.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.513+0000 7f365affd640 1 -- 172.21.15.67:0/2060758477 <== mgr.24383 v2:172.21.15.73:6828/1567621854 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f3664104d00 con 0x7f3650073fa0 2024-08-31T05:20:31.515 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:20:31.515 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (5m) 106s ago 7m 26.4M - 0.25.0 c8568f914cd2 cad2b6757f0e 2024-08-31T05:20:31.515 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (7m) 106s ago 7m 8388k - 19.1.1-242-g244a32d3 395b9209a980 87adb449d2b7 2024-08-31T05:20:31.515 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (6m) 0s ago 6m 5263k - 19.1.1-242-g244a32d3 395b9209a980 d95ba11fe269 2024-08-31T05:20:31.515 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (7m) 106s ago 7m 6895k - 19.1.1-242-g244a32d3 395b9209a980 a47c71179c57 2024-08-31T05:20:31.515 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (6m) 0s ago 6m 6895k - 19.1.1-242-g244a32d3 395b9209a980 5f2ce08c4451 2024-08-31T05:20:31.516 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (5m) 106s ago 7m 76.9M - 9.4.12 2bacad6d85d8 ac51e53c0deb 2024-08-31T05:20:31.516 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (2m) 106s ago 2m 15.7M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:20:31.516 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (2m) 106s ago 2m 17.2M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:20:31.516 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (2m) 0s ago 2m 12.3M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:20:31.516 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (2m) 0s ago 2m 14.1M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:20:31.516 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:9283,8765,8443 running (8m) 106s ago 8m 498M - 19.1.1-242-g244a32d3 395b9209a980 436d56f83ade 2024-08-31T05:20:31.516 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (27s) 0s ago 6m 564M - 19.3.0-4560-gd19e6118 79f4cde5e369 d18b213f9418 2024-08-31T05:20:31.516 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (8m) 106s ago 8m 47.9M 2048M 19.1.1-242-g244a32d3 395b9209a980 7082a38c8108 2024-08-31T05:20:31.516 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (6m) 0s ago 6m 38.1M 2048M 19.1.1-242-g244a32d3 395b9209a980 30ccf0ed274b 2024-08-31T05:20:31.516 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (7m) 106s ago 7m 16.1M - 1.5.0 0da6a335fe13 d7c795c5bd95 2024-08-31T05:20:31.516 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (6m) 0s ago 6m 16.4M - 1.5.0 0da6a335fe13 f718603a0e92 2024-08-31T05:20:31.516 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (5m) 106s ago 5m 47.0M 3946M 19.1.1-242-g244a32d3 395b9209a980 b9f3f60b65f9 2024-08-31T05:20:31.516 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (4m) 106s ago 4m 54.9M 3946M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:20:31.517 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (4m) 106s ago 4m 52.9M 3946M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:20:31.517 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (4m) 0s ago 4m 88.5M 4970M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:20:31.517 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (3m) 0s ago 3m 84.1M 4970M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:20:31.517 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (3m) 0s ago 3m 76.5M 4970M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:20:31.517 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (5m) 106s ago 6m 58.3M - 2.43.0 a07b618ecd1d 9a2383a57b2c 2024-08-31T05:20:31.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.516+0000 7f366bb18640 1 -- 172.21.15.67:0/2060758477 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f3650073fa0 msgr2=0x7f3650076460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:31.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.516+0000 7f366bb18640 1 --2- 172.21.15.67:0/2060758477 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f3650073fa0 0x7f3650076460 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f366419a920 tx=0x7f3654005f90 comp rx=0 tx=0).stop 2024-08-31T05:20:31.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.516+0000 7f366bb18640 1 -- 172.21.15.67:0/2060758477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3664100620 msgr2=0x7f3664199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:31.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.516+0000 7f366bb18640 1 --2- 172.21.15.67:0/2060758477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3664100620 0x7f3664199470 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3660009230 tx=0x7f36600045e0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.516+0000 7f366bb18640 1 -- 172.21.15.67:0/2060758477 shutdown_connections 2024-08-31T05:20:31.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.516+0000 7f366bb18640 1 --2- 172.21.15.67:0/2060758477 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f3650073fa0 0x7f3650076460 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.516+0000 7f366bb18640 1 --2- 172.21.15.67:0/2060758477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3664101820 0x7f36641999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.516+0000 7f366bb18640 1 --2- 172.21.15.67:0/2060758477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3664100620 0x7f3664199470 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.516+0000 7f366bb18640 1 -- 172.21.15.67:0/2060758477 >> 172.21.15.67:0/2060758477 conn(0x7f36640fbdb0 msgr2=0x7f36640fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:20:31.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.516+0000 7f366bb18640 1 -- 172.21.15.67:0/2060758477 shutdown_connections 2024-08-31T05:20:31.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.516+0000 7f366bb18640 1 -- 172.21.15.67:0/2060758477 wait complete. 2024-08-31T05:20:31.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.624+0000 7f0462896640 1 -- 172.21.15.67:0/1762525321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f045c101800 msgr2=0x7f045c101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:31.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.624+0000 7f0462896640 1 --2- 172.21.15.67:0/1762525321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f045c101800 0x7f045c101c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0450009880 tx=0x7f045002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.625+0000 7f0462896640 1 -- 172.21.15.67:0/1762525321 shutdown_connections 2024-08-31T05:20:31.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.625+0000 7f0462896640 1 --2- 172.21.15.67:0/1762525321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f045c101800 0x7f045c101c80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.625+0000 7f0462896640 1 --2- 172.21.15.67:0/1762525321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f045c100600 0x7f045c100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.625+0000 7f0462896640 1 -- 172.21.15.67:0/1762525321 >> 172.21.15.67:0/1762525321 conn(0x7f045c0fbdb0 msgr2=0x7f045c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:20:31.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.625+0000 7f0462896640 1 -- 172.21.15.67:0/1762525321 shutdown_connections 2024-08-31T05:20:31.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.625+0000 7f0462896640 1 -- 172.21.15.67:0/1762525321 wait complete. 2024-08-31T05:20:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.625+0000 7f0462896640 1 Processor -- start 2024-08-31T05:20:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.625+0000 7f0462896640 1 -- start start 2024-08-31T05:20:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.626+0000 7f0462896640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f045c100600 0x7f045c06a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.626+0000 7f0462896640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f045c101800 0x7f045c19bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.626+0000 7f0462896640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f045c109420 con 0x7f045c100600 2024-08-31T05:20:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.626+0000 7f0462896640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f045c1092a0 con 0x7f045c101800 2024-08-31T05:20:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.626+0000 7f045bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f045c100600 0x7f045c06a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.626+0000 7f045bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f045c100600 0x7f045c06a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58154/0 (socket says 172.21.15.67:58154) 2024-08-31T05:20:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.626+0000 7f045bfff640 1 -- 172.21.15.67:0/3687292849 learned_addr learned my addr 172.21.15.67:0/3687292849 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:20:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.626+0000 7f045b7fe640 1 --2- 172.21.15.67:0/3687292849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f045c101800 0x7f045c19bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.626+0000 7f045bfff640 1 -- 172.21.15.67:0/3687292849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f045c101800 msgr2=0x7f045c19bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.626+0000 7f045bfff640 1 --2- 172.21.15.67:0/3687292849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f045c101800 0x7f045c19bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.626+0000 7f045bfff640 1 -- 172.21.15.67:0/3687292849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045c19c580 con 0x7f045c100600 2024-08-31T05:20:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.627+0000 7f045bfff640 1 --2- 172.21.15.67:0/3687292849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f045c100600 0x7f045c06a530 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f044c00e940 tx=0x7f044c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:20:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.627+0000 7f04597fa640 1 -- 172.21.15.67:0/3687292849 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f044c00cac0 con 0x7f045c100600 2024-08-31T05:20:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.627+0000 7f04597fa640 1 -- 172.21.15.67:0/3687292849 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f044c00cc60 con 0x7f045c100600 2024-08-31T05:20:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.627+0000 7f0462896640 1 -- 172.21.15.67:0/3687292849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045c19c870 con 0x7f045c100600 2024-08-31T05:20:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.627+0000 7f0462896640 1 -- 172.21.15.67:0/3687292849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045c19ce00 con 0x7f045c100600 2024-08-31T05:20:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.627+0000 7f04597fa640 1 -- 172.21.15.67:0/3687292849 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f044c003dd0 con 0x7f045c100600 2024-08-31T05:20:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.628+0000 7f0462896640 1 -- 172.21.15.67:0/3687292849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f045c100a00 con 0x7f045c100600 2024-08-31T05:20:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.629+0000 7f04597fa640 1 -- 172.21.15.67:0/3687292849 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7f044c004000 con 0x7f045c100600 2024-08-31T05:20:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.629+0000 7f04597fa640 1 --2- 172.21.15.67:0/3687292849 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f0444073f40 0x7f0444076400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.630+0000 7f04597fa640 1 -- 172.21.15.67:0/3687292849 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f044c095b90 con 0x7f045c100600 2024-08-31T05:20:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.630+0000 7f045b7fe640 1 --2- 172.21.15.67:0/3687292849 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f0444073f40 0x7f0444076400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:31.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.630+0000 7f045b7fe640 1 --2- 172.21.15.67:0/3687292849 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f0444073f40 0x7f0444076400 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f045c06a2b0 tx=0x7f0450009620 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:20:31.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:31.635+0000 7f04597fa640 1 -- 172.21.15.67:0/3687292849 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f044c016330 con 0x7f045c100600 2024-08-31T05:20:31.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:31 smithi073 ceph-mon[24726]: mgrmap e25: smithi073.zfoyxd(active, since 7s), standbys: smithi067.hftacj 2024-08-31T05:20:31.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:31 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mgr metadata", "who": "smithi067.hftacj", "id": "smithi067.hftacj"}]: dispatch 2024-08-31T05:20:31.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:31 smithi073 ceph-mon[24726]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:31.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:31 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:31.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:31 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:31.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:31 smithi067 ceph-mon[17432]: mgrmap e25: smithi073.zfoyxd(active, since 7s), standbys: smithi067.hftacj 2024-08-31T05:20:31.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:31 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mgr metadata", "who": "smithi067.hftacj", "id": "smithi067.hftacj"}]: dispatch 2024-08-31T05:20:31.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:31 smithi067 ceph-mon[17432]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:31.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:31 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:31.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:31 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:32.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.044+0000 7f0462896640 1 -- 172.21.15.67:0/3687292849 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f045c062b90 con 0x7f045c100600 2024-08-31T05:20:32.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.045+0000 7f04597fa640 1 -- 172.21.15.67:0/3687292849 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f044c05d5d0 con 0x7f045c100600 2024-08-31T05:20:32.047 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:20:32.047 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:20:32.047 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2 2024-08-31T05:20:32.047 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:20:32.047 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:20:32.047 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 1, 2024-08-31T05:20:32.048 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 1 2024-08-31T05:20:32.048 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:20:32.048 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:20:32.048 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 6 2024-08-31T05:20:32.048 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:20:32.048 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:20:32.048 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:20:32.048 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:20:32.048 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:20:32.048 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 13, 2024-08-31T05:20:32.048 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 1 2024-08-31T05:20:32.048 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:20:32.048 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:20:32.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.048+0000 7f0462896640 1 -- 172.21.15.67:0/3687292849 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f0444073f40 msgr2=0x7f0444076400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:32.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.048+0000 7f0462896640 1 --2- 172.21.15.67:0/3687292849 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f0444073f40 0x7f0444076400 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f045c06a2b0 tx=0x7f0450009620 comp rx=0 tx=0).stop 2024-08-31T05:20:32.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.048+0000 7f0462896640 1 -- 172.21.15.67:0/3687292849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f045c100600 msgr2=0x7f045c06a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:32.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.048+0000 7f0462896640 1 --2- 172.21.15.67:0/3687292849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f045c100600 0x7f045c06a530 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f044c00e940 tx=0x7f044c00ee00 comp rx=0 tx=0).stop 2024-08-31T05:20:32.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.048+0000 7f0462896640 1 -- 172.21.15.67:0/3687292849 shutdown_connections 2024-08-31T05:20:32.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.048+0000 7f0462896640 1 --2- 172.21.15.67:0/3687292849 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f0444073f40 0x7f0444076400 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:32.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.048+0000 7f0462896640 1 --2- 172.21.15.67:0/3687292849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f045c101800 0x7f045c19bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:32.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.048+0000 7f0462896640 1 --2- 172.21.15.67:0/3687292849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f045c100600 0x7f045c06a530 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:32.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.048+0000 7f0462896640 1 -- 172.21.15.67:0/3687292849 >> 172.21.15.67:0/3687292849 conn(0x7f045c0fbdb0 msgr2=0x7f045c104d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:20:32.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.048+0000 7f0462896640 1 -- 172.21.15.67:0/3687292849 shutdown_connections 2024-08-31T05:20:32.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.049+0000 7f0462896640 1 -- 172.21.15.67:0/3687292849 wait complete. 2024-08-31T05:20:32.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.174+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/101096075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fdc100600 msgr2=0x7f8fdc100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:32.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.174+0000 7f8fe0ac8640 1 --2- 172.21.15.67:0/101096075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fdc100600 0x7f8fdc100a00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009880 tx=0x7f8fcc02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:20:32.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.174+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/101096075 shutdown_connections 2024-08-31T05:20:32.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.174+0000 7f8fe0ac8640 1 --2- 172.21.15.67:0/101096075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fdc101800 0x7f8fdc101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:32.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.174+0000 7f8fe0ac8640 1 --2- 172.21.15.67:0/101096075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fdc100600 0x7f8fdc100a00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:32.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.174+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/101096075 >> 172.21.15.67:0/101096075 conn(0x7f8fdc0fbdb0 msgr2=0x7f8fdc0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:20:32.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.174+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/101096075 shutdown_connections 2024-08-31T05:20:32.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.174+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/101096075 wait complete. 2024-08-31T05:20:32.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.175+0000 7f8fe0ac8640 1 Processor -- start 2024-08-31T05:20:32.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.175+0000 7f8fe0ac8640 1 -- start start 2024-08-31T05:20:32.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.175+0000 7f8fe0ac8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fdc100600 0x7f8fdc104520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:32.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.175+0000 7f8fe0ac8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fdc101800 0x7f8fdc102be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:32.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.175+0000 7f8fe0ac8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc109440 con 0x7f8fdc100600 2024-08-31T05:20:32.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.175+0000 7f8fe0ac8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc1092c0 con 0x7f8fdc101800 2024-08-31T05:20:32.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.176+0000 7f8fda59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fdc100600 0x7f8fdc104520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:32.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.176+0000 7f8fda59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fdc100600 0x7f8fdc104520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58176/0 (socket says 172.21.15.67:58176) 2024-08-31T05:20:32.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.176+0000 7f8fda59c640 1 -- 172.21.15.67:0/283944900 learned_addr learned my addr 172.21.15.67:0/283944900 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:20:32.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.176+0000 7f8fd9d9b640 1 --2- 172.21.15.67:0/283944900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fdc101800 0x7f8fdc102be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:32.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.176+0000 7f8fda59c640 1 -- 172.21.15.67:0/283944900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fdc101800 msgr2=0x7f8fdc102be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:32.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.176+0000 7f8fda59c640 1 --2- 172.21.15.67:0/283944900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fdc101800 0x7f8fdc102be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:32.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.176+0000 7f8fda59c640 1 -- 172.21.15.67:0/283944900 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc103120 con 0x7f8fdc100600 2024-08-31T05:20:32.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.176+0000 7f8fd9d9b640 1 --2- 172.21.15.67:0/283944900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fdc101800 0x7f8fdc102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:20:32.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.176+0000 7f8fda59c640 1 --2- 172.21.15.67:0/283944900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fdc100600 0x7f8fdc104520 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc006010 tx=0x7f8fcc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:20:32.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.177+0000 7f8fcb7fe640 1 -- 172.21.15.67:0/283944900 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8fcc03f070 con 0x7f8fdc100600 2024-08-31T05:20:32.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.177+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/283944900 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fdc1033b0 con 0x7f8fdc100600 2024-08-31T05:20:32.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.177+0000 7f8fcb7fe640 1 -- 172.21.15.67:0/283944900 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8fcc0049d0 con 0x7f8fdc100600 2024-08-31T05:20:32.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.177+0000 7f8fcb7fe640 1 -- 172.21.15.67:0/283944900 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8fcc035030 con 0x7f8fdc100600 2024-08-31T05:20:32.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.177+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/283944900 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fdc1038e0 con 0x7f8fdc100600 2024-08-31T05:20:32.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.179+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/283944900 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fdc100a00 con 0x7f8fdc100600 2024-08-31T05:20:32.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.179+0000 7f8fcb7fe640 1 -- 172.21.15.67:0/283944900 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7f8fcc042070 con 0x7f8fdc100600 2024-08-31T05:20:32.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.180+0000 7f8fcb7fe640 1 --2- 172.21.15.67:0/283944900 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f8fc4073fa0 0x7f8fc4076460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:20:32.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.180+0000 7f8fcb7fe640 1 -- 172.21.15.67:0/283944900 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f8fcc0b5ec0 con 0x7f8fdc100600 2024-08-31T05:20:32.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.180+0000 7f8fd9d9b640 1 --2- 172.21.15.67:0/283944900 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f8fc4073fa0 0x7f8fc4076460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:20:32.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.181+0000 7f8fd9d9b640 1 --2- 172.21.15.67:0/283944900 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f8fc4073fa0 0x7f8fc4076460 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc1042a0 tx=0x7f8fd0005f90 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:20:32.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.187+0000 7f8fcb7fe640 1 -- 172.21.15.67:0/283944900 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f8fcc081b00 con 0x7f8fdc100600 2024-08-31T05:20:32.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.498+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/283944900 --> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8fdc06a200 con 0x7f8fc4073fa0 2024-08-31T05:20:32.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.500+0000 7f8fcb7fe640 1 -- 172.21.15.67:0/283944900 <== mgr.24383 v2:172.21.15.73:6828/1567621854 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f8fdc06a200 con 0x7f8fc4073fa0 2024-08-31T05:20:32.502 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:20:32.502 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:20:32.502 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:20:32.502 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-31T05:20:32.502 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [], 2024-08-31T05:20:32.502 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "1/2 daemons upgraded", 2024-08-31T05:20:32.502 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-08-31T05:20:32.502 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:20:32.502 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:20:32.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.504+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/283944900 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f8fc4073fa0 msgr2=0x7f8fc4076460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:32.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.504+0000 7f8fe0ac8640 1 --2- 172.21.15.67:0/283944900 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f8fc4073fa0 0x7f8fc4076460 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc1042a0 tx=0x7f8fd0005f90 comp rx=0 tx=0).stop 2024-08-31T05:20:32.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.504+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/283944900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fdc100600 msgr2=0x7f8fdc104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:20:32.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.504+0000 7f8fe0ac8640 1 --2- 172.21.15.67:0/283944900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fdc100600 0x7f8fdc104520 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc006010 tx=0x7f8fcc0045e0 comp rx=0 tx=0).stop 2024-08-31T05:20:32.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.504+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/283944900 shutdown_connections 2024-08-31T05:20:32.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.504+0000 7f8fe0ac8640 1 --2- 172.21.15.67:0/283944900 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f8fc4073fa0 0x7f8fc4076460 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc1042a0 tx=0x7f8fd0005f90 comp rx=0 tx=0).stop 2024-08-31T05:20:32.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.504+0000 7f8fe0ac8640 1 --2- 172.21.15.67:0/283944900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fdc101800 0x7f8fdc102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:20:32.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.504+0000 7f8fe0ac8640 1 --2- 172.21.15.67:0/283944900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fdc100600 0x7f8fdc104520 secure :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc006010 tx=0x7f8fcc0045e0 comp rx=0 tx=0).stop 2024-08-31T05:20:32.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.504+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/283944900 >> 172.21.15.67:0/283944900 conn(0x7f8fdc0fbdb0 msgr2=0x7f8fdc069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:20:32.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.505+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/283944900 shutdown_connections 2024-08-31T05:20:32.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:20:32.506+0000 7f8fe0ac8640 1 -- 172.21.15.67:0/283944900 wait complete. 2024-08-31T05:20:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:32 smithi073 ceph-mon[24726]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:32 smithi073 ceph-mon[24726]: pgmap v7: 65 pgs: 65 active+clean; 121 MiB data, 604 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 109 op/s 2024-08-31T05:20:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:32 smithi073 ceph-mon[24726]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:32 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:32 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:32 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3687292849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:20:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:32 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:32 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:33.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:32 smithi067 ceph-mon[17432]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:33.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:32 smithi067 ceph-mon[17432]: pgmap v7: 65 pgs: 65 active+clean; 121 MiB data, 604 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 109 op/s 2024-08-31T05:20:33.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:32 smithi067 ceph-mon[17432]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:33.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:32 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:33.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:32 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:33.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:32 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3687292849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:20:33.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:32 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:33.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:32 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:33.923 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:33 smithi073 ceph-mon[24726]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:33.923 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:33 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:33.923 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:33 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:33.923 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:33 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:33.923 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:33 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:33.923 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:33 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:33.923 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:33 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:33.923 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:33 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:33.924 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:33 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:33.924 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:33 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:34.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:33 smithi067 ceph-mon[17432]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:33 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:33 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:33 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:33 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:33 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:33 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:33 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:33 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:33 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:34.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:34 smithi073 ceph-mon[24726]: Adjusting osd_memory_target on smithi067 to 1216M 2024-08-31T05:20:34.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:34 smithi073 ceph-mon[24726]: pgmap v8: 65 pgs: 65 active+clean; 121 MiB data, 604 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 85 op/s 2024-08-31T05:20:35.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:34 smithi067 ceph-mon[17432]: Adjusting osd_memory_target on smithi067 to 1216M 2024-08-31T05:20:35.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:34 smithi067 ceph-mon[17432]: pgmap v8: 65 pgs: 65 active+clean; 121 MiB data, 604 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 85 op/s 2024-08-31T05:20:36.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:36.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:36.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:36.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:36.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:36.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:36.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:36.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:36.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: Adjusting osd_memory_target on smithi073 to 2240M 2024-08-31T05:20:36.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:36.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:20:36.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:20:36.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: Updating smithi067:/etc/ceph/ceph.conf 2024-08-31T05:20:36.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: Updating smithi073:/etc/ceph/ceph.conf 2024-08-31T05:20:36.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: pgmap v9: 65 pgs: 65 active+clean; 142 MiB data, 632 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 196 op/s 2024-08-31T05:20:36.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: Updating smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:36.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: Updating smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:36.698 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:20:36.698 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:20:36.698 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:36.698 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:36 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:36.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:36.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:36.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:36.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:36.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:36.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:36.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:36.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-31T05:20:36.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: Adjusting osd_memory_target on smithi073 to 2240M 2024-08-31T05:20:36.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:36.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:20:36.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:20:36.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: Updating smithi067:/etc/ceph/ceph.conf 2024-08-31T05:20:36.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: Updating smithi073:/etc/ceph/ceph.conf 2024-08-31T05:20:36.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: pgmap v9: 65 pgs: 65 active+clean; 142 MiB data, 632 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 196 op/s 2024-08-31T05:20:36.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: Updating smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:36.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: Updating smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:36.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:20:36.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:20:36.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:36.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:36 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:37 smithi067 ceph-mon[17432]: Updating smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:20:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:37 smithi067 ceph-mon[17432]: Updating smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:20:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:37 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:37 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:37 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:37 smithi067 ceph-mon[17432]: Reconfiguring ceph-exporter.smithi067 (dependencies changed)... 2024-08-31T05:20:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:37 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi067", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:20:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:37 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi067", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:20:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:37 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:20:37.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:37 smithi067 ceph-mon[17432]: Deploying daemon ceph-exporter.smithi067 on smithi067 2024-08-31T05:20:37.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:37 smithi073 ceph-mon[24726]: Updating smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:20:37.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:37 smithi073 ceph-mon[24726]: Updating smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:20:37.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:37 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:37.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:37 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:37.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:37 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:37.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:37 smithi073 ceph-mon[24726]: Reconfiguring ceph-exporter.smithi067 (dependencies changed)... 2024-08-31T05:20:37.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:37 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi067", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:20:37.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:37 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi067", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:20:37.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:37 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:20:37.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:37 smithi073 ceph-mon[24726]: Deploying daemon ceph-exporter.smithi067 on smithi067 2024-08-31T05:20:38.500 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:38 smithi067 ceph-mon[17432]: pgmap v10: 65 pgs: 65 active+clean; 142 MiB data, 632 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 180 op/s 2024-08-31T05:20:38.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:38 smithi073 ceph-mon[24726]: pgmap v10: 65 pgs: 65 active+clean; 142 MiB data, 632 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 180 op/s 2024-08-31T05:20:40.609 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:40 smithi067 ceph-mon[17432]: pgmap v11: 65 pgs: 65 active+clean; 154 MiB data, 688 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 271 op/s 2024-08-31T05:20:40.609 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:40 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:20:40.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:40 smithi073 ceph-mon[24726]: pgmap v11: 65 pgs: 65 active+clean; 154 MiB data, 688 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 271 op/s 2024-08-31T05:20:40.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:40 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:20:42.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:42 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:42.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:42 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:42.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:42 smithi067 ceph-mon[17432]: Reconfiguring prometheus.smithi067 (dependencies changed)... 2024-08-31T05:20:42.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:42 smithi067 ceph-mon[17432]: pgmap v12: 65 pgs: 65 active+clean; 162 MiB data, 702 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 298 op/s 2024-08-31T05:20:42.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:42 smithi067 ceph-mon[17432]: Reconfiguring daemon prometheus.smithi067 on smithi067 2024-08-31T05:20:42.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:42 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:42.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:42 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:20:42.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:42 smithi073 ceph-mon[24726]: Reconfiguring prometheus.smithi067 (dependencies changed)... 2024-08-31T05:20:42.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:42 smithi073 ceph-mon[24726]: pgmap v12: 65 pgs: 65 active+clean; 162 MiB data, 702 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 298 op/s 2024-08-31T05:20:42.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:42 smithi073 ceph-mon[24726]: Reconfiguring daemon prometheus.smithi067 on smithi067 2024-08-31T05:20:44.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:44 smithi067 ceph-mon[17432]: pgmap v13: 65 pgs: 65 active+clean; 162 MiB data, 702 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 248 op/s 2024-08-31T05:20:44.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:44 smithi073 ceph-mon[24726]: pgmap v13: 65 pgs: 65 active+clean; 162 MiB data, 702 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 248 op/s 2024-08-31T05:20:46.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:46 smithi073 ceph-mon[24726]: pgmap v14: 65 pgs: 65 active+clean; 176 MiB data, 760 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 401 op/s 2024-08-31T05:20:46.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:46 smithi067 ceph-mon[17432]: pgmap v14: 65 pgs: 65 active+clean; 176 MiB data, 760 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 401 op/s 2024-08-31T05:20:48.823 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:48 smithi067 ceph-mon[17432]: pgmap v15: 65 pgs: 65 active+clean; 176 MiB data, 760 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 285 op/s 2024-08-31T05:20:48.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:48 smithi073 ceph-mon[24726]: pgmap v15: 65 pgs: 65 active+clean; 176 MiB data, 760 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 285 op/s 2024-08-31T05:20:50.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:50 smithi067 ceph-mon[17432]: pgmap v16: 65 pgs: 65 active+clean; 187 MiB data, 792 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 402 op/s 2024-08-31T05:20:50.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:50 smithi073 ceph-mon[24726]: pgmap v16: 65 pgs: 65 active+clean; 187 MiB data, 792 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 402 op/s 2024-08-31T05:20:51.635 INFO:tasks.workunit.client.1.smithi073.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-08-31T05:20:51.640 INFO:tasks.workunit.client.1.smithi073.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-08-31T05:20:51.640 INFO:tasks.workunit.client.1.smithi073.stderr:+ make 2024-08-31T05:20:52.450 INFO:tasks.workunit.client.1.smithi073.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-08-31T05:20:52.820 INFO:tasks.workunit.client.1.smithi073.stderr:++ readlink -f fsstress 2024-08-31T05:20:52.822 INFO:tasks.workunit.client.1.smithi073.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-08-31T05:20:52.822 INFO:tasks.workunit.client.1.smithi073.stderr:+ popd 2024-08-31T05:20:52.823 INFO:tasks.workunit.client.1.smithi073.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-08-31T05:20:52.823 INFO:tasks.workunit.client.1.smithi073.stderr:+ popd 2024-08-31T05:20:52.823 INFO:tasks.workunit.client.1.smithi073.stdout:~/cephtest/mnt.1/client.1/tmp 2024-08-31T05:20:52.824 INFO:tasks.workunit.client.1.smithi073.stderr:++ mktemp -d -p . 2024-08-31T05:20:52.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:52 smithi067 ceph-mon[17432]: pgmap v17: 65 pgs: 65 active+clean; 197 MiB data, 814 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 352 op/s 2024-08-31T05:20:52.826 INFO:tasks.workunit.client.1.smithi073.stderr:+ T=./tmp.XN6wATsPTV 2024-08-31T05:20:52.826 INFO:tasks.workunit.client.1.smithi073.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.XN6wATsPTV -l 1 -n 1000 -p 10 -v 2024-08-31T05:20:52.830 INFO:tasks.workunit.client.1.smithi073.stdout:seed = 1725825442 2024-08-31T05:20:52.835 INFO:tasks.workunit.client.1.smithi073.stdout:0/0: link - no file 2024-08-31T05:20:52.835 INFO:tasks.workunit.client.1.smithi073.stdout:0/1: read - no filename 2024-08-31T05:20:52.835 INFO:tasks.workunit.client.1.smithi073.stdout:0/2: read - no filename 2024-08-31T05:20:52.835 INFO:tasks.workunit.client.1.smithi073.stdout:0/3: dread - no filename 2024-08-31T05:20:52.835 INFO:tasks.workunit.client.1.smithi073.stdout:0/4: read - no filename 2024-08-31T05:20:52.835 INFO:tasks.workunit.client.1.smithi073.stdout:0/5: dwrite - no filename 2024-08-31T05:20:52.835 INFO:tasks.workunit.client.1.smithi073.stdout:0/6: dread - no filename 2024-08-31T05:20:52.835 INFO:tasks.workunit.client.1.smithi073.stdout:0/7: write - no filename 2024-08-31T05:20:52.835 INFO:tasks.workunit.client.1.smithi073.stdout:0/8: dread - no filename 2024-08-31T05:20:52.836 INFO:tasks.workunit.client.1.smithi073.stdout:0/9: chown . 493418 1 2024-08-31T05:20:52.836 INFO:tasks.workunit.client.1.smithi073.stdout:0/10: dread - no filename 2024-08-31T05:20:52.836 INFO:tasks.workunit.client.1.smithi073.stdout:0/11: dwrite - no filename 2024-08-31T05:20:52.836 INFO:tasks.workunit.client.1.smithi073.stdout:0/12: write - no filename 2024-08-31T05:20:52.836 INFO:tasks.workunit.client.1.smithi073.stdout:0/13: readlink - no filename 2024-08-31T05:20:52.836 INFO:tasks.workunit.client.1.smithi073.stdout:0/14: chown . 4 1 2024-08-31T05:20:52.838 INFO:tasks.workunit.client.1.smithi073.stdout:2/0: chown . 313113611 1 2024-08-31T05:20:52.839 INFO:tasks.workunit.client.1.smithi073.stdout:2/1: read - no filename 2024-08-31T05:20:52.839 INFO:tasks.workunit.client.1.smithi073.stdout:2/2: write - no filename 2024-08-31T05:20:52.839 INFO:tasks.workunit.client.1.smithi073.stdout:2/3: dread - no filename 2024-08-31T05:20:52.839 INFO:tasks.workunit.client.1.smithi073.stdout:2/4: chown . 1437 1 2024-08-31T05:20:52.839 INFO:tasks.workunit.client.1.smithi073.stdout:2/5: chown . 28790855 1 2024-08-31T05:20:52.839 INFO:tasks.workunit.client.1.smithi073.stdout:2/6: write - no filename 2024-08-31T05:20:52.839 INFO:tasks.workunit.client.1.smithi073.stdout:2/7: chown . 6 1 2024-08-31T05:20:52.839 INFO:tasks.workunit.client.1.smithi073.stdout:2/8: chown . 676796 1 2024-08-31T05:20:52.839 INFO:tasks.workunit.client.1.smithi073.stdout:2/9: dwrite - no filename 2024-08-31T05:20:52.840 INFO:tasks.workunit.client.1.smithi073.stdout:2/10: write - no filename 2024-08-31T05:20:52.840 INFO:tasks.workunit.client.1.smithi073.stdout:0/15: mkdir d0 0 2024-08-31T05:20:52.840 INFO:tasks.workunit.client.1.smithi073.stdout:0/16: chown d0 223282 1 2024-08-31T05:20:52.840 INFO:tasks.workunit.client.1.smithi073.stdout:0/17: write - no filename 2024-08-31T05:20:52.840 INFO:tasks.workunit.client.1.smithi073.stdout:3/0: link - no file 2024-08-31T05:20:52.841 INFO:tasks.workunit.client.1.smithi073.stdout:1/0: creat f0 x:0 0 0 2024-08-31T05:20:52.842 INFO:tasks.workunit.client.1.smithi073.stdout:1/1: truncate f0 909903 0 2024-08-31T05:20:52.844 INFO:tasks.workunit.client.1.smithi073.stdout:2/11: creat f0 x:0 0 0 2024-08-31T05:20:52.845 INFO:tasks.workunit.client.1.smithi073.stdout:0/18: mkdir d0/d1 0 2024-08-31T05:20:52.846 INFO:tasks.workunit.client.1.smithi073.stdout:0/19: dwrite - no filename 2024-08-31T05:20:52.846 INFO:tasks.workunit.client.1.smithi073.stdout:0/20: rename d0 to d0/d1/d2 22 2024-08-31T05:20:52.846 INFO:tasks.workunit.client.1.smithi073.stdout:1/2: mknod c1 0 2024-08-31T05:20:52.846 INFO:tasks.workunit.client.1.smithi073.stdout:1/3: read f0 [842490,41757] 0 2024-08-31T05:20:52.848 INFO:tasks.workunit.client.1.smithi073.stdout:5/0: rename - no filename 2024-08-31T05:20:52.848 INFO:tasks.workunit.client.1.smithi073.stdout:5/1: dread - no filename 2024-08-31T05:20:52.848 INFO:tasks.workunit.client.1.smithi073.stdout:5/2: dwrite - no filename 2024-08-31T05:20:52.848 INFO:tasks.workunit.client.1.smithi073.stdout:1/4: dread f0 [0,4194304] 0 2024-08-31T05:20:52.849 INFO:tasks.workunit.client.1.smithi073.stdout:2/12: creat f1 x:0 0 0 2024-08-31T05:20:52.849 INFO:tasks.workunit.client.1.smithi073.stdout:2/13: dread - f1 zero size 2024-08-31T05:20:52.849 INFO:tasks.workunit.client.1.smithi073.stdout:3/1: mknod c0 0 2024-08-31T05:20:52.850 INFO:tasks.workunit.client.1.smithi073.stdout:3/2: chown c0 12437 1 2024-08-31T05:20:52.850 INFO:tasks.workunit.client.1.smithi073.stdout:3/3: rmdir - no directory 2024-08-31T05:20:52.850 INFO:tasks.workunit.client.1.smithi073.stdout:3/4: chown c0 526900 1 2024-08-31T05:20:52.850 INFO:tasks.workunit.client.1.smithi073.stdout:3/5: dread - no filename 2024-08-31T05:20:52.851 INFO:tasks.workunit.client.1.smithi073.stdout:3/6: stat c0 0 2024-08-31T05:20:52.851 INFO:tasks.workunit.client.1.smithi073.stdout:3/7: truncate - no filename 2024-08-31T05:20:52.851 INFO:tasks.workunit.client.1.smithi073.stdout:0/21: rmdir d0 39 2024-08-31T05:20:52.851 INFO:tasks.workunit.client.1.smithi073.stdout:0/22: fdatasync - no filename 2024-08-31T05:20:52.851 INFO:tasks.workunit.client.1.smithi073.stdout:3/8: chown c0 55683 1 2024-08-31T05:20:52.852 INFO:tasks.workunit.client.1.smithi073.stdout:3/9: fsync - no filename 2024-08-31T05:20:52.852 INFO:tasks.workunit.client.1.smithi073.stdout:3/10: write - no filename 2024-08-31T05:20:52.852 INFO:tasks.workunit.client.1.smithi073.stdout:3/11: dread - no filename 2024-08-31T05:20:52.852 INFO:tasks.workunit.client.1.smithi073.stdout:3/12: chown c0 0 1 2024-08-31T05:20:52.852 INFO:tasks.workunit.client.1.smithi073.stdout:3/13: dread - no filename 2024-08-31T05:20:52.852 INFO:tasks.workunit.client.1.smithi073.stdout:3/14: dread - no filename 2024-08-31T05:20:52.852 INFO:tasks.workunit.client.1.smithi073.stdout:3/15: stat c0 0 2024-08-31T05:20:52.852 INFO:tasks.workunit.client.1.smithi073.stdout:3/16: dwrite - no filename 2024-08-31T05:20:52.852 INFO:tasks.workunit.client.1.smithi073.stdout:3/17: write - no filename 2024-08-31T05:20:52.852 INFO:tasks.workunit.client.1.smithi073.stdout:3/18: dwrite - no filename 2024-08-31T05:20:52.852 INFO:tasks.workunit.client.1.smithi073.stdout:3/19: dread - no filename 2024-08-31T05:20:52.853 INFO:tasks.workunit.client.1.smithi073.stdout:6/0: unlink - no file 2024-08-31T05:20:52.853 INFO:tasks.workunit.client.1.smithi073.stdout:6/1: rename - no filename 2024-08-31T05:20:52.853 INFO:tasks.workunit.client.1.smithi073.stdout:6/2: truncate - no filename 2024-08-31T05:20:52.853 INFO:tasks.workunit.client.1.smithi073.stdout:4/0: getdents . 0 2024-08-31T05:20:52.853 INFO:tasks.workunit.client.1.smithi073.stdout:4/1: chown . 47076 1 2024-08-31T05:20:52.854 INFO:tasks.workunit.client.1.smithi073.stdout:4/2: dwrite - no filename 2024-08-31T05:20:52.854 INFO:tasks.workunit.client.1.smithi073.stdout:4/3: dread - no filename 2024-08-31T05:20:52.854 INFO:tasks.workunit.client.1.smithi073.stdout:4/4: dread - no filename 2024-08-31T05:20:52.854 INFO:tasks.workunit.client.1.smithi073.stdout:4/5: truncate - no filename 2024-08-31T05:20:52.854 INFO:tasks.workunit.client.1.smithi073.stdout:4/6: unlink - no file 2024-08-31T05:20:52.854 INFO:tasks.workunit.client.1.smithi073.stdout:4/7: truncate - no filename 2024-08-31T05:20:52.854 INFO:tasks.workunit.client.1.smithi073.stdout:4/8: dread - no filename 2024-08-31T05:20:52.854 INFO:tasks.workunit.client.1.smithi073.stdout:4/9: chown . 22607 1 2024-08-31T05:20:52.854 INFO:tasks.workunit.client.1.smithi073.stdout:4/10: read - no filename 2024-08-31T05:20:52.856 INFO:tasks.workunit.client.1.smithi073.stdout:2/14: mkdir d2 0 2024-08-31T05:20:52.859 INFO:tasks.workunit.client.1.smithi073.stdout:3/20: rename c0 to c1 0 2024-08-31T05:20:52.860 INFO:tasks.workunit.client.1.smithi073.stdout:7/0: dread - no filename 2024-08-31T05:20:52.861 INFO:tasks.workunit.client.1.smithi073.stdout:5/3: symlink l0 0 2024-08-31T05:20:52.865 INFO:tasks.workunit.client.1.smithi073.stdout:6/3: creat f0 x:0 0 0 2024-08-31T05:20:52.868 INFO:tasks.workunit.client.1.smithi073.stdout:4/11: creat f0 x:0 0 0 2024-08-31T05:20:52.869 INFO:tasks.workunit.client.1.smithi073.stdout:4/12: read - f0 zero size 2024-08-31T05:20:52.869 INFO:tasks.workunit.client.1.smithi073.stdout:5/4: creat f1 x:0 0 0 2024-08-31T05:20:52.870 INFO:tasks.workunit.client.1.smithi073.stdout:2/15: mknod d2/c3 0 2024-08-31T05:20:52.873 INFO:tasks.workunit.client.1.smithi073.stdout:6/4: dwrite f0 [0,4194304] 0 2024-08-31T05:20:52.875 INFO:tasks.workunit.client.1.smithi073.stdout:7/1: getdents . 0 2024-08-31T05:20:52.877 INFO:tasks.workunit.client.1.smithi073.stdout:2/16: rename f0 to d2/f4 0 2024-08-31T05:20:52.879 INFO:tasks.workunit.client.1.smithi073.stdout:8/0: mkdir d0 0 2024-08-31T05:20:52.879 INFO:tasks.workunit.client.1.smithi073.stdout:8/1: dwrite - no filename 2024-08-31T05:20:52.879 INFO:tasks.workunit.client.1.smithi073.stdout:8/2: dread - no filename 2024-08-31T05:20:52.880 INFO:tasks.workunit.client.1.smithi073.stdout:8/3: dwrite - no filename 2024-08-31T05:20:52.880 INFO:tasks.workunit.client.1.smithi073.stdout:4/13: dwrite f0 [0,4194304] 0 2024-08-31T05:20:52.882 INFO:tasks.workunit.client.1.smithi073.stdout:6/5: symlink l1 0 2024-08-31T05:20:52.888 INFO:tasks.workunit.client.1.smithi073.stdout:2/17: fdatasync d2/f4 0 2024-08-31T05:20:52.888 INFO:tasks.workunit.client.1.smithi073.stdout:2/18: read - d2/f4 zero size 2024-08-31T05:20:52.891 INFO:tasks.workunit.client.1.smithi073.stdout:4/14: creat f1 x:0 0 0 2024-08-31T05:20:52.893 INFO:tasks.workunit.client.1.smithi073.stdout:9/0: creat f0 x:0 0 0 2024-08-31T05:20:52.895 INFO:tasks.workunit.client.1.smithi073.stdout:6/6: rename f0 to f2 0 2024-08-31T05:20:52.896 INFO:tasks.workunit.client.1.smithi073.stdout:2/19: dwrite d2/f4 [0,4194304] 0 2024-08-31T05:20:52.896 INFO:tasks.workunit.client.1.smithi073.stdout:7/2: symlink l0 0 2024-08-31T05:20:52.896 INFO:tasks.workunit.client.1.smithi073.stdout:7/3: fsync - no filename 2024-08-31T05:20:52.897 INFO:tasks.workunit.client.1.smithi073.stdout:7/4: dread - no filename 2024-08-31T05:20:52.897 INFO:tasks.workunit.client.1.smithi073.stdout:7/5: dwrite - no filename 2024-08-31T05:20:52.897 INFO:tasks.workunit.client.1.smithi073.stdout:7/6: read - no filename 2024-08-31T05:20:52.897 INFO:tasks.workunit.client.1.smithi073.stdout:7/7: truncate - no filename 2024-08-31T05:20:52.897 INFO:tasks.workunit.client.1.smithi073.stdout:2/20: fdatasync f1 0 2024-08-31T05:20:52.897 INFO:tasks.workunit.client.1.smithi073.stdout:7/8: chown l0 4036321 1 2024-08-31T05:20:52.897 INFO:tasks.workunit.client.1.smithi073.stdout:7/9: dread - no filename 2024-08-31T05:20:52.898 INFO:tasks.workunit.client.1.smithi073.stdout:7/10: dwrite - no filename 2024-08-31T05:20:52.900 INFO:tasks.workunit.client.1.smithi073.stdout:6/7: dread f2 [0,4194304] 0 2024-08-31T05:20:52.908 INFO:tasks.workunit.client.1.smithi073.stdout:8/4: mkdir d0/d1 0 2024-08-31T05:20:52.909 INFO:tasks.workunit.client.1.smithi073.stdout:4/15: symlink l2 0 2024-08-31T05:20:52.914 INFO:tasks.workunit.client.1.smithi073.stdout:7/11: mkdir d1 0 2024-08-31T05:20:52.915 INFO:tasks.workunit.client.1.smithi073.stdout:2/21: symlink d2/l5 0 2024-08-31T05:20:52.919 INFO:tasks.workunit.client.1.smithi073.stdout:4/16: symlink l3 0 2024-08-31T05:20:52.920 INFO:tasks.workunit.client.1.smithi073.stdout:2/22: symlink d2/l6 0 2024-08-31T05:20:52.924 INFO:tasks.workunit.client.1.smithi073.stdout:8/5: rmdir d0/d1 0 2024-08-31T05:20:52.925 INFO:tasks.workunit.client.1.smithi073.stdout:4/17: dwrite f1 [0,4194304] 0 2024-08-31T05:20:52.926 INFO:tasks.workunit.client.1.smithi073.stdout:8/6: mknod d0/c2 0 2024-08-31T05:20:52.927 INFO:tasks.workunit.client.1.smithi073.stdout:8/7: read - no filename 2024-08-31T05:20:52.927 INFO:tasks.workunit.client.1.smithi073.stdout:8/8: dread - no filename 2024-08-31T05:20:52.927 INFO:tasks.workunit.client.1.smithi073.stdout:8/9: write - no filename 2024-08-31T05:20:52.927 INFO:tasks.workunit.client.1.smithi073.stdout:4/18: rename l2 to l4 0 2024-08-31T05:20:52.930 INFO:tasks.workunit.client.1.smithi073.stdout:8/10: symlink d0/l3 0 2024-08-31T05:20:52.930 INFO:tasks.workunit.client.1.smithi073.stdout:8/11: dwrite - no filename 2024-08-31T05:20:52.931 INFO:tasks.workunit.client.1.smithi073.stdout:4/19: rename f1 to f5 0 2024-08-31T05:20:52.932 INFO:tasks.workunit.client.1.smithi073.stdout:4/20: write f0 [862636,1998] 0 2024-08-31T05:20:52.934 INFO:tasks.workunit.client.1.smithi073.stdout:8/12: rmdir d0 39 2024-08-31T05:20:52.941 INFO:tasks.workunit.client.1.smithi073.stdout:4/21: dwrite f5 [0,4194304] 0 2024-08-31T05:20:52.945 INFO:tasks.workunit.client.1.smithi073.stdout:4/22: symlink l6 0 2024-08-31T05:20:52.945 INFO:tasks.workunit.client.1.smithi073.stdout:4/23: read f0 [984241,68538] 0 2024-08-31T05:20:52.946 INFO:tasks.workunit.client.1.smithi073.stdout:4/24: rmdir - no directory 2024-08-31T05:20:52.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:52 smithi073 ceph-mon[24726]: pgmap v17: 65 pgs: 65 active+clean; 197 MiB data, 814 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 352 op/s 2024-08-31T05:20:52.946 INFO:tasks.workunit.client.1.smithi073.stdout:4/25: stat f0 0 2024-08-31T05:20:53.271 INFO:tasks.workunit.client.1.smithi073.stdout:0/23: rename d0 to d0/d1/d3 22 2024-08-31T05:20:53.271 INFO:tasks.workunit.client.1.smithi073.stdout:0/24: truncate - no filename 2024-08-31T05:20:53.271 INFO:tasks.workunit.client.1.smithi073.stdout:0/25: truncate - no filename 2024-08-31T05:20:53.303 INFO:tasks.workunit.client.1.smithi073.stdout:1/5: truncate f0 388441 0 2024-08-31T05:20:53.303 INFO:tasks.workunit.client.1.smithi073.stdout:1/6: rmdir - no directory 2024-08-31T05:20:53.309 INFO:tasks.workunit.client.1.smithi073.stdout:4/26: fsync f0 0 2024-08-31T05:20:53.320 INFO:tasks.workunit.client.1.smithi073.stdout:6/8: dwrite f2 [4194304,4194304] 0 2024-08-31T05:20:53.331 INFO:tasks.workunit.client.1.smithi073.stdout:9/1: fsync f0 0 2024-08-31T05:20:53.366 INFO:tasks.workunit.client.1.smithi073.stdout:0/26: creat d0/f4 x:0 0 0 2024-08-31T05:20:53.367 INFO:tasks.workunit.client.1.smithi073.stdout:3/21: rename c1 to c2 0 2024-08-31T05:20:53.367 INFO:tasks.workunit.client.1.smithi073.stdout:3/22: write - no filename 2024-08-31T05:20:53.367 INFO:tasks.workunit.client.1.smithi073.stdout:3/23: dread - no filename 2024-08-31T05:20:53.368 INFO:tasks.workunit.client.1.smithi073.stdout:1/7: creat f2 x:0 0 0 2024-08-31T05:20:53.369 INFO:tasks.workunit.client.1.smithi073.stdout:4/27: mkdir d7 0 2024-08-31T05:20:53.370 INFO:tasks.workunit.client.1.smithi073.stdout:8/13: creat d0/f4 x:0 0 0 2024-08-31T05:20:53.374 INFO:tasks.workunit.client.1.smithi073.stdout:9/2: creat f1 x:0 0 0 2024-08-31T05:20:53.374 INFO:tasks.workunit.client.1.smithi073.stdout:4/28: write f5 [4220569,99421] 0 2024-08-31T05:20:53.375 INFO:tasks.workunit.client.1.smithi073.stdout:0/27: mknod d0/c5 0 2024-08-31T05:20:53.375 INFO:tasks.workunit.client.1.smithi073.stdout:9/3: write f0 [734632,73860] 0 2024-08-31T05:20:53.377 INFO:tasks.workunit.client.1.smithi073.stdout:1/8: symlink l3 0 2024-08-31T05:20:53.381 INFO:tasks.workunit.client.1.smithi073.stdout:8/14: creat d0/f5 x:0 0 0 2024-08-31T05:20:53.382 INFO:tasks.workunit.client.1.smithi073.stdout:6/9: link f2 f3 0 2024-08-31T05:20:53.386 INFO:tasks.workunit.client.1.smithi073.stdout:9/4: rename f0 to f2 0 2024-08-31T05:20:53.388 INFO:tasks.workunit.client.1.smithi073.stdout:1/9: creat f4 x:0 0 0 2024-08-31T05:20:53.389 INFO:tasks.workunit.client.1.smithi073.stdout:8/15: mknod d0/c6 0 2024-08-31T05:20:53.389 INFO:tasks.workunit.client.1.smithi073.stdout:8/16: dread - d0/f5 zero size 2024-08-31T05:20:53.390 INFO:tasks.workunit.client.1.smithi073.stdout:6/10: mknod c4 0 2024-08-31T05:20:53.390 INFO:tasks.workunit.client.1.smithi073.stdout:6/11: stat f3 0 2024-08-31T05:20:53.392 INFO:tasks.workunit.client.1.smithi073.stdout:4/29: creat d7/f8 x:0 0 0 2024-08-31T05:20:53.395 INFO:tasks.workunit.client.1.smithi073.stdout:9/5: creat f3 x:0 0 0 2024-08-31T05:20:53.398 INFO:tasks.workunit.client.1.smithi073.stdout:8/17: creat d0/f7 x:0 0 0 2024-08-31T05:20:53.398 INFO:tasks.workunit.client.1.smithi073.stdout:8/18: read - d0/f5 zero size 2024-08-31T05:20:53.399 INFO:tasks.workunit.client.1.smithi073.stdout:8/19: chown d0/c6 40369 1 2024-08-31T05:20:53.399 INFO:tasks.workunit.client.1.smithi073.stdout:6/12: symlink l5 0 2024-08-31T05:20:53.408 INFO:tasks.workunit.client.1.smithi073.stdout:6/13: creat f6 x:0 0 0 2024-08-31T05:20:53.408 INFO:tasks.workunit.client.1.smithi073.stdout:9/6: dwrite f2 [0,4194304] 0 2024-08-31T05:20:53.408 INFO:tasks.workunit.client.1.smithi073.stdout:9/7: dread - f1 zero size 2024-08-31T05:20:53.412 INFO:tasks.workunit.client.1.smithi073.stdout:9/8: unlink f1 0 2024-08-31T05:20:53.416 INFO:tasks.workunit.client.1.smithi073.stdout:9/9: symlink l4 0 2024-08-31T05:20:53.423 INFO:tasks.workunit.client.1.smithi073.stdout:9/10: dwrite f2 [0,4194304] 0 2024-08-31T05:20:53.602 INFO:tasks.workunit.client.1.smithi073.stdout:5/5: sync 2024-08-31T05:20:53.603 INFO:tasks.workunit.client.1.smithi073.stdout:5/6: write f1 [845491,1390] 0 2024-08-31T05:20:53.603 INFO:tasks.workunit.client.1.smithi073.stdout:5/7: chown f1 110975 1 2024-08-31T05:20:53.609 INFO:tasks.workunit.client.1.smithi073.stdout:5/8: dwrite f1 [0,4194304] 0 2024-08-31T05:20:53.610 INFO:tasks.workunit.client.1.smithi073.stdout:5/9: creat f2 x:0 0 0 2024-08-31T05:20:53.611 INFO:tasks.workunit.client.1.smithi073.stdout:5/10: dread - f2 zero size 2024-08-31T05:20:53.611 INFO:tasks.workunit.client.1.smithi073.stdout:5/11: read f1 [1074283,127900] 0 2024-08-31T05:20:53.615 INFO:tasks.workunit.client.1.smithi073.stdout:5/12: dread f1 [0,4194304] 0 2024-08-31T05:20:53.621 INFO:tasks.workunit.client.1.smithi073.stdout:5/13: link l0 l3 0 2024-08-31T05:20:53.621 INFO:tasks.workunit.client.1.smithi073.stdout:0/28: fsync d0/f4 0 2024-08-31T05:20:53.622 INFO:tasks.workunit.client.1.smithi073.stdout:3/24: chown c2 128481633 1 2024-08-31T05:20:53.625 INFO:tasks.workunit.client.1.smithi073.stdout:3/25: mknod c3 0 2024-08-31T05:20:53.625 INFO:tasks.workunit.client.1.smithi073.stdout:3/26: chown c3 1 1 2024-08-31T05:20:53.627 INFO:tasks.workunit.client.1.smithi073.stdout:0/29: link d0/f4 d0/d1/f6 0 2024-08-31T05:20:53.630 INFO:tasks.workunit.client.1.smithi073.stdout:3/27: creat f4 x:0 0 0 2024-08-31T05:20:53.630 INFO:tasks.workunit.client.1.smithi073.stdout:3/28: chown c2 1346 1 2024-08-31T05:20:53.630 INFO:tasks.workunit.client.1.smithi073.stdout:0/30: creat d0/f7 x:0 0 0 2024-08-31T05:20:53.633 INFO:tasks.workunit.client.1.smithi073.stdout:3/29: creat f5 x:0 0 0 2024-08-31T05:20:53.636 INFO:tasks.workunit.client.1.smithi073.stdout:3/30: symlink l6 0 2024-08-31T05:20:53.641 INFO:tasks.workunit.client.1.smithi073.stdout:0/31: dwrite d0/f4 [0,4194304] 0 2024-08-31T05:20:53.643 INFO:tasks.workunit.client.1.smithi073.stdout:8/20: getdents d0 0 2024-08-31T05:20:53.643 INFO:tasks.workunit.client.1.smithi073.stdout:0/32: truncate d0/f7 635304 0 2024-08-31T05:20:53.643 INFO:tasks.workunit.client.1.smithi073.stdout:8/21: stat d0/c6 0 2024-08-31T05:20:53.648 INFO:tasks.workunit.client.1.smithi073.stdout:8/22: link d0/f4 d0/f8 0 2024-08-31T05:20:53.650 INFO:tasks.workunit.client.1.smithi073.stdout:8/23: chown d0/f4 1358460 1 2024-08-31T05:20:53.650 INFO:tasks.workunit.client.1.smithi073.stdout:0/33: dwrite d0/f7 [0,4194304] 0 2024-08-31T05:20:53.651 INFO:tasks.workunit.client.1.smithi073.stdout:0/34: read d0/f4 [1402224,91760] 0 2024-08-31T05:20:53.653 INFO:tasks.workunit.client.1.smithi073.stdout:8/24: creat d0/f9 x:0 0 0 2024-08-31T05:20:53.656 INFO:tasks.workunit.client.1.smithi073.stdout:0/35: mknod d0/c8 0 2024-08-31T05:20:53.661 INFO:tasks.workunit.client.1.smithi073.stdout:0/36: rename d0/c5 to d0/c9 0 2024-08-31T05:20:53.663 INFO:tasks.workunit.client.1.smithi073.stdout:9/11: dwrite f2 [4194304,4194304] 0 2024-08-31T05:20:53.665 INFO:tasks.workunit.client.1.smithi073.stdout:8/25: link d0/c2 d0/ca 0 2024-08-31T05:20:53.670 INFO:tasks.workunit.client.1.smithi073.stdout:9/12: rename f3 to f5 0 2024-08-31T05:20:53.671 INFO:tasks.workunit.client.1.smithi073.stdout:8/26: mkdir d0/db 0 2024-08-31T05:20:53.671 INFO:tasks.workunit.client.1.smithi073.stdout:8/27: dread - d0/f8 zero size 2024-08-31T05:20:53.672 INFO:tasks.workunit.client.1.smithi073.stdout:8/28: stat d0/f9 0 2024-08-31T05:20:53.672 INFO:tasks.workunit.client.1.smithi073.stdout:8/29: chown d0/f9 2 1 2024-08-31T05:20:53.672 INFO:tasks.workunit.client.1.smithi073.stdout:8/30: read - d0/f7 zero size 2024-08-31T05:20:53.673 INFO:tasks.workunit.client.1.smithi073.stdout:8/31: dread - d0/f7 zero size 2024-08-31T05:20:53.678 INFO:tasks.workunit.client.1.smithi073.stdout:8/32: creat d0/fc x:0 0 0 2024-08-31T05:20:53.681 INFO:tasks.workunit.client.1.smithi073.stdout:8/33: chown d0/ca 57 1 2024-08-31T05:20:53.681 INFO:tasks.workunit.client.1.smithi073.stdout:8/34: readlink d0/l3 0 2024-08-31T05:20:53.682 INFO:tasks.workunit.client.1.smithi073.stdout:8/35: dread - d0/f7 zero size 2024-08-31T05:20:53.684 INFO:tasks.workunit.client.1.smithi073.stdout:8/36: link d0/fc d0/fd 0 2024-08-31T05:20:53.693 INFO:tasks.workunit.client.1.smithi073.stdout:8/37: dwrite d0/f4 [0,4194304] 0 2024-08-31T05:20:53.693 INFO:tasks.workunit.client.1.smithi073.stdout:8/38: stat d0/c6 0 2024-08-31T05:20:53.697 INFO:tasks.workunit.client.1.smithi073.stdout:8/39: rename d0/f7 to d0/fe 0 2024-08-31T05:20:53.698 INFO:tasks.workunit.client.1.smithi073.stdout:1/10: write f0 [544016,113645] 0 2024-08-31T05:20:53.698 INFO:tasks.workunit.client.1.smithi073.stdout:1/11: read - f2 zero size 2024-08-31T05:20:53.702 INFO:tasks.workunit.client.1.smithi073.stdout:1/12: mkdir d5 0 2024-08-31T05:20:53.703 INFO:tasks.workunit.client.1.smithi073.stdout:1/13: truncate f2 730983 0 2024-08-31T05:20:53.706 INFO:tasks.workunit.client.1.smithi073.stdout:1/14: creat d5/f6 x:0 0 0 2024-08-31T05:20:53.710 INFO:tasks.workunit.client.1.smithi073.stdout:1/15: rename f4 to d5/f7 0 2024-08-31T05:20:53.711 INFO:tasks.workunit.client.1.smithi073.stdout:1/16: mkdir d5/d8 0 2024-08-31T05:20:53.712 INFO:tasks.workunit.client.1.smithi073.stdout:1/17: dread - d5/f7 zero size 2024-08-31T05:20:53.714 INFO:tasks.workunit.client.1.smithi073.stdout:5/14: getdents . 0 2024-08-31T05:20:53.715 INFO:tasks.workunit.client.1.smithi073.stdout:5/15: dread - f2 zero size 2024-08-31T05:20:53.717 INFO:tasks.workunit.client.1.smithi073.stdout:1/18: rmdir d5/d8 0 2024-08-31T05:20:53.718 INFO:tasks.workunit.client.1.smithi073.stdout:5/16: chown l3 543825413 1 2024-08-31T05:20:53.718 INFO:tasks.workunit.client.1.smithi073.stdout:5/17: readlink l0 0 2024-08-31T05:20:53.720 INFO:tasks.workunit.client.1.smithi073.stdout:1/19: creat d5/f9 x:0 0 0 2024-08-31T05:20:53.721 INFO:tasks.workunit.client.1.smithi073.stdout:1/20: chown d5/f7 98 1 2024-08-31T05:20:53.721 INFO:tasks.workunit.client.1.smithi073.stdout:5/18: dread f1 [0,4194304] 0 2024-08-31T05:20:53.722 INFO:tasks.workunit.client.1.smithi073.stdout:1/21: dread f2 [0,4194304] 0 2024-08-31T05:20:53.723 INFO:tasks.workunit.client.1.smithi073.stdout:1/22: write d5/f9 [279879,125203] 0 2024-08-31T05:20:53.728 INFO:tasks.workunit.client.1.smithi073.stdout:3/31: getdents . 0 2024-08-31T05:20:53.728 INFO:tasks.workunit.client.1.smithi073.stdout:3/32: dread - f5 zero size 2024-08-31T05:20:53.729 INFO:tasks.workunit.client.1.smithi073.stdout:3/33: chown l6 0 1 2024-08-31T05:20:53.730 INFO:tasks.workunit.client.1.smithi073.stdout:3/34: read - f4 zero size 2024-08-31T05:20:53.730 INFO:tasks.workunit.client.1.smithi073.stdout:5/19: link l0 l4 0 2024-08-31T05:20:53.731 INFO:tasks.workunit.client.1.smithi073.stdout:5/20: chown f2 989247 1 2024-08-31T05:20:53.733 INFO:tasks.workunit.client.1.smithi073.stdout:3/35: mknod c7 0 2024-08-31T05:20:53.734 INFO:tasks.workunit.client.1.smithi073.stdout:1/23: dwrite f2 [0,4194304] 0 2024-08-31T05:20:53.734 INFO:tasks.workunit.client.1.smithi073.stdout:3/36: truncate f5 79737 0 2024-08-31T05:20:53.735 INFO:tasks.workunit.client.1.smithi073.stdout:3/37: chown c2 919073172 1 2024-08-31T05:20:53.736 INFO:tasks.workunit.client.1.smithi073.stdout:5/21: creat f5 x:0 0 0 2024-08-31T05:20:53.737 INFO:tasks.workunit.client.1.smithi073.stdout:3/38: write f4 [50913,62166] 0 2024-08-31T05:20:53.737 INFO:tasks.workunit.client.1.smithi073.stdout:3/39: stat f5 0 2024-08-31T05:20:53.739 INFO:tasks.workunit.client.1.smithi073.stdout:8/40: fsync d0/f4 0 2024-08-31T05:20:53.741 INFO:tasks.workunit.client.1.smithi073.stdout:8/41: dread - d0/f9 zero size 2024-08-31T05:20:53.741 INFO:tasks.workunit.client.1.smithi073.stdout:5/22: rename f5 to f6 0 2024-08-31T05:20:53.743 INFO:tasks.workunit.client.1.smithi073.stdout:1/24: dwrite d5/f9 [0,4194304] 0 2024-08-31T05:20:53.746 INFO:tasks.workunit.client.1.smithi073.stdout:0/37: truncate d0/f4 839365 0 2024-08-31T05:20:53.747 INFO:tasks.workunit.client.1.smithi073.stdout:0/38: chown d0 194 1 2024-08-31T05:20:53.747 INFO:tasks.workunit.client.1.smithi073.stdout:0/39: readlink - no filename 2024-08-31T05:20:53.749 INFO:tasks.workunit.client.1.smithi073.stdout:2/23: sync 2024-08-31T05:20:53.749 INFO:tasks.workunit.client.1.smithi073.stdout:7/12: sync 2024-08-31T05:20:53.749 INFO:tasks.workunit.client.1.smithi073.stdout:8/42: rename d0/l3 to d0/db/lf 0 2024-08-31T05:20:53.750 INFO:tasks.workunit.client.1.smithi073.stdout:3/40: dwrite f4 [0,4194304] 0 2024-08-31T05:20:53.751 INFO:tasks.workunit.client.1.smithi073.stdout:1/25: unlink c1 0 2024-08-31T05:20:53.751 INFO:tasks.workunit.client.1.smithi073.stdout:7/13: chown d1 155451 1 2024-08-31T05:20:53.751 INFO:tasks.workunit.client.1.smithi073.stdout:7/14: dread - no filename 2024-08-31T05:20:53.752 INFO:tasks.workunit.client.1.smithi073.stdout:2/24: read - f1 zero size 2024-08-31T05:20:53.755 INFO:tasks.workunit.client.1.smithi073.stdout:9/13: fsync f5 0 2024-08-31T05:20:53.755 INFO:tasks.workunit.client.1.smithi073.stdout:9/14: rmdir - no directory 2024-08-31T05:20:53.759 INFO:tasks.workunit.client.1.smithi073.stdout:8/43: creat d0/f10 x:0 0 0 2024-08-31T05:20:53.759 INFO:tasks.workunit.client.1.smithi073.stdout:9/15: chown l4 2911108 1 2024-08-31T05:20:53.764 INFO:tasks.workunit.client.1.smithi073.stdout:8/44: chown d0/fc 1453 1 2024-08-31T05:20:53.764 INFO:tasks.workunit.client.1.smithi073.stdout:5/23: dwrite f1 [0,4194304] 0 2024-08-31T05:20:53.767 INFO:tasks.workunit.client.1.smithi073.stdout:0/40: dwrite d0/f7 [0,4194304] 0 2024-08-31T05:20:53.768 INFO:tasks.workunit.client.1.smithi073.stdout:8/45: chown d0/f5 1992 1 2024-08-31T05:20:53.768 INFO:tasks.workunit.client.1.smithi073.stdout:3/41: dwrite f4 [0,4194304] 0 2024-08-31T05:20:53.770 INFO:tasks.workunit.client.1.smithi073.stdout:1/26: dread f2 [0,4194304] 0 2024-08-31T05:20:53.772 INFO:tasks.workunit.client.1.smithi073.stdout:8/46: fsync d0/f5 0 2024-08-31T05:20:53.772 INFO:tasks.workunit.client.1.smithi073.stdout:2/25: dread d2/f4 [0,4194304] 0 2024-08-31T05:20:53.772 INFO:tasks.workunit.client.1.smithi073.stdout:0/41: write d0/f7 [1913231,122213] 0 2024-08-31T05:20:53.773 INFO:tasks.workunit.client.1.smithi073.stdout:1/27: dread - d5/f7 zero size 2024-08-31T05:20:53.774 INFO:tasks.workunit.client.1.smithi073.stdout:2/26: dread - f1 zero size 2024-08-31T05:20:53.775 INFO:tasks.workunit.client.1.smithi073.stdout:3/42: rename c7 to c8 0 2024-08-31T05:20:53.776 INFO:tasks.workunit.client.1.smithi073.stdout:9/16: dwrite f2 [0,4194304] 0 2024-08-31T05:20:53.777 INFO:tasks.workunit.client.1.smithi073.stdout:8/47: truncate d0/fd 169732 0 2024-08-31T05:20:53.778 INFO:tasks.workunit.client.1.smithi073.stdout:1/28: truncate d5/f7 760454 0 2024-08-31T05:20:53.779 INFO:tasks.workunit.client.1.smithi073.stdout:1/29: truncate d5/f6 849901 0 2024-08-31T05:20:53.780 INFO:tasks.workunit.client.1.smithi073.stdout:5/24: dwrite f1 [0,4194304] 0 2024-08-31T05:20:53.781 INFO:tasks.workunit.client.1.smithi073.stdout:3/43: rename f5 to f9 0 2024-08-31T05:20:53.782 INFO:tasks.workunit.client.1.smithi073.stdout:1/30: write d5/f6 [1398455,101583] 0 2024-08-31T05:20:53.783 INFO:tasks.workunit.client.1.smithi073.stdout:9/17: mknod c6 0 2024-08-31T05:20:53.786 INFO:tasks.workunit.client.1.smithi073.stdout:0/42: link d0/f7 d0/d1/fa 0 2024-08-31T05:20:53.791 INFO:tasks.workunit.client.1.smithi073.stdout:2/27: dwrite d2/f4 [0,4194304] 0 2024-08-31T05:20:53.792 INFO:tasks.workunit.client.1.smithi073.stdout:2/28: read - f1 zero size 2024-08-31T05:20:53.795 INFO:tasks.workunit.client.1.smithi073.stdout:5/25: dwrite f1 [4194304,4194304] 0 2024-08-31T05:20:53.796 INFO:tasks.workunit.client.1.smithi073.stdout:5/26: write f2 [53482,63458] 0 2024-08-31T05:20:53.799 INFO:tasks.workunit.client.1.smithi073.stdout:2/29: dread d2/f4 [0,4194304] 0 2024-08-31T05:20:53.801 INFO:tasks.workunit.client.1.smithi073.stdout:2/30: write d2/f4 [265168,88037] 0 2024-08-31T05:20:53.802 INFO:tasks.workunit.client.1.smithi073.stdout:3/44: mkdir da 0 2024-08-31T05:20:53.803 INFO:tasks.workunit.client.1.smithi073.stdout:5/27: dread f1 [0,4194304] 0 2024-08-31T05:20:53.806 INFO:tasks.workunit.client.1.smithi073.stdout:1/31: mkdir d5/da 0 2024-08-31T05:20:53.809 INFO:tasks.workunit.client.1.smithi073.stdout:9/18: creat f7 x:0 0 0 2024-08-31T05:20:53.810 INFO:tasks.workunit.client.1.smithi073.stdout:9/19: write f7 [915567,58890] 0 2024-08-31T05:20:53.815 INFO:tasks.workunit.client.1.smithi073.stdout:5/28: fsync f2 0 2024-08-31T05:20:53.816 INFO:tasks.workunit.client.1.smithi073.stdout:9/20: dwrite f7 [0,4194304] 0 2024-08-31T05:20:53.816 INFO:tasks.workunit.client.1.smithi073.stdout:9/21: stat f5 0 2024-08-31T05:20:53.818 INFO:tasks.workunit.client.1.smithi073.stdout:8/48: rename d0/ca to d0/c11 0 2024-08-31T05:20:53.825 INFO:tasks.workunit.client.1.smithi073.stdout:8/49: dwrite d0/f8 [0,4194304] 0 2024-08-31T05:20:53.835 INFO:tasks.workunit.client.1.smithi073.stdout:3/45: write f4 [5183820,6589] 0 2024-08-31T05:20:53.840 INFO:tasks.workunit.client.1.smithi073.stdout:0/43: mknod d0/d1/cb 0 2024-08-31T05:20:53.841 INFO:tasks.workunit.client.1.smithi073.stdout:8/50: fsync d0/f8 0 2024-08-31T05:20:53.843 INFO:tasks.workunit.client.1.smithi073.stdout:9/22: creat f8 x:0 0 0 2024-08-31T05:20:53.844 INFO:tasks.workunit.client.1.smithi073.stdout:9/23: write f8 [149988,101992] 0 2024-08-31T05:20:53.854 INFO:tasks.workunit.client.1.smithi073.stdout:1/32: symlink d5/da/lb 0 2024-08-31T05:20:53.860 INFO:tasks.workunit.client.1.smithi073.stdout:5/29: rename l3 to l7 0 2024-08-31T05:20:53.862 INFO:tasks.workunit.client.1.smithi073.stdout:0/44: dwrite d0/d1/f6 [0,4194304] 0 2024-08-31T05:20:53.863 INFO:tasks.workunit.client.1.smithi073.stdout:9/24: rename f2 to f9 0 2024-08-31T05:20:53.864 INFO:tasks.workunit.client.1.smithi073.stdout:0/45: read d0/f4 [2473028,92819] 0 2024-08-31T05:20:53.865 INFO:tasks.workunit.client.1.smithi073.stdout:2/31: link d2/l6 d2/l7 0 2024-08-31T05:20:53.865 INFO:tasks.workunit.client.1.smithi073.stdout:9/25: write f7 [2965891,88853] 0 2024-08-31T05:20:53.866 INFO:tasks.workunit.client.1.smithi073.stdout:1/33: fdatasync f2 0 2024-08-31T05:20:53.867 INFO:tasks.workunit.client.1.smithi073.stdout:4/30: sync 2024-08-31T05:20:53.867 INFO:tasks.workunit.client.1.smithi073.stdout:6/14: sync 2024-08-31T05:20:53.868 INFO:tasks.workunit.client.1.smithi073.stdout:4/31: fsync f5 0 2024-08-31T05:20:53.869 INFO:tasks.workunit.client.1.smithi073.stdout:3/46: creat da/fb x:0 0 0 2024-08-31T05:20:53.870 INFO:tasks.workunit.client.1.smithi073.stdout:5/30: dwrite f2 [0,4194304] 0 2024-08-31T05:20:53.871 INFO:tasks.workunit.client.1.smithi073.stdout:3/47: chown f9 14 1 2024-08-31T05:20:53.872 INFO:tasks.workunit.client.1.smithi073.stdout:3/48: readlink l6 0 2024-08-31T05:20:53.874 INFO:tasks.workunit.client.1.smithi073.stdout:0/46: mknod d0/cc 0 2024-08-31T05:20:53.877 INFO:tasks.workunit.client.1.smithi073.stdout:2/32: dread d2/f4 [0,4194304] 0 2024-08-31T05:20:53.880 INFO:tasks.workunit.client.1.smithi073.stdout:6/15: dwrite f6 [0,4194304] 0 2024-08-31T05:20:53.881 INFO:tasks.workunit.client.1.smithi073.stdout:5/31: mknod c8 0 2024-08-31T05:20:53.883 INFO:tasks.workunit.client.1.smithi073.stdout:3/49: dread f4 [0,4194304] 0 2024-08-31T05:20:53.886 INFO:tasks.workunit.client.1.smithi073.stdout:9/26: dwrite f9 [4194304,4194304] 0 2024-08-31T05:20:53.888 INFO:tasks.workunit.client.1.smithi073.stdout:0/47: symlink d0/d1/ld 0 2024-08-31T05:20:53.888 INFO:tasks.workunit.client.1.smithi073.stdout:0/48: chown d0 15507 1 2024-08-31T05:20:53.888 INFO:tasks.workunit.client.1.smithi073.stdout:9/27: write f8 [102116,116172] 0 2024-08-31T05:20:53.889 INFO:tasks.workunit.client.1.smithi073.stdout:9/28: dread - f5 zero size 2024-08-31T05:20:53.889 INFO:tasks.workunit.client.1.smithi073.stdout:2/33: symlink d2/l8 0 2024-08-31T05:20:53.891 INFO:tasks.workunit.client.1.smithi073.stdout:6/16: symlink l7 0 2024-08-31T05:20:53.893 INFO:tasks.workunit.client.1.smithi073.stdout:0/49: dread d0/f7 [0,4194304] 0 2024-08-31T05:20:53.895 INFO:tasks.workunit.client.1.smithi073.stdout:5/32: unlink f6 0 2024-08-31T05:20:53.898 INFO:tasks.workunit.client.1.smithi073.stdout:3/50: symlink da/lc 0 2024-08-31T05:20:53.902 INFO:tasks.workunit.client.1.smithi073.stdout:9/29: creat fa x:0 0 0 2024-08-31T05:20:53.902 INFO:tasks.workunit.client.1.smithi073.stdout:2/34: fsync d2/f4 0 2024-08-31T05:20:53.903 INFO:tasks.workunit.client.1.smithi073.stdout:2/35: write d2/f4 [3013693,62563] 0 2024-08-31T05:20:53.905 INFO:tasks.workunit.client.1.smithi073.stdout:6/17: rename l1 to l8 0 2024-08-31T05:20:53.908 INFO:tasks.workunit.client.1.smithi073.stdout:0/50: mknod d0/ce 0 2024-08-31T05:20:53.909 INFO:tasks.workunit.client.1.smithi073.stdout:5/33: creat f9 x:0 0 0 2024-08-31T05:20:53.910 INFO:tasks.workunit.client.1.smithi073.stdout:3/51: creat da/fd x:0 0 0 2024-08-31T05:20:53.912 INFO:tasks.workunit.client.1.smithi073.stdout:1/34: getdents d5 0 2024-08-31T05:20:53.912 INFO:tasks.workunit.client.1.smithi073.stdout:1/35: stat d5/f9 0 2024-08-31T05:20:53.913 INFO:tasks.workunit.client.1.smithi073.stdout:1/36: fsync f0 0 2024-08-31T05:20:53.913 INFO:tasks.workunit.client.1.smithi073.stdout:9/30: creat fb x:0 0 0 2024-08-31T05:20:53.914 INFO:tasks.workunit.client.1.smithi073.stdout:2/36: mkdir d2/d9 0 2024-08-31T05:20:53.914 INFO:tasks.workunit.client.1.smithi073.stdout:2/37: read - f1 zero size 2024-08-31T05:20:53.915 INFO:tasks.workunit.client.1.smithi073.stdout:2/38: write d2/f4 [2478724,130233] 0 2024-08-31T05:20:53.916 INFO:tasks.workunit.client.1.smithi073.stdout:4/32: link l4 d7/l9 0 2024-08-31T05:20:53.917 INFO:tasks.workunit.client.1.smithi073.stdout:0/51: fdatasync d0/f7 0 2024-08-31T05:20:53.918 INFO:tasks.workunit.client.1.smithi073.stdout:4/33: write f5 [3479366,50176] 0 2024-08-31T05:20:53.918 INFO:tasks.workunit.client.1.smithi073.stdout:0/52: readlink d0/d1/ld 0 2024-08-31T05:20:53.920 INFO:tasks.workunit.client.1.smithi073.stdout:3/52: creat da/fe x:0 0 0 2024-08-31T05:20:53.921 INFO:tasks.workunit.client.1.smithi073.stdout:9/31: dwrite f8 [0,4194304] 0 2024-08-31T05:20:53.924 INFO:tasks.workunit.client.1.smithi073.stdout:2/39: stat d2/l7 0 2024-08-31T05:20:53.926 INFO:tasks.workunit.client.1.smithi073.stdout:5/34: rename l7 to la 0 2024-08-31T05:20:53.926 INFO:tasks.workunit.client.1.smithi073.stdout:2/40: dread - f1 zero size 2024-08-31T05:20:53.928 INFO:tasks.workunit.client.1.smithi073.stdout:0/53: creat d0/d1/ff x:0 0 0 2024-08-31T05:20:53.931 INFO:tasks.workunit.client.1.smithi073.stdout:4/34: dwrite f0 [0,4194304] 0 2024-08-31T05:20:53.938 INFO:tasks.workunit.client.1.smithi073.stdout:2/41: creat d2/fa x:0 0 0 2024-08-31T05:20:53.938 INFO:tasks.workunit.client.1.smithi073.stdout:9/32: dwrite f7 [0,4194304] 0 2024-08-31T05:20:53.939 INFO:tasks.workunit.client.1.smithi073.stdout:5/35: link f1 fb 0 2024-08-31T05:20:53.942 INFO:tasks.workunit.client.1.smithi073.stdout:1/37: dwrite d5/f7 [0,4194304] 0 2024-08-31T05:20:53.943 INFO:tasks.workunit.client.1.smithi073.stdout:9/33: mkdir dc 0 2024-08-31T05:20:53.946 INFO:tasks.workunit.client.1.smithi073.stdout:5/36: mkdir dc 0 2024-08-31T05:20:53.947 INFO:tasks.workunit.client.1.smithi073.stdout:3/53: dwrite f4 [0,4194304] 0 2024-08-31T05:20:53.949 INFO:tasks.workunit.client.1.smithi073.stdout:6/18: write f3 [7233826,112980] 0 2024-08-31T05:20:53.950 INFO:tasks.workunit.client.1.smithi073.stdout:6/19: chown c4 1011 1 2024-08-31T05:20:53.950 INFO:tasks.workunit.client.1.smithi073.stdout:9/34: dread f8 [0,4194304] 0 2024-08-31T05:20:53.951 INFO:tasks.workunit.client.1.smithi073.stdout:9/35: write f5 [811764,72906] 0 2024-08-31T05:20:53.953 INFO:tasks.workunit.client.1.smithi073.stdout:9/36: write fa [899903,4306] 0 2024-08-31T05:20:53.953 INFO:tasks.workunit.client.1.smithi073.stdout:3/54: unlink c2 0 2024-08-31T05:20:53.954 INFO:tasks.workunit.client.1.smithi073.stdout:2/42: link d2/c3 d2/d9/cb 0 2024-08-31T05:20:53.955 INFO:tasks.workunit.client.1.smithi073.stdout:9/37: write fb [345086,120279] 0 2024-08-31T05:20:53.955 INFO:tasks.workunit.client.1.smithi073.stdout:4/35: fsync f0 0 2024-08-31T05:20:53.956 INFO:tasks.workunit.client.1.smithi073.stdout:9/38: chown fb 735 1 2024-08-31T05:20:53.957 INFO:tasks.workunit.client.1.smithi073.stdout:5/37: mknod dc/cd 0 2024-08-31T05:20:53.957 INFO:tasks.workunit.client.1.smithi073.stdout:9/39: write fa [1779541,52543] 0 2024-08-31T05:20:53.958 INFO:tasks.workunit.client.1.smithi073.stdout:9/40: rename dc to dc/dd 22 2024-08-31T05:20:53.959 INFO:tasks.workunit.client.1.smithi073.stdout:3/55: creat da/ff x:0 0 0 2024-08-31T05:20:53.963 INFO:tasks.workunit.client.1.smithi073.stdout:4/36: dread f0 [0,4194304] 0 2024-08-31T05:20:53.965 INFO:tasks.workunit.client.1.smithi073.stdout:5/38: dread fb [4194304,4194304] 0 2024-08-31T05:20:53.965 INFO:tasks.workunit.client.1.smithi073.stdout:3/56: creat da/f10 x:0 0 0 2024-08-31T05:20:53.966 INFO:tasks.workunit.client.1.smithi073.stdout:4/37: write f0 [491629,99135] 0 2024-08-31T05:20:53.966 INFO:tasks.workunit.client.1.smithi073.stdout:2/43: stat d2/d9/cb 0 2024-08-31T05:20:53.968 INFO:tasks.workunit.client.1.smithi073.stdout:5/39: stat l0 0 2024-08-31T05:20:53.968 INFO:tasks.workunit.client.1.smithi073.stdout:4/38: fdatasync d7/f8 0 2024-08-31T05:20:53.969 INFO:tasks.workunit.client.1.smithi073.stdout:3/57: write da/fd [68181,86900] 0 2024-08-31T05:20:53.969 INFO:tasks.workunit.client.1.smithi073.stdout:9/41: dwrite f5 [0,4194304] 0 2024-08-31T05:20:53.971 INFO:tasks.workunit.client.1.smithi073.stdout:3/58: chown l6 1815172 1 2024-08-31T05:20:53.971 INFO:tasks.workunit.client.1.smithi073.stdout:5/40: chown f2 0 1 2024-08-31T05:20:53.971 INFO:tasks.workunit.client.1.smithi073.stdout:4/39: write d7/f8 [977632,22740] 0 2024-08-31T05:20:53.972 INFO:tasks.workunit.client.1.smithi073.stdout:3/59: chown f4 239807 1 2024-08-31T05:20:53.974 INFO:tasks.workunit.client.1.smithi073.stdout:1/38: truncate d5/f7 3121550 0 2024-08-31T05:20:53.975 INFO:tasks.workunit.client.1.smithi073.stdout:2/44: rename d2/l6 to d2/d9/lc 0 2024-08-31T05:20:53.976 INFO:tasks.workunit.client.1.smithi073.stdout:1/39: write d5/f6 [1547655,75918] 0 2024-08-31T05:20:53.976 INFO:tasks.workunit.client.1.smithi073.stdout:2/45: read - f1 zero size 2024-08-31T05:20:53.977 INFO:tasks.workunit.client.1.smithi073.stdout:2/46: read - d2/fa zero size 2024-08-31T05:20:53.978 INFO:tasks.workunit.client.1.smithi073.stdout:6/20: truncate f3 6973583 0 2024-08-31T05:20:53.980 INFO:tasks.workunit.client.1.smithi073.stdout:4/40: creat d7/fa x:0 0 0 2024-08-31T05:20:53.981 INFO:tasks.workunit.client.1.smithi073.stdout:3/60: mknod da/c11 0 2024-08-31T05:20:53.981 INFO:tasks.workunit.client.1.smithi073.stdout:7/15: sync 2024-08-31T05:20:53.984 INFO:tasks.workunit.client.1.smithi073.stdout:3/61: fsync f9 0 2024-08-31T05:20:53.987 INFO:tasks.workunit.client.1.smithi073.stdout:3/62: chown l6 5653251 1 2024-08-31T05:20:53.988 INFO:tasks.workunit.client.1.smithi073.stdout:1/40: dwrite d5/f6 [0,4194304] 0 2024-08-31T05:20:53.989 INFO:tasks.workunit.client.1.smithi073.stdout:1/41: chown d5/da 5232918 1 2024-08-31T05:20:53.989 INFO:tasks.workunit.client.1.smithi073.stdout:2/47: dwrite d2/f4 [0,4194304] 0 2024-08-31T05:20:53.990 INFO:tasks.workunit.client.1.smithi073.stdout:7/16: symlink d1/l2 0 2024-08-31T05:20:53.994 INFO:tasks.workunit.client.1.smithi073.stdout:2/48: write d2/fa [326587,116597] 0 2024-08-31T05:20:53.995 INFO:tasks.workunit.client.1.smithi073.stdout:3/63: rename da/fe to da/f12 0 2024-08-31T05:20:53.996 INFO:tasks.workunit.client.1.smithi073.stdout:7/17: stat d1/l2 0 2024-08-31T05:20:53.996 INFO:tasks.workunit.client.1.smithi073.stdout:4/41: dread f5 [0,4194304] 0 2024-08-31T05:20:53.997 INFO:tasks.workunit.client.1.smithi073.stdout:3/64: chown da 228992078 1 2024-08-31T05:20:53.998 INFO:tasks.workunit.client.1.smithi073.stdout:1/42: link d5/f7 d5/fc 0 2024-08-31T05:20:54.000 INFO:tasks.workunit.client.1.smithi073.stdout:4/42: write d7/fa [879637,75312] 0 2024-08-31T05:20:54.001 INFO:tasks.workunit.client.1.smithi073.stdout:7/18: rmdir d1 39 2024-08-31T05:20:54.001 INFO:tasks.workunit.client.1.smithi073.stdout:7/19: write - no filename 2024-08-31T05:20:54.002 INFO:tasks.workunit.client.1.smithi073.stdout:7/20: truncate - no filename 2024-08-31T05:20:54.002 INFO:tasks.workunit.client.1.smithi073.stdout:7/21: write - no filename 2024-08-31T05:20:54.002 INFO:tasks.workunit.client.1.smithi073.stdout:7/22: dread - no filename 2024-08-31T05:20:54.002 INFO:tasks.workunit.client.1.smithi073.stdout:5/41: dwrite f1 [0,4194304] 0 2024-08-31T05:20:54.003 INFO:tasks.workunit.client.1.smithi073.stdout:4/43: write d7/f8 [24309,47342] 0 2024-08-31T05:20:54.004 INFO:tasks.workunit.client.1.smithi073.stdout:4/44: stat l6 0 2024-08-31T05:20:54.004 INFO:tasks.workunit.client.1.smithi073.stdout:1/43: write d5/f7 [2295437,9692] 0 2024-08-31T05:20:54.004 INFO:tasks.workunit.client.1.smithi073.stdout:5/42: write f1 [1739535,28605] 0 2024-08-31T05:20:54.005 INFO:tasks.workunit.client.1.smithi073.stdout:6/21: dwrite f2 [0,4194304] 0 2024-08-31T05:20:54.006 INFO:tasks.workunit.client.1.smithi073.stdout:3/65: mknod da/c13 0 2024-08-31T05:20:54.006 INFO:tasks.workunit.client.1.smithi073.stdout:5/43: chown fb 104174 1 2024-08-31T05:20:54.015 INFO:tasks.workunit.client.1.smithi073.stdout:1/44: creat d5/fd x:0 0 0 2024-08-31T05:20:54.017 INFO:tasks.workunit.client.1.smithi073.stdout:3/66: creat da/f14 x:0 0 0 2024-08-31T05:20:54.018 INFO:tasks.workunit.client.1.smithi073.stdout:1/45: dread d5/f7 [0,4194304] 0 2024-08-31T05:20:54.020 INFO:tasks.workunit.client.1.smithi073.stdout:5/44: mknod dc/ce 0 2024-08-31T05:20:54.020 INFO:tasks.workunit.client.1.smithi073.stdout:5/45: chown dc/cd 3 1 2024-08-31T05:20:54.022 INFO:tasks.workunit.client.1.smithi073.stdout:7/23: mknod d1/c3 0 2024-08-31T05:20:54.026 INFO:tasks.workunit.client.1.smithi073.stdout:2/49: link d2/d9/cb d2/cd 0 2024-08-31T05:20:54.034 INFO:tasks.workunit.client.1.smithi073.stdout:5/46: fsync fb 0 2024-08-31T05:20:54.035 INFO:tasks.workunit.client.1.smithi073.stdout:2/50: dread d2/fa [0,4194304] 0 2024-08-31T05:20:54.037 INFO:tasks.workunit.client.1.smithi073.stdout:2/51: write d2/fa [1000914,111398] 0 2024-08-31T05:20:54.041 INFO:tasks.workunit.client.1.smithi073.stdout:5/47: dwrite f9 [0,4194304] 0 2024-08-31T05:20:54.068 INFO:tasks.workunit.client.1.smithi073.stdout:5/48: mkdir dc/df 0 2024-08-31T05:20:54.069 INFO:tasks.workunit.client.1.smithi073.stdout:6/22: getdents . 0 2024-08-31T05:20:54.069 INFO:tasks.workunit.client.1.smithi073.stdout:6/23: write f2 [35240,2226] 0 2024-08-31T05:20:54.072 INFO:tasks.workunit.client.1.smithi073.stdout:3/67: getdents da 0 2024-08-31T05:20:54.073 INFO:tasks.workunit.client.1.smithi073.stdout:1/46: truncate d5/fc 2421920 0 2024-08-31T05:20:54.073 INFO:tasks.workunit.client.1.smithi073.stdout:1/47: chown d5 383074223 1 2024-08-31T05:20:54.074 INFO:tasks.workunit.client.1.smithi073.stdout:2/52: rename d2/cd to d2/d9/ce 0 2024-08-31T05:20:54.074 INFO:tasks.workunit.client.1.smithi073.stdout:1/48: chown d5/f6 243 1 2024-08-31T05:20:54.075 INFO:tasks.workunit.client.1.smithi073.stdout:4/45: truncate d7/fa 883312 0 2024-08-31T05:20:54.075 INFO:tasks.workunit.client.1.smithi073.stdout:8/51: sync 2024-08-31T05:20:54.075 INFO:tasks.workunit.client.1.smithi073.stdout:0/54: sync 2024-08-31T05:20:54.076 INFO:tasks.workunit.client.1.smithi073.stdout:0/55: readlink d0/d1/ld 0 2024-08-31T05:20:54.077 INFO:tasks.workunit.client.1.smithi073.stdout:6/24: dwrite f6 [0,4194304] 0 2024-08-31T05:20:54.077 INFO:tasks.workunit.client.1.smithi073.stdout:3/68: creat da/f15 x:0 0 0 2024-08-31T05:20:54.080 INFO:tasks.workunit.client.1.smithi073.stdout:5/49: rename f1 to dc/f10 0 2024-08-31T05:20:54.081 INFO:tasks.workunit.client.1.smithi073.stdout:2/53: mkdir d2/d9/df 0 2024-08-31T05:20:54.082 INFO:tasks.workunit.client.1.smithi073.stdout:1/49: dread f0 [0,4194304] 0 2024-08-31T05:20:54.084 INFO:tasks.workunit.client.1.smithi073.stdout:3/69: rmdir da 39 2024-08-31T05:20:54.089 INFO:tasks.workunit.client.1.smithi073.stdout:0/56: rename d0/c8 to d0/d1/c10 0 2024-08-31T05:20:54.090 INFO:tasks.workunit.client.1.smithi073.stdout:0/57: read d0/d1/f6 [765379,96422] 0 2024-08-31T05:20:54.092 INFO:tasks.workunit.client.1.smithi073.stdout:9/42: sync 2024-08-31T05:20:54.092 INFO:tasks.workunit.client.1.smithi073.stdout:7/24: sync 2024-08-31T05:20:54.092 INFO:tasks.workunit.client.1.smithi073.stdout:2/54: creat d2/d9/f10 x:0 0 0 2024-08-31T05:20:54.093 INFO:tasks.workunit.client.1.smithi073.stdout:2/55: chown d2/d9/df 57701873 1 2024-08-31T05:20:54.096 INFO:tasks.workunit.client.1.smithi073.stdout:3/70: write da/fd [87030,126213] 0 2024-08-31T05:20:54.099 INFO:tasks.workunit.client.1.smithi073.stdout:6/25: link f3 f9 0 2024-08-31T05:20:54.100 INFO:tasks.workunit.client.1.smithi073.stdout:5/50: mknod dc/df/c11 0 2024-08-31T05:20:54.103 INFO:tasks.workunit.client.1.smithi073.stdout:0/58: creat d0/f11 x:0 0 0 2024-08-31T05:20:54.103 INFO:tasks.workunit.client.1.smithi073.stdout:4/46: truncate f5 344291 0 2024-08-31T05:20:54.103 INFO:tasks.workunit.client.1.smithi073.stdout:4/47: chown l6 47329 1 2024-08-31T05:20:54.104 INFO:tasks.workunit.client.1.smithi073.stdout:9/43: unlink fa 0 2024-08-31T05:20:54.104 INFO:tasks.workunit.client.1.smithi073.stdout:7/25: rename d1/c3 to d1/c4 0 2024-08-31T05:20:54.105 INFO:tasks.workunit.client.1.smithi073.stdout:7/26: write - no filename 2024-08-31T05:20:54.107 INFO:tasks.workunit.client.1.smithi073.stdout:8/52: link d0/c6 d0/c12 0 2024-08-31T05:20:54.109 INFO:tasks.workunit.client.1.smithi073.stdout:3/71: symlink da/l16 0 2024-08-31T05:20:54.111 INFO:tasks.workunit.client.1.smithi073.stdout:5/51: fsync dc/f10 0 2024-08-31T05:20:54.113 INFO:tasks.workunit.client.1.smithi073.stdout:8/53: dwrite d0/f4 [0,4194304] 0 2024-08-31T05:20:54.114 INFO:tasks.workunit.client.1.smithi073.stdout:0/59: chown d0/d1/c10 45352 1 2024-08-31T05:20:54.118 INFO:tasks.workunit.client.1.smithi073.stdout:7/27: rename d1/l2 to d1/l5 0 2024-08-31T05:20:54.118 INFO:tasks.workunit.client.1.smithi073.stdout:7/28: write - no filename 2024-08-31T05:20:54.118 INFO:tasks.workunit.client.1.smithi073.stdout:7/29: truncate - no filename 2024-08-31T05:20:54.123 INFO:tasks.workunit.client.1.smithi073.stdout:3/72: creat da/f17 x:0 0 0 2024-08-31T05:20:54.124 INFO:tasks.workunit.client.1.smithi073.stdout:1/50: truncate d5/f6 2539926 0 2024-08-31T05:20:54.124 INFO:tasks.workunit.client.1.smithi073.stdout:1/51: chown d5/fc 1061873521 1 2024-08-31T05:20:54.124 INFO:tasks.workunit.client.1.smithi073.stdout:1/52: chown l3 14379 1 2024-08-31T05:20:54.125 INFO:tasks.workunit.client.1.smithi073.stdout:5/52: creat dc/f12 x:0 0 0 2024-08-31T05:20:54.128 INFO:tasks.workunit.client.1.smithi073.stdout:8/54: unlink d0/f9 0 2024-08-31T05:20:54.128 INFO:tasks.workunit.client.1.smithi073.stdout:8/55: dread - d0/f5 zero size 2024-08-31T05:20:54.129 INFO:tasks.workunit.client.1.smithi073.stdout:0/60: chown d0/c9 5113 1 2024-08-31T05:20:54.129 INFO:tasks.workunit.client.1.smithi073.stdout:8/56: chown d0/f4 8219723 1 2024-08-31T05:20:54.129 INFO:tasks.workunit.client.1.smithi073.stdout:0/61: chown d0/d1/ff 216226 1 2024-08-31T05:20:54.131 INFO:tasks.workunit.client.1.smithi073.stdout:9/44: mkdir dc/de 0 2024-08-31T05:20:54.132 INFO:tasks.workunit.client.1.smithi073.stdout:9/45: stat f8 0 2024-08-31T05:20:54.132 INFO:tasks.workunit.client.1.smithi073.stdout:7/30: rmdir d1 39 2024-08-31T05:20:54.134 INFO:tasks.workunit.client.1.smithi073.stdout:2/56: link d2/l8 d2/l11 0 2024-08-31T05:20:54.134 INFO:tasks.workunit.client.1.smithi073.stdout:6/26: dwrite f3 [0,4194304] 0 2024-08-31T05:20:54.136 INFO:tasks.workunit.client.1.smithi073.stdout:5/53: symlink dc/df/l13 0 2024-08-31T05:20:54.139 INFO:tasks.workunit.client.1.smithi073.stdout:8/57: chown d0/c6 4445 1 2024-08-31T05:20:54.140 INFO:tasks.workunit.client.1.smithi073.stdout:0/62: mknod d0/d1/c12 0 2024-08-31T05:20:54.140 INFO:tasks.workunit.client.1.smithi073.stdout:8/58: dread d0/fd [0,4194304] 0 2024-08-31T05:20:54.144 INFO:tasks.workunit.client.1.smithi073.stdout:7/31: chown d1 97715 1 2024-08-31T05:20:54.144 INFO:tasks.workunit.client.1.smithi073.stdout:7/32: fsync - no filename 2024-08-31T05:20:54.144 INFO:tasks.workunit.client.1.smithi073.stdout:7/33: fdatasync - no filename 2024-08-31T05:20:54.151 INFO:tasks.workunit.client.1.smithi073.stdout:1/53: truncate f2 1811572 0 2024-08-31T05:20:54.154 INFO:tasks.workunit.client.1.smithi073.stdout:0/63: creat d0/d1/f13 x:0 0 0 2024-08-31T05:20:54.154 INFO:tasks.workunit.client.1.smithi073.stdout:8/59: mknod d0/c13 0 2024-08-31T05:20:54.156 INFO:tasks.workunit.client.1.smithi073.stdout:7/34: chown d1/c4 44 1 2024-08-31T05:20:54.157 INFO:tasks.workunit.client.1.smithi073.stdout:9/46: mknod dc/de/cf 0 2024-08-31T05:20:54.162 INFO:tasks.workunit.client.1.smithi073.stdout:1/54: creat d5/da/fe x:0 0 0 2024-08-31T05:20:54.162 INFO:tasks.workunit.client.1.smithi073.stdout:1/55: dread - d5/da/fe zero size 2024-08-31T05:20:54.165 INFO:tasks.workunit.client.1.smithi073.stdout:5/54: truncate fb 187309 0 2024-08-31T05:20:54.166 INFO:tasks.workunit.client.1.smithi073.stdout:0/64: mknod d0/d1/c14 0 2024-08-31T05:20:54.168 INFO:tasks.workunit.client.1.smithi073.stdout:5/55: truncate dc/f12 141426 0 2024-08-31T05:20:54.168 INFO:tasks.workunit.client.1.smithi073.stdout:8/60: mknod d0/c14 0 2024-08-31T05:20:54.169 INFO:tasks.workunit.client.1.smithi073.stdout:4/48: dread f5 [0,4194304] 0 2024-08-31T05:20:54.169 INFO:tasks.workunit.client.1.smithi073.stdout:7/35: mknod d1/c6 0 2024-08-31T05:20:54.170 INFO:tasks.workunit.client.1.smithi073.stdout:5/56: chown dc/ce 86 1 2024-08-31T05:20:54.170 INFO:tasks.workunit.client.1.smithi073.stdout:8/61: chown d0/c12 1 1 2024-08-31T05:20:54.170 INFO:tasks.workunit.client.1.smithi073.stdout:1/56: dwrite d5/fd [0,4194304] 0 2024-08-31T05:20:54.171 INFO:tasks.workunit.client.1.smithi073.stdout:9/47: mkdir dc/d10 0 2024-08-31T05:20:54.171 INFO:tasks.workunit.client.1.smithi073.stdout:4/49: fsync f0 0 2024-08-31T05:20:54.173 INFO:tasks.workunit.client.1.smithi073.stdout:3/73: getdents da 0 2024-08-31T05:20:54.173 INFO:tasks.workunit.client.1.smithi073.stdout:2/57: dwrite d2/fa [0,4194304] 0 2024-08-31T05:20:54.174 INFO:tasks.workunit.client.1.smithi073.stdout:6/27: truncate f6 4104702 0 2024-08-31T05:20:54.175 INFO:tasks.workunit.client.1.smithi073.stdout:3/74: dread - da/f12 zero size 2024-08-31T05:20:54.176 INFO:tasks.workunit.client.1.smithi073.stdout:2/58: write d2/d9/f10 [155490,96936] 0 2024-08-31T05:20:54.180 INFO:tasks.workunit.client.1.smithi073.stdout:7/36: creat d1/f7 x:0 0 0 2024-08-31T05:20:54.181 INFO:tasks.workunit.client.1.smithi073.stdout:5/57: creat dc/f14 x:0 0 0 2024-08-31T05:20:54.182 INFO:tasks.workunit.client.1.smithi073.stdout:5/58: write dc/f14 [457606,110849] 0 2024-08-31T05:20:54.182 INFO:tasks.workunit.client.1.smithi073.stdout:9/48: rmdir dc 39 2024-08-31T05:20:54.183 INFO:tasks.workunit.client.1.smithi073.stdout:8/62: rmdir d0/db 39 2024-08-31T05:20:54.183 INFO:tasks.workunit.client.1.smithi073.stdout:2/59: fdatasync d2/d9/f10 0 2024-08-31T05:20:54.184 INFO:tasks.workunit.client.1.smithi073.stdout:4/50: mkdir d7/db 0 2024-08-31T05:20:54.187 INFO:tasks.workunit.client.1.smithi073.stdout:6/28: creat fa x:0 0 0 2024-08-31T05:20:54.190 INFO:tasks.workunit.client.1.smithi073.stdout:5/59: dwrite f9 [0,4194304] 0 2024-08-31T05:20:54.192 INFO:tasks.workunit.client.1.smithi073.stdout:3/75: mkdir da/d18 0 2024-08-31T05:20:54.194 INFO:tasks.workunit.client.1.smithi073.stdout:3/76: truncate da/fb 319366 0 2024-08-31T05:20:54.196 INFO:tasks.workunit.client.1.smithi073.stdout:7/37: rename d1/c4 to d1/c8 0 2024-08-31T05:20:54.197 INFO:tasks.workunit.client.1.smithi073.stdout:7/38: dread - d1/f7 zero size 2024-08-31T05:20:54.198 INFO:tasks.workunit.client.1.smithi073.stdout:5/60: dwrite f9 [0,4194304] 0 2024-08-31T05:20:54.203 INFO:tasks.workunit.client.1.smithi073.stdout:5/61: dread f2 [0,4194304] 0 2024-08-31T05:20:54.203 INFO:tasks.workunit.client.1.smithi073.stdout:5/62: readlink l0 0 2024-08-31T05:20:54.204 INFO:tasks.workunit.client.1.smithi073.stdout:4/51: creat d7/fc x:0 0 0 2024-08-31T05:20:54.209 INFO:tasks.workunit.client.1.smithi073.stdout:6/29: symlink lb 0 2024-08-31T05:20:54.218 INFO:tasks.workunit.client.1.smithi073.stdout:7/39: readlink d1/l5 0 2024-08-31T05:20:54.218 INFO:tasks.workunit.client.1.smithi073.stdout:9/49: mkdir dc/de/d11 0 2024-08-31T05:20:54.219 INFO:tasks.workunit.client.1.smithi073.stdout:6/30: write f3 [6714243,3866] 0 2024-08-31T05:20:54.219 INFO:tasks.workunit.client.1.smithi073.stdout:8/63: rename d0/fd to d0/db/f15 0 2024-08-31T05:20:54.221 INFO:tasks.workunit.client.1.smithi073.stdout:9/50: dread f5 [0,4194304] 0 2024-08-31T05:20:54.222 INFO:tasks.workunit.client.1.smithi073.stdout:5/63: symlink dc/l15 0 2024-08-31T05:20:54.224 INFO:tasks.workunit.client.1.smithi073.stdout:2/60: creat d2/d9/df/f12 x:0 0 0 2024-08-31T05:20:54.224 INFO:tasks.workunit.client.1.smithi073.stdout:2/61: readlink d2/l5 0 2024-08-31T05:20:54.293 INFO:tasks.workunit.client.1.smithi073.stdout:1/57: sync 2024-08-31T05:20:54.293 INFO:tasks.workunit.client.1.smithi073.stdout:7/40: sync 2024-08-31T05:20:54.293 INFO:tasks.workunit.client.1.smithi073.stdout:0/65: sync 2024-08-31T05:20:54.294 INFO:tasks.workunit.client.1.smithi073.stdout:0/66: fdatasync d0/f11 0 2024-08-31T05:20:54.334 INFO:tasks.workunit.client.1.smithi073.stdout:3/77: symlink da/d18/l19 0 2024-08-31T05:20:54.337 INFO:tasks.workunit.client.1.smithi073.stdout:8/64: unlink d0/f8 0 2024-08-31T05:20:54.337 INFO:tasks.workunit.client.1.smithi073.stdout:9/51: fsync f8 0 2024-08-31T05:20:54.338 INFO:tasks.workunit.client.1.smithi073.stdout:5/64: mkdir dc/d16 0 2024-08-31T05:20:54.338 INFO:tasks.workunit.client.1.smithi073.stdout:4/52: getdents d7/db 0 2024-08-31T05:20:54.341 INFO:tasks.workunit.client.1.smithi073.stdout:2/62: rename d2/d9/f10 to d2/d9/f13 0 2024-08-31T05:20:54.341 INFO:tasks.workunit.client.1.smithi073.stdout:2/63: write f1 [646821,60027] 0 2024-08-31T05:20:54.343 INFO:tasks.workunit.client.1.smithi073.stdout:7/41: mknod d1/c9 0 2024-08-31T05:20:54.343 INFO:tasks.workunit.client.1.smithi073.stdout:2/64: dread d2/d9/f13 [0,4194304] 0 2024-08-31T05:20:54.344 INFO:tasks.workunit.client.1.smithi073.stdout:1/58: symlink d5/lf 0 2024-08-31T05:20:54.345 INFO:tasks.workunit.client.1.smithi073.stdout:0/67: mkdir d0/d15 0 2024-08-31T05:20:54.347 INFO:tasks.workunit.client.1.smithi073.stdout:3/78: mknod da/d18/c1a 0 2024-08-31T05:20:54.351 INFO:tasks.workunit.client.1.smithi073.stdout:8/65: mknod d0/db/c16 0 2024-08-31T05:20:54.352 INFO:tasks.workunit.client.1.smithi073.stdout:9/52: rename dc/de/cf to dc/c12 0 2024-08-31T05:20:54.353 INFO:tasks.workunit.client.1.smithi073.stdout:3/79: dwrite da/fb [0,4194304] 0 2024-08-31T05:20:54.354 INFO:tasks.workunit.client.1.smithi073.stdout:3/80: write da/f17 [940145,41525] 0 2024-08-31T05:20:54.354 INFO:tasks.workunit.client.1.smithi073.stdout:5/65: creat dc/f17 x:0 0 0 2024-08-31T05:20:54.355 INFO:tasks.workunit.client.1.smithi073.stdout:5/66: chown dc/df 0 1 2024-08-31T05:20:54.355 INFO:tasks.workunit.client.1.smithi073.stdout:3/81: write da/fb [1067885,109858] 0 2024-08-31T05:20:54.355 INFO:tasks.workunit.client.1.smithi073.stdout:3/82: stat da/f14 0 2024-08-31T05:20:54.357 INFO:tasks.workunit.client.1.smithi073.stdout:7/42: mkdir d1/da 0 2024-08-31T05:20:54.359 INFO:tasks.workunit.client.1.smithi073.stdout:2/65: write d2/d9/f13 [1137248,103906] 0 2024-08-31T05:20:54.361 INFO:tasks.workunit.client.1.smithi073.stdout:1/59: unlink d5/lf 0 2024-08-31T05:20:54.367 INFO:tasks.workunit.client.1.smithi073.stdout:9/53: rmdir dc/de 39 2024-08-31T05:20:54.367 INFO:tasks.workunit.client.1.smithi073.stdout:9/54: chown f7 16699 1 2024-08-31T05:20:54.369 INFO:tasks.workunit.client.1.smithi073.stdout:4/53: symlink d7/db/ld 0 2024-08-31T05:20:54.369 INFO:tasks.workunit.client.1.smithi073.stdout:4/54: rename d7/db to d7/db/de 22 2024-08-31T05:20:54.373 INFO:tasks.workunit.client.1.smithi073.stdout:3/83: mkdir da/d1b 0 2024-08-31T05:20:54.374 INFO:tasks.workunit.client.1.smithi073.stdout:3/84: chown da/fd 5554275 1 2024-08-31T05:20:54.374 INFO:tasks.workunit.client.1.smithi073.stdout:2/66: mknod d2/c14 0 2024-08-31T05:20:54.375 INFO:tasks.workunit.client.1.smithi073.stdout:1/60: mkdir d5/d10 0 2024-08-31T05:20:54.377 INFO:tasks.workunit.client.1.smithi073.stdout:8/66: fdatasync d0/db/f15 0 2024-08-31T05:20:54.379 INFO:tasks.workunit.client.1.smithi073.stdout:4/55: mkdir d7/df 0 2024-08-31T05:20:54.380 INFO:tasks.workunit.client.1.smithi073.stdout:3/85: dread f4 [0,4194304] 0 2024-08-31T05:20:54.380 INFO:tasks.workunit.client.1.smithi073.stdout:3/86: dread - da/f10 zero size 2024-08-31T05:20:54.381 INFO:tasks.workunit.client.1.smithi073.stdout:4/56: truncate d7/f8 1017087 0 2024-08-31T05:20:54.383 INFO:tasks.workunit.client.1.smithi073.stdout:2/67: dwrite d2/fa [0,4194304] 0 2024-08-31T05:20:54.383 INFO:tasks.workunit.client.1.smithi073.stdout:2/68: stat d2/d9/df/f12 0 2024-08-31T05:20:54.384 INFO:tasks.workunit.client.1.smithi073.stdout:2/69: write d2/d9/df/f12 [552390,8849] 0 2024-08-31T05:20:54.387 INFO:tasks.workunit.client.1.smithi073.stdout:9/55: rmdir dc/de 39 2024-08-31T05:20:54.391 INFO:tasks.workunit.client.1.smithi073.stdout:2/70: dwrite d2/d9/df/f12 [0,4194304] 0 2024-08-31T05:20:54.398 INFO:tasks.workunit.client.1.smithi073.stdout:4/57: creat d7/df/f10 x:0 0 0 2024-08-31T05:20:54.401 INFO:tasks.workunit.client.1.smithi073.stdout:2/71: symlink d2/d9/df/l15 0 2024-08-31T05:20:54.403 INFO:tasks.workunit.client.1.smithi073.stdout:8/67: creat d0/f17 x:0 0 0 2024-08-31T05:20:54.406 INFO:tasks.workunit.client.1.smithi073.stdout:4/58: mkdir d7/db/d11 0 2024-08-31T05:20:54.407 INFO:tasks.workunit.client.1.smithi073.stdout:2/72: symlink d2/d9/l16 0 2024-08-31T05:20:54.408 INFO:tasks.workunit.client.1.smithi073.stdout:2/73: write d2/f4 [1838006,52767] 0 2024-08-31T05:20:54.409 INFO:tasks.workunit.client.1.smithi073.stdout:2/74: write d2/d9/df/f12 [792347,124926] 0 2024-08-31T05:20:54.409 INFO:tasks.workunit.client.1.smithi073.stdout:2/75: fsync f1 0 2024-08-31T05:20:54.410 INFO:tasks.workunit.client.1.smithi073.stdout:0/68: sync 2024-08-31T05:20:54.414 INFO:tasks.workunit.client.1.smithi073.stdout:9/56: link l4 dc/de/d11/l13 0 2024-08-31T05:20:54.414 INFO:tasks.workunit.client.1.smithi073.stdout:9/57: write f8 [757155,627] 0 2024-08-31T05:20:54.415 INFO:tasks.workunit.client.1.smithi073.stdout:9/58: chown dc/d10 16304 1 2024-08-31T05:20:54.415 INFO:tasks.workunit.client.1.smithi073.stdout:9/59: write f7 [1886808,32316] 0 2024-08-31T05:20:54.416 INFO:tasks.workunit.client.1.smithi073.stdout:4/59: link f0 d7/f12 0 2024-08-31T05:20:54.419 INFO:tasks.workunit.client.1.smithi073.stdout:0/69: write d0/d1/f6 [75790,36725] 0 2024-08-31T05:20:54.419 INFO:tasks.workunit.client.1.smithi073.stdout:0/70: chown d0/d1/f13 28 1 2024-08-31T05:20:54.420 INFO:tasks.workunit.client.1.smithi073.stdout:8/68: creat d0/f18 x:0 0 0 2024-08-31T05:20:54.427 INFO:tasks.workunit.client.1.smithi073.stdout:9/60: creat dc/de/d11/f14 x:0 0 0 2024-08-31T05:20:54.429 INFO:tasks.workunit.client.1.smithi073.stdout:0/71: dwrite d0/f4 [0,4194304] 0 2024-08-31T05:20:54.430 INFO:tasks.workunit.client.1.smithi073.stdout:8/69: dwrite d0/f17 [0,4194304] 0 2024-08-31T05:20:54.433 INFO:tasks.workunit.client.1.smithi073.stdout:0/72: chown d0/d1/ff 29331 1 2024-08-31T05:20:54.435 INFO:tasks.workunit.client.1.smithi073.stdout:4/60: dwrite f0 [0,4194304] 0 2024-08-31T05:20:54.435 INFO:tasks.workunit.client.1.smithi073.stdout:9/61: creat dc/de/d11/f15 x:0 0 0 2024-08-31T05:20:54.437 INFO:tasks.workunit.client.1.smithi073.stdout:0/73: write d0/f7 [4844685,40647] 0 2024-08-31T05:20:54.440 INFO:tasks.workunit.client.1.smithi073.stdout:0/74: read d0/f7 [460507,117759] 0 2024-08-31T05:20:54.440 INFO:tasks.workunit.client.1.smithi073.stdout:9/62: write f7 [713336,105993] 0 2024-08-31T05:20:54.442 INFO:tasks.workunit.client.1.smithi073.stdout:9/63: chown f9 93208 1 2024-08-31T05:20:54.446 INFO:tasks.workunit.client.1.smithi073.stdout:8/70: dwrite d0/f18 [0,4194304] 0 2024-08-31T05:20:54.448 INFO:tasks.workunit.client.1.smithi073.stdout:9/64: mknod dc/de/c16 0 2024-08-31T05:20:54.454 INFO:tasks.workunit.client.1.smithi073.stdout:8/71: mknod d0/c19 0 2024-08-31T05:20:54.456 INFO:tasks.workunit.client.1.smithi073.stdout:8/72: dread - d0/f5 zero size 2024-08-31T05:20:54.458 INFO:tasks.workunit.client.1.smithi073.stdout:9/65: dwrite dc/de/d11/f15 [0,4194304] 0 2024-08-31T05:20:54.458 INFO:tasks.workunit.client.1.smithi073.stdout:8/73: chown d0/c2 1327552048 1 2024-08-31T05:20:54.460 INFO:tasks.workunit.client.1.smithi073.stdout:9/66: mknod dc/de/d11/c17 0 2024-08-31T05:20:54.461 INFO:tasks.workunit.client.1.smithi073.stdout:8/74: creat d0/f1a x:0 0 0 2024-08-31T05:20:54.461 INFO:tasks.workunit.client.1.smithi073.stdout:8/75: stat d0/c6 0 2024-08-31T05:20:54.463 INFO:tasks.workunit.client.1.smithi073.stdout:9/67: creat dc/d10/f18 x:0 0 0 2024-08-31T05:20:54.463 INFO:tasks.workunit.client.1.smithi073.stdout:9/68: chown fb 35249 1 2024-08-31T05:20:54.467 INFO:tasks.workunit.client.1.smithi073.stdout:8/76: creat d0/f1b x:0 0 0 2024-08-31T05:20:54.469 INFO:tasks.workunit.client.1.smithi073.stdout:8/77: mkdir d0/db/d1c 0 2024-08-31T05:20:54.469 INFO:tasks.workunit.client.1.smithi073.stdout:9/69: dread f5 [0,4194304] 0 2024-08-31T05:20:54.472 INFO:tasks.workunit.client.1.smithi073.stdout:9/70: creat dc/d10/f19 x:0 0 0 2024-08-31T05:20:54.473 INFO:tasks.workunit.client.1.smithi073.stdout:6/31: dread f6 [0,4194304] 0 2024-08-31T05:20:54.473 INFO:tasks.workunit.client.1.smithi073.stdout:8/78: mknod d0/c1d 0 2024-08-31T05:20:54.474 INFO:tasks.workunit.client.1.smithi073.stdout:6/32: write f3 [5114516,58824] 0 2024-08-31T05:20:54.476 INFO:tasks.workunit.client.1.smithi073.stdout:8/79: rmdir d0 39 2024-08-31T05:20:54.477 INFO:tasks.workunit.client.1.smithi073.stdout:6/33: creat fc x:0 0 0 2024-08-31T05:20:54.480 INFO:tasks.workunit.client.1.smithi073.stdout:7/43: getdents d1 0 2024-08-31T05:20:54.481 INFO:tasks.workunit.client.1.smithi073.stdout:9/71: dwrite fb [0,4194304] 0 2024-08-31T05:20:54.484 INFO:tasks.workunit.client.1.smithi073.stdout:7/44: unlink d1/f7 0 2024-08-31T05:20:54.484 INFO:tasks.workunit.client.1.smithi073.stdout:7/45: dwrite - no filename 2024-08-31T05:20:54.484 INFO:tasks.workunit.client.1.smithi073.stdout:7/46: dwrite - no filename 2024-08-31T05:20:54.484 INFO:tasks.workunit.client.1.smithi073.stdout:7/47: fdatasync - no filename 2024-08-31T05:20:54.484 INFO:tasks.workunit.client.1.smithi073.stdout:7/48: chown d1/l5 29 1 2024-08-31T05:20:54.487 INFO:tasks.workunit.client.1.smithi073.stdout:9/72: rename dc/de/d11/f15 to dc/de/f1a 0 2024-08-31T05:20:54.489 INFO:tasks.workunit.client.1.smithi073.stdout:3/87: getdents da 0 2024-08-31T05:20:54.490 INFO:tasks.workunit.client.1.smithi073.stdout:7/49: symlink d1/lb 0 2024-08-31T05:20:54.490 INFO:tasks.workunit.client.1.smithi073.stdout:7/50: truncate - no filename 2024-08-31T05:20:54.490 INFO:tasks.workunit.client.1.smithi073.stdout:7/51: readlink d1/l5 0 2024-08-31T05:20:54.490 INFO:tasks.workunit.client.1.smithi073.stdout:7/52: chown d1 16323359 1 2024-08-31T05:20:54.491 INFO:tasks.workunit.client.1.smithi073.stdout:9/73: symlink dc/de/d11/l1b 0 2024-08-31T05:20:54.492 INFO:tasks.workunit.client.1.smithi073.stdout:7/53: mknod d1/cc 0 2024-08-31T05:20:54.492 INFO:tasks.workunit.client.1.smithi073.stdout:7/54: write - no filename 2024-08-31T05:20:54.492 INFO:tasks.workunit.client.1.smithi073.stdout:7/55: write - no filename 2024-08-31T05:20:54.494 INFO:tasks.workunit.client.1.smithi073.stdout:3/88: mknod da/d1b/c1c 0 2024-08-31T05:20:54.495 INFO:tasks.workunit.client.1.smithi073.stdout:3/89: fsync da/f12 0 2024-08-31T05:20:54.499 INFO:tasks.workunit.client.1.smithi073.stdout:5/67: dwrite fb [0,4194304] 0 2024-08-31T05:20:54.499 INFO:tasks.workunit.client.1.smithi073.stdout:7/56: link d1/lb d1/ld 0 2024-08-31T05:20:54.499 INFO:tasks.workunit.client.1.smithi073.stdout:7/57: dwrite - no filename 2024-08-31T05:20:54.499 INFO:tasks.workunit.client.1.smithi073.stdout:7/58: fdatasync - no filename 2024-08-31T05:20:54.499 INFO:tasks.workunit.client.1.smithi073.stdout:7/59: write - no filename 2024-08-31T05:20:54.499 INFO:tasks.workunit.client.1.smithi073.stdout:7/60: dwrite - no filename 2024-08-31T05:20:54.500 INFO:tasks.workunit.client.1.smithi073.stdout:7/61: write - no filename 2024-08-31T05:20:54.501 INFO:tasks.workunit.client.1.smithi073.stdout:1/61: truncate d5/fd 2323136 0 2024-08-31T05:20:54.502 INFO:tasks.workunit.client.1.smithi073.stdout:3/90: creat da/d1b/f1d x:0 0 0 2024-08-31T05:20:54.506 INFO:tasks.workunit.client.1.smithi073.stdout:7/62: rename d1/c9 to d1/ce 0 2024-08-31T05:20:54.508 INFO:tasks.workunit.client.1.smithi073.stdout:1/62: write d5/fc [2238024,51734] 0 2024-08-31T05:20:54.509 INFO:tasks.workunit.client.1.smithi073.stdout:3/91: symlink da/d18/l1e 0 2024-08-31T05:20:54.510 INFO:tasks.workunit.client.1.smithi073.stdout:2/76: getdents d2/d9 0 2024-08-31T05:20:54.515 INFO:tasks.workunit.client.1.smithi073.stdout:1/63: rmdir d5 39 2024-08-31T05:20:54.515 INFO:tasks.workunit.client.1.smithi073.stdout:4/61: getdents d7 0 2024-08-31T05:20:54.516 INFO:tasks.workunit.client.1.smithi073.stdout:3/92: rmdir da/d1b 39 2024-08-31T05:20:54.517 INFO:tasks.workunit.client.1.smithi073.stdout:2/77: mknod d2/d9/df/c17 0 2024-08-31T05:20:54.517 INFO:tasks.workunit.client.1.smithi073.stdout:2/78: readlink d2/l5 0 2024-08-31T05:20:54.521 INFO:tasks.workunit.client.1.smithi073.stdout:4/62: mkdir d7/df/d13 0 2024-08-31T05:20:54.522 INFO:tasks.workunit.client.1.smithi073.stdout:4/63: write d7/f8 [1556575,57572] 0 2024-08-31T05:20:54.522 INFO:tasks.workunit.client.1.smithi073.stdout:1/64: dread d5/f7 [0,4194304] 0 2024-08-31T05:20:54.524 INFO:tasks.workunit.client.1.smithi073.stdout:3/93: rmdir da/d18 39 2024-08-31T05:20:54.525 INFO:tasks.workunit.client.1.smithi073.stdout:2/79: symlink d2/d9/df/l18 0 2024-08-31T05:20:54.526 INFO:tasks.workunit.client.1.smithi073.stdout:5/68: getdents dc 0 2024-08-31T05:20:54.526 INFO:tasks.workunit.client.1.smithi073.stdout:2/80: write d2/fa [4823387,98321] 0 2024-08-31T05:20:54.526 INFO:tasks.workunit.client.1.smithi073.stdout:7/63: link d1/c8 d1/cf 0 2024-08-31T05:20:54.527 INFO:tasks.workunit.client.1.smithi073.stdout:5/69: chown fb 487911 1 2024-08-31T05:20:54.528 INFO:tasks.workunit.client.1.smithi073.stdout:5/70: dread dc/f12 [0,4194304] 0 2024-08-31T05:20:54.531 INFO:tasks.workunit.client.1.smithi073.stdout:4/64: chown l4 916 1 2024-08-31T05:20:54.532 INFO:tasks.workunit.client.1.smithi073.stdout:0/75: truncate d0/d1/f6 1902169 0 2024-08-31T05:20:54.538 INFO:tasks.workunit.client.1.smithi073.stdout:2/81: rename d2/d9/f13 to d2/f19 0 2024-08-31T05:20:54.539 INFO:tasks.workunit.client.1.smithi073.stdout:5/71: mknod dc/df/c18 0 2024-08-31T05:20:54.542 INFO:tasks.workunit.client.1.smithi073.stdout:4/65: unlink d7/df/f10 0 2024-08-31T05:20:54.546 INFO:tasks.workunit.client.1.smithi073.stdout:3/94: creat da/d18/f1f x:0 0 0 2024-08-31T05:20:54.551 INFO:tasks.workunit.client.1.smithi073.stdout:2/82: creat d2/d9/df/f1a x:0 0 0 2024-08-31T05:20:54.552 INFO:tasks.workunit.client.1.smithi073.stdout:5/72: read dc/f12 [112354,128232] 0 2024-08-31T05:20:54.553 INFO:tasks.workunit.client.1.smithi073.stdout:4/66: creat d7/f14 x:0 0 0 2024-08-31T05:20:54.554 INFO:tasks.workunit.client.1.smithi073.stdout:3/95: dwrite da/d18/f1f [0,4194304] 0 2024-08-31T05:20:54.554 INFO:tasks.workunit.client.1.smithi073.stdout:6/34: dwrite f6 [0,4194304] 0 2024-08-31T05:20:54.557 INFO:tasks.workunit.client.1.smithi073.stdout:0/76: creat d0/d15/f16 x:0 0 0 2024-08-31T05:20:54.558 INFO:tasks.workunit.client.1.smithi073.stdout:9/74: truncate f9 3840120 0 2024-08-31T05:20:54.560 INFO:tasks.workunit.client.1.smithi073.stdout:0/77: dread - d0/d15/f16 zero size 2024-08-31T05:20:54.561 INFO:tasks.workunit.client.1.smithi073.stdout:5/73: symlink dc/l19 0 2024-08-31T05:20:54.564 INFO:tasks.workunit.client.1.smithi073.stdout:3/96: dread da/fb [0,4194304] 0 2024-08-31T05:20:54.565 INFO:tasks.workunit.client.1.smithi073.stdout:4/67: dread d7/f12 [0,4194304] 0 2024-08-31T05:20:54.566 INFO:tasks.workunit.client.1.smithi073.stdout:6/35: creat fd x:0 0 0 2024-08-31T05:20:54.566 INFO:tasks.workunit.client.1.smithi073.stdout:9/75: rmdir dc/de 39 2024-08-31T05:20:54.568 INFO:tasks.workunit.client.1.smithi073.stdout:0/78: mkdir d0/d15/d17 0 2024-08-31T05:20:54.569 INFO:tasks.workunit.client.1.smithi073.stdout:0/79: dread - d0/f11 zero size 2024-08-31T05:20:54.570 INFO:tasks.workunit.client.1.smithi073.stdout:2/83: dwrite d2/f19 [0,4194304] 0 2024-08-31T05:20:54.571 INFO:tasks.workunit.client.1.smithi073.stdout:9/76: rename dc to dc/de/d11/d1c 22 2024-08-31T05:20:54.571 INFO:tasks.workunit.client.1.smithi073.stdout:9/77: fdatasync fb 0 2024-08-31T05:20:54.572 INFO:tasks.workunit.client.1.smithi073.stdout:3/97: creat da/d1b/f20 x:0 0 0 2024-08-31T05:20:54.573 INFO:tasks.workunit.client.1.smithi073.stdout:9/78: write f8 [3646886,106667] 0 2024-08-31T05:20:54.574 INFO:tasks.workunit.client.1.smithi073.stdout:2/84: symlink d2/l1b 0 2024-08-31T05:20:54.574 INFO:tasks.workunit.client.1.smithi073.stdout:9/79: chown dc/de/d11/l1b 12 1 2024-08-31T05:20:54.575 INFO:tasks.workunit.client.1.smithi073.stdout:2/85: rename d2/d9 to d2/d9/d1c 22 2024-08-31T05:20:54.577 INFO:tasks.workunit.client.1.smithi073.stdout:3/98: creat da/d18/f21 x:0 0 0 2024-08-31T05:20:54.580 INFO:tasks.workunit.client.1.smithi073.stdout:2/86: dread d2/f19 [0,4194304] 0 2024-08-31T05:20:54.580 INFO:tasks.workunit.client.1.smithi073.stdout:9/80: mknod dc/de/c1d 0 2024-08-31T05:20:54.581 INFO:tasks.workunit.client.1.smithi073.stdout:0/80: write d0/d1/f6 [642560,6770] 0 2024-08-31T05:20:54.581 INFO:tasks.workunit.client.1.smithi073.stdout:9/81: fdatasync dc/d10/f18 0 2024-08-31T05:20:54.582 INFO:tasks.workunit.client.1.smithi073.stdout:0/81: chown d0/d1/f13 3332 1 2024-08-31T05:20:54.587 INFO:tasks.workunit.client.1.smithi073.stdout:2/87: dwrite d2/fa [0,4194304] 0 2024-08-31T05:20:54.589 INFO:tasks.workunit.client.1.smithi073.stdout:0/82: link d0/ce d0/d1/c18 0 2024-08-31T05:20:54.592 INFO:tasks.workunit.client.1.smithi073.stdout:9/82: dwrite dc/de/f1a [0,4194304] 0 2024-08-31T05:20:54.594 INFO:tasks.workunit.client.1.smithi073.stdout:2/88: rename d2/c3 to d2/d9/c1d 0 2024-08-31T05:20:54.597 INFO:tasks.workunit.client.1.smithi073.stdout:1/65: dwrite f2 [0,4194304] 0 2024-08-31T05:20:54.599 INFO:tasks.workunit.client.1.smithi073.stdout:9/83: creat dc/de/f1e x:0 0 0 2024-08-31T05:20:54.600 INFO:tasks.workunit.client.1.smithi073.stdout:9/84: fdatasync dc/d10/f18 0 2024-08-31T05:20:54.600 INFO:tasks.workunit.client.1.smithi073.stdout:9/85: chown c6 6793 1 2024-08-31T05:20:54.602 INFO:tasks.workunit.client.1.smithi073.stdout:8/80: sync 2024-08-31T05:20:54.608 INFO:tasks.workunit.client.1.smithi073.stdout:9/86: creat dc/de/f1f x:0 0 0 2024-08-31T05:20:54.611 INFO:tasks.workunit.client.1.smithi073.stdout:0/83: rmdir d0/d15/d17 0 2024-08-31T05:20:54.612 INFO:tasks.workunit.client.1.smithi073.stdout:8/81: chown d0/f4 12520923 1 2024-08-31T05:20:54.613 INFO:tasks.workunit.client.1.smithi073.stdout:0/84: mkdir d0/d15/d19 0 2024-08-31T05:20:54.614 INFO:tasks.workunit.client.1.smithi073.stdout:0/85: truncate d0/d15/f16 774753 0 2024-08-31T05:20:54.617 INFO:tasks.workunit.client.1.smithi073.stdout:8/82: getdents d0/db/d1c 0 2024-08-31T05:20:54.660 INFO:tasks.workunit.client.1.smithi073.stdout:1/66: write d5/fd [296052,49387] 0 2024-08-31T05:20:54.660 INFO:tasks.workunit.client.1.smithi073.stdout:8/83: unlink d0/f18 0 2024-08-31T05:20:54.661 INFO:tasks.workunit.client.1.smithi073.stdout:2/89: stat d2/d9/c1d 0 2024-08-31T05:20:54.662 INFO:tasks.workunit.client.1.smithi073.stdout:8/84: chown d0/db/c16 421446838 1 2024-08-31T05:20:54.662 INFO:tasks.workunit.client.1.smithi073.stdout:0/86: dwrite d0/d1/fa [0,4194304] 0 2024-08-31T05:20:54.666 INFO:tasks.workunit.client.1.smithi073.stdout:8/85: truncate d0/fe 460473 0 2024-08-31T05:20:54.666 INFO:tasks.workunit.client.1.smithi073.stdout:0/87: truncate d0/d1/ff 541402 0 2024-08-31T05:20:54.669 INFO:tasks.workunit.client.1.smithi073.stdout:8/86: dread d0/fe [0,4194304] 0 2024-08-31T05:20:54.671 INFO:tasks.workunit.client.1.smithi073.stdout:0/88: truncate d0/d1/f13 118849 0 2024-08-31T05:20:54.672 INFO:tasks.workunit.client.1.smithi073.stdout:1/67: dwrite d5/fd [0,4194304] 0 2024-08-31T05:20:54.673 INFO:tasks.workunit.client.1.smithi073.stdout:1/68: stat d5/fd 0 2024-08-31T05:20:54.675 INFO:tasks.workunit.client.1.smithi073.stdout:2/90: dwrite d2/d9/df/f1a [0,4194304] 0 2024-08-31T05:20:54.678 INFO:tasks.workunit.client.1.smithi073.stdout:0/89: creat d0/f1a x:0 0 0 2024-08-31T05:20:54.678 INFO:tasks.workunit.client.1.smithi073.stdout:0/90: dread - d0/f11 zero size 2024-08-31T05:20:54.679 INFO:tasks.workunit.client.1.smithi073.stdout:1/69: mknod d5/da/c11 0 2024-08-31T05:20:54.685 INFO:tasks.workunit.client.1.smithi073.stdout:0/91: mknod d0/d15/c1b 0 2024-08-31T05:20:54.687 INFO:tasks.workunit.client.1.smithi073.stdout:2/91: dwrite d2/f19 [0,4194304] 0 2024-08-31T05:20:54.687 INFO:tasks.workunit.client.1.smithi073.stdout:1/70: truncate d5/f7 3450530 0 2024-08-31T05:20:54.691 INFO:tasks.workunit.client.1.smithi073.stdout:1/71: mknod d5/da/c12 0 2024-08-31T05:20:54.695 INFO:tasks.workunit.client.1.smithi073.stdout:7/64: sync 2024-08-31T05:20:54.695 INFO:tasks.workunit.client.1.smithi073.stdout:7/65: dread - no filename 2024-08-31T05:20:54.695 INFO:tasks.workunit.client.1.smithi073.stdout:1/72: mkdir d5/da/d13 0 2024-08-31T05:20:54.695 INFO:tasks.workunit.client.1.smithi073.stdout:2/92: dread d2/f19 [0,4194304] 0 2024-08-31T05:20:54.695 INFO:tasks.workunit.client.1.smithi073.stdout:7/66: chown d1 10595 1 2024-08-31T05:20:54.696 INFO:tasks.workunit.client.1.smithi073.stdout:0/92: dwrite d0/d15/f16 [0,4194304] 0 2024-08-31T05:20:54.698 INFO:tasks.workunit.client.1.smithi073.stdout:7/67: mkdir d1/d10 0 2024-08-31T05:20:54.698 INFO:tasks.workunit.client.1.smithi073.stdout:7/68: truncate - no filename 2024-08-31T05:20:54.698 INFO:tasks.workunit.client.1.smithi073.stdout:7/69: dwrite - no filename 2024-08-31T05:20:54.698 INFO:tasks.workunit.client.1.smithi073.stdout:7/70: dwrite - no filename 2024-08-31T05:20:54.698 INFO:tasks.workunit.client.1.smithi073.stdout:7/71: fsync - no filename 2024-08-31T05:20:54.698 INFO:tasks.workunit.client.1.smithi073.stdout:2/93: mknod d2/d9/c1e 0 2024-08-31T05:20:54.699 INFO:tasks.workunit.client.1.smithi073.stdout:1/73: mknod d5/da/d13/c14 0 2024-08-31T05:20:54.701 INFO:tasks.workunit.client.1.smithi073.stdout:7/72: rmdir d1/d10 0 2024-08-31T05:20:54.704 INFO:tasks.workunit.client.1.smithi073.stdout:1/74: dread f0 [0,4194304] 0 2024-08-31T05:20:54.705 INFO:tasks.workunit.client.1.smithi073.stdout:7/73: mkdir d1/d11 0 2024-08-31T05:20:54.706 INFO:tasks.workunit.client.1.smithi073.stdout:0/93: dwrite d0/d1/f6 [0,4194304] 0 2024-08-31T05:20:54.707 INFO:tasks.workunit.client.1.smithi073.stdout:1/75: creat d5/da/f15 x:0 0 0 2024-08-31T05:20:54.709 INFO:tasks.workunit.client.1.smithi073.stdout:7/74: chown d1/lb 924028414 1 2024-08-31T05:20:54.709 INFO:tasks.workunit.client.1.smithi073.stdout:7/75: write - no filename 2024-08-31T05:20:54.710 INFO:tasks.workunit.client.1.smithi073.stdout:7/76: truncate - no filename 2024-08-31T05:20:54.710 INFO:tasks.workunit.client.1.smithi073.stdout:2/94: dwrite f1 [0,4194304] 0 2024-08-31T05:20:54.711 INFO:tasks.workunit.client.1.smithi073.stdout:1/76: creat d5/d10/f16 x:0 0 0 2024-08-31T05:20:54.712 INFO:tasks.workunit.client.1.smithi073.stdout:7/77: creat d1/da/f12 x:0 0 0 2024-08-31T05:20:54.712 INFO:tasks.workunit.client.1.smithi073.stdout:1/77: fdatasync d5/da/f15 0 2024-08-31T05:20:54.715 INFO:tasks.workunit.client.1.smithi073.stdout:1/78: mkdir d5/d17 0 2024-08-31T05:20:54.767 INFO:tasks.workunit.client.1.smithi073.stdout:5/74: sync 2024-08-31T05:20:54.767 INFO:tasks.workunit.client.1.smithi073.stdout:4/68: sync 2024-08-31T05:20:54.768 INFO:tasks.workunit.client.1.smithi073.stdout:4/69: chown f0 8929790 1 2024-08-31T05:20:54.768 INFO:tasks.workunit.client.1.smithi073.stdout:5/75: read dc/f12 [94680,37119] 0 2024-08-31T05:20:54.768 INFO:tasks.workunit.client.1.smithi073.stdout:4/70: write d7/fc [735484,83368] 0 2024-08-31T05:20:54.769 INFO:tasks.workunit.client.1.smithi073.stdout:4/71: dread - d7/f14 zero size 2024-08-31T05:20:54.770 INFO:tasks.workunit.client.1.smithi073.stdout:4/72: dread f5 [0,4194304] 0 2024-08-31T05:20:54.770 INFO:tasks.workunit.client.1.smithi073.stdout:5/76: rename dc/df to dc/d16/d1a 0 2024-08-31T05:20:54.805 INFO:tasks.workunit.client.1.smithi073.stdout:0/94: getdents d0/d15 0 2024-08-31T05:20:54.807 INFO:tasks.workunit.client.1.smithi073.stdout:0/95: write d0/d1/fa [1161483,20475] 0 2024-08-31T05:20:54.808 INFO:tasks.workunit.client.1.smithi073.stdout:8/87: dwrite d0/db/f15 [0,4194304] 0 2024-08-31T05:20:54.810 INFO:tasks.workunit.client.1.smithi073.stdout:0/96: fsync d0/d1/f13 0 2024-08-31T05:20:54.810 INFO:tasks.workunit.client.1.smithi073.stdout:1/79: dread d5/fc [0,4194304] 0 2024-08-31T05:20:54.812 INFO:tasks.workunit.client.1.smithi073.stdout:1/80: write f0 [133306,63472] 0 2024-08-31T05:20:54.815 INFO:tasks.workunit.client.1.smithi073.stdout:0/97: dread d0/f4 [0,4194304] 0 2024-08-31T05:20:54.818 INFO:tasks.workunit.client.1.smithi073.stdout:1/81: creat d5/da/f18 x:0 0 0 2024-08-31T05:20:54.821 INFO:tasks.workunit.client.1.smithi073.stdout:0/98: dwrite d0/d1/fa [0,4194304] 0 2024-08-31T05:20:54.824 INFO:tasks.workunit.client.1.smithi073.stdout:7/78: fsync d1/da/f12 0 2024-08-31T05:20:54.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:54 smithi067 ceph-mon[17432]: pgmap v18: 65 pgs: 65 active+clean; 197 MiB data, 814 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 311 op/s 2024-08-31T05:20:54.825 INFO:tasks.workunit.client.1.smithi073.stdout:7/79: write d1/da/f12 [259218,28158] 0 2024-08-31T05:20:54.826 INFO:tasks.workunit.client.1.smithi073.stdout:1/82: fdatasync d5/fc 0 2024-08-31T05:20:54.827 INFO:tasks.workunit.client.1.smithi073.stdout:1/83: write d5/da/fe [471789,13962] 0 2024-08-31T05:20:54.829 INFO:tasks.workunit.client.1.smithi073.stdout:2/95: truncate d2/d9/df/f12 427259 0 2024-08-31T05:20:54.829 INFO:tasks.workunit.client.1.smithi073.stdout:2/96: truncate f1 4662188 0 2024-08-31T05:20:54.833 INFO:tasks.workunit.client.1.smithi073.stdout:7/80: symlink d1/l13 0 2024-08-31T05:20:54.836 INFO:tasks.workunit.client.1.smithi073.stdout:4/73: dwrite d7/fa [0,4194304] 0 2024-08-31T05:20:54.837 INFO:tasks.workunit.client.1.smithi073.stdout:1/84: creat d5/f19 x:0 0 0 2024-08-31T05:20:54.838 INFO:tasks.workunit.client.1.smithi073.stdout:3/99: sync 2024-08-31T05:20:54.838 INFO:tasks.workunit.client.1.smithi073.stdout:6/36: sync 2024-08-31T05:20:54.838 INFO:tasks.workunit.client.1.smithi073.stdout:9/87: sync 2024-08-31T05:20:54.838 INFO:tasks.workunit.client.1.smithi073.stdout:2/97: creat d2/d9/df/f1f x:0 0 0 2024-08-31T05:20:54.839 INFO:tasks.workunit.client.1.smithi073.stdout:1/85: chown d5/da/c12 13 1 2024-08-31T05:20:54.841 INFO:tasks.workunit.client.1.smithi073.stdout:6/37: truncate fc 63210 0 2024-08-31T05:20:54.841 INFO:tasks.workunit.client.1.smithi073.stdout:0/99: rename d0/ce to d0/c1c 0 2024-08-31T05:20:54.841 INFO:tasks.workunit.client.1.smithi073.stdout:2/98: readlink d2/d9/df/l18 0 2024-08-31T05:20:54.842 INFO:tasks.workunit.client.1.smithi073.stdout:7/81: stat d1/cf 0 2024-08-31T05:20:54.845 INFO:tasks.workunit.client.1.smithi073.stdout:7/82: fsync d1/da/f12 0 2024-08-31T05:20:54.846 INFO:tasks.workunit.client.1.smithi073.stdout:4/74: unlink d7/f14 0 2024-08-31T05:20:54.847 INFO:tasks.workunit.client.1.smithi073.stdout:8/88: dwrite d0/f4 [0,4194304] 0 2024-08-31T05:20:54.847 INFO:tasks.workunit.client.1.smithi073.stdout:9/88: mknod dc/de/d11/c20 0 2024-08-31T05:20:54.850 INFO:tasks.workunit.client.1.smithi073.stdout:0/100: fsync d0/d1/f6 0 2024-08-31T05:20:54.852 INFO:tasks.workunit.client.1.smithi073.stdout:2/99: symlink d2/l20 0 2024-08-31T05:20:54.855 INFO:tasks.workunit.client.1.smithi073.stdout:1/86: dwrite d5/f19 [0,4194304] 0 2024-08-31T05:20:54.855 INFO:tasks.workunit.client.1.smithi073.stdout:3/100: symlink da/l22 0 2024-08-31T05:20:54.857 INFO:tasks.workunit.client.1.smithi073.stdout:6/38: dwrite f3 [0,4194304] 0 2024-08-31T05:20:54.858 INFO:tasks.workunit.client.1.smithi073.stdout:6/39: write f6 [710413,79560] 0 2024-08-31T05:20:54.862 INFO:tasks.workunit.client.1.smithi073.stdout:8/89: readlink d0/db/lf 0 2024-08-31T05:20:54.864 INFO:tasks.workunit.client.1.smithi073.stdout:9/89: symlink dc/de/d11/l21 0 2024-08-31T05:20:54.865 INFO:tasks.workunit.client.1.smithi073.stdout:9/90: read f8 [1869953,75778] 0 2024-08-31T05:20:54.869 INFO:tasks.workunit.client.1.smithi073.stdout:5/77: sync 2024-08-31T05:20:54.869 INFO:tasks.workunit.client.1.smithi073.stdout:4/75: dwrite d7/f12 [0,4194304] 0 2024-08-31T05:20:54.869 INFO:tasks.workunit.client.1.smithi073.stdout:4/76: chown d7/db/d11 1000285 1 2024-08-31T05:20:54.872 INFO:tasks.workunit.client.1.smithi073.stdout:6/40: rename f2 to fe 0 2024-08-31T05:20:54.875 INFO:tasks.workunit.client.1.smithi073.stdout:7/83: mkdir d1/d11/d14 0 2024-08-31T05:20:54.875 INFO:tasks.workunit.client.1.smithi073.stdout:4/77: dread d7/fa [0,4194304] 0 2024-08-31T05:20:54.877 INFO:tasks.workunit.client.1.smithi073.stdout:7/84: dread d1/da/f12 [0,4194304] 0 2024-08-31T05:20:54.878 INFO:tasks.workunit.client.1.smithi073.stdout:7/85: write d1/da/f12 [1126811,59870] 0 2024-08-31T05:20:54.883 INFO:tasks.workunit.client.1.smithi073.stdout:9/91: creat dc/d10/f22 x:0 0 0 2024-08-31T05:20:54.884 INFO:tasks.workunit.client.1.smithi073.stdout:9/92: write f7 [2933747,28717] 0 2024-08-31T05:20:54.886 INFO:tasks.workunit.client.1.smithi073.stdout:5/78: mkdir dc/d16/d1b 0 2024-08-31T05:20:54.897 INFO:tasks.workunit.client.1.smithi073.stdout:8/90: mknod d0/c1e 0 2024-08-31T05:20:54.898 INFO:tasks.workunit.client.1.smithi073.stdout:7/86: mkdir d1/da/d15 0 2024-08-31T05:20:54.899 INFO:tasks.workunit.client.1.smithi073.stdout:3/101: write f4 [4377251,128042] 0 2024-08-31T05:20:54.899 INFO:tasks.workunit.client.1.smithi073.stdout:3/102: dread - da/d1b/f20 zero size 2024-08-31T05:20:54.910 INFO:tasks.workunit.client.1.smithi073.stdout:5/79: symlink dc/d16/l1c 0 2024-08-31T05:20:54.917 INFO:tasks.workunit.client.1.smithi073.stdout:4/78: mknod d7/db/d11/c15 0 2024-08-31T05:20:54.918 INFO:tasks.workunit.client.1.smithi073.stdout:4/79: dread f5 [0,4194304] 0 2024-08-31T05:20:54.918 INFO:tasks.workunit.client.1.smithi073.stdout:4/80: write d7/f12 [4478033,95548] 0 2024-08-31T05:20:54.922 INFO:tasks.workunit.client.1.smithi073.stdout:4/81: dread d7/fc [0,4194304] 0 2024-08-31T05:20:54.923 INFO:tasks.workunit.client.1.smithi073.stdout:3/103: creat da/d1b/f23 x:0 0 0 2024-08-31T05:20:54.923 INFO:tasks.workunit.client.1.smithi073.stdout:3/104: write da/f10 [692815,100066] 0 2024-08-31T05:20:54.925 INFO:tasks.workunit.client.1.smithi073.stdout:9/93: symlink dc/l23 0 2024-08-31T05:20:54.926 INFO:tasks.workunit.client.1.smithi073.stdout:9/94: write dc/de/d11/f14 [878050,42351] 0 2024-08-31T05:20:54.929 INFO:tasks.workunit.client.1.smithi073.stdout:1/87: getdents d5 0 2024-08-31T05:20:54.931 INFO:tasks.workunit.client.1.smithi073.stdout:2/100: dwrite d2/d9/df/f12 [0,4194304] 0 2024-08-31T05:20:54.933 INFO:tasks.workunit.client.1.smithi073.stdout:8/91: creat d0/db/d1c/f1f x:0 0 0 2024-08-31T05:20:54.935 INFO:tasks.workunit.client.1.smithi073.stdout:6/41: truncate f3 4707072 0 2024-08-31T05:20:54.936 INFO:tasks.workunit.client.1.smithi073.stdout:7/87: mknod d1/d11/d14/c16 0 2024-08-31T05:20:54.936 INFO:tasks.workunit.client.1.smithi073.stdout:6/42: write fa [687015,74230] 0 2024-08-31T05:20:54.940 INFO:tasks.workunit.client.1.smithi073.stdout:4/82: dread d7/fa [0,4194304] 0 2024-08-31T05:20:54.944 INFO:tasks.workunit.client.1.smithi073.stdout:2/101: chown d2/l8 31955 1 2024-08-31T05:20:54.944 INFO:tasks.workunit.client.1.smithi073.stdout:0/101: sync 2024-08-31T05:20:54.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:54 smithi073 ceph-mon[24726]: pgmap v18: 65 pgs: 65 active+clean; 197 MiB data, 814 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 311 op/s 2024-08-31T05:20:54.945 INFO:tasks.workunit.client.1.smithi073.stdout:0/102: truncate d0/f1a 461775 0 2024-08-31T05:20:54.945 INFO:tasks.workunit.client.1.smithi073.stdout:8/92: creat d0/db/d1c/f20 x:0 0 0 2024-08-31T05:20:54.947 INFO:tasks.workunit.client.1.smithi073.stdout:7/88: mkdir d1/d17 0 2024-08-31T05:20:54.948 INFO:tasks.workunit.client.1.smithi073.stdout:7/89: chown d1/l13 499868 1 2024-08-31T05:20:54.948 INFO:tasks.workunit.client.1.smithi073.stdout:2/102: dread d2/f19 [0,4194304] 0 2024-08-31T05:20:54.948 INFO:tasks.workunit.client.1.smithi073.stdout:7/90: rename d1/da to d1/da/d18 22 2024-08-31T05:20:54.948 INFO:tasks.workunit.client.1.smithi073.stdout:6/43: creat ff x:0 0 0 2024-08-31T05:20:54.950 INFO:tasks.workunit.client.1.smithi073.stdout:3/105: mknod da/c24 0 2024-08-31T05:20:54.950 INFO:tasks.workunit.client.1.smithi073.stdout:3/106: stat da/f10 0 2024-08-31T05:20:54.956 INFO:tasks.workunit.client.1.smithi073.stdout:1/88: creat d5/d17/f1a x:0 0 0 2024-08-31T05:20:54.956 INFO:tasks.workunit.client.1.smithi073.stdout:3/107: dwrite da/d1b/f20 [0,4194304] 0 2024-08-31T05:20:54.956 INFO:tasks.workunit.client.1.smithi073.stdout:3/108: chown c3 1876591 1 2024-08-31T05:20:54.957 INFO:tasks.workunit.client.1.smithi073.stdout:3/109: write f4 [2345755,120505] 0 2024-08-31T05:20:54.958 INFO:tasks.workunit.client.1.smithi073.stdout:0/103: creat d0/d15/f1d x:0 0 0 2024-08-31T05:20:54.960 INFO:tasks.workunit.client.1.smithi073.stdout:0/104: fsync d0/d1/f6 0 2024-08-31T05:20:54.960 INFO:tasks.workunit.client.1.smithi073.stdout:3/110: dread da/fd [0,4194304] 0 2024-08-31T05:20:54.960 INFO:tasks.workunit.client.1.smithi073.stdout:0/105: chown d0/f7 33856676 1 2024-08-31T05:20:54.961 INFO:tasks.workunit.client.1.smithi073.stdout:0/106: fsync d0/f4 0 2024-08-31T05:20:54.963 INFO:tasks.workunit.client.1.smithi073.stdout:2/103: rename d2/l11 to d2/d9/df/l21 0 2024-08-31T05:20:54.967 INFO:tasks.workunit.client.1.smithi073.stdout:5/80: getdents dc/d16 0 2024-08-31T05:20:54.971 INFO:tasks.workunit.client.1.smithi073.stdout:9/95: link dc/de/d11/l1b dc/d10/l24 0 2024-08-31T05:20:54.972 INFO:tasks.workunit.client.1.smithi073.stdout:9/96: dread - dc/de/f1e zero size 2024-08-31T05:20:54.973 INFO:tasks.workunit.client.1.smithi073.stdout:5/81: dwrite f9 [0,4194304] 0 2024-08-31T05:20:54.975 INFO:tasks.workunit.client.1.smithi073.stdout:8/93: symlink d0/l21 0 2024-08-31T05:20:54.975 INFO:tasks.workunit.client.1.smithi073.stdout:8/94: chown d0/db/c16 78 1 2024-08-31T05:20:54.976 INFO:tasks.workunit.client.1.smithi073.stdout:8/95: dread - d0/db/d1c/f20 zero size 2024-08-31T05:20:54.980 INFO:tasks.workunit.client.1.smithi073.stdout:0/107: rmdir d0 39 2024-08-31T05:20:54.982 INFO:tasks.workunit.client.1.smithi073.stdout:4/83: write f5 [1004094,88920] 0 2024-08-31T05:20:54.985 INFO:tasks.workunit.client.1.smithi073.stdout:7/91: symlink d1/d17/l19 0 2024-08-31T05:20:54.985 INFO:tasks.workunit.client.1.smithi073.stdout:7/92: write d1/da/f12 [1217304,3228] 0 2024-08-31T05:20:54.986 INFO:tasks.workunit.client.1.smithi073.stdout:7/93: write d1/da/f12 [942997,74155] 0 2024-08-31T05:20:54.991 INFO:tasks.workunit.client.1.smithi073.stdout:5/82: rename dc/d16/l1c to dc/d16/d1b/l1d 0 2024-08-31T05:20:54.997 INFO:tasks.workunit.client.1.smithi073.stdout:6/44: write f3 [4746594,95119] 0 2024-08-31T05:20:55.003 INFO:tasks.workunit.client.1.smithi073.stdout:8/96: dwrite d0/fe [0,4194304] 0 2024-08-31T05:20:55.009 INFO:tasks.workunit.client.1.smithi073.stdout:6/45: dwrite fa [0,4194304] 0 2024-08-31T05:20:55.009 INFO:tasks.workunit.client.1.smithi073.stdout:0/108: dwrite d0/f11 [0,4194304] 0 2024-08-31T05:20:55.009 INFO:tasks.workunit.client.1.smithi073.stdout:5/83: rmdir dc 39 2024-08-31T05:20:55.010 INFO:tasks.workunit.client.1.smithi073.stdout:6/46: fsync fe 0 2024-08-31T05:20:55.012 INFO:tasks.workunit.client.1.smithi073.stdout:8/97: dread d0/fc [0,4194304] 0 2024-08-31T05:20:55.012 INFO:tasks.workunit.client.1.smithi073.stdout:3/111: creat da/f25 x:0 0 0 2024-08-31T05:20:55.013 INFO:tasks.workunit.client.1.smithi073.stdout:3/112: chown da/d18/c1a 124 1 2024-08-31T05:20:55.014 INFO:tasks.workunit.client.1.smithi073.stdout:8/98: chown d0/c19 8883099 1 2024-08-31T05:20:55.015 INFO:tasks.workunit.client.1.smithi073.stdout:3/113: truncate da/d18/f21 194832 0 2024-08-31T05:20:55.017 INFO:tasks.workunit.client.1.smithi073.stdout:2/104: truncate f1 4531013 0 2024-08-31T05:20:55.019 INFO:tasks.workunit.client.1.smithi073.stdout:2/105: chown d2/d9/l16 667273 1 2024-08-31T05:20:55.019 INFO:tasks.workunit.client.1.smithi073.stdout:4/84: creat d7/df/d13/f16 x:0 0 0 2024-08-31T05:20:55.020 INFO:tasks.workunit.client.1.smithi073.stdout:4/85: truncate f0 5370800 0 2024-08-31T05:20:55.021 INFO:tasks.workunit.client.1.smithi073.stdout:4/86: chown l4 127 1 2024-08-31T05:20:55.024 INFO:tasks.workunit.client.1.smithi073.stdout:1/89: getdents d5/da 0 2024-08-31T05:20:55.024 INFO:tasks.workunit.client.1.smithi073.stdout:8/99: dwrite d0/f10 [0,4194304] 0 2024-08-31T05:20:55.025 INFO:tasks.workunit.client.1.smithi073.stdout:8/100: chown d0/db 17742307 1 2024-08-31T05:20:55.026 INFO:tasks.workunit.client.1.smithi073.stdout:9/97: creat dc/f25 x:0 0 0 2024-08-31T05:20:55.027 INFO:tasks.workunit.client.1.smithi073.stdout:9/98: stat dc/d10/f19 0 2024-08-31T05:20:55.032 INFO:tasks.workunit.client.1.smithi073.stdout:6/47: symlink l10 0 2024-08-31T05:20:55.032 INFO:tasks.workunit.client.1.smithi073.stdout:6/48: write f3 [2682337,79020] 0 2024-08-31T05:20:55.032 INFO:tasks.workunit.client.1.smithi073.stdout:6/49: rmdir - no directory 2024-08-31T05:20:55.041 INFO:tasks.workunit.client.1.smithi073.stdout:4/87: symlink d7/df/d13/l17 0 2024-08-31T05:20:55.044 INFO:tasks.workunit.client.1.smithi073.stdout:1/90: mkdir d5/d10/d1b 0 2024-08-31T05:20:55.044 INFO:tasks.workunit.client.1.smithi073.stdout:4/88: write f0 [2409545,43808] 0 2024-08-31T05:20:55.044 INFO:tasks.workunit.client.1.smithi073.stdout:4/89: rename d7 to d7/df/d18 22 2024-08-31T05:20:55.045 INFO:tasks.workunit.client.1.smithi073.stdout:8/101: creat d0/db/f22 x:0 0 0 2024-08-31T05:20:55.045 INFO:tasks.workunit.client.1.smithi073.stdout:4/90: readlink d7/df/d13/l17 0 2024-08-31T05:20:55.046 INFO:tasks.workunit.client.1.smithi073.stdout:0/109: link d0/f11 d0/f1e 0 2024-08-31T05:20:55.048 INFO:tasks.workunit.client.1.smithi073.stdout:6/50: mknod c11 0 2024-08-31T05:20:55.052 INFO:tasks.workunit.client.1.smithi073.stdout:8/102: mkdir d0/db/d1c/d23 0 2024-08-31T05:20:55.054 INFO:tasks.workunit.client.1.smithi073.stdout:4/91: creat d7/db/f19 x:0 0 0 2024-08-31T05:20:55.057 INFO:tasks.workunit.client.1.smithi073.stdout:0/110: creat d0/d1/f1f x:0 0 0 2024-08-31T05:20:55.058 INFO:tasks.workunit.client.1.smithi073.stdout:0/111: dread d0/d1/ff [0,4194304] 0 2024-08-31T05:20:55.059 INFO:tasks.workunit.client.1.smithi073.stdout:6/51: rename l10 to l12 0 2024-08-31T05:20:55.062 INFO:tasks.workunit.client.1.smithi073.stdout:8/103: mkdir d0/db/d1c/d24 0 2024-08-31T05:20:55.063 INFO:tasks.workunit.client.1.smithi073.stdout:8/104: write d0/f10 [4283228,120699] 0 2024-08-31T05:20:55.063 INFO:tasks.workunit.client.1.smithi073.stdout:4/92: mkdir d7/d1a 0 2024-08-31T05:20:55.064 INFO:tasks.workunit.client.1.smithi073.stdout:8/105: readlink d0/l21 0 2024-08-31T05:20:55.066 INFO:tasks.workunit.client.1.smithi073.stdout:6/52: unlink c11 0 2024-08-31T05:20:55.066 INFO:tasks.workunit.client.1.smithi073.stdout:4/93: dread f5 [0,4194304] 0 2024-08-31T05:20:55.067 INFO:tasks.workunit.client.1.smithi073.stdout:3/114: getdents da/d18 0 2024-08-31T05:20:55.068 INFO:tasks.workunit.client.1.smithi073.stdout:3/115: write f4 [2482276,15585] 0 2024-08-31T05:20:55.068 INFO:tasks.workunit.client.1.smithi073.stdout:2/106: getdents d2/d9 0 2024-08-31T05:20:55.069 INFO:tasks.workunit.client.1.smithi073.stdout:2/107: chown d2/d9/ce 1515352 1 2024-08-31T05:20:55.069 INFO:tasks.workunit.client.1.smithi073.stdout:3/116: truncate da/f15 116002 0 2024-08-31T05:20:55.074 INFO:tasks.workunit.client.1.smithi073.stdout:8/106: mknod d0/db/d1c/c25 0 2024-08-31T05:20:55.076 INFO:tasks.workunit.client.1.smithi073.stdout:6/53: creat f13 x:0 0 0 2024-08-31T05:20:55.076 INFO:tasks.workunit.client.1.smithi073.stdout:6/54: stat l5 0 2024-08-31T05:20:55.077 INFO:tasks.workunit.client.1.smithi073.stdout:6/55: dread - fd zero size 2024-08-31T05:20:55.077 INFO:tasks.workunit.client.1.smithi073.stdout:6/56: write fa [3238772,75387] 0 2024-08-31T05:20:55.078 INFO:tasks.workunit.client.1.smithi073.stdout:6/57: stat fd 0 2024-08-31T05:20:55.078 INFO:tasks.workunit.client.1.smithi073.stdout:6/58: write f3 [4002511,47035] 0 2024-08-31T05:20:55.082 INFO:tasks.workunit.client.1.smithi073.stdout:2/108: write d2/f19 [4919549,23955] 0 2024-08-31T05:20:55.082 INFO:tasks.workunit.client.1.smithi073.stdout:2/109: stat d2/f4 0 2024-08-31T05:20:55.083 INFO:tasks.workunit.client.1.smithi073.stdout:3/117: symlink da/d1b/l26 0 2024-08-31T05:20:55.084 INFO:tasks.workunit.client.1.smithi073.stdout:3/118: write f4 [5672055,82256] 0 2024-08-31T05:20:55.089 INFO:tasks.workunit.client.1.smithi073.stdout:0/112: rmdir d0/d15/d19 0 2024-08-31T05:20:55.095 INFO:tasks.workunit.client.1.smithi073.stdout:2/110: creat d2/d9/df/f22 x:0 0 0 2024-08-31T05:20:55.098 INFO:tasks.workunit.client.1.smithi073.stdout:3/119: rmdir da/d18 39 2024-08-31T05:20:55.098 INFO:tasks.workunit.client.1.smithi073.stdout:3/120: chown da/f12 31473 1 2024-08-31T05:20:55.098 INFO:tasks.workunit.client.1.smithi073.stdout:8/107: getdents d0/db/d1c/d24 0 2024-08-31T05:20:55.100 INFO:tasks.workunit.client.1.smithi073.stdout:0/113: mknod d0/d15/c20 0 2024-08-31T05:20:55.104 INFO:tasks.workunit.client.1.smithi073.stdout:2/111: rename d2/l1b to d2/l23 0 2024-08-31T05:20:55.108 INFO:tasks.workunit.client.1.smithi073.stdout:0/114: creat d0/f21 x:0 0 0 2024-08-31T05:20:55.112 INFO:tasks.workunit.client.1.smithi073.stdout:2/112: creat d2/d9/f24 x:0 0 0 2024-08-31T05:20:55.112 INFO:tasks.workunit.client.1.smithi073.stdout:4/94: truncate f0 2836007 0 2024-08-31T05:20:55.112 INFO:tasks.workunit.client.1.smithi073.stdout:4/95: write d7/db/f19 [452639,43187] 0 2024-08-31T05:20:55.114 INFO:tasks.workunit.client.1.smithi073.stdout:0/115: mknod d0/d1/c22 0 2024-08-31T05:20:55.115 INFO:tasks.workunit.client.1.smithi073.stdout:0/116: truncate d0/d15/f1d 481226 0 2024-08-31T05:20:55.116 INFO:tasks.workunit.client.1.smithi073.stdout:2/113: mkdir d2/d25 0 2024-08-31T05:20:55.118 INFO:tasks.workunit.client.1.smithi073.stdout:3/121: link da/d1b/f1d da/f27 0 2024-08-31T05:20:55.118 INFO:tasks.workunit.client.1.smithi073.stdout:3/122: dread - da/f12 zero size 2024-08-31T05:20:55.118 INFO:tasks.workunit.client.1.smithi073.stdout:3/123: fdatasync da/f15 0 2024-08-31T05:20:55.119 INFO:tasks.workunit.client.1.smithi073.stdout:3/124: chown da/l22 570412 1 2024-08-31T05:20:55.120 INFO:tasks.workunit.client.1.smithi073.stdout:0/117: rmdir d0/d1 39 2024-08-31T05:20:55.121 INFO:tasks.workunit.client.1.smithi073.stdout:6/59: truncate fa 2161455 0 2024-08-31T05:20:55.122 INFO:tasks.workunit.client.1.smithi073.stdout:7/94: sync 2024-08-31T05:20:55.122 INFO:tasks.workunit.client.1.smithi073.stdout:3/125: dread f4 [0,4194304] 0 2024-08-31T05:20:55.123 INFO:tasks.workunit.client.1.smithi073.stdout:2/114: rename d2/d9/l16 to d2/d25/l26 0 2024-08-31T05:20:55.131 INFO:tasks.workunit.client.1.smithi073.stdout:7/95: dwrite d1/da/f12 [0,4194304] 0 2024-08-31T05:20:55.132 INFO:tasks.workunit.client.1.smithi073.stdout:6/60: chown l12 23957652 1 2024-08-31T05:20:55.135 INFO:tasks.workunit.client.1.smithi073.stdout:2/115: dwrite d2/f19 [0,4194304] 0 2024-08-31T05:20:55.137 INFO:tasks.workunit.client.1.smithi073.stdout:8/108: dwrite d0/db/f15 [4194304,4194304] 0 2024-08-31T05:20:55.137 INFO:tasks.workunit.client.1.smithi073.stdout:3/126: mknod da/d1b/c28 0 2024-08-31T05:20:55.138 INFO:tasks.workunit.client.1.smithi073.stdout:2/116: readlink d2/d9/df/l18 0 2024-08-31T05:20:55.140 INFO:tasks.workunit.client.1.smithi073.stdout:8/109: read d0/f17 [1309949,6030] 0 2024-08-31T05:20:55.140 INFO:tasks.workunit.client.1.smithi073.stdout:2/117: write d2/f4 [1195197,73104] 0 2024-08-31T05:20:55.143 INFO:tasks.workunit.client.1.smithi073.stdout:8/110: fdatasync d0/db/d1c/f1f 0 2024-08-31T05:20:55.145 INFO:tasks.workunit.client.1.smithi073.stdout:8/111: read - d0/db/d1c/f1f zero size 2024-08-31T05:20:55.146 INFO:tasks.workunit.client.1.smithi073.stdout:8/112: chown d0/db/d1c/f20 67 1 2024-08-31T05:20:55.146 INFO:tasks.workunit.client.1.smithi073.stdout:8/113: read d0/f17 [1710612,76552] 0 2024-08-31T05:20:55.153 INFO:tasks.workunit.client.1.smithi073.stdout:2/118: mkdir d2/d9/d27 0 2024-08-31T05:20:55.158 INFO:tasks.workunit.client.1.smithi073.stdout:0/118: getdents d0/d15 0 2024-08-31T05:20:55.161 INFO:tasks.workunit.client.1.smithi073.stdout:8/114: link d0/fe d0/db/d1c/d23/f26 0 2024-08-31T05:20:55.162 INFO:tasks.workunit.client.1.smithi073.stdout:3/127: creat da/f29 x:0 0 0 2024-08-31T05:20:55.164 INFO:tasks.workunit.client.1.smithi073.stdout:4/96: write f0 [338873,31604] 0 2024-08-31T05:20:55.165 INFO:tasks.workunit.client.1.smithi073.stdout:0/119: readlink d0/d1/ld 0 2024-08-31T05:20:55.165 INFO:tasks.workunit.client.1.smithi073.stdout:0/120: fsync d0/f21 0 2024-08-31T05:20:55.167 INFO:tasks.workunit.client.1.smithi073.stdout:3/128: chown da/d18/f1f 448 1 2024-08-31T05:20:55.172 INFO:tasks.workunit.client.1.smithi073.stdout:3/129: creat da/d18/f2a x:0 0 0 2024-08-31T05:20:55.177 INFO:tasks.workunit.client.1.smithi073.stdout:8/115: creat d0/f27 x:0 0 0 2024-08-31T05:20:55.177 INFO:tasks.workunit.client.1.smithi073.stdout:8/116: write d0/f10 [3513809,18976] 0 2024-08-31T05:20:55.178 INFO:tasks.workunit.client.1.smithi073.stdout:0/121: getdents d0/d15 0 2024-08-31T05:20:55.178 INFO:tasks.workunit.client.1.smithi073.stdout:8/117: chown d0/f1a 22423 1 2024-08-31T05:20:55.178 INFO:tasks.workunit.client.1.smithi073.stdout:0/122: readlink d0/d1/ld 0 2024-08-31T05:20:55.179 INFO:tasks.workunit.client.1.smithi073.stdout:7/96: truncate d1/da/f12 3902775 0 2024-08-31T05:20:55.186 INFO:tasks.workunit.client.1.smithi073.stdout:8/118: dwrite d0/db/d1c/f20 [0,4194304] 0 2024-08-31T05:20:55.190 INFO:tasks.workunit.client.1.smithi073.stdout:0/123: link d0/d1/c22 d0/d15/c23 0 2024-08-31T05:20:55.190 INFO:tasks.workunit.client.1.smithi073.stdout:0/124: stat d0/d1/cb 0 2024-08-31T05:20:55.191 INFO:tasks.workunit.client.1.smithi073.stdout:8/119: creat d0/db/d1c/d24/f28 x:0 0 0 2024-08-31T05:20:55.194 INFO:tasks.workunit.client.1.smithi073.stdout:0/125: rename d0/d15/c1b to d0/d1/c24 0 2024-08-31T05:20:55.201 INFO:tasks.workunit.client.1.smithi073.stdout:4/97: dwrite f5 [0,4194304] 0 2024-08-31T05:20:55.201 INFO:tasks.workunit.client.1.smithi073.stdout:0/126: rename d0/d1/c10 to d0/d1/c25 0 2024-08-31T05:20:55.203 INFO:tasks.workunit.client.1.smithi073.stdout:8/120: dwrite d0/f27 [0,4194304] 0 2024-08-31T05:20:55.205 INFO:tasks.workunit.client.1.smithi073.stdout:0/127: truncate d0/f7 5769725 0 2024-08-31T05:20:55.205 INFO:tasks.workunit.client.1.smithi073.stdout:6/61: dread fa [0,4194304] 0 2024-08-31T05:20:55.207 INFO:tasks.workunit.client.1.smithi073.stdout:3/130: write da/f27 [938575,69651] 0 2024-08-31T05:20:55.207 INFO:tasks.workunit.client.1.smithi073.stdout:4/98: write d7/f12 [1038856,106404] 0 2024-08-31T05:20:55.210 INFO:tasks.workunit.client.1.smithi073.stdout:6/62: unlink l8 0 2024-08-31T05:20:55.210 INFO:tasks.workunit.client.1.smithi073.stdout:3/131: chown da/d1b/c1c 236302 1 2024-08-31T05:20:55.211 INFO:tasks.workunit.client.1.smithi073.stdout:0/128: unlink d0/c9 0 2024-08-31T05:20:55.217 INFO:tasks.workunit.client.1.smithi073.stdout:7/97: dwrite d1/da/f12 [4194304,4194304] 0 2024-08-31T05:20:55.217 INFO:tasks.workunit.client.1.smithi073.stdout:4/99: dread d7/fc [0,4194304] 0 2024-08-31T05:20:55.218 INFO:tasks.workunit.client.1.smithi073.stdout:6/63: dread f6 [0,4194304] 0 2024-08-31T05:20:55.231 INFO:tasks.workunit.client.1.smithi073.stdout:3/132: rename da/d1b/l26 to da/d1b/l2b 0 2024-08-31T05:20:55.233 INFO:tasks.workunit.client.1.smithi073.stdout:6/64: dread - f13 zero size 2024-08-31T05:20:55.233 INFO:tasks.workunit.client.1.smithi073.stdout:8/121: dread d0/f17 [0,4194304] 0 2024-08-31T05:20:55.234 INFO:tasks.workunit.client.1.smithi073.stdout:8/122: read d0/f10 [1391948,75784] 0 2024-08-31T05:20:55.235 INFO:tasks.workunit.client.1.smithi073.stdout:8/123: write d0/db/d1c/f1f [97542,111505] 0 2024-08-31T05:20:55.236 INFO:tasks.workunit.client.1.smithi073.stdout:9/99: sync 2024-08-31T05:20:55.236 INFO:tasks.workunit.client.1.smithi073.stdout:5/84: sync 2024-08-31T05:20:55.237 INFO:tasks.workunit.client.1.smithi073.stdout:9/100: dread - dc/de/f1f zero size 2024-08-31T05:20:55.238 INFO:tasks.workunit.client.1.smithi073.stdout:4/100: write d7/fc [633627,82894] 0 2024-08-31T05:20:55.270 INFO:tasks.workunit.client.1.smithi073.stdout:1/91: sync 2024-08-31T05:20:55.271 INFO:tasks.workunit.client.1.smithi073.stdout:2/119: sync 2024-08-31T05:20:55.414 INFO:tasks.workunit.client.1.smithi073.stdout:3/133: fdatasync f4 0 2024-08-31T05:20:55.415 INFO:tasks.workunit.client.1.smithi073.stdout:3/134: read da/d18/f21 [182150,71500] 0 2024-08-31T05:20:55.415 INFO:tasks.workunit.client.1.smithi073.stdout:6/65: rename f3 to f14 0 2024-08-31T05:20:55.416 INFO:tasks.workunit.client.1.smithi073.stdout:6/66: truncate f13 594758 0 2024-08-31T05:20:55.416 INFO:tasks.workunit.client.1.smithi073.stdout:6/67: chown l5 22985 1 2024-08-31T05:20:55.418 INFO:tasks.workunit.client.1.smithi073.stdout:9/101: unlink dc/d10/f22 0 2024-08-31T05:20:55.419 INFO:tasks.workunit.client.1.smithi073.stdout:4/101: fdatasync d7/fa 0 2024-08-31T05:20:55.424 INFO:tasks.workunit.client.1.smithi073.stdout:1/92: mkdir d5/d10/d1c 0 2024-08-31T05:20:55.424 INFO:tasks.workunit.client.1.smithi073.stdout:0/129: creat d0/f26 x:0 0 0 2024-08-31T05:20:55.424 INFO:tasks.workunit.client.1.smithi073.stdout:0/130: fsync d0/d1/f1f 0 2024-08-31T05:20:55.425 INFO:tasks.workunit.client.1.smithi073.stdout:4/102: dwrite f0 [0,4194304] 0 2024-08-31T05:20:55.425 INFO:tasks.workunit.client.1.smithi073.stdout:4/103: chown d7/df 2 1 2024-08-31T05:20:55.426 INFO:tasks.workunit.client.1.smithi073.stdout:4/104: readlink d7/df/d13/l17 0 2024-08-31T05:20:55.430 INFO:tasks.workunit.client.1.smithi073.stdout:3/135: mkdir da/d1b/d2c 0 2024-08-31T05:20:55.436 INFO:tasks.workunit.client.1.smithi073.stdout:9/102: creat dc/d10/f26 x:0 0 0 2024-08-31T05:20:55.444 INFO:tasks.workunit.client.1.smithi073.stdout:4/105: mkdir d7/df/d1b 0 2024-08-31T05:20:55.444 INFO:tasks.workunit.client.1.smithi073.stdout:4/106: chown d7/db/d11 247 1 2024-08-31T05:20:55.446 INFO:tasks.workunit.client.1.smithi073.stdout:3/136: creat da/d1b/f2d x:0 0 0 2024-08-31T05:20:55.447 INFO:tasks.workunit.client.1.smithi073.stdout:3/137: truncate da/f29 502070 0 2024-08-31T05:20:55.448 INFO:tasks.workunit.client.1.smithi073.stdout:3/138: write da/d1b/f2d [383059,76222] 0 2024-08-31T05:20:55.451 INFO:tasks.workunit.client.1.smithi073.stdout:4/107: dread d7/f8 [0,4194304] 0 2024-08-31T05:20:55.452 INFO:tasks.workunit.client.1.smithi073.stdout:4/108: write d7/db/f19 [904875,77385] 0 2024-08-31T05:20:55.455 INFO:tasks.workunit.client.1.smithi073.stdout:8/124: getdents d0/db/d1c/d23 0 2024-08-31T05:20:55.458 INFO:tasks.workunit.client.1.smithi073.stdout:4/109: mknod d7/df/d13/c1c 0 2024-08-31T05:20:55.458 INFO:tasks.workunit.client.1.smithi073.stdout:4/110: fdatasync d7/db/f19 0 2024-08-31T05:20:55.459 INFO:tasks.workunit.client.1.smithi073.stdout:4/111: write f0 [1815141,97763] 0 2024-08-31T05:20:55.460 INFO:tasks.workunit.client.1.smithi073.stdout:4/112: chown f0 49348 1 2024-08-31T05:20:55.461 INFO:tasks.workunit.client.1.smithi073.stdout:0/131: creat d0/f27 x:0 0 0 2024-08-31T05:20:55.461 INFO:tasks.workunit.client.1.smithi073.stdout:0/132: chown d0/f11 3 1 2024-08-31T05:20:55.462 INFO:tasks.workunit.client.1.smithi073.stdout:3/139: creat da/d1b/d2c/f2e x:0 0 0 2024-08-31T05:20:55.467 INFO:tasks.workunit.client.1.smithi073.stdout:4/113: rename l3 to d7/df/d13/l1d 0 2024-08-31T05:20:55.469 INFO:tasks.workunit.client.1.smithi073.stdout:3/140: dwrite da/d18/f1f [4194304,4194304] 0 2024-08-31T05:20:55.575 INFO:tasks.workunit.client.1.smithi073.stdout:4/114: rename d7/f8 to d7/df/f1e 0 2024-08-31T05:20:55.578 INFO:tasks.workunit.client.1.smithi073.stdout:4/115: dread f5 [0,4194304] 0 2024-08-31T05:20:55.579 INFO:tasks.workunit.client.1.smithi073.stdout:4/116: fdatasync d7/db/f19 0 2024-08-31T05:20:55.583 INFO:tasks.workunit.client.1.smithi073.stdout:3/141: creat da/f2f x:0 0 0 2024-08-31T05:20:55.584 INFO:tasks.workunit.client.1.smithi073.stdout:3/142: truncate da/d1b/d2c/f2e 612075 0 2024-08-31T05:20:55.584 INFO:tasks.workunit.client.1.smithi073.stdout:3/143: chown da/l22 235 1 2024-08-31T05:20:55.679 INFO:tasks.workunit.client.1.smithi073.stdout:7/98: truncate d1/da/f12 7802938 0 2024-08-31T05:20:55.682 INFO:tasks.workunit.client.1.smithi073.stdout:6/68: fsync f9 0 2024-08-31T05:20:55.683 INFO:tasks.workunit.client.1.smithi073.stdout:6/69: dread fc [0,4194304] 0 2024-08-31T05:20:55.683 INFO:tasks.workunit.client.1.smithi073.stdout:6/70: readlink l5 0 2024-08-31T05:20:55.686 INFO:tasks.workunit.client.1.smithi073.stdout:6/71: mkdir d15 0 2024-08-31T05:20:55.686 INFO:tasks.workunit.client.1.smithi073.stdout:6/72: write ff [77141,772] 0 2024-08-31T05:20:55.687 INFO:tasks.workunit.client.1.smithi073.stdout:4/117: write d7/fa [3777720,20124] 0 2024-08-31T05:20:55.690 INFO:tasks.workunit.client.1.smithi073.stdout:1/93: getdents d5/d10 0 2024-08-31T05:20:55.693 INFO:tasks.workunit.client.1.smithi073.stdout:4/118: creat d7/df/d1b/f1f x:0 0 0 2024-08-31T05:20:55.695 INFO:tasks.workunit.client.1.smithi073.stdout:6/73: truncate f14 2822777 0 2024-08-31T05:20:55.696 INFO:tasks.workunit.client.1.smithi073.stdout:4/119: mknod d7/d1a/c20 0 2024-08-31T05:20:55.703 INFO:tasks.workunit.client.1.smithi073.stdout:5/85: truncate dc/f14 454910 0 2024-08-31T05:20:55.705 INFO:tasks.workunit.client.1.smithi073.stdout:6/74: dwrite fd [0,4194304] 0 2024-08-31T05:20:55.706 INFO:tasks.workunit.client.1.smithi073.stdout:6/75: readlink l7 0 2024-08-31T05:20:55.707 INFO:tasks.workunit.client.1.smithi073.stdout:9/103: write f9 [2296142,24750] 0 2024-08-31T05:20:55.711 INFO:tasks.workunit.client.1.smithi073.stdout:2/120: dwrite f1 [0,4194304] 0 2024-08-31T05:20:55.711 INFO:tasks.workunit.client.1.smithi073.stdout:6/76: dread fc [0,4194304] 0 2024-08-31T05:20:55.712 INFO:tasks.workunit.client.1.smithi073.stdout:4/120: dwrite d7/df/d13/f16 [0,4194304] 0 2024-08-31T05:20:55.712 INFO:tasks.workunit.client.1.smithi073.stdout:8/125: write d0/f17 [2231471,113975] 0 2024-08-31T05:20:55.713 INFO:tasks.workunit.client.1.smithi073.stdout:9/104: mkdir dc/d27 0 2024-08-31T05:20:55.714 INFO:tasks.workunit.client.1.smithi073.stdout:0/133: write d0/f11 [816955,116208] 0 2024-08-31T05:20:55.717 INFO:tasks.workunit.client.1.smithi073.stdout:4/121: creat d7/df/f21 x:0 0 0 2024-08-31T05:20:55.720 INFO:tasks.workunit.client.1.smithi073.stdout:6/77: creat d15/f16 x:0 0 0 2024-08-31T05:20:55.721 INFO:tasks.workunit.client.1.smithi073.stdout:6/78: readlink lb 0 2024-08-31T05:20:55.722 INFO:tasks.workunit.client.1.smithi073.stdout:0/134: mkdir d0/d28 0 2024-08-31T05:20:55.723 INFO:tasks.workunit.client.1.smithi073.stdout:4/122: mknod d7/db/c22 0 2024-08-31T05:20:55.723 INFO:tasks.workunit.client.1.smithi073.stdout:0/135: stat d0/d1/f6 0 2024-08-31T05:20:55.725 INFO:tasks.workunit.client.1.smithi073.stdout:8/126: dwrite d0/f1a [0,4194304] 0 2024-08-31T05:20:55.725 INFO:tasks.workunit.client.1.smithi073.stdout:4/123: dread - d7/df/f21 zero size 2024-08-31T05:20:55.726 INFO:tasks.workunit.client.1.smithi073.stdout:4/124: chown d7/db/d11 178 1 2024-08-31T05:20:55.726 INFO:tasks.workunit.client.1.smithi073.stdout:6/79: mkdir d15/d17 0 2024-08-31T05:20:55.729 INFO:tasks.workunit.client.1.smithi073.stdout:9/105: link dc/de/d11/f14 dc/f28 0 2024-08-31T05:20:55.733 INFO:tasks.workunit.client.1.smithi073.stdout:0/136: creat d0/f29 x:0 0 0 2024-08-31T05:20:55.735 INFO:tasks.workunit.client.1.smithi073.stdout:6/80: dwrite ff [0,4194304] 0 2024-08-31T05:20:55.735 INFO:tasks.workunit.client.1.smithi073.stdout:0/137: dread - d0/d1/f1f zero size 2024-08-31T05:20:55.737 INFO:tasks.workunit.client.1.smithi073.stdout:0/138: chown d0/d1/f6 266505644 1 2024-08-31T05:20:55.738 INFO:tasks.workunit.client.1.smithi073.stdout:8/127: dread d0/f10 [0,4194304] 0 2024-08-31T05:20:55.738 INFO:tasks.workunit.client.1.smithi073.stdout:6/81: symlink d15/l18 0 2024-08-31T05:20:55.739 INFO:tasks.workunit.client.1.smithi073.stdout:0/139: dread - d0/f26 zero size 2024-08-31T05:20:55.739 INFO:tasks.workunit.client.1.smithi073.stdout:6/82: stat l5 0 2024-08-31T05:20:55.741 INFO:tasks.workunit.client.1.smithi073.stdout:8/128: mknod d0/db/d1c/d23/c29 0 2024-08-31T05:20:55.742 INFO:tasks.workunit.client.1.smithi073.stdout:3/144: sync 2024-08-31T05:20:55.744 INFO:tasks.workunit.client.1.smithi073.stdout:6/83: rename ff to d15/f19 0 2024-08-31T05:20:55.745 INFO:tasks.workunit.client.1.smithi073.stdout:8/129: mkdir d0/db/d1c/d2a 0 2024-08-31T05:20:55.748 INFO:tasks.workunit.client.1.smithi073.stdout:3/145: creat da/d1b/d2c/f30 x:0 0 0 2024-08-31T05:20:55.749 INFO:tasks.workunit.client.1.smithi073.stdout:3/146: truncate da/f14 755709 0 2024-08-31T05:20:55.751 INFO:tasks.workunit.client.1.smithi073.stdout:8/130: creat d0/db/f2b x:0 0 0 2024-08-31T05:20:55.751 INFO:tasks.workunit.client.1.smithi073.stdout:8/131: chown d0/c12 12827202 1 2024-08-31T05:20:55.753 INFO:tasks.workunit.client.1.smithi073.stdout:0/140: rename d0/d1/c22 to d0/d28/c2a 0 2024-08-31T05:20:55.755 INFO:tasks.workunit.client.1.smithi073.stdout:3/147: truncate da/d18/f21 365322 0 2024-08-31T05:20:55.761 INFO:tasks.workunit.client.1.smithi073.stdout:8/132: creat d0/db/d1c/d2a/f2c x:0 0 0 2024-08-31T05:20:55.765 INFO:tasks.workunit.client.1.smithi073.stdout:8/133: symlink d0/db/d1c/l2d 0 2024-08-31T05:20:55.766 INFO:tasks.workunit.client.1.smithi073.stdout:8/134: write d0/fc [3625261,77831] 0 2024-08-31T05:20:55.766 INFO:tasks.workunit.client.1.smithi073.stdout:3/148: link da/l22 da/d1b/l31 0 2024-08-31T05:20:55.768 INFO:tasks.workunit.client.1.smithi073.stdout:7/99: write d1/da/f12 [1754085,129629] 0 2024-08-31T05:20:55.772 INFO:tasks.workunit.client.1.smithi073.stdout:7/100: dread d1/da/f12 [0,4194304] 0 2024-08-31T05:20:55.776 INFO:tasks.workunit.client.1.smithi073.stdout:7/101: dread d1/da/f12 [0,4194304] 0 2024-08-31T05:20:55.777 INFO:tasks.workunit.client.1.smithi073.stdout:3/149: rename da/fd to da/f32 0 2024-08-31T05:20:55.788 INFO:tasks.workunit.client.1.smithi073.stdout:7/102: dwrite d1/da/f12 [4194304,4194304] 0 2024-08-31T05:20:55.790 INFO:tasks.workunit.client.1.smithi073.stdout:9/106: truncate dc/f28 658102 0 2024-08-31T05:20:55.792 INFO:tasks.workunit.client.1.smithi073.stdout:5/86: dwrite dc/f12 [0,4194304] 0 2024-08-31T05:20:55.797 INFO:tasks.workunit.client.1.smithi073.stdout:8/135: getdents d0/db/d1c/d23 0 2024-08-31T05:20:55.799 INFO:tasks.workunit.client.1.smithi073.stdout:8/136: write d0/db/f2b [460172,87347] 0 2024-08-31T05:20:55.801 INFO:tasks.workunit.client.1.smithi073.stdout:7/103: link d1/l5 d1/l1a 0 2024-08-31T05:20:55.803 INFO:tasks.workunit.client.1.smithi073.stdout:6/84: write fa [2474996,129899] 0 2024-08-31T05:20:55.806 INFO:tasks.workunit.client.1.smithi073.stdout:6/85: mkdir d15/d1a 0 2024-08-31T05:20:55.808 INFO:tasks.workunit.client.1.smithi073.stdout:6/86: write d15/f16 [583231,5457] 0 2024-08-31T05:20:55.808 INFO:tasks.workunit.client.1.smithi073.stdout:7/104: fdatasync d1/da/f12 0 2024-08-31T05:20:55.809 INFO:tasks.workunit.client.1.smithi073.stdout:6/87: readlink l5 0 2024-08-31T05:20:55.813 INFO:tasks.workunit.client.1.smithi073.stdout:8/137: link d0/c12 d0/db/d1c/d24/c2e 0 2024-08-31T05:20:55.817 INFO:tasks.workunit.client.1.smithi073.stdout:0/141: dwrite d0/d1/ff [0,4194304] 0 2024-08-31T05:20:55.820 INFO:tasks.workunit.client.1.smithi073.stdout:7/105: dwrite d1/da/f12 [4194304,4194304] 0 2024-08-31T05:20:55.820 INFO:tasks.workunit.client.1.smithi073.stdout:0/142: chown d0/d1/f6 361113 1 2024-08-31T05:20:55.821 INFO:tasks.workunit.client.1.smithi073.stdout:1/94: sync 2024-08-31T05:20:55.821 INFO:tasks.workunit.client.1.smithi073.stdout:1/95: stat f0 0 2024-08-31T05:20:55.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:55 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:20:55.825 INFO:tasks.workunit.client.1.smithi073.stdout:7/106: dread d1/da/f12 [4194304,4194304] 0 2024-08-31T05:20:55.825 INFO:tasks.workunit.client.1.smithi073.stdout:3/150: unlink da/f32 0 2024-08-31T05:20:55.826 INFO:tasks.workunit.client.1.smithi073.stdout:0/143: mkdir d0/d28/d2b 0 2024-08-31T05:20:55.829 INFO:tasks.workunit.client.1.smithi073.stdout:7/107: dread d1/da/f12 [4194304,4194304] 0 2024-08-31T05:20:55.830 INFO:tasks.workunit.client.1.smithi073.stdout:7/108: chown d1/da/d15 48 1 2024-08-31T05:20:55.832 INFO:tasks.workunit.client.1.smithi073.stdout:0/144: dwrite d0/f21 [0,4194304] 0 2024-08-31T05:20:55.837 INFO:tasks.workunit.client.1.smithi073.stdout:4/125: sync 2024-08-31T05:20:55.837 INFO:tasks.workunit.client.1.smithi073.stdout:2/121: sync 2024-08-31T05:20:55.839 INFO:tasks.workunit.client.1.smithi073.stdout:2/122: read - d2/d9/df/f22 zero size 2024-08-31T05:20:55.839 INFO:tasks.workunit.client.1.smithi073.stdout:3/151: rename da/d1b/c1c to da/d1b/c33 0 2024-08-31T05:20:55.841 INFO:tasks.workunit.client.1.smithi073.stdout:3/152: dread - da/f25 zero size 2024-08-31T05:20:55.841 INFO:tasks.workunit.client.1.smithi073.stdout:4/126: truncate d7/df/d13/f16 4799405 0 2024-08-31T05:20:55.843 INFO:tasks.workunit.client.1.smithi073.stdout:4/127: readlink d7/df/d13/l17 0 2024-08-31T05:20:55.843 INFO:tasks.workunit.client.1.smithi073.stdout:9/107: dwrite f5 [0,4194304] 0 2024-08-31T05:20:55.846 INFO:tasks.workunit.client.1.smithi073.stdout:6/88: write fe [892542,43145] 0 2024-08-31T05:20:55.850 INFO:tasks.workunit.client.1.smithi073.stdout:0/145: mkdir d0/d15/d2c 0 2024-08-31T05:20:55.850 INFO:tasks.workunit.client.1.smithi073.stdout:8/138: write d0/fe [107584,8965] 0 2024-08-31T05:20:55.852 INFO:tasks.workunit.client.1.smithi073.stdout:2/123: symlink d2/d9/df/l28 0 2024-08-31T05:20:55.853 INFO:tasks.workunit.client.1.smithi073.stdout:5/87: write dc/f14 [888057,2878] 0 2024-08-31T05:20:55.854 INFO:tasks.workunit.client.1.smithi073.stdout:4/128: creat d7/df/d1b/f23 x:0 0 0 2024-08-31T05:20:55.854 INFO:tasks.workunit.client.1.smithi073.stdout:8/139: fdatasync d0/fc 0 2024-08-31T05:20:55.856 INFO:tasks.workunit.client.1.smithi073.stdout:9/108: creat dc/d10/f29 x:0 0 0 2024-08-31T05:20:55.859 INFO:tasks.workunit.client.1.smithi073.stdout:3/153: dwrite da/d1b/f1d [0,4194304] 0 2024-08-31T05:20:55.859 INFO:tasks.workunit.client.1.smithi073.stdout:9/109: dread - dc/de/f1f zero size 2024-08-31T05:20:55.863 INFO:tasks.workunit.client.1.smithi073.stdout:7/109: dwrite d1/da/f12 [4194304,4194304] 0 2024-08-31T05:20:55.864 INFO:tasks.workunit.client.1.smithi073.stdout:4/129: mkdir d7/d24 0 2024-08-31T05:20:55.864 INFO:tasks.workunit.client.1.smithi073.stdout:3/154: read da/f15 [82538,5104] 0 2024-08-31T05:20:55.867 INFO:tasks.workunit.client.1.smithi073.stdout:6/89: dwrite f9 [0,4194304] 0 2024-08-31T05:20:55.867 INFO:tasks.workunit.client.1.smithi073.stdout:2/124: creat d2/d9/df/f29 x:0 0 0 2024-08-31T05:20:55.870 INFO:tasks.workunit.client.1.smithi073.stdout:5/88: symlink dc/d16/d1a/l1e 0 2024-08-31T05:20:55.871 INFO:tasks.workunit.client.1.smithi073.stdout:9/110: mkdir dc/de/d11/d2a 0 2024-08-31T05:20:55.874 INFO:tasks.workunit.client.1.smithi073.stdout:3/155: symlink da/d1b/l34 0 2024-08-31T05:20:55.874 INFO:tasks.workunit.client.1.smithi073.stdout:5/89: write f9 [2066536,48282] 0 2024-08-31T05:20:55.874 INFO:tasks.workunit.client.1.smithi073.stdout:1/96: dwrite d5/f7 [0,4194304] 0 2024-08-31T05:20:55.877 INFO:tasks.workunit.client.1.smithi073.stdout:7/110: creat d1/d11/d14/f1b x:0 0 0 2024-08-31T05:20:55.877 INFO:tasks.workunit.client.1.smithi073.stdout:1/97: dread - d5/da/f15 zero size 2024-08-31T05:20:55.878 INFO:tasks.workunit.client.1.smithi073.stdout:7/111: truncate d1/d11/d14/f1b 447023 0 2024-08-31T05:20:55.882 INFO:tasks.workunit.client.1.smithi073.stdout:2/125: creat d2/d9/f2a x:0 0 0 2024-08-31T05:20:55.884 INFO:tasks.workunit.client.1.smithi073.stdout:9/111: rename dc/l23 to dc/de/l2b 0 2024-08-31T05:20:55.886 INFO:tasks.workunit.client.1.smithi073.stdout:9/112: truncate dc/d10/f18 243188 0 2024-08-31T05:20:55.887 INFO:tasks.workunit.client.1.smithi073.stdout:3/156: symlink da/d18/l35 0 2024-08-31T05:20:55.887 INFO:tasks.workunit.client.1.smithi073.stdout:9/113: chown f5 1922426 1 2024-08-31T05:20:55.890 INFO:tasks.workunit.client.1.smithi073.stdout:2/126: dwrite f1 [0,4194304] 0 2024-08-31T05:20:55.890 INFO:tasks.workunit.client.1.smithi073.stdout:9/114: read dc/de/f1a [1471739,116171] 0 2024-08-31T05:20:55.890 INFO:tasks.workunit.client.1.smithi073.stdout:2/127: chown d2/d9/df 2001 1 2024-08-31T05:20:55.891 INFO:tasks.workunit.client.1.smithi073.stdout:6/90: symlink d15/d1a/l1b 0 2024-08-31T05:20:55.894 INFO:tasks.workunit.client.1.smithi073.stdout:5/90: rename dc/f10 to dc/d16/d1a/f1f 0 2024-08-31T05:20:55.895 INFO:tasks.workunit.client.1.smithi073.stdout:5/91: dread - dc/f17 zero size 2024-08-31T05:20:55.897 INFO:tasks.workunit.client.1.smithi073.stdout:1/98: symlink d5/d10/d1c/l1d 0 2024-08-31T05:20:55.897 INFO:tasks.workunit.client.1.smithi073.stdout:9/115: read f8 [2262067,5061] 0 2024-08-31T05:20:55.902 INFO:tasks.workunit.client.1.smithi073.stdout:3/157: unlink da/l22 0 2024-08-31T05:20:55.903 INFO:tasks.workunit.client.1.smithi073.stdout:5/92: symlink dc/l20 0 2024-08-31T05:20:55.908 INFO:tasks.workunit.client.1.smithi073.stdout:0/146: getdents d0/d15 0 2024-08-31T05:20:55.909 INFO:tasks.workunit.client.1.smithi073.stdout:7/112: link d1/c6 d1/da/d15/c1c 0 2024-08-31T05:20:55.910 INFO:tasks.workunit.client.1.smithi073.stdout:7/113: read d1/da/f12 [3446100,117396] 0 2024-08-31T05:20:55.911 INFO:tasks.workunit.client.1.smithi073.stdout:2/128: creat d2/d9/d27/f2b x:0 0 0 2024-08-31T05:20:55.912 INFO:tasks.workunit.client.1.smithi073.stdout:6/91: getdents d15/d17 0 2024-08-31T05:20:55.913 INFO:tasks.workunit.client.1.smithi073.stdout:6/92: chown d15/f16 110539 1 2024-08-31T05:20:55.913 INFO:tasks.workunit.client.1.smithi073.stdout:2/129: chown d2/d9/df/f1a 1156 1 2024-08-31T05:20:55.913 INFO:tasks.workunit.client.1.smithi073.stdout:3/158: mknod da/d1b/c36 0 2024-08-31T05:20:55.915 INFO:tasks.workunit.client.1.smithi073.stdout:0/147: dwrite d0/f26 [0,4194304] 0 2024-08-31T05:20:55.915 INFO:tasks.workunit.client.1.smithi073.stdout:5/93: rename la to dc/l21 0 2024-08-31T05:20:55.916 INFO:tasks.workunit.client.1.smithi073.stdout:0/148: chown d0/f1a 425011286 1 2024-08-31T05:20:55.916 INFO:tasks.workunit.client.1.smithi073.stdout:5/94: write dc/f12 [414624,41538] 0 2024-08-31T05:20:55.917 INFO:tasks.workunit.client.1.smithi073.stdout:0/149: fdatasync d0/d15/f1d 0 2024-08-31T05:20:55.917 INFO:tasks.workunit.client.1.smithi073.stdout:0/150: chown d0/d1/ff 0 1 2024-08-31T05:20:55.921 INFO:tasks.workunit.client.1.smithi073.stdout:7/114: mknod d1/d11/d14/c1d 0 2024-08-31T05:20:55.926 INFO:tasks.workunit.client.1.smithi073.stdout:6/93: write d15/f19 [557873,107320] 0 2024-08-31T05:20:55.927 INFO:tasks.workunit.client.1.smithi073.stdout:6/94: write f13 [335968,126228] 0 2024-08-31T05:20:55.928 INFO:tasks.workunit.client.1.smithi073.stdout:3/159: mknod da/d18/c37 0 2024-08-31T05:20:55.937 INFO:tasks.workunit.client.1.smithi073.stdout:0/151: rename d0/f7 to d0/d28/f2d 0 2024-08-31T05:20:55.945 INFO:tasks.workunit.client.1.smithi073.stdout:4/130: truncate f5 2388973 0 2024-08-31T05:20:55.945 INFO:tasks.workunit.client.1.smithi073.stdout:7/115: dread d1/da/f12 [0,4194304] 0 2024-08-31T05:20:55.945 INFO:tasks.workunit.client.1.smithi073.stdout:4/131: write d7/fa [4616728,113012] 0 2024-08-31T05:20:55.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:55 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:20:55.946 INFO:tasks.workunit.client.1.smithi073.stdout:3/160: creat da/d18/f38 x:0 0 0 2024-08-31T05:20:55.950 INFO:tasks.workunit.client.1.smithi073.stdout:1/99: getdents d5/da/d13 0 2024-08-31T05:20:55.950 INFO:tasks.workunit.client.1.smithi073.stdout:1/100: dread - d5/da/f18 zero size 2024-08-31T05:20:55.952 INFO:tasks.workunit.client.1.smithi073.stdout:9/116: getdents dc 0 2024-08-31T05:20:55.960 INFO:tasks.workunit.client.1.smithi073.stdout:7/116: mknod d1/d17/c1e 0 2024-08-31T05:20:55.961 INFO:tasks.workunit.client.1.smithi073.stdout:4/132: creat d7/df/f25 x:0 0 0 2024-08-31T05:20:55.966 INFO:tasks.workunit.client.1.smithi073.stdout:9/117: readlink dc/de/d11/l1b 0 2024-08-31T05:20:55.966 INFO:tasks.workunit.client.1.smithi073.stdout:9/118: chown f5 1 1 2024-08-31T05:20:55.966 INFO:tasks.workunit.client.1.smithi073.stdout:4/133: dwrite f0 [0,4194304] 0 2024-08-31T05:20:55.968 INFO:tasks.workunit.client.1.smithi073.stdout:0/152: mkdir d0/d15/d2c/d2e 0 2024-08-31T05:20:55.968 INFO:tasks.workunit.client.1.smithi073.stdout:6/95: link l12 d15/d1a/l1c 0 2024-08-31T05:20:55.969 INFO:tasks.workunit.client.1.smithi073.stdout:0/153: read d0/f26 [165058,38893] 0 2024-08-31T05:20:55.971 INFO:tasks.workunit.client.1.smithi073.stdout:7/117: creat d1/d17/f1f x:0 0 0 2024-08-31T05:20:55.972 INFO:tasks.workunit.client.1.smithi073.stdout:8/140: sync 2024-08-31T05:20:55.979 INFO:tasks.workunit.client.1.smithi073.stdout:8/141: dwrite d0/db/d1c/f20 [0,4194304] 0 2024-08-31T05:20:55.980 INFO:tasks.workunit.client.1.smithi073.stdout:8/142: dread - d0/db/d1c/d24/f28 zero size 2024-08-31T05:20:55.981 INFO:tasks.workunit.client.1.smithi073.stdout:9/119: unlink dc/de/d11/l21 0 2024-08-31T05:20:55.982 INFO:tasks.workunit.client.1.smithi073.stdout:8/143: truncate d0/db/d1c/d2a/f2c 695733 0 2024-08-31T05:20:55.982 INFO:tasks.workunit.client.1.smithi073.stdout:9/120: fdatasync f7 0 2024-08-31T05:20:55.983 INFO:tasks.workunit.client.1.smithi073.stdout:8/144: chown d0/db/lf 206924 1 2024-08-31T05:20:55.983 INFO:tasks.workunit.client.1.smithi073.stdout:4/134: symlink d7/df/d13/l26 0 2024-08-31T05:20:55.991 INFO:tasks.workunit.client.1.smithi073.stdout:7/118: mknod d1/d11/d14/c20 0 2024-08-31T05:20:55.994 INFO:tasks.workunit.client.1.smithi073.stdout:5/95: rename dc/l21 to dc/l22 0 2024-08-31T05:20:55.996 INFO:tasks.workunit.client.1.smithi073.stdout:1/101: link d5/da/d13/c14 d5/d10/d1b/c1e 0 2024-08-31T05:20:55.997 INFO:tasks.workunit.client.1.smithi073.stdout:1/102: write d5/d10/f16 [587847,3457] 0 2024-08-31T05:20:56.002 INFO:tasks.workunit.client.1.smithi073.stdout:2/130: truncate d2/fa 2744114 0 2024-08-31T05:20:56.002 INFO:tasks.workunit.client.1.smithi073.stdout:2/131: stat d2/d9/df/l18 0 2024-08-31T05:20:56.003 INFO:tasks.workunit.client.1.smithi073.stdout:1/103: dwrite d5/f7 [0,4194304] 0 2024-08-31T05:20:56.003 INFO:tasks.workunit.client.1.smithi073.stdout:2/132: dread - d2/d9/f2a zero size 2024-08-31T05:20:56.004 INFO:tasks.workunit.client.1.smithi073.stdout:8/145: creat d0/db/d1c/d23/f2f x:0 0 0 2024-08-31T05:20:56.004 INFO:tasks.workunit.client.1.smithi073.stdout:8/146: stat d0/f4 0 2024-08-31T05:20:56.007 INFO:tasks.workunit.client.1.smithi073.stdout:6/96: mknod d15/d17/c1d 0 2024-08-31T05:20:56.009 INFO:tasks.workunit.client.1.smithi073.stdout:1/104: dread d5/fc [0,4194304] 0 2024-08-31T05:20:56.011 INFO:tasks.workunit.client.1.smithi073.stdout:7/119: readlink d1/l5 0 2024-08-31T05:20:56.012 INFO:tasks.workunit.client.1.smithi073.stdout:2/133: dwrite d2/d9/df/f12 [0,4194304] 0 2024-08-31T05:20:56.013 INFO:tasks.workunit.client.1.smithi073.stdout:7/120: chown d1/l1a 4538 1 2024-08-31T05:20:56.014 INFO:tasks.workunit.client.1.smithi073.stdout:5/96: creat dc/d16/d1b/f23 x:0 0 0 2024-08-31T05:20:56.014 INFO:tasks.workunit.client.1.smithi073.stdout:2/134: fsync d2/f19 0 2024-08-31T05:20:56.015 INFO:tasks.workunit.client.1.smithi073.stdout:5/97: read - dc/f17 zero size 2024-08-31T05:20:56.016 INFO:tasks.workunit.client.1.smithi073.stdout:8/147: dwrite d0/db/d1c/d24/f28 [0,4194304] 0 2024-08-31T05:20:56.017 INFO:tasks.workunit.client.1.smithi073.stdout:5/98: fdatasync dc/f12 0 2024-08-31T05:20:56.018 INFO:tasks.workunit.client.1.smithi073.stdout:9/121: getdents dc/de/d11/d2a 0 2024-08-31T05:20:56.020 INFO:tasks.workunit.client.1.smithi073.stdout:8/148: dread - d0/f5 zero size 2024-08-31T05:20:56.020 INFO:tasks.workunit.client.1.smithi073.stdout:4/135: mknod d7/d24/c27 0 2024-08-31T05:20:56.026 INFO:tasks.workunit.client.1.smithi073.stdout:7/121: dwrite d1/d11/d14/f1b [0,4194304] 0 2024-08-31T05:20:56.026 INFO:tasks.workunit.client.1.smithi073.stdout:2/135: dwrite d2/d9/df/f1f [0,4194304] 0 2024-08-31T05:20:56.029 INFO:tasks.workunit.client.1.smithi073.stdout:3/161: truncate da/f27 682909 0 2024-08-31T05:20:56.030 INFO:tasks.workunit.client.1.smithi073.stdout:3/162: dread - da/f2f zero size 2024-08-31T05:20:56.030 INFO:tasks.workunit.client.1.smithi073.stdout:0/154: creat d0/f2f x:0 0 0 2024-08-31T05:20:56.033 INFO:tasks.workunit.client.1.smithi073.stdout:1/105: mknod d5/d10/c1f 0 2024-08-31T05:20:56.033 INFO:tasks.workunit.client.1.smithi073.stdout:3/163: write da/f25 [928125,109436] 0 2024-08-31T05:20:56.034 INFO:tasks.workunit.client.1.smithi073.stdout:7/122: dread d1/d11/d14/f1b [0,4194304] 0 2024-08-31T05:20:56.035 INFO:tasks.workunit.client.1.smithi073.stdout:7/123: readlink d1/lb 0 2024-08-31T05:20:56.036 INFO:tasks.workunit.client.1.smithi073.stdout:7/124: dread - d1/d17/f1f zero size 2024-08-31T05:20:56.041 INFO:tasks.workunit.client.1.smithi073.stdout:1/106: dwrite f2 [4194304,4194304] 0 2024-08-31T05:20:56.042 INFO:tasks.workunit.client.1.smithi073.stdout:1/107: chown d5/f9 225 1 2024-08-31T05:20:56.046 INFO:tasks.workunit.client.1.smithi073.stdout:5/99: mknod dc/d16/d1b/c24 0 2024-08-31T05:20:56.049 INFO:tasks.workunit.client.1.smithi073.stdout:1/108: dwrite d5/f19 [0,4194304] 0 2024-08-31T05:20:56.054 INFO:tasks.workunit.client.1.smithi073.stdout:4/136: rename f0 to d7/df/d13/f28 0 2024-08-31T05:20:56.056 INFO:tasks.workunit.client.1.smithi073.stdout:8/149: creat d0/db/d1c/d2a/f30 x:0 0 0 2024-08-31T05:20:56.058 INFO:tasks.workunit.client.1.smithi073.stdout:8/150: fdatasync d0/db/d1c/d24/f28 0 2024-08-31T05:20:56.060 INFO:tasks.workunit.client.1.smithi073.stdout:8/151: chown d0/fe 27719731 1 2024-08-31T05:20:56.062 INFO:tasks.workunit.client.1.smithi073.stdout:2/136: creat d2/f2c x:0 0 0 2024-08-31T05:20:56.062 INFO:tasks.workunit.client.1.smithi073.stdout:4/137: dwrite d7/df/d1b/f1f [0,4194304] 0 2024-08-31T05:20:56.064 INFO:tasks.workunit.client.1.smithi073.stdout:2/137: write d2/d9/d27/f2b [446649,120974] 0 2024-08-31T05:20:56.066 INFO:tasks.workunit.client.1.smithi073.stdout:0/155: creat d0/d28/f30 x:0 0 0 2024-08-31T05:20:56.067 INFO:tasks.workunit.client.1.smithi073.stdout:0/156: read d0/d1/ff [3190156,63897] 0 2024-08-31T05:20:56.075 INFO:tasks.workunit.client.1.smithi073.stdout:5/100: creat dc/d16/d1b/f25 x:0 0 0 2024-08-31T05:20:56.076 INFO:tasks.workunit.client.1.smithi073.stdout:6/97: write fc [187025,19215] 0 2024-08-31T05:20:56.078 INFO:tasks.workunit.client.1.smithi073.stdout:6/98: write fe [696615,28559] 0 2024-08-31T05:20:56.081 INFO:tasks.workunit.client.1.smithi073.stdout:6/99: write d15/f19 [183679,111397] 0 2024-08-31T05:20:56.083 INFO:tasks.workunit.client.1.smithi073.stdout:5/101: dwrite dc/f12 [0,4194304] 0 2024-08-31T05:20:56.085 INFO:tasks.workunit.client.1.smithi073.stdout:5/102: readlink dc/d16/d1a/l1e 0 2024-08-31T05:20:56.086 INFO:tasks.workunit.client.1.smithi073.stdout:8/152: symlink d0/db/d1c/l31 0 2024-08-31T05:20:56.088 INFO:tasks.workunit.client.1.smithi073.stdout:4/138: creat d7/d1a/f29 x:0 0 0 2024-08-31T05:20:56.089 INFO:tasks.workunit.client.1.smithi073.stdout:4/139: dread - d7/df/f25 zero size 2024-08-31T05:20:56.089 INFO:tasks.workunit.client.1.smithi073.stdout:6/100: dwrite f9 [4194304,4194304] 0 2024-08-31T05:20:56.091 INFO:tasks.workunit.client.1.smithi073.stdout:2/138: rename d2/d9/df/l15 to d2/d9/d27/l2d 0 2024-08-31T05:20:56.101 INFO:tasks.workunit.client.1.smithi073.stdout:2/139: dwrite d2/d9/d27/f2b [0,4194304] 0 2024-08-31T05:20:56.102 INFO:tasks.workunit.client.1.smithi073.stdout:2/140: dread - d2/d9/df/f22 zero size 2024-08-31T05:20:56.106 INFO:tasks.workunit.client.1.smithi073.stdout:5/103: stat l0 0 2024-08-31T05:20:56.106 INFO:tasks.workunit.client.1.smithi073.stdout:5/104: dread - dc/d16/d1b/f25 zero size 2024-08-31T05:20:56.109 INFO:tasks.workunit.client.1.smithi073.stdout:6/101: mkdir d15/d1a/d1e 0 2024-08-31T05:20:56.112 INFO:tasks.workunit.client.1.smithi073.stdout:7/125: dwrite d1/da/f12 [0,4194304] 0 2024-08-31T05:20:56.112 INFO:tasks.workunit.client.1.smithi073.stdout:9/122: write dc/f28 [562600,42] 0 2024-08-31T05:20:56.113 INFO:tasks.workunit.client.1.smithi073.stdout:9/123: chown f7 23278114 1 2024-08-31T05:20:56.113 INFO:tasks.workunit.client.1.smithi073.stdout:7/126: write d1/d17/f1f [333220,62043] 0 2024-08-31T05:20:56.115 INFO:tasks.workunit.client.1.smithi073.stdout:3/164: mknod da/d1b/c39 0 2024-08-31T05:20:56.117 INFO:tasks.workunit.client.1.smithi073.stdout:3/165: write da/d18/f2a [861851,105962] 0 2024-08-31T05:20:56.118 INFO:tasks.workunit.client.1.smithi073.stdout:0/157: truncate d0/d1/f6 2062805 0 2024-08-31T05:20:56.122 INFO:tasks.workunit.client.1.smithi073.stdout:8/153: link d0/db/d1c/d24/f28 d0/db/d1c/d24/f32 0 2024-08-31T05:20:56.124 INFO:tasks.workunit.client.1.smithi073.stdout:8/154: readlink d0/db/d1c/l31 0 2024-08-31T05:20:56.124 INFO:tasks.workunit.client.1.smithi073.stdout:5/105: rename dc/d16/d1b to dc/d16/d26 0 2024-08-31T05:20:56.126 INFO:tasks.workunit.client.1.smithi073.stdout:3/166: dwrite da/f29 [0,4194304] 0 2024-08-31T05:20:56.126 INFO:tasks.workunit.client.1.smithi073.stdout:8/155: stat d0/db/d1c/f1f 0 2024-08-31T05:20:56.126 INFO:tasks.workunit.client.1.smithi073.stdout:8/156: rename d0 to d0/db/d1c/d24/d33 22 2024-08-31T05:20:56.130 INFO:tasks.workunit.client.1.smithi073.stdout:9/124: rename dc/de/d11/c17 to dc/de/d11/c2c 0 2024-08-31T05:20:56.134 INFO:tasks.workunit.client.1.smithi073.stdout:9/125: dread dc/f28 [0,4194304] 0 2024-08-31T05:20:56.135 INFO:tasks.workunit.client.1.smithi073.stdout:0/158: mknod d0/d15/c31 0 2024-08-31T05:20:56.138 INFO:tasks.workunit.client.1.smithi073.stdout:2/141: unlink d2/d9/df/l21 0 2024-08-31T05:20:56.139 INFO:tasks.workunit.client.1.smithi073.stdout:2/142: truncate d2/d9/df/f22 1032866 0 2024-08-31T05:20:56.140 INFO:tasks.workunit.client.1.smithi073.stdout:8/157: mkdir d0/db/d1c/d34 0 2024-08-31T05:20:56.142 INFO:tasks.workunit.client.1.smithi073.stdout:1/109: truncate d5/f19 567799 0 2024-08-31T05:20:56.143 INFO:tasks.workunit.client.1.smithi073.stdout:7/127: creat d1/da/d15/f21 x:0 0 0 2024-08-31T05:20:56.147 INFO:tasks.workunit.client.1.smithi073.stdout:1/110: fdatasync d5/fc 0 2024-08-31T05:20:56.147 INFO:tasks.workunit.client.1.smithi073.stdout:2/143: dwrite d2/d9/df/f29 [0,4194304] 0 2024-08-31T05:20:56.152 INFO:tasks.workunit.client.1.smithi073.stdout:8/158: mknod d0/c35 0 2024-08-31T05:20:56.153 INFO:tasks.workunit.client.1.smithi073.stdout:1/111: mknod d5/da/c20 0 2024-08-31T05:20:56.154 INFO:tasks.workunit.client.1.smithi073.stdout:9/126: link c6 dc/c2d 0 2024-08-31T05:20:56.156 INFO:tasks.workunit.client.1.smithi073.stdout:2/144: dwrite d2/f2c [0,4194304] 0 2024-08-31T05:20:56.157 INFO:tasks.workunit.client.1.smithi073.stdout:2/145: fdatasync d2/d9/df/f1a 0 2024-08-31T05:20:56.157 INFO:tasks.workunit.client.1.smithi073.stdout:2/146: dread - d2/d9/f2a zero size 2024-08-31T05:20:56.158 INFO:tasks.workunit.client.1.smithi073.stdout:0/159: rename d0/d15/f1d to d0/f32 0 2024-08-31T05:20:56.163 INFO:tasks.workunit.client.1.smithi073.stdout:1/112: mknod d5/c21 0 2024-08-31T05:20:56.164 INFO:tasks.workunit.client.1.smithi073.stdout:3/167: dread - da/d1b/d2c/f30 zero size 2024-08-31T05:20:56.164 INFO:tasks.workunit.client.1.smithi073.stdout:2/147: fsync d2/d9/df/f29 0 2024-08-31T05:20:56.165 INFO:tasks.workunit.client.1.smithi073.stdout:1/113: chown d5/da/f18 2594601 1 2024-08-31T05:20:56.166 INFO:tasks.workunit.client.1.smithi073.stdout:2/148: write d2/d9/df/f22 [1821760,124137] 0 2024-08-31T05:20:56.168 INFO:tasks.workunit.client.1.smithi073.stdout:4/140: truncate d7/fc 153796 0 2024-08-31T05:20:56.171 INFO:tasks.workunit.client.1.smithi073.stdout:3/168: dwrite da/d18/f2a [0,4194304] 0 2024-08-31T05:20:56.174 INFO:tasks.workunit.client.1.smithi073.stdout:8/159: mkdir d0/db/d1c/d34/d36 0 2024-08-31T05:20:56.178 INFO:tasks.workunit.client.1.smithi073.stdout:9/127: getdents dc/d27 0 2024-08-31T05:20:56.178 INFO:tasks.workunit.client.1.smithi073.stdout:8/160: dread d0/f17 [0,4194304] 0 2024-08-31T05:20:56.179 INFO:tasks.workunit.client.1.smithi073.stdout:9/128: truncate dc/d10/f19 676880 0 2024-08-31T05:20:56.181 INFO:tasks.workunit.client.1.smithi073.stdout:6/102: truncate fd 3996476 0 2024-08-31T05:20:56.182 INFO:tasks.workunit.client.1.smithi073.stdout:2/149: creat d2/d9/df/f2e x:0 0 0 2024-08-31T05:20:56.183 INFO:tasks.workunit.client.1.smithi073.stdout:2/150: truncate d2/f19 5661365 0 2024-08-31T05:20:56.183 INFO:tasks.workunit.client.1.smithi073.stdout:4/141: creat d7/db/f2a x:0 0 0 2024-08-31T05:20:56.184 INFO:tasks.workunit.client.1.smithi073.stdout:2/151: read - d2/d9/df/f2e zero size 2024-08-31T05:20:56.186 INFO:tasks.workunit.client.1.smithi073.stdout:2/152: write d2/f2c [3898896,14317] 0 2024-08-31T05:20:56.186 INFO:tasks.workunit.client.1.smithi073.stdout:4/142: read d7/db/f19 [498562,15873] 0 2024-08-31T05:20:56.187 INFO:tasks.workunit.client.1.smithi073.stdout:5/106: truncate f9 2360998 0 2024-08-31T05:20:56.188 INFO:tasks.workunit.client.1.smithi073.stdout:3/169: chown da/f27 0 1 2024-08-31T05:20:56.189 INFO:tasks.workunit.client.1.smithi073.stdout:3/170: write da/f25 [63789,23833] 0 2024-08-31T05:20:56.193 INFO:tasks.workunit.client.1.smithi073.stdout:8/161: rmdir d0/db/d1c/d2a 39 2024-08-31T05:20:56.194 INFO:tasks.workunit.client.1.smithi073.stdout:9/129: rename dc/de/f1a to dc/d27/f2e 0 2024-08-31T05:20:56.196 INFO:tasks.workunit.client.1.smithi073.stdout:3/171: dwrite da/d1b/d2c/f2e [0,4194304] 0 2024-08-31T05:20:56.196 INFO:tasks.workunit.client.1.smithi073.stdout:6/103: creat d15/f1f x:0 0 0 2024-08-31T05:20:56.200 INFO:tasks.workunit.client.1.smithi073.stdout:0/160: creat d0/f33 x:0 0 0 2024-08-31T05:20:56.202 INFO:tasks.workunit.client.1.smithi073.stdout:8/162: dwrite d0/f27 [4194304,4194304] 0 2024-08-31T05:20:56.202 INFO:tasks.workunit.client.1.smithi073.stdout:0/161: dread d0/f1a [0,4194304] 0 2024-08-31T05:20:56.203 INFO:tasks.workunit.client.1.smithi073.stdout:2/153: symlink d2/d25/l2f 0 2024-08-31T05:20:56.204 INFO:tasks.workunit.client.1.smithi073.stdout:4/143: creat d7/df/d13/f2b x:0 0 0 2024-08-31T05:20:56.206 INFO:tasks.workunit.client.1.smithi073.stdout:4/144: write d7/df/d13/f2b [842635,122743] 0 2024-08-31T05:20:56.207 INFO:tasks.workunit.client.1.smithi073.stdout:4/145: chown d7/d24 105099166 1 2024-08-31T05:20:56.216 INFO:tasks.workunit.client.1.smithi073.stdout:5/107: rename dc/d16/d1a/l13 to dc/d16/d26/l27 0 2024-08-31T05:20:56.220 INFO:tasks.workunit.client.1.smithi073.stdout:3/172: unlink da/f25 0 2024-08-31T05:20:56.221 INFO:tasks.workunit.client.1.smithi073.stdout:6/104: creat d15/d1a/f20 x:0 0 0 2024-08-31T05:20:56.225 INFO:tasks.workunit.client.1.smithi073.stdout:8/163: creat d0/db/d1c/d23/f37 x:0 0 0 2024-08-31T05:20:56.227 INFO:tasks.workunit.client.1.smithi073.stdout:4/146: mkdir d7/db/d11/d2c 0 2024-08-31T05:20:56.227 INFO:tasks.workunit.client.1.smithi073.stdout:1/114: dwrite d5/f19 [0,4194304] 0 2024-08-31T05:20:56.229 INFO:tasks.workunit.client.1.smithi073.stdout:0/162: rename d0/d15/c20 to d0/d28/c34 0 2024-08-31T05:20:56.229 INFO:tasks.workunit.client.1.smithi073.stdout:0/163: dread - d0/f29 zero size 2024-08-31T05:20:56.243 INFO:tasks.workunit.client.1.smithi073.stdout:6/105: symlink d15/l21 0 2024-08-31T05:20:56.244 INFO:tasks.workunit.client.1.smithi073.stdout:8/164: mkdir d0/db/d1c/d34/d38 0 2024-08-31T05:20:56.244 INFO:tasks.workunit.client.1.smithi073.stdout:1/115: mknod d5/d10/c22 0 2024-08-31T05:20:56.246 INFO:tasks.workunit.client.1.smithi073.stdout:1/116: truncate d5/f19 4310406 0 2024-08-31T05:20:56.248 INFO:tasks.workunit.client.1.smithi073.stdout:3/173: dread da/d1b/f20 [0,4194304] 0 2024-08-31T05:20:56.251 INFO:tasks.workunit.client.1.smithi073.stdout:1/117: dwrite d5/f9 [0,4194304] 0 2024-08-31T05:20:56.349 INFO:tasks.workunit.client.1.smithi073.stdout:7/128: sync 2024-08-31T05:20:56.406 INFO:tasks.workunit.client.1.smithi073.stdout:9/130: sync 2024-08-31T05:20:56.415 INFO:tasks.workunit.client.0.smithi067.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-08-31T05:20:56.420 INFO:tasks.workunit.client.0.smithi067.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-08-31T05:20:56.421 INFO:tasks.workunit.client.0.smithi067.stderr:+ make 2024-08-31T05:20:56.445 INFO:tasks.workunit.client.1.smithi073.stdout:4/147: mkdir d7/db/d11/d2c/d2d 0 2024-08-31T05:20:56.446 INFO:tasks.workunit.client.1.smithi073.stdout:4/148: dread - d7/df/f25 zero size 2024-08-31T05:20:56.447 INFO:tasks.workunit.client.1.smithi073.stdout:6/106: sync 2024-08-31T05:20:56.447 INFO:tasks.workunit.client.1.smithi073.stdout:5/108: sync 2024-08-31T05:20:56.450 INFO:tasks.workunit.client.1.smithi073.stdout:9/131: fdatasync dc/de/d11/f14 0 2024-08-31T05:20:56.451 INFO:tasks.workunit.client.1.smithi073.stdout:9/132: fsync fb 0 2024-08-31T05:20:56.451 INFO:tasks.workunit.client.1.smithi073.stdout:2/154: getdents d2/d9/d27 0 2024-08-31T05:20:56.452 INFO:tasks.workunit.client.1.smithi073.stdout:4/149: stat d7/df/d13/l1d 0 2024-08-31T05:20:56.456 INFO:tasks.workunit.client.1.smithi073.stdout:8/165: rename d0/db/f15 to d0/f39 0 2024-08-31T05:20:56.457 INFO:tasks.workunit.client.1.smithi073.stdout:2/155: creat d2/d9/df/f30 x:0 0 0 2024-08-31T05:20:56.457 INFO:tasks.workunit.client.1.smithi073.stdout:9/133: dwrite f7 [0,4194304] 0 2024-08-31T05:20:56.459 INFO:tasks.workunit.client.1.smithi073.stdout:3/174: rename da/d1b/f1d to da/d1b/f3a 0 2024-08-31T05:20:56.462 INFO:tasks.workunit.client.1.smithi073.stdout:9/134: fdatasync f8 0 2024-08-31T05:20:56.462 INFO:tasks.workunit.client.1.smithi073.stdout:3/175: write f9 [620173,82875] 0 2024-08-31T05:20:56.465 INFO:tasks.workunit.client.1.smithi073.stdout:3/176: dread - da/ff zero size 2024-08-31T05:20:56.467 INFO:tasks.workunit.client.1.smithi073.stdout:9/135: unlink dc/de/d11/f14 0 2024-08-31T05:20:56.467 INFO:tasks.workunit.client.1.smithi073.stdout:4/150: dwrite d7/f12 [0,4194304] 0 2024-08-31T05:20:56.468 INFO:tasks.workunit.client.1.smithi073.stdout:5/109: dread dc/d16/d1a/f1f [0,4194304] 0 2024-08-31T05:20:56.470 INFO:tasks.workunit.client.1.smithi073.stdout:8/166: getdents d0/db/d1c 0 2024-08-31T05:20:56.473 INFO:tasks.workunit.client.1.smithi073.stdout:9/136: symlink dc/d27/l2f 0 2024-08-31T05:20:56.474 INFO:tasks.workunit.client.1.smithi073.stdout:9/137: write dc/d10/f18 [881007,74819] 0 2024-08-31T05:20:56.474 INFO:tasks.workunit.client.1.smithi073.stdout:5/110: creat dc/d16/d1a/f28 x:0 0 0 2024-08-31T05:20:56.475 INFO:tasks.workunit.client.1.smithi073.stdout:4/151: fsync f5 0 2024-08-31T05:20:56.475 INFO:tasks.workunit.client.1.smithi073.stdout:9/138: stat dc/de/d11/l1b 0 2024-08-31T05:20:56.476 INFO:tasks.workunit.client.1.smithi073.stdout:4/152: fdatasync d7/df/f21 0 2024-08-31T05:20:56.476 INFO:tasks.workunit.client.1.smithi073.stdout:8/167: unlink d0/f10 0 2024-08-31T05:20:56.478 INFO:tasks.workunit.client.1.smithi073.stdout:5/111: symlink dc/d16/d1a/l29 0 2024-08-31T05:20:56.479 INFO:tasks.workunit.client.1.smithi073.stdout:9/139: read fb [372206,93913] 0 2024-08-31T05:20:56.480 INFO:tasks.workunit.client.1.smithi073.stdout:8/168: symlink d0/db/d1c/d23/l3a 0 2024-08-31T05:20:56.481 INFO:tasks.workunit.client.1.smithi073.stdout:5/112: creat dc/d16/f2a x:0 0 0 2024-08-31T05:20:56.482 INFO:tasks.workunit.client.1.smithi073.stdout:9/140: creat dc/f30 x:0 0 0 2024-08-31T05:20:56.483 INFO:tasks.workunit.client.1.smithi073.stdout:9/141: dread - dc/f25 zero size 2024-08-31T05:20:56.484 INFO:tasks.workunit.client.1.smithi073.stdout:9/142: readlink dc/d27/l2f 0 2024-08-31T05:20:56.487 INFO:tasks.workunit.client.1.smithi073.stdout:8/169: dwrite d0/fe [0,4194304] 0 2024-08-31T05:20:56.489 INFO:tasks.workunit.client.1.smithi073.stdout:8/170: truncate d0/f5 487813 0 2024-08-31T05:20:56.492 INFO:tasks.workunit.client.1.smithi073.stdout:8/171: creat d0/db/d1c/f3b x:0 0 0 2024-08-31T05:20:56.493 INFO:tasks.workunit.client.1.smithi073.stdout:8/172: chown d0/fe 19 1 2024-08-31T05:20:56.494 INFO:tasks.workunit.client.1.smithi073.stdout:9/143: dwrite dc/d10/f19 [0,4194304] 0 2024-08-31T05:20:56.506 INFO:tasks.workunit.client.1.smithi073.stdout:6/107: sync 2024-08-31T05:20:56.526 INFO:tasks.workunit.client.1.smithi073.stdout:0/164: write d0/f4 [2740987,29339] 0 2024-08-31T05:20:56.526 INFO:tasks.workunit.client.1.smithi073.stdout:4/153: truncate d7/fc 491948 0 2024-08-31T05:20:56.526 INFO:tasks.workunit.client.1.smithi073.stdout:0/165: write d0/d1/f1f [916196,70278] 0 2024-08-31T05:20:56.527 INFO:tasks.workunit.client.1.smithi073.stdout:1/118: write d5/f6 [1379294,89747] 0 2024-08-31T05:20:56.528 INFO:tasks.workunit.client.1.smithi073.stdout:7/129: write d1/d11/d14/f1b [4242292,3127] 0 2024-08-31T05:20:56.528 INFO:tasks.workunit.client.1.smithi073.stdout:4/154: dread - d7/db/f2a zero size 2024-08-31T05:20:56.529 INFO:tasks.workunit.client.1.smithi073.stdout:7/130: fdatasync d1/da/f12 0 2024-08-31T05:20:56.530 INFO:tasks.workunit.client.1.smithi073.stdout:4/155: readlink d7/df/d13/l26 0 2024-08-31T05:20:56.531 INFO:tasks.workunit.client.1.smithi073.stdout:2/156: getdents d2/d9/df 0 2024-08-31T05:20:56.531 INFO:tasks.workunit.client.1.smithi073.stdout:1/119: mknod d5/da/d13/c23 0 2024-08-31T05:20:56.532 INFO:tasks.workunit.client.0.smithi067.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-08-31T05:20:56.533 INFO:tasks.workunit.client.1.smithi073.stdout:0/166: symlink d0/d28/d2b/l35 0 2024-08-31T05:20:56.534 INFO:tasks.workunit.client.1.smithi073.stdout:0/167: chown d0/d1/f13 23620192 1 2024-08-31T05:20:56.535 INFO:tasks.workunit.client.1.smithi073.stdout:4/156: mkdir d7/df/d13/d2e 0 2024-08-31T05:20:56.537 INFO:tasks.workunit.client.1.smithi073.stdout:7/131: dwrite d1/da/f12 [8388608,4194304] 0 2024-08-31T05:20:56.538 INFO:tasks.workunit.client.1.smithi073.stdout:2/157: symlink d2/d9/df/l31 0 2024-08-31T05:20:56.541 INFO:tasks.workunit.client.1.smithi073.stdout:0/168: fdatasync d0/d28/f2d 0 2024-08-31T05:20:56.543 INFO:tasks.workunit.client.1.smithi073.stdout:7/132: mkdir d1/d17/d22 0 2024-08-31T05:20:56.547 INFO:tasks.workunit.client.1.smithi073.stdout:2/158: rmdir d2/d9/df 39 2024-08-31T05:20:56.549 INFO:tasks.workunit.client.1.smithi073.stdout:5/113: truncate dc/f12 3338232 0 2024-08-31T05:20:56.549 INFO:tasks.workunit.client.1.smithi073.stdout:7/133: dwrite d1/da/f12 [8388608,4194304] 0 2024-08-31T05:20:56.551 INFO:tasks.workunit.client.1.smithi073.stdout:0/169: mknod d0/d28/c36 0 2024-08-31T05:20:56.554 INFO:tasks.workunit.client.1.smithi073.stdout:9/144: truncate dc/d10/f18 258838 0 2024-08-31T05:20:56.555 INFO:tasks.workunit.client.1.smithi073.stdout:6/108: truncate fe 1525897 0 2024-08-31T05:20:56.563 INFO:tasks.workunit.client.1.smithi073.stdout:5/114: dwrite dc/d16/d26/f23 [0,4194304] 0 2024-08-31T05:20:56.563 INFO:tasks.workunit.client.1.smithi073.stdout:1/120: getdents d5/d17 0 2024-08-31T05:20:56.564 INFO:tasks.workunit.client.1.smithi073.stdout:7/134: dwrite d1/d17/f1f [0,4194304] 0 2024-08-31T05:20:56.567 INFO:tasks.workunit.client.1.smithi073.stdout:0/170: truncate d0/d1/ff 4585129 0 2024-08-31T05:20:56.567 INFO:tasks.workunit.client.1.smithi073.stdout:7/135: chown d1/c8 778453 1 2024-08-31T05:20:56.568 INFO:tasks.workunit.client.1.smithi073.stdout:3/177: link da/d1b/c36 da/d1b/c3b 0 2024-08-31T05:20:56.570 INFO:tasks.workunit.client.1.smithi073.stdout:8/173: unlink d0/db/d1c/d23/c29 0 2024-08-31T05:20:56.571 INFO:tasks.workunit.client.1.smithi073.stdout:5/115: creat dc/d16/f2b x:0 0 0 2024-08-31T05:20:56.573 INFO:tasks.workunit.client.1.smithi073.stdout:6/109: dwrite d15/d1a/f20 [0,4194304] 0 2024-08-31T05:20:56.573 INFO:tasks.workunit.client.1.smithi073.stdout:3/178: stat da/d1b/c39 0 2024-08-31T05:20:56.577 INFO:tasks.workunit.client.1.smithi073.stdout:0/171: creat d0/d15/f37 x:0 0 0 2024-08-31T05:20:56.577 INFO:tasks.workunit.client.1.smithi073.stdout:6/110: chown d15/l18 82 1 2024-08-31T05:20:56.578 INFO:tasks.workunit.client.1.smithi073.stdout:9/145: mknod dc/d10/c31 0 2024-08-31T05:20:56.582 INFO:tasks.workunit.client.1.smithi073.stdout:6/111: creat d15/f22 x:0 0 0 2024-08-31T05:20:56.584 INFO:tasks.workunit.client.1.smithi073.stdout:3/179: dread f9 [0,4194304] 0 2024-08-31T05:20:56.586 INFO:tasks.workunit.client.1.smithi073.stdout:8/174: dread d0/f39 [4194304,4194304] 0 2024-08-31T05:20:56.586 INFO:tasks.workunit.client.1.smithi073.stdout:6/112: mknod d15/c23 0 2024-08-31T05:20:56.586 INFO:tasks.workunit.client.1.smithi073.stdout:7/136: dread d1/da/f12 [4194304,4194304] 0 2024-08-31T05:20:56.587 INFO:tasks.workunit.client.1.smithi073.stdout:0/172: creat d0/d15/d2c/d2e/f38 x:0 0 0 2024-08-31T05:20:56.587 INFO:tasks.workunit.client.1.smithi073.stdout:5/116: dread fb [0,4194304] 0 2024-08-31T05:20:56.589 INFO:tasks.workunit.client.1.smithi073.stdout:6/113: unlink c4 0 2024-08-31T05:20:56.589 INFO:tasks.workunit.client.1.smithi073.stdout:3/180: read da/f29 [2291981,75105] 0 2024-08-31T05:20:56.591 INFO:tasks.workunit.client.1.smithi073.stdout:9/146: dwrite f9 [0,4194304] 0 2024-08-31T05:20:56.592 INFO:tasks.workunit.client.1.smithi073.stdout:5/117: write fb [1980248,38356] 0 2024-08-31T05:20:56.594 INFO:tasks.workunit.client.1.smithi073.stdout:7/137: write d1/da/f12 [8450523,67161] 0 2024-08-31T05:20:56.594 INFO:tasks.workunit.client.1.smithi073.stdout:8/175: chown d0/db/d1c/d24/f28 131 1 2024-08-31T05:20:56.594 INFO:tasks.workunit.client.1.smithi073.stdout:3/181: truncate da/ff 991254 0 2024-08-31T05:20:56.611 INFO:tasks.workunit.client.1.smithi073.stdout:3/182: chown da/f17 31121 1 2024-08-31T05:20:56.615 INFO:tasks.workunit.client.1.smithi073.stdout:0/173: dwrite d0/d15/f37 [0,4194304] 0 2024-08-31T05:20:56.615 INFO:tasks.workunit.client.1.smithi073.stdout:1/121: dread f2 [0,4194304] 0 2024-08-31T05:20:56.617 INFO:tasks.workunit.client.1.smithi073.stdout:8/176: chown d0/db/d1c/d34/d36 286 1 2024-08-31T05:20:56.617 INFO:tasks.workunit.client.1.smithi073.stdout:2/159: dwrite d2/fa [0,4194304] 0 2024-08-31T05:20:56.617 INFO:tasks.workunit.client.1.smithi073.stdout:1/122: chown d5/fc 20487111 1 2024-08-31T05:20:56.618 INFO:tasks.workunit.client.1.smithi073.stdout:7/138: rename d1/l13 to d1/d17/d22/l23 0 2024-08-31T05:20:56.618 INFO:tasks.workunit.client.1.smithi073.stdout:0/174: truncate d0/f21 4750488 0 2024-08-31T05:20:56.619 INFO:tasks.workunit.client.1.smithi073.stdout:8/177: chown d0/db/lf 151968 1 2024-08-31T05:20:56.621 INFO:tasks.workunit.client.1.smithi073.stdout:3/183: mkdir da/d3c 0 2024-08-31T05:20:56.621 INFO:tasks.workunit.client.1.smithi073.stdout:1/123: chown d5/da/d13/c14 1 1 2024-08-31T05:20:56.622 INFO:tasks.workunit.client.1.smithi073.stdout:0/175: symlink d0/d28/d2b/l39 0 2024-08-31T05:20:56.622 INFO:tasks.workunit.client.1.smithi073.stdout:1/124: chown d5/d10/c22 4 1 2024-08-31T05:20:56.626 INFO:tasks.workunit.client.1.smithi073.stdout:3/184: readlink da/d1b/l34 0 2024-08-31T05:20:56.626 INFO:tasks.workunit.client.1.smithi073.stdout:0/176: mknod d0/d15/d2c/d2e/c3a 0 2024-08-31T05:20:56.627 INFO:tasks.workunit.client.1.smithi073.stdout:1/125: mknod d5/d10/c24 0 2024-08-31T05:20:56.628 INFO:tasks.workunit.client.1.smithi073.stdout:0/177: write d0/f4 [3243318,21812] 0 2024-08-31T05:20:56.629 INFO:tasks.workunit.client.1.smithi073.stdout:9/147: link dc/de/d11/l1b dc/d27/l32 0 2024-08-31T05:20:56.631 INFO:tasks.workunit.client.1.smithi073.stdout:0/178: fsync d0/d1/f1f 0 2024-08-31T05:20:56.633 INFO:tasks.workunit.client.1.smithi073.stdout:8/178: dwrite d0/db/d1c/f1f [0,4194304] 0 2024-08-31T05:20:56.633 INFO:tasks.workunit.client.1.smithi073.stdout:0/179: dread - d0/d28/f30 zero size 2024-08-31T05:20:56.634 INFO:tasks.workunit.client.1.smithi073.stdout:8/179: chown d0/db/d1c/f1f 539565 1 2024-08-31T05:20:56.635 INFO:tasks.workunit.client.1.smithi073.stdout:1/126: creat d5/f25 x:0 0 0 2024-08-31T05:20:56.636 INFO:tasks.workunit.client.1.smithi073.stdout:3/185: rename da/d18/l19 to da/d3c/l3d 0 2024-08-31T05:20:56.636 INFO:tasks.workunit.client.1.smithi073.stdout:5/118: truncate f2 3434474 0 2024-08-31T05:20:56.636 INFO:tasks.workunit.client.1.smithi073.stdout:0/180: write d0/d28/f30 [922750,103139] 0 2024-08-31T05:20:56.638 INFO:tasks.workunit.client.1.smithi073.stdout:5/119: stat dc/l15 0 2024-08-31T05:20:56.639 INFO:tasks.workunit.client.1.smithi073.stdout:9/148: stat dc/d10/l24 0 2024-08-31T05:20:56.640 INFO:tasks.workunit.client.1.smithi073.stdout:5/120: write dc/d16/f2b [587578,4543] 0 2024-08-31T05:20:56.643 INFO:tasks.workunit.client.1.smithi073.stdout:0/181: symlink d0/d15/d2c/l3b 0 2024-08-31T05:20:56.643 INFO:tasks.workunit.client.1.smithi073.stdout:2/160: truncate d2/f19 3541614 0 2024-08-31T05:20:56.644 INFO:tasks.workunit.client.1.smithi073.stdout:2/161: chown d2/d9/ce 12626 1 2024-08-31T05:20:56.645 INFO:tasks.workunit.client.1.smithi073.stdout:5/121: creat dc/d16/d26/f2c x:0 0 0 2024-08-31T05:20:56.645 INFO:tasks.workunit.client.1.smithi073.stdout:8/180: getdents d0/db/d1c 0 2024-08-31T05:20:56.647 INFO:tasks.workunit.client.1.smithi073.stdout:2/162: dread - d2/d9/df/f2e zero size 2024-08-31T05:20:56.648 INFO:tasks.workunit.client.1.smithi073.stdout:8/181: truncate d0/db/f22 357545 0 2024-08-31T05:20:56.648 INFO:tasks.workunit.client.1.smithi073.stdout:2/163: read - d2/d9/df/f2e zero size 2024-08-31T05:20:56.648 INFO:tasks.workunit.client.1.smithi073.stdout:5/122: rename dc/l20 to dc/d16/d26/l2d 0 2024-08-31T05:20:56.650 INFO:tasks.workunit.client.1.smithi073.stdout:3/186: getdents da/d18 0 2024-08-31T05:20:56.650 INFO:tasks.workunit.client.1.smithi073.stdout:3/187: read - da/f12 zero size 2024-08-31T05:20:56.651 INFO:tasks.workunit.client.1.smithi073.stdout:5/123: creat dc/d16/f2e x:0 0 0 2024-08-31T05:20:56.652 INFO:tasks.workunit.client.1.smithi073.stdout:5/124: write dc/d16/d1a/f28 [561707,40042] 0 2024-08-31T05:20:56.653 INFO:tasks.workunit.client.1.smithi073.stdout:5/125: dread - dc/d16/d26/f2c zero size 2024-08-31T05:20:56.657 INFO:tasks.workunit.client.1.smithi073.stdout:2/164: unlink d2/d25/l26 0 2024-08-31T05:20:56.658 INFO:tasks.workunit.client.1.smithi073.stdout:2/165: chown d2/d9/ce 681700 1 2024-08-31T05:20:56.659 INFO:tasks.workunit.client.1.smithi073.stdout:8/182: creat d0/f3c x:0 0 0 2024-08-31T05:20:56.659 INFO:tasks.workunit.client.1.smithi073.stdout:9/149: write dc/d10/f18 [402195,81635] 0 2024-08-31T05:20:56.659 INFO:tasks.workunit.client.1.smithi073.stdout:4/157: sync 2024-08-31T05:20:56.662 INFO:tasks.workunit.client.1.smithi073.stdout:4/158: symlink d7/db/l2f 0 2024-08-31T05:20:56.664 INFO:tasks.workunit.client.1.smithi073.stdout:8/183: dread d0/db/d1c/d23/f26 [0,4194304] 0 2024-08-31T05:20:56.664 INFO:tasks.workunit.client.1.smithi073.stdout:9/150: creat dc/d10/f33 x:0 0 0 2024-08-31T05:20:56.664 INFO:tasks.workunit.client.1.smithi073.stdout:3/188: write da/d18/f21 [1299214,44306] 0 2024-08-31T05:20:56.668 INFO:tasks.workunit.client.1.smithi073.stdout:4/159: rename d7/d1a/c20 to d7/df/d13/c30 0 2024-08-31T05:20:56.669 INFO:tasks.workunit.client.1.smithi073.stdout:8/184: unlink d0/db/d1c/d2a/f2c 0 2024-08-31T05:20:56.670 INFO:tasks.workunit.client.1.smithi073.stdout:9/151: dread dc/d10/f19 [0,4194304] 0 2024-08-31T05:20:56.672 INFO:tasks.workunit.client.1.smithi073.stdout:8/185: chown d0/c12 15764906 1 2024-08-31T05:20:56.673 INFO:tasks.workunit.client.1.smithi073.stdout:4/160: rename d7/df/d1b/f23 to d7/df/d13/d2e/f31 0 2024-08-31T05:20:56.673 INFO:tasks.workunit.client.1.smithi073.stdout:3/189: dread da/d1b/f3a [0,4194304] 0 2024-08-31T05:20:56.673 INFO:tasks.workunit.client.1.smithi073.stdout:5/126: dread f9 [0,4194304] 0 2024-08-31T05:20:56.674 INFO:tasks.workunit.client.1.smithi073.stdout:9/152: write dc/d10/f26 [591115,75989] 0 2024-08-31T05:20:56.675 INFO:tasks.workunit.client.1.smithi073.stdout:9/153: stat dc/d10/f26 0 2024-08-31T05:20:56.678 INFO:tasks.workunit.client.1.smithi073.stdout:4/161: truncate d7/d1a/f29 687954 0 2024-08-31T05:20:56.679 INFO:tasks.workunit.client.1.smithi073.stdout:9/154: chown dc/de/d11/l13 56 1 2024-08-31T05:20:56.680 INFO:tasks.workunit.client.1.smithi073.stdout:2/166: truncate d2/f19 2125331 0 2024-08-31T05:20:56.680 INFO:tasks.workunit.client.1.smithi073.stdout:8/186: link d0/db/d1c/d2a/f30 d0/db/d1c/d34/f3d 0 2024-08-31T05:20:56.680 INFO:tasks.workunit.client.1.smithi073.stdout:9/155: dread - dc/de/f1e zero size 2024-08-31T05:20:56.681 INFO:tasks.workunit.client.1.smithi073.stdout:4/162: creat d7/df/f32 x:0 0 0 2024-08-31T05:20:56.682 INFO:tasks.workunit.client.1.smithi073.stdout:3/190: dread da/d18/f21 [0,4194304] 0 2024-08-31T05:20:56.682 INFO:tasks.workunit.client.1.smithi073.stdout:8/187: mknod d0/db/c3e 0 2024-08-31T05:20:56.682 INFO:tasks.workunit.client.1.smithi073.stdout:5/127: dwrite fb [0,4194304] 0 2024-08-31T05:20:56.683 INFO:tasks.workunit.client.1.smithi073.stdout:2/167: mkdir d2/d9/d32 0 2024-08-31T05:20:56.683 INFO:tasks.workunit.client.1.smithi073.stdout:5/128: readlink l0 0 2024-08-31T05:20:56.683 INFO:tasks.workunit.client.1.smithi073.stdout:9/156: rmdir dc 39 2024-08-31T05:20:56.684 INFO:tasks.workunit.client.1.smithi073.stdout:4/163: mknod d7/db/c33 0 2024-08-31T05:20:56.684 INFO:tasks.workunit.client.1.smithi073.stdout:2/168: chown d2/d9/ce 5314 1 2024-08-31T05:20:56.685 INFO:tasks.workunit.client.1.smithi073.stdout:8/188: read d0/db/d1c/d23/f26 [2185285,112871] 0 2024-08-31T05:20:56.686 INFO:tasks.workunit.client.1.smithi073.stdout:5/129: symlink dc/d16/d1a/l2f 0 2024-08-31T05:20:56.687 INFO:tasks.workunit.client.1.smithi073.stdout:3/191: rename f4 to da/f3e 0 2024-08-31T05:20:56.687 INFO:tasks.workunit.client.1.smithi073.stdout:5/130: truncate dc/d16/d26/f2c 423017 0 2024-08-31T05:20:56.688 INFO:tasks.workunit.client.1.smithi073.stdout:4/164: unlink d7/df/f32 0 2024-08-31T05:20:56.689 INFO:tasks.workunit.client.1.smithi073.stdout:4/165: dread - d7/df/f25 zero size 2024-08-31T05:20:56.689 INFO:tasks.workunit.client.1.smithi073.stdout:9/157: mkdir dc/d10/d34 0 2024-08-31T05:20:56.690 INFO:tasks.workunit.client.1.smithi073.stdout:2/169: creat d2/d9/d27/f33 x:0 0 0 2024-08-31T05:20:56.691 INFO:tasks.workunit.client.1.smithi073.stdout:8/189: dwrite d0/f4 [0,4194304] 0 2024-08-31T05:20:56.691 INFO:tasks.workunit.client.1.smithi073.stdout:4/166: chown d7/df/d13/f16 26516 1 2024-08-31T05:20:56.692 INFO:tasks.workunit.client.1.smithi073.stdout:5/131: chown dc/d16/d26/l27 0 1 2024-08-31T05:20:56.697 INFO:tasks.workunit.client.1.smithi073.stdout:8/190: unlink d0/c19 0 2024-08-31T05:20:56.697 INFO:tasks.workunit.client.1.smithi073.stdout:9/158: creat dc/de/d11/d2a/f35 x:0 0 0 2024-08-31T05:20:56.699 INFO:tasks.workunit.client.1.smithi073.stdout:5/132: symlink dc/d16/d26/l30 0 2024-08-31T05:20:56.699 INFO:tasks.workunit.client.1.smithi073.stdout:8/191: dread - d0/db/d1c/d23/f2f zero size 2024-08-31T05:20:56.701 INFO:tasks.workunit.client.1.smithi073.stdout:4/167: dwrite d7/f12 [0,4194304] 0 2024-08-31T05:20:56.701 INFO:tasks.workunit.client.1.smithi073.stdout:9/159: getdents dc/de/d11 0 2024-08-31T05:20:56.703 INFO:tasks.workunit.client.1.smithi073.stdout:8/192: write d0/db/d1c/d23/f37 [233830,60868] 0 2024-08-31T05:20:56.706 INFO:tasks.workunit.client.1.smithi073.stdout:9/160: mkdir dc/de/d11/d36 0 2024-08-31T05:20:56.707 INFO:tasks.workunit.client.1.smithi073.stdout:2/170: dread d2/d9/df/f1f [0,4194304] 0 2024-08-31T05:20:56.708 INFO:tasks.workunit.client.1.smithi073.stdout:9/161: dread - dc/de/f1e zero size 2024-08-31T05:20:56.708 INFO:tasks.workunit.client.1.smithi073.stdout:8/193: write d0/f27 [7960038,12502] 0 2024-08-31T05:20:56.712 INFO:tasks.workunit.client.1.smithi073.stdout:2/171: mknod d2/d9/c34 0 2024-08-31T05:20:56.712 INFO:tasks.workunit.client.1.smithi073.stdout:4/168: dwrite d7/f12 [0,4194304] 0 2024-08-31T05:20:56.720 INFO:tasks.workunit.client.1.smithi073.stdout:4/169: dread d7/df/d13/f2b [0,4194304] 0 2024-08-31T05:20:56.720 INFO:tasks.workunit.client.1.smithi073.stdout:8/194: dwrite d0/f4 [0,4194304] 0 2024-08-31T05:20:56.725 INFO:tasks.workunit.client.1.smithi073.stdout:2/172: dwrite d2/d9/df/f30 [0,4194304] 0 2024-08-31T05:20:56.728 INFO:tasks.workunit.client.1.smithi073.stdout:8/195: creat d0/db/d1c/d2a/f3f x:0 0 0 2024-08-31T05:20:56.732 INFO:tasks.workunit.client.1.smithi073.stdout:5/133: getdents dc/d16/d1a 0 2024-08-31T05:20:56.734 INFO:tasks.workunit.client.1.smithi073.stdout:8/196: truncate d0/db/d1c/f3b 709900 0 2024-08-31T05:20:56.734 INFO:tasks.workunit.client.1.smithi073.stdout:5/134: fdatasync dc/d16/d26/f23 0 2024-08-31T05:20:56.735 INFO:tasks.workunit.client.1.smithi073.stdout:2/173: dwrite d2/d9/f24 [0,4194304] 0 2024-08-31T05:20:56.736 INFO:tasks.workunit.client.1.smithi073.stdout:4/170: getdents d7/df/d13/d2e 0 2024-08-31T05:20:56.738 INFO:tasks.workunit.client.1.smithi073.stdout:5/135: fdatasync f9 0 2024-08-31T05:20:56.739 INFO:tasks.workunit.client.1.smithi073.stdout:2/174: creat d2/f35 x:0 0 0 2024-08-31T05:20:56.742 INFO:tasks.workunit.client.1.smithi073.stdout:2/175: write d2/d9/df/f22 [2953311,84194] 0 2024-08-31T05:20:56.742 INFO:tasks.workunit.client.1.smithi073.stdout:8/197: mknod d0/db/d1c/d34/d36/c40 0 2024-08-31T05:20:56.744 INFO:tasks.workunit.client.1.smithi073.stdout:5/136: mknod dc/d16/d26/c31 0 2024-08-31T05:20:56.745 INFO:tasks.workunit.client.1.smithi073.stdout:8/198: truncate d0/db/d1c/d34/f3d 802023 0 2024-08-31T05:20:56.745 INFO:tasks.workunit.client.1.smithi073.stdout:5/137: write dc/d16/f2b [965986,9561] 0 2024-08-31T05:20:56.746 INFO:tasks.workunit.client.1.smithi073.stdout:9/162: rename dc/de/d11/d2a to dc/d37 0 2024-08-31T05:20:56.748 INFO:tasks.workunit.client.1.smithi073.stdout:2/176: mkdir d2/d9/df/d36 0 2024-08-31T05:20:56.748 INFO:tasks.workunit.client.1.smithi073.stdout:2/177: chown d2/d9/d27/l2d 118664820 1 2024-08-31T05:20:56.750 INFO:tasks.workunit.client.1.smithi073.stdout:6/114: sync 2024-08-31T05:20:56.752 INFO:tasks.workunit.client.1.smithi073.stdout:2/178: mknod d2/d9/df/c37 0 2024-08-31T05:20:56.756 INFO:tasks.workunit.client.1.smithi073.stdout:6/115: rename fc to d15/d1a/d1e/f24 0 2024-08-31T05:20:56.757 INFO:tasks.workunit.client.1.smithi073.stdout:2/179: symlink d2/d9/d27/l38 0 2024-08-31T05:20:56.757 INFO:tasks.workunit.client.1.smithi073.stdout:6/116: creat d15/d1a/d1e/f25 x:0 0 0 2024-08-31T05:20:56.758 INFO:tasks.workunit.client.1.smithi073.stdout:2/180: creat d2/d9/d32/f39 x:0 0 0 2024-08-31T05:20:56.758 INFO:tasks.workunit.client.1.smithi073.stdout:6/117: mkdir d15/d17/d26 0 2024-08-31T05:20:56.759 INFO:tasks.workunit.client.1.smithi073.stdout:2/181: chown d2/d25/l2f 4468281 1 2024-08-31T05:20:56.760 INFO:tasks.workunit.client.1.smithi073.stdout:2/182: read - d2/d9/d27/f33 zero size 2024-08-31T05:20:56.761 INFO:tasks.workunit.client.1.smithi073.stdout:2/183: fsync d2/d9/f2a 0 2024-08-31T05:20:56.762 INFO:tasks.workunit.client.1.smithi073.stdout:6/118: dread f14 [0,4194304] 0 2024-08-31T05:20:56.763 INFO:tasks.workunit.client.1.smithi073.stdout:2/184: chown d2/d9/d27/l2d 23 1 2024-08-31T05:20:56.764 INFO:tasks.workunit.client.1.smithi073.stdout:6/119: write d15/f22 [355001,108398] 0 2024-08-31T05:20:56.765 INFO:tasks.workunit.client.1.smithi073.stdout:8/199: write d0/db/d1c/d24/f28 [2880454,19283] 0 2024-08-31T05:20:56.765 INFO:tasks.workunit.client.1.smithi073.stdout:2/185: rmdir d2/d9 39 2024-08-31T05:20:56.766 INFO:tasks.workunit.client.1.smithi073.stdout:4/171: dwrite f5 [0,4194304] 0 2024-08-31T05:20:56.767 INFO:tasks.workunit.client.1.smithi073.stdout:8/200: fsync d0/db/d1c/f3b 0 2024-08-31T05:20:56.768 INFO:tasks.workunit.client.1.smithi073.stdout:6/120: symlink d15/l27 0 2024-08-31T05:20:56.768 INFO:tasks.workunit.client.1.smithi073.stdout:9/163: truncate dc/f28 1072225 0 2024-08-31T05:20:56.770 INFO:tasks.workunit.client.1.smithi073.stdout:4/172: mkdir d7/df/d1b/d34 0 2024-08-31T05:20:56.770 INFO:tasks.workunit.client.1.smithi073.stdout:8/201: write d0/f5 [670577,100134] 0 2024-08-31T05:20:56.774 INFO:tasks.workunit.client.1.smithi073.stdout:2/186: fdatasync d2/d9/df/f1f 0 2024-08-31T05:20:56.774 INFO:tasks.workunit.client.1.smithi073.stdout:4/173: symlink d7/db/d11/l35 0 2024-08-31T05:20:56.777 INFO:tasks.workunit.client.1.smithi073.stdout:5/138: dwrite f2 [0,4194304] 0 2024-08-31T05:20:56.778 INFO:tasks.workunit.client.1.smithi073.stdout:2/187: write d2/d9/f24 [4276554,12855] 0 2024-08-31T05:20:56.783 INFO:tasks.workunit.client.1.smithi073.stdout:9/164: dwrite dc/d10/f33 [0,4194304] 0 2024-08-31T05:20:56.784 INFO:tasks.workunit.client.1.smithi073.stdout:4/174: truncate d7/db/f19 760144 0 2024-08-31T05:20:56.785 INFO:tasks.workunit.client.1.smithi073.stdout:4/175: stat d7/fa 0 2024-08-31T05:20:56.786 INFO:tasks.workunit.client.1.smithi073.stdout:5/139: mkdir dc/d16/d26/d32 0 2024-08-31T05:20:56.788 INFO:tasks.workunit.client.1.smithi073.stdout:2/188: rename d2/c14 to d2/d25/c3a 0 2024-08-31T05:20:56.792 INFO:tasks.workunit.client.1.smithi073.stdout:9/165: creat dc/d27/f38 x:0 0 0 2024-08-31T05:20:56.794 INFO:tasks.workunit.client.1.smithi073.stdout:5/140: dwrite f2 [0,4194304] 0 2024-08-31T05:20:56.796 INFO:tasks.workunit.client.1.smithi073.stdout:8/202: write d0/db/d1c/d34/f3d [1155492,127385] 0 2024-08-31T05:20:56.797 INFO:tasks.workunit.client.1.smithi073.stdout:2/189: dread f1 [0,4194304] 0 2024-08-31T05:20:56.797 INFO:tasks.workunit.client.1.smithi073.stdout:9/166: creat dc/d10/d34/f39 x:0 0 0 2024-08-31T05:20:56.798 INFO:tasks.workunit.client.1.smithi073.stdout:7/139: sync 2024-08-31T05:20:56.804 INFO:tasks.workunit.client.1.smithi073.stdout:9/167: write dc/d37/f35 [642043,44388] 0 2024-08-31T05:20:56.805 INFO:tasks.workunit.client.1.smithi073.stdout:8/203: read d0/db/d1c/d24/f28 [4169997,69401] 0 2024-08-31T05:20:56.806 INFO:tasks.workunit.client.1.smithi073.stdout:6/121: dwrite f14 [0,4194304] 0 2024-08-31T05:20:56.807 INFO:tasks.workunit.client.1.smithi073.stdout:7/140: creat d1/da/d15/f24 x:0 0 0 2024-08-31T05:20:56.811 INFO:tasks.workunit.client.1.smithi073.stdout:9/168: mknod dc/d37/c3a 0 2024-08-31T05:20:56.812 INFO:tasks.workunit.client.1.smithi073.stdout:8/204: chown d0/db/d1c/d24/f32 36 1 2024-08-31T05:20:56.812 INFO:tasks.workunit.client.1.smithi073.stdout:4/176: write d7/db/f19 [685258,54664] 0 2024-08-31T05:20:56.814 INFO:tasks.workunit.client.1.smithi073.stdout:6/122: symlink d15/l28 0 2024-08-31T05:20:56.815 INFO:tasks.workunit.client.1.smithi073.stdout:4/177: readlink d7/db/l2f 0 2024-08-31T05:20:56.815 INFO:tasks.workunit.client.1.smithi073.stdout:6/123: stat d15/l28 0 2024-08-31T05:20:56.816 INFO:tasks.workunit.client.1.smithi073.stdout:2/190: dwrite d2/d9/df/f30 [0,4194304] 0 2024-08-31T05:20:56.817 INFO:tasks.workunit.client.1.smithi073.stdout:8/205: read d0/db/d1c/f1f [3995135,34615] 0 2024-08-31T05:20:56.817 INFO:tasks.workunit.client.1.smithi073.stdout:7/141: unlink d1/c6 0 2024-08-31T05:20:56.819 INFO:tasks.workunit.client.1.smithi073.stdout:8/206: fsync d0/db/f22 0 2024-08-31T05:20:56.819 INFO:tasks.workunit.client.1.smithi073.stdout:9/169: readlink dc/de/l2b 0 2024-08-31T05:20:56.821 INFO:tasks.workunit.client.1.smithi073.stdout:4/178: chown d7/df/d1b/d34 430968247 1 2024-08-31T05:20:56.821 INFO:tasks.workunit.client.1.smithi073.stdout:5/141: dwrite f9 [0,4194304] 0 2024-08-31T05:20:56.823 INFO:tasks.workunit.client.1.smithi073.stdout:8/207: dread - d0/db/d1c/d2a/f3f zero size 2024-08-31T05:20:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:56 smithi067 ceph-mon[17432]: pgmap v19: 65 pgs: 65 active+clean; 330 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 24 MiB/s wr, 417 op/s 2024-08-31T05:20:56.826 INFO:tasks.workunit.client.1.smithi073.stdout:9/170: symlink dc/d27/l3b 0 2024-08-31T05:20:56.829 INFO:tasks.workunit.client.1.smithi073.stdout:2/191: rename d2/f4 to d2/d9/df/f3b 0 2024-08-31T05:20:56.829 INFO:tasks.workunit.client.1.smithi073.stdout:8/208: fdatasync d0/f1b 0 2024-08-31T05:20:56.830 INFO:tasks.workunit.client.1.smithi073.stdout:5/142: creat dc/d16/d1a/f33 x:0 0 0 2024-08-31T05:20:56.831 INFO:tasks.workunit.client.1.smithi073.stdout:0/182: sync 2024-08-31T05:20:56.831 INFO:tasks.workunit.client.1.smithi073.stdout:3/192: sync 2024-08-31T05:20:56.832 INFO:tasks.workunit.client.1.smithi073.stdout:1/127: sync 2024-08-31T05:20:56.834 INFO:tasks.workunit.client.1.smithi073.stdout:2/192: chown d2/l5 123135 1 2024-08-31T05:20:56.837 INFO:tasks.workunit.client.1.smithi073.stdout:6/124: dwrite f13 [0,4194304] 0 2024-08-31T05:20:56.837 INFO:tasks.workunit.client.1.smithi073.stdout:9/171: rename dc/de/f1f to dc/f3c 0 2024-08-31T05:20:56.839 INFO:tasks.workunit.client.1.smithi073.stdout:3/193: dread da/f15 [0,4194304] 0 2024-08-31T05:20:56.839 INFO:tasks.workunit.client.1.smithi073.stdout:0/183: write d0/d1/f6 [3510476,11799] 0 2024-08-31T05:20:56.841 INFO:tasks.workunit.client.1.smithi073.stdout:6/125: chown l7 452630320 1 2024-08-31T05:20:56.842 INFO:tasks.workunit.client.1.smithi073.stdout:0/184: chown d0/f2f 1258 1 2024-08-31T05:20:56.843 INFO:tasks.workunit.client.1.smithi073.stdout:7/142: dread d1/d11/d14/f1b [0,4194304] 0 2024-08-31T05:20:56.843 INFO:tasks.workunit.client.1.smithi073.stdout:1/128: truncate d5/da/f18 901363 0 2024-08-31T05:20:56.844 INFO:tasks.workunit.client.1.smithi073.stdout:4/179: dwrite d7/db/f2a [0,4194304] 0 2024-08-31T05:20:56.845 INFO:tasks.workunit.client.1.smithi073.stdout:5/143: dread dc/d16/d26/f2c [0,4194304] 0 2024-08-31T05:20:56.846 INFO:tasks.workunit.client.1.smithi073.stdout:8/209: truncate d0/f39 9322810 0 2024-08-31T05:20:56.847 INFO:tasks.workunit.client.1.smithi073.stdout:1/129: write d5/d17/f1a [400050,7833] 0 2024-08-31T05:20:56.847 INFO:tasks.workunit.client.1.smithi073.stdout:2/193: unlink d2/d9/df/f12 0 2024-08-31T05:20:56.850 INFO:tasks.workunit.client.1.smithi073.stdout:2/194: write d2/d9/f24 [2483268,84135] 0 2024-08-31T05:20:56.851 INFO:tasks.workunit.client.1.smithi073.stdout:3/194: readlink da/d3c/l3d 0 2024-08-31T05:20:56.852 INFO:tasks.workunit.client.1.smithi073.stdout:2/195: dread - d2/d9/d27/f33 zero size 2024-08-31T05:20:56.853 INFO:tasks.workunit.client.1.smithi073.stdout:5/144: dread fb [0,4194304] 0 2024-08-31T05:20:56.854 INFO:tasks.workunit.client.1.smithi073.stdout:5/145: fsync f9 0 2024-08-31T05:20:56.860 INFO:tasks.workunit.client.1.smithi073.stdout:5/146: dwrite dc/f14 [0,4194304] 0 2024-08-31T05:20:56.861 INFO:tasks.workunit.client.1.smithi073.stdout:5/147: chown f2 2476425 1 2024-08-31T05:20:56.861 INFO:tasks.workunit.client.1.smithi073.stdout:0/185: rename d0/d1 to d0/d28/d2b/d3c 0 2024-08-31T05:20:56.862 INFO:tasks.workunit.client.1.smithi073.stdout:5/148: fdatasync dc/d16/d1a/f33 0 2024-08-31T05:20:56.865 INFO:tasks.workunit.client.1.smithi073.stdout:1/130: mkdir d5/d26 0 2024-08-31T05:20:56.866 INFO:tasks.workunit.client.1.smithi073.stdout:0/186: dwrite d0/f11 [0,4194304] 0 2024-08-31T05:20:56.867 INFO:tasks.workunit.client.1.smithi073.stdout:4/180: creat d7/df/d13/d2e/f36 x:0 0 0 2024-08-31T05:20:56.868 INFO:tasks.workunit.client.1.smithi073.stdout:4/181: readlink d7/df/d13/l1d 0 2024-08-31T05:20:56.869 INFO:tasks.workunit.client.1.smithi073.stdout:9/172: creat dc/d37/f3d x:0 0 0 2024-08-31T05:20:56.871 INFO:tasks.workunit.client.1.smithi073.stdout:0/187: dread d0/f1e [0,4194304] 0 2024-08-31T05:20:56.871 INFO:tasks.workunit.client.1.smithi073.stdout:8/210: creat d0/db/d1c/d23/f41 x:0 0 0 2024-08-31T05:20:56.872 INFO:tasks.workunit.client.1.smithi073.stdout:6/126: truncate fd 4296158 0 2024-08-31T05:20:56.874 INFO:tasks.workunit.client.1.smithi073.stdout:6/127: write d15/f19 [791479,103233] 0 2024-08-31T05:20:56.874 INFO:tasks.workunit.client.1.smithi073.stdout:3/195: stat da/d1b/l2b 0 2024-08-31T05:20:56.879 INFO:tasks.workunit.client.1.smithi073.stdout:0/188: dwrite d0/d28/d2b/d3c/f13 [0,4194304] 0 2024-08-31T05:20:56.881 INFO:tasks.workunit.client.1.smithi073.stdout:7/143: unlink d1/ce 0 2024-08-31T05:20:56.881 INFO:tasks.workunit.client.1.smithi073.stdout:6/128: dread f13 [0,4194304] 0 2024-08-31T05:20:56.884 INFO:tasks.workunit.client.1.smithi073.stdout:5/149: unlink dc/d16/d1a/l1e 0 2024-08-31T05:20:56.886 INFO:tasks.workunit.client.1.smithi073.stdout:0/189: dread d0/d28/f30 [0,4194304] 0 2024-08-31T05:20:56.886 INFO:tasks.workunit.client.1.smithi073.stdout:6/129: dread f9 [0,4194304] 0 2024-08-31T05:20:56.890 INFO:tasks.workunit.client.1.smithi073.stdout:4/182: rename d7/l9 to d7/df/l37 0 2024-08-31T05:20:56.893 INFO:tasks.workunit.client.1.smithi073.stdout:8/211: rmdir d0/db 39 2024-08-31T05:20:56.898 INFO:tasks.workunit.client.1.smithi073.stdout:9/173: dwrite dc/d10/d34/f39 [0,4194304] 0 2024-08-31T05:20:56.900 INFO:tasks.workunit.client.1.smithi073.stdout:2/196: mkdir d2/d9/d3c 0 2024-08-31T05:20:56.906 INFO:tasks.workunit.client.1.smithi073.stdout:0/190: dread d0/f4 [0,4194304] 0 2024-08-31T05:20:56.908 INFO:tasks.workunit.client.1.smithi073.stdout:2/197: dwrite d2/d9/df/f30 [0,4194304] 0 2024-08-31T05:20:56.909 INFO:tasks.workunit.client.1.smithi073.stdout:5/150: creat dc/d16/d26/f34 x:0 0 0 2024-08-31T05:20:56.909 INFO:tasks.workunit.client.1.smithi073.stdout:0/191: chown d0/d28/d2b/d3c/c14 15 1 2024-08-31T05:20:56.913 INFO:tasks.workunit.client.1.smithi073.stdout:5/151: dread dc/f14 [0,4194304] 0 2024-08-31T05:20:56.913 INFO:tasks.workunit.client.1.smithi073.stdout:0/192: dread d0/d15/f37 [0,4194304] 0 2024-08-31T05:20:56.916 INFO:tasks.workunit.client.1.smithi073.stdout:4/183: creat d7/db/d11/f38 x:0 0 0 2024-08-31T05:20:56.918 INFO:tasks.workunit.client.1.smithi073.stdout:8/212: rmdir d0 39 2024-08-31T05:20:56.921 INFO:tasks.workunit.client.1.smithi073.stdout:0/193: dwrite d0/f21 [0,4194304] 0 2024-08-31T05:20:56.922 INFO:tasks.workunit.client.1.smithi073.stdout:0/194: dread - d0/f2f zero size 2024-08-31T05:20:56.926 INFO:tasks.workunit.client.1.smithi073.stdout:4/184: dread d7/df/f1e [0,4194304] 0 2024-08-31T05:20:56.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:56 smithi073 ceph-mon[24726]: pgmap v19: 65 pgs: 65 active+clean; 330 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 24 MiB/s wr, 417 op/s 2024-08-31T05:20:56.974 INFO:tasks.workunit.client.1.smithi073.stdout:0/195: mkdir d0/d15/d2c/d2e/d3d 0 2024-08-31T05:20:56.978 INFO:tasks.workunit.client.1.smithi073.stdout:4/185: rename d7/db/ld to d7/db/d11/d2c/l39 0 2024-08-31T05:20:56.978 INFO:tasks.workunit.client.1.smithi073.stdout:4/186: chown d7/df/d13/l26 4 1 2024-08-31T05:20:56.978 INFO:tasks.workunit.client.1.smithi073.stdout:4/187: readlink l6 0 2024-08-31T05:20:56.982 INFO:tasks.workunit.client.1.smithi073.stdout:3/196: write da/d1b/f20 [719968,76092] 0 2024-08-31T05:20:56.987 INFO:tasks.workunit.client.1.smithi073.stdout:0/196: creat d0/d28/d2b/f3e x:0 0 0 2024-08-31T05:20:56.988 INFO:tasks.workunit.client.1.smithi073.stdout:0/197: fsync d0/d28/d2b/d3c/f13 0 2024-08-31T05:20:56.989 INFO:tasks.workunit.client.1.smithi073.stdout:5/152: rmdir dc/d16/d26/d32 0 2024-08-31T05:20:56.990 INFO:tasks.workunit.client.1.smithi073.stdout:5/153: chown dc/l19 37819797 1 2024-08-31T05:20:56.993 INFO:tasks.workunit.client.1.smithi073.stdout:9/174: rmdir dc/de/d11/d36 0 2024-08-31T05:20:56.995 INFO:tasks.workunit.client.1.smithi073.stdout:4/188: link d7/df/f25 d7/df/d13/d2e/f3a 0 2024-08-31T05:20:56.997 INFO:tasks.workunit.client.1.smithi073.stdout:0/198: creat d0/d15/d2c/d2e/f3f x:0 0 0 2024-08-31T05:20:56.998 INFO:tasks.workunit.client.1.smithi073.stdout:5/154: rename dc/l19 to dc/d16/d1a/l35 0 2024-08-31T05:20:56.999 INFO:tasks.workunit.client.1.smithi073.stdout:5/155: chown l4 0 1 2024-08-31T05:20:57.001 INFO:tasks.workunit.client.1.smithi073.stdout:0/199: dread d0/d28/d2b/d3c/f1f [0,4194304] 0 2024-08-31T05:20:57.001 INFO:tasks.workunit.client.1.smithi073.stdout:0/200: chown d0/f27 23450259 1 2024-08-31T05:20:57.001 INFO:tasks.workunit.client.1.smithi073.stdout:8/213: creat d0/db/d1c/d34/d38/f42 x:0 0 0 2024-08-31T05:20:57.002 INFO:tasks.workunit.client.1.smithi073.stdout:8/214: fsync d0/f4 0 2024-08-31T05:20:57.003 INFO:tasks.workunit.client.1.smithi073.stdout:9/175: dread - dc/f30 zero size 2024-08-31T05:20:57.003 INFO:tasks.workunit.client.1.smithi073.stdout:0/201: dread d0/d28/d2b/d3c/f1f [0,4194304] 0 2024-08-31T05:20:57.004 INFO:tasks.workunit.client.1.smithi073.stdout:0/202: stat d0/d15/d2c/d2e/f38 0 2024-08-31T05:20:57.005 INFO:tasks.workunit.client.1.smithi073.stdout:5/156: symlink dc/l36 0 2024-08-31T05:20:57.006 INFO:tasks.workunit.client.1.smithi073.stdout:1/131: sync 2024-08-31T05:20:57.006 INFO:tasks.workunit.client.1.smithi073.stdout:1/132: readlink l3 0 2024-08-31T05:20:57.009 INFO:tasks.workunit.client.1.smithi073.stdout:9/176: creat dc/d10/f3e x:0 0 0 2024-08-31T05:20:57.011 INFO:tasks.workunit.client.1.smithi073.stdout:4/189: symlink d7/df/d1b/d34/l3b 0 2024-08-31T05:20:57.011 INFO:tasks.workunit.client.1.smithi073.stdout:0/203: dwrite d0/d15/d2c/d2e/f3f [0,4194304] 0 2024-08-31T05:20:57.013 INFO:tasks.workunit.client.1.smithi073.stdout:8/215: rename d0/db/d1c/d2a/f3f to d0/db/d1c/d34/d38/f43 0 2024-08-31T05:20:57.016 INFO:tasks.workunit.client.1.smithi073.stdout:3/197: link da/lc da/d1b/d2c/l3f 0 2024-08-31T05:20:57.018 INFO:tasks.workunit.client.1.smithi073.stdout:1/133: rmdir d5/da 39 2024-08-31T05:20:57.018 INFO:tasks.workunit.client.1.smithi073.stdout:8/216: dwrite d0/db/f2b [0,4194304] 0 2024-08-31T05:20:57.022 INFO:tasks.workunit.client.1.smithi073.stdout:9/177: unlink dc/d37/c3a 0 2024-08-31T05:20:57.023 INFO:tasks.workunit.client.1.smithi073.stdout:4/190: symlink d7/df/l3c 0 2024-08-31T05:20:57.024 INFO:tasks.workunit.client.1.smithi073.stdout:0/204: mkdir d0/d15/d2c/d40 0 2024-08-31T05:20:57.025 INFO:tasks.workunit.client.1.smithi073.stdout:4/191: write d7/db/f19 [1428756,111826] 0 2024-08-31T05:20:57.030 INFO:tasks.workunit.client.1.smithi073.stdout:3/198: write da/d18/f21 [1029648,99587] 0 2024-08-31T05:20:57.030 INFO:tasks.workunit.client.1.smithi073.stdout:3/199: chown da/l16 915 1 2024-08-31T05:20:57.032 INFO:tasks.workunit.client.1.smithi073.stdout:1/134: mkdir d5/d10/d1c/d27 0 2024-08-31T05:20:57.033 INFO:tasks.workunit.client.1.smithi073.stdout:8/217: mkdir d0/db/d44 0 2024-08-31T05:20:57.033 INFO:tasks.workunit.client.1.smithi073.stdout:8/218: chown d0 15203 1 2024-08-31T05:20:57.038 INFO:tasks.workunit.client.1.smithi073.stdout:0/205: mkdir d0/d15/d2c/d41 0 2024-08-31T05:20:57.040 INFO:tasks.workunit.client.1.smithi073.stdout:4/192: creat d7/db/d11/f3d x:0 0 0 2024-08-31T05:20:57.041 INFO:tasks.workunit.client.1.smithi073.stdout:4/193: write d7/db/f2a [3850317,100324] 0 2024-08-31T05:20:57.041 INFO:tasks.workunit.client.1.smithi073.stdout:5/157: link dc/d16/d1a/c11 dc/d16/c37 0 2024-08-31T05:20:57.045 INFO:tasks.workunit.client.1.smithi073.stdout:1/135: creat d5/d10/f28 x:0 0 0 2024-08-31T05:20:57.047 INFO:tasks.workunit.client.1.smithi073.stdout:4/194: dwrite d7/db/d11/f3d [0,4194304] 0 2024-08-31T05:20:57.051 INFO:tasks.workunit.client.1.smithi073.stdout:6/130: sync 2024-08-31T05:20:57.051 INFO:tasks.workunit.client.1.smithi073.stdout:2/198: sync 2024-08-31T05:20:57.052 INFO:tasks.workunit.client.1.smithi073.stdout:6/131: chown f14 37896 1 2024-08-31T05:20:57.052 INFO:tasks.workunit.client.1.smithi073.stdout:7/144: sync 2024-08-31T05:20:57.052 INFO:tasks.workunit.client.1.smithi073.stdout:5/158: symlink dc/d16/d1a/l38 0 2024-08-31T05:20:57.052 INFO:tasks.workunit.client.1.smithi073.stdout:3/200: mkdir da/d1b/d40 0 2024-08-31T05:20:57.053 INFO:tasks.workunit.client.1.smithi073.stdout:1/136: unlink d5/d17/f1a 0 2024-08-31T05:20:57.054 INFO:tasks.workunit.client.1.smithi073.stdout:3/201: stat da/c11 0 2024-08-31T05:20:57.054 INFO:tasks.workunit.client.1.smithi073.stdout:3/202: chown da 111022 1 2024-08-31T05:20:57.055 INFO:tasks.workunit.client.1.smithi073.stdout:3/203: chown c3 1579665755 1 2024-08-31T05:20:57.055 INFO:tasks.workunit.client.1.smithi073.stdout:4/195: creat d7/f3e x:0 0 0 2024-08-31T05:20:57.057 INFO:tasks.workunit.client.1.smithi073.stdout:3/204: chown da/d18/l35 304 1 2024-08-31T05:20:57.057 INFO:tasks.workunit.client.1.smithi073.stdout:2/199: chown d2/d25/c3a 550 1 2024-08-31T05:20:57.057 INFO:tasks.workunit.client.1.smithi073.stdout:3/205: readlink da/d1b/l2b 0 2024-08-31T05:20:57.057 INFO:tasks.workunit.client.1.smithi073.stdout:7/145: dread d1/d11/d14/f1b [0,4194304] 0 2024-08-31T05:20:57.058 INFO:tasks.workunit.client.1.smithi073.stdout:6/132: creat d15/f29 x:0 0 0 2024-08-31T05:20:57.058 INFO:tasks.workunit.client.1.smithi073.stdout:2/200: write d2/d9/f2a [203336,56784] 0 2024-08-31T05:20:57.059 INFO:tasks.workunit.client.1.smithi073.stdout:2/201: chown d2/d9/d3c 1883854 1 2024-08-31T05:20:57.060 INFO:tasks.workunit.client.1.smithi073.stdout:5/159: rename f2 to dc/f39 0 2024-08-31T05:20:57.061 INFO:tasks.workunit.client.1.smithi073.stdout:5/160: write dc/f17 [723330,97388] 0 2024-08-31T05:20:57.062 INFO:tasks.workunit.client.1.smithi073.stdout:8/219: creat d0/f45 x:0 0 0 2024-08-31T05:20:57.062 INFO:tasks.workunit.client.1.smithi073.stdout:8/220: readlink d0/db/d1c/l31 0 2024-08-31T05:20:57.068 INFO:tasks.workunit.client.1.smithi073.stdout:4/196: unlink d7/df/d13/l26 0 2024-08-31T05:20:57.068 INFO:tasks.workunit.client.1.smithi073.stdout:8/221: dwrite d0/f4 [4194304,4194304] 0 2024-08-31T05:20:57.070 INFO:tasks.workunit.client.1.smithi073.stdout:3/206: mknod da/d1b/d2c/c41 0 2024-08-31T05:20:57.072 INFO:tasks.workunit.client.1.smithi073.stdout:3/207: dread f9 [0,4194304] 0 2024-08-31T05:20:57.072 INFO:tasks.workunit.client.1.smithi073.stdout:7/146: symlink d1/d11/l25 0 2024-08-31T05:20:57.074 INFO:tasks.workunit.client.1.smithi073.stdout:7/147: fdatasync d1/d17/f1f 0 2024-08-31T05:20:57.074 INFO:tasks.workunit.client.1.smithi073.stdout:3/208: chown f9 117 1 2024-08-31T05:20:57.074 INFO:tasks.workunit.client.1.smithi073.stdout:3/209: chown da 12787 1 2024-08-31T05:20:57.080 INFO:tasks.workunit.client.1.smithi073.stdout:5/161: symlink dc/d16/d1a/l3a 0 2024-08-31T05:20:57.088 INFO:tasks.workunit.client.1.smithi073.stdout:8/222: dread d0/f1a [0,4194304] 0 2024-08-31T05:20:57.089 INFO:tasks.workunit.client.1.smithi073.stdout:6/133: link f6 d15/f2a 0 2024-08-31T05:20:57.092 INFO:tasks.workunit.client.1.smithi073.stdout:8/223: dread d0/db/d1c/d2a/f30 [0,4194304] 0 2024-08-31T05:20:57.095 INFO:tasks.workunit.client.1.smithi073.stdout:9/178: write dc/d27/f2e [1547976,113205] 0 2024-08-31T05:20:57.096 INFO:tasks.workunit.client.1.smithi073.stdout:5/162: mkdir dc/d16/d3b 0 2024-08-31T05:20:57.097 INFO:tasks.workunit.client.1.smithi073.stdout:5/163: stat dc/d16/d26/l27 0 2024-08-31T05:20:57.099 INFO:tasks.workunit.client.1.smithi073.stdout:0/206: link d0/d28/c2a d0/c42 0 2024-08-31T05:20:57.105 INFO:tasks.workunit.client.1.smithi073.stdout:6/134: mkdir d15/d1a/d2b 0 2024-08-31T05:20:57.108 INFO:tasks.workunit.client.1.smithi073.stdout:3/210: rename da/d1b/f2d to da/d3c/f42 0 2024-08-31T05:20:57.119 INFO:tasks.workunit.client.1.smithi073.stdout:1/137: link d5/da/c11 d5/d10/d1c/d27/c29 0 2024-08-31T05:20:57.123 INFO:tasks.workunit.client.1.smithi073.stdout:0/207: dread d0/f4 [0,4194304] 0 2024-08-31T05:20:57.124 INFO:tasks.workunit.client.1.smithi073.stdout:6/135: rmdir d15 39 2024-08-31T05:20:57.130 INFO:tasks.workunit.client.1.smithi073.stdout:8/224: mknod d0/c46 0 2024-08-31T05:20:57.131 INFO:tasks.workunit.client.1.smithi073.stdout:8/225: dread d0/db/f22 [0,4194304] 0 2024-08-31T05:20:57.131 INFO:tasks.workunit.client.1.smithi073.stdout:2/202: getdents d2/d25 0 2024-08-31T05:20:57.132 INFO:tasks.workunit.client.1.smithi073.stdout:2/203: dread - d2/d9/df/f2e zero size 2024-08-31T05:20:57.133 INFO:tasks.workunit.client.1.smithi073.stdout:9/179: symlink dc/l3f 0 2024-08-31T05:20:57.135 INFO:tasks.workunit.client.1.smithi073.stdout:5/164: mkdir dc/d16/d3b/d3c 0 2024-08-31T05:20:57.137 INFO:tasks.workunit.client.1.smithi073.stdout:1/138: mkdir d5/d17/d2a 0 2024-08-31T05:20:57.138 INFO:tasks.workunit.client.1.smithi073.stdout:9/180: dwrite dc/d10/f29 [0,4194304] 0 2024-08-31T05:20:57.139 INFO:tasks.workunit.client.1.smithi073.stdout:4/197: getdents d7/db/d11 0 2024-08-31T05:20:57.139 INFO:tasks.workunit.client.1.smithi073.stdout:1/139: read f0 [36370,68057] 0 2024-08-31T05:20:57.139 INFO:tasks.workunit.client.1.smithi073.stdout:1/140: readlink d5/d10/d1c/l1d 0 2024-08-31T05:20:57.140 INFO:tasks.workunit.client.1.smithi073.stdout:6/136: fdatasync fe 0 2024-08-31T05:20:57.143 INFO:tasks.workunit.client.1.smithi073.stdout:7/148: truncate d1/da/f12 264511 0 2024-08-31T05:20:57.144 INFO:tasks.workunit.client.1.smithi073.stdout:8/226: mknod d0/db/d1c/d23/c47 0 2024-08-31T05:20:57.152 INFO:tasks.workunit.client.1.smithi073.stdout:4/198: chown d7/fc 59458298 1 2024-08-31T05:20:57.153 INFO:tasks.workunit.client.1.smithi073.stdout:1/141: rmdir d5/d10 39 2024-08-31T05:20:57.157 INFO:tasks.workunit.client.1.smithi073.stdout:4/199: truncate d7/df/d13/d2e/f36 722667 0 2024-08-31T05:20:57.158 INFO:tasks.workunit.client.1.smithi073.stdout:7/149: creat d1/da/f26 x:0 0 0 2024-08-31T05:20:57.159 INFO:tasks.workunit.client.1.smithi073.stdout:9/181: dwrite dc/f3c [0,4194304] 0 2024-08-31T05:20:57.161 INFO:tasks.workunit.client.1.smithi073.stdout:3/211: dwrite da/f27 [0,4194304] 0 2024-08-31T05:20:57.162 INFO:tasks.workunit.client.1.smithi073.stdout:2/204: truncate d2/d9/df/f1f 1110747 0 2024-08-31T05:20:57.162 INFO:tasks.workunit.client.1.smithi073.stdout:9/182: chown dc/d10/f29 63118723 1 2024-08-31T05:20:57.169 INFO:tasks.workunit.client.1.smithi073.stdout:4/200: dread d7/db/d11/f3d [0,4194304] 0 2024-08-31T05:20:57.171 INFO:tasks.workunit.client.1.smithi073.stdout:1/142: symlink d5/da/d13/l2b 0 2024-08-31T05:20:57.172 INFO:tasks.workunit.client.1.smithi073.stdout:1/143: write d5/da/f18 [1268702,108263] 0 2024-08-31T05:20:57.176 INFO:tasks.workunit.client.1.smithi073.stdout:6/137: rename d15/f2a to d15/d17/d26/f2c 0 2024-08-31T05:20:57.178 INFO:tasks.workunit.client.1.smithi073.stdout:8/227: link d0/db/d1c/d34/d38/f42 d0/db/d1c/d24/f48 0 2024-08-31T05:20:57.179 INFO:tasks.workunit.client.1.smithi073.stdout:8/228: readlink d0/db/lf 0 2024-08-31T05:20:57.185 INFO:tasks.workunit.client.1.smithi073.stdout:3/212: write da/f29 [789371,103010] 0 2024-08-31T05:20:57.186 INFO:tasks.workunit.client.1.smithi073.stdout:8/229: dwrite d0/db/d1c/d23/f37 [0,4194304] 0 2024-08-31T05:20:57.188 INFO:tasks.workunit.client.1.smithi073.stdout:8/230: dread - d0/f45 zero size 2024-08-31T05:20:57.188 INFO:tasks.workunit.client.1.smithi073.stdout:3/213: write da/f2f [776397,9094] 0 2024-08-31T05:20:57.189 INFO:tasks.workunit.client.1.smithi073.stdout:5/165: write dc/f12 [891787,15221] 0 2024-08-31T05:20:57.190 INFO:tasks.workunit.client.1.smithi073.stdout:3/214: write da/d18/f1f [6475944,50174] 0 2024-08-31T05:20:57.192 INFO:tasks.workunit.client.1.smithi073.stdout:3/215: write da/d18/f1f [3451258,10667] 0 2024-08-31T05:20:57.196 INFO:tasks.workunit.client.1.smithi073.stdout:7/150: chown d1/da/f12 0 1 2024-08-31T05:20:57.199 INFO:tasks.workunit.client.1.smithi073.stdout:2/205: symlink d2/d9/d3c/l3d 0 2024-08-31T05:20:57.201 INFO:tasks.workunit.client.1.smithi073.stdout:0/208: sync 2024-08-31T05:20:57.203 INFO:tasks.workunit.client.1.smithi073.stdout:1/144: rename d5/da/c11 to d5/d26/c2c 0 2024-08-31T05:20:57.206 INFO:tasks.workunit.client.1.smithi073.stdout:0/209: readlink d0/d28/d2b/d3c/ld 0 2024-08-31T05:20:57.206 INFO:tasks.workunit.client.1.smithi073.stdout:4/201: dread d7/df/d13/f16 [0,4194304] 0 2024-08-31T05:20:57.207 INFO:tasks.workunit.client.1.smithi073.stdout:5/166: dwrite dc/d16/f2b [0,4194304] 0 2024-08-31T05:20:57.209 INFO:tasks.workunit.client.1.smithi073.stdout:0/210: dread - d0/f2f zero size 2024-08-31T05:20:57.209 INFO:tasks.workunit.client.1.smithi073.stdout:2/206: chown d2/f19 28137674 1 2024-08-31T05:20:57.210 INFO:tasks.workunit.client.1.smithi073.stdout:3/216: dwrite da/d18/f21 [0,4194304] 0 2024-08-31T05:20:57.211 INFO:tasks.workunit.client.1.smithi073.stdout:6/138: dwrite d15/d1a/d1e/f24 [0,4194304] 0 2024-08-31T05:20:57.212 INFO:tasks.workunit.client.1.smithi073.stdout:8/231: rename d0/db/d1c/d24/c2e to d0/db/d1c/d34/d38/c49 0 2024-08-31T05:20:57.213 INFO:tasks.workunit.client.1.smithi073.stdout:4/202: dread d7/d1a/f29 [0,4194304] 0 2024-08-31T05:20:57.214 INFO:tasks.workunit.client.1.smithi073.stdout:9/183: truncate f7 2321645 0 2024-08-31T05:20:57.215 INFO:tasks.workunit.client.1.smithi073.stdout:3/217: stat da/d1b/d40 0 2024-08-31T05:20:57.215 INFO:tasks.workunit.client.1.smithi073.stdout:0/211: write d0/d28/d2b/d3c/f1f [580805,24966] 0 2024-08-31T05:20:57.216 INFO:tasks.workunit.client.1.smithi073.stdout:6/139: truncate d15/f16 813227 0 2024-08-31T05:20:57.216 INFO:tasks.workunit.client.1.smithi073.stdout:1/145: unlink d5/da/lb 0 2024-08-31T05:20:57.217 INFO:tasks.workunit.client.1.smithi073.stdout:5/167: write dc/f39 [2336282,79139] 0 2024-08-31T05:20:57.218 INFO:tasks.workunit.client.1.smithi073.stdout:6/140: fsync d15/f19 0 2024-08-31T05:20:57.218 INFO:tasks.workunit.client.1.smithi073.stdout:2/207: unlink d2/fa 0 2024-08-31T05:20:57.218 INFO:tasks.workunit.client.1.smithi073.stdout:1/146: fsync d5/f9 0 2024-08-31T05:20:57.221 INFO:tasks.workunit.client.1.smithi073.stdout:5/168: write dc/f17 [480440,4066] 0 2024-08-31T05:20:57.223 INFO:tasks.workunit.client.1.smithi073.stdout:9/184: mknod dc/d10/d34/c40 0 2024-08-31T05:20:57.224 INFO:tasks.workunit.client.1.smithi073.stdout:0/212: fdatasync d0/f11 0 2024-08-31T05:20:57.224 INFO:tasks.workunit.client.1.smithi073.stdout:7/151: dwrite d1/da/d15/f21 [0,4194304] 0 2024-08-31T05:20:57.225 INFO:tasks.workunit.client.1.smithi073.stdout:5/169: fsync dc/d16/d26/f34 0 2024-08-31T05:20:57.227 INFO:tasks.workunit.client.1.smithi073.stdout:5/170: dread - dc/d16/d26/f34 zero size 2024-08-31T05:20:57.231 INFO:tasks.workunit.client.1.smithi073.stdout:6/141: truncate f14 1142494 0 2024-08-31T05:20:57.235 INFO:tasks.workunit.client.1.smithi073.stdout:7/152: creat d1/d17/d22/f27 x:0 0 0 2024-08-31T05:20:57.237 INFO:tasks.workunit.client.1.smithi073.stdout:5/171: mkdir dc/d3d 0 2024-08-31T05:20:57.238 INFO:tasks.workunit.client.1.smithi073.stdout:3/218: creat da/f43 x:0 0 0 2024-08-31T05:20:57.242 INFO:tasks.workunit.client.1.smithi073.stdout:0/213: creat d0/d15/d2c/d2e/d3d/f43 x:0 0 0 2024-08-31T05:20:57.243 INFO:tasks.workunit.client.1.smithi073.stdout:8/232: dwrite d0/db/d1c/d24/f32 [0,4194304] 0 2024-08-31T05:20:57.243 INFO:tasks.workunit.client.1.smithi073.stdout:1/147: link d5/d10/f16 d5/da/f2d 0 2024-08-31T05:20:57.244 INFO:tasks.workunit.client.1.smithi073.stdout:2/208: dwrite d2/d9/df/f3b [0,4194304] 0 2024-08-31T05:20:57.244 INFO:tasks.workunit.client.1.smithi073.stdout:5/172: mkdir dc/d3d/d3e 0 2024-08-31T05:20:57.251 INFO:tasks.workunit.client.1.smithi073.stdout:1/148: readlink d5/d10/d1c/l1d 0 2024-08-31T05:20:57.252 INFO:tasks.workunit.client.1.smithi073.stdout:9/185: truncate dc/d10/f29 2311216 0 2024-08-31T05:20:57.253 INFO:tasks.workunit.client.1.smithi073.stdout:0/214: write d0/d28/d2b/f3e [198454,117628] 0 2024-08-31T05:20:57.254 INFO:tasks.workunit.client.1.smithi073.stdout:2/209: chown d2/d9/d27/l2d 9 1 2024-08-31T05:20:57.256 INFO:tasks.workunit.client.1.smithi073.stdout:1/149: truncate d5/f19 5339131 0 2024-08-31T05:20:57.258 INFO:tasks.workunit.client.1.smithi073.stdout:2/210: write d2/d9/df/f2e [765954,109091] 0 2024-08-31T05:20:57.259 INFO:tasks.workunit.client.1.smithi073.stdout:6/142: write fe [1174259,63209] 0 2024-08-31T05:20:57.263 INFO:tasks.workunit.client.1.smithi073.stdout:8/233: dwrite d0/f5 [0,4194304] 0 2024-08-31T05:20:57.269 INFO:tasks.workunit.client.1.smithi073.stdout:1/150: dwrite d5/d10/f28 [0,4194304] 0 2024-08-31T05:20:57.270 INFO:tasks.workunit.client.1.smithi073.stdout:1/151: chown d5/d10/d1c 1511 1 2024-08-31T05:20:57.281 INFO:tasks.workunit.client.1.smithi073.stdout:3/219: creat da/d1b/d40/f44 x:0 0 0 2024-08-31T05:20:57.281 INFO:tasks.workunit.client.1.smithi073.stdout:7/153: link d1/lb d1/d11/d14/l28 0 2024-08-31T05:20:57.282 INFO:tasks.workunit.client.1.smithi073.stdout:0/215: chown d0/c1c 2541 1 2024-08-31T05:20:57.283 INFO:tasks.workunit.client.1.smithi073.stdout:9/186: rename dc/d10/d34 to dc/de/d11/d41 0 2024-08-31T05:20:57.284 INFO:tasks.workunit.client.1.smithi073.stdout:8/234: mknod d0/db/d1c/d24/c4a 0 2024-08-31T05:20:57.284 INFO:tasks.workunit.client.1.smithi073.stdout:2/211: dread d2/d9/df/f1f [0,4194304] 0 2024-08-31T05:20:57.286 INFO:tasks.workunit.client.1.smithi073.stdout:7/154: creat d1/d11/d14/f29 x:0 0 0 2024-08-31T05:20:57.289 INFO:tasks.workunit.client.1.smithi073.stdout:6/143: creat d15/d1a/d2b/f2d x:0 0 0 2024-08-31T05:20:57.289 INFO:tasks.workunit.client.1.smithi073.stdout:3/220: mkdir da/d1b/d45 0 2024-08-31T05:20:57.289 INFO:tasks.workunit.client.1.smithi073.stdout:8/235: unlink d0/db/d1c/d23/f37 0 2024-08-31T05:20:57.290 INFO:tasks.workunit.client.1.smithi073.stdout:5/173: dread dc/f12 [0,4194304] 0 2024-08-31T05:20:57.290 INFO:tasks.workunit.client.1.smithi073.stdout:3/221: readlink da/d18/l1e 0 2024-08-31T05:20:57.291 INFO:tasks.workunit.client.1.smithi073.stdout:7/155: mknod d1/d11/c2a 0 2024-08-31T05:20:57.292 INFO:tasks.workunit.client.1.smithi073.stdout:3/222: chown da/f15 72 1 2024-08-31T05:20:57.294 INFO:tasks.workunit.client.1.smithi073.stdout:7/156: chown d1/d17/c1e 747530 1 2024-08-31T05:20:57.295 INFO:tasks.workunit.client.1.smithi073.stdout:2/212: dread d2/d9/df/f30 [0,4194304] 0 2024-08-31T05:20:57.295 INFO:tasks.workunit.client.1.smithi073.stdout:5/174: truncate dc/d16/d1a/f28 1602953 0 2024-08-31T05:20:57.297 INFO:tasks.workunit.client.1.smithi073.stdout:8/236: write d0/db/d1c/d23/f26 [3285512,5431] 0 2024-08-31T05:20:57.299 INFO:tasks.workunit.client.1.smithi073.stdout:3/223: symlink da/d1b/d40/l46 0 2024-08-31T05:20:57.302 INFO:tasks.workunit.client.1.smithi073.stdout:6/144: dwrite d15/d1a/d1e/f24 [4194304,4194304] 0 2024-08-31T05:20:57.309 INFO:tasks.workunit.client.1.smithi073.stdout:9/187: dread f8 [0,4194304] 0 2024-08-31T05:20:57.309 INFO:tasks.workunit.client.1.smithi073.stdout:8/237: creat d0/db/d1c/d34/d38/f4b x:0 0 0 2024-08-31T05:20:57.310 INFO:tasks.workunit.client.1.smithi073.stdout:2/213: dread d2/d9/df/f3b [0,4194304] 0 2024-08-31T05:20:57.311 INFO:tasks.workunit.client.1.smithi073.stdout:7/157: dread d1/d11/d14/f1b [0,4194304] 0 2024-08-31T05:20:57.311 INFO:tasks.workunit.client.1.smithi073.stdout:5/175: dwrite dc/d16/d1a/f33 [0,4194304] 0 2024-08-31T05:20:57.312 INFO:tasks.workunit.client.1.smithi073.stdout:3/224: symlink da/d1b/d45/l47 0 2024-08-31T05:20:57.312 INFO:tasks.workunit.client.1.smithi073.stdout:8/238: chown d0/db/d1c/d24 14 1 2024-08-31T05:20:57.314 INFO:tasks.workunit.client.1.smithi073.stdout:2/214: stat d2/d9/df/l18 0 2024-08-31T05:20:57.318 INFO:tasks.workunit.client.1.smithi073.stdout:5/176: fsync fb 0 2024-08-31T05:20:57.319 INFO:tasks.workunit.client.1.smithi073.stdout:8/239: write d0/f3c [781889,45694] 0 2024-08-31T05:20:57.320 INFO:tasks.workunit.client.1.smithi073.stdout:7/158: creat d1/d11/d14/f2b x:0 0 0 2024-08-31T05:20:57.320 INFO:tasks.workunit.client.1.smithi073.stdout:6/145: fdatasync d15/d1a/d1e/f24 0 2024-08-31T05:20:57.321 INFO:tasks.workunit.client.1.smithi073.stdout:3/225: creat da/d1b/d2c/f48 x:0 0 0 2024-08-31T05:20:57.322 INFO:tasks.workunit.client.1.smithi073.stdout:9/188: truncate dc/f28 340061 0 2024-08-31T05:20:57.323 INFO:tasks.workunit.client.1.smithi073.stdout:0/216: dwrite d0/d28/f30 [0,4194304] 0 2024-08-31T05:20:57.326 INFO:tasks.workunit.client.1.smithi073.stdout:3/226: rename da/d1b/d45 to da/d1b/d45/d49 22 2024-08-31T05:20:57.326 INFO:tasks.workunit.client.1.smithi073.stdout:6/146: chown d15/f19 114781853 1 2024-08-31T05:20:57.327 INFO:tasks.workunit.client.1.smithi073.stdout:5/177: mkdir dc/d16/d3b/d3f 0 2024-08-31T05:20:57.330 INFO:tasks.workunit.client.1.smithi073.stdout:3/227: write da/d18/f38 [812104,85225] 0 2024-08-31T05:20:57.333 INFO:tasks.workunit.client.1.smithi073.stdout:0/217: rename d0/d28/d2b/d3c/cb to d0/d15/d2c/d41/c44 0 2024-08-31T05:20:57.333 INFO:tasks.workunit.client.1.smithi073.stdout:9/189: dread dc/d37/f35 [0,4194304] 0 2024-08-31T05:20:57.334 INFO:tasks.workunit.client.1.smithi073.stdout:5/178: mknod dc/d16/d3b/c40 0 2024-08-31T05:20:57.335 INFO:tasks.workunit.client.1.smithi073.stdout:2/215: dwrite f1 [0,4194304] 0 2024-08-31T05:20:57.338 INFO:tasks.workunit.client.1.smithi073.stdout:6/147: rename d15/d17/c1d to d15/d17/d26/c2e 0 2024-08-31T05:20:57.343 INFO:tasks.workunit.client.1.smithi073.stdout:2/216: creat d2/d9/df/f3e x:0 0 0 2024-08-31T05:20:57.345 INFO:tasks.workunit.client.1.smithi073.stdout:5/179: creat dc/d16/d26/f41 x:0 0 0 2024-08-31T05:20:57.349 INFO:tasks.workunit.client.1.smithi073.stdout:3/228: dwrite da/f14 [0,4194304] 0 2024-08-31T05:20:57.349 INFO:tasks.workunit.client.1.smithi073.stdout:0/218: mkdir d0/d45 0 2024-08-31T05:20:57.350 INFO:tasks.workunit.client.1.smithi073.stdout:2/217: rmdir d2 39 2024-08-31T05:20:57.350 INFO:tasks.workunit.client.1.smithi073.stdout:4/203: sync 2024-08-31T05:20:57.351 INFO:tasks.workunit.client.1.smithi073.stdout:6/148: dread d15/f16 [0,4194304] 0 2024-08-31T05:20:57.352 INFO:tasks.workunit.client.1.smithi073.stdout:7/159: dread d1/d17/f1f [0,4194304] 0 2024-08-31T05:20:57.355 INFO:tasks.workunit.client.1.smithi073.stdout:9/190: dwrite dc/de/d11/d41/f39 [0,4194304] 0 2024-08-31T05:20:57.356 INFO:tasks.workunit.client.1.smithi073.stdout:4/204: dread - d7/df/f21 zero size 2024-08-31T05:20:57.356 INFO:tasks.workunit.client.1.smithi073.stdout:6/149: mkdir d15/d1a/d2b/d2f 0 2024-08-31T05:20:57.358 INFO:tasks.workunit.client.1.smithi073.stdout:4/205: readlink d7/df/d13/l1d 0 2024-08-31T05:20:57.358 INFO:tasks.workunit.client.1.smithi073.stdout:0/219: unlink d0/d28/c36 0 2024-08-31T05:20:57.359 INFO:tasks.workunit.client.1.smithi073.stdout:6/150: write d15/f19 [5120840,280] 0 2024-08-31T05:20:57.359 INFO:tasks.workunit.client.1.smithi073.stdout:8/240: dread d0/fc [4194304,4194304] 0 2024-08-31T05:20:57.360 INFO:tasks.workunit.client.1.smithi073.stdout:9/191: truncate dc/f30 515638 0 2024-08-31T05:20:57.361 INFO:tasks.workunit.client.1.smithi073.stdout:2/218: write d2/d9/f2a [399857,6599] 0 2024-08-31T05:20:57.364 INFO:tasks.workunit.client.1.smithi073.stdout:9/192: mkdir dc/d37/d42 0 2024-08-31T05:20:57.365 INFO:tasks.workunit.client.1.smithi073.stdout:3/229: rename c3 to da/c4a 0 2024-08-31T05:20:57.366 INFO:tasks.workunit.client.1.smithi073.stdout:6/151: dread f14 [0,4194304] 0 2024-08-31T05:20:57.366 INFO:tasks.workunit.client.1.smithi073.stdout:8/241: write d0/db/d1c/d34/d38/f4b [13705,12286] 0 2024-08-31T05:20:57.367 INFO:tasks.workunit.client.1.smithi073.stdout:0/220: creat d0/d15/d2c/d2e/f46 x:0 0 0 2024-08-31T05:20:57.368 INFO:tasks.workunit.client.1.smithi073.stdout:9/193: write dc/de/f1e [987568,55924] 0 2024-08-31T05:20:57.371 INFO:tasks.workunit.client.1.smithi073.stdout:3/230: write da/d1b/f3a [1880871,130838] 0 2024-08-31T05:20:57.371 INFO:tasks.workunit.client.1.smithi073.stdout:7/160: rename d1/l5 to d1/d17/l2c 0 2024-08-31T05:20:57.374 INFO:tasks.workunit.client.1.smithi073.stdout:5/180: dwrite dc/f14 [4194304,4194304] 0 2024-08-31T05:20:57.375 INFO:tasks.workunit.client.1.smithi073.stdout:9/194: unlink dc/de/d11/l13 0 2024-08-31T05:20:57.376 INFO:tasks.workunit.client.1.smithi073.stdout:6/152: creat d15/d1a/d2b/d2f/f30 x:0 0 0 2024-08-31T05:20:57.377 INFO:tasks.workunit.client.1.smithi073.stdout:9/195: chown dc/d37 296334 1 2024-08-31T05:20:57.377 INFO:tasks.workunit.client.1.smithi073.stdout:7/161: mknod d1/c2d 0 2024-08-31T05:20:57.380 INFO:tasks.workunit.client.1.smithi073.stdout:0/221: rename d0/d15/f16 to d0/d15/d2c/d40/f47 0 2024-08-31T05:20:57.383 INFO:tasks.workunit.client.1.smithi073.stdout:3/231: getdents da/d18 0 2024-08-31T05:20:57.383 INFO:tasks.workunit.client.1.smithi073.stdout:8/242: dwrite d0/f1a [0,4194304] 0 2024-08-31T05:20:57.384 INFO:tasks.workunit.client.1.smithi073.stdout:8/243: write d0/f1b [272946,38252] 0 2024-08-31T05:20:57.386 INFO:tasks.workunit.client.1.smithi073.stdout:6/153: creat d15/d17/d26/f31 x:0 0 0 2024-08-31T05:20:57.387 INFO:tasks.workunit.client.1.smithi073.stdout:7/162: dread d1/d11/d14/f1b [0,4194304] 0 2024-08-31T05:20:57.389 INFO:tasks.workunit.client.1.smithi073.stdout:2/219: link d2/l23 d2/l3f 0 2024-08-31T05:20:57.390 INFO:tasks.workunit.client.1.smithi073.stdout:5/181: mknod dc/d3d/d3e/c42 0 2024-08-31T05:20:57.391 INFO:tasks.workunit.client.1.smithi073.stdout:5/182: fdatasync dc/d16/d26/f25 0 2024-08-31T05:20:57.392 INFO:tasks.workunit.client.1.smithi073.stdout:3/232: mknod da/d1b/d40/c4b 0 2024-08-31T05:20:57.396 INFO:tasks.workunit.client.1.smithi073.stdout:7/163: creat d1/f2e x:0 0 0 2024-08-31T05:20:57.397 INFO:tasks.workunit.client.1.smithi073.stdout:2/220: creat d2/d9/d3c/f40 x:0 0 0 2024-08-31T05:20:57.397 INFO:tasks.workunit.client.1.smithi073.stdout:8/244: mknod d0/db/d44/c4c 0 2024-08-31T05:20:57.398 INFO:tasks.workunit.client.1.smithi073.stdout:8/245: dread - d0/f45 zero size 2024-08-31T05:20:57.398 INFO:tasks.workunit.client.1.smithi073.stdout:3/233: unlink da/f27 0 2024-08-31T05:20:57.399 INFO:tasks.workunit.client.1.smithi073.stdout:5/183: rename dc/f12 to dc/d16/d26/f43 0 2024-08-31T05:20:57.399 INFO:tasks.workunit.client.1.smithi073.stdout:3/234: chown da/f12 29 1 2024-08-31T05:20:57.400 INFO:tasks.workunit.client.1.smithi073.stdout:8/246: write d0/f27 [3607663,38119] 0 2024-08-31T05:20:57.400 INFO:tasks.workunit.client.1.smithi073.stdout:0/222: rmdir d0/d45 0 2024-08-31T05:20:57.401 INFO:tasks.workunit.client.1.smithi073.stdout:6/154: link d15/f19 d15/d1a/f32 0 2024-08-31T05:20:57.402 INFO:tasks.workunit.client.1.smithi073.stdout:6/155: dread - d15/f1f zero size 2024-08-31T05:20:57.404 INFO:tasks.workunit.client.1.smithi073.stdout:7/164: rename d1/d11/d14/c1d to d1/d11/c2f 0 2024-08-31T05:20:57.405 INFO:tasks.workunit.client.1.smithi073.stdout:5/184: mknod dc/d16/d1a/c44 0 2024-08-31T05:20:57.406 INFO:tasks.workunit.client.1.smithi073.stdout:9/196: link dc/d10/f29 dc/de/d11/f43 0 2024-08-31T05:20:57.407 INFO:tasks.workunit.client.1.smithi073.stdout:9/197: stat dc/d27/f2e 0 2024-08-31T05:20:57.409 INFO:tasks.workunit.client.1.smithi073.stdout:9/198: dread - dc/d10/f3e zero size 2024-08-31T05:20:57.410 INFO:tasks.workunit.client.1.smithi073.stdout:9/199: readlink dc/de/d11/l1b 0 2024-08-31T05:20:57.411 INFO:tasks.workunit.client.1.smithi073.stdout:9/200: stat dc/de/l2b 0 2024-08-31T05:20:57.412 INFO:tasks.workunit.client.1.smithi073.stdout:5/185: dwrite dc/d16/f2e [0,4194304] 0 2024-08-31T05:20:57.417 INFO:tasks.workunit.client.1.smithi073.stdout:5/186: dread dc/d16/f2e [0,4194304] 0 2024-08-31T05:20:57.417 INFO:tasks.workunit.client.1.smithi073.stdout:5/187: dread - dc/d16/f2a zero size 2024-08-31T05:20:57.420 INFO:tasks.workunit.client.1.smithi073.stdout:6/156: dread fd [0,4194304] 0 2024-08-31T05:20:57.421 INFO:tasks.workunit.client.1.smithi073.stdout:6/157: write d15/d1a/f20 [247962,38671] 0 2024-08-31T05:20:57.426 INFO:tasks.workunit.client.1.smithi073.stdout:6/158: dwrite fa [0,4194304] 0 2024-08-31T05:20:57.435 INFO:tasks.workunit.client.1.smithi073.stdout:1/152: sync 2024-08-31T05:20:57.441 INFO:tasks.workunit.client.1.smithi073.stdout:1/153: dwrite d5/fc [4194304,4194304] 0 2024-08-31T05:20:57.442 INFO:tasks.workunit.client.1.smithi073.stdout:1/154: truncate d5/da/f2d 1028962 0 2024-08-31T05:20:57.443 INFO:tasks.workunit.client.1.smithi073.stdout:5/188: dread dc/d16/d26/f23 [0,4194304] 0 2024-08-31T05:20:57.448 INFO:tasks.workunit.client.1.smithi073.stdout:7/165: stat d1/l1a 0 2024-08-31T05:20:57.449 INFO:tasks.workunit.client.1.smithi073.stdout:7/166: rename d1/d17/d22 to d1/d17/d22/d30 22 2024-08-31T05:20:57.451 INFO:tasks.workunit.client.1.smithi073.stdout:9/201: rmdir dc 39 2024-08-31T05:20:57.454 INFO:tasks.workunit.client.1.smithi073.stdout:6/159: rmdir d15/d1a 39 2024-08-31T05:20:57.455 INFO:tasks.workunit.client.1.smithi073.stdout:1/155: mkdir d5/d10/d2e 0 2024-08-31T05:20:57.456 INFO:tasks.workunit.client.1.smithi073.stdout:5/189: mknod dc/d16/d1a/c45 0 2024-08-31T05:20:57.457 INFO:tasks.workunit.client.1.smithi073.stdout:2/221: creat d2/d9/f41 x:0 0 0 2024-08-31T05:20:57.458 INFO:tasks.workunit.client.1.smithi073.stdout:3/235: creat da/d1b/f4c x:0 0 0 2024-08-31T05:20:57.459 INFO:tasks.workunit.client.1.smithi073.stdout:7/167: fdatasync d1/d11/d14/f1b 0 2024-08-31T05:20:57.460 INFO:tasks.workunit.client.1.smithi073.stdout:0/223: link d0/d28/d2b/d3c/c14 d0/d28/d2b/c48 0 2024-08-31T05:20:57.464 INFO:tasks.workunit.client.1.smithi073.stdout:1/156: unlink d5/fd 0 2024-08-31T05:20:57.466 INFO:tasks.workunit.client.1.smithi073.stdout:5/190: symlink dc/d3d/l46 0 2024-08-31T05:20:57.467 INFO:tasks.workunit.client.1.smithi073.stdout:2/222: creat d2/d9/d32/f42 x:0 0 0 2024-08-31T05:20:57.467 INFO:tasks.workunit.client.1.smithi073.stdout:9/202: dwrite dc/de/f1e [0,4194304] 0 2024-08-31T05:20:57.468 INFO:tasks.workunit.client.1.smithi073.stdout:3/236: rmdir da/d1b 39 2024-08-31T05:20:57.471 INFO:tasks.workunit.client.1.smithi073.stdout:7/168: chown d1/da/d15/c1c 206580 1 2024-08-31T05:20:57.475 INFO:tasks.workunit.client.1.smithi073.stdout:5/191: dwrite dc/d16/d26/f23 [0,4194304] 0 2024-08-31T05:20:57.475 INFO:tasks.workunit.client.1.smithi073.stdout:9/203: dread dc/de/d11/d41/f39 [0,4194304] 0 2024-08-31T05:20:57.475 INFO:tasks.workunit.client.1.smithi073.stdout:2/223: fsync d2/d9/df/f3b 0 2024-08-31T05:20:57.475 INFO:tasks.workunit.client.1.smithi073.stdout:9/204: chown dc/d10/f26 6 1 2024-08-31T05:20:57.478 INFO:tasks.workunit.client.1.smithi073.stdout:3/237: write da/d1b/d40/f44 [720939,86889] 0 2024-08-31T05:20:57.479 INFO:tasks.workunit.client.1.smithi073.stdout:7/169: truncate d1/da/d15/f24 124124 0 2024-08-31T05:20:57.479 INFO:tasks.workunit.client.1.smithi073.stdout:1/157: link d5/da/f2d d5/d17/f2f 0 2024-08-31T05:20:57.481 INFO:tasks.workunit.client.1.smithi073.stdout:2/224: mkdir d2/d9/df/d43 0 2024-08-31T05:20:57.483 INFO:tasks.workunit.client.1.smithi073.stdout:9/205: write dc/f25 [670817,85074] 0 2024-08-31T05:20:57.484 INFO:tasks.workunit.client.1.smithi073.stdout:0/224: creat d0/f49 x:0 0 0 2024-08-31T05:20:57.485 INFO:tasks.workunit.client.1.smithi073.stdout:3/238: creat da/d18/f4d x:0 0 0 2024-08-31T05:20:57.486 INFO:tasks.workunit.client.1.smithi073.stdout:0/225: stat d0/d28/d2b/d3c/c12 0 2024-08-31T05:20:57.487 INFO:tasks.workunit.client.1.smithi073.stdout:2/225: unlink d2/d9/f41 0 2024-08-31T05:20:57.487 INFO:tasks.workunit.client.1.smithi073.stdout:1/158: dwrite d5/da/f18 [0,4194304] 0 2024-08-31T05:20:57.488 INFO:tasks.workunit.client.1.smithi073.stdout:9/206: chown c6 88572261 1 2024-08-31T05:20:57.490 INFO:tasks.workunit.client.1.smithi073.stdout:0/226: mkdir d0/d15/d2c/d40/d4a 0 2024-08-31T05:20:57.491 INFO:tasks.workunit.client.1.smithi073.stdout:3/239: rename da/d1b/c36 to da/d3c/c4e 0 2024-08-31T05:20:57.492 INFO:tasks.workunit.client.1.smithi073.stdout:9/207: unlink dc/d27/l32 0 2024-08-31T05:20:57.494 INFO:tasks.workunit.client.1.smithi073.stdout:0/227: unlink d0/d28/d2b/l35 0 2024-08-31T05:20:57.496 INFO:tasks.workunit.client.1.smithi073.stdout:2/226: rename d2/d9/df/l18 to d2/d9/df/d36/l44 0 2024-08-31T05:20:57.497 INFO:tasks.workunit.client.1.smithi073.stdout:1/159: dwrite d5/da/fe [0,4194304] 0 2024-08-31T05:20:57.497 INFO:tasks.workunit.client.1.smithi073.stdout:3/240: mknod da/d18/c4f 0 2024-08-31T05:20:57.497 INFO:tasks.workunit.client.1.smithi073.stdout:2/227: chown d2/d9/ce 84445957 1 2024-08-31T05:20:57.498 INFO:tasks.workunit.client.1.smithi073.stdout:1/160: readlink l3 0 2024-08-31T05:20:57.498 INFO:tasks.workunit.client.1.smithi073.stdout:9/208: write dc/d37/f35 [1212808,51696] 0 2024-08-31T05:20:57.498 INFO:tasks.workunit.client.1.smithi073.stdout:2/228: chown d2/d9/d32 124537876 1 2024-08-31T05:20:57.499 INFO:tasks.workunit.client.1.smithi073.stdout:0/228: rmdir d0/d28/d2b/d3c 39 2024-08-31T05:20:57.500 INFO:tasks.workunit.client.1.smithi073.stdout:3/241: rename da/d1b/d40 to da/d1b/d40/d50 22 2024-08-31T05:20:57.503 INFO:tasks.workunit.client.1.smithi073.stdout:2/229: rename d2/d9/c34 to d2/d9/d32/c45 0 2024-08-31T05:20:57.504 INFO:tasks.workunit.client.1.smithi073.stdout:2/230: chown d2/d9/df/d43 12 1 2024-08-31T05:20:57.507 INFO:tasks.workunit.client.1.smithi073.stdout:3/242: dwrite da/d1b/d2c/f2e [0,4194304] 0 2024-08-31T05:20:57.508 INFO:tasks.workunit.client.1.smithi073.stdout:1/161: link d5/da/f2d d5/da/f30 0 2024-08-31T05:20:57.508 INFO:tasks.workunit.client.1.smithi073.stdout:9/209: getdents dc/d10 0 2024-08-31T05:20:57.509 INFO:tasks.workunit.client.1.smithi073.stdout:0/229: creat d0/d15/d2c/d40/d4a/f4b x:0 0 0 2024-08-31T05:20:57.509 INFO:tasks.workunit.client.1.smithi073.stdout:2/231: creat d2/d9/d3c/f46 x:0 0 0 2024-08-31T05:20:57.509 INFO:tasks.workunit.client.1.smithi073.stdout:9/210: chown dc 8162894 1 2024-08-31T05:20:57.511 INFO:tasks.workunit.client.1.smithi073.stdout:1/162: symlink d5/da/d13/l31 0 2024-08-31T05:20:57.512 INFO:tasks.workunit.client.1.smithi073.stdout:0/230: rmdir d0/d15 39 2024-08-31T05:20:57.512 INFO:tasks.workunit.client.1.smithi073.stdout:9/211: write dc/f3c [4691899,85281] 0 2024-08-31T05:20:57.515 INFO:tasks.workunit.client.1.smithi073.stdout:2/232: rename d2/d9/df/f30 to d2/d9/d32/f47 0 2024-08-31T05:20:57.517 INFO:tasks.workunit.client.1.smithi073.stdout:1/163: mkdir d5/d17/d32 0 2024-08-31T05:20:57.519 INFO:tasks.workunit.client.1.smithi073.stdout:9/212: mknod dc/de/d11/d41/c44 0 2024-08-31T05:20:57.519 INFO:tasks.workunit.client.1.smithi073.stdout:1/164: stat d5/d17/d2a 0 2024-08-31T05:20:57.519 INFO:tasks.workunit.client.1.smithi073.stdout:3/243: dwrite da/d18/f4d [0,4194304] 0 2024-08-31T05:20:57.521 INFO:tasks.workunit.client.1.smithi073.stdout:3/244: stat da/c11 0 2024-08-31T05:20:57.522 INFO:tasks.workunit.client.1.smithi073.stdout:2/233: symlink d2/d9/df/d36/l48 0 2024-08-31T05:20:57.523 INFO:tasks.workunit.client.1.smithi073.stdout:3/245: read da/d18/f21 [2882435,130193] 0 2024-08-31T05:20:57.526 INFO:tasks.workunit.client.1.smithi073.stdout:0/231: dread d0/d15/f37 [0,4194304] 0 2024-08-31T05:20:57.530 INFO:tasks.workunit.client.1.smithi073.stdout:0/232: unlink d0/d28/d2b/d3c/c12 0 2024-08-31T05:20:57.532 INFO:tasks.workunit.client.1.smithi073.stdout:4/206: sync 2024-08-31T05:20:57.533 INFO:tasks.workunit.client.1.smithi073.stdout:0/233: dread d0/d28/d2b/f3e [0,4194304] 0 2024-08-31T05:20:57.533 INFO:tasks.workunit.client.1.smithi073.stdout:1/165: rename d5/da to d5/d10/d33 0 2024-08-31T05:20:57.534 INFO:tasks.workunit.client.1.smithi073.stdout:4/207: rmdir d7 39 2024-08-31T05:20:57.534 INFO:tasks.workunit.client.1.smithi073.stdout:0/234: chown d0/f26 25 1 2024-08-31T05:20:57.534 INFO:tasks.workunit.client.1.smithi073.stdout:1/166: chown d5/d10/d1c/d27 225040 1 2024-08-31T05:20:57.536 INFO:tasks.workunit.client.1.smithi073.stdout:1/167: rmdir d5/d10/d33/d13 39 2024-08-31T05:20:57.596 INFO:tasks.workunit.client.1.smithi073.stdout:1/168: read f0 [39095,105280] 0 2024-08-31T05:20:57.598 INFO:tasks.workunit.client.1.smithi073.stdout:0/235: dwrite d0/f27 [0,4194304] 0 2024-08-31T05:20:57.598 INFO:tasks.workunit.client.1.smithi073.stdout:1/169: write d5/f7 [4198909,44421] 0 2024-08-31T05:20:57.599 INFO:tasks.workunit.client.1.smithi073.stdout:1/170: chown d5/d10/d33 521968 1 2024-08-31T05:20:57.599 INFO:tasks.workunit.client.1.smithi073.stdout:0/236: read - d0/d15/d2c/d2e/f46 zero size 2024-08-31T05:20:57.601 INFO:tasks.workunit.client.1.smithi073.stdout:0/237: symlink d0/d15/d2c/l4c 0 2024-08-31T05:20:57.602 INFO:tasks.workunit.client.1.smithi073.stdout:0/238: stat d0/d28/d2b/d3c/f1f 0 2024-08-31T05:20:57.603 INFO:tasks.workunit.client.1.smithi073.stdout:3/246: dread da/d18/f1f [0,4194304] 0 2024-08-31T05:20:57.634 INFO:tasks.workunit.client.1.smithi073.stdout:8/247: sync 2024-08-31T05:20:57.634 INFO:tasks.workunit.client.1.smithi073.stdout:6/160: sync 2024-08-31T05:20:57.635 INFO:tasks.workunit.client.1.smithi073.stdout:1/171: truncate f2 1994552 0 2024-08-31T05:20:57.637 INFO:tasks.workunit.client.1.smithi073.stdout:3/247: dread - da/d1b/d2c/f48 zero size 2024-08-31T05:20:57.637 INFO:tasks.workunit.client.1.smithi073.stdout:1/172: write d5/f19 [3506396,3266] 0 2024-08-31T05:20:57.640 INFO:tasks.workunit.client.1.smithi073.stdout:8/248: rename d0/fc to d0/db/d44/f4d 0 2024-08-31T05:20:57.641 INFO:tasks.workunit.client.1.smithi073.stdout:3/248: write da/f2f [1349566,104598] 0 2024-08-31T05:20:57.642 INFO:tasks.workunit.client.1.smithi073.stdout:4/208: dread d7/db/f2a [0,4194304] 0 2024-08-31T05:20:57.642 INFO:tasks.workunit.client.1.smithi073.stdout:1/173: chown d5/f25 3236 1 2024-08-31T05:20:57.644 INFO:tasks.workunit.client.1.smithi073.stdout:8/249: chown d0/c35 54580705 1 2024-08-31T05:20:57.646 INFO:tasks.workunit.client.1.smithi073.stdout:0/239: dwrite d0/d28/f2d [4194304,4194304] 0 2024-08-31T05:20:57.646 INFO:tasks.workunit.client.1.smithi073.stdout:3/249: symlink da/d18/l51 0 2024-08-31T05:20:57.647 INFO:tasks.workunit.client.1.smithi073.stdout:4/209: dread - d7/df/d13/d2e/f3a zero size 2024-08-31T05:20:57.650 INFO:tasks.workunit.client.1.smithi073.stdout:6/161: dwrite d15/d17/d26/f31 [0,4194304] 0 2024-08-31T05:20:57.653 INFO:tasks.workunit.client.1.smithi073.stdout:0/240: chown d0/d15/d2c/d2e/c3a 0 1 2024-08-31T05:20:57.653 INFO:tasks.workunit.client.1.smithi073.stdout:6/162: chown f14 72802 1 2024-08-31T05:20:57.654 INFO:tasks.workunit.client.1.smithi073.stdout:8/250: rename d0/db/d1c/d34/d36 to d0/db/d44/d4e 0 2024-08-31T05:20:57.655 INFO:tasks.workunit.client.1.smithi073.stdout:4/210: fsync d7/db/f2a 0 2024-08-31T05:20:57.661 INFO:tasks.workunit.client.1.smithi073.stdout:4/211: creat d7/df/f3f x:0 0 0 2024-08-31T05:20:57.661 INFO:tasks.workunit.client.1.smithi073.stdout:8/251: write d0/db/d1c/d34/d38/f43 [23316,48429] 0 2024-08-31T05:20:57.662 INFO:tasks.workunit.client.1.smithi073.stdout:6/163: creat d15/d1a/d1e/f33 x:0 0 0 2024-08-31T05:20:57.662 INFO:tasks.workunit.client.1.smithi073.stdout:3/250: dwrite da/f14 [4194304,4194304] 0 2024-08-31T05:20:57.669 INFO:tasks.workunit.client.1.smithi073.stdout:8/252: chown d0/db/d1c/d2a 176556 1 2024-08-31T05:20:57.671 INFO:tasks.workunit.client.1.smithi073.stdout:1/174: dwrite d5/d10/d33/f2d [0,4194304] 0 2024-08-31T05:20:57.672 INFO:tasks.workunit.client.1.smithi073.stdout:8/253: write d0/db/d1c/d24/f32 [2733728,12733] 0 2024-08-31T05:20:57.674 INFO:tasks.workunit.client.1.smithi073.stdout:0/241: dwrite d0/f32 [0,4194304] 0 2024-08-31T05:20:57.675 INFO:tasks.workunit.client.1.smithi073.stdout:1/175: chown d5/f7 656852052 1 2024-08-31T05:20:57.681 INFO:tasks.workunit.client.1.smithi073.stdout:3/251: dwrite da/d3c/f42 [0,4194304] 0 2024-08-31T05:20:57.682 INFO:tasks.workunit.client.1.smithi073.stdout:0/242: rename d0/d28/d2b to d0/d15/d2c/d4d 0 2024-08-31T05:20:57.683 INFO:tasks.workunit.client.1.smithi073.stdout:0/243: chown d0/f4 18784 1 2024-08-31T05:20:57.685 INFO:tasks.workunit.client.1.smithi073.stdout:1/176: creat d5/f34 x:0 0 0 2024-08-31T05:20:57.686 INFO:tasks.workunit.client.1.smithi073.stdout:8/254: dwrite d0/f1b [0,4194304] 0 2024-08-31T05:20:57.693 INFO:tasks.workunit.client.1.smithi073.stdout:8/255: write d0/db/d1c/f3b [741118,109341] 0 2024-08-31T05:20:57.694 INFO:tasks.workunit.client.1.smithi073.stdout:3/252: creat da/f52 x:0 0 0 2024-08-31T05:20:57.694 INFO:tasks.workunit.client.1.smithi073.stdout:4/212: dread d7/f12 [0,4194304] 0 2024-08-31T05:20:57.697 INFO:tasks.workunit.client.1.smithi073.stdout:4/213: chown l6 1609785 1 2024-08-31T05:20:57.697 INFO:tasks.workunit.client.1.smithi073.stdout:6/164: dwrite d15/d1a/f32 [0,4194304] 0 2024-08-31T05:20:57.697 INFO:tasks.workunit.client.1.smithi073.stdout:8/256: mknod d0/db/d1c/c4f 0 2024-08-31T05:20:57.699 INFO:tasks.workunit.client.1.smithi073.stdout:1/177: dwrite d5/d10/d33/f2d [0,4194304] 0 2024-08-31T05:20:57.700 INFO:tasks.workunit.client.1.smithi073.stdout:1/178: readlink l3 0 2024-08-31T05:20:57.700 INFO:tasks.workunit.client.1.smithi073.stdout:4/214: rmdir d7/df/d1b 39 2024-08-31T05:20:57.702 INFO:tasks.workunit.client.1.smithi073.stdout:6/165: write d15/d1a/d1e/f24 [7755447,101297] 0 2024-08-31T05:20:57.702 INFO:tasks.workunit.client.1.smithi073.stdout:0/244: write d0/f26 [4713002,35802] 0 2024-08-31T05:20:57.704 INFO:tasks.workunit.client.1.smithi073.stdout:3/253: rename da/c4a to da/d3c/c53 0 2024-08-31T05:20:57.704 INFO:tasks.workunit.client.1.smithi073.stdout:1/179: mkdir d5/d10/d1c/d35 0 2024-08-31T05:20:57.705 INFO:tasks.workunit.client.1.smithi073.stdout:4/215: dread d7/df/d13/d2e/f36 [0,4194304] 0 2024-08-31T05:20:57.707 INFO:tasks.workunit.client.1.smithi073.stdout:6/166: unlink d15/d1a/l1b 0 2024-08-31T05:20:57.709 INFO:tasks.workunit.client.1.smithi073.stdout:3/254: rmdir da 39 2024-08-31T05:20:57.710 INFO:tasks.workunit.client.1.smithi073.stdout:0/245: mknod d0/d15/d2c/d2e/d3d/c4e 0 2024-08-31T05:20:57.711 INFO:tasks.workunit.client.1.smithi073.stdout:9/213: sync 2024-08-31T05:20:57.711 INFO:tasks.workunit.client.1.smithi073.stdout:7/170: sync 2024-08-31T05:20:57.711 INFO:tasks.workunit.client.1.smithi073.stdout:5/192: sync 2024-08-31T05:20:57.713 INFO:tasks.workunit.client.1.smithi073.stdout:0/246: mkdir d0/d28/d4f 0 2024-08-31T05:20:57.715 INFO:tasks.workunit.client.1.smithi073.stdout:8/257: write d0/db/d1c/d24/f28 [3116136,80450] 0 2024-08-31T05:20:57.715 INFO:tasks.workunit.client.1.smithi073.stdout:9/214: unlink dc/d10/f19 0 2024-08-31T05:20:57.716 INFO:tasks.workunit.client.1.smithi073.stdout:5/193: unlink dc/d16/d26/c24 0 2024-08-31T05:20:57.717 INFO:tasks.workunit.client.1.smithi073.stdout:5/194: write f9 [646063,88002] 0 2024-08-31T05:20:57.717 INFO:tasks.workunit.client.1.smithi073.stdout:4/216: mknod d7/df/c40 0 2024-08-31T05:20:57.718 INFO:tasks.workunit.client.1.smithi073.stdout:6/167: link d15/d1a/d2b/f2d d15/d17/d26/f34 0 2024-08-31T05:20:57.718 INFO:tasks.workunit.client.1.smithi073.stdout:7/171: symlink d1/d11/l31 0 2024-08-31T05:20:57.719 INFO:tasks.workunit.client.1.smithi073.stdout:3/255: symlink da/d1b/d45/l54 0 2024-08-31T05:20:57.719 INFO:tasks.workunit.client.1.smithi073.stdout:6/168: truncate d15/f1f 726159 0 2024-08-31T05:20:57.720 INFO:tasks.workunit.client.1.smithi073.stdout:1/180: creat d5/d10/d33/f36 x:0 0 0 2024-08-31T05:20:57.720 INFO:tasks.workunit.client.1.smithi073.stdout:6/169: readlink l5 0 2024-08-31T05:20:57.723 INFO:tasks.workunit.client.1.smithi073.stdout:4/217: symlink d7/df/d13/d2e/l41 0 2024-08-31T05:20:57.723 INFO:tasks.workunit.client.1.smithi073.stdout:1/181: stat d5/d17/f2f 0 2024-08-31T05:20:57.724 INFO:tasks.workunit.client.1.smithi073.stdout:7/172: write d1/da/d15/f21 [3707235,104368] 0 2024-08-31T05:20:57.724 INFO:tasks.workunit.client.1.smithi073.stdout:6/170: unlink f13 0 2024-08-31T05:20:57.726 INFO:tasks.workunit.client.1.smithi073.stdout:5/195: dread dc/d16/f2b [0,4194304] 0 2024-08-31T05:20:57.726 INFO:tasks.workunit.client.1.smithi073.stdout:1/182: truncate d5/f25 902786 0 2024-08-31T05:20:57.727 INFO:tasks.workunit.client.1.smithi073.stdout:4/218: unlink d7/df/l3c 0 2024-08-31T05:20:57.727 INFO:tasks.workunit.client.1.smithi073.stdout:6/171: dread f9 [0,4194304] 0 2024-08-31T05:20:57.728 INFO:tasks.workunit.client.1.smithi073.stdout:3/256: truncate da/d18/f21 5051236 0 2024-08-31T05:20:57.734 INFO:tasks.workunit.client.1.smithi073.stdout:1/183: dwrite d5/d10/d33/fe [0,4194304] 0 2024-08-31T05:20:57.735 INFO:tasks.workunit.client.1.smithi073.stdout:6/172: mknod d15/d1a/d1e/c35 0 2024-08-31T05:20:57.736 INFO:tasks.workunit.client.1.smithi073.stdout:8/258: link d0/c14 d0/db/d1c/d34/d38/c50 0 2024-08-31T05:20:57.737 INFO:tasks.workunit.client.1.smithi073.stdout:7/173: fdatasync d1/da/f12 0 2024-08-31T05:20:57.738 INFO:tasks.workunit.client.1.smithi073.stdout:3/257: dwrite da/f43 [0,4194304] 0 2024-08-31T05:20:57.738 INFO:tasks.workunit.client.1.smithi073.stdout:8/259: chown d0/db/c3e 24 1 2024-08-31T05:20:57.740 INFO:tasks.workunit.client.1.smithi073.stdout:7/174: read d1/d11/d14/f1b [1530500,70121] 0 2024-08-31T05:20:57.741 INFO:tasks.workunit.client.1.smithi073.stdout:0/247: write d0/f4 [4259985,57322] 0 2024-08-31T05:20:57.744 INFO:tasks.workunit.client.1.smithi073.stdout:6/173: unlink d15/f16 0 2024-08-31T05:20:57.747 INFO:tasks.workunit.client.1.smithi073.stdout:3/258: creat da/d1b/d45/f55 x:0 0 0 2024-08-31T05:20:57.748 INFO:tasks.workunit.client.1.smithi073.stdout:5/196: link l4 dc/d16/d1a/l47 0 2024-08-31T05:20:57.749 INFO:tasks.workunit.client.1.smithi073.stdout:1/184: dwrite d5/d10/d33/f15 [0,4194304] 0 2024-08-31T05:20:57.750 INFO:tasks.workunit.client.1.smithi073.stdout:7/175: creat d1/da/f32 x:0 0 0 2024-08-31T05:20:57.750 INFO:tasks.workunit.client.1.smithi073.stdout:3/259: fsync da/f10 0 2024-08-31T05:20:57.751 INFO:tasks.workunit.client.1.smithi073.stdout:0/248: symlink d0/d15/d2c/d4d/d3c/l50 0 2024-08-31T05:20:57.754 INFO:tasks.workunit.client.1.smithi073.stdout:8/260: truncate d0/db/d1c/d23/f2f 913643 0 2024-08-31T05:20:57.754 INFO:tasks.workunit.client.1.smithi073.stdout:5/197: chown dc/d16/d1a/l38 0 1 2024-08-31T05:20:57.754 INFO:tasks.workunit.client.1.smithi073.stdout:4/219: write d7/db/d11/f3d [25068,111009] 0 2024-08-31T05:20:57.755 INFO:tasks.workunit.client.1.smithi073.stdout:3/260: read - da/d1b/d2c/f30 zero size 2024-08-31T05:20:57.759 INFO:tasks.workunit.client.1.smithi073.stdout:3/261: write da/f12 [678877,94567] 0 2024-08-31T05:20:57.759 INFO:tasks.workunit.client.1.smithi073.stdout:4/220: read d7/fa [432544,59183] 0 2024-08-31T05:20:57.761 INFO:tasks.workunit.client.1.smithi073.stdout:6/174: dread fd [0,4194304] 0 2024-08-31T05:20:57.762 INFO:tasks.workunit.client.1.smithi073.stdout:9/215: dwrite f7 [0,4194304] 0 2024-08-31T05:20:57.762 INFO:tasks.workunit.client.1.smithi073.stdout:4/221: chown d7/df/d13/c1c 34 1 2024-08-31T05:20:57.763 INFO:tasks.workunit.client.1.smithi073.stdout:7/176: dwrite d1/d17/d22/f27 [0,4194304] 0 2024-08-31T05:20:57.772 INFO:tasks.workunit.client.1.smithi073.stdout:7/177: dwrite d1/d11/d14/f29 [0,4194304] 0 2024-08-31T05:20:57.786 INFO:tasks.workunit.client.1.smithi073.stdout:5/198: rmdir dc/d16/d3b 39 2024-08-31T05:20:57.789 INFO:tasks.workunit.client.1.smithi073.stdout:3/262: creat da/d1b/d45/f56 x:0 0 0 2024-08-31T05:20:57.791 INFO:tasks.workunit.client.1.smithi073.stdout:1/185: mkdir d5/d17/d32/d37 0 2024-08-31T05:20:57.792 INFO:tasks.workunit.client.1.smithi073.stdout:9/216: symlink dc/d37/d42/l45 0 2024-08-31T05:20:57.793 INFO:tasks.workunit.client.1.smithi073.stdout:3/263: creat da/d1b/d40/f57 x:0 0 0 2024-08-31T05:20:57.795 INFO:tasks.workunit.client.1.smithi073.stdout:6/175: creat d15/f36 x:0 0 0 2024-08-31T05:20:57.798 INFO:tasks.workunit.client.1.smithi073.stdout:5/199: link dc/d16/d1a/f1f dc/f48 0 2024-08-31T05:20:57.798 INFO:tasks.workunit.client.1.smithi073.stdout:0/249: getdents d0/d15 0 2024-08-31T05:20:57.800 INFO:tasks.workunit.client.1.smithi073.stdout:1/186: dwrite d5/d10/d33/f15 [0,4194304] 0 2024-08-31T05:20:57.801 INFO:tasks.workunit.client.1.smithi073.stdout:1/187: chown d5/c21 65 1 2024-08-31T05:20:57.802 INFO:tasks.workunit.client.1.smithi073.stdout:6/176: creat d15/d1a/d1e/f37 x:0 0 0 2024-08-31T05:20:57.803 INFO:tasks.workunit.client.1.smithi073.stdout:4/222: link d7/df/l37 d7/df/d1b/d34/l42 0 2024-08-31T05:20:57.804 INFO:tasks.workunit.client.1.smithi073.stdout:3/264: dwrite da/f10 [0,4194304] 0 2024-08-31T05:20:57.805 INFO:tasks.workunit.client.1.smithi073.stdout:5/200: mkdir dc/d16/d26/d49 0 2024-08-31T05:20:57.805 INFO:tasks.workunit.client.1.smithi073.stdout:7/178: write d1/da/f12 [156511,116869] 0 2024-08-31T05:20:57.806 INFO:tasks.workunit.client.1.smithi073.stdout:0/250: rmdir d0/d15/d2c 39 2024-08-31T05:20:57.809 INFO:tasks.workunit.client.1.smithi073.stdout:9/217: link dc/d10/l24 dc/d27/l46 0 2024-08-31T05:20:57.809 INFO:tasks.workunit.client.1.smithi073.stdout:9/218: readlink dc/de/l2b 0 2024-08-31T05:20:57.809 INFO:tasks.workunit.client.1.smithi073.stdout:6/177: mkdir d15/d17/d26/d38 0 2024-08-31T05:20:57.811 INFO:tasks.workunit.client.1.smithi073.stdout:4/223: unlink d7/db/d11/f3d 0 2024-08-31T05:20:57.812 INFO:tasks.workunit.client.1.smithi073.stdout:6/178: truncate f9 1879158 0 2024-08-31T05:20:57.812 INFO:tasks.workunit.client.1.smithi073.stdout:9/219: write dc/d37/f3d [971924,106908] 0 2024-08-31T05:20:57.814 INFO:tasks.workunit.client.1.smithi073.stdout:3/265: symlink da/d18/l58 0 2024-08-31T05:20:57.815 INFO:tasks.workunit.client.1.smithi073.stdout:4/224: dread - d7/df/d13/d2e/f3a zero size 2024-08-31T05:20:57.816 INFO:tasks.workunit.client.1.smithi073.stdout:5/201: creat dc/d3d/d3e/f4a x:0 0 0 2024-08-31T05:20:57.817 INFO:tasks.workunit.client.1.smithi073.stdout:9/220: write dc/d37/f35 [31580,89241] 0 2024-08-31T05:20:57.829 INFO:tasks.workunit.client.1.smithi073.stdout:2/234: sync 2024-08-31T05:20:57.841 INFO:tasks.workunit.client.1.smithi073.stdout:3/266: write da/f14 [2577140,94774] 0 2024-08-31T05:20:57.841 INFO:tasks.workunit.client.1.smithi073.stdout:0/251: dwrite d0/f49 [0,4194304] 0 2024-08-31T05:20:57.841 INFO:tasks.workunit.client.1.smithi073.stdout:4/225: dread - d7/df/f21 zero size 2024-08-31T05:20:57.842 INFO:tasks.workunit.client.1.smithi073.stdout:1/188: dwrite d5/d10/d33/f36 [0,4194304] 0 2024-08-31T05:20:57.848 INFO:tasks.workunit.client.1.smithi073.stdout:0/252: chown d0/d15/d2c/d41 52 1 2024-08-31T05:20:57.848 INFO:tasks.workunit.client.1.smithi073.stdout:7/179: getdents d1/d11/d14 0 2024-08-31T05:20:57.849 INFO:tasks.workunit.client.1.smithi073.stdout:3/267: mknod da/c59 0 2024-08-31T05:20:57.849 INFO:tasks.workunit.client.1.smithi073.stdout:9/221: dread dc/d10/f18 [0,4194304] 0 2024-08-31T05:20:57.851 INFO:tasks.workunit.client.1.smithi073.stdout:7/180: write d1/da/f26 [491432,47165] 0 2024-08-31T05:20:57.851 INFO:tasks.workunit.client.1.smithi073.stdout:1/189: rename d5/d10/d33/f2d to d5/d17/f38 0 2024-08-31T05:20:57.852 INFO:tasks.workunit.client.1.smithi073.stdout:1/190: chown d5/d10 4064 1 2024-08-31T05:20:57.852 INFO:tasks.workunit.client.1.smithi073.stdout:7/181: stat d1/d11/d14 0 2024-08-31T05:20:57.853 INFO:tasks.workunit.client.1.smithi073.stdout:2/235: dwrite f1 [0,4194304] 0 2024-08-31T05:20:57.853 INFO:tasks.workunit.client.1.smithi073.stdout:1/191: truncate d5/f34 168848 0 2024-08-31T05:20:57.854 INFO:tasks.workunit.client.1.smithi073.stdout:4/226: truncate d7/df/d13/d2e/f36 91679 0 2024-08-31T05:20:57.854 INFO:tasks.workunit.client.1.smithi073.stdout:1/192: chown d5/d10/c24 0 1 2024-08-31T05:20:57.856 INFO:tasks.workunit.client.1.smithi073.stdout:9/222: creat dc/d27/f47 x:0 0 0 2024-08-31T05:20:57.860 INFO:tasks.workunit.client.1.smithi073.stdout:1/193: dread d5/d10/d33/fe [0,4194304] 0 2024-08-31T05:20:57.861 INFO:tasks.workunit.client.1.smithi073.stdout:3/268: mkdir da/d3c/d5a 0 2024-08-31T05:20:57.862 INFO:tasks.workunit.client.1.smithi073.stdout:3/269: write da/d18/f38 [881130,75588] 0 2024-08-31T05:20:57.864 INFO:tasks.workunit.client.1.smithi073.stdout:2/236: symlink d2/d25/l49 0 2024-08-31T05:20:57.864 INFO:tasks.workunit.client.1.smithi073.stdout:5/202: dread dc/d16/d1a/f28 [0,4194304] 0 2024-08-31T05:20:57.867 INFO:tasks.workunit.client.1.smithi073.stdout:9/223: write dc/d10/f18 [1413884,111845] 0 2024-08-31T05:20:57.870 INFO:tasks.workunit.client.1.smithi073.stdout:1/194: chown d5/d26/c2c 139543315 1 2024-08-31T05:20:57.872 INFO:tasks.workunit.client.1.smithi073.stdout:1/195: write d5/d10/d33/f36 [3434773,36598] 0 2024-08-31T05:20:57.872 INFO:tasks.workunit.client.1.smithi073.stdout:7/182: mkdir d1/da/d15/d33 0 2024-08-31T05:20:57.874 INFO:tasks.workunit.client.1.smithi073.stdout:3/270: unlink da/d1b/d2c/f30 0 2024-08-31T05:20:57.875 INFO:tasks.workunit.client.1.smithi073.stdout:1/196: dread d5/f7 [4194304,4194304] 0 2024-08-31T05:20:57.877 INFO:tasks.workunit.client.1.smithi073.stdout:2/237: symlink d2/d9/d3c/l4a 0 2024-08-31T05:20:57.878 INFO:tasks.workunit.client.1.smithi073.stdout:2/238: stat d2/d9/c1d 0 2024-08-31T05:20:57.880 INFO:tasks.workunit.client.1.smithi073.stdout:5/203: creat dc/d3d/f4b x:0 0 0 2024-08-31T05:20:57.884 INFO:tasks.workunit.client.1.smithi073.stdout:9/224: symlink dc/d10/l48 0 2024-08-31T05:20:57.888 INFO:tasks.workunit.client.1.smithi073.stdout:9/225: dread dc/d10/f26 [0,4194304] 0 2024-08-31T05:20:57.891 INFO:tasks.workunit.client.1.smithi073.stdout:0/253: truncate d0/f49 1065218 0 2024-08-31T05:20:57.891 INFO:tasks.workunit.client.1.smithi073.stdout:0/254: chown d0/f26 3507 1 2024-08-31T05:20:57.892 INFO:tasks.workunit.client.1.smithi073.stdout:7/183: rename d1/da/f12 to d1/da/f34 0 2024-08-31T05:20:57.893 INFO:tasks.workunit.client.1.smithi073.stdout:7/184: truncate d1/d17/d22/f27 4430838 0 2024-08-31T05:20:57.893 INFO:tasks.workunit.client.1.smithi073.stdout:7/185: chown d1/d11 104531 1 2024-08-31T05:20:57.893 INFO:tasks.workunit.client.1.smithi073.stdout:7/186: dread - d1/f2e zero size 2024-08-31T05:20:57.893 INFO:tasks.workunit.client.1.smithi073.stdout:7/187: dread - d1/da/f32 zero size 2024-08-31T05:20:57.897 INFO:tasks.workunit.client.1.smithi073.stdout:1/197: creat d5/d26/f39 x:0 0 0 2024-08-31T05:20:57.899 INFO:tasks.workunit.client.1.smithi073.stdout:3/271: dread da/d18/f21 [0,4194304] 0 2024-08-31T05:20:57.903 INFO:tasks.workunit.client.1.smithi073.stdout:1/198: dread d5/d10/d33/f30 [0,4194304] 0 2024-08-31T05:20:57.911 INFO:tasks.workunit.client.1.smithi073.stdout:5/204: creat dc/d3d/f4c x:0 0 0 2024-08-31T05:20:57.913 INFO:tasks.workunit.client.1.smithi073.stdout:4/227: rename d7/db/l2f to d7/df/l43 0 2024-08-31T05:20:57.922 INFO:tasks.workunit.client.1.smithi073.stdout:0/255: unlink d0/f2f 0 2024-08-31T05:20:57.923 INFO:tasks.workunit.client.1.smithi073.stdout:7/188: mkdir d1/d17/d22/d35 0 2024-08-31T05:20:57.942 INFO:tasks.workunit.client.1.smithi073.stdout:8/261: sync 2024-08-31T05:20:57.942 INFO:tasks.workunit.client.1.smithi073.stdout:4/228: creat d7/df/d13/f44 x:0 0 0 2024-08-31T05:20:57.943 INFO:tasks.workunit.client.1.smithi073.stdout:0/256: read d0/f49 [1054900,11549] 0 2024-08-31T05:20:57.945 INFO:tasks.workunit.client.1.smithi073.stdout:0/257: chown d0/d15/d2c/d4d/d3c/c18 0 1 2024-08-31T05:20:57.946 INFO:tasks.workunit.client.1.smithi073.stdout:7/189: creat d1/da/d15/d33/f36 x:0 0 0 2024-08-31T05:20:57.952 INFO:tasks.workunit.client.1.smithi073.stdout:8/262: dwrite d0/db/d1c/d34/d38/f4b [0,4194304] 0 2024-08-31T05:20:57.954 INFO:tasks.workunit.client.1.smithi073.stdout:8/263: write d0/db/d1c/d34/d38/f43 [941008,115507] 0 2024-08-31T05:20:57.980 INFO:tasks.workunit.client.1.smithi073.stdout:0/258: mknod d0/d15/d2c/d4d/d3c/c51 0 2024-08-31T05:20:57.981 INFO:tasks.workunit.client.1.smithi073.stdout:6/179: sync 2024-08-31T05:20:57.981 INFO:tasks.workunit.client.1.smithi073.stdout:0/259: dread - d0/d15/d2c/d2e/f46 zero size 2024-08-31T05:20:57.981 INFO:tasks.workunit.client.1.smithi073.stdout:7/190: readlink d1/d17/d22/l23 0 2024-08-31T05:20:57.983 INFO:tasks.workunit.client.1.smithi073.stdout:5/205: symlink dc/d16/d3b/d3f/l4d 0 2024-08-31T05:20:57.984 INFO:tasks.workunit.client.1.smithi073.stdout:7/191: truncate d1/da/f32 420230 0 2024-08-31T05:20:57.985 INFO:tasks.workunit.client.1.smithi073.stdout:5/206: write dc/f39 [3301769,37824] 0 2024-08-31T05:20:57.988 INFO:tasks.workunit.client.1.smithi073.stdout:7/192: dread d1/da/f26 [0,4194304] 0 2024-08-31T05:20:57.993 INFO:tasks.workunit.client.1.smithi073.stdout:5/207: dread dc/d16/d1a/f33 [0,4194304] 0 2024-08-31T05:20:57.993 INFO:tasks.workunit.client.1.smithi073.stdout:8/264: rename d0/db/f2b to d0/db/d1c/d34/f51 0 2024-08-31T05:20:57.993 INFO:tasks.workunit.client.1.smithi073.stdout:6/180: symlink d15/d1a/d2b/l39 0 2024-08-31T05:20:57.994 INFO:tasks.workunit.client.1.smithi073.stdout:0/260: mkdir d0/d15/d2c/d41/d52 0 2024-08-31T05:20:58.011 INFO:tasks.workunit.client.1.smithi073.stdout:5/208: unlink dc/d16/d26/f23 0 2024-08-31T05:20:58.019 INFO:tasks.workunit.client.1.smithi073.stdout:6/181: dwrite f9 [0,4194304] 0 2024-08-31T05:20:58.019 INFO:tasks.workunit.client.1.smithi073.stdout:4/229: getdents d7/df 0 2024-08-31T05:20:58.020 INFO:tasks.workunit.client.1.smithi073.stdout:2/239: dwrite d2/d9/df/f1f [0,4194304] 0 2024-08-31T05:20:58.020 INFO:tasks.workunit.client.1.smithi073.stdout:2/240: fsync f1 0 2024-08-31T05:20:58.022 INFO:tasks.workunit.client.1.smithi073.stdout:7/193: creat d1/d17/d22/d35/f37 x:0 0 0 2024-08-31T05:20:58.025 INFO:tasks.workunit.client.1.smithi073.stdout:8/265: mknod d0/c52 0 2024-08-31T05:20:58.026 INFO:tasks.workunit.client.1.smithi073.stdout:9/226: write f8 [1304181,25995] 0 2024-08-31T05:20:58.026 INFO:tasks.workunit.client.1.smithi073.stdout:2/241: dread d2/d9/f2a [0,4194304] 0 2024-08-31T05:20:58.027 INFO:tasks.workunit.client.1.smithi073.stdout:2/242: dread - d2/d9/d27/f33 zero size 2024-08-31T05:20:58.028 INFO:tasks.workunit.client.1.smithi073.stdout:5/209: stat l0 0 2024-08-31T05:20:58.032 INFO:tasks.workunit.client.1.smithi073.stdout:0/261: truncate d0/d15/d2c/d4d/d3c/f13 3283428 0 2024-08-31T05:20:58.032 INFO:tasks.workunit.client.1.smithi073.stdout:0/262: stat d0/d15/d2c/d4d/f3e 0 2024-08-31T05:20:58.037 INFO:tasks.workunit.client.1.smithi073.stdout:3/272: sync 2024-08-31T05:20:58.037 INFO:tasks.workunit.client.1.smithi073.stdout:3/273: chown l6 84779413 1 2024-08-31T05:20:58.046 INFO:tasks.workunit.client.1.smithi073.stdout:7/194: mkdir d1/da/d38 0 2024-08-31T05:20:58.046 INFO:tasks.workunit.client.1.smithi073.stdout:7/195: chown d1/da/d15/d33/f36 50871 1 2024-08-31T05:20:58.049 INFO:tasks.workunit.client.1.smithi073.stdout:8/266: unlink d0/db/d1c/d24/f28 0 2024-08-31T05:20:58.051 INFO:tasks.workunit.client.1.smithi073.stdout:9/227: unlink dc/d27/f47 0 2024-08-31T05:20:58.052 INFO:tasks.workunit.client.1.smithi073.stdout:2/243: rename d2/d9/df/c37 to d2/d9/df/c4b 0 2024-08-31T05:20:58.053 INFO:tasks.workunit.client.1.smithi073.stdout:2/244: chown d2/d9/df/f3e 1477437 1 2024-08-31T05:20:58.055 INFO:tasks.workunit.client.1.smithi073.stdout:1/199: truncate d5/d10/f16 3499619 0 2024-08-31T05:20:58.056 INFO:tasks.workunit.client.1.smithi073.stdout:0/263: chown d0/d15/d2c/d4d/d3c/ff 2006 1 2024-08-31T05:20:58.058 INFO:tasks.workunit.client.1.smithi073.stdout:2/245: dwrite d2/d9/d27/f2b [0,4194304] 0 2024-08-31T05:20:58.059 INFO:tasks.workunit.client.1.smithi073.stdout:3/274: creat da/d18/f5b x:0 0 0 2024-08-31T05:20:58.065 INFO:tasks.workunit.client.1.smithi073.stdout:3/275: dread da/d18/f38 [0,4194304] 0 2024-08-31T05:20:58.067 INFO:tasks.workunit.client.1.smithi073.stdout:9/228: dread dc/d27/f2e [0,4194304] 0 2024-08-31T05:20:58.070 INFO:tasks.workunit.client.1.smithi073.stdout:8/267: creat d0/db/d1c/d24/f53 x:0 0 0 2024-08-31T05:20:58.074 INFO:tasks.workunit.client.1.smithi073.stdout:5/210: mkdir dc/d16/d4e 0 2024-08-31T05:20:58.077 INFO:tasks.workunit.client.1.smithi073.stdout:1/200: creat d5/d10/f3a x:0 0 0 2024-08-31T05:20:58.079 INFO:tasks.workunit.client.1.smithi073.stdout:0/264: mknod d0/d15/d2c/d40/c53 0 2024-08-31T05:20:58.083 INFO:tasks.workunit.client.1.smithi073.stdout:7/196: mknod d1/da/d38/c39 0 2024-08-31T05:20:58.083 INFO:tasks.workunit.client.1.smithi073.stdout:1/201: dwrite d5/d10/d33/f36 [4194304,4194304] 0 2024-08-31T05:20:58.085 INFO:tasks.workunit.client.1.smithi073.stdout:9/229: dread f8 [0,4194304] 0 2024-08-31T05:20:58.086 INFO:tasks.workunit.client.1.smithi073.stdout:3/276: dread - da/d1b/f23 zero size 2024-08-31T05:20:58.086 INFO:tasks.workunit.client.1.smithi073.stdout:9/230: chown dc/d27 20902849 1 2024-08-31T05:20:58.091 INFO:tasks.workunit.client.1.smithi073.stdout:9/231: dwrite f7 [0,4194304] 0 2024-08-31T05:20:58.093 INFO:tasks.workunit.client.1.smithi073.stdout:5/211: mkdir dc/d16/d3b/d3f/d4f 0 2024-08-31T05:20:58.097 INFO:tasks.workunit.client.1.smithi073.stdout:6/182: getdents d15/d1a/d2b/d2f 0 2024-08-31T05:20:58.099 INFO:tasks.workunit.client.1.smithi073.stdout:7/197: rmdir d1 39 2024-08-31T05:20:58.100 INFO:tasks.workunit.client.1.smithi073.stdout:1/202: rmdir d5/d17/d32 39 2024-08-31T05:20:58.101 INFO:tasks.workunit.client.1.smithi073.stdout:1/203: write d5/d10/d33/f36 [8830089,15096] 0 2024-08-31T05:20:58.113 INFO:tasks.workunit.client.1.smithi073.stdout:5/212: rename dc/d3d/d3e/f4a to dc/d16/d3b/d3f/f50 0 2024-08-31T05:20:58.114 INFO:tasks.workunit.client.1.smithi073.stdout:5/213: truncate dc/d16/d3b/d3f/f50 925951 0 2024-08-31T05:20:58.114 INFO:tasks.workunit.client.1.smithi073.stdout:6/183: creat d15/d17/f3a x:0 0 0 2024-08-31T05:20:58.115 INFO:tasks.workunit.client.1.smithi073.stdout:5/214: dread - dc/d3d/f4c zero size 2024-08-31T05:20:58.115 INFO:tasks.workunit.client.1.smithi073.stdout:6/184: readlink d15/l18 0 2024-08-31T05:20:58.127 INFO:tasks.workunit.client.1.smithi073.stdout:5/215: rename dc/d16/d26/f43 to dc/d16/d26/f51 0 2024-08-31T05:20:58.127 INFO:tasks.workunit.client.1.smithi073.stdout:4/230: write d7/d1a/f29 [1137738,443] 0 2024-08-31T05:20:58.129 INFO:tasks.workunit.client.1.smithi073.stdout:7/198: mknod d1/c3a 0 2024-08-31T05:20:58.130 INFO:tasks.workunit.client.1.smithi073.stdout:1/204: creat d5/d17/d2a/f3b x:0 0 0 2024-08-31T05:20:58.131 INFO:tasks.workunit.client.1.smithi073.stdout:1/205: truncate d5/d26/f39 536592 0 2024-08-31T05:20:58.132 INFO:tasks.workunit.client.1.smithi073.stdout:3/277: creat da/d1b/f5c x:0 0 0 2024-08-31T05:20:58.136 INFO:tasks.workunit.client.1.smithi073.stdout:6/185: rename fe to d15/d17/f3b 0 2024-08-31T05:20:58.138 INFO:tasks.workunit.client.1.smithi073.stdout:5/216: mkdir dc/d52 0 2024-08-31T05:20:58.138 INFO:tasks.workunit.client.1.smithi073.stdout:5/217: fsync dc/d3d/f4b 0 2024-08-31T05:20:58.139 INFO:tasks.workunit.client.1.smithi073.stdout:4/231: mknod d7/df/d13/d2e/c45 0 2024-08-31T05:20:58.140 INFO:tasks.workunit.client.1.smithi073.stdout:4/232: chown d7/df/d13/d2e/c45 309 1 2024-08-31T05:20:58.142 INFO:tasks.workunit.client.1.smithi073.stdout:7/199: mknod d1/d17/c3b 0 2024-08-31T05:20:58.142 INFO:tasks.workunit.client.1.smithi073.stdout:7/200: stat d1/d11/l25 0 2024-08-31T05:20:58.146 INFO:tasks.workunit.client.1.smithi073.stdout:3/278: unlink da/d1b/l2b 0 2024-08-31T05:20:58.149 INFO:tasks.workunit.client.1.smithi073.stdout:6/186: symlink d15/d17/d26/l3c 0 2024-08-31T05:20:58.150 INFO:tasks.workunit.client.1.smithi073.stdout:6/187: fdatasync d15/d1a/f32 0 2024-08-31T05:20:58.154 INFO:tasks.workunit.client.1.smithi073.stdout:4/233: creat d7/f46 x:0 0 0 2024-08-31T05:20:58.155 INFO:tasks.workunit.client.1.smithi073.stdout:7/201: creat d1/d11/d14/f3c x:0 0 0 2024-08-31T05:20:58.156 INFO:tasks.workunit.client.1.smithi073.stdout:7/202: fsync d1/da/d15/d33/f36 0 2024-08-31T05:20:58.160 INFO:tasks.workunit.client.1.smithi073.stdout:3/279: mkdir da/d1b/d40/d5d 0 2024-08-31T05:20:58.165 INFO:tasks.workunit.client.1.smithi073.stdout:4/234: truncate d7/df/d13/f16 3735013 0 2024-08-31T05:20:58.168 INFO:tasks.workunit.client.1.smithi073.stdout:1/206: creat d5/d17/d32/d37/f3c x:0 0 0 2024-08-31T05:20:58.170 INFO:tasks.workunit.client.1.smithi073.stdout:3/280: creat da/d3c/f5e x:0 0 0 2024-08-31T05:20:58.171 INFO:tasks.workunit.client.1.smithi073.stdout:6/188: getdents d15/d17/d26/d38 0 2024-08-31T05:20:58.174 INFO:tasks.workunit.client.1.smithi073.stdout:4/235: mkdir d7/df/d13/d2e/d47 0 2024-08-31T05:20:58.175 INFO:tasks.workunit.client.1.smithi073.stdout:4/236: write d7/db/f2a [4081967,126991] 0 2024-08-31T05:20:58.179 INFO:tasks.workunit.client.1.smithi073.stdout:1/207: truncate f0 1616949 0 2024-08-31T05:20:58.179 INFO:tasks.workunit.client.1.smithi073.stdout:3/281: rmdir da/d1b/d45 39 2024-08-31T05:20:58.183 INFO:tasks.workunit.client.1.smithi073.stdout:5/218: getdents dc/d16/d3b 0 2024-08-31T05:20:58.184 INFO:tasks.workunit.client.1.smithi073.stdout:3/282: dwrite da/d1b/f20 [0,4194304] 0 2024-08-31T05:20:58.184 INFO:tasks.workunit.client.1.smithi073.stdout:3/283: chown da/d18 2 1 2024-08-31T05:20:58.185 INFO:tasks.workunit.client.1.smithi073.stdout:3/284: write da/f14 [4021327,26898] 0 2024-08-31T05:20:58.186 INFO:tasks.workunit.client.1.smithi073.stdout:3/285: read - da/d1b/f4c zero size 2024-08-31T05:20:58.188 INFO:tasks.workunit.client.1.smithi073.stdout:4/237: creat d7/df/d13/d2e/f48 x:0 0 0 2024-08-31T05:20:58.189 INFO:tasks.workunit.client.1.smithi073.stdout:4/238: read d7/df/d1b/f1f [1428344,4288] 0 2024-08-31T05:20:58.194 INFO:tasks.workunit.client.1.smithi073.stdout:8/268: truncate d0/f27 1691750 0 2024-08-31T05:20:58.195 INFO:tasks.workunit.client.1.smithi073.stdout:6/189: creat d15/d17/d26/d38/f3d x:0 0 0 2024-08-31T05:20:58.199 INFO:tasks.workunit.client.1.smithi073.stdout:9/232: dwrite dc/de/d11/d41/f39 [0,4194304] 0 2024-08-31T05:20:58.200 INFO:tasks.workunit.client.1.smithi073.stdout:9/233: chown dc/de/c1d 142 1 2024-08-31T05:20:58.201 INFO:tasks.workunit.client.1.smithi073.stdout:7/203: link d1/d11/d14/c16 d1/da/d15/c3d 0 2024-08-31T05:20:58.210 INFO:tasks.workunit.client.1.smithi073.stdout:4/239: rename d7/df/f1e to d7/df/d1b/d34/f49 0 2024-08-31T05:20:58.221 INFO:tasks.workunit.client.1.smithi073.stdout:9/234: creat dc/d10/f49 x:0 0 0 2024-08-31T05:20:58.229 INFO:tasks.workunit.client.1.smithi073.stdout:8/269: unlink d0/db/d1c/d34/d38/c49 0 2024-08-31T05:20:58.231 INFO:tasks.workunit.client.1.smithi073.stdout:7/204: rename d1/d17 to d1/da/d3e 0 2024-08-31T05:20:58.232 INFO:tasks.workunit.client.1.smithi073.stdout:9/235: mknod dc/de/c4a 0 2024-08-31T05:20:58.232 INFO:tasks.workunit.client.1.smithi073.stdout:7/205: dread d1/da/f32 [0,4194304] 0 2024-08-31T05:20:58.244 INFO:tasks.workunit.client.1.smithi073.stdout:9/236: fdatasync dc/de/d11/f43 0 2024-08-31T05:20:58.247 INFO:tasks.workunit.client.1.smithi073.stdout:9/237: dread dc/d10/f18 [0,4194304] 0 2024-08-31T05:20:58.248 INFO:tasks.workunit.client.1.smithi073.stdout:3/286: getdents da/d1b/d40 0 2024-08-31T05:20:58.264 INFO:tasks.workunit.client.1.smithi073.stdout:2/246: sync 2024-08-31T05:20:58.268 INFO:tasks.workunit.client.1.smithi073.stdout:1/208: dwrite d5/d17/f2f [0,4194304] 0 2024-08-31T05:20:58.270 INFO:tasks.workunit.client.1.smithi073.stdout:5/219: truncate f9 3738813 0 2024-08-31T05:20:58.271 INFO:tasks.workunit.client.1.smithi073.stdout:2/247: creat d2/d9/df/d36/f4c x:0 0 0 2024-08-31T05:20:58.274 INFO:tasks.workunit.client.1.smithi073.stdout:1/209: rename d5/d10/f3a to d5/d17/d32/f3d 0 2024-08-31T05:20:58.276 INFO:tasks.workunit.client.1.smithi073.stdout:8/270: dwrite d0/db/d1c/f1f [4194304,4194304] 0 2024-08-31T05:20:58.300 INFO:tasks.workunit.client.1.smithi073.stdout:3/287: getdents da/d1b 0 2024-08-31T05:20:58.301 INFO:tasks.workunit.client.1.smithi073.stdout:2/248: mknod d2/d9/c4d 0 2024-08-31T05:20:58.304 INFO:tasks.workunit.client.1.smithi073.stdout:8/271: mknod d0/db/d1c/d23/c54 0 2024-08-31T05:20:58.305 INFO:tasks.workunit.client.1.smithi073.stdout:4/240: rename d7/df/d13/c30 to d7/d24/c4a 0 2024-08-31T05:20:58.306 INFO:tasks.workunit.client.1.smithi073.stdout:9/238: truncate dc/d37/f3d 125956 0 2024-08-31T05:20:58.307 INFO:tasks.workunit.client.1.smithi073.stdout:2/249: dwrite d2/d9/df/f2e [0,4194304] 0 2024-08-31T05:20:58.308 INFO:tasks.workunit.client.1.smithi073.stdout:9/239: write dc/de/d11/d41/f39 [2477266,7809] 0 2024-08-31T05:20:58.309 INFO:tasks.workunit.client.1.smithi073.stdout:2/250: dread - d2/d9/df/f3e zero size 2024-08-31T05:20:58.309 INFO:tasks.workunit.client.1.smithi073.stdout:3/288: rename da/d18/l51 to da/d1b/d2c/l5f 0 2024-08-31T05:20:58.311 INFO:tasks.workunit.client.1.smithi073.stdout:4/241: mknod d7/c4b 0 2024-08-31T05:20:58.311 INFO:tasks.workunit.client.1.smithi073.stdout:3/289: dread - da/d1b/d40/f57 zero size 2024-08-31T05:20:58.311 INFO:tasks.workunit.client.1.smithi073.stdout:5/220: truncate dc/d16/f2b 68801 0 2024-08-31T05:20:58.315 INFO:tasks.workunit.client.1.smithi073.stdout:2/251: rmdir d2/d9 39 2024-08-31T05:20:58.316 INFO:tasks.workunit.client.1.smithi073.stdout:4/242: mkdir d7/df/d13/d2e/d47/d4c 0 2024-08-31T05:20:58.317 INFO:tasks.workunit.client.1.smithi073.stdout:9/240: dwrite dc/f25 [0,4194304] 0 2024-08-31T05:20:58.318 INFO:tasks.workunit.client.1.smithi073.stdout:3/290: getdents da/d3c 0 2024-08-31T05:20:58.321 INFO:tasks.workunit.client.1.smithi073.stdout:2/252: symlink d2/d9/df/l4e 0 2024-08-31T05:20:58.322 INFO:tasks.workunit.client.1.smithi073.stdout:9/241: creat dc/de/d11/d41/f4b x:0 0 0 2024-08-31T05:20:58.323 INFO:tasks.workunit.client.1.smithi073.stdout:4/243: dread d7/db/f2a [0,4194304] 0 2024-08-31T05:20:58.325 INFO:tasks.workunit.client.1.smithi073.stdout:9/242: creat dc/d10/f4c x:0 0 0 2024-08-31T05:20:58.327 INFO:tasks.workunit.client.1.smithi073.stdout:3/291: dread da/d1b/d2c/f2e [0,4194304] 0 2024-08-31T05:20:58.327 INFO:tasks.workunit.client.1.smithi073.stdout:4/244: chown d7/df/d13/d2e/f36 289806 1 2024-08-31T05:20:58.327 INFO:tasks.workunit.client.1.smithi073.stdout:2/253: creat d2/f4f x:0 0 0 2024-08-31T05:20:58.329 INFO:tasks.workunit.client.1.smithi073.stdout:3/292: creat da/d3c/f60 x:0 0 0 2024-08-31T05:20:58.331 INFO:tasks.workunit.client.1.smithi073.stdout:9/243: dwrite dc/f3c [4194304,4194304] 0 2024-08-31T05:20:58.331 INFO:tasks.workunit.client.1.smithi073.stdout:2/254: getdents d2/d9/d27 0 2024-08-31T05:20:58.332 INFO:tasks.workunit.client.1.smithi073.stdout:9/244: fdatasync fb 0 2024-08-31T05:20:58.333 INFO:tasks.workunit.client.1.smithi073.stdout:2/255: fsync d2/d9/d32/f39 0 2024-08-31T05:20:58.333 INFO:tasks.workunit.client.1.smithi073.stdout:2/256: dread - d2/f4f zero size 2024-08-31T05:20:58.334 INFO:tasks.workunit.client.1.smithi073.stdout:2/257: chown d2/d9/d27/l38 60630 1 2024-08-31T05:20:58.336 INFO:tasks.workunit.client.1.smithi073.stdout:9/245: symlink dc/d37/l4d 0 2024-08-31T05:20:58.337 INFO:tasks.workunit.client.1.smithi073.stdout:2/258: mknod d2/d9/df/d36/c50 0 2024-08-31T05:20:58.337 INFO:tasks.workunit.client.1.smithi073.stdout:8/272: dread d0/db/d1c/d24/f32 [0,4194304] 0 2024-08-31T05:20:58.338 INFO:tasks.workunit.client.1.smithi073.stdout:9/246: mknod dc/de/d11/d41/c4e 0 2024-08-31T05:20:58.339 INFO:tasks.workunit.client.1.smithi073.stdout:9/247: chown dc/d37/l4d 5062241 1 2024-08-31T05:20:58.339 INFO:tasks.workunit.client.1.smithi073.stdout:2/259: dread d2/d9/f2a [0,4194304] 0 2024-08-31T05:20:58.341 INFO:tasks.workunit.client.1.smithi073.stdout:9/248: truncate dc/de/d11/d41/f4b 15059 0 2024-08-31T05:20:58.342 INFO:tasks.workunit.client.1.smithi073.stdout:8/273: link d0/db/d1c/d34/d38/f43 d0/db/d1c/d34/f55 0 2024-08-31T05:20:58.343 INFO:tasks.workunit.client.1.smithi073.stdout:2/260: mknod d2/d9/d3c/c51 0 2024-08-31T05:20:58.345 INFO:tasks.workunit.client.1.smithi073.stdout:9/249: unlink dc/d10/l48 0 2024-08-31T05:20:58.345 INFO:tasks.workunit.client.1.smithi073.stdout:9/250: chown dc/d37 168 1 2024-08-31T05:20:58.347 INFO:tasks.workunit.client.1.smithi073.stdout:2/261: stat d2/l3f 0 2024-08-31T05:20:58.347 INFO:tasks.workunit.client.1.smithi073.stdout:2/262: readlink d2/d9/df/d36/l48 0 2024-08-31T05:20:58.348 INFO:tasks.workunit.client.1.smithi073.stdout:2/263: fsync d2/d9/f24 0 2024-08-31T05:20:58.348 INFO:tasks.workunit.client.1.smithi073.stdout:9/251: creat dc/de/f4f x:0 0 0 2024-08-31T05:20:58.349 INFO:tasks.workunit.client.1.smithi073.stdout:2/264: write d2/d9/df/f29 [3511140,81444] 0 2024-08-31T05:20:58.351 INFO:tasks.workunit.client.1.smithi073.stdout:8/274: rename d0/c6 to d0/c56 0 2024-08-31T05:20:58.352 INFO:tasks.workunit.client.1.smithi073.stdout:2/265: symlink d2/d25/l52 0 2024-08-31T05:20:58.352 INFO:tasks.workunit.client.1.smithi073.stdout:8/275: chown d0/db/d44/d4e/c40 114 1 2024-08-31T05:20:58.354 INFO:tasks.workunit.client.1.smithi073.stdout:2/266: creat d2/d9/df/f53 x:0 0 0 2024-08-31T05:20:58.357 INFO:tasks.workunit.client.1.smithi073.stdout:2/267: unlink d2/d25/l52 0 2024-08-31T05:20:58.360 INFO:tasks.workunit.client.1.smithi073.stdout:8/276: rename d0/db/d1c/l31 to d0/db/d1c/d2a/l57 0 2024-08-31T05:20:58.360 INFO:tasks.workunit.client.1.smithi073.stdout:9/252: dread fb [0,4194304] 0 2024-08-31T05:20:58.363 INFO:tasks.workunit.client.1.smithi073.stdout:9/253: unlink c6 0 2024-08-31T05:20:58.366 INFO:tasks.workunit.client.1.smithi073.stdout:9/254: creat dc/de/d11/d41/f50 x:0 0 0 2024-08-31T05:20:58.367 INFO:tasks.workunit.client.1.smithi073.stdout:9/255: write dc/d10/f3e [127957,35883] 0 2024-08-31T05:20:58.373 INFO:tasks.workunit.client.1.smithi073.stdout:9/256: dwrite f5 [4194304,4194304] 0 2024-08-31T05:20:58.385 INFO:tasks.workunit.client.1.smithi073.stdout:8/277: mkdir d0/db/d1c/d2a/d58 0 2024-08-31T05:20:58.386 INFO:tasks.workunit.client.1.smithi073.stdout:6/190: sync 2024-08-31T05:20:58.386 INFO:tasks.workunit.client.1.smithi073.stdout:0/265: sync 2024-08-31T05:20:58.386 INFO:tasks.workunit.client.1.smithi073.stdout:6/191: fsync fa 0 2024-08-31T05:20:58.388 INFO:tasks.workunit.client.1.smithi073.stdout:8/278: symlink d0/db/d44/l59 0 2024-08-31T05:20:58.390 INFO:tasks.workunit.client.1.smithi073.stdout:6/192: rmdir d15/d17/d26 39 2024-08-31T05:20:58.391 INFO:tasks.workunit.client.1.smithi073.stdout:8/279: fdatasync d0/db/d1c/d23/f41 0 2024-08-31T05:20:58.393 INFO:tasks.workunit.client.1.smithi073.stdout:0/266: creat d0/d15/d2c/d4d/f54 x:0 0 0 2024-08-31T05:20:58.394 INFO:tasks.workunit.client.1.smithi073.stdout:9/257: dwrite dc/d10/f29 [0,4194304] 0 2024-08-31T05:20:58.394 INFO:tasks.workunit.client.1.smithi073.stdout:8/280: creat d0/db/f5a x:0 0 0 2024-08-31T05:20:58.395 INFO:tasks.workunit.client.1.smithi073.stdout:8/281: chown d0/db/d44/f4d 2038 1 2024-08-31T05:20:58.397 INFO:tasks.workunit.client.1.smithi073.stdout:6/193: link d15/d17/d26/d38/f3d d15/d1a/d1e/f3e 0 2024-08-31T05:20:58.401 INFO:tasks.workunit.client.1.smithi073.stdout:9/258: truncate dc/d27/f38 543535 0 2024-08-31T05:20:58.401 INFO:tasks.workunit.client.1.smithi073.stdout:8/282: creat d0/db/d1c/d34/d38/f5b x:0 0 0 2024-08-31T05:20:58.403 INFO:tasks.workunit.client.1.smithi073.stdout:6/194: truncate d15/d17/f3b 2016566 0 2024-08-31T05:20:58.403 INFO:tasks.workunit.client.1.smithi073.stdout:8/283: truncate d0/db/f22 933360 0 2024-08-31T05:20:58.406 INFO:tasks.workunit.client.1.smithi073.stdout:6/195: rmdir d15/d17/d26/d38 39 2024-08-31T05:20:58.406 INFO:tasks.workunit.client.1.smithi073.stdout:9/259: dwrite f5 [0,4194304] 0 2024-08-31T05:20:58.415 INFO:tasks.workunit.client.1.smithi073.stdout:8/284: dwrite d0/db/d1c/d23/f26 [0,4194304] 0 2024-08-31T05:20:58.416 INFO:tasks.workunit.client.1.smithi073.stdout:9/260: rename dc/de/d11/d41/c44 to dc/de/c51 0 2024-08-31T05:20:58.418 INFO:tasks.workunit.client.1.smithi073.stdout:8/285: stat d0/db/d1c/d24/f32 0 2024-08-31T05:20:58.422 INFO:tasks.workunit.client.1.smithi073.stdout:8/286: creat d0/db/d44/d4e/f5c x:0 0 0 2024-08-31T05:20:58.423 INFO:tasks.workunit.client.1.smithi073.stdout:6/196: dwrite fd [0,4194304] 0 2024-08-31T05:20:58.424 INFO:tasks.workunit.client.1.smithi073.stdout:0/267: dread d0/d15/d2c/d2e/f3f [0,4194304] 0 2024-08-31T05:20:58.425 INFO:tasks.workunit.client.1.smithi073.stdout:8/287: write d0/db/d1c/f3b [712222,34308] 0 2024-08-31T05:20:58.425 INFO:tasks.workunit.client.1.smithi073.stdout:0/268: write d0/f32 [594322,67856] 0 2024-08-31T05:20:58.428 INFO:tasks.workunit.client.1.smithi073.stdout:8/288: chown d0/f45 0 1 2024-08-31T05:20:58.429 INFO:tasks.workunit.client.1.smithi073.stdout:6/197: creat d15/d1a/d2b/d2f/f3f x:0 0 0 2024-08-31T05:20:58.430 INFO:tasks.workunit.client.1.smithi073.stdout:8/289: fdatasync d0/db/d44/d4e/f5c 0 2024-08-31T05:20:58.431 INFO:tasks.workunit.client.1.smithi073.stdout:0/269: chown d0/d15/d2c/d4d/d3c/c24 2074637842 1 2024-08-31T05:20:58.432 INFO:tasks.workunit.client.1.smithi073.stdout:8/290: fdatasync d0/db/d1c/d23/f2f 0 2024-08-31T05:20:58.434 INFO:tasks.workunit.client.1.smithi073.stdout:9/261: dwrite dc/d10/f18 [0,4194304] 0 2024-08-31T05:20:58.434 INFO:tasks.workunit.client.1.smithi073.stdout:6/198: creat d15/d17/d26/d38/f40 x:0 0 0 2024-08-31T05:20:58.435 INFO:tasks.workunit.client.1.smithi073.stdout:8/291: symlink d0/db/d1c/d34/l5d 0 2024-08-31T05:20:58.436 INFO:tasks.workunit.client.1.smithi073.stdout:0/270: creat d0/d15/d2c/d41/d52/f55 x:0 0 0 2024-08-31T05:20:58.437 INFO:tasks.workunit.client.1.smithi073.stdout:9/262: unlink dc/d10/f3e 0 2024-08-31T05:20:58.438 INFO:tasks.workunit.client.1.smithi073.stdout:6/199: mkdir d15/d41 0 2024-08-31T05:20:58.440 INFO:tasks.workunit.client.1.smithi073.stdout:0/271: creat d0/d15/d2c/d40/f56 x:0 0 0 2024-08-31T05:20:58.440 INFO:tasks.workunit.client.1.smithi073.stdout:9/263: mkdir dc/de/d11/d41/d52 0 2024-08-31T05:20:58.440 INFO:tasks.workunit.client.1.smithi073.stdout:8/292: truncate d0/f27 2212528 0 2024-08-31T05:20:58.442 INFO:tasks.workunit.client.1.smithi073.stdout:0/272: unlink d0/d15/d2c/d4d/d3c/ld 0 2024-08-31T05:20:58.442 INFO:tasks.workunit.client.1.smithi073.stdout:8/293: truncate d0/db/d1c/f3b 991936 0 2024-08-31T05:20:58.444 INFO:tasks.workunit.client.1.smithi073.stdout:6/200: mknod d15/c42 0 2024-08-31T05:20:58.445 INFO:tasks.workunit.client.1.smithi073.stdout:6/201: write d15/d17/f3a [393046,48485] 0 2024-08-31T05:20:58.452 INFO:tasks.workunit.client.1.smithi073.stdout:7/206: sync 2024-08-31T05:20:58.475 INFO:tasks.workunit.client.1.smithi073.stdout:8/294: rmdir d0/db/d1c/d24 39 2024-08-31T05:20:58.476 INFO:tasks.workunit.client.1.smithi073.stdout:9/264: rename dc/d37/f3d to dc/d10/f53 0 2024-08-31T05:20:58.479 INFO:tasks.workunit.client.1.smithi073.stdout:8/295: dwrite d0/f5 [0,4194304] 0 2024-08-31T05:20:58.479 INFO:tasks.workunit.client.1.smithi073.stdout:9/265: creat dc/d37/f54 x:0 0 0 2024-08-31T05:20:58.481 INFO:tasks.workunit.client.1.smithi073.stdout:0/273: getdents d0/d15/d2c/d4d 0 2024-08-31T05:20:58.482 INFO:tasks.workunit.client.1.smithi073.stdout:0/274: chown d0/d15/d2c/d40/f56 6 1 2024-08-31T05:20:58.483 INFO:tasks.workunit.client.1.smithi073.stdout:0/275: truncate d0/f21 5666586 0 2024-08-31T05:20:58.484 INFO:tasks.workunit.client.1.smithi073.stdout:0/276: stat d0/d28/f2d 0 2024-08-31T05:20:58.484 INFO:tasks.workunit.client.1.smithi073.stdout:7/207: link d1/d11/c2f d1/d11/c3f 0 2024-08-31T05:20:58.487 INFO:tasks.workunit.client.1.smithi073.stdout:8/296: creat d0/f5e x:0 0 0 2024-08-31T05:20:58.489 INFO:tasks.workunit.client.1.smithi073.stdout:9/266: link dc/d27/l3b dc/d37/d42/l55 0 2024-08-31T05:20:58.491 INFO:tasks.workunit.client.1.smithi073.stdout:9/267: mkdir dc/de/d56 0 2024-08-31T05:20:58.492 INFO:tasks.workunit.client.1.smithi073.stdout:9/268: truncate dc/d10/f4c 841937 0 2024-08-31T05:20:58.493 INFO:tasks.workunit.client.1.smithi073.stdout:8/297: chown d0/db/d1c/d2a/l57 949129 1 2024-08-31T05:20:58.493 INFO:tasks.workunit.client.1.smithi073.stdout:7/208: dread d1/da/f34 [0,4194304] 0 2024-08-31T05:20:58.494 INFO:tasks.workunit.client.1.smithi073.stdout:7/209: read - d1/d11/d14/f3c zero size 2024-08-31T05:20:58.494 INFO:tasks.workunit.client.1.smithi073.stdout:8/298: chown d0/db/d1c/d23 1175093 1 2024-08-31T05:20:58.496 INFO:tasks.workunit.client.1.smithi073.stdout:8/299: chown d0/db/d1c/f1f 2674488 1 2024-08-31T05:20:58.496 INFO:tasks.workunit.client.1.smithi073.stdout:7/210: symlink d1/da/d38/l40 0 2024-08-31T05:20:58.497 INFO:tasks.workunit.client.1.smithi073.stdout:9/269: dwrite f7 [0,4194304] 0 2024-08-31T05:20:58.498 INFO:tasks.workunit.client.1.smithi073.stdout:8/300: mkdir d0/db/d44/d4e/d5f 0 2024-08-31T05:20:58.502 INFO:tasks.workunit.client.1.smithi073.stdout:9/270: truncate dc/d27/f38 700917 0 2024-08-31T05:20:58.504 INFO:tasks.workunit.client.1.smithi073.stdout:9/271: write dc/d37/f35 [1094965,118841] 0 2024-08-31T05:20:58.505 INFO:tasks.workunit.client.1.smithi073.stdout:8/301: creat d0/db/d1c/d34/d38/f60 x:0 0 0 2024-08-31T05:20:58.506 INFO:tasks.workunit.client.1.smithi073.stdout:7/211: dwrite d1/da/d15/f24 [0,4194304] 0 2024-08-31T05:20:58.508 INFO:tasks.workunit.client.1.smithi073.stdout:0/277: dread d0/d15/f37 [0,4194304] 0 2024-08-31T05:20:58.509 INFO:tasks.workunit.client.1.smithi073.stdout:9/272: stat dc/d10/f53 0 2024-08-31T05:20:58.510 INFO:tasks.workunit.client.1.smithi073.stdout:8/302: symlink d0/db/d44/d4e/l61 0 2024-08-31T05:20:58.511 INFO:tasks.workunit.client.1.smithi073.stdout:7/212: creat d1/da/d3e/d22/f41 x:0 0 0 2024-08-31T05:20:58.512 INFO:tasks.workunit.client.1.smithi073.stdout:9/273: read dc/d10/f33 [4167080,101760] 0 2024-08-31T05:20:58.513 INFO:tasks.workunit.client.1.smithi073.stdout:0/278: getdents d0/d28/d4f 0 2024-08-31T05:20:58.515 INFO:tasks.workunit.client.1.smithi073.stdout:8/303: mkdir d0/d62 0 2024-08-31T05:20:58.516 INFO:tasks.workunit.client.1.smithi073.stdout:7/213: creat d1/da/d15/d33/f42 x:0 0 0 2024-08-31T05:20:58.517 INFO:tasks.workunit.client.1.smithi073.stdout:9/274: creat dc/de/d11/d41/f57 x:0 0 0 2024-08-31T05:20:58.518 INFO:tasks.workunit.client.1.smithi073.stdout:0/279: creat d0/d15/d2c/d2e/f57 x:0 0 0 2024-08-31T05:20:58.518 INFO:tasks.workunit.client.1.smithi073.stdout:0/280: fsync d0/f21 0 2024-08-31T05:20:58.519 INFO:tasks.workunit.client.1.smithi073.stdout:8/304: creat d0/db/d44/d4e/f63 x:0 0 0 2024-08-31T05:20:58.520 INFO:tasks.workunit.client.1.smithi073.stdout:7/214: creat d1/f43 x:0 0 0 2024-08-31T05:20:58.520 INFO:tasks.workunit.client.1.smithi073.stdout:9/275: mknod dc/d37/d42/c58 0 2024-08-31T05:20:58.522 INFO:tasks.workunit.client.1.smithi073.stdout:8/305: creat d0/db/d1c/d34/d38/f64 x:0 0 0 2024-08-31T05:20:58.524 INFO:tasks.workunit.client.1.smithi073.stdout:0/281: mkdir d0/d58 0 2024-08-31T05:20:58.525 INFO:tasks.workunit.client.1.smithi073.stdout:0/282: dread - d0/d15/d2c/d2e/f57 zero size 2024-08-31T05:20:58.525 INFO:tasks.workunit.client.1.smithi073.stdout:8/306: chown d0/db/d1c/d24/c4a 1 1 2024-08-31T05:20:58.525 INFO:tasks.workunit.client.1.smithi073.stdout:9/276: getdents dc/de 0 2024-08-31T05:20:58.526 INFO:tasks.workunit.client.1.smithi073.stdout:0/283: symlink d0/d15/d2c/l59 0 2024-08-31T05:20:58.527 INFO:tasks.workunit.client.1.smithi073.stdout:9/277: write dc/d37/f35 [338616,90763] 0 2024-08-31T05:20:58.527 INFO:tasks.workunit.client.1.smithi073.stdout:8/307: getdents d0/db/d44/d4e/d5f 0 2024-08-31T05:20:58.527 INFO:tasks.workunit.client.1.smithi073.stdout:5/221: sync 2024-08-31T05:20:58.527 INFO:tasks.workunit.client.1.smithi073.stdout:1/210: sync 2024-08-31T05:20:58.528 INFO:tasks.workunit.client.1.smithi073.stdout:9/278: dread - dc/de/f4f zero size 2024-08-31T05:20:58.529 INFO:tasks.workunit.client.1.smithi073.stdout:5/222: mkdir dc/d53 0 2024-08-31T05:20:58.531 INFO:tasks.workunit.client.1.smithi073.stdout:1/211: creat d5/f3e x:0 0 0 2024-08-31T05:20:58.536 INFO:tasks.workunit.client.1.smithi073.stdout:1/212: chown d5/d17/d32/d37/f3c 8228555 1 2024-08-31T05:20:58.537 INFO:tasks.workunit.client.1.smithi073.stdout:0/284: dwrite d0/d15/d2c/d2e/d3d/f43 [0,4194304] 0 2024-08-31T05:20:58.537 INFO:tasks.workunit.client.1.smithi073.stdout:8/308: link d0/db/d1c/d34/d38/c50 d0/db/d1c/d23/c65 0 2024-08-31T05:20:58.539 INFO:tasks.workunit.client.1.smithi073.stdout:9/279: dwrite dc/d10/f18 [0,4194304] 0 2024-08-31T05:20:58.540 INFO:tasks.workunit.client.1.smithi073.stdout:1/213: unlink d5/d10/d33/f18 0 2024-08-31T05:20:58.540 INFO:tasks.workunit.client.1.smithi073.stdout:0/285: rmdir d0/d15/d2c/d2e 39 2024-08-31T05:20:58.540 INFO:tasks.workunit.client.1.smithi073.stdout:5/223: dread dc/d16/d1a/f33 [0,4194304] 0 2024-08-31T05:20:58.544 INFO:tasks.workunit.client.1.smithi073.stdout:1/214: chown d5/d10/d33/fe 9 1 2024-08-31T05:20:58.545 INFO:tasks.workunit.client.1.smithi073.stdout:9/280: creat dc/d37/d42/f59 x:0 0 0 2024-08-31T05:20:58.546 INFO:tasks.workunit.client.1.smithi073.stdout:1/215: write d5/f25 [796622,57093] 0 2024-08-31T05:20:58.546 INFO:tasks.workunit.client.1.smithi073.stdout:8/309: dread d0/db/d1c/d34/d38/f43 [0,4194304] 0 2024-08-31T05:20:58.547 INFO:tasks.workunit.client.1.smithi073.stdout:1/216: chown d5/fc 9057 1 2024-08-31T05:20:58.548 INFO:tasks.workunit.client.1.smithi073.stdout:0/286: creat d0/d15/d2c/d40/f5a x:0 0 0 2024-08-31T05:20:58.549 INFO:tasks.workunit.client.1.smithi073.stdout:0/287: stat d0/d15 0 2024-08-31T05:20:58.550 INFO:tasks.workunit.client.1.smithi073.stdout:9/281: mkdir dc/d37/d42/d5a 0 2024-08-31T05:20:58.550 INFO:tasks.workunit.client.1.smithi073.stdout:1/217: truncate d5/f7 1709192 0 2024-08-31T05:20:58.552 INFO:tasks.workunit.client.1.smithi073.stdout:5/224: creat dc/d16/f54 x:0 0 0 2024-08-31T05:20:58.552 INFO:tasks.workunit.client.1.smithi073.stdout:0/288: write d0/d15/d2c/d40/f47 [1697966,65557] 0 2024-08-31T05:20:58.553 INFO:tasks.workunit.client.1.smithi073.stdout:5/225: fdatasync dc/d3d/f4c 0 2024-08-31T05:20:58.555 INFO:tasks.workunit.client.1.smithi073.stdout:1/218: unlink f2 0 2024-08-31T05:20:58.556 INFO:tasks.workunit.client.1.smithi073.stdout:8/310: dwrite d0/db/d44/d4e/f5c [0,4194304] 0 2024-08-31T05:20:58.556 INFO:tasks.workunit.client.1.smithi073.stdout:5/226: mkdir dc/d3d/d55 0 2024-08-31T05:20:58.557 INFO:tasks.workunit.client.1.smithi073.stdout:0/289: chown d0/d15/d2c/d4d/f3e 590 1 2024-08-31T05:20:58.560 INFO:tasks.workunit.client.1.smithi073.stdout:0/290: rmdir d0/d15/d2c 39 2024-08-31T05:20:58.561 INFO:tasks.workunit.client.1.smithi073.stdout:1/219: mkdir d5/d17/d3f 0 2024-08-31T05:20:58.563 INFO:tasks.workunit.client.1.smithi073.stdout:8/311: creat d0/db/d1c/d2a/d58/f66 x:0 0 0 2024-08-31T05:20:58.565 INFO:tasks.workunit.client.1.smithi073.stdout:5/227: rmdir dc/d16/d3b/d3c 0 2024-08-31T05:20:58.569 INFO:tasks.workunit.client.1.smithi073.stdout:8/312: stat d0/db/d1c/f20 0 2024-08-31T05:20:58.569 INFO:tasks.workunit.client.1.smithi073.stdout:8/313: dread - d0/f5e zero size 2024-08-31T05:20:58.572 INFO:tasks.workunit.client.1.smithi073.stdout:8/314: fdatasync d0/db/d1c/d2a/d58/f66 0 2024-08-31T05:20:58.572 INFO:tasks.workunit.client.1.smithi073.stdout:5/228: read fb [2269156,82235] 0 2024-08-31T05:20:58.573 INFO:tasks.workunit.client.1.smithi073.stdout:5/229: readlink dc/d16/d1a/l3a 0 2024-08-31T05:20:58.575 INFO:tasks.workunit.client.1.smithi073.stdout:9/282: dwrite dc/d27/f2e [0,4194304] 0 2024-08-31T05:20:58.576 INFO:tasks.workunit.client.1.smithi073.stdout:1/220: truncate d5/f19 4412465 0 2024-08-31T05:20:58.577 INFO:tasks.workunit.client.1.smithi073.stdout:9/283: stat dc/de/d11/d41/c4e 0 2024-08-31T05:20:58.579 INFO:tasks.workunit.client.1.smithi073.stdout:8/315: dwrite d0/db/d1c/f1f [0,4194304] 0 2024-08-31T05:20:58.580 INFO:tasks.workunit.client.1.smithi073.stdout:8/316: write d0/f45 [52787,45710] 0 2024-08-31T05:20:58.581 INFO:tasks.workunit.client.1.smithi073.stdout:1/221: mknod d5/d10/d2e/c40 0 2024-08-31T05:20:58.582 INFO:tasks.workunit.client.1.smithi073.stdout:8/317: write d0/db/d1c/d23/f2f [1504712,55290] 0 2024-08-31T05:20:58.585 INFO:tasks.workunit.client.1.smithi073.stdout:9/284: unlink dc/d27/l2f 0 2024-08-31T05:20:58.585 INFO:tasks.workunit.client.1.smithi073.stdout:5/230: link dc/d16/d1a/l38 dc/d16/d3b/d3f/d4f/l56 0 2024-08-31T05:20:58.588 INFO:tasks.workunit.client.1.smithi073.stdout:9/285: read dc/d10/f33 [479834,44351] 0 2024-08-31T05:20:58.590 INFO:tasks.workunit.client.1.smithi073.stdout:9/286: rmdir dc/d10 39 2024-08-31T05:20:58.591 INFO:tasks.workunit.client.1.smithi073.stdout:8/318: dwrite d0/db/d44/d4e/f5c [0,4194304] 0 2024-08-31T05:20:58.597 INFO:tasks.workunit.client.1.smithi073.stdout:5/231: dwrite dc/d16/f54 [0,4194304] 0 2024-08-31T05:20:58.598 INFO:tasks.workunit.client.1.smithi073.stdout:9/287: fdatasync dc/d10/f26 0 2024-08-31T05:20:58.601 INFO:tasks.workunit.client.1.smithi073.stdout:9/288: fdatasync f9 0 2024-08-31T05:20:58.605 INFO:tasks.workunit.client.1.smithi073.stdout:8/319: dread d0/f5 [0,4194304] 0 2024-08-31T05:20:58.605 INFO:tasks.workunit.client.1.smithi073.stdout:9/289: truncate dc/de/d11/d41/f50 509177 0 2024-08-31T05:20:58.608 INFO:tasks.workunit.client.1.smithi073.stdout:5/232: readlink dc/d16/d3b/d3f/d4f/l56 0 2024-08-31T05:20:58.608 INFO:tasks.workunit.client.1.smithi073.stdout:5/233: stat dc/d16/d3b/c40 0 2024-08-31T05:20:58.612 INFO:tasks.workunit.client.1.smithi073.stdout:8/320: dread - d0/db/d1c/d24/f48 zero size 2024-08-31T05:20:58.614 INFO:tasks.workunit.client.1.smithi073.stdout:5/234: symlink dc/d16/d4e/l57 0 2024-08-31T05:20:58.618 INFO:tasks.workunit.client.1.smithi073.stdout:5/235: link dc/f17 dc/d52/f58 0 2024-08-31T05:20:58.619 INFO:tasks.workunit.client.1.smithi073.stdout:5/236: mknod dc/d3d/d3e/c59 0 2024-08-31T05:20:58.626 INFO:tasks.workunit.client.1.smithi073.stdout:5/237: dwrite dc/d3d/f4b [0,4194304] 0 2024-08-31T05:20:58.628 INFO:tasks.workunit.client.1.smithi073.stdout:9/290: dwrite dc/f25 [4194304,4194304] 0 2024-08-31T05:20:58.633 INFO:tasks.workunit.client.1.smithi073.stdout:5/238: dread dc/d52/f58 [0,4194304] 0 2024-08-31T05:20:58.633 INFO:tasks.workunit.client.1.smithi073.stdout:9/291: mkdir dc/de/d11/d41/d52/d5b 0 2024-08-31T05:20:58.635 INFO:tasks.workunit.client.1.smithi073.stdout:9/292: read f8 [1249943,54368] 0 2024-08-31T05:20:58.635 INFO:tasks.workunit.client.1.smithi073.stdout:5/239: rmdir dc/d52 39 2024-08-31T05:20:58.637 INFO:tasks.workunit.client.1.smithi073.stdout:4/245: sync 2024-08-31T05:20:58.637 INFO:tasks.workunit.client.1.smithi073.stdout:3/293: sync 2024-08-31T05:20:58.637 INFO:tasks.workunit.client.1.smithi073.stdout:5/240: mknod dc/d16/d4e/c5a 0 2024-08-31T05:20:58.638 INFO:tasks.workunit.client.1.smithi073.stdout:4/246: readlink d7/df/d13/d2e/l41 0 2024-08-31T05:20:58.638 INFO:tasks.workunit.client.1.smithi073.stdout:9/293: creat dc/de/d56/f5c x:0 0 0 2024-08-31T05:20:58.639 INFO:tasks.workunit.client.1.smithi073.stdout:9/294: chown fb 34939150 1 2024-08-31T05:20:58.640 INFO:tasks.workunit.client.1.smithi073.stdout:5/241: write dc/d16/d3b/d3f/f50 [1464221,78650] 0 2024-08-31T05:20:58.640 INFO:tasks.workunit.client.1.smithi073.stdout:9/295: write dc/d37/d42/f59 [351784,56962] 0 2024-08-31T05:20:58.642 INFO:tasks.workunit.client.1.smithi073.stdout:4/247: symlink d7/df/d1b/d34/l4d 0 2024-08-31T05:20:58.643 INFO:tasks.workunit.client.1.smithi073.stdout:8/321: dread d0/db/d1c/d34/f51 [0,4194304] 0 2024-08-31T05:20:58.643 INFO:tasks.workunit.client.1.smithi073.stdout:8/322: chown d0/d62 1 1 2024-08-31T05:20:58.645 INFO:tasks.workunit.client.1.smithi073.stdout:3/294: link da/d18/f21 da/f61 0 2024-08-31T05:20:58.646 INFO:tasks.workunit.client.1.smithi073.stdout:8/323: write d0/db/d1c/d23/f26 [1914112,130746] 0 2024-08-31T05:20:58.646 INFO:tasks.workunit.client.1.smithi073.stdout:3/295: dread - da/d3c/f60 zero size 2024-08-31T05:20:58.646 INFO:tasks.workunit.client.1.smithi073.stdout:4/248: creat d7/db/f4e x:0 0 0 2024-08-31T05:20:58.647 INFO:tasks.workunit.client.1.smithi073.stdout:8/324: dread d0/f45 [0,4194304] 0 2024-08-31T05:20:58.647 INFO:tasks.workunit.client.1.smithi073.stdout:4/249: dread - d7/df/d13/f44 zero size 2024-08-31T05:20:58.648 INFO:tasks.workunit.client.1.smithi073.stdout:9/296: rename dc/d37/d42/l55 to dc/d37/d42/l5d 0 2024-08-31T05:20:58.651 INFO:tasks.workunit.client.1.smithi073.stdout:4/250: creat d7/db/f4f x:0 0 0 2024-08-31T05:20:58.652 INFO:tasks.workunit.client.1.smithi073.stdout:9/297: dread dc/f30 [0,4194304] 0 2024-08-31T05:20:58.653 INFO:tasks.workunit.client.1.smithi073.stdout:8/325: mknod d0/c67 0 2024-08-31T05:20:58.655 INFO:tasks.workunit.client.1.smithi073.stdout:4/251: fdatasync d7/fc 0 2024-08-31T05:20:58.657 INFO:tasks.workunit.client.1.smithi073.stdout:9/298: rmdir dc/d37 39 2024-08-31T05:20:58.657 INFO:tasks.workunit.client.1.smithi073.stdout:4/252: dread d7/fc [0,4194304] 0 2024-08-31T05:20:58.658 INFO:tasks.workunit.client.1.smithi073.stdout:5/242: write fb [3115692,117010] 0 2024-08-31T05:20:58.659 INFO:tasks.workunit.client.1.smithi073.stdout:5/243: read dc/d16/f54 [1626390,4633] 0 2024-08-31T05:20:58.661 INFO:tasks.workunit.client.1.smithi073.stdout:9/299: chown dc/f28 444495 1 2024-08-31T05:20:58.666 INFO:tasks.workunit.client.1.smithi073.stdout:4/253: mkdir d7/df/d13/d2e/d47/d4c/d50 0 2024-08-31T05:20:58.668 INFO:tasks.workunit.client.1.smithi073.stdout:8/326: truncate d0/db/d1c/d34/d38/f4b 1605039 0 2024-08-31T05:20:58.670 INFO:tasks.workunit.client.1.smithi073.stdout:8/327: dread - d0/db/d1c/d34/d38/f5b zero size 2024-08-31T05:20:58.672 INFO:tasks.workunit.client.1.smithi073.stdout:5/244: write f9 [3234456,45374] 0 2024-08-31T05:20:58.672 INFO:tasks.workunit.client.1.smithi073.stdout:4/254: dwrite d7/db/f4f [0,4194304] 0 2024-08-31T05:20:58.673 INFO:tasks.workunit.client.1.smithi073.stdout:4/255: chown d7/df/d13/d2e/d47 13554910 1 2024-08-31T05:20:58.675 INFO:tasks.workunit.client.1.smithi073.stdout:9/300: truncate f7 2370339 0 2024-08-31T05:20:58.676 INFO:tasks.workunit.client.1.smithi073.stdout:5/245: unlink c8 0 2024-08-31T05:20:58.677 INFO:tasks.workunit.client.1.smithi073.stdout:8/328: mkdir d0/db/d1c/d34/d68 0 2024-08-31T05:20:58.678 INFO:tasks.workunit.client.1.smithi073.stdout:4/256: fdatasync d7/fc 0 2024-08-31T05:20:58.683 INFO:tasks.workunit.client.1.smithi073.stdout:8/329: dread d0/db/d1c/d34/d38/f43 [0,4194304] 0 2024-08-31T05:20:58.683 INFO:tasks.workunit.client.1.smithi073.stdout:9/301: dread fb [0,4194304] 0 2024-08-31T05:20:58.683 INFO:tasks.workunit.client.1.smithi073.stdout:4/257: unlink d7/db/d11/f38 0 2024-08-31T05:20:58.684 INFO:tasks.workunit.client.1.smithi073.stdout:5/246: dwrite dc/f39 [0,4194304] 0 2024-08-31T05:20:58.685 INFO:tasks.workunit.client.1.smithi073.stdout:4/258: dread - d7/df/d13/d2e/f3a zero size 2024-08-31T05:20:58.687 INFO:tasks.workunit.client.1.smithi073.stdout:8/330: symlink d0/db/d1c/d34/d68/l69 0 2024-08-31T05:20:58.688 INFO:tasks.workunit.client.1.smithi073.stdout:4/259: readlink d7/df/l43 0 2024-08-31T05:20:58.690 INFO:tasks.workunit.client.1.smithi073.stdout:8/331: truncate d0/f3c 1194222 0 2024-08-31T05:20:58.694 INFO:tasks.workunit.client.1.smithi073.stdout:4/260: truncate d7/db/f2a 4585245 0 2024-08-31T05:20:58.695 INFO:tasks.workunit.client.1.smithi073.stdout:5/247: dwrite dc/d16/d26/f41 [0,4194304] 0 2024-08-31T05:20:58.695 INFO:tasks.workunit.client.1.smithi073.stdout:9/302: dwrite dc/de/d56/f5c [0,4194304] 0 2024-08-31T05:20:58.698 INFO:tasks.workunit.client.1.smithi073.stdout:4/261: fsync d7/df/d13/f44 0 2024-08-31T05:20:58.698 INFO:tasks.workunit.client.1.smithi073.stdout:9/303: stat dc/de/d11/d41/f57 0 2024-08-31T05:20:58.701 INFO:tasks.workunit.client.1.smithi073.stdout:4/262: creat d7/df/d1b/f51 x:0 0 0 2024-08-31T05:20:58.703 INFO:tasks.workunit.client.1.smithi073.stdout:8/332: dwrite d0/db/d1c/d2a/d58/f66 [0,4194304] 0 2024-08-31T05:20:58.704 INFO:tasks.workunit.client.1.smithi073.stdout:4/263: write d7/df/d13/f2b [57690,65060] 0 2024-08-31T05:20:58.705 INFO:tasks.workunit.client.1.smithi073.stdout:5/248: write dc/d16/d26/f2c [140749,7718] 0 2024-08-31T05:20:58.711 INFO:tasks.workunit.client.1.smithi073.stdout:8/333: fsync d0/db/d1c/d34/d38/f4b 0 2024-08-31T05:20:58.715 INFO:tasks.workunit.client.1.smithi073.stdout:8/334: symlink d0/db/d1c/d34/l6a 0 2024-08-31T05:20:58.716 INFO:tasks.workunit.client.1.smithi073.stdout:4/264: getdents d7/df/d1b/d34 0 2024-08-31T05:20:58.717 INFO:tasks.workunit.client.1.smithi073.stdout:5/249: dwrite dc/d16/d26/f51 [0,4194304] 0 2024-08-31T05:20:58.718 INFO:tasks.workunit.client.1.smithi073.stdout:5/250: chown dc/l15 4 1 2024-08-31T05:20:58.719 INFO:tasks.workunit.client.1.smithi073.stdout:4/265: unlink d7/f3e 0 2024-08-31T05:20:58.721 INFO:tasks.workunit.client.1.smithi073.stdout:6/202: sync 2024-08-31T05:20:58.721 INFO:tasks.workunit.client.1.smithi073.stdout:7/215: sync 2024-08-31T05:20:58.721 INFO:tasks.workunit.client.1.smithi073.stdout:7/216: chown d1/c2d 797878 1 2024-08-31T05:20:58.722 INFO:tasks.workunit.client.1.smithi073.stdout:6/203: truncate d15/f29 436168 0 2024-08-31T05:20:58.722 INFO:tasks.workunit.client.1.smithi073.stdout:2/268: sync 2024-08-31T05:20:58.722 INFO:tasks.workunit.client.1.smithi073.stdout:8/335: creat d0/db/d1c/d24/f6b x:0 0 0 2024-08-31T05:20:58.724 INFO:tasks.workunit.client.1.smithi073.stdout:4/266: creat d7/df/d1b/d34/f52 x:0 0 0 2024-08-31T05:20:58.724 INFO:tasks.workunit.client.1.smithi073.stdout:6/204: read - d15/d1a/d2b/d2f/f30 zero size 2024-08-31T05:20:58.725 INFO:tasks.workunit.client.1.smithi073.stdout:2/269: chown d2/d9/df/d36/l48 6290 1 2024-08-31T05:20:58.725 INFO:tasks.workunit.client.1.smithi073.stdout:8/336: dread - d0/db/d1c/d34/d38/f5b zero size 2024-08-31T05:20:58.725 INFO:tasks.workunit.client.1.smithi073.stdout:7/217: mkdir d1/da/d15/d33/d44 0 2024-08-31T05:20:58.726 INFO:tasks.workunit.client.1.smithi073.stdout:7/218: dread - d1/d11/d14/f3c zero size 2024-08-31T05:20:58.726 INFO:tasks.workunit.client.1.smithi073.stdout:4/267: mkdir d7/df/d13/d53 0 2024-08-31T05:20:58.727 INFO:tasks.workunit.client.1.smithi073.stdout:7/219: dread - d1/f2e zero size 2024-08-31T05:20:58.728 INFO:tasks.workunit.client.1.smithi073.stdout:8/337: truncate d0/db/d1c/d34/d38/f5b 732117 0 2024-08-31T05:20:58.729 INFO:tasks.workunit.client.1.smithi073.stdout:4/268: write d7/f46 [666491,86735] 0 2024-08-31T05:20:58.729 INFO:tasks.workunit.client.1.smithi073.stdout:2/270: mknod d2/d9/d32/c54 0 2024-08-31T05:20:58.731 INFO:tasks.workunit.client.1.smithi073.stdout:7/220: write d1/da/d15/f24 [1500611,117524] 0 2024-08-31T05:20:58.731 INFO:tasks.workunit.client.1.smithi073.stdout:5/251: fdatasync dc/d16/d26/f41 0 2024-08-31T05:20:58.737 INFO:tasks.workunit.client.1.smithi073.stdout:5/252: rename dc/d3d/d3e/c42 to dc/d16/d4e/c5b 0 2024-08-31T05:20:58.738 INFO:tasks.workunit.client.1.smithi073.stdout:2/271: creat d2/d9/f55 x:0 0 0 2024-08-31T05:20:58.738 INFO:tasks.workunit.client.1.smithi073.stdout:6/205: write d15/d1a/d2b/f2d [552038,72708] 0 2024-08-31T05:20:58.739 INFO:tasks.workunit.client.1.smithi073.stdout:7/221: symlink d1/da/d15/l45 0 2024-08-31T05:20:58.743 INFO:tasks.workunit.client.1.smithi073.stdout:5/253: dread dc/d16/d3b/d3f/f50 [0,4194304] 0 2024-08-31T05:20:58.744 INFO:tasks.workunit.client.1.smithi073.stdout:8/338: dwrite d0/db/d1c/d24/f32 [0,4194304] 0 2024-08-31T05:20:58.745 INFO:tasks.workunit.client.1.smithi073.stdout:8/339: chown d0/db/d1c/d23/f26 133154996 1 2024-08-31T05:20:58.798 INFO:tasks.workunit.client.1.smithi073.stdout:1/222: sync 2024-08-31T05:20:58.798 INFO:tasks.workunit.client.1.smithi073.stdout:0/291: sync 2024-08-31T05:20:58.798 INFO:tasks.workunit.client.1.smithi073.stdout:1/223: chown d5/d17/d32/d37 65360608 1 2024-08-31T05:20:58.799 INFO:tasks.workunit.client.1.smithi073.stdout:1/224: write d5/f25 [537047,130683] 0 2024-08-31T05:20:58.802 INFO:tasks.workunit.client.1.smithi073.stdout:0/292: dwrite d0/d28/f2d [0,4194304] 0 2024-08-31T05:20:58.802 INFO:tasks.workunit.client.1.smithi073.stdout:0/293: fsync d0/f33 0 2024-08-31T05:20:58.803 INFO:tasks.workunit.client.1.smithi073.stdout:1/225: dread d5/d10/d33/f15 [0,4194304] 0 2024-08-31T05:20:58.822 INFO:tasks.workunit.client.1.smithi073.stdout:2/272: unlink d2/d9/df/l28 0 2024-08-31T05:20:58.822 INFO:tasks.workunit.client.1.smithi073.stdout:4/269: write d7/df/f25 [457935,41341] 0 2024-08-31T05:20:58.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:20:58 smithi067 ceph-mon[17432]: pgmap v20: 65 pgs: 65 active+clean; 330 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 22 MiB/s wr, 265 op/s 2024-08-31T05:20:58.830 INFO:tasks.workunit.client.1.smithi073.stdout:7/222: symlink d1/da/d15/l46 0 2024-08-31T05:20:58.831 INFO:tasks.workunit.client.1.smithi073.stdout:2/273: mkdir d2/d9/d32/d56 0 2024-08-31T05:20:58.832 INFO:tasks.workunit.client.1.smithi073.stdout:2/274: write d2/d9/d27/f33 [856280,24702] 0 2024-08-31T05:20:58.833 INFO:tasks.workunit.client.1.smithi073.stdout:2/275: write d2/d9/d27/f33 [1722104,127123] 0 2024-08-31T05:20:58.833 INFO:tasks.workunit.client.1.smithi073.stdout:6/206: link d15/d1a/d2b/d2f/f3f d15/d1a/d1e/f43 0 2024-08-31T05:20:58.835 INFO:tasks.workunit.client.1.smithi073.stdout:4/270: write d7/df/f21 [896101,9063] 0 2024-08-31T05:20:58.835 INFO:tasks.workunit.client.1.smithi073.stdout:5/254: creat dc/d53/f5c x:0 0 0 2024-08-31T05:20:58.836 INFO:tasks.workunit.client.1.smithi073.stdout:5/255: chown dc/f14 1258395 1 2024-08-31T05:20:58.837 INFO:tasks.workunit.client.1.smithi073.stdout:4/271: dread - d7/df/d1b/f51 zero size 2024-08-31T05:20:58.837 INFO:tasks.workunit.client.1.smithi073.stdout:8/340: symlink d0/l6c 0 2024-08-31T05:20:58.837 INFO:tasks.workunit.client.1.smithi073.stdout:1/226: write d5/d10/d33/fe [231316,124325] 0 2024-08-31T05:20:58.838 INFO:tasks.workunit.client.1.smithi073.stdout:7/223: mkdir d1/da/d3e/d22/d47 0 2024-08-31T05:20:58.841 INFO:tasks.workunit.client.1.smithi073.stdout:2/276: rename d2/d9/f55 to d2/d9/d3c/f57 0 2024-08-31T05:20:58.842 INFO:tasks.workunit.client.1.smithi073.stdout:7/224: chown d1/da/d3e/d22/f41 83129910 1 2024-08-31T05:20:58.844 INFO:tasks.workunit.client.1.smithi073.stdout:8/341: mknod d0/c6d 0 2024-08-31T05:20:58.845 INFO:tasks.workunit.client.1.smithi073.stdout:5/256: symlink dc/d16/d26/d49/l5d 0 2024-08-31T05:20:58.846 INFO:tasks.workunit.client.1.smithi073.stdout:9/304: sync 2024-08-31T05:20:58.846 INFO:tasks.workunit.client.1.smithi073.stdout:3/296: sync 2024-08-31T05:20:58.846 INFO:tasks.workunit.client.1.smithi073.stdout:2/277: mknod d2/d25/c58 0 2024-08-31T05:20:58.846 INFO:tasks.workunit.client.1.smithi073.stdout:5/257: readlink l0 0 2024-08-31T05:20:58.848 INFO:tasks.workunit.client.1.smithi073.stdout:7/225: mknod d1/c48 0 2024-08-31T05:20:58.851 INFO:tasks.workunit.client.1.smithi073.stdout:0/294: dwrite d0/d15/d2c/d4d/f3e [0,4194304] 0 2024-08-31T05:20:58.856 INFO:tasks.workunit.client.1.smithi073.stdout:2/278: chown d2/d9/d32/c54 34 1 2024-08-31T05:20:58.856 INFO:tasks.workunit.client.1.smithi073.stdout:9/305: chown dc/d37 82 1 2024-08-31T05:20:58.860 INFO:tasks.workunit.client.1.smithi073.stdout:5/258: creat dc/d16/d4e/f5e x:0 0 0 2024-08-31T05:20:58.860 INFO:tasks.workunit.client.1.smithi073.stdout:6/207: dread f6 [0,4194304] 0 2024-08-31T05:20:58.860 INFO:tasks.workunit.client.1.smithi073.stdout:4/272: dwrite d7/df/d13/f28 [0,4194304] 0 2024-08-31T05:20:58.863 INFO:tasks.workunit.client.1.smithi073.stdout:1/227: dwrite d5/d17/f2f [4194304,4194304] 0 2024-08-31T05:20:58.865 INFO:tasks.workunit.client.1.smithi073.stdout:9/306: chown dc/de/c4a 3681 1 2024-08-31T05:20:58.873 INFO:tasks.workunit.client.1.smithi073.stdout:6/208: write d15/f22 [896615,111864] 0 2024-08-31T05:20:58.875 INFO:tasks.workunit.client.1.smithi073.stdout:9/307: creat dc/d37/f5e x:0 0 0 2024-08-31T05:20:58.875 INFO:tasks.workunit.client.1.smithi073.stdout:1/228: dread - d5/d17/d32/d37/f3c zero size 2024-08-31T05:20:58.877 INFO:tasks.workunit.client.1.smithi073.stdout:8/342: dwrite d0/db/d1c/f3b [0,4194304] 0 2024-08-31T05:20:58.878 INFO:tasks.workunit.client.1.smithi073.stdout:5/259: write dc/d16/d26/f34 [457754,14126] 0 2024-08-31T05:20:58.881 INFO:tasks.workunit.client.1.smithi073.stdout:3/297: dwrite da/d1b/d45/f56 [0,4194304] 0 2024-08-31T05:20:58.882 INFO:tasks.workunit.client.1.smithi073.stdout:4/273: rename d7/db/c33 to d7/df/d13/d53/c54 0 2024-08-31T05:20:58.883 INFO:tasks.workunit.client.1.smithi073.stdout:2/279: truncate d2/d9/df/f3b 1978008 0 2024-08-31T05:20:58.886 INFO:tasks.workunit.client.1.smithi073.stdout:0/295: dwrite d0/f29 [0,4194304] 0 2024-08-31T05:20:58.893 INFO:tasks.workunit.client.1.smithi073.stdout:1/229: chown d5/d10/d33/c20 27482 1 2024-08-31T05:20:58.893 INFO:tasks.workunit.client.1.smithi073.stdout:7/226: dwrite d1/da/f34 [0,4194304] 0 2024-08-31T05:20:58.895 INFO:tasks.workunit.client.1.smithi073.stdout:2/280: chown d2/d9/df/d36/c50 50 1 2024-08-31T05:20:58.895 INFO:tasks.workunit.client.1.smithi073.stdout:0/296: chown d0/f26 181 1 2024-08-31T05:20:58.895 INFO:tasks.workunit.client.1.smithi073.stdout:6/209: dread d15/d1a/d2b/f2d [0,4194304] 0 2024-08-31T05:20:58.895 INFO:tasks.workunit.client.1.smithi073.stdout:5/260: mknod dc/d16/d4e/c5f 0 2024-08-31T05:20:58.896 INFO:tasks.workunit.client.1.smithi073.stdout:8/343: mknod d0/db/d1c/d23/c6e 0 2024-08-31T05:20:58.896 INFO:tasks.workunit.client.1.smithi073.stdout:4/274: dread d7/df/f25 [0,4194304] 0 2024-08-31T05:20:58.897 INFO:tasks.workunit.client.1.smithi073.stdout:9/308: mkdir dc/de/d11/d41/d52/d5f 0 2024-08-31T05:20:58.898 INFO:tasks.workunit.client.1.smithi073.stdout:5/261: stat dc/d16/d26/f51 0 2024-08-31T05:20:58.905 INFO:tasks.workunit.client.1.smithi073.stdout:5/262: dwrite dc/d3d/f4b [0,4194304] 0 2024-08-31T05:20:58.920 INFO:tasks.workunit.client.1.smithi073.stdout:1/230: creat d5/d10/d1b/f41 x:0 0 0 2024-08-31T05:20:58.922 INFO:tasks.workunit.client.1.smithi073.stdout:5/263: fsync dc/d16/d1a/f33 0 2024-08-31T05:20:58.923 INFO:tasks.workunit.client.1.smithi073.stdout:5/264: fsync dc/d3d/f4c 0 2024-08-31T05:20:58.925 INFO:tasks.workunit.client.1.smithi073.stdout:7/227: dread d1/da/d3e/f1f [0,4194304] 0 2024-08-31T05:20:58.927 INFO:tasks.workunit.client.1.smithi073.stdout:3/298: dread da/f14 [4194304,4194304] 0 2024-08-31T05:20:58.930 INFO:tasks.workunit.client.1.smithi073.stdout:4/275: rename d7/d24/c4a to d7/df/d13/c55 0 2024-08-31T05:20:58.931 INFO:tasks.workunit.client.1.smithi073.stdout:7/228: dwrite d1/da/d15/d33/f42 [0,4194304] 0 2024-08-31T05:20:58.932 INFO:tasks.workunit.client.1.smithi073.stdout:8/344: write d0/f45 [292609,68113] 0 2024-08-31T05:20:58.934 INFO:tasks.workunit.client.1.smithi073.stdout:6/210: dwrite d15/d1a/d1e/f43 [0,4194304] 0 2024-08-31T05:20:58.936 INFO:tasks.workunit.client.1.smithi073.stdout:6/211: chown d15/d1a/d2b/f2d 13146 1 2024-08-31T05:20:58.938 INFO:tasks.workunit.client.1.smithi073.stdout:9/309: creat dc/f60 x:0 0 0 2024-08-31T05:20:58.941 INFO:tasks.workunit.client.1.smithi073.stdout:8/345: dread d0/db/d1c/d24/f32 [0,4194304] 0 2024-08-31T05:20:58.944 INFO:tasks.workunit.client.1.smithi073.stdout:2/281: getdents d2/d9/d3c 0 2024-08-31T05:20:58.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:20:58 smithi073 ceph-mon[24726]: pgmap v20: 65 pgs: 65 active+clean; 330 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 22 MiB/s wr, 265 op/s 2024-08-31T05:20:58.947 INFO:tasks.workunit.client.1.smithi073.stdout:7/229: symlink d1/da/d3e/d22/d35/l49 0 2024-08-31T05:20:58.948 INFO:tasks.workunit.client.1.smithi073.stdout:1/231: truncate d5/fc 916885 0 2024-08-31T05:20:58.950 INFO:tasks.workunit.client.1.smithi073.stdout:5/265: symlink dc/d16/d3b/d3f/d4f/l60 0 2024-08-31T05:20:58.953 INFO:tasks.workunit.client.1.smithi073.stdout:8/346: rename d0/db/d1c/d34/f55 to d0/db/d44/f6f 0 2024-08-31T05:20:58.954 INFO:tasks.workunit.client.1.smithi073.stdout:5/266: write dc/d3d/f4c [54394,56961] 0 2024-08-31T05:20:58.956 INFO:tasks.workunit.client.1.smithi073.stdout:5/267: stat dc/d3d/f4b 0 2024-08-31T05:20:58.957 INFO:tasks.workunit.client.1.smithi073.stdout:7/230: dwrite d1/d11/d14/f29 [0,4194304] 0 2024-08-31T05:20:58.958 INFO:tasks.workunit.client.1.smithi073.stdout:5/268: fdatasync fb 0 2024-08-31T05:20:58.959 INFO:tasks.workunit.client.1.smithi073.stdout:1/232: dwrite d5/f34 [0,4194304] 0 2024-08-31T05:20:58.961 INFO:tasks.workunit.client.1.smithi073.stdout:1/233: write d5/d26/f39 [116093,97038] 0 2024-08-31T05:20:58.964 INFO:tasks.workunit.client.1.smithi073.stdout:1/234: chown d5/f9 33 1 2024-08-31T05:20:58.964 INFO:tasks.workunit.client.1.smithi073.stdout:1/235: chown d5/f3e 3398 1 2024-08-31T05:20:58.966 INFO:tasks.workunit.client.1.smithi073.stdout:9/310: creat dc/f61 x:0 0 0 2024-08-31T05:20:58.969 INFO:tasks.workunit.client.1.smithi073.stdout:2/282: dread d2/d9/df/f1a [0,4194304] 0 2024-08-31T05:20:58.972 INFO:tasks.workunit.client.1.smithi073.stdout:4/276: link d7/df/d13/d2e/f36 d7/df/f56 0 2024-08-31T05:20:58.973 INFO:tasks.workunit.client.1.smithi073.stdout:6/212: dwrite d15/d1a/d1e/f43 [4194304,4194304] 0 2024-08-31T05:20:58.975 INFO:tasks.workunit.client.1.smithi073.stdout:7/231: rename d1/cc to d1/da/d3e/d22/d35/c4a 0 2024-08-31T05:20:58.978 INFO:tasks.workunit.client.1.smithi073.stdout:7/232: chown d1/cf 4815 1 2024-08-31T05:20:58.978 INFO:tasks.workunit.client.1.smithi073.stdout:9/311: mknod dc/de/c62 0 2024-08-31T05:20:58.985 INFO:tasks.workunit.client.1.smithi073.stdout:1/236: mknod d5/d10/d1c/d27/c42 0 2024-08-31T05:20:58.985 INFO:tasks.workunit.client.1.smithi073.stdout:1/237: dread - d5/f3e zero size 2024-08-31T05:20:58.988 INFO:tasks.workunit.client.1.smithi073.stdout:9/312: symlink dc/d37/d42/l63 0 2024-08-31T05:20:58.995 INFO:tasks.workunit.client.1.smithi073.stdout:9/313: dwrite dc/d37/f5e [0,4194304] 0 2024-08-31T05:20:58.999 INFO:tasks.workunit.client.1.smithi073.stdout:2/283: dread f1 [0,4194304] 0 2024-08-31T05:20:59.000 INFO:tasks.workunit.client.1.smithi073.stdout:6/213: link d15/d1a/d2b/l39 d15/d17/d26/l44 0 2024-08-31T05:20:59.001 INFO:tasks.workunit.client.1.smithi073.stdout:2/284: readlink d2/d9/df/d36/l48 0 2024-08-31T05:20:59.001 INFO:tasks.workunit.client.1.smithi073.stdout:6/214: read - d15/d1a/d1e/f37 zero size 2024-08-31T05:20:59.003 INFO:tasks.workunit.client.1.smithi073.stdout:5/269: dwrite dc/d16/f2e [0,4194304] 0 2024-08-31T05:20:59.003 INFO:tasks.workunit.client.1.smithi073.stdout:6/215: dread - d15/d1a/d1e/f33 zero size 2024-08-31T05:20:59.006 INFO:tasks.workunit.client.1.smithi073.stdout:1/238: fsync d5/f7 0 2024-08-31T05:20:59.010 INFO:tasks.workunit.client.1.smithi073.stdout:6/216: dread fd [0,4194304] 0 2024-08-31T05:20:59.010 INFO:tasks.workunit.client.1.smithi073.stdout:7/233: write d1/da/f26 [1009253,15937] 0 2024-08-31T05:20:59.014 INFO:tasks.workunit.client.1.smithi073.stdout:7/234: dwrite d1/da/d15/f21 [0,4194304] 0 2024-08-31T05:20:59.015 INFO:tasks.workunit.client.1.smithi073.stdout:7/235: chown d1/d11/d14/c20 9 1 2024-08-31T05:20:59.026 INFO:tasks.workunit.client.1.smithi073.stdout:0/297: sync 2024-08-31T05:20:59.051 INFO:tasks.workunit.client.1.smithi073.stdout:4/277: fsync d7/db/f2a 0 2024-08-31T05:20:59.054 INFO:tasks.workunit.client.1.smithi073.stdout:2/285: symlink d2/l59 0 2024-08-31T05:20:59.058 INFO:tasks.workunit.client.1.smithi073.stdout:2/286: dwrite d2/d9/df/f2e [0,4194304] 0 2024-08-31T05:20:59.064 INFO:tasks.workunit.client.1.smithi073.stdout:9/314: truncate dc/d10/f18 2145301 0 2024-08-31T05:20:59.065 INFO:tasks.workunit.client.1.smithi073.stdout:9/315: read dc/d27/f2e [3087223,105583] 0 2024-08-31T05:20:59.066 INFO:tasks.workunit.client.1.smithi073.stdout:9/316: dread dc/d10/f4c [0,4194304] 0 2024-08-31T05:20:59.072 INFO:tasks.workunit.client.1.smithi073.stdout:5/270: creat dc/f61 x:0 0 0 2024-08-31T05:20:59.072 INFO:tasks.workunit.client.1.smithi073.stdout:9/317: dwrite dc/de/d11/d41/f4b [0,4194304] 0 2024-08-31T05:20:59.073 INFO:tasks.workunit.client.1.smithi073.stdout:4/278: link d7/db/f4e d7/db/d11/d2c/d2d/f57 0 2024-08-31T05:20:59.074 INFO:tasks.workunit.client.1.smithi073.stdout:4/279: fdatasync d7/d1a/f29 0 2024-08-31T05:20:59.079 INFO:tasks.workunit.client.1.smithi073.stdout:1/239: creat d5/d17/f43 x:0 0 0 2024-08-31T05:20:59.083 INFO:tasks.workunit.client.1.smithi073.stdout:7/236: creat d1/da/d15/f4b x:0 0 0 2024-08-31T05:20:59.085 INFO:tasks.workunit.client.1.smithi073.stdout:0/298: creat d0/f5b x:0 0 0 2024-08-31T05:20:59.086 INFO:tasks.workunit.client.1.smithi073.stdout:1/240: dwrite d5/d26/f39 [0,4194304] 0 2024-08-31T05:20:59.092 INFO:tasks.workunit.client.1.smithi073.stdout:7/237: dwrite d1/d11/d14/f2b [0,4194304] 0 2024-08-31T05:20:59.093 INFO:tasks.workunit.client.1.smithi073.stdout:4/280: write d7/df/d13/f44 [949003,109350] 0 2024-08-31T05:20:59.100 INFO:tasks.workunit.client.1.smithi073.stdout:2/287: creat d2/f5a x:0 0 0 2024-08-31T05:20:59.102 INFO:tasks.workunit.client.1.smithi073.stdout:1/241: unlink d5/d26/f39 0 2024-08-31T05:20:59.103 INFO:tasks.workunit.client.1.smithi073.stdout:5/271: creat dc/d3d/d55/f62 x:0 0 0 2024-08-31T05:20:59.107 INFO:tasks.workunit.client.1.smithi073.stdout:9/318: link dc/de/d11/d41/f50 dc/d37/d42/f64 0 2024-08-31T05:20:59.107 INFO:tasks.workunit.client.1.smithi073.stdout:9/319: dread - dc/de/d11/d41/f57 zero size 2024-08-31T05:20:59.111 INFO:tasks.workunit.client.1.smithi073.stdout:4/281: dread d7/df/d13/d2e/f36 [0,4194304] 0 2024-08-31T05:20:59.116 INFO:tasks.workunit.client.1.smithi073.stdout:1/242: creat d5/d10/d2e/f44 x:0 0 0 2024-08-31T05:20:59.117 INFO:tasks.workunit.client.1.smithi073.stdout:1/243: fsync d5/f3e 0 2024-08-31T05:20:59.117 INFO:tasks.workunit.client.1.smithi073.stdout:2/288: dwrite d2/d9/d32/f47 [0,4194304] 0 2024-08-31T05:20:59.119 INFO:tasks.workunit.client.1.smithi073.stdout:2/289: fdatasync d2/d9/df/f1f 0 2024-08-31T05:20:59.120 INFO:tasks.workunit.client.1.smithi073.stdout:2/290: truncate d2/f5a 724454 0 2024-08-31T05:20:59.120 INFO:tasks.workunit.client.1.smithi073.stdout:0/299: rename d0/d15/d2c/d4d/d3c/c14 to d0/d28/d4f/c5c 0 2024-08-31T05:20:59.120 INFO:tasks.workunit.client.1.smithi073.stdout:3/299: sync 2024-08-31T05:20:59.122 INFO:tasks.workunit.client.1.smithi073.stdout:9/320: fdatasync f8 0 2024-08-31T05:20:59.136 INFO:tasks.workunit.client.1.smithi073.stdout:2/291: read d2/d9/df/f3b [1469499,11103] 0 2024-08-31T05:20:59.137 INFO:tasks.workunit.client.1.smithi073.stdout:3/300: write da/d18/f1f [7875560,42902] 0 2024-08-31T05:20:59.140 INFO:tasks.workunit.client.1.smithi073.stdout:2/292: read d2/d9/df/f29 [762467,110078] 0 2024-08-31T05:20:59.141 INFO:tasks.workunit.client.1.smithi073.stdout:5/272: dwrite dc/d16/d1a/f33 [0,4194304] 0 2024-08-31T05:20:59.142 INFO:tasks.workunit.client.1.smithi073.stdout:4/282: write d7/db/d11/d2c/d2d/f57 [793642,85938] 0 2024-08-31T05:20:59.143 INFO:tasks.workunit.client.1.smithi073.stdout:5/273: write dc/d16/d26/f34 [637356,84686] 0 2024-08-31T05:20:59.144 INFO:tasks.workunit.client.1.smithi073.stdout:7/238: truncate d1/da/d3e/d22/f27 887540 0 2024-08-31T05:20:59.144 INFO:tasks.workunit.client.1.smithi073.stdout:4/283: dread - d7/df/d13/d2e/f48 zero size 2024-08-31T05:20:59.145 INFO:tasks.workunit.client.1.smithi073.stdout:7/239: read - d1/da/d3e/d22/f41 zero size 2024-08-31T05:20:59.149 INFO:tasks.workunit.client.1.smithi073.stdout:3/301: unlink da/d18/c37 0 2024-08-31T05:20:59.150 INFO:tasks.workunit.client.1.smithi073.stdout:9/321: mknod dc/de/d11/d41/d52/d5f/c65 0 2024-08-31T05:20:59.152 INFO:tasks.workunit.client.1.smithi073.stdout:5/274: mknod dc/d16/d26/c63 0 2024-08-31T05:20:59.153 INFO:tasks.workunit.client.1.smithi073.stdout:5/275: write dc/d16/d26/f25 [488847,37615] 0 2024-08-31T05:20:59.155 INFO:tasks.workunit.client.1.smithi073.stdout:0/300: link d0/d15/d2c/l4c d0/d15/d2c/d40/d4a/l5d 0 2024-08-31T05:20:59.159 INFO:tasks.workunit.client.1.smithi073.stdout:9/322: mkdir dc/de/d66 0 2024-08-31T05:20:59.162 INFO:tasks.workunit.client.1.smithi073.stdout:4/284: unlink d7/df/d1b/d34/f52 0 2024-08-31T05:20:59.163 INFO:tasks.workunit.client.1.smithi073.stdout:4/285: write d7/db/f4e [32038,33726] 0 2024-08-31T05:20:59.174 INFO:tasks.workunit.client.1.smithi073.stdout:7/240: dread d1/da/d3e/d22/f27 [0,4194304] 0 2024-08-31T05:20:59.175 INFO:tasks.workunit.client.1.smithi073.stdout:4/286: creat d7/db/d11/f58 x:0 0 0 2024-08-31T05:20:59.176 INFO:tasks.workunit.client.1.smithi073.stdout:3/302: getdents da/d1b/d40 0 2024-08-31T05:20:59.181 INFO:tasks.workunit.client.1.smithi073.stdout:7/241: creat d1/da/d38/f4c x:0 0 0 2024-08-31T05:20:59.182 INFO:tasks.workunit.client.1.smithi073.stdout:4/287: mkdir d7/db/d11/d59 0 2024-08-31T05:20:59.183 INFO:tasks.workunit.client.1.smithi073.stdout:2/293: truncate d2/d9/df/f22 1183399 0 2024-08-31T05:20:59.186 INFO:tasks.workunit.client.1.smithi073.stdout:5/276: getdents dc/d3d/d3e 0 2024-08-31T05:20:59.189 INFO:tasks.workunit.client.1.smithi073.stdout:7/242: symlink d1/da/d3e/d22/d35/l4d 0 2024-08-31T05:20:59.190 INFO:tasks.workunit.client.1.smithi073.stdout:7/243: write d1/da/f26 [1775644,123423] 0 2024-08-31T05:20:59.193 INFO:tasks.workunit.client.1.smithi073.stdout:2/294: mknod d2/d25/c5b 0 2024-08-31T05:20:59.193 INFO:tasks.workunit.client.1.smithi073.stdout:2/295: write d2/d9/d27/f33 [2882044,117902] 0 2024-08-31T05:20:59.194 INFO:tasks.workunit.client.1.smithi073.stdout:9/323: write dc/d10/f4c [1607117,116685] 0 2024-08-31T05:20:59.195 INFO:tasks.workunit.client.1.smithi073.stdout:2/296: chown d2/d9/cb 989 1 2024-08-31T05:20:59.195 INFO:tasks.workunit.client.1.smithi073.stdout:2/297: dread - d2/d9/d3c/f46 zero size 2024-08-31T05:20:59.196 INFO:tasks.workunit.client.1.smithi073.stdout:5/277: mknod dc/d16/d4e/c64 0 2024-08-31T05:20:59.199 INFO:tasks.workunit.client.1.smithi073.stdout:7/244: mknod d1/da/d15/d33/c4e 0 2024-08-31T05:20:59.201 INFO:tasks.workunit.client.1.smithi073.stdout:2/298: dwrite d2/d9/d27/f33 [0,4194304] 0 2024-08-31T05:20:59.202 INFO:tasks.workunit.client.1.smithi073.stdout:2/299: fdatasync d2/d9/df/f53 0 2024-08-31T05:20:59.205 INFO:tasks.workunit.client.1.smithi073.stdout:5/278: fsync dc/d52/f58 0 2024-08-31T05:20:59.209 INFO:tasks.workunit.client.1.smithi073.stdout:8/347: sync 2024-08-31T05:20:59.209 INFO:tasks.workunit.client.1.smithi073.stdout:6/217: sync 2024-08-31T05:20:59.213 INFO:tasks.workunit.client.1.smithi073.stdout:9/324: creat dc/de/d66/f67 x:0 0 0 2024-08-31T05:20:59.216 INFO:tasks.workunit.client.1.smithi073.stdout:3/303: dwrite da/d18/f38 [0,4194304] 0 2024-08-31T05:20:59.217 INFO:tasks.workunit.client.1.smithi073.stdout:4/288: write d7/df/d1b/f1f [3877496,38381] 0 2024-08-31T05:20:59.220 INFO:tasks.workunit.client.1.smithi073.stdout:4/289: write d7/df/d13/f2b [1570370,99394] 0 2024-08-31T05:20:59.220 INFO:tasks.workunit.client.1.smithi073.stdout:5/279: creat dc/d16/d3b/d3f/f65 x:0 0 0 2024-08-31T05:20:59.221 INFO:tasks.workunit.client.1.smithi073.stdout:4/290: write d7/db/f2a [3430479,127748] 0 2024-08-31T05:20:59.221 INFO:tasks.workunit.client.1.smithi073.stdout:5/280: write dc/f48 [3898943,107658] 0 2024-08-31T05:20:59.222 INFO:tasks.workunit.client.1.smithi073.stdout:5/281: chown dc/d16/d1a/c45 108 1 2024-08-31T05:20:59.222 INFO:tasks.workunit.client.1.smithi073.stdout:5/282: dread - dc/d16/d4e/f5e zero size 2024-08-31T05:20:59.228 INFO:tasks.workunit.client.1.smithi073.stdout:5/283: dwrite dc/d16/d26/f25 [0,4194304] 0 2024-08-31T05:20:59.232 INFO:tasks.workunit.client.1.smithi073.stdout:9/325: dread dc/de/f1e [0,4194304] 0 2024-08-31T05:20:59.247 INFO:tasks.workunit.client.1.smithi073.stdout:4/291: symlink d7/d1a/l5a 0 2024-08-31T05:20:59.249 INFO:tasks.workunit.client.1.smithi073.stdout:7/245: dwrite d1/da/f32 [0,4194304] 0 2024-08-31T05:20:59.249 INFO:tasks.workunit.client.1.smithi073.stdout:8/348: link d0/db/f22 d0/db/d44/f70 0 2024-08-31T05:20:59.250 INFO:tasks.workunit.client.1.smithi073.stdout:7/246: write d1/da/d15/d33/f42 [5095676,119412] 0 2024-08-31T05:20:59.253 INFO:tasks.workunit.client.1.smithi073.stdout:5/284: rmdir dc/d16 39 2024-08-31T05:20:59.254 INFO:tasks.workunit.client.1.smithi073.stdout:5/285: truncate f9 4586368 0 2024-08-31T05:20:59.256 INFO:tasks.workunit.client.1.smithi073.stdout:1/244: sync 2024-08-31T05:20:59.256 INFO:tasks.workunit.client.1.smithi073.stdout:0/301: sync 2024-08-31T05:20:59.258 INFO:tasks.workunit.client.1.smithi073.stdout:7/247: dwrite d1/da/d15/d33/f36 [0,4194304] 0 2024-08-31T05:20:59.259 INFO:tasks.workunit.client.1.smithi073.stdout:7/248: readlink d1/da/d38/l40 0 2024-08-31T05:20:59.263 INFO:tasks.workunit.client.1.smithi073.stdout:2/300: truncate d2/d9/d27/f33 2160050 0 2024-08-31T05:20:59.263 INFO:tasks.workunit.client.1.smithi073.stdout:6/218: creat d15/d17/d26/f45 x:0 0 0 2024-08-31T05:20:59.271 INFO:tasks.workunit.client.1.smithi073.stdout:4/292: write d7/df/f3f [733705,121213] 0 2024-08-31T05:20:59.275 INFO:tasks.workunit.client.1.smithi073.stdout:0/302: rmdir d0/d15/d2c/d41/d52 39 2024-08-31T05:20:59.277 INFO:tasks.workunit.client.1.smithi073.stdout:4/293: dwrite d7/db/f2a [0,4194304] 0 2024-08-31T05:20:59.279 INFO:tasks.workunit.client.1.smithi073.stdout:2/301: creat d2/d9/d3c/f5c x:0 0 0 2024-08-31T05:20:59.281 INFO:tasks.workunit.client.1.smithi073.stdout:3/304: write da/d18/f21 [1676232,17525] 0 2024-08-31T05:20:59.281 INFO:tasks.workunit.client.1.smithi073.stdout:1/245: dread d5/f9 [0,4194304] 0 2024-08-31T05:20:59.282 INFO:tasks.workunit.client.1.smithi073.stdout:8/349: link d0/f3c d0/db/d44/f71 0 2024-08-31T05:20:59.284 INFO:tasks.workunit.client.1.smithi073.stdout:9/326: dwrite dc/d27/f2e [0,4194304] 0 2024-08-31T05:20:59.288 INFO:tasks.workunit.client.1.smithi073.stdout:0/303: symlink d0/d28/d4f/l5e 0 2024-08-31T05:20:59.295 INFO:tasks.workunit.client.1.smithi073.stdout:8/350: mkdir d0/db/d44/d72 0 2024-08-31T05:20:59.304 INFO:tasks.workunit.client.1.smithi073.stdout:8/351: dread - d0/db/d1c/d34/d38/f64 zero size 2024-08-31T05:20:59.304 INFO:tasks.workunit.client.1.smithi073.stdout:0/304: symlink d0/d28/l5f 0 2024-08-31T05:20:59.305 INFO:tasks.workunit.client.1.smithi073.stdout:6/219: creat d15/f46 x:0 0 0 2024-08-31T05:20:59.307 INFO:tasks.workunit.client.1.smithi073.stdout:7/249: truncate d1/da/f32 2556394 0 2024-08-31T05:20:59.307 INFO:tasks.workunit.client.1.smithi073.stdout:4/294: dwrite d7/df/d13/d2e/f31 [0,4194304] 0 2024-08-31T05:20:59.308 INFO:tasks.workunit.client.1.smithi073.stdout:5/286: link dc/d16/d26/l27 dc/d16/d4e/l66 0 2024-08-31T05:20:59.308 INFO:tasks.workunit.client.1.smithi073.stdout:0/305: write d0/d15/d2c/d40/f56 [7794,55410] 0 2024-08-31T05:20:59.310 INFO:tasks.workunit.client.1.smithi073.stdout:3/305: creat da/f62 x:0 0 0 2024-08-31T05:20:59.310 INFO:tasks.workunit.client.1.smithi073.stdout:5/287: chown dc/f39 62517 1 2024-08-31T05:20:59.311 INFO:tasks.workunit.client.1.smithi073.stdout:4/295: stat l4 0 2024-08-31T05:20:59.311 INFO:tasks.workunit.client.1.smithi073.stdout:5/288: readlink dc/l22 0 2024-08-31T05:20:59.312 INFO:tasks.workunit.client.1.smithi073.stdout:3/306: chown da/d18/f38 7470 1 2024-08-31T05:20:59.312 INFO:tasks.workunit.client.1.smithi073.stdout:3/307: stat da/f12 0 2024-08-31T05:20:59.313 INFO:tasks.workunit.client.1.smithi073.stdout:9/327: write f7 [2113515,11537] 0 2024-08-31T05:20:59.313 INFO:tasks.workunit.client.1.smithi073.stdout:2/302: getdents d2/d9/df 0 2024-08-31T05:20:59.315 INFO:tasks.workunit.client.1.smithi073.stdout:0/306: unlink d0/f11 0 2024-08-31T05:20:59.317 INFO:tasks.workunit.client.1.smithi073.stdout:7/250: rename d1/da/d15/l46 to d1/da/d3e/d22/d47/l4f 0 2024-08-31T05:20:59.318 INFO:tasks.workunit.client.1.smithi073.stdout:0/307: rename d0/d15/d2c to d0/d15/d2c/d4d/d60 22 2024-08-31T05:20:59.318 INFO:tasks.workunit.client.1.smithi073.stdout:5/289: readlink dc/d16/d26/l27 0 2024-08-31T05:20:59.320 INFO:tasks.workunit.client.1.smithi073.stdout:4/296: dread d7/df/d13/d2e/f3a [0,4194304] 0 2024-08-31T05:20:59.321 INFO:tasks.workunit.client.1.smithi073.stdout:3/308: mknod da/d1b/d45/c63 0 2024-08-31T05:20:59.322 INFO:tasks.workunit.client.1.smithi073.stdout:2/303: mkdir d2/d9/d32/d5d 0 2024-08-31T05:20:59.323 INFO:tasks.workunit.client.1.smithi073.stdout:9/328: mknod dc/d10/c68 0 2024-08-31T05:20:59.326 INFO:tasks.workunit.client.1.smithi073.stdout:0/308: fsync d0/d15/d2c/d41/d52/f55 0 2024-08-31T05:20:59.328 INFO:tasks.workunit.client.1.smithi073.stdout:4/297: fsync d7/df/f56 0 2024-08-31T05:20:59.330 INFO:tasks.workunit.client.1.smithi073.stdout:3/309: rename da/d18/l1e to da/d3c/d5a/l64 0 2024-08-31T05:20:59.332 INFO:tasks.workunit.client.1.smithi073.stdout:7/251: dwrite d1/da/f32 [0,4194304] 0 2024-08-31T05:20:59.332 INFO:tasks.workunit.client.1.smithi073.stdout:2/304: creat d2/d9/df/d36/f5e x:0 0 0 2024-08-31T05:20:59.334 INFO:tasks.workunit.client.1.smithi073.stdout:9/329: symlink dc/de/d11/d41/l69 0 2024-08-31T05:20:59.337 INFO:tasks.workunit.client.1.smithi073.stdout:6/220: link d15/d1a/d1e/f3e d15/f47 0 2024-08-31T05:20:59.339 INFO:tasks.workunit.client.1.smithi073.stdout:0/309: dwrite d0/d15/d2c/d40/d4a/f4b [0,4194304] 0 2024-08-31T05:20:59.339 INFO:tasks.workunit.client.1.smithi073.stdout:5/290: dread dc/d16/d1a/f1f [0,4194304] 0 2024-08-31T05:20:59.341 INFO:tasks.workunit.client.1.smithi073.stdout:4/298: dwrite d7/df/f3f [0,4194304] 0 2024-08-31T05:20:59.341 INFO:tasks.workunit.client.1.smithi073.stdout:5/291: write dc/d3d/f4c [50332,61564] 0 2024-08-31T05:20:59.342 INFO:tasks.workunit.client.1.smithi073.stdout:3/310: rename da/d1b to da/d3c/d65 0 2024-08-31T05:20:59.346 INFO:tasks.workunit.client.1.smithi073.stdout:3/311: write da/f2f [583060,120516] 0 2024-08-31T05:20:59.348 INFO:tasks.workunit.client.1.smithi073.stdout:3/312: dread - da/d3c/d65/d40/f57 zero size 2024-08-31T05:20:59.350 INFO:tasks.workunit.client.1.smithi073.stdout:7/252: link d1/f43 d1/da/d15/d33/f50 0 2024-08-31T05:20:59.350 INFO:tasks.workunit.client.1.smithi073.stdout:9/330: chown dc/d37/d42/l5d 373930 1 2024-08-31T05:20:59.355 INFO:tasks.workunit.client.1.smithi073.stdout:6/221: symlink d15/l48 0 2024-08-31T05:20:59.355 INFO:tasks.workunit.client.1.smithi073.stdout:9/331: fsync dc/d27/f2e 0 2024-08-31T05:20:59.355 INFO:tasks.workunit.client.1.smithi073.stdout:7/253: unlink d1/d11/d14/f1b 0 2024-08-31T05:20:59.356 INFO:tasks.workunit.client.1.smithi073.stdout:3/313: creat da/d3c/d5a/f66 x:0 0 0 2024-08-31T05:20:59.356 INFO:tasks.workunit.client.1.smithi073.stdout:4/299: dwrite d7/df/d13/d2e/f48 [0,4194304] 0 2024-08-31T05:20:59.357 INFO:tasks.workunit.client.1.smithi073.stdout:9/332: rmdir dc/de/d66 39 2024-08-31T05:20:59.358 INFO:tasks.workunit.client.1.smithi073.stdout:5/292: getdents dc/d16/d4e 0 2024-08-31T05:20:59.359 INFO:tasks.workunit.client.1.smithi073.stdout:9/333: stat dc/de/f1e 0 2024-08-31T05:20:59.359 INFO:tasks.workunit.client.1.smithi073.stdout:3/314: mkdir da/d3c/d67 0 2024-08-31T05:20:59.360 INFO:tasks.workunit.client.1.smithi073.stdout:6/222: creat d15/f49 x:0 0 0 2024-08-31T05:20:59.361 INFO:tasks.workunit.client.1.smithi073.stdout:7/254: creat d1/da/d3e/d22/d47/f51 x:0 0 0 2024-08-31T05:20:59.362 INFO:tasks.workunit.client.1.smithi073.stdout:5/293: fsync dc/d16/f54 0 2024-08-31T05:20:59.364 INFO:tasks.workunit.client.1.smithi073.stdout:7/255: read d1/da/d15/d33/f42 [1796724,58731] 0 2024-08-31T05:20:59.364 INFO:tasks.workunit.client.1.smithi073.stdout:3/315: write da/fb [5133277,71974] 0 2024-08-31T05:20:59.366 INFO:tasks.workunit.client.1.smithi073.stdout:7/256: stat d1/f43 0 2024-08-31T05:20:59.366 INFO:tasks.workunit.client.1.smithi073.stdout:5/294: chown dc/d16/d26/f2c 133287 1 2024-08-31T05:20:59.368 INFO:tasks.workunit.client.1.smithi073.stdout:6/223: dread d15/d17/f3a [0,4194304] 0 2024-08-31T05:20:59.368 INFO:tasks.workunit.client.1.smithi073.stdout:4/300: dwrite d7/db/f4e [0,4194304] 0 2024-08-31T05:20:59.369 INFO:tasks.workunit.client.1.smithi073.stdout:4/301: read d7/df/f3f [898891,97232] 0 2024-08-31T05:20:59.370 INFO:tasks.workunit.client.1.smithi073.stdout:9/334: getdents dc/de/d11 0 2024-08-31T05:20:59.370 INFO:tasks.workunit.client.1.smithi073.stdout:7/257: unlink d1/da/d3e/d22/d35/f37 0 2024-08-31T05:20:59.373 INFO:tasks.workunit.client.1.smithi073.stdout:6/224: rename f6 to d15/d17/d26/d38/f4a 0 2024-08-31T05:20:59.374 INFO:tasks.workunit.client.1.smithi073.stdout:4/302: fsync d7/df/f56 0 2024-08-31T05:20:59.376 INFO:tasks.workunit.client.1.smithi073.stdout:5/295: creat dc/f67 x:0 0 0 2024-08-31T05:20:59.376 INFO:tasks.workunit.client.1.smithi073.stdout:7/258: creat d1/da/d3e/f52 x:0 0 0 2024-08-31T05:20:59.377 INFO:tasks.workunit.client.1.smithi073.stdout:1/246: sync 2024-08-31T05:20:59.379 INFO:tasks.workunit.client.1.smithi073.stdout:3/316: getdents da/d3c/d65/d45 0 2024-08-31T05:20:59.379 INFO:tasks.workunit.client.1.smithi073.stdout:5/296: creat dc/d53/f68 x:0 0 0 2024-08-31T05:20:59.383 INFO:tasks.workunit.client.1.smithi073.stdout:1/247: dread d5/d17/f38 [4194304,4194304] 0 2024-08-31T05:20:59.383 INFO:tasks.workunit.client.1.smithi073.stdout:1/248: fsync d5/d10/f28 0 2024-08-31T05:20:59.383 INFO:tasks.workunit.client.1.smithi073.stdout:4/303: creat d7/db/d11/d2c/d2d/f5b x:0 0 0 2024-08-31T05:20:59.384 INFO:tasks.workunit.client.1.smithi073.stdout:5/297: creat dc/d16/d3b/d3f/f69 x:0 0 0 2024-08-31T05:20:59.384 INFO:tasks.workunit.client.1.smithi073.stdout:4/304: fdatasync d7/df/d13/d2e/f48 0 2024-08-31T05:20:59.385 INFO:tasks.workunit.client.1.smithi073.stdout:0/310: dread - d0/d15/d2c/d4d/f54 zero size 2024-08-31T05:20:59.386 INFO:tasks.workunit.client.1.smithi073.stdout:7/259: link d1/da/d3e/d22/d47/f51 d1/d11/f53 0 2024-08-31T05:20:59.386 INFO:tasks.workunit.client.1.smithi073.stdout:5/298: truncate dc/d16/d3b/d3f/f69 400220 0 2024-08-31T05:20:59.387 INFO:tasks.workunit.client.1.smithi073.stdout:3/317: mkdir da/d68 0 2024-08-31T05:20:59.389 INFO:tasks.workunit.client.1.smithi073.stdout:4/305: mkdir d7/d1a/d5c 0 2024-08-31T05:20:59.389 INFO:tasks.workunit.client.1.smithi073.stdout:5/299: fsync dc/d3d/d55/f62 0 2024-08-31T05:20:59.390 INFO:tasks.workunit.client.1.smithi073.stdout:1/249: symlink d5/d10/d33/l45 0 2024-08-31T05:20:59.393 INFO:tasks.workunit.client.1.smithi073.stdout:4/306: truncate d7/db/f19 2345830 0 2024-08-31T05:20:59.393 INFO:tasks.workunit.client.1.smithi073.stdout:3/318: link da/d3c/f60 da/d68/f69 0 2024-08-31T05:20:59.395 INFO:tasks.workunit.client.1.smithi073.stdout:1/250: write d5/d17/f38 [2871085,122826] 0 2024-08-31T05:20:59.397 INFO:tasks.workunit.client.1.smithi073.stdout:2/305: dwrite d2/d9/f2a [0,4194304] 0 2024-08-31T05:20:59.399 INFO:tasks.workunit.client.1.smithi073.stdout:8/352: sync 2024-08-31T05:20:59.399 INFO:tasks.workunit.client.1.smithi073.stdout:3/319: symlink da/d3c/d65/d2c/l6a 0 2024-08-31T05:20:59.400 INFO:tasks.workunit.client.1.smithi073.stdout:2/306: chown d2/d9/d3c/c51 2752 1 2024-08-31T05:20:59.400 INFO:tasks.workunit.client.1.smithi073.stdout:5/300: link dc/d3d/d3e/c59 dc/d16/d1a/c6a 0 2024-08-31T05:20:59.403 INFO:tasks.workunit.client.1.smithi073.stdout:3/320: unlink da/c59 0 2024-08-31T05:20:59.404 INFO:tasks.workunit.client.1.smithi073.stdout:4/307: dread d7/df/f21 [0,4194304] 0 2024-08-31T05:20:59.405 INFO:tasks.workunit.client.1.smithi073.stdout:2/307: symlink d2/d25/l5f 0 2024-08-31T05:20:59.407 INFO:tasks.workunit.client.1.smithi073.stdout:8/353: mkdir d0/db/d1c/d24/d73 0 2024-08-31T05:20:59.408 INFO:tasks.workunit.client.1.smithi073.stdout:4/308: chown d7/df/d13/d2e/d47/d4c 1 1 2024-08-31T05:20:59.408 INFO:tasks.workunit.client.1.smithi073.stdout:1/251: dwrite d5/f7 [0,4194304] 0 2024-08-31T05:20:59.409 INFO:tasks.workunit.client.1.smithi073.stdout:5/301: mknod dc/c6b 0 2024-08-31T05:20:59.410 INFO:tasks.workunit.client.1.smithi073.stdout:3/321: creat da/d68/f6b x:0 0 0 2024-08-31T05:20:59.411 INFO:tasks.workunit.client.1.smithi073.stdout:6/225: write d15/d17/f3b [2757990,105203] 0 2024-08-31T05:20:59.411 INFO:tasks.workunit.client.1.smithi073.stdout:2/308: symlink d2/d9/df/d36/l60 0 2024-08-31T05:20:59.413 INFO:tasks.workunit.client.1.smithi073.stdout:1/252: chown d5/d10/d33/f30 2876187 1 2024-08-31T05:20:59.414 INFO:tasks.workunit.client.1.smithi073.stdout:4/309: write d7/df/d13/d2e/f48 [2862591,85673] 0 2024-08-31T05:20:59.415 INFO:tasks.workunit.client.1.smithi073.stdout:2/309: fdatasync d2/d9/d3c/f46 0 2024-08-31T05:20:59.415 INFO:tasks.workunit.client.1.smithi073.stdout:6/226: chown d15/l48 12603 1 2024-08-31T05:20:59.416 INFO:tasks.workunit.client.1.smithi073.stdout:5/302: creat dc/d16/d3b/d3f/d4f/f6c x:0 0 0 2024-08-31T05:20:59.416 INFO:tasks.workunit.client.1.smithi073.stdout:9/335: dwrite f8 [0,4194304] 0 2024-08-31T05:20:59.417 INFO:tasks.workunit.client.1.smithi073.stdout:6/227: rmdir d15 39 2024-08-31T05:20:59.418 INFO:tasks.workunit.client.1.smithi073.stdout:1/253: write d5/d10/d1b/f41 [938781,94706] 0 2024-08-31T05:20:59.418 INFO:tasks.workunit.client.1.smithi073.stdout:4/310: stat d7/db/d11/d2c/d2d 0 2024-08-31T05:20:59.419 INFO:tasks.workunit.client.1.smithi073.stdout:3/322: symlink da/d3c/d67/l6c 0 2024-08-31T05:20:59.422 INFO:tasks.workunit.client.1.smithi073.stdout:5/303: mknod dc/d16/d26/c6d 0 2024-08-31T05:20:59.423 INFO:tasks.workunit.client.1.smithi073.stdout:0/311: write d0/f1e [3152331,8353] 0 2024-08-31T05:20:59.424 INFO:tasks.workunit.client.1.smithi073.stdout:1/254: rmdir d5/d17 39 2024-08-31T05:20:59.426 INFO:tasks.workunit.client.1.smithi073.stdout:7/260: truncate d1/da/f32 2449082 0 2024-08-31T05:20:59.426 INFO:tasks.workunit.client.1.smithi073.stdout:8/354: dwrite d0/db/d44/f6f [0,4194304] 0 2024-08-31T05:20:59.429 INFO:tasks.workunit.client.1.smithi073.stdout:3/323: rmdir da/d3c/d65/d2c 39 2024-08-31T05:20:59.429 INFO:tasks.workunit.client.1.smithi073.stdout:8/355: chown d0/db/d1c/d34/f3d 11715709 1 2024-08-31T05:20:59.431 INFO:tasks.workunit.client.1.smithi073.stdout:8/356: readlink d0/db/d44/l59 0 2024-08-31T05:20:59.433 INFO:tasks.workunit.client.1.smithi073.stdout:6/228: mkdir d15/d1a/d2b/d2f/d4b 0 2024-08-31T05:20:59.435 INFO:tasks.workunit.client.1.smithi073.stdout:1/255: rmdir d5/d26 39 2024-08-31T05:20:59.435 INFO:tasks.workunit.client.1.smithi073.stdout:0/312: fsync d0/d15/d2c/d2e/f57 0 2024-08-31T05:20:59.435 INFO:tasks.workunit.client.1.smithi073.stdout:4/311: dwrite d7/db/d11/f58 [0,4194304] 0 2024-08-31T05:20:59.436 INFO:tasks.workunit.client.1.smithi073.stdout:7/261: mknod d1/da/d3e/c54 0 2024-08-31T05:20:59.438 INFO:tasks.workunit.client.1.smithi073.stdout:6/229: truncate d15/d17/f3a 1084644 0 2024-08-31T05:20:59.439 INFO:tasks.workunit.client.1.smithi073.stdout:5/304: symlink dc/l6e 0 2024-08-31T05:20:59.441 INFO:tasks.workunit.client.1.smithi073.stdout:0/313: read d0/d15/f37 [79490,106951] 0 2024-08-31T05:20:59.444 INFO:tasks.workunit.client.1.smithi073.stdout:3/324: rename da/d18/f21 to da/d3c/d65/d40/d5d/f6d 0 2024-08-31T05:20:59.447 INFO:tasks.workunit.client.1.smithi073.stdout:2/310: getdents d2/d9/df/d36 0 2024-08-31T05:20:59.448 INFO:tasks.workunit.client.1.smithi073.stdout:2/311: chown d2/d9/df/d43 1 1 2024-08-31T05:20:59.449 INFO:tasks.workunit.client.1.smithi073.stdout:9/336: link dc/de/c51 dc/de/d11/d41/d52/d5f/c6a 0 2024-08-31T05:20:59.452 INFO:tasks.workunit.client.1.smithi073.stdout:3/325: mknod da/d68/c6e 0 2024-08-31T05:20:59.452 INFO:tasks.workunit.client.1.smithi073.stdout:9/337: dread dc/d10/f53 [0,4194304] 0 2024-08-31T05:20:59.453 INFO:tasks.workunit.client.1.smithi073.stdout:1/256: creat d5/d26/f46 x:0 0 0 2024-08-31T05:20:59.454 INFO:tasks.workunit.client.1.smithi073.stdout:7/262: mknod d1/da/d15/c55 0 2024-08-31T05:20:59.457 INFO:tasks.workunit.client.1.smithi073.stdout:8/357: creat d0/db/d1c/d24/f74 x:0 0 0 2024-08-31T05:20:59.458 INFO:tasks.workunit.client.1.smithi073.stdout:2/312: rename d2/d9/c4d to d2/d9/d27/c61 0 2024-08-31T05:20:59.460 INFO:tasks.workunit.client.1.smithi073.stdout:0/314: dwrite d0/f26 [4194304,4194304] 0 2024-08-31T05:20:59.461 INFO:tasks.workunit.client.1.smithi073.stdout:5/305: creat dc/d16/f6f x:0 0 0 2024-08-31T05:20:59.464 INFO:tasks.workunit.client.1.smithi073.stdout:1/257: dread - d5/d17/d32/d37/f3c zero size 2024-08-31T05:20:59.464 INFO:tasks.workunit.client.1.smithi073.stdout:8/358: mkdir d0/db/d44/d72/d75 0 2024-08-31T05:20:59.469 INFO:tasks.workunit.client.1.smithi073.stdout:6/230: dread d15/d17/d26/f31 [0,4194304] 0 2024-08-31T05:20:59.469 INFO:tasks.workunit.client.1.smithi073.stdout:5/306: chown dc/d16/d3b/d3f/f50 112088901 1 2024-08-31T05:20:59.471 INFO:tasks.workunit.client.1.smithi073.stdout:4/312: dread f5 [0,4194304] 0 2024-08-31T05:20:59.473 INFO:tasks.workunit.client.1.smithi073.stdout:5/307: readlink dc/d16/d26/l27 0 2024-08-31T05:20:59.474 INFO:tasks.workunit.client.1.smithi073.stdout:7/263: dwrite d1/da/d3e/f52 [0,4194304] 0 2024-08-31T05:20:59.474 INFO:tasks.workunit.client.1.smithi073.stdout:0/315: rename d0/d15/d2c/d4d/d3c/l50 to d0/d58/l61 0 2024-08-31T05:20:59.476 INFO:tasks.workunit.client.1.smithi073.stdout:3/326: dread da/d18/f1f [0,4194304] 0 2024-08-31T05:20:59.476 INFO:tasks.workunit.client.1.smithi073.stdout:0/316: stat d0/f26 0 2024-08-31T05:20:59.477 INFO:tasks.workunit.client.1.smithi073.stdout:9/338: dread f9 [0,4194304] 0 2024-08-31T05:20:59.477 INFO:tasks.workunit.client.1.smithi073.stdout:6/231: creat d15/d1a/d2b/f4c x:0 0 0 2024-08-31T05:20:59.477 INFO:tasks.workunit.client.1.smithi073.stdout:8/359: truncate d0/db/d1c/d34/f3d 2051164 0 2024-08-31T05:20:59.478 INFO:tasks.workunit.client.1.smithi073.stdout:2/313: dwrite d2/d9/df/f1a [4194304,4194304] 0 2024-08-31T05:20:59.479 INFO:tasks.workunit.client.1.smithi073.stdout:5/308: chown dc/d16/d4e 7487 1 2024-08-31T05:20:59.481 INFO:tasks.workunit.client.1.smithi073.stdout:9/339: fsync dc/de/d11/d41/f4b 0 2024-08-31T05:20:59.483 INFO:tasks.workunit.client.1.smithi073.stdout:7/264: mknod d1/da/d3e/d22/c56 0 2024-08-31T05:20:59.484 INFO:tasks.workunit.client.1.smithi073.stdout:2/314: write d2/f35 [947143,49052] 0 2024-08-31T05:20:59.485 INFO:tasks.workunit.client.1.smithi073.stdout:8/360: fdatasync d0/db/d1c/f20 0 2024-08-31T05:20:59.487 INFO:tasks.workunit.client.1.smithi073.stdout:3/327: creat da/d3c/d67/f6f x:0 0 0 2024-08-31T05:20:59.487 INFO:tasks.workunit.client.1.smithi073.stdout:5/309: creat dc/d52/f70 x:0 0 0 2024-08-31T05:20:59.487 INFO:tasks.workunit.client.1.smithi073.stdout:6/232: chown d15/d17/d26/l44 143 1 2024-08-31T05:20:59.487 INFO:tasks.workunit.client.1.smithi073.stdout:0/317: mkdir d0/d15/d2c/d2e/d3d/d62 0 2024-08-31T05:20:59.487 INFO:tasks.workunit.client.1.smithi073.stdout:9/340: stat dc/de/d11/c2c 0 2024-08-31T05:20:59.488 INFO:tasks.workunit.client.1.smithi073.stdout:7/265: rmdir d1/da/d15/d33 39 2024-08-31T05:20:59.488 INFO:tasks.workunit.client.1.smithi073.stdout:2/315: dread - d2/d9/d3c/f40 zero size 2024-08-31T05:20:59.488 INFO:tasks.workunit.client.1.smithi073.stdout:8/361: stat d0/db/d1c/d34/d38/f64 0 2024-08-31T05:20:59.492 INFO:tasks.workunit.client.1.smithi073.stdout:0/318: dread - d0/f5b zero size 2024-08-31T05:20:59.492 INFO:tasks.workunit.client.1.smithi073.stdout:0/319: chown d0/d15/d2c/d2e/f38 365 1 2024-08-31T05:20:59.493 INFO:tasks.workunit.client.1.smithi073.stdout:5/310: unlink dc/l36 0 2024-08-31T05:20:59.493 INFO:tasks.workunit.client.1.smithi073.stdout:5/311: readlink dc/d16/d4e/l66 0 2024-08-31T05:20:59.495 INFO:tasks.workunit.client.1.smithi073.stdout:6/233: unlink d15/d1a/d2b/f2d 0 2024-08-31T05:20:59.496 INFO:tasks.workunit.client.1.smithi073.stdout:2/316: creat d2/d9/df/f62 x:0 0 0 2024-08-31T05:20:59.498 INFO:tasks.workunit.client.1.smithi073.stdout:8/362: symlink d0/db/d1c/d2a/l76 0 2024-08-31T05:20:59.498 INFO:tasks.workunit.client.1.smithi073.stdout:2/317: stat d2/d9/f24 0 2024-08-31T05:20:59.498 INFO:tasks.workunit.client.1.smithi073.stdout:7/266: symlink d1/da/d3e/d22/d47/l57 0 2024-08-31T05:20:59.498 INFO:tasks.workunit.client.1.smithi073.stdout:5/312: dread dc/d16/d1a/f33 [0,4194304] 0 2024-08-31T05:20:59.499 INFO:tasks.workunit.client.1.smithi073.stdout:0/320: rmdir d0/d15/d2c/d40 39 2024-08-31T05:20:59.499 INFO:tasks.workunit.client.1.smithi073.stdout:7/267: dread - d1/da/d3e/d22/f41 zero size 2024-08-31T05:20:59.501 INFO:tasks.workunit.client.1.smithi073.stdout:6/234: creat d15/d1a/f4d x:0 0 0 2024-08-31T05:20:59.501 INFO:tasks.workunit.client.1.smithi073.stdout:7/268: fsync d1/da/d15/f24 0 2024-08-31T05:20:59.502 INFO:tasks.workunit.client.1.smithi073.stdout:7/269: stat d1/da/d3e/d22/f27 0 2024-08-31T05:20:59.504 INFO:tasks.workunit.client.1.smithi073.stdout:6/235: truncate d15/d1a/d1e/f33 446013 0 2024-08-31T05:20:59.504 INFO:tasks.workunit.client.1.smithi073.stdout:8/363: dwrite d0/fe [0,4194304] 0 2024-08-31T05:20:59.506 INFO:tasks.workunit.client.1.smithi073.stdout:0/321: chown d0/d15/d2c/d40/d4a/f4b 154459 1 2024-08-31T05:20:59.508 INFO:tasks.workunit.client.1.smithi073.stdout:2/318: creat d2/d9/d32/d56/f63 x:0 0 0 2024-08-31T05:20:59.516 INFO:tasks.workunit.client.1.smithi073.stdout:6/236: symlink d15/d1a/d2b/d2f/l4e 0 2024-08-31T05:20:59.516 INFO:tasks.workunit.client.1.smithi073.stdout:0/322: mkdir d0/d58/d63 0 2024-08-31T05:20:59.516 INFO:tasks.workunit.client.1.smithi073.stdout:8/364: dwrite d0/db/d44/d4e/f5c [0,4194304] 0 2024-08-31T05:20:59.517 INFO:tasks.workunit.client.1.smithi073.stdout:2/319: creat d2/d9/df/f64 x:0 0 0 2024-08-31T05:20:59.518 INFO:tasks.workunit.client.1.smithi073.stdout:2/320: read d2/d9/d27/f33 [1558420,66113] 0 2024-08-31T05:20:59.519 INFO:tasks.workunit.client.1.smithi073.stdout:7/270: creat d1/da/d15/f58 x:0 0 0 2024-08-31T05:20:59.522 INFO:tasks.workunit.client.1.smithi073.stdout:9/341: truncate dc/de/d11/d41/f39 3422059 0 2024-08-31T05:20:59.525 INFO:tasks.workunit.client.1.smithi073.stdout:0/323: creat d0/d15/d2c/d40/d4a/f64 x:0 0 0 2024-08-31T05:20:59.526 INFO:tasks.workunit.client.1.smithi073.stdout:7/271: mknod d1/da/d3e/c59 0 2024-08-31T05:20:59.527 INFO:tasks.workunit.client.1.smithi073.stdout:2/321: mkdir d2/d9/d65 0 2024-08-31T05:20:59.530 INFO:tasks.workunit.client.1.smithi073.stdout:5/313: dwrite dc/d16/d26/f25 [4194304,4194304] 0 2024-08-31T05:20:59.531 INFO:tasks.workunit.client.1.smithi073.stdout:0/324: creat d0/d15/d2c/d2e/d3d/f65 x:0 0 0 2024-08-31T05:20:59.532 INFO:tasks.workunit.client.1.smithi073.stdout:2/322: dread d2/f5a [0,4194304] 0 2024-08-31T05:20:59.536 INFO:tasks.workunit.client.1.smithi073.stdout:9/342: dwrite dc/d37/f54 [0,4194304] 0 2024-08-31T05:20:59.536 INFO:tasks.workunit.client.1.smithi073.stdout:7/272: creat d1/da/d15/f5a x:0 0 0 2024-08-31T05:20:59.537 INFO:tasks.workunit.client.1.smithi073.stdout:2/323: fsync d2/d9/f2a 0 2024-08-31T05:20:59.540 INFO:tasks.workunit.client.1.smithi073.stdout:5/314: creat dc/d16/d26/d49/f71 x:0 0 0 2024-08-31T05:20:59.543 INFO:tasks.workunit.client.1.smithi073.stdout:7/273: creat d1/d11/d14/f5b x:0 0 0 2024-08-31T05:20:59.545 INFO:tasks.workunit.client.1.smithi073.stdout:5/315: unlink dc/c6b 0 2024-08-31T05:20:59.546 INFO:tasks.workunit.client.1.smithi073.stdout:5/316: fsync dc/f67 0 2024-08-31T05:20:59.547 INFO:tasks.workunit.client.1.smithi073.stdout:0/325: dwrite d0/d15/d2c/d2e/d3d/f65 [0,4194304] 0 2024-08-31T05:20:59.549 INFO:tasks.workunit.client.1.smithi073.stdout:2/324: mkdir d2/d9/d66 0 2024-08-31T05:20:59.550 INFO:tasks.workunit.client.1.smithi073.stdout:8/365: dread d0/f27 [0,4194304] 0 2024-08-31T05:20:59.551 INFO:tasks.workunit.client.1.smithi073.stdout:6/237: unlink d15/d17/d26/f31 0 2024-08-31T05:20:59.551 INFO:tasks.workunit.client.1.smithi073.stdout:0/326: fsync d0/d15/d2c/d4d/f3e 0 2024-08-31T05:20:59.554 INFO:tasks.workunit.client.1.smithi073.stdout:5/317: write dc/d16/d26/d49/f71 [446345,4438] 0 2024-08-31T05:20:59.555 INFO:tasks.workunit.client.1.smithi073.stdout:2/325: write d2/f5a [350814,106941] 0 2024-08-31T05:20:59.555 INFO:tasks.workunit.client.1.smithi073.stdout:6/238: fdatasync d15/d1a/f4d 0 2024-08-31T05:20:59.558 INFO:tasks.workunit.client.1.smithi073.stdout:7/274: dwrite d1/da/d38/f4c [0,4194304] 0 2024-08-31T05:20:59.559 INFO:tasks.workunit.client.1.smithi073.stdout:8/366: chown d0/db/d1c/d23/c47 2 1 2024-08-31T05:20:59.560 INFO:tasks.workunit.client.1.smithi073.stdout:6/239: chown d15/f47 0 1 2024-08-31T05:20:59.563 INFO:tasks.workunit.client.1.smithi073.stdout:0/327: truncate d0/d15/d2c/d2e/d3d/f43 5175630 0 2024-08-31T05:20:59.564 INFO:tasks.workunit.client.1.smithi073.stdout:6/240: dread - d15/f49 zero size 2024-08-31T05:20:59.565 INFO:tasks.workunit.client.1.smithi073.stdout:7/275: mkdir d1/da/d3e/d22/d5c 0 2024-08-31T05:20:59.570 INFO:tasks.workunit.client.1.smithi073.stdout:9/343: dread f5 [4194304,4194304] 0 2024-08-31T05:20:59.570 INFO:tasks.workunit.client.1.smithi073.stdout:0/328: chown d0/d15/d2c/d2e/d3d/c4e 491 1 2024-08-31T05:20:59.571 INFO:tasks.workunit.client.1.smithi073.stdout:7/276: mknod d1/da/d3e/d22/d5c/c5d 0 2024-08-31T05:20:59.571 INFO:tasks.workunit.client.1.smithi073.stdout:5/318: dread dc/d16/d1a/f1f [0,4194304] 0 2024-08-31T05:20:59.572 INFO:tasks.workunit.client.1.smithi073.stdout:2/326: dwrite d2/f4f [0,4194304] 0 2024-08-31T05:20:59.573 INFO:tasks.workunit.client.1.smithi073.stdout:2/327: fsync f1 0 2024-08-31T05:20:59.574 INFO:tasks.workunit.client.1.smithi073.stdout:9/344: fdatasync dc/d10/f18 0 2024-08-31T05:20:59.576 INFO:tasks.workunit.client.1.smithi073.stdout:5/319: creat dc/d16/d1a/f72 x:0 0 0 2024-08-31T05:20:59.581 INFO:tasks.workunit.client.1.smithi073.stdout:5/320: write fb [1323163,14775] 0 2024-08-31T05:20:59.583 INFO:tasks.workunit.client.1.smithi073.stdout:5/321: fdatasync dc/d3d/f4b 0 2024-08-31T05:20:59.584 INFO:tasks.workunit.client.1.smithi073.stdout:0/329: rename d0/d28/c2a to d0/d15/d2c/d4d/d3c/c66 0 2024-08-31T05:20:59.586 INFO:tasks.workunit.client.1.smithi073.stdout:7/277: link d1/l1a d1/da/d3e/d22/l5e 0 2024-08-31T05:20:59.586 INFO:tasks.workunit.client.1.smithi073.stdout:2/328: dwrite d2/d9/df/f1a [0,4194304] 0 2024-08-31T05:20:59.586 INFO:tasks.workunit.client.1.smithi073.stdout:0/330: readlink d0/d28/d4f/l5e 0 2024-08-31T05:20:59.589 INFO:tasks.workunit.client.1.smithi073.stdout:1/258: sync 2024-08-31T05:20:59.589 INFO:tasks.workunit.client.1.smithi073.stdout:5/322: fdatasync dc/d16/d26/d49/f71 0 2024-08-31T05:20:59.589 INFO:tasks.workunit.client.1.smithi073.stdout:7/278: creat d1/d11/d14/f5f x:0 0 0 2024-08-31T05:20:59.590 INFO:tasks.workunit.client.1.smithi073.stdout:6/241: dread d15/d1a/f20 [0,4194304] 0 2024-08-31T05:20:59.590 INFO:tasks.workunit.client.1.smithi073.stdout:8/367: dread d0/f1a [0,4194304] 0 2024-08-31T05:20:59.591 INFO:tasks.workunit.client.1.smithi073.stdout:1/259: chown d5/f3e 29026161 1 2024-08-31T05:20:59.594 INFO:tasks.workunit.client.1.smithi073.stdout:6/242: write d15/f29 [1056484,80537] 0 2024-08-31T05:20:59.595 INFO:tasks.workunit.client.1.smithi073.stdout:5/323: creat dc/d16/d3b/f73 x:0 0 0 2024-08-31T05:20:59.595 INFO:tasks.workunit.client.1.smithi073.stdout:1/260: fsync d5/d10/d2e/f44 0 2024-08-31T05:20:59.599 INFO:tasks.workunit.client.1.smithi073.stdout:2/329: dwrite f1 [0,4194304] 0 2024-08-31T05:20:59.600 INFO:tasks.workunit.client.1.smithi073.stdout:2/330: fsync d2/d9/d3c/f46 0 2024-08-31T05:20:59.600 INFO:tasks.workunit.client.1.smithi073.stdout:5/324: chown dc/d16/d26/d49/l5d 3 1 2024-08-31T05:20:59.601 INFO:tasks.workunit.client.1.smithi073.stdout:9/345: dread fb [0,4194304] 0 2024-08-31T05:20:59.605 INFO:tasks.workunit.client.1.smithi073.stdout:2/331: truncate d2/d9/df/f53 539367 0 2024-08-31T05:20:59.606 INFO:tasks.workunit.client.1.smithi073.stdout:5/325: truncate dc/d16/d26/f34 1377796 0 2024-08-31T05:20:59.607 INFO:tasks.workunit.client.1.smithi073.stdout:1/261: creat d5/d17/d32/f47 x:0 0 0 2024-08-31T05:20:59.607 INFO:tasks.workunit.client.1.smithi073.stdout:6/243: mknod d15/d1a/d2b/d2f/d4b/c4f 0 2024-08-31T05:20:59.608 INFO:tasks.workunit.client.1.smithi073.stdout:2/332: read - d2/d9/df/f64 zero size 2024-08-31T05:20:59.614 INFO:tasks.workunit.client.1.smithi073.stdout:6/244: rename d15/c23 to d15/d41/c50 0 2024-08-31T05:20:59.615 INFO:tasks.workunit.client.1.smithi073.stdout:6/245: fdatasync d15/f36 0 2024-08-31T05:20:59.617 INFO:tasks.workunit.client.1.smithi073.stdout:0/331: dread d0/f1e [0,4194304] 0 2024-08-31T05:20:59.617 INFO:tasks.workunit.client.1.smithi073.stdout:7/279: write d1/da/d15/d33/f50 [450058,97814] 0 2024-08-31T05:20:59.618 INFO:tasks.workunit.client.1.smithi073.stdout:6/246: mkdir d15/d1a/d51 0 2024-08-31T05:20:59.619 INFO:tasks.workunit.client.1.smithi073.stdout:0/332: dread - d0/d15/d2c/d41/d52/f55 zero size 2024-08-31T05:20:59.620 INFO:tasks.workunit.client.1.smithi073.stdout:9/346: dread dc/d37/f35 [0,4194304] 0 2024-08-31T05:20:59.621 INFO:tasks.workunit.client.1.smithi073.stdout:6/247: chown d15/d17/d26/f2c 22563 1 2024-08-31T05:20:59.622 INFO:tasks.workunit.client.1.smithi073.stdout:7/280: mkdir d1/da/d15/d33/d44/d60 0 2024-08-31T05:20:59.622 INFO:tasks.workunit.client.1.smithi073.stdout:9/347: symlink dc/d27/l6b 0 2024-08-31T05:20:59.623 INFO:tasks.workunit.client.1.smithi073.stdout:6/248: dread - d15/d1a/d1e/f37 zero size 2024-08-31T05:20:59.624 INFO:tasks.workunit.client.1.smithi073.stdout:9/348: dread - dc/f60 zero size 2024-08-31T05:20:59.628 INFO:tasks.workunit.client.1.smithi073.stdout:7/281: write d1/da/f34 [4738417,61901] 0 2024-08-31T05:20:59.628 INFO:tasks.workunit.client.1.smithi073.stdout:8/368: dwrite d0/db/d1c/d34/f3d [0,4194304] 0 2024-08-31T05:20:59.630 INFO:tasks.workunit.client.1.smithi073.stdout:0/333: dread d0/f49 [0,4194304] 0 2024-08-31T05:20:59.630 INFO:tasks.workunit.client.1.smithi073.stdout:6/249: dread - d15/d17/d26/d38/f40 zero size 2024-08-31T05:20:59.631 INFO:tasks.workunit.client.1.smithi073.stdout:7/282: mknod d1/da/d3e/d22/d35/c61 0 2024-08-31T05:20:59.632 INFO:tasks.workunit.client.1.smithi073.stdout:1/262: dread d5/d10/d33/f30 [0,4194304] 0 2024-08-31T05:20:59.633 INFO:tasks.workunit.client.1.smithi073.stdout:6/250: dread - d15/d1a/d2b/f4c zero size 2024-08-31T05:20:59.633 INFO:tasks.workunit.client.1.smithi073.stdout:9/349: symlink dc/d37/d42/d5a/l6c 0 2024-08-31T05:20:59.634 INFO:tasks.workunit.client.1.smithi073.stdout:7/283: chown d1/da/d15/c3d 10723 1 2024-08-31T05:20:59.634 INFO:tasks.workunit.client.1.smithi073.stdout:9/350: chown dc/d37 3117826 1 2024-08-31T05:20:59.635 INFO:tasks.workunit.client.1.smithi073.stdout:7/284: fdatasync d1/d11/d14/f29 0 2024-08-31T05:20:59.636 INFO:tasks.workunit.client.1.smithi073.stdout:0/334: mknod d0/d15/d2c/d4d/d3c/c67 0 2024-08-31T05:20:59.638 INFO:tasks.workunit.client.1.smithi073.stdout:8/369: link d0/db/d1c/d2a/f30 d0/db/d44/f77 0 2024-08-31T05:20:59.639 INFO:tasks.workunit.client.1.smithi073.stdout:6/251: creat d15/d1a/f52 x:0 0 0 2024-08-31T05:20:59.641 INFO:tasks.workunit.client.1.smithi073.stdout:9/351: rename fb to dc/d37/f6d 0 2024-08-31T05:20:59.641 INFO:tasks.workunit.client.1.smithi073.stdout:7/285: readlink d1/da/d3e/d22/d47/l4f 0 2024-08-31T05:20:59.642 INFO:tasks.workunit.client.1.smithi073.stdout:1/263: dwrite d5/d10/d33/fe [0,4194304] 0 2024-08-31T05:20:59.644 INFO:tasks.workunit.client.1.smithi073.stdout:6/252: write d15/d17/d26/f45 [192180,66423] 0 2024-08-31T05:20:59.645 INFO:tasks.workunit.client.1.smithi073.stdout:6/253: dread - d15/d1a/d1e/f25 zero size 2024-08-31T05:20:59.646 INFO:tasks.workunit.client.1.smithi073.stdout:1/264: symlink d5/d17/d2a/l48 0 2024-08-31T05:20:59.649 INFO:tasks.workunit.client.1.smithi073.stdout:8/370: creat d0/db/d1c/d24/f78 x:0 0 0 2024-08-31T05:20:59.653 INFO:tasks.workunit.client.1.smithi073.stdout:7/286: getdents d1/da/d38 0 2024-08-31T05:20:59.655 INFO:tasks.workunit.client.1.smithi073.stdout:6/254: rename l5 to d15/d17/l53 0 2024-08-31T05:20:59.656 INFO:tasks.workunit.client.1.smithi073.stdout:8/371: getdents d0/db/d1c/d2a/d58 0 2024-08-31T05:20:59.658 INFO:tasks.workunit.client.1.smithi073.stdout:1/265: dread f0 [0,4194304] 0 2024-08-31T05:20:59.660 INFO:tasks.workunit.client.1.smithi073.stdout:1/266: write d5/f9 [4596691,28026] 0 2024-08-31T05:20:59.660 INFO:tasks.workunit.client.1.smithi073.stdout:9/352: dread dc/d37/f5e [0,4194304] 0 2024-08-31T05:20:59.662 INFO:tasks.workunit.client.1.smithi073.stdout:6/255: dread d15/f29 [0,4194304] 0 2024-08-31T05:20:59.662 INFO:tasks.workunit.client.1.smithi073.stdout:1/267: mknod d5/d10/c49 0 2024-08-31T05:20:59.663 INFO:tasks.workunit.client.1.smithi073.stdout:9/353: creat dc/d37/f6e x:0 0 0 2024-08-31T05:20:59.663 INFO:tasks.workunit.client.1.smithi073.stdout:1/268: write d5/d10/d33/f36 [7106592,91507] 0 2024-08-31T05:20:59.665 INFO:tasks.workunit.client.1.smithi073.stdout:6/256: mknod d15/d1a/d2b/d2f/c54 0 2024-08-31T05:20:59.666 INFO:tasks.workunit.client.1.smithi073.stdout:0/335: dread d0/d15/d2c/d2e/f3f [0,4194304] 0 2024-08-31T05:20:59.667 INFO:tasks.workunit.client.1.smithi073.stdout:7/287: truncate d1/da/d15/d33/f36 751345 0 2024-08-31T05:20:59.667 INFO:tasks.workunit.client.1.smithi073.stdout:9/354: unlink dc/d37/d42/l5d 0 2024-08-31T05:20:59.669 INFO:tasks.workunit.client.1.smithi073.stdout:6/257: dread d15/d17/d26/f45 [0,4194304] 0 2024-08-31T05:20:59.669 INFO:tasks.workunit.client.1.smithi073.stdout:0/336: mkdir d0/d15/d2c/d2e/d3d/d68 0 2024-08-31T05:20:59.669 INFO:tasks.workunit.client.1.smithi073.stdout:7/288: read d1/da/d3e/d22/f27 [284618,5714] 0 2024-08-31T05:20:59.670 INFO:tasks.workunit.client.1.smithi073.stdout:9/355: symlink dc/d37/d42/l6f 0 2024-08-31T05:20:59.670 INFO:tasks.workunit.client.1.smithi073.stdout:1/269: dread d5/f7 [0,4194304] 0 2024-08-31T05:20:59.671 INFO:tasks.workunit.client.1.smithi073.stdout:1/270: readlink l3 0 2024-08-31T05:20:59.671 INFO:tasks.workunit.client.1.smithi073.stdout:0/337: chown d0/d15/d2c/d2e/d3d/d68 4344 1 2024-08-31T05:20:59.671 INFO:tasks.workunit.client.1.smithi073.stdout:6/258: symlink d15/d17/d26/d38/l55 0 2024-08-31T05:20:59.672 INFO:tasks.workunit.client.1.smithi073.stdout:7/289: write d1/da/d3e/f52 [1996405,16958] 0 2024-08-31T05:20:59.673 INFO:tasks.workunit.client.1.smithi073.stdout:1/271: fsync f0 0 2024-08-31T05:20:59.673 INFO:tasks.workunit.client.1.smithi073.stdout:9/356: truncate dc/f28 253558 0 2024-08-31T05:20:59.674 INFO:tasks.workunit.client.1.smithi073.stdout:0/338: stat d0/d15/d2c/d40/d4a/l5d 0 2024-08-31T05:20:59.675 INFO:tasks.workunit.client.1.smithi073.stdout:6/259: write d15/d1a/d1e/f33 [1006795,78330] 0 2024-08-31T05:20:59.678 INFO:tasks.workunit.client.1.smithi073.stdout:9/357: mknod dc/c70 0 2024-08-31T05:20:59.679 INFO:tasks.workunit.client.1.smithi073.stdout:0/339: readlink d0/d58/l61 0 2024-08-31T05:20:59.679 INFO:tasks.workunit.client.1.smithi073.stdout:6/260: mknod d15/d1a/d2b/d2f/c56 0 2024-08-31T05:20:59.681 INFO:tasks.workunit.client.1.smithi073.stdout:7/290: mknod d1/da/d15/c62 0 2024-08-31T05:20:59.681 INFO:tasks.workunit.client.1.smithi073.stdout:7/291: truncate d1/f43 754300 0 2024-08-31T05:20:59.683 INFO:tasks.workunit.client.1.smithi073.stdout:7/292: write d1/da/d15/f24 [4982788,127951] 0 2024-08-31T05:20:59.683 INFO:tasks.workunit.client.1.smithi073.stdout:7/293: dread - d1/d11/f53 zero size 2024-08-31T05:20:59.684 INFO:tasks.workunit.client.1.smithi073.stdout:6/261: creat d15/d1a/d2b/d2f/d4b/f57 x:0 0 0 2024-08-31T05:20:59.685 INFO:tasks.workunit.client.1.smithi073.stdout:7/294: truncate d1/f2e 308446 0 2024-08-31T05:20:59.686 INFO:tasks.workunit.client.1.smithi073.stdout:0/340: mkdir d0/d69 0 2024-08-31T05:20:59.689 INFO:tasks.workunit.client.1.smithi073.stdout:6/262: unlink d15/d1a/f4d 0 2024-08-31T05:20:59.691 INFO:tasks.workunit.client.1.smithi073.stdout:7/295: dwrite d1/da/f26 [0,4194304] 0 2024-08-31T05:20:59.697 INFO:tasks.workunit.client.1.smithi073.stdout:3/328: sync 2024-08-31T05:20:59.697 INFO:tasks.workunit.client.1.smithi073.stdout:4/313: sync 2024-08-31T05:20:59.698 INFO:tasks.workunit.client.1.smithi073.stdout:7/296: dread d1/da/d15/d33/f50 [0,4194304] 0 2024-08-31T05:20:59.699 INFO:tasks.workunit.client.1.smithi073.stdout:4/314: write d7/d1a/f29 [287427,60438] 0 2024-08-31T05:20:59.700 INFO:tasks.workunit.client.1.smithi073.stdout:6/263: dwrite d15/f29 [0,4194304] 0 2024-08-31T05:20:59.702 INFO:tasks.workunit.client.1.smithi073.stdout:7/297: write d1/da/d3e/f1f [5142546,63177] 0 2024-08-31T05:20:59.706 INFO:tasks.workunit.client.1.smithi073.stdout:6/264: fdatasync d15/d17/f3a 0 2024-08-31T05:20:59.708 INFO:tasks.workunit.client.1.smithi073.stdout:7/298: rename d1/d11/d14/f2b to d1/d11/d14/f63 0 2024-08-31T05:20:59.710 INFO:tasks.workunit.client.1.smithi073.stdout:6/265: mknod d15/d1a/d2b/c58 0 2024-08-31T05:20:59.711 INFO:tasks.workunit.client.1.smithi073.stdout:4/315: dwrite d7/f12 [0,4194304] 0 2024-08-31T05:20:59.712 INFO:tasks.workunit.client.1.smithi073.stdout:9/358: dread dc/de/d11/f43 [0,4194304] 0 2024-08-31T05:20:59.712 INFO:tasks.workunit.client.1.smithi073.stdout:7/299: creat d1/d11/f64 x:0 0 0 2024-08-31T05:20:59.715 INFO:tasks.workunit.client.1.smithi073.stdout:3/329: truncate da/d18/f1f 2627622 0 2024-08-31T05:20:59.716 INFO:tasks.workunit.client.1.smithi073.stdout:4/316: fdatasync d7/df/f56 0 2024-08-31T05:20:59.717 INFO:tasks.workunit.client.1.smithi073.stdout:7/300: truncate d1/da/d3e/d22/f41 829586 0 2024-08-31T05:20:59.718 INFO:tasks.workunit.client.1.smithi073.stdout:9/359: write dc/de/f1e [1759993,85203] 0 2024-08-31T05:20:59.721 INFO:tasks.workunit.client.1.smithi073.stdout:9/360: chown dc/de/d11/d41/d52/d5b 19 1 2024-08-31T05:20:59.721 INFO:tasks.workunit.client.1.smithi073.stdout:7/301: read d1/da/d3e/f1f [719137,120375] 0 2024-08-31T05:20:59.725 INFO:tasks.workunit.client.1.smithi073.stdout:7/302: mkdir d1/da/d65 0 2024-08-31T05:20:59.726 INFO:tasks.workunit.client.1.smithi073.stdout:9/361: creat dc/de/d11/d41/d52/d5f/f71 x:0 0 0 2024-08-31T05:20:59.726 INFO:tasks.workunit.client.1.smithi073.stdout:3/330: dwrite da/d3c/d65/f4c [0,4194304] 0 2024-08-31T05:20:59.727 INFO:tasks.workunit.client.0.smithi067.stderr:++ readlink -f fsstress 2024-08-31T05:20:59.728 INFO:tasks.workunit.client.1.smithi073.stdout:9/362: readlink dc/d37/d42/l63 0 2024-08-31T05:20:59.728 INFO:tasks.workunit.client.1.smithi073.stdout:7/303: write d1/d11/f64 [156976,120578] 0 2024-08-31T05:20:59.730 INFO:tasks.workunit.client.1.smithi073.stdout:3/331: mknod da/d3c/c70 0 2024-08-31T05:20:59.730 INFO:tasks.workunit.client.0.smithi067.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-08-31T05:20:59.730 INFO:tasks.workunit.client.0.smithi067.stderr:+ popd 2024-08-31T05:20:59.731 INFO:tasks.workunit.client.1.smithi073.stdout:3/332: read da/fb [3022952,22878] 0 2024-08-31T05:20:59.731 INFO:tasks.workunit.client.0.smithi067.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-08-31T05:20:59.732 INFO:tasks.workunit.client.0.smithi067.stderr:+ popd 2024-08-31T05:20:59.732 INFO:tasks.workunit.client.1.smithi073.stdout:3/333: fsync da/d18/f2a 0 2024-08-31T05:20:59.732 INFO:tasks.workunit.client.1.smithi073.stdout:7/304: creat d1/da/d15/d33/d44/f66 x:0 0 0 2024-08-31T05:20:59.733 INFO:tasks.workunit.client.0.smithi067.stdout:~/cephtest/mnt.0/client.0/tmp 2024-08-31T05:20:59.733 INFO:tasks.workunit.client.0.smithi067.stderr:++ mktemp -d -p . 2024-08-31T05:20:59.735 INFO:tasks.workunit.client.1.smithi073.stdout:7/305: read d1/d11/d14/f63 [809002,13311] 0 2024-08-31T05:20:59.735 INFO:tasks.workunit.client.1.smithi073.stdout:3/334: creat da/d3c/f71 x:0 0 0 2024-08-31T05:20:59.736 INFO:tasks.workunit.client.1.smithi073.stdout:3/335: chown da/d3c/d5a/f66 125210 1 2024-08-31T05:20:59.737 INFO:tasks.workunit.client.0.smithi067.stderr:+ T=./tmp.RVPAQwVJYp 2024-08-31T05:20:59.737 INFO:tasks.workunit.client.0.smithi067.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.RVPAQwVJYp -l 1 -n 1000 -p 10 -v 2024-08-31T05:20:59.738 INFO:tasks.workunit.client.1.smithi073.stdout:7/306: truncate d1/d11/f53 849814 0 2024-08-31T05:20:59.739 INFO:tasks.workunit.client.1.smithi073.stdout:3/336: symlink da/d3c/l72 0 2024-08-31T05:20:59.740 INFO:tasks.workunit.client.1.smithi073.stdout:7/307: mknod d1/d11/d14/c67 0 2024-08-31T05:20:59.741 INFO:tasks.workunit.client.1.smithi073.stdout:7/308: fsync d1/da/d15/f24 0 2024-08-31T05:20:59.741 INFO:tasks.workunit.client.1.smithi073.stdout:4/317: dread d7/df/d1b/f1f [0,4194304] 0 2024-08-31T05:20:59.743 INFO:tasks.workunit.client.1.smithi073.stdout:3/337: rename da/d3c/d65/f4c to da/d3c/d67/f73 0 2024-08-31T05:20:59.745 INFO:tasks.workunit.client.0.smithi067.stdout:seed = 1725560570 2024-08-31T05:20:59.747 INFO:tasks.workunit.client.1.smithi073.stdout:9/363: dread dc/f25 [4194304,4194304] 0 2024-08-31T05:20:59.747 INFO:tasks.workunit.client.1.smithi073.stdout:7/309: dwrite d1/d11/d14/f29 [0,4194304] 0 2024-08-31T05:20:59.748 INFO:tasks.workunit.client.1.smithi073.stdout:3/338: chown da/d3c/d65/c3b 3772 1 2024-08-31T05:20:59.749 INFO:tasks.workunit.client.1.smithi073.stdout:3/339: write da/d3c/f5e [505794,23091] 0 2024-08-31T05:20:59.750 INFO:tasks.workunit.client.1.smithi073.stdout:7/310: write d1/d11/d14/f29 [601252,999] 0 2024-08-31T05:20:59.752 INFO:tasks.workunit.client.1.smithi073.stdout:9/364: mkdir dc/de/d56/d72 0 2024-08-31T05:20:59.752 INFO:tasks.workunit.client.1.smithi073.stdout:7/311: write d1/d11/d14/f5b [843495,128015] 0 2024-08-31T05:20:59.753 INFO:tasks.workunit.client.1.smithi073.stdout:7/312: stat d1/d11/d14/f29 0 2024-08-31T05:20:59.753 INFO:tasks.workunit.client.1.smithi073.stdout:7/313: fsync d1/d11/d14/f3c 0 2024-08-31T05:20:59.755 INFO:tasks.workunit.client.1.smithi073.stdout:7/314: write d1/da/d3e/d22/f41 [1746336,116206] 0 2024-08-31T05:20:59.756 INFO:tasks.workunit.client.1.smithi073.stdout:3/340: symlink da/d3c/d65/d45/l74 0 2024-08-31T05:20:59.760 INFO:tasks.workunit.client.0.smithi067.stdout:2/0: dwrite - no filename 2024-08-31T05:20:59.760 INFO:tasks.workunit.client.0.smithi067.stdout:2/1: write - no filename 2024-08-31T05:20:59.760 INFO:tasks.workunit.client.0.smithi067.stdout:2/2: dread - no filename 2024-08-31T05:20:59.760 INFO:tasks.workunit.client.0.smithi067.stdout:2/3: dwrite - no filename 2024-08-31T05:20:59.762 INFO:tasks.workunit.client.1.smithi073.stdout:4/318: truncate d7/db/f4e 2821034 0 2024-08-31T05:20:59.763 INFO:tasks.workunit.client.0.smithi067.stdout:0/0: getdents . 0 2024-08-31T05:20:59.765 INFO:tasks.workunit.client.0.smithi067.stdout:3/0: chown . 2034489 1 2024-08-31T05:20:59.765 INFO:tasks.workunit.client.1.smithi073.stdout:9/365: mkdir dc/de/d11/d41/d52/d5b/d73 0 2024-08-31T05:20:59.765 INFO:tasks.workunit.client.1.smithi073.stdout:3/341: dwrite da/ff [0,4194304] 0 2024-08-31T05:20:59.766 INFO:tasks.workunit.client.0.smithi067.stdout:1/0: creat f0 x:0 0 0 2024-08-31T05:20:59.766 INFO:tasks.workunit.client.0.smithi067.stdout:1/1: write f0 [402694,9074] 0 2024-08-31T05:20:59.767 INFO:tasks.workunit.client.1.smithi073.stdout:4/319: fsync f5 0 2024-08-31T05:20:59.769 INFO:tasks.workunit.client.0.smithi067.stdout:2/4: symlink l0 0 2024-08-31T05:20:59.769 INFO:tasks.workunit.client.0.smithi067.stdout:2/5: read - no filename 2024-08-31T05:20:59.769 INFO:tasks.workunit.client.0.smithi067.stdout:2/6: dwrite - no filename 2024-08-31T05:20:59.769 INFO:tasks.workunit.client.0.smithi067.stdout:2/7: rmdir - no directory 2024-08-31T05:20:59.769 INFO:tasks.workunit.client.0.smithi067.stdout:2/8: dwrite - no filename 2024-08-31T05:20:59.769 INFO:tasks.workunit.client.0.smithi067.stdout:2/9: dread - no filename 2024-08-31T05:20:59.769 INFO:tasks.workunit.client.0.smithi067.stdout:2/10: write - no filename 2024-08-31T05:20:59.770 INFO:tasks.workunit.client.0.smithi067.stdout:4/0: truncate - no filename 2024-08-31T05:20:59.770 INFO:tasks.workunit.client.0.smithi067.stdout:2/11: chown l0 29913 1 2024-08-31T05:20:59.771 INFO:tasks.workunit.client.1.smithi073.stdout:9/366: rename dc/f60 to dc/de/d11/d41/f74 0 2024-08-31T05:20:59.771 INFO:tasks.workunit.client.1.smithi073.stdout:7/315: dread d1/da/f34 [0,4194304] 0 2024-08-31T05:20:59.772 INFO:tasks.workunit.client.0.smithi067.stdout:0/1: mknod c0 0 2024-08-31T05:20:59.773 INFO:tasks.workunit.client.1.smithi073.stdout:4/320: mkdir d7/d5d 0 2024-08-31T05:20:59.774 INFO:tasks.workunit.client.1.smithi073.stdout:3/342: dread f9 [0,4194304] 0 2024-08-31T05:20:59.774 INFO:tasks.workunit.client.0.smithi067.stdout:1/2: creat f1 x:0 0 0 2024-08-31T05:20:59.774 INFO:tasks.workunit.client.1.smithi073.stdout:3/343: chown da/d3c/d67/f6f 1083 1 2024-08-31T05:20:59.775 INFO:tasks.workunit.client.0.smithi067.stdout:1/3: write f0 [163011,56941] 0 2024-08-31T05:20:59.777 INFO:tasks.workunit.client.0.smithi067.stdout:3/1: symlink l0 0 2024-08-31T05:20:59.777 INFO:tasks.workunit.client.1.smithi073.stdout:7/316: rmdir d1/d11/d14 39 2024-08-31T05:20:59.781 INFO:tasks.workunit.client.0.smithi067.stdout:2/12: creat f1 x:0 0 0 2024-08-31T05:20:59.782 INFO:tasks.workunit.client.1.smithi073.stdout:3/344: mknod da/d3c/d67/c75 0 2024-08-31T05:20:59.783 INFO:tasks.workunit.client.0.smithi067.stdout:2/13: chown f1 0 1 2024-08-31T05:20:59.783 INFO:tasks.workunit.client.0.smithi067.stdout:2/14: write f1 [393880,105334] 0 2024-08-31T05:20:59.783 INFO:tasks.workunit.client.0.smithi067.stdout:0/2: mkdir d1 0 2024-08-31T05:20:59.783 INFO:tasks.workunit.client.0.smithi067.stdout:0/3: dread - no filename 2024-08-31T05:20:59.785 INFO:tasks.workunit.client.1.smithi073.stdout:7/317: fdatasync d1/da/f34 0 2024-08-31T05:20:59.788 INFO:tasks.workunit.client.1.smithi073.stdout:3/345: write da/d3c/d65/d2c/f48 [257537,100653] 0 2024-08-31T05:20:59.789 INFO:tasks.workunit.client.0.smithi067.stdout:2/15: dwrite f1 [0,4194304] 0 2024-08-31T05:20:59.790 INFO:tasks.workunit.client.1.smithi073.stdout:9/367: creat dc/f75 x:0 0 0 2024-08-31T05:20:59.791 INFO:tasks.workunit.client.0.smithi067.stdout:2/16: chown f1 1940 1 2024-08-31T05:20:59.791 INFO:tasks.workunit.client.0.smithi067.stdout:2/17: write f1 [71253,48232] 0 2024-08-31T05:20:59.793 INFO:tasks.workunit.client.0.smithi067.stdout:3/2: creat f1 x:0 0 0 2024-08-31T05:20:59.793 INFO:tasks.workunit.client.0.smithi067.stdout:3/3: truncate f1 795052 0 2024-08-31T05:20:59.794 INFO:tasks.workunit.client.0.smithi067.stdout:4/1: creat f0 x:0 0 0 2024-08-31T05:20:59.795 INFO:tasks.workunit.client.1.smithi073.stdout:9/368: dwrite dc/de/d56/f5c [0,4194304] 0 2024-08-31T05:20:59.795 INFO:tasks.workunit.client.0.smithi067.stdout:4/2: dread - f0 zero size 2024-08-31T05:20:59.798 INFO:tasks.workunit.client.1.smithi073.stdout:3/346: symlink da/d3c/d65/d45/l76 0 2024-08-31T05:20:59.799 INFO:tasks.workunit.client.1.smithi073.stdout:3/347: fsync da/d3c/f42 0 2024-08-31T05:20:59.799 INFO:tasks.workunit.client.1.smithi073.stdout:9/369: dread dc/d37/f6d [0,4194304] 0 2024-08-31T05:20:59.801 INFO:tasks.workunit.client.0.smithi067.stdout:1/4: link f1 f2 0 2024-08-31T05:20:59.801 INFO:tasks.workunit.client.1.smithi073.stdout:3/348: stat da/d3c/f60 0 2024-08-31T05:20:59.801 INFO:tasks.workunit.client.1.smithi073.stdout:7/318: rename d1/da/d15/d33/f36 to d1/da/d3e/d22/d47/f68 0 2024-08-31T05:20:59.802 INFO:tasks.workunit.client.0.smithi067.stdout:1/5: write f0 [733001,80011] 0 2024-08-31T05:20:59.802 INFO:tasks.workunit.client.1.smithi073.stdout:4/321: getdents d7/d24 0 2024-08-31T05:20:59.803 INFO:tasks.workunit.client.1.smithi073.stdout:3/349: write da/d3c/d65/d45/f56 [1391007,127314] 0 2024-08-31T05:20:59.803 INFO:tasks.workunit.client.0.smithi067.stdout:7/0: write - no filename 2024-08-31T05:20:59.803 INFO:tasks.workunit.client.0.smithi067.stdout:7/1: dwrite - no filename 2024-08-31T05:20:59.804 INFO:tasks.workunit.client.0.smithi067.stdout:7/2: dwrite - no filename 2024-08-31T05:20:59.804 INFO:tasks.workunit.client.0.smithi067.stdout:7/3: rmdir - no directory 2024-08-31T05:20:59.804 INFO:tasks.workunit.client.0.smithi067.stdout:7/4: link - no file 2024-08-31T05:20:59.805 INFO:tasks.workunit.client.0.smithi067.stdout:5/0: creat f0 x:0 0 0 2024-08-31T05:20:59.807 INFO:tasks.workunit.client.0.smithi067.stdout:5/1: write f0 [958302,121325] 0 2024-08-31T05:20:59.809 INFO:tasks.workunit.client.1.smithi073.stdout:9/370: creat dc/d37/d42/f76 x:0 0 0 2024-08-31T05:20:59.810 INFO:tasks.workunit.client.0.smithi067.stdout:3/4: symlink l2 0 2024-08-31T05:20:59.811 INFO:tasks.workunit.client.1.smithi073.stdout:5/326: sync 2024-08-31T05:20:59.811 INFO:tasks.workunit.client.0.smithi067.stdout:0/4: mknod d1/c2 0 2024-08-31T05:20:59.811 INFO:tasks.workunit.client.0.smithi067.stdout:0/5: dread - no filename 2024-08-31T05:20:59.811 INFO:tasks.workunit.client.0.smithi067.stdout:0/6: dwrite - no filename 2024-08-31T05:20:59.811 INFO:tasks.workunit.client.0.smithi067.stdout:0/7: write - no filename 2024-08-31T05:20:59.811 INFO:tasks.workunit.client.0.smithi067.stdout:0/8: read - no filename 2024-08-31T05:20:59.812 INFO:tasks.workunit.client.1.smithi073.stdout:5/327: readlink dc/l22 0 2024-08-31T05:20:59.814 INFO:tasks.workunit.client.1.smithi073.stdout:5/328: fsync dc/d16/d3b/d3f/f69 0 2024-08-31T05:20:59.814 INFO:tasks.workunit.client.1.smithi073.stdout:3/350: symlink da/d3c/d65/d40/d5d/l77 0 2024-08-31T05:20:59.815 INFO:tasks.workunit.client.0.smithi067.stdout:1/6: mkdir d3 0 2024-08-31T05:20:59.816 INFO:tasks.workunit.client.1.smithi073.stdout:9/371: dwrite dc/d37/f6e [0,4194304] 0 2024-08-31T05:20:59.818 INFO:tasks.workunit.client.0.smithi067.stdout:8/0: chown . 2729 1 2024-08-31T05:20:59.818 INFO:tasks.workunit.client.0.smithi067.stdout:8/1: rename - no filename 2024-08-31T05:20:59.818 INFO:tasks.workunit.client.0.smithi067.stdout:8/2: fsync - no filename 2024-08-31T05:20:59.818 INFO:tasks.workunit.client.0.smithi067.stdout:8/3: truncate - no filename 2024-08-31T05:20:59.818 INFO:tasks.workunit.client.0.smithi067.stdout:8/4: dread - no filename 2024-08-31T05:20:59.823 INFO:tasks.workunit.client.1.smithi073.stdout:5/329: dread dc/d16/f2b [0,4194304] 0 2024-08-31T05:20:59.823 INFO:tasks.workunit.client.0.smithi067.stdout:5/2: dread f0 [0,4194304] 0 2024-08-31T05:20:59.823 INFO:tasks.workunit.client.1.smithi073.stdout:5/330: write dc/f14 [4468907,22686] 0 2024-08-31T05:20:59.824 INFO:tasks.workunit.client.0.smithi067.stdout:6/0: mknod c0 0 2024-08-31T05:20:59.824 INFO:tasks.workunit.client.1.smithi073.stdout:5/331: dread - dc/d16/d3b/f73 zero size 2024-08-31T05:20:59.824 INFO:tasks.workunit.client.1.smithi073.stdout:3/351: rmdir da/d3c/d65/d2c 39 2024-08-31T05:20:59.825 INFO:tasks.workunit.client.1.smithi073.stdout:3/352: stat da/d3c/d65/d40/d5d 0 2024-08-31T05:20:59.827 INFO:tasks.workunit.client.1.smithi073.stdout:9/372: creat dc/d37/d42/d5a/f77 x:0 0 0 2024-08-31T05:20:59.829 INFO:tasks.workunit.client.1.smithi073.stdout:4/322: read d7/db/f4e [1407496,106711] 0 2024-08-31T05:20:59.829 INFO:tasks.workunit.client.0.smithi067.stdout:3/5: creat f3 x:0 0 0 2024-08-31T05:20:59.833 INFO:tasks.workunit.client.0.smithi067.stdout:5/3: dwrite f0 [0,4194304] 0 2024-08-31T05:20:59.836 INFO:tasks.workunit.client.0.smithi067.stdout:9/0: read - no filename 2024-08-31T05:20:59.836 INFO:tasks.workunit.client.0.smithi067.stdout:9/1: dread - no filename 2024-08-31T05:20:59.837 INFO:tasks.workunit.client.0.smithi067.stdout:9/2: write - no filename 2024-08-31T05:20:59.837 INFO:tasks.workunit.client.0.smithi067.stdout:9/3: unlink - no file 2024-08-31T05:20:59.839 INFO:tasks.workunit.client.0.smithi067.stdout:7/5: mknod c0 0 2024-08-31T05:20:59.839 INFO:tasks.workunit.client.0.smithi067.stdout:7/6: dwrite - no filename 2024-08-31T05:20:59.840 INFO:tasks.workunit.client.0.smithi067.stdout:7/7: write - no filename 2024-08-31T05:20:59.840 INFO:tasks.workunit.client.0.smithi067.stdout:7/8: stat c0 0 2024-08-31T05:20:59.840 INFO:tasks.workunit.client.0.smithi067.stdout:7/9: dwrite - no filename 2024-08-31T05:20:59.840 INFO:tasks.workunit.client.0.smithi067.stdout:7/10: write - no filename 2024-08-31T05:20:59.842 INFO:tasks.workunit.client.0.smithi067.stdout:6/1: creat f1 x:0 0 0 2024-08-31T05:20:59.845 INFO:tasks.workunit.client.0.smithi067.stdout:5/4: creat f1 x:0 0 0 2024-08-31T05:20:59.847 INFO:tasks.workunit.client.0.smithi067.stdout:8/5: mkdir d0 0 2024-08-31T05:20:59.848 INFO:tasks.workunit.client.0.smithi067.stdout:7/11: creat f1 x:0 0 0 2024-08-31T05:20:59.848 INFO:tasks.workunit.client.0.smithi067.stdout:6/2: mknod c2 0 2024-08-31T05:20:59.850 INFO:tasks.workunit.client.0.smithi067.stdout:9/4: creat f0 x:0 0 0 2024-08-31T05:20:59.852 INFO:tasks.workunit.client.0.smithi067.stdout:0/9: getdents d1 0 2024-08-31T05:20:59.852 INFO:tasks.workunit.client.0.smithi067.stdout:6/3: truncate f1 310900 0 2024-08-31T05:20:59.854 INFO:tasks.workunit.client.0.smithi067.stdout:8/6: getdents d0 0 2024-08-31T05:20:59.855 INFO:tasks.workunit.client.0.smithi067.stdout:7/12: rename f1 to f2 0 2024-08-31T05:20:59.855 INFO:tasks.workunit.client.0.smithi067.stdout:6/4: write f1 [241013,45524] 0 2024-08-31T05:20:59.857 INFO:tasks.workunit.client.0.smithi067.stdout:9/5: mkdir d1 0 2024-08-31T05:20:59.858 INFO:tasks.workunit.client.0.smithi067.stdout:3/6: getdents . 0 2024-08-31T05:20:59.859 INFO:tasks.workunit.client.0.smithi067.stdout:1/7: dwrite f1 [0,4194304] 0 2024-08-31T05:20:59.859 INFO:tasks.workunit.client.0.smithi067.stdout:6/5: truncate f1 761398 0 2024-08-31T05:20:59.860 INFO:tasks.workunit.client.0.smithi067.stdout:0/10: mkdir d1/d3 0 2024-08-31T05:20:59.862 INFO:tasks.workunit.client.0.smithi067.stdout:5/5: dwrite f0 [0,4194304] 0 2024-08-31T05:20:59.862 INFO:tasks.workunit.client.0.smithi067.stdout:6/6: chown c0 50099 1 2024-08-31T05:20:59.863 INFO:tasks.workunit.client.0.smithi067.stdout:9/6: write f0 [541854,70965] 0 2024-08-31T05:20:59.864 INFO:tasks.workunit.client.0.smithi067.stdout:0/11: rename d1/d3 to d1/d3/d4 22 2024-08-31T05:20:59.864 INFO:tasks.workunit.client.0.smithi067.stdout:0/12: dwrite - no filename 2024-08-31T05:20:59.864 INFO:tasks.workunit.client.0.smithi067.stdout:3/7: creat f4 x:0 0 0 2024-08-31T05:20:59.864 INFO:tasks.workunit.client.0.smithi067.stdout:8/7: symlink d0/l1 0 2024-08-31T05:20:59.867 INFO:tasks.workunit.client.0.smithi067.stdout:3/8: fsync f1 0 2024-08-31T05:20:59.868 INFO:tasks.workunit.client.0.smithi067.stdout:1/8: symlink d3/l4 0 2024-08-31T05:20:59.868 INFO:tasks.workunit.client.0.smithi067.stdout:9/7: write f0 [1106925,58891] 0 2024-08-31T05:20:59.870 INFO:tasks.workunit.client.0.smithi067.stdout:7/13: rename f2 to f3 0 2024-08-31T05:20:59.870 INFO:tasks.workunit.client.0.smithi067.stdout:7/14: readlink - no filename 2024-08-31T05:20:59.871 INFO:tasks.workunit.client.0.smithi067.stdout:3/9: write f1 [998089,86888] 0 2024-08-31T05:20:59.871 INFO:tasks.workunit.client.0.smithi067.stdout:1/9: read f1 [618564,72860] 0 2024-08-31T05:20:59.873 INFO:tasks.workunit.client.0.smithi067.stdout:8/8: mkdir d0/d2 0 2024-08-31T05:20:59.874 INFO:tasks.workunit.client.0.smithi067.stdout:0/13: mknod d1/c5 0 2024-08-31T05:20:59.875 INFO:tasks.workunit.client.0.smithi067.stdout:3/10: write f4 [636368,70789] 0 2024-08-31T05:20:59.876 INFO:tasks.workunit.client.0.smithi067.stdout:3/11: readlink l0 0 2024-08-31T05:20:59.887 INFO:tasks.workunit.client.1.smithi073.stdout:7/319: dread d1/d11/d14/f63 [0,4194304] 0 2024-08-31T05:20:59.888 INFO:tasks.workunit.client.1.smithi073.stdout:9/373: stat dc/de/d11/d41/f39 0 2024-08-31T05:20:59.888 INFO:tasks.workunit.client.0.smithi067.stdout:1/10: creat d3/f5 x:0 0 0 2024-08-31T05:20:59.888 INFO:tasks.workunit.client.1.smithi073.stdout:4/323: dread d7/df/d13/d2e/f3a [0,4194304] 0 2024-08-31T05:20:59.889 INFO:tasks.workunit.client.0.smithi067.stdout:0/14: creat d1/f6 x:0 0 0 2024-08-31T05:20:59.889 INFO:tasks.workunit.client.0.smithi067.stdout:5/6: dread f0 [0,4194304] 0 2024-08-31T05:20:59.890 INFO:tasks.workunit.client.0.smithi067.stdout:7/15: write f3 [211867,48068] 0 2024-08-31T05:20:59.890 INFO:tasks.workunit.client.1.smithi073.stdout:9/374: read dc/de/f1e [305705,3597] 0 2024-08-31T05:20:59.891 INFO:tasks.workunit.client.0.smithi067.stdout:6/7: dwrite f1 [0,4194304] 0 2024-08-31T05:20:59.893 INFO:tasks.workunit.client.0.smithi067.stdout:9/8: dread f0 [0,4194304] 0 2024-08-31T05:20:59.895 INFO:tasks.workunit.client.1.smithi073.stdout:5/332: dwrite dc/d16/f54 [0,4194304] 0 2024-08-31T05:20:59.896 INFO:tasks.workunit.client.1.smithi073.stdout:7/320: mknod d1/da/d3e/d22/d47/c69 0 2024-08-31T05:20:59.897 INFO:tasks.workunit.client.1.smithi073.stdout:3/353: dwrite f9 [0,4194304] 0 2024-08-31T05:20:59.900 INFO:tasks.workunit.client.1.smithi073.stdout:3/354: chown da/f15 1100309 1 2024-08-31T05:20:59.900 INFO:tasks.workunit.client.0.smithi067.stdout:1/11: dwrite f0 [0,4194304] 0 2024-08-31T05:20:59.901 INFO:tasks.workunit.client.1.smithi073.stdout:4/324: dwrite d7/df/d13/d2e/f31 [0,4194304] 0 2024-08-31T05:20:59.905 INFO:tasks.workunit.client.1.smithi073.stdout:9/375: symlink dc/l78 0 2024-08-31T05:20:59.910 INFO:tasks.workunit.client.1.smithi073.stdout:7/321: mkdir d1/da/d15/d6a 0 2024-08-31T05:20:59.911 INFO:tasks.workunit.client.1.smithi073.stdout:4/325: dwrite d7/db/f19 [0,4194304] 0 2024-08-31T05:20:59.912 INFO:tasks.workunit.client.1.smithi073.stdout:7/322: chown d1/da/d15/f4b 196 1 2024-08-31T05:20:59.914 INFO:tasks.workunit.client.1.smithi073.stdout:7/323: chown d1/da/d38/f4c 1 1 2024-08-31T05:20:59.916 INFO:tasks.workunit.client.1.smithi073.stdout:9/376: mknod dc/c79 0 2024-08-31T05:20:59.918 INFO:tasks.workunit.client.1.smithi073.stdout:4/326: rename d7/df/d13/d2e/l41 to d7/db/d11/d2c/d2d/l5e 0 2024-08-31T05:20:59.921 INFO:tasks.workunit.client.1.smithi073.stdout:3/355: link da/d3c/d65/d40/c4b da/d18/c78 0 2024-08-31T05:20:59.922 INFO:tasks.workunit.client.1.smithi073.stdout:3/356: write da/d3c/d65/d40/f44 [1307340,116886] 0 2024-08-31T05:20:59.923 INFO:tasks.workunit.client.1.smithi073.stdout:7/324: mkdir d1/da/d3e/d22/d6b 0 2024-08-31T05:20:59.925 INFO:tasks.workunit.client.1.smithi073.stdout:9/377: creat dc/de/d11/f7a x:0 0 0 2024-08-31T05:20:59.929 INFO:tasks.workunit.client.1.smithi073.stdout:3/357: symlink da/d3c/d65/d40/l79 0 2024-08-31T05:20:59.932 INFO:tasks.workunit.client.1.smithi073.stdout:9/378: rmdir dc/d27 39 2024-08-31T05:20:59.933 INFO:tasks.workunit.client.1.smithi073.stdout:9/379: write dc/de/d11/d41/d52/d5f/f71 [273532,63979] 0 2024-08-31T05:20:59.934 INFO:tasks.workunit.client.1.smithi073.stdout:3/358: symlink da/d3c/d65/d40/l7a 0 2024-08-31T05:20:59.935 INFO:tasks.workunit.client.1.smithi073.stdout:2/333: sync 2024-08-31T05:20:59.936 INFO:tasks.workunit.client.1.smithi073.stdout:7/325: mknod d1/da/d65/c6c 0 2024-08-31T05:20:59.937 INFO:tasks.workunit.client.1.smithi073.stdout:7/326: dread d1/f2e [0,4194304] 0 2024-08-31T05:20:59.940 INFO:tasks.workunit.client.1.smithi073.stdout:7/327: mknod d1/da/d15/d33/d44/c6d 0 2024-08-31T05:20:59.942 INFO:tasks.workunit.client.1.smithi073.stdout:9/380: link dc/de/d11/d41/f39 dc/d10/f7b 0 2024-08-31T05:20:59.943 INFO:tasks.workunit.client.1.smithi073.stdout:7/328: write d1/d11/d14/f5f [213729,93013] 0 2024-08-31T05:20:59.943 INFO:tasks.workunit.client.1.smithi073.stdout:5/333: dwrite dc/d16/d1a/f28 [0,4194304] 0 2024-08-31T05:20:59.944 INFO:tasks.workunit.client.1.smithi073.stdout:7/329: stat d1/d11/d14 0 2024-08-31T05:20:59.947 INFO:tasks.workunit.client.1.smithi073.stdout:9/381: mknod dc/de/d11/d41/d52/d5f/c7c 0 2024-08-31T05:20:59.949 INFO:tasks.workunit.client.1.smithi073.stdout:5/334: creat dc/d16/d3b/f74 x:0 0 0 2024-08-31T05:20:59.953 INFO:tasks.workunit.client.1.smithi073.stdout:9/382: dwrite dc/f61 [0,4194304] 0 2024-08-31T05:20:59.953 INFO:tasks.workunit.client.1.smithi073.stdout:7/330: dread d1/da/d3e/d22/f41 [0,4194304] 0 2024-08-31T05:20:59.954 INFO:tasks.workunit.client.1.smithi073.stdout:5/335: symlink dc/d3d/d3e/l75 0 2024-08-31T05:20:59.959 INFO:tasks.workunit.client.1.smithi073.stdout:9/383: rename f8 to dc/de/d56/f7d 0 2024-08-31T05:20:59.960 INFO:tasks.workunit.client.1.smithi073.stdout:9/384: read - dc/de/d11/d41/f74 zero size 2024-08-31T05:20:59.961 INFO:tasks.workunit.client.1.smithi073.stdout:7/331: dwrite d1/da/d15/f4b [0,4194304] 0 2024-08-31T05:20:59.961 INFO:tasks.workunit.client.1.smithi073.stdout:5/336: creat dc/d16/d3b/f76 x:0 0 0 2024-08-31T05:20:59.966 INFO:tasks.workunit.client.1.smithi073.stdout:7/332: unlink l0 0 2024-08-31T05:20:59.967 INFO:tasks.workunit.client.1.smithi073.stdout:9/385: symlink dc/de/d11/l7e 0 2024-08-31T05:20:59.969 INFO:tasks.workunit.client.1.smithi073.stdout:5/337: rename dc/d3d/f4b to dc/d16/d3b/f77 0 2024-08-31T05:20:59.970 INFO:tasks.workunit.client.1.smithi073.stdout:4/327: dwrite d7/fc [0,4194304] 0 2024-08-31T05:20:59.974 INFO:tasks.workunit.client.1.smithi073.stdout:7/333: symlink d1/da/d3e/d22/d47/l6e 0 2024-08-31T05:20:59.974 INFO:tasks.workunit.client.1.smithi073.stdout:7/334: chown d1/da/d3e/f1f 0 1 2024-08-31T05:20:59.975 INFO:tasks.workunit.client.1.smithi073.stdout:9/386: symlink dc/d37/l7f 0 2024-08-31T05:20:59.979 INFO:tasks.workunit.client.1.smithi073.stdout:5/338: symlink dc/d3d/d55/l78 0 2024-08-31T05:20:59.982 INFO:tasks.workunit.client.1.smithi073.stdout:5/339: dread dc/f17 [0,4194304] 0 2024-08-31T05:20:59.983 INFO:tasks.workunit.client.1.smithi073.stdout:5/340: write dc/f61 [644062,125031] 0 2024-08-31T05:20:59.984 INFO:tasks.workunit.client.1.smithi073.stdout:9/387: creat dc/de/d11/d41/d52/d5b/f80 x:0 0 0 2024-08-31T05:20:59.986 INFO:tasks.workunit.client.1.smithi073.stdout:7/335: mknod d1/da/d3e/d22/d6b/c6f 0 2024-08-31T05:20:59.990 INFO:tasks.workunit.client.1.smithi073.stdout:5/341: creat dc/d53/f79 x:0 0 0 2024-08-31T05:20:59.990 INFO:tasks.workunit.client.1.smithi073.stdout:5/342: chown dc/d16/f2e 4508 1 2024-08-31T05:20:59.993 INFO:tasks.workunit.client.1.smithi073.stdout:7/336: creat d1/da/d3e/d22/d6b/f70 x:0 0 0 2024-08-31T05:20:59.995 INFO:tasks.workunit.client.1.smithi073.stdout:4/328: dread d7/df/d13/f16 [0,4194304] 0 2024-08-31T05:20:59.998 INFO:tasks.workunit.client.1.smithi073.stdout:7/337: mknod d1/da/d15/d33/d44/c71 0 2024-08-31T05:20:59.998 INFO:tasks.workunit.client.1.smithi073.stdout:6/266: sync 2024-08-31T05:20:59.998 INFO:tasks.workunit.client.1.smithi073.stdout:8/372: sync 2024-08-31T05:20:59.998 INFO:tasks.workunit.client.1.smithi073.stdout:1/272: sync 2024-08-31T05:20:59.998 INFO:tasks.workunit.client.1.smithi073.stdout:0/341: sync 2024-08-31T05:20:59.999 INFO:tasks.workunit.client.1.smithi073.stdout:1/273: write d5/f34 [186374,1343] 0 2024-08-31T05:20:59.999 INFO:tasks.workunit.client.1.smithi073.stdout:5/343: symlink dc/l7a 0 2024-08-31T05:21:00.003 INFO:tasks.workunit.client.1.smithi073.stdout:0/342: rmdir d0 39 2024-08-31T05:21:00.008 INFO:tasks.workunit.client.1.smithi073.stdout:8/373: chown d0/db/d1c/c25 403482435 1 2024-08-31T05:21:00.009 INFO:tasks.workunit.client.1.smithi073.stdout:8/374: read d0/db/d44/f71 [195324,7254] 0 2024-08-31T05:21:00.010 INFO:tasks.workunit.client.1.smithi073.stdout:8/375: stat d0/db/d1c/d2a/l76 0 2024-08-31T05:21:00.051 INFO:tasks.workunit.client.1.smithi073.stdout:3/359: sync 2024-08-31T05:21:00.051 INFO:tasks.workunit.client.1.smithi073.stdout:2/334: sync 2024-08-31T05:21:00.052 INFO:tasks.workunit.client.1.smithi073.stdout:3/360: chown da/d68/f6b 67473 1 2024-08-31T05:21:00.235 INFO:tasks.workunit.client.1.smithi073.stdout:5/344: unlink dc/d16/d1a/c45 0 2024-08-31T05:21:00.250 INFO:tasks.workunit.client.1.smithi073.stdout:8/376: mkdir d0/db/d44/d72/d79 0 2024-08-31T05:21:00.253 INFO:tasks.workunit.client.1.smithi073.stdout:9/388: dwrite dc/de/f1e [4194304,4194304] 0 2024-08-31T05:21:00.253 INFO:tasks.workunit.client.1.smithi073.stdout:3/361: truncate da/d3c/d65/d2c/f48 952742 0 2024-08-31T05:21:00.254 INFO:tasks.workunit.client.1.smithi073.stdout:2/335: rename d2/d9/d3c/c51 to d2/d9/d32/d56/c67 0 2024-08-31T05:21:00.255 INFO:tasks.workunit.client.1.smithi073.stdout:5/345: creat dc/d16/d3b/d3f/d4f/f7b x:0 0 0 2024-08-31T05:21:00.256 INFO:tasks.workunit.client.1.smithi073.stdout:5/346: fsync dc/f39 0 2024-08-31T05:21:00.261 INFO:tasks.workunit.client.1.smithi073.stdout:8/377: rmdir d0/db/d44/d72 39 2024-08-31T05:21:00.261 INFO:tasks.workunit.client.1.smithi073.stdout:5/347: dread dc/d16/d26/f2c [0,4194304] 0 2024-08-31T05:21:00.263 INFO:tasks.workunit.client.1.smithi073.stdout:6/267: write d15/d1a/d1e/f3e [125597,117150] 0 2024-08-31T05:21:00.264 INFO:tasks.workunit.client.1.smithi073.stdout:2/336: dwrite d2/d9/d32/f42 [0,4194304] 0 2024-08-31T05:21:00.268 INFO:tasks.workunit.client.1.smithi073.stdout:8/378: dread d0/db/f22 [0,4194304] 0 2024-08-31T05:21:00.268 INFO:tasks.workunit.client.1.smithi073.stdout:3/362: rename da/d3c/d65/f23 to da/d3c/f7b 0 2024-08-31T05:21:00.269 INFO:tasks.workunit.client.1.smithi073.stdout:2/337: chown d2/f4f 208 1 2024-08-31T05:21:00.270 INFO:tasks.workunit.client.1.smithi073.stdout:1/274: link d5/d10/d33/c12 d5/d17/d3f/c4a 0 2024-08-31T05:21:00.271 INFO:tasks.workunit.client.1.smithi073.stdout:4/329: getdents d7/df/d1b 0 2024-08-31T05:21:00.277 INFO:tasks.workunit.client.1.smithi073.stdout:5/348: rename dc/d16/d1a/c18 to dc/d16/d3b/d3f/d4f/c7c 0 2024-08-31T05:21:00.279 INFO:tasks.workunit.client.1.smithi073.stdout:7/338: dwrite d1/da/d3e/f1f [4194304,4194304] 0 2024-08-31T05:21:00.281 INFO:tasks.workunit.client.1.smithi073.stdout:2/338: chown d2/d9/d3c/f5c 851 1 2024-08-31T05:21:00.281 INFO:tasks.workunit.client.1.smithi073.stdout:6/268: fdatasync d15/f47 0 2024-08-31T05:21:00.281 INFO:tasks.workunit.client.1.smithi073.stdout:1/275: creat d5/d10/d1c/f4b x:0 0 0 2024-08-31T05:21:00.282 INFO:tasks.workunit.client.1.smithi073.stdout:0/343: dwrite d0/d15/d2c/d40/f5a [0,4194304] 0 2024-08-31T05:21:00.285 INFO:tasks.workunit.client.1.smithi073.stdout:2/339: chown d2/d9/d32/f39 0 1 2024-08-31T05:21:00.286 INFO:tasks.workunit.client.1.smithi073.stdout:9/389: dwrite dc/d37/f35 [0,4194304] 0 2024-08-31T05:21:00.288 INFO:tasks.workunit.client.1.smithi073.stdout:1/276: truncate d5/d17/d2a/f3b 54582 0 2024-08-31T05:21:00.289 INFO:tasks.workunit.client.1.smithi073.stdout:8/379: creat d0/db/d1c/d2a/d58/f7a x:0 0 0 2024-08-31T05:21:00.292 INFO:tasks.workunit.client.1.smithi073.stdout:7/339: unlink d1/da/d3e/l19 0 2024-08-31T05:21:00.294 INFO:tasks.workunit.client.1.smithi073.stdout:6/269: rename d15 to d15/d59 22 2024-08-31T05:21:00.295 INFO:tasks.workunit.client.1.smithi073.stdout:6/270: readlink d15/l18 0 2024-08-31T05:21:00.295 INFO:tasks.workunit.client.1.smithi073.stdout:2/340: dwrite d2/d9/d27/f2b [0,4194304] 0 2024-08-31T05:21:00.296 INFO:tasks.workunit.client.1.smithi073.stdout:6/271: chown d15/d17/f3a 107098 1 2024-08-31T05:21:00.297 INFO:tasks.workunit.client.1.smithi073.stdout:2/341: chown d2/d9/df/f2e 5894571 1 2024-08-31T05:21:00.303 INFO:tasks.workunit.client.1.smithi073.stdout:0/344: creat d0/d15/d2c/d2e/d3d/f6a x:0 0 0 2024-08-31T05:21:00.305 INFO:tasks.workunit.client.1.smithi073.stdout:6/272: dread d15/f29 [0,4194304] 0 2024-08-31T05:21:00.306 INFO:tasks.workunit.client.1.smithi073.stdout:9/390: symlink dc/de/d11/d41/d52/d5f/l81 0 2024-08-31T05:21:00.307 INFO:tasks.workunit.client.1.smithi073.stdout:6/273: chown d15/d1a/d2b/l39 35434545 1 2024-08-31T05:21:00.307 INFO:tasks.workunit.client.1.smithi073.stdout:2/342: dwrite d2/d9/df/f1f [0,4194304] 0 2024-08-31T05:21:00.308 INFO:tasks.workunit.client.1.smithi073.stdout:6/274: fsync d15/d1a/d2b/d2f/f3f 0 2024-08-31T05:21:00.308 INFO:tasks.workunit.client.1.smithi073.stdout:9/391: chown dc/de/d11/d41/d52/d5f/c7c 21490719 1 2024-08-31T05:21:00.308 INFO:tasks.workunit.client.1.smithi073.stdout:7/340: creat d1/da/f72 x:0 0 0 2024-08-31T05:21:00.309 INFO:tasks.workunit.client.1.smithi073.stdout:7/341: chown d1/d11/d14/f63 4948351 1 2024-08-31T05:21:00.311 INFO:tasks.workunit.client.1.smithi073.stdout:7/342: write d1/da/d15/f24 [5321526,93694] 0 2024-08-31T05:21:00.314 INFO:tasks.workunit.client.1.smithi073.stdout:3/363: getdents da/d3c 0 2024-08-31T05:21:00.314 INFO:tasks.workunit.client.0.smithi067.stdout:3/12: symlink l5 0 2024-08-31T05:21:00.314 INFO:tasks.workunit.client.0.smithi067.stdout:3/13: write f1 [537450,15859] 0 2024-08-31T05:21:00.315 INFO:tasks.workunit.client.0.smithi067.stdout:8/9: creat d0/d2/f3 x:0 0 0 2024-08-31T05:21:00.316 INFO:tasks.workunit.client.0.smithi067.stdout:8/10: fdatasync d0/d2/f3 0 2024-08-31T05:21:00.318 INFO:tasks.workunit.client.0.smithi067.stdout:5/7: creat f2 x:0 0 0 2024-08-31T05:21:00.320 INFO:tasks.workunit.client.0.smithi067.stdout:7/16: mknod c4 0 2024-08-31T05:21:00.324 INFO:tasks.workunit.client.0.smithi067.stdout:6/8: creat f3 x:0 0 0 2024-08-31T05:21:00.325 INFO:tasks.workunit.client.0.smithi067.stdout:6/9: chown c2 4 1 2024-08-31T05:21:00.325 INFO:tasks.workunit.client.0.smithi067.stdout:3/14: dread f1 [0,4194304] 0 2024-08-31T05:21:00.326 INFO:tasks.workunit.client.0.smithi067.stdout:3/15: chown f1 0 1 2024-08-31T05:21:00.326 INFO:tasks.workunit.client.0.smithi067.stdout:9/9: write f0 [2142491,85980] 0 2024-08-31T05:21:00.326 INFO:tasks.workunit.client.0.smithi067.stdout:1/12: fsync f1 0 2024-08-31T05:21:00.329 INFO:tasks.workunit.client.0.smithi067.stdout:8/11: mkdir d0/d4 0 2024-08-31T05:21:00.331 INFO:tasks.workunit.client.0.smithi067.stdout:8/12: write d0/d2/f3 [643452,94172] 0 2024-08-31T05:21:00.331 INFO:tasks.workunit.client.0.smithi067.stdout:5/8: symlink l3 0 2024-08-31T05:21:00.331 INFO:tasks.workunit.client.0.smithi067.stdout:5/9: fsync f1 0 2024-08-31T05:21:00.333 INFO:tasks.workunit.client.0.smithi067.stdout:6/10: creat f4 x:0 0 0 2024-08-31T05:21:00.335 INFO:tasks.workunit.client.0.smithi067.stdout:3/16: rename f3 to f6 0 2024-08-31T05:21:00.337 INFO:tasks.workunit.client.0.smithi067.stdout:1/13: creat d3/f6 x:0 0 0 2024-08-31T05:21:00.339 INFO:tasks.workunit.client.0.smithi067.stdout:8/13: rmdir d0/d2 39 2024-08-31T05:21:00.341 INFO:tasks.workunit.client.0.smithi067.stdout:5/10: unlink f0 0 2024-08-31T05:21:00.343 INFO:tasks.workunit.client.0.smithi067.stdout:3/17: dread f4 [0,4194304] 0 2024-08-31T05:21:00.343 INFO:tasks.workunit.client.0.smithi067.stdout:6/11: dwrite f4 [0,4194304] 0 2024-08-31T05:21:00.345 INFO:tasks.workunit.client.0.smithi067.stdout:0/15: getdents d1 0 2024-08-31T05:21:00.347 INFO:tasks.workunit.client.0.smithi067.stdout:1/14: creat d3/f7 x:0 0 0 2024-08-31T05:21:00.349 INFO:tasks.workunit.client.0.smithi067.stdout:8/14: stat d0/d2 0 2024-08-31T05:21:00.350 INFO:tasks.workunit.client.0.smithi067.stdout:8/15: truncate d0/d2/f3 1095556 0 2024-08-31T05:21:00.351 INFO:tasks.workunit.client.0.smithi067.stdout:5/11: creat f4 x:0 0 0 2024-08-31T05:21:00.354 INFO:tasks.workunit.client.0.smithi067.stdout:3/18: dread f4 [0,4194304] 0 2024-08-31T05:21:00.354 INFO:tasks.workunit.client.0.smithi067.stdout:6/12: rename c2 to c5 0 2024-08-31T05:21:00.356 INFO:tasks.workunit.client.0.smithi067.stdout:0/16: unlink c0 0 2024-08-31T05:21:00.357 INFO:tasks.workunit.client.0.smithi067.stdout:0/17: write d1/f6 [906059,8183] 0 2024-08-31T05:21:00.358 INFO:tasks.workunit.client.0.smithi067.stdout:1/15: symlink d3/l8 0 2024-08-31T05:21:00.359 INFO:tasks.workunit.client.0.smithi067.stdout:1/16: write d3/f5 [1029429,51207] 0 2024-08-31T05:21:00.360 INFO:tasks.workunit.client.0.smithi067.stdout:6/13: dread f1 [0,4194304] 0 2024-08-31T05:21:00.360 INFO:tasks.workunit.client.0.smithi067.stdout:5/12: symlink l5 0 2024-08-31T05:21:00.361 INFO:tasks.workunit.client.0.smithi067.stdout:5/13: truncate f4 982543 0 2024-08-31T05:21:00.362 INFO:tasks.workunit.client.0.smithi067.stdout:5/14: chown l3 14266 1 2024-08-31T05:21:00.362 INFO:tasks.workunit.client.0.smithi067.stdout:3/19: symlink l7 0 2024-08-31T05:21:00.363 INFO:tasks.workunit.client.0.smithi067.stdout:3/20: chown l2 5 1 2024-08-31T05:21:00.363 INFO:tasks.workunit.client.0.smithi067.stdout:3/21: chown l7 1743155 1 2024-08-31T05:21:00.364 INFO:tasks.workunit.client.0.smithi067.stdout:0/18: mknod d1/c7 0 2024-08-31T05:21:00.367 INFO:tasks.workunit.client.0.smithi067.stdout:6/14: creat f6 x:0 0 0 2024-08-31T05:21:00.369 INFO:tasks.workunit.client.0.smithi067.stdout:5/15: creat f6 x:0 0 0 2024-08-31T05:21:00.370 INFO:tasks.workunit.client.1.smithi073.stdout:3/364: write da/d68/f6b [967595,65944] 0 2024-08-31T05:21:00.370 INFO:tasks.workunit.client.1.smithi073.stdout:0/345: mkdir d0/d15/d2c/d40/d4a/d6b 0 2024-08-31T05:21:00.371 INFO:tasks.workunit.client.1.smithi073.stdout:6/275: rename l7 to d15/d1a/d2b/l5a 0 2024-08-31T05:21:00.372 INFO:tasks.workunit.client.0.smithi067.stdout:0/19: mkdir d1/d8 0 2024-08-31T05:21:00.372 INFO:tasks.workunit.client.1.smithi073.stdout:7/343: fsync d1/da/d3e/d22/f27 0 2024-08-31T05:21:00.372 INFO:tasks.workunit.client.1.smithi073.stdout:9/392: chown dc/de/c51 150 1 2024-08-31T05:21:00.373 INFO:tasks.workunit.client.1.smithi073.stdout:6/276: dread - d15/d1a/d2b/f4c zero size 2024-08-31T05:21:00.375 INFO:tasks.workunit.client.0.smithi067.stdout:6/15: creat f7 x:0 0 0 2024-08-31T05:21:00.376 INFO:tasks.workunit.client.0.smithi067.stdout:6/16: truncate f6 43158 0 2024-08-31T05:21:00.376 INFO:tasks.workunit.client.0.smithi067.stdout:6/17: chown f7 674 1 2024-08-31T05:21:00.377 INFO:tasks.workunit.client.1.smithi073.stdout:0/346: chown d0/c1c 2 1 2024-08-31T05:21:00.378 INFO:tasks.workunit.client.1.smithi073.stdout:4/330: dwrite d7/df/d13/d2e/f36 [0,4194304] 0 2024-08-31T05:21:00.381 INFO:tasks.workunit.client.1.smithi073.stdout:3/365: rename da/d3c/f7b to da/d3c/d67/f7c 0 2024-08-31T05:21:00.382 INFO:tasks.workunit.client.0.smithi067.stdout:5/16: rename f1 to f7 0 2024-08-31T05:21:00.383 INFO:tasks.workunit.client.1.smithi073.stdout:4/331: dread d7/df/d13/f2b [0,4194304] 0 2024-08-31T05:21:00.387 INFO:tasks.workunit.client.1.smithi073.stdout:7/344: rmdir d1/d11/d14 39 2024-08-31T05:21:00.387 INFO:tasks.workunit.client.0.smithi067.stdout:8/16: getdents d0 0 2024-08-31T05:21:00.389 INFO:tasks.workunit.client.1.smithi073.stdout:4/332: dwrite d7/df/d13/d2e/f36 [0,4194304] 0 2024-08-31T05:21:00.389 INFO:tasks.workunit.client.1.smithi073.stdout:1/277: getdents d5/d10/d33 0 2024-08-31T05:21:00.391 INFO:tasks.workunit.client.0.smithi067.stdout:6/18: write f1 [3641660,66993] 0 2024-08-31T05:21:00.394 INFO:tasks.workunit.client.0.smithi067.stdout:5/17: mknod c8 0 2024-08-31T05:21:00.396 INFO:tasks.workunit.client.1.smithi073.stdout:4/333: dwrite d7/df/d13/f44 [0,4194304] 0 2024-08-31T05:21:00.398 INFO:tasks.workunit.client.0.smithi067.stdout:0/20: mknod d1/d3/c9 0 2024-08-31T05:21:00.400 INFO:tasks.workunit.client.1.smithi073.stdout:6/277: rename d15/d17/f3b to d15/d1a/f5b 0 2024-08-31T05:21:00.401 INFO:tasks.workunit.client.1.smithi073.stdout:6/278: dread - d15/d17/d26/d38/f40 zero size 2024-08-31T05:21:00.401 INFO:tasks.workunit.client.0.smithi067.stdout:8/17: mkdir d0/d2/d5 0 2024-08-31T05:21:00.402 INFO:tasks.workunit.client.0.smithi067.stdout:8/18: write d0/d2/f3 [779989,19024] 0 2024-08-31T05:21:00.403 INFO:tasks.workunit.client.0.smithi067.stdout:8/19: stat d0/d4 0 2024-08-31T05:21:00.405 INFO:tasks.workunit.client.0.smithi067.stdout:6/19: rename f6 to f8 0 2024-08-31T05:21:00.405 INFO:tasks.workunit.client.1.smithi073.stdout:9/393: mkdir dc/d82 0 2024-08-31T05:21:00.407 INFO:tasks.workunit.client.0.smithi067.stdout:0/21: mkdir d1/d3/da 0 2024-08-31T05:21:00.409 INFO:tasks.workunit.client.1.smithi073.stdout:5/349: sync 2024-08-31T05:21:00.409 INFO:tasks.workunit.client.1.smithi073.stdout:8/380: sync 2024-08-31T05:21:00.409 INFO:tasks.workunit.client.1.smithi073.stdout:5/350: fsync dc/d16/f6f 0 2024-08-31T05:21:00.411 INFO:tasks.workunit.client.1.smithi073.stdout:1/278: mknod d5/d17/d32/c4c 0 2024-08-31T05:21:00.413 INFO:tasks.workunit.client.0.smithi067.stdout:6/20: dwrite f3 [0,4194304] 0 2024-08-31T05:21:00.413 INFO:tasks.workunit.client.0.smithi067.stdout:6/21: rmdir - no directory 2024-08-31T05:21:00.413 INFO:tasks.workunit.client.0.smithi067.stdout:8/20: rename d0/d2/d5 to d0/d2/d6 0 2024-08-31T05:21:00.416 INFO:tasks.workunit.client.0.smithi067.stdout:1/17: truncate d3/f5 407781 0 2024-08-31T05:21:00.417 INFO:tasks.workunit.client.0.smithi067.stdout:1/18: chown d3/l4 687 1 2024-08-31T05:21:00.417 INFO:tasks.workunit.client.1.smithi073.stdout:0/347: symlink d0/l6c 0 2024-08-31T05:21:00.421 INFO:tasks.workunit.client.1.smithi073.stdout:4/334: creat d7/df/d1b/d34/f5f x:0 0 0 2024-08-31T05:21:00.422 INFO:tasks.workunit.client.0.smithi067.stdout:6/22: write f8 [1013791,86982] 0 2024-08-31T05:21:00.422 INFO:tasks.workunit.client.0.smithi067.stdout:6/23: dread - f7 zero size 2024-08-31T05:21:00.424 INFO:tasks.workunit.client.0.smithi067.stdout:8/21: symlink d0/d2/d6/l7 0 2024-08-31T05:21:00.427 INFO:tasks.workunit.client.0.smithi067.stdout:6/24: dread f3 [0,4194304] 0 2024-08-31T05:21:00.428 INFO:tasks.workunit.client.1.smithi073.stdout:3/366: symlink da/d3c/d65/l7d 0 2024-08-31T05:21:00.429 INFO:tasks.workunit.client.0.smithi067.stdout:0/22: rename d1/d3 to d1/db 0 2024-08-31T05:21:00.429 INFO:tasks.workunit.client.0.smithi067.stdout:8/22: dread d0/d2/f3 [0,4194304] 0 2024-08-31T05:21:00.430 INFO:tasks.workunit.client.0.smithi067.stdout:0/23: truncate d1/f6 1074363 0 2024-08-31T05:21:00.432 INFO:tasks.workunit.client.1.smithi073.stdout:9/394: fsync dc/d37/d42/f64 0 2024-08-31T05:21:00.432 INFO:tasks.workunit.client.1.smithi073.stdout:8/381: mknod d0/db/c7b 0 2024-08-31T05:21:00.433 INFO:tasks.workunit.client.1.smithi073.stdout:8/382: chown d0/f4 1916019 1 2024-08-31T05:21:00.434 INFO:tasks.workunit.client.1.smithi073.stdout:7/345: symlink d1/d11/l73 0 2024-08-31T05:21:00.435 INFO:tasks.workunit.client.1.smithi073.stdout:7/346: chown d1/da/d3e 22094531 1 2024-08-31T05:21:00.436 INFO:tasks.workunit.client.1.smithi073.stdout:5/351: symlink dc/d3d/l7d 0 2024-08-31T05:21:00.439 INFO:tasks.workunit.client.1.smithi073.stdout:1/279: unlink d5/d17/d32/f47 0 2024-08-31T05:21:00.443 INFO:tasks.workunit.client.1.smithi073.stdout:5/352: dwrite dc/d53/f68 [0,4194304] 0 2024-08-31T05:21:00.443 INFO:tasks.workunit.client.1.smithi073.stdout:3/367: creat da/d68/f7e x:0 0 0 2024-08-31T05:21:00.444 INFO:tasks.workunit.client.0.smithi067.stdout:0/24: mknod d1/db/da/cc 0 2024-08-31T05:21:00.445 INFO:tasks.workunit.client.1.smithi073.stdout:3/368: write da/d3c/f5e [421364,42578] 0 2024-08-31T05:21:00.445 INFO:tasks.workunit.client.0.smithi067.stdout:0/25: write d1/f6 [643293,115263] 0 2024-08-31T05:21:00.450 INFO:tasks.workunit.client.0.smithi067.stdout:0/26: mkdir d1/dd 0 2024-08-31T05:21:00.452 INFO:tasks.workunit.client.0.smithi067.stdout:8/23: truncate d0/d2/f3 663263 0 2024-08-31T05:21:00.453 INFO:tasks.workunit.client.1.smithi073.stdout:8/383: dwrite d0/f1a [4194304,4194304] 0 2024-08-31T05:21:00.455 INFO:tasks.workunit.client.0.smithi067.stdout:6/25: fsync f8 0 2024-08-31T05:21:00.456 INFO:tasks.workunit.client.1.smithi073.stdout:4/335: symlink d7/df/l60 0 2024-08-31T05:21:00.458 INFO:tasks.workunit.client.1.smithi073.stdout:4/336: read d7/df/f56 [623248,98549] 0 2024-08-31T05:21:00.458 INFO:tasks.workunit.client.1.smithi073.stdout:6/279: creat d15/d17/f5c x:0 0 0 2024-08-31T05:21:00.459 INFO:tasks.workunit.client.0.smithi067.stdout:0/27: dwrite d1/f6 [0,4194304] 0 2024-08-31T05:21:00.460 INFO:tasks.workunit.client.0.smithi067.stdout:6/26: creat f9 x:0 0 0 2024-08-31T05:21:00.463 INFO:tasks.workunit.client.0.smithi067.stdout:0/28: dread d1/f6 [0,4194304] 0 2024-08-31T05:21:00.470 INFO:tasks.workunit.client.1.smithi073.stdout:8/384: mknod d0/db/d1c/d34/d68/c7c 0 2024-08-31T05:21:00.472 INFO:tasks.workunit.client.0.smithi067.stdout:0/29: mknod d1/d8/ce 0 2024-08-31T05:21:00.474 INFO:tasks.workunit.client.1.smithi073.stdout:4/337: symlink d7/l61 0 2024-08-31T05:21:00.474 INFO:tasks.workunit.client.1.smithi073.stdout:7/347: write d1/da/f32 [1581289,77298] 0 2024-08-31T05:21:00.475 INFO:tasks.workunit.client.0.smithi067.stdout:8/24: truncate d0/d2/f3 1659496 0 2024-08-31T05:21:00.476 INFO:tasks.workunit.client.0.smithi067.stdout:0/30: dread d1/f6 [0,4194304] 0 2024-08-31T05:21:00.477 INFO:tasks.workunit.client.1.smithi073.stdout:6/280: dread d15/f29 [0,4194304] 0 2024-08-31T05:21:00.478 INFO:tasks.workunit.client.1.smithi073.stdout:6/281: rename d15 to d15/d1a/d51/d5d 22 2024-08-31T05:21:00.478 INFO:tasks.workunit.client.1.smithi073.stdout:6/282: write fa [56021,53212] 0 2024-08-31T05:21:00.479 INFO:tasks.workunit.client.1.smithi073.stdout:8/385: mknod d0/db/d1c/d34/d38/c7d 0 2024-08-31T05:21:00.480 INFO:tasks.workunit.client.0.smithi067.stdout:0/31: rename d1/db to d1/df 0 2024-08-31T05:21:00.483 INFO:tasks.workunit.client.0.smithi067.stdout:0/32: rename d1/c7 to d1/dd/c10 0 2024-08-31T05:21:00.483 INFO:tasks.workunit.client.0.smithi067.stdout:0/33: chown d1/df/da 1729 1 2024-08-31T05:21:00.483 INFO:tasks.workunit.client.1.smithi073.stdout:4/338: fdatasync d7/df/f3f 0 2024-08-31T05:21:00.484 INFO:tasks.workunit.client.0.smithi067.stdout:0/34: stat d1/c2 0 2024-08-31T05:21:00.484 INFO:tasks.workunit.client.1.smithi073.stdout:4/339: read d7/df/d1b/f1f [612581,129074] 0 2024-08-31T05:21:00.485 INFO:tasks.workunit.client.1.smithi073.stdout:7/348: dread d1/da/d3e/d22/d47/f51 [0,4194304] 0 2024-08-31T05:21:00.486 INFO:tasks.workunit.client.0.smithi067.stdout:8/25: write d0/d2/f3 [212549,11670] 0 2024-08-31T05:21:00.486 INFO:tasks.workunit.client.1.smithi073.stdout:7/349: chown d1/da/d3e/d22/l23 347781 1 2024-08-31T05:21:00.487 INFO:tasks.workunit.client.1.smithi073.stdout:5/353: creat dc/d16/f7e x:0 0 0 2024-08-31T05:21:00.488 INFO:tasks.workunit.client.1.smithi073.stdout:5/354: fsync dc/d16/d3b/d3f/f65 0 2024-08-31T05:21:00.491 INFO:tasks.workunit.client.1.smithi073.stdout:6/283: unlink d15/d1a/d1e/f33 0 2024-08-31T05:21:00.492 INFO:tasks.workunit.client.1.smithi073.stdout:1/280: getdents d5/d17 0 2024-08-31T05:21:00.493 INFO:tasks.workunit.client.1.smithi073.stdout:7/350: fdatasync d1/d11/d14/f5b 0 2024-08-31T05:21:00.493 INFO:tasks.workunit.client.1.smithi073.stdout:5/355: mkdir dc/d16/d3b/d7f 0 2024-08-31T05:21:00.493 INFO:tasks.workunit.client.1.smithi073.stdout:3/369: link da/d3c/d65/d40/c4b da/d3c/d65/d40/c7f 0 2024-08-31T05:21:00.494 INFO:tasks.workunit.client.0.smithi067.stdout:0/35: dwrite d1/f6 [0,4194304] 0 2024-08-31T05:21:00.495 INFO:tasks.workunit.client.1.smithi073.stdout:7/351: truncate d1/da/d15/d33/f42 5513385 0 2024-08-31T05:21:00.496 INFO:tasks.workunit.client.0.smithi067.stdout:8/26: dwrite d0/d2/f3 [0,4194304] 0 2024-08-31T05:21:00.496 INFO:tasks.workunit.client.1.smithi073.stdout:4/340: mkdir d7/d1a/d5c/d62 0 2024-08-31T05:21:00.497 INFO:tasks.workunit.client.1.smithi073.stdout:1/281: rename d5/d10/d33/d13/c23 to d5/d10/d1c/d27/c4d 0 2024-08-31T05:21:00.500 INFO:tasks.workunit.client.1.smithi073.stdout:3/370: creat da/d3c/d65/d40/d5d/f80 x:0 0 0 2024-08-31T05:21:00.501 INFO:tasks.workunit.client.1.smithi073.stdout:5/356: dwrite dc/d16/d26/d49/f71 [0,4194304] 0 2024-08-31T05:21:00.501 INFO:tasks.workunit.client.1.smithi073.stdout:1/282: dread d5/f9 [4194304,4194304] 0 2024-08-31T05:21:00.502 INFO:tasks.workunit.client.0.smithi067.stdout:8/27: mkdir d0/d8 0 2024-08-31T05:21:00.503 INFO:tasks.workunit.client.1.smithi073.stdout:1/283: chown d5/d10 5570 1 2024-08-31T05:21:00.503 INFO:tasks.workunit.client.1.smithi073.stdout:5/357: stat dc/d16/d1a/f33 0 2024-08-31T05:21:00.504 INFO:tasks.workunit.client.1.smithi073.stdout:7/352: mkdir d1/da/d15/d33/d44/d74 0 2024-08-31T05:21:00.506 INFO:tasks.workunit.client.0.smithi067.stdout:0/36: link d1/c2 d1/df/da/c11 0 2024-08-31T05:21:00.508 INFO:tasks.workunit.client.1.smithi073.stdout:5/358: write dc/d16/d26/f34 [88923,84011] 0 2024-08-31T05:21:00.508 INFO:tasks.workunit.client.1.smithi073.stdout:2/343: sync 2024-08-31T05:21:00.509 INFO:tasks.workunit.client.1.smithi073.stdout:8/386: truncate d0/f39 7846315 0 2024-08-31T05:21:00.509 INFO:tasks.workunit.client.1.smithi073.stdout:6/284: creat d15/d17/f5e x:0 0 0 2024-08-31T05:21:00.513 INFO:tasks.workunit.client.1.smithi073.stdout:8/387: dread - d0/db/d1c/d24/f48 zero size 2024-08-31T05:21:00.513 INFO:tasks.workunit.client.1.smithi073.stdout:7/353: creat d1/da/d3e/d22/f75 x:0 0 0 2024-08-31T05:21:00.514 INFO:tasks.workunit.client.1.smithi073.stdout:2/344: symlink d2/d9/d32/d56/l68 0 2024-08-31T05:21:00.514 INFO:tasks.workunit.client.1.smithi073.stdout:3/371: dwrite da/d3c/d65/d45/f55 [0,4194304] 0 2024-08-31T05:21:00.515 INFO:tasks.workunit.client.1.smithi073.stdout:5/359: write dc/d16/d4e/f5e [315865,73115] 0 2024-08-31T05:21:00.516 INFO:tasks.workunit.client.0.smithi067.stdout:0/37: dwrite d1/f6 [0,4194304] 0 2024-08-31T05:21:00.517 INFO:tasks.workunit.client.1.smithi073.stdout:7/354: fsync d1/da/d15/d33/d44/f66 0 2024-08-31T05:21:00.518 INFO:tasks.workunit.client.1.smithi073.stdout:5/360: read dc/d16/d1a/f28 [1410425,89191] 0 2024-08-31T05:21:00.519 INFO:tasks.workunit.client.1.smithi073.stdout:3/372: creat da/d3c/d67/f81 x:0 0 0 2024-08-31T05:21:00.519 INFO:tasks.workunit.client.1.smithi073.stdout:5/361: truncate dc/d3d/f4c 214950 0 2024-08-31T05:21:00.521 INFO:tasks.workunit.client.1.smithi073.stdout:2/345: mknod d2/c69 0 2024-08-31T05:21:00.521 INFO:tasks.workunit.client.0.smithi067.stdout:0/38: dread d1/f6 [0,4194304] 0 2024-08-31T05:21:00.524 INFO:tasks.workunit.client.0.smithi067.stdout:0/39: mknod d1/c12 0 2024-08-31T05:21:00.525 INFO:tasks.workunit.client.1.smithi073.stdout:6/285: truncate d15/d1a/d1e/f43 1072296 0 2024-08-31T05:21:00.527 INFO:tasks.workunit.client.1.smithi073.stdout:7/355: fsync d1/d11/f53 0 2024-08-31T05:21:00.531 INFO:tasks.workunit.client.1.smithi073.stdout:6/286: dread d15/d1a/f20 [0,4194304] 0 2024-08-31T05:21:00.532 INFO:tasks.workunit.client.1.smithi073.stdout:5/362: chown dc/d16/d26/l1d 386074 1 2024-08-31T05:21:00.533 INFO:tasks.workunit.client.1.smithi073.stdout:8/388: mkdir d0/db/d44/d72/d75/d7e 0 2024-08-31T05:21:00.534 INFO:tasks.workunit.client.1.smithi073.stdout:8/389: fsync d0/db/d1c/f1f 0 2024-08-31T05:21:00.535 INFO:tasks.workunit.client.0.smithi067.stdout:0/40: dwrite d1/f6 [0,4194304] 0 2024-08-31T05:21:00.536 INFO:tasks.workunit.client.1.smithi073.stdout:2/346: symlink d2/d9/df/l6a 0 2024-08-31T05:21:00.537 INFO:tasks.workunit.client.0.smithi067.stdout:0/41: chown d1/d8/ce 138 1 2024-08-31T05:21:00.541 INFO:tasks.workunit.client.1.smithi073.stdout:1/284: write d5/d10/d33/f15 [5077418,20999] 0 2024-08-31T05:21:00.542 INFO:tasks.workunit.client.1.smithi073.stdout:7/356: rename d1/da/d3e/d22/d47/l4f to d1/da/d3e/d22/d5c/l76 0 2024-08-31T05:21:00.542 INFO:tasks.workunit.client.1.smithi073.stdout:0/348: sync 2024-08-31T05:21:00.542 INFO:tasks.workunit.client.1.smithi073.stdout:9/395: sync 2024-08-31T05:21:00.546 INFO:tasks.workunit.client.1.smithi073.stdout:6/287: dwrite d15/d1a/d1e/f25 [0,4194304] 0 2024-08-31T05:21:00.548 INFO:tasks.workunit.client.1.smithi073.stdout:5/363: dwrite dc/d16/d26/f51 [0,4194304] 0 2024-08-31T05:21:00.550 INFO:tasks.workunit.client.1.smithi073.stdout:4/341: dwrite d7/df/d13/d2e/f36 [0,4194304] 0 2024-08-31T05:21:00.550 INFO:tasks.workunit.client.1.smithi073.stdout:9/396: chown dc/f3c 43550143 1 2024-08-31T05:21:00.551 INFO:tasks.workunit.client.1.smithi073.stdout:4/342: readlink d7/df/d1b/d34/l4d 0 2024-08-31T05:21:00.551 INFO:tasks.workunit.client.1.smithi073.stdout:6/288: chown d15/f49 2599 1 2024-08-31T05:21:00.551 INFO:tasks.workunit.client.1.smithi073.stdout:8/390: creat d0/db/d44/d72/d79/f7f x:0 0 0 2024-08-31T05:21:00.552 INFO:tasks.workunit.client.1.smithi073.stdout:2/347: mknod d2/d9/d66/c6b 0 2024-08-31T05:21:00.552 INFO:tasks.workunit.client.1.smithi073.stdout:8/391: fdatasync d0/f4 0 2024-08-31T05:21:00.554 INFO:tasks.workunit.client.1.smithi073.stdout:9/397: dread - dc/f75 zero size 2024-08-31T05:21:00.556 INFO:tasks.workunit.client.0.smithi067.stdout:0/42: fsync d1/f6 0 2024-08-31T05:21:00.556 INFO:tasks.workunit.client.1.smithi073.stdout:0/349: truncate d0/d15/d2c/d2e/f57 843465 0 2024-08-31T05:21:00.557 INFO:tasks.workunit.client.1.smithi073.stdout:7/357: mknod d1/da/d15/d33/d44/d60/c77 0 2024-08-31T05:21:00.557 INFO:tasks.workunit.client.1.smithi073.stdout:2/348: write d2/d9/df/f3e [182434,72948] 0 2024-08-31T05:21:00.563 INFO:tasks.workunit.client.1.smithi073.stdout:3/373: dwrite da/fb [4194304,4194304] 0 2024-08-31T05:21:00.564 INFO:tasks.workunit.client.1.smithi073.stdout:3/374: chown da/f29 5369 1 2024-08-31T05:21:00.567 INFO:tasks.workunit.client.0.smithi067.stdout:0/43: truncate d1/f6 2976845 0 2024-08-31T05:21:00.567 INFO:tasks.workunit.client.0.smithi067.stdout:0/44: readlink - no filename 2024-08-31T05:21:00.567 INFO:tasks.workunit.client.1.smithi073.stdout:6/289: write d15/d1a/f20 [1265315,124097] 0 2024-08-31T05:21:00.568 INFO:tasks.workunit.client.0.smithi067.stdout:8/28: truncate d0/d2/f3 2712218 0 2024-08-31T05:21:00.570 INFO:tasks.workunit.client.1.smithi073.stdout:5/364: mknod dc/d16/d26/d49/c80 0 2024-08-31T05:21:00.571 INFO:tasks.workunit.client.1.smithi073.stdout:5/365: readlink dc/d3d/d3e/l75 0 2024-08-31T05:21:00.572 INFO:tasks.workunit.client.1.smithi073.stdout:8/392: dread - d0/db/d1c/d24/f53 zero size 2024-08-31T05:21:00.575 INFO:tasks.workunit.client.1.smithi073.stdout:0/350: write d0/f26 [6442575,15078] 0 2024-08-31T05:21:00.577 INFO:tasks.workunit.client.1.smithi073.stdout:7/358: mknod d1/da/d3e/d22/d5c/c78 0 2024-08-31T05:21:00.578 INFO:tasks.workunit.client.1.smithi073.stdout:1/285: truncate d5/d10/d33/fe 2727478 0 2024-08-31T05:21:00.579 INFO:tasks.workunit.client.1.smithi073.stdout:3/375: mkdir da/d3c/d82 0 2024-08-31T05:21:00.580 INFO:tasks.workunit.client.1.smithi073.stdout:9/398: creat dc/de/d66/f83 x:0 0 0 2024-08-31T05:21:00.580 INFO:tasks.workunit.client.1.smithi073.stdout:5/366: rmdir dc/d16/d1a 39 2024-08-31T05:21:00.583 INFO:tasks.workunit.client.1.smithi073.stdout:4/343: rename d7/df/d13/l1d to d7/df/l63 0 2024-08-31T05:21:00.584 INFO:tasks.workunit.client.1.smithi073.stdout:3/376: stat da/d18/c78 0 2024-08-31T05:21:00.587 INFO:tasks.workunit.client.1.smithi073.stdout:3/377: write da/d3c/d65/f20 [3234814,33706] 0 2024-08-31T05:21:00.589 INFO:tasks.workunit.client.1.smithi073.stdout:9/399: getdents dc/de/d11/d41/d52/d5b/d73 0 2024-08-31T05:21:00.590 INFO:tasks.workunit.client.1.smithi073.stdout:5/367: dwrite dc/f14 [4194304,4194304] 0 2024-08-31T05:21:00.590 INFO:tasks.workunit.client.1.smithi073.stdout:3/378: fsync da/d3c/d65/d40/f44 0 2024-08-31T05:21:00.591 INFO:tasks.workunit.client.1.smithi073.stdout:0/351: rename d0/f4 to d0/d15/d2c/d40/f6d 0 2024-08-31T05:21:00.592 INFO:tasks.workunit.client.0.smithi067.stdout:0/45: write d1/f6 [3164481,16300] 0 2024-08-31T05:21:00.592 INFO:tasks.workunit.client.1.smithi073.stdout:5/368: dread - dc/d52/f70 zero size 2024-08-31T05:21:00.595 INFO:tasks.workunit.client.1.smithi073.stdout:3/379: write da/d68/f6b [704462,126734] 0 2024-08-31T05:21:00.596 INFO:tasks.workunit.client.0.smithi067.stdout:8/29: dread d0/d2/f3 [0,4194304] 0 2024-08-31T05:21:00.596 INFO:tasks.workunit.client.1.smithi073.stdout:3/380: write da/d3c/d67/f6f [920965,61041] 0 2024-08-31T05:21:00.596 INFO:tasks.workunit.client.1.smithi073.stdout:2/349: dread d2/f4f [0,4194304] 0 2024-08-31T05:21:00.597 INFO:tasks.workunit.client.1.smithi073.stdout:5/369: truncate dc/d16/d4e/f5e 427518 0 2024-08-31T05:21:00.600 INFO:tasks.workunit.client.0.smithi067.stdout:0/46: dread d1/f6 [0,4194304] 0 2024-08-31T05:21:00.601 INFO:tasks.workunit.client.1.smithi073.stdout:0/352: dread - d0/f5b zero size 2024-08-31T05:21:00.601 INFO:tasks.workunit.client.1.smithi073.stdout:1/286: rename d5/d10/f16 to d5/d17/d3f/f4e 0 2024-08-31T05:21:00.602 INFO:tasks.workunit.client.1.smithi073.stdout:3/381: dread - da/d3c/d67/f7c zero size 2024-08-31T05:21:00.603 INFO:tasks.workunit.client.1.smithi073.stdout:5/370: creat dc/d16/d26/d49/f81 x:0 0 0 2024-08-31T05:21:00.603 INFO:tasks.workunit.client.0.smithi067.stdout:0/47: dread d1/f6 [0,4194304] 0 2024-08-31T05:21:00.605 INFO:tasks.workunit.client.1.smithi073.stdout:6/290: dread d15/d1a/f32 [0,4194304] 0 2024-08-31T05:21:00.606 INFO:tasks.workunit.client.1.smithi073.stdout:9/400: dwrite f9 [0,4194304] 0 2024-08-31T05:21:00.606 INFO:tasks.workunit.client.1.smithi073.stdout:2/350: mknod d2/d9/c6c 0 2024-08-31T05:21:00.607 INFO:tasks.workunit.client.1.smithi073.stdout:5/371: dread - dc/d16/d3b/f74 zero size 2024-08-31T05:21:00.608 INFO:tasks.workunit.client.0.smithi067.stdout:8/30: creat d0/f9 x:0 0 0 2024-08-31T05:21:00.609 INFO:tasks.workunit.client.0.smithi067.stdout:8/31: fdatasync d0/f9 0 2024-08-31T05:21:00.610 INFO:tasks.workunit.client.0.smithi067.stdout:8/32: truncate d0/f9 490676 0 2024-08-31T05:21:00.613 INFO:tasks.workunit.client.1.smithi073.stdout:1/287: symlink d5/d17/d32/l4f 0 2024-08-31T05:21:00.617 INFO:tasks.workunit.client.1.smithi073.stdout:7/359: truncate d1/d11/d14/f63 4050284 0 2024-08-31T05:21:00.618 INFO:tasks.workunit.client.1.smithi073.stdout:7/360: write d1/da/f34 [3301368,103424] 0 2024-08-31T05:21:00.618 INFO:tasks.workunit.client.1.smithi073.stdout:3/382: creat da/d3c/d65/d40/d5d/f83 x:0 0 0 2024-08-31T05:21:00.619 INFO:tasks.workunit.client.0.smithi067.stdout:0/48: dwrite d1/f6 [0,4194304] 0 2024-08-31T05:21:00.621 INFO:tasks.workunit.client.0.smithi067.stdout:8/33: mkdir d0/d2/da 0 2024-08-31T05:21:00.623 INFO:tasks.workunit.client.1.smithi073.stdout:4/344: dread d7/fa [0,4194304] 0 2024-08-31T05:21:00.623 INFO:tasks.workunit.client.0.smithi067.stdout:0/49: creat d1/df/f13 x:0 0 0 2024-08-31T05:21:00.624 INFO:tasks.workunit.client.1.smithi073.stdout:4/345: write d7/df/d1b/f51 [919890,12431] 0 2024-08-31T05:21:00.625 INFO:tasks.workunit.client.0.smithi067.stdout:8/34: dread d0/d2/f3 [0,4194304] 0 2024-08-31T05:21:00.625 INFO:tasks.workunit.client.1.smithi073.stdout:4/346: readlink d7/df/l60 0 2024-08-31T05:21:00.626 INFO:tasks.workunit.client.1.smithi073.stdout:5/372: rename dc/d16/d3b/d3f/f69 to dc/d53/f82 0 2024-08-31T05:21:00.627 INFO:tasks.workunit.client.1.smithi073.stdout:6/291: creat d15/d17/d26/d38/f5f x:0 0 0 2024-08-31T05:21:00.629 INFO:tasks.workunit.client.0.smithi067.stdout:8/35: write d0/d2/f3 [216607,19191] 0 2024-08-31T05:21:00.629 INFO:tasks.workunit.client.0.smithi067.stdout:8/36: chown d0/d2/d6 36591 1 2024-08-31T05:21:00.632 INFO:tasks.workunit.client.1.smithi073.stdout:2/351: symlink d2/d9/l6d 0 2024-08-31T05:21:00.632 INFO:tasks.workunit.client.1.smithi073.stdout:7/361: creat d1/da/d3e/d22/d47/f79 x:0 0 0 2024-08-31T05:21:00.633 INFO:tasks.workunit.client.1.smithi073.stdout:2/352: truncate d2/d9/d3c/f57 337045 0 2024-08-31T05:21:00.633 INFO:tasks.workunit.client.0.smithi067.stdout:8/37: symlink d0/d2/d6/lb 0 2024-08-31T05:21:00.634 INFO:tasks.workunit.client.1.smithi073.stdout:2/353: write d2/d9/d32/d56/f63 [199202,110634] 0 2024-08-31T05:21:00.635 INFO:tasks.workunit.client.1.smithi073.stdout:2/354: read - d2/d9/d3c/f46 zero size 2024-08-31T05:21:00.637 INFO:tasks.workunit.client.0.smithi067.stdout:8/38: rename d0/d8 to d0/d2/dc 0 2024-08-31T05:21:00.639 INFO:tasks.workunit.client.0.smithi067.stdout:8/39: dread d0/d2/f3 [0,4194304] 0 2024-08-31T05:21:00.640 INFO:tasks.workunit.client.1.smithi073.stdout:6/292: readlink d15/d17/d26/l3c 0 2024-08-31T05:21:00.640 INFO:tasks.workunit.client.1.smithi073.stdout:6/293: dread - d15/f49 zero size 2024-08-31T05:21:00.641 INFO:tasks.workunit.client.1.smithi073.stdout:6/294: fsync d15/f22 0 2024-08-31T05:21:00.642 INFO:tasks.workunit.client.1.smithi073.stdout:6/295: truncate d15/d1a/f20 4830938 0 2024-08-31T05:21:00.642 INFO:tasks.workunit.client.0.smithi067.stdout:8/40: rmdir d0 39 2024-08-31T05:21:00.648 INFO:tasks.workunit.client.1.smithi073.stdout:0/353: link d0/f49 d0/d58/f6e 0 2024-08-31T05:21:00.649 INFO:tasks.workunit.client.1.smithi073.stdout:8/393: dwrite d0/f39 [4194304,4194304] 0 2024-08-31T05:21:00.650 INFO:tasks.workunit.client.1.smithi073.stdout:8/394: dread - d0/db/d1c/d34/d38/f64 zero size 2024-08-31T05:21:00.654 INFO:tasks.workunit.client.1.smithi073.stdout:8/395: chown d0/db/d1c/d34 25 1 2024-08-31T05:21:00.656 INFO:tasks.workunit.client.1.smithi073.stdout:2/355: mknod d2/d9/c6e 0 2024-08-31T05:21:00.658 INFO:tasks.workunit.client.0.smithi067.stdout:8/41: dwrite d0/d2/f3 [0,4194304] 0 2024-08-31T05:21:00.659 INFO:tasks.workunit.client.0.smithi067.stdout:8/42: chown d0/d2 20879575 1 2024-08-31T05:21:00.659 INFO:tasks.workunit.client.1.smithi073.stdout:0/354: unlink d0/d15/d2c/d4d/f3e 0 2024-08-31T05:21:00.660 INFO:tasks.workunit.client.0.smithi067.stdout:8/43: write d0/f9 [1503660,89680] 0 2024-08-31T05:21:00.661 INFO:tasks.workunit.client.1.smithi073.stdout:9/401: dwrite dc/d10/f7b [0,4194304] 0 2024-08-31T05:21:00.663 INFO:tasks.workunit.client.1.smithi073.stdout:0/355: read d0/d15/d2c/d2e/f3f [3022859,7133] 0 2024-08-31T05:21:00.668 INFO:tasks.workunit.client.1.smithi073.stdout:0/356: truncate d0/d15/d2c/d2e/f38 49556 0 2024-08-31T05:21:00.668 INFO:tasks.workunit.client.1.smithi073.stdout:7/362: rmdir d1/da/d15/d6a 0 2024-08-31T05:21:00.670 INFO:tasks.workunit.client.1.smithi073.stdout:5/373: dwrite dc/d16/d1a/f33 [0,4194304] 0 2024-08-31T05:21:00.670 INFO:tasks.workunit.client.1.smithi073.stdout:2/356: mknod d2/d9/df/d36/c6f 0 2024-08-31T05:21:00.671 INFO:tasks.workunit.client.1.smithi073.stdout:2/357: stat d2/d9/d3c/l3d 0 2024-08-31T05:21:00.672 INFO:tasks.workunit.client.1.smithi073.stdout:2/358: fdatasync d2/d9/d3c/f46 0 2024-08-31T05:21:00.673 INFO:tasks.workunit.client.1.smithi073.stdout:5/374: chown dc/d16 5801698 1 2024-08-31T05:21:00.675 INFO:tasks.workunit.client.1.smithi073.stdout:8/396: getdents d0/db/d1c/d24/d73 0 2024-08-31T05:21:00.676 INFO:tasks.workunit.client.1.smithi073.stdout:9/402: mkdir dc/de/d66/d84 0 2024-08-31T05:21:00.677 INFO:tasks.workunit.client.1.smithi073.stdout:2/359: chown d2/d9/df/d36/l48 59479748 1 2024-08-31T05:21:00.678 INFO:tasks.workunit.client.1.smithi073.stdout:4/347: link d7/df/l43 d7/df/l64 0 2024-08-31T05:21:00.680 INFO:tasks.workunit.client.1.smithi073.stdout:8/397: chown d0/db/d1c/d24/c4a 16338582 1 2024-08-31T05:21:00.681 INFO:tasks.workunit.client.1.smithi073.stdout:5/375: symlink dc/d16/l83 0 2024-08-31T05:21:00.683 INFO:tasks.workunit.client.1.smithi073.stdout:7/363: dwrite d1/da/d15/f58 [0,4194304] 0 2024-08-31T05:21:00.683 INFO:tasks.workunit.client.1.smithi073.stdout:0/357: chown d0/d15/d2c/d4d/c48 8169083 1 2024-08-31T05:21:00.685 INFO:tasks.workunit.client.1.smithi073.stdout:4/348: mkdir d7/db/d11/d59/d65 0 2024-08-31T05:21:00.687 INFO:tasks.workunit.client.0.smithi067.stdout:8/44: fsync d0/d2/f3 0 2024-08-31T05:21:00.688 INFO:tasks.workunit.client.1.smithi073.stdout:8/398: mkdir d0/db/d1c/d34/d80 0 2024-08-31T05:21:00.689 INFO:tasks.workunit.client.1.smithi073.stdout:7/364: chown d1/d11/d14/l28 323188 1 2024-08-31T05:21:00.690 INFO:tasks.workunit.client.1.smithi073.stdout:6/296: dwrite d15/d1a/d2b/d2f/f3f [0,4194304] 0 2024-08-31T05:21:00.692 INFO:tasks.workunit.client.1.smithi073.stdout:4/349: write d7/df/d1b/d34/f5f [212848,13295] 0 2024-08-31T05:21:00.693 INFO:tasks.workunit.client.1.smithi073.stdout:5/376: rename dc/d16/d26 to dc/d3d/d55/d84 0 2024-08-31T05:21:00.696 INFO:tasks.workunit.client.1.smithi073.stdout:9/403: dwrite dc/de/d66/f67 [0,4194304] 0 2024-08-31T05:21:00.699 INFO:tasks.workunit.client.1.smithi073.stdout:6/297: write d15/d1a/d2b/d2f/d4b/f57 [749973,95430] 0 2024-08-31T05:21:00.700 INFO:tasks.workunit.client.1.smithi073.stdout:0/358: mknod d0/d15/d2c/d2e/d3d/d68/c6f 0 2024-08-31T05:21:00.701 INFO:tasks.workunit.client.0.smithi067.stdout:8/45: dread d0/f9 [0,4194304] 0 2024-08-31T05:21:00.702 INFO:tasks.workunit.client.0.smithi067.stdout:8/46: read d0/f9 [1501432,130046] 0 2024-08-31T05:21:00.702 INFO:tasks.workunit.client.1.smithi073.stdout:5/377: mknod dc/d3d/d55/d84/c85 0 2024-08-31T05:21:00.702 INFO:tasks.workunit.client.1.smithi073.stdout:2/360: dwrite d2/d9/d32/d56/f63 [0,4194304] 0 2024-08-31T05:21:00.702 INFO:tasks.workunit.client.0.smithi067.stdout:8/47: chown d0/d2 202185201 1 2024-08-31T05:21:00.705 INFO:tasks.workunit.client.1.smithi073.stdout:4/350: rename d7/fa to d7/d1a/d5c/f66 0 2024-08-31T05:21:00.707 INFO:tasks.workunit.client.1.smithi073.stdout:1/288: dwrite d5/d10/d33/fe [0,4194304] 0 2024-08-31T05:21:00.708 INFO:tasks.workunit.client.1.smithi073.stdout:1/289: stat d5/d10/d33/f30 0 2024-08-31T05:21:00.712 INFO:tasks.workunit.client.0.smithi067.stdout:8/48: mkdir d0/d2/da/dd 0 2024-08-31T05:21:00.714 INFO:tasks.workunit.client.1.smithi073.stdout:5/378: symlink dc/d16/d3b/l86 0 2024-08-31T05:21:00.715 INFO:tasks.workunit.client.1.smithi073.stdout:4/351: dwrite d7/db/f4f [0,4194304] 0 2024-08-31T05:21:00.717 INFO:tasks.workunit.client.0.smithi067.stdout:8/49: dread d0/d2/f3 [0,4194304] 0 2024-08-31T05:21:00.718 INFO:tasks.workunit.client.1.smithi073.stdout:2/361: mkdir d2/d9/d66/d70 0 2024-08-31T05:21:00.721 INFO:tasks.workunit.client.0.smithi067.stdout:8/50: write d0/f9 [379175,122931] 0 2024-08-31T05:21:00.724 INFO:tasks.workunit.client.1.smithi073.stdout:6/298: mknod d15/d17/d26/c60 0 2024-08-31T05:21:00.725 INFO:tasks.workunit.client.1.smithi073.stdout:1/290: unlink d5/d10/d1c/d27/c4d 0 2024-08-31T05:21:00.726 INFO:tasks.workunit.client.1.smithi073.stdout:9/404: getdents dc/de/d56 0 2024-08-31T05:21:00.726 INFO:tasks.workunit.client.1.smithi073.stdout:7/365: dwrite d1/da/d3e/d22/d47/f51 [0,4194304] 0 2024-08-31T05:21:00.727 INFO:tasks.workunit.client.1.smithi073.stdout:6/299: write d15/f19 [5303696,26225] 0 2024-08-31T05:21:00.728 INFO:tasks.workunit.client.0.smithi067.stdout:8/51: dwrite d0/d2/f3 [0,4194304] 0 2024-08-31T05:21:00.729 INFO:tasks.workunit.client.0.smithi067.stdout:8/52: write d0/d2/f3 [3738249,65912] 0 2024-08-31T05:21:00.730 INFO:tasks.workunit.client.1.smithi073.stdout:1/291: chown d5/d10/d1c/f4b 5676 1 2024-08-31T05:21:00.730 INFO:tasks.workunit.client.1.smithi073.stdout:7/366: chown d1/da/d3e/d22/d6b 68 1 2024-08-31T05:21:00.731 INFO:tasks.workunit.client.0.smithi067.stdout:8/53: write d0/d2/f3 [4873011,27577] 0 2024-08-31T05:21:00.733 INFO:tasks.workunit.client.0.smithi067.stdout:8/54: write d0/d2/f3 [2067256,69056] 0 2024-08-31T05:21:00.733 INFO:tasks.workunit.client.1.smithi073.stdout:2/362: creat d2/d9/d32/d5d/f71 x:0 0 0 2024-08-31T05:21:00.733 INFO:tasks.workunit.client.1.smithi073.stdout:9/405: mkdir dc/de/d11/d85 0 2024-08-31T05:21:00.733 INFO:tasks.workunit.client.1.smithi073.stdout:1/292: truncate d5/f7 4587962 0 2024-08-31T05:21:00.734 INFO:tasks.workunit.client.1.smithi073.stdout:5/379: dwrite dc/d16/d3b/f73 [0,4194304] 0 2024-08-31T05:21:00.735 INFO:tasks.workunit.client.1.smithi073.stdout:4/352: write d7/df/d13/d2e/f3a [1021419,111541] 0 2024-08-31T05:21:00.737 INFO:tasks.workunit.client.0.smithi067.stdout:8/55: mkdir d0/d4/de 0 2024-08-31T05:21:00.739 INFO:tasks.workunit.client.1.smithi073.stdout:1/293: chown d5/d10/d33/f36 1276772 1 2024-08-31T05:21:00.739 INFO:tasks.workunit.client.1.smithi073.stdout:0/359: truncate d0/f32 1628594 0 2024-08-31T05:21:00.740 INFO:tasks.workunit.client.1.smithi073.stdout:9/406: rename dc/d37/l4d to dc/d37/l86 0 2024-08-31T05:21:00.741 INFO:tasks.workunit.client.1.smithi073.stdout:1/294: write d5/d17/f43 [922528,54118] 0 2024-08-31T05:21:00.742 INFO:tasks.workunit.client.0.smithi067.stdout:8/56: dread d0/d2/f3 [0,4194304] 0 2024-08-31T05:21:00.742 INFO:tasks.workunit.client.1.smithi073.stdout:7/367: rename d1/c8 to d1/da/d15/d33/d44/d60/c7a 0 2024-08-31T05:21:00.742 INFO:tasks.workunit.client.1.smithi073.stdout:6/300: dread d15/f29 [0,4194304] 0 2024-08-31T05:21:00.744 INFO:tasks.workunit.client.1.smithi073.stdout:5/380: mkdir dc/d16/d1a/d87 0 2024-08-31T05:21:00.745 INFO:tasks.workunit.client.1.smithi073.stdout:6/301: write d15/d17/d26/d38/f5f [798603,45863] 0 2024-08-31T05:21:00.747 INFO:tasks.workunit.client.1.smithi073.stdout:2/363: creat d2/d9/d66/d70/f72 x:0 0 0 2024-08-31T05:21:00.748 INFO:tasks.workunit.client.1.smithi073.stdout:8/399: dread d0/fe [0,4194304] 0 2024-08-31T05:21:00.748 INFO:tasks.workunit.client.1.smithi073.stdout:2/364: readlink d2/d9/df/d36/l44 0 2024-08-31T05:21:00.748 INFO:tasks.workunit.client.1.smithi073.stdout:7/368: creat d1/da/f7b x:0 0 0 2024-08-31T05:21:00.749 INFO:tasks.workunit.client.1.smithi073.stdout:9/407: mknod dc/de/d11/d41/c87 0 2024-08-31T05:21:00.750 INFO:tasks.workunit.client.0.smithi067.stdout:8/57: dwrite d0/f9 [0,4194304] 0 2024-08-31T05:21:00.750 INFO:tasks.workunit.client.1.smithi073.stdout:7/369: chown d1/da/d15/c1c 2 1 2024-08-31T05:21:00.752 INFO:tasks.workunit.client.1.smithi073.stdout:8/400: truncate d0/db/d1c/d24/f78 254173 0 2024-08-31T05:21:00.752 INFO:tasks.workunit.client.1.smithi073.stdout:5/381: symlink dc/l88 0 2024-08-31T05:21:00.753 INFO:tasks.workunit.client.1.smithi073.stdout:6/302: mkdir d15/d1a/d51/d61 0 2024-08-31T05:21:00.756 INFO:tasks.workunit.client.0.smithi067.stdout:8/58: mknod d0/d2/da/dd/cf 0 2024-08-31T05:21:00.757 INFO:tasks.workunit.client.1.smithi073.stdout:5/382: dread - dc/d3d/d55/d84/d49/f81 zero size 2024-08-31T05:21:00.759 INFO:tasks.workunit.client.1.smithi073.stdout:0/360: getdents d0/d28 0 2024-08-31T05:21:00.759 INFO:tasks.workunit.client.0.smithi067.stdout:8/59: write d0/d2/f3 [4897910,126856] 0 2024-08-31T05:21:00.761 INFO:tasks.workunit.client.1.smithi073.stdout:2/365: dread d2/d9/df/f22 [0,4194304] 0 2024-08-31T05:21:00.762 INFO:tasks.workunit.client.1.smithi073.stdout:6/303: rename f9 to d15/d17/d26/d38/f62 0 2024-08-31T05:21:00.763 INFO:tasks.workunit.client.0.smithi067.stdout:8/60: dread d0/f9 [0,4194304] 0 2024-08-31T05:21:00.763 INFO:tasks.workunit.client.1.smithi073.stdout:1/295: dwrite d5/d10/d33/f30 [8388608,4194304] 0 2024-08-31T05:21:00.764 INFO:tasks.workunit.client.0.smithi067.stdout:8/61: read d0/f9 [3696662,111909] 0 2024-08-31T05:21:00.769 INFO:tasks.workunit.client.1.smithi073.stdout:2/366: creat d2/d9/d3c/f73 x:0 0 0 2024-08-31T05:21:00.769 INFO:tasks.workunit.client.1.smithi073.stdout:3/383: sync 2024-08-31T05:21:00.769 INFO:tasks.workunit.client.1.smithi073.stdout:9/408: dwrite dc/de/f1e [4194304,4194304] 0 2024-08-31T05:21:00.776 INFO:tasks.workunit.client.1.smithi073.stdout:8/401: dwrite d0/db/d1c/d2a/d58/f66 [0,4194304] 0 2024-08-31T05:21:00.776 INFO:tasks.workunit.client.1.smithi073.stdout:7/370: dwrite d1/da/d3e/f1f [4194304,4194304] 0 2024-08-31T05:21:00.781 INFO:tasks.workunit.client.1.smithi073.stdout:7/371: chown d1/da/d15/f58 21823961 1 2024-08-31T05:21:00.784 INFO:tasks.workunit.client.1.smithi073.stdout:0/361: dwrite d0/d15/d2c/d2e/f38 [0,4194304] 0 2024-08-31T05:21:00.784 INFO:tasks.workunit.client.1.smithi073.stdout:3/384: read da/d3c/d65/d2c/f48 [424228,14270] 0 2024-08-31T05:21:00.784 INFO:tasks.workunit.client.1.smithi073.stdout:6/304: dwrite d15/d1a/d2b/d2f/f3f [0,4194304] 0 2024-08-31T05:21:00.786 INFO:tasks.workunit.client.1.smithi073.stdout:3/385: chown da/d3c/d65/d45/f55 19204669 1 2024-08-31T05:21:00.820 INFO:tasks.workunit.client.1.smithi073.stdout:2/367: creat d2/d9/d66/d70/f74 x:0 0 0 2024-08-31T05:21:00.826 INFO:tasks.workunit.client.1.smithi073.stdout:7/372: unlink d1/da/d3e/d22/f41 0 2024-08-31T05:21:00.827 INFO:tasks.workunit.client.1.smithi073.stdout:0/362: write d0/d15/d2c/d40/f6d [1592570,126422] 0 2024-08-31T05:21:00.830 INFO:tasks.workunit.client.1.smithi073.stdout:9/409: symlink dc/de/d66/d84/l88 0 2024-08-31T05:21:00.831 INFO:tasks.workunit.client.1.smithi073.stdout:2/368: creat d2/d9/d32/d56/f75 x:0 0 0 2024-08-31T05:21:00.832 INFO:tasks.workunit.client.1.smithi073.stdout:4/353: dwrite d7/df/d13/f16 [0,4194304] 0 2024-08-31T05:21:00.836 INFO:tasks.workunit.client.1.smithi073.stdout:0/363: creat d0/d58/f70 x:0 0 0 2024-08-31T05:21:00.836 INFO:tasks.workunit.client.0.smithi067.stdout:8/62: truncate d0/d2/f3 1729950 0 2024-08-31T05:21:00.836 INFO:tasks.workunit.client.1.smithi073.stdout:5/383: link dc/d3d/d55/l78 dc/d16/d3b/l89 0 2024-08-31T05:21:00.837 INFO:tasks.workunit.client.0.smithi067.stdout:8/63: chown d0/d2/da/dd 1901 1 2024-08-31T05:21:00.838 INFO:tasks.workunit.client.1.smithi073.stdout:2/369: write d2/d9/f2a [4599216,103600] 0 2024-08-31T05:21:00.840 INFO:tasks.workunit.client.1.smithi073.stdout:2/370: stat d2/d9/d3c 0 2024-08-31T05:21:00.840 INFO:tasks.workunit.client.1.smithi073.stdout:0/364: chown d0/d28/f30 31965 1 2024-08-31T05:21:00.841 INFO:tasks.workunit.client.1.smithi073.stdout:1/296: getdents d5/d10/d33/d13 0 2024-08-31T05:21:00.841 INFO:tasks.workunit.client.1.smithi073.stdout:7/373: dwrite d1/da/d3e/d22/d47/f79 [0,4194304] 0 2024-08-31T05:21:00.844 INFO:tasks.workunit.client.1.smithi073.stdout:6/305: getdents d15/d1a 0 2024-08-31T05:21:00.844 INFO:tasks.workunit.client.1.smithi073.stdout:0/365: write d0/f26 [3356503,109133] 0 2024-08-31T05:21:00.845 INFO:tasks.workunit.client.1.smithi073.stdout:9/410: dwrite dc/de/f1e [0,4194304] 0 2024-08-31T05:21:00.846 INFO:tasks.workunit.client.1.smithi073.stdout:5/384: creat dc/d3d/d55/d84/f8a x:0 0 0 2024-08-31T05:21:00.849 INFO:tasks.workunit.client.1.smithi073.stdout:9/411: fdatasync dc/de/d66/f83 0 2024-08-31T05:21:00.850 INFO:tasks.workunit.client.1.smithi073.stdout:2/371: mkdir d2/d9/d27/d76 0 2024-08-31T05:21:00.850 INFO:tasks.workunit.client.1.smithi073.stdout:3/386: write da/d3c/d65/f3a [2266932,25341] 0 2024-08-31T05:21:00.852 INFO:tasks.workunit.client.0.smithi067.stdout:8/64: write d0/d2/f3 [1771534,124339] 0 2024-08-31T05:21:00.856 INFO:tasks.workunit.client.0.smithi067.stdout:8/65: write d0/d2/f3 [573816,55806] 0 2024-08-31T05:21:00.857 INFO:tasks.workunit.client.1.smithi073.stdout:6/306: creat d15/d1a/d2b/f63 x:0 0 0 2024-08-31T05:21:00.857 INFO:tasks.workunit.client.1.smithi073.stdout:3/387: fsync da/d18/f4d 0 2024-08-31T05:21:00.857 INFO:tasks.workunit.client.1.smithi073.stdout:0/366: creat d0/d15/d2c/d2e/d3d/f71 x:0 0 0 2024-08-31T05:21:00.859 INFO:tasks.workunit.client.1.smithi073.stdout:5/385: creat dc/d16/d3b/d3f/d4f/f8b x:0 0 0 2024-08-31T05:21:00.859 INFO:tasks.workunit.client.1.smithi073.stdout:8/402: dwrite d0/db/d1c/d34/d38/f4b [0,4194304] 0 2024-08-31T05:21:00.861 INFO:tasks.workunit.client.1.smithi073.stdout:2/372: read - d2/d9/d66/d70/f72 zero size 2024-08-31T05:21:00.862 INFO:tasks.workunit.client.1.smithi073.stdout:4/354: truncate d7/fc 3458129 0 2024-08-31T05:21:00.864 INFO:tasks.workunit.client.1.smithi073.stdout:3/388: unlink da/f3e 0 2024-08-31T05:21:00.866 INFO:tasks.workunit.client.1.smithi073.stdout:1/297: dwrite d5/f25 [0,4194304] 0 2024-08-31T05:21:00.867 INFO:tasks.workunit.client.1.smithi073.stdout:8/403: write d0/db/d1c/f20 [4152621,72597] 0 2024-08-31T05:21:00.868 INFO:tasks.workunit.client.1.smithi073.stdout:6/307: rename d15/d1a/d1e/f43 to d15/d1a/d2b/d2f/f64 0 2024-08-31T05:21:00.868 INFO:tasks.workunit.client.1.smithi073.stdout:2/373: unlink d2/f5a 0 2024-08-31T05:21:00.869 INFO:tasks.workunit.client.1.smithi073.stdout:4/355: write d7/df/f3f [1597924,84439] 0 2024-08-31T05:21:00.873 INFO:tasks.workunit.client.1.smithi073.stdout:4/356: stat d7/df/f21 0 2024-08-31T05:21:00.873 INFO:tasks.workunit.client.1.smithi073.stdout:1/298: creat d5/d10/d1c/f50 x:0 0 0 2024-08-31T05:21:00.876 INFO:tasks.workunit.client.1.smithi073.stdout:9/412: dwrite dc/de/d11/d41/f57 [0,4194304] 0 2024-08-31T05:21:00.880 INFO:tasks.workunit.client.1.smithi073.stdout:4/357: chown d7/df/l60 15073 1 2024-08-31T05:21:00.880 INFO:tasks.workunit.client.1.smithi073.stdout:2/374: creat d2/d9/f77 x:0 0 0 2024-08-31T05:21:00.885 INFO:tasks.workunit.client.1.smithi073.stdout:1/299: write d5/d10/d2e/f44 [640567,35908] 0 2024-08-31T05:21:00.886 INFO:tasks.workunit.client.1.smithi073.stdout:3/389: dwrite da/d68/f7e [0,4194304] 0 2024-08-31T05:21:00.890 INFO:tasks.workunit.client.1.smithi073.stdout:3/390: dread - da/d3c/d65/f5c zero size 2024-08-31T05:21:00.892 INFO:tasks.workunit.client.1.smithi073.stdout:8/404: dwrite d0/db/d1c/d34/d38/f64 [0,4194304] 0 2024-08-31T05:21:00.896 INFO:tasks.workunit.client.1.smithi073.stdout:0/367: dread d0/d15/d2c/d4d/d3c/f6 [0,4194304] 0 2024-08-31T05:21:00.897 INFO:tasks.workunit.client.1.smithi073.stdout:4/358: mknod d7/db/d11/d2c/c67 0 2024-08-31T05:21:00.898 INFO:tasks.workunit.client.1.smithi073.stdout:1/300: mkdir d5/d10/d1c/d27/d51 0 2024-08-31T05:21:00.900 INFO:tasks.workunit.client.1.smithi073.stdout:1/301: write d5/d17/d2a/f3b [644649,28106] 0 2024-08-31T05:21:00.901 INFO:tasks.workunit.client.1.smithi073.stdout:3/391: creat da/d68/f84 x:0 0 0 2024-08-31T05:21:00.902 INFO:tasks.workunit.client.1.smithi073.stdout:1/302: write d5/d10/d2e/f44 [220627,118503] 0 2024-08-31T05:21:00.903 INFO:tasks.workunit.client.1.smithi073.stdout:6/308: dread f14 [0,4194304] 0 2024-08-31T05:21:00.904 INFO:tasks.workunit.client.1.smithi073.stdout:9/413: unlink dc/d27/l3b 0 2024-08-31T05:21:00.907 INFO:tasks.workunit.client.1.smithi073.stdout:0/368: symlink d0/d15/d2c/l72 0 2024-08-31T05:21:00.909 INFO:tasks.workunit.client.1.smithi073.stdout:3/392: creat da/d18/f85 x:0 0 0 2024-08-31T05:21:00.910 INFO:tasks.workunit.client.1.smithi073.stdout:1/303: rename d5/d17/f43 to d5/d10/d1c/f52 0 2024-08-31T05:21:00.911 INFO:tasks.workunit.client.1.smithi073.stdout:6/309: stat d15/d17/d26/f34 0 2024-08-31T05:21:00.911 INFO:tasks.workunit.client.1.smithi073.stdout:1/304: chown d5/d10/d33/f36 243540701 1 2024-08-31T05:21:00.912 INFO:tasks.workunit.client.1.smithi073.stdout:8/405: rmdir d0/db/d44/d4e/d5f 0 2024-08-31T05:21:00.917 INFO:tasks.workunit.client.1.smithi073.stdout:9/414: rename dc/de/d56/d72 to dc/d37/d42/d5a/d89 0 2024-08-31T05:21:00.917 INFO:tasks.workunit.client.1.smithi073.stdout:9/415: chown dc/de/d11/d41/f74 178671 1 2024-08-31T05:21:00.918 INFO:tasks.workunit.client.1.smithi073.stdout:9/416: stat dc/d10/f49 0 2024-08-31T05:21:00.918 INFO:tasks.workunit.client.1.smithi073.stdout:2/375: write d2/d9/df/f3b [2694084,30904] 0 2024-08-31T05:21:00.918 INFO:tasks.workunit.client.1.smithi073.stdout:9/417: chown dc/f25 377594 1 2024-08-31T05:21:00.919 INFO:tasks.workunit.client.1.smithi073.stdout:8/406: mknod d0/db/d1c/d23/c81 0 2024-08-31T05:21:00.921 INFO:tasks.workunit.client.1.smithi073.stdout:0/369: truncate d0/f49 153299 0 2024-08-31T05:21:00.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:00 smithi073 ceph-mon[24726]: pgmap v21: 65 pgs: 65 active+clean; 582 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 8.3 MiB/s rd, 61 MiB/s wr, 313 op/s 2024-08-31T05:21:00.980 INFO:tasks.workunit.client.1.smithi073.stdout:3/393: mkdir da/d3c/d82/d86 0 2024-08-31T05:21:00.981 INFO:tasks.workunit.client.1.smithi073.stdout:9/418: creat dc/de/d11/d41/d52/d5b/f8a x:0 0 0 2024-08-31T05:21:00.983 INFO:tasks.workunit.client.1.smithi073.stdout:9/419: chown dc/d10/c68 111667 1 2024-08-31T05:21:00.985 INFO:tasks.workunit.client.1.smithi073.stdout:6/310: dwrite d15/d17/d26/f2c [0,4194304] 0 2024-08-31T05:21:00.988 INFO:tasks.workunit.client.1.smithi073.stdout:8/407: dwrite d0/f39 [4194304,4194304] 0 2024-08-31T05:21:00.990 INFO:tasks.workunit.client.1.smithi073.stdout:8/408: chown d0/db/d44/d4e/l61 103455 1 2024-08-31T05:21:01.017 INFO:tasks.workunit.client.1.smithi073.stdout:9/420: unlink dc/de/d11/d41/d52/d5f/c6a 0 2024-08-31T05:21:01.017 INFO:tasks.workunit.client.1.smithi073.stdout:8/409: symlink d0/db/d44/d4e/l82 0 2024-08-31T05:21:01.017 INFO:tasks.workunit.client.1.smithi073.stdout:3/394: dread da/f29 [0,4194304] 0 2024-08-31T05:21:01.017 INFO:tasks.workunit.client.1.smithi073.stdout:9/421: dwrite dc/de/d66/f83 [0,4194304] 0 2024-08-31T05:21:01.017 INFO:tasks.workunit.client.1.smithi073.stdout:3/395: readlink da/d3c/d65/d40/d5d/l77 0 2024-08-31T05:21:01.017 INFO:tasks.workunit.client.1.smithi073.stdout:0/370: rename d0/f49 to d0/d15/d2c/d41/f73 0 2024-08-31T05:21:01.017 INFO:tasks.workunit.client.1.smithi073.stdout:9/422: dread - dc/de/d11/d41/f74 zero size 2024-08-31T05:21:01.017 INFO:tasks.workunit.client.1.smithi073.stdout:9/423: write dc/d37/d42/f59 [62363,23598] 0 2024-08-31T05:21:01.018 INFO:tasks.workunit.client.1.smithi073.stdout:9/424: stat dc/d37/d42 0 2024-08-31T05:21:01.018 INFO:tasks.workunit.client.1.smithi073.stdout:6/311: creat d15/d17/f65 x:0 0 0 2024-08-31T05:21:01.018 INFO:tasks.workunit.client.1.smithi073.stdout:8/410: creat d0/db/d44/d72/d79/f83 x:0 0 0 2024-08-31T05:21:01.018 INFO:tasks.workunit.client.1.smithi073.stdout:8/411: truncate d0/db/d44/f77 4718922 0 2024-08-31T05:21:01.018 INFO:tasks.workunit.client.1.smithi073.stdout:0/371: creat d0/d15/d2c/d41/d52/f74 x:0 0 0 2024-08-31T05:21:01.019 INFO:tasks.workunit.client.1.smithi073.stdout:6/312: rename f14 to d15/d1a/d1e/f66 0 2024-08-31T05:21:01.019 INFO:tasks.workunit.client.1.smithi073.stdout:8/412: dwrite d0/f39 [0,4194304] 0 2024-08-31T05:21:01.019 INFO:tasks.workunit.client.1.smithi073.stdout:6/313: chown d15/d17/d26/d38/f62 14157 1 2024-08-31T05:21:01.019 INFO:tasks.workunit.client.1.smithi073.stdout:8/413: chown d0/db/f22 81335607 1 2024-08-31T05:21:01.019 INFO:tasks.workunit.client.1.smithi073.stdout:6/314: write d15/d17/f65 [414374,21313] 0 2024-08-31T05:21:01.020 INFO:tasks.workunit.client.1.smithi073.stdout:6/315: chown d15/d17/d26/d38/f40 22925878 1 2024-08-31T05:21:01.024 INFO:tasks.workunit.client.1.smithi073.stdout:8/414: creat d0/db/d44/f84 x:0 0 0 2024-08-31T05:21:01.027 INFO:tasks.workunit.client.1.smithi073.stdout:6/316: unlink d15/d17/d26/c2e 0 2024-08-31T05:21:01.030 INFO:tasks.workunit.client.1.smithi073.stdout:3/396: dread da/d18/f38 [0,4194304] 0 2024-08-31T05:21:01.031 INFO:tasks.workunit.client.1.smithi073.stdout:8/415: dwrite d0/f1a [4194304,4194304] 0 2024-08-31T05:21:01.032 INFO:tasks.workunit.client.1.smithi073.stdout:9/425: dread dc/d27/f2e [0,4194304] 0 2024-08-31T05:21:01.033 INFO:tasks.workunit.client.1.smithi073.stdout:9/426: dread - dc/f75 zero size 2024-08-31T05:21:01.033 INFO:tasks.workunit.client.1.smithi073.stdout:8/416: write d0/f5e [187903,91062] 0 2024-08-31T05:21:01.036 INFO:tasks.workunit.client.1.smithi073.stdout:6/317: dread d15/d1a/f20 [0,4194304] 0 2024-08-31T05:21:01.037 INFO:tasks.workunit.client.1.smithi073.stdout:3/397: mkdir da/d3c/d65/d87 0 2024-08-31T05:21:01.039 INFO:tasks.workunit.client.1.smithi073.stdout:0/372: dread d0/d15/d2c/d2e/d3d/f43 [0,4194304] 0 2024-08-31T05:21:01.039 INFO:tasks.workunit.client.1.smithi073.stdout:0/373: stat d0/d28/d4f/c5c 0 2024-08-31T05:21:01.040 INFO:tasks.workunit.client.1.smithi073.stdout:9/427: rename dc/de/d11/l7e to dc/d37/d42/l8b 0 2024-08-31T05:21:01.042 INFO:tasks.workunit.client.1.smithi073.stdout:3/398: mknod da/d3c/d65/d40/d5d/c88 0 2024-08-31T05:21:01.043 INFO:tasks.workunit.client.1.smithi073.stdout:0/374: chown d0/f1a 67237423 1 2024-08-31T05:21:01.044 INFO:tasks.workunit.client.1.smithi073.stdout:9/428: rename dc/de/d11/d41/l69 to dc/d10/l8c 0 2024-08-31T05:21:01.046 INFO:tasks.workunit.client.1.smithi073.stdout:3/399: creat da/d3c/d65/d40/d5d/f89 x:0 0 0 2024-08-31T05:21:01.046 INFO:tasks.workunit.client.1.smithi073.stdout:8/417: link d0/c11 d0/db/d1c/d2a/d58/c85 0 2024-08-31T05:21:01.047 INFO:tasks.workunit.client.1.smithi073.stdout:3/400: stat da/d3c/d65/d87 0 2024-08-31T05:21:01.048 INFO:tasks.workunit.client.1.smithi073.stdout:6/318: link d15/d1a/d1e/f25 d15/d17/d26/f67 0 2024-08-31T05:21:01.048 INFO:tasks.workunit.client.1.smithi073.stdout:3/401: write da/d3c/f5e [697581,92307] 0 2024-08-31T05:21:01.056 INFO:tasks.workunit.client.1.smithi073.stdout:6/319: mkdir d15/d68 0 2024-08-31T05:21:01.056 INFO:tasks.workunit.client.1.smithi073.stdout:0/375: dread d0/d15/d2c/d40/d4a/f4b [0,4194304] 0 2024-08-31T05:21:01.057 INFO:tasks.workunit.client.1.smithi073.stdout:0/376: fdatasync d0/d28/f30 0 2024-08-31T05:21:01.061 INFO:tasks.workunit.client.1.smithi073.stdout:9/429: rename dc/de/d11/d41 to dc/d37/d42/d8d 0 2024-08-31T05:21:01.061 INFO:tasks.workunit.client.1.smithi073.stdout:9/430: write dc/de/d66/f83 [1965231,107982] 0 2024-08-31T05:21:01.061 INFO:tasks.workunit.client.1.smithi073.stdout:4/359: sync 2024-08-31T05:21:01.061 INFO:tasks.workunit.client.1.smithi073.stdout:5/386: sync 2024-08-31T05:21:01.061 INFO:tasks.workunit.client.1.smithi073.stdout:7/374: sync 2024-08-31T05:21:01.061 INFO:tasks.workunit.client.1.smithi073.stdout:0/377: symlink d0/d15/d2c/d2e/d3d/l75 0 2024-08-31T05:21:01.062 INFO:tasks.workunit.client.1.smithi073.stdout:6/320: rename d15/d68 to d15/d1a/d1e/d69 0 2024-08-31T05:21:01.063 INFO:tasks.workunit.client.1.smithi073.stdout:6/321: chown d15/f46 664 1 2024-08-31T05:21:01.065 INFO:tasks.workunit.client.1.smithi073.stdout:9/431: dwrite dc/f3c [4194304,4194304] 0 2024-08-31T05:21:01.065 INFO:tasks.workunit.client.1.smithi073.stdout:3/402: write da/d68/f69 [177229,34319] 0 2024-08-31T05:21:01.067 INFO:tasks.workunit.client.1.smithi073.stdout:8/418: fsync d0/db/d44/f77 0 2024-08-31T05:21:01.067 INFO:tasks.workunit.client.1.smithi073.stdout:4/360: stat d7/df/l64 0 2024-08-31T05:21:01.069 INFO:tasks.workunit.client.1.smithi073.stdout:8/419: dread d0/db/d1c/d24/f78 [0,4194304] 0 2024-08-31T05:21:01.069 INFO:tasks.workunit.client.1.smithi073.stdout:5/387: symlink dc/d3d/d55/d84/d49/l8c 0 2024-08-31T05:21:01.070 INFO:tasks.workunit.client.1.smithi073.stdout:6/322: readlink d15/d1a/l1c 0 2024-08-31T05:21:01.071 INFO:tasks.workunit.client.1.smithi073.stdout:3/403: mkdir da/d3c/d5a/d8a 0 2024-08-31T05:21:01.071 INFO:tasks.workunit.client.1.smithi073.stdout:6/323: stat d15/d17/d26/d38/f3d 0 2024-08-31T05:21:01.071 INFO:tasks.workunit.client.1.smithi073.stdout:3/404: read da/f15 [33853,79154] 0 2024-08-31T05:21:01.072 INFO:tasks.workunit.client.1.smithi073.stdout:6/324: readlink d15/d1a/d2b/d2f/l4e 0 2024-08-31T05:21:01.072 INFO:tasks.workunit.client.1.smithi073.stdout:9/432: unlink dc/d37/d42/d8d/d52/d5f/c7c 0 2024-08-31T05:21:01.073 INFO:tasks.workunit.client.1.smithi073.stdout:9/433: chown dc/d37/f35 31536558 1 2024-08-31T05:21:01.074 INFO:tasks.workunit.client.1.smithi073.stdout:9/434: write dc/d10/f7b [1412645,101836] 0 2024-08-31T05:21:01.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:00 smithi067 ceph-mon[17432]: pgmap v21: 65 pgs: 65 active+clean; 582 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 8.3 MiB/s rd, 61 MiB/s wr, 313 op/s 2024-08-31T05:21:01.112 INFO:tasks.workunit.client.1.smithi073.stdout:4/361: rename d7/db/d11/d2c/l39 to d7/d5d/l68 0 2024-08-31T05:21:01.113 INFO:tasks.workunit.client.1.smithi073.stdout:5/388: write dc/d52/f58 [951125,130903] 0 2024-08-31T05:21:01.114 INFO:tasks.workunit.client.1.smithi073.stdout:7/375: getdents d1/d11/d14 0 2024-08-31T05:21:01.115 INFO:tasks.workunit.client.1.smithi073.stdout:0/378: rename d0/f27 to d0/f76 0 2024-08-31T05:21:01.116 INFO:tasks.workunit.client.1.smithi073.stdout:4/362: creat d7/db/f69 x:0 0 0 2024-08-31T05:21:01.117 INFO:tasks.workunit.client.1.smithi073.stdout:5/389: rmdir dc/d16/d3b 39 2024-08-31T05:21:01.117 INFO:tasks.workunit.client.1.smithi073.stdout:0/379: chown d0/d15/d2c/d4d/d3c/c51 1 1 2024-08-31T05:21:01.118 INFO:tasks.workunit.client.1.smithi073.stdout:4/363: write d7/db/f19 [1460293,39954] 0 2024-08-31T05:21:01.119 INFO:tasks.workunit.client.1.smithi073.stdout:0/380: fdatasync d0/f26 0 2024-08-31T05:21:01.119 INFO:tasks.workunit.client.1.smithi073.stdout:6/325: getdents d15/d41 0 2024-08-31T05:21:01.121 INFO:tasks.workunit.client.1.smithi073.stdout:6/326: read - d15/d17/f5c zero size 2024-08-31T05:21:01.124 INFO:tasks.workunit.client.1.smithi073.stdout:6/327: mkdir d15/d1a/d2b/d6a 0 2024-08-31T05:21:01.127 INFO:tasks.workunit.client.1.smithi073.stdout:3/405: dread da/f10 [0,4194304] 0 2024-08-31T05:21:01.128 INFO:tasks.workunit.client.1.smithi073.stdout:6/328: chown d15/d1a/d2b/d2f/c54 13 1 2024-08-31T05:21:01.128 INFO:tasks.workunit.client.1.smithi073.stdout:9/435: dread f5 [0,4194304] 0 2024-08-31T05:21:01.128 INFO:tasks.workunit.client.1.smithi073.stdout:5/390: dwrite dc/d3d/d55/d84/f41 [4194304,4194304] 0 2024-08-31T05:21:01.131 INFO:tasks.workunit.client.1.smithi073.stdout:5/391: dread - dc/d16/f7e zero size 2024-08-31T05:21:01.132 INFO:tasks.workunit.client.1.smithi073.stdout:3/406: truncate da/d3c/d67/f7c 806971 0 2024-08-31T05:21:01.134 INFO:tasks.workunit.client.1.smithi073.stdout:7/376: dread d1/da/d38/f4c [0,4194304] 0 2024-08-31T05:21:01.134 INFO:tasks.workunit.client.1.smithi073.stdout:3/407: fsync da/f2f 0 2024-08-31T05:21:01.134 INFO:tasks.workunit.client.1.smithi073.stdout:6/329: creat d15/d1a/d2b/d2f/d4b/f6b x:0 0 0 2024-08-31T05:21:01.136 INFO:tasks.workunit.client.1.smithi073.stdout:5/392: chown dc/d3d/d55/l78 90188 1 2024-08-31T05:21:01.137 INFO:tasks.workunit.client.1.smithi073.stdout:6/330: chown d15/d17/d26/d38/f40 3 1 2024-08-31T05:21:01.138 INFO:tasks.workunit.client.1.smithi073.stdout:7/377: creat d1/da/d15/d33/d44/f7c x:0 0 0 2024-08-31T05:21:01.139 INFO:tasks.workunit.client.1.smithi073.stdout:9/436: dread dc/de/f1e [0,4194304] 0 2024-08-31T05:21:01.139 INFO:tasks.workunit.client.1.smithi073.stdout:5/393: write dc/d52/f58 [1613998,104619] 0 2024-08-31T05:21:01.140 INFO:tasks.workunit.client.1.smithi073.stdout:4/364: dread d7/df/f3f [0,4194304] 0 2024-08-31T05:21:01.141 INFO:tasks.workunit.client.1.smithi073.stdout:9/437: write dc/f61 [1008164,75829] 0 2024-08-31T05:21:01.141 INFO:tasks.workunit.client.1.smithi073.stdout:5/394: chown dc/d53/f79 258774 1 2024-08-31T05:21:01.142 INFO:tasks.workunit.client.1.smithi073.stdout:6/331: truncate d15/d17/d26/d38/f3d 913794 0 2024-08-31T05:21:01.142 INFO:tasks.workunit.client.1.smithi073.stdout:7/378: creat d1/da/d15/d33/d44/d60/f7d x:0 0 0 2024-08-31T05:21:01.143 INFO:tasks.workunit.client.1.smithi073.stdout:6/332: stat d15/d1a/d2b/f63 0 2024-08-31T05:21:01.145 INFO:tasks.workunit.client.1.smithi073.stdout:4/365: unlink d7/d5d/l68 0 2024-08-31T05:21:01.146 INFO:tasks.workunit.client.1.smithi073.stdout:9/438: mknod dc/d82/c8e 0 2024-08-31T05:21:01.148 INFO:tasks.workunit.client.1.smithi073.stdout:5/395: mknod dc/d16/d3b/d3f/d4f/c8d 0 2024-08-31T05:21:01.149 INFO:tasks.workunit.client.1.smithi073.stdout:5/396: truncate dc/d16/f6f 513789 0 2024-08-31T05:21:01.150 INFO:tasks.workunit.client.1.smithi073.stdout:7/379: link d1/d11/f53 d1/da/d65/f7e 0 2024-08-31T05:21:01.151 INFO:tasks.workunit.client.1.smithi073.stdout:9/439: symlink dc/l8f 0 2024-08-31T05:21:01.151 INFO:tasks.workunit.client.1.smithi073.stdout:6/333: link d15/f29 d15/d1a/d2b/d2f/f6c 0 2024-08-31T05:21:01.152 INFO:tasks.workunit.client.1.smithi073.stdout:5/397: write dc/d16/d3b/f77 [4415727,18090] 0 2024-08-31T05:21:01.153 INFO:tasks.workunit.client.1.smithi073.stdout:5/398: fdatasync dc/d16/f54 0 2024-08-31T05:21:01.155 INFO:tasks.workunit.client.1.smithi073.stdout:4/366: dread d7/db/f4e [0,4194304] 0 2024-08-31T05:21:01.155 INFO:tasks.workunit.client.1.smithi073.stdout:3/408: dread da/d3c/d65/f20 [0,4194304] 0 2024-08-31T05:21:01.156 INFO:tasks.workunit.client.1.smithi073.stdout:5/399: creat dc/d16/d4e/f8e x:0 0 0 2024-08-31T05:21:01.156 INFO:tasks.workunit.client.1.smithi073.stdout:3/409: dread - da/f52 zero size 2024-08-31T05:21:01.157 INFO:tasks.workunit.client.1.smithi073.stdout:3/410: fdatasync da/d68/f6b 0 2024-08-31T05:21:01.158 INFO:tasks.workunit.client.1.smithi073.stdout:3/411: truncate da/d3c/f71 16332 0 2024-08-31T05:21:01.159 INFO:tasks.workunit.client.1.smithi073.stdout:3/412: write da/f12 [87183,80436] 0 2024-08-31T05:21:01.159 INFO:tasks.workunit.client.1.smithi073.stdout:4/367: unlink d7/df/d13/f28 0 2024-08-31T05:21:01.159 INFO:tasks.workunit.client.1.smithi073.stdout:3/413: chown da/f61 3748 1 2024-08-31T05:21:01.161 INFO:tasks.workunit.client.1.smithi073.stdout:5/400: creat dc/d3d/d55/d84/d49/f8f x:0 0 0 2024-08-31T05:21:01.162 INFO:tasks.workunit.client.1.smithi073.stdout:5/401: truncate dc/d3d/f4c 1177069 0 2024-08-31T05:21:01.163 INFO:tasks.workunit.client.1.smithi073.stdout:1/305: sync 2024-08-31T05:21:01.163 INFO:tasks.workunit.client.1.smithi073.stdout:2/376: sync 2024-08-31T05:21:01.163 INFO:tasks.workunit.client.1.smithi073.stdout:4/368: symlink d7/d1a/d5c/l6a 0 2024-08-31T05:21:01.164 INFO:tasks.workunit.client.1.smithi073.stdout:7/380: write d1/da/d3e/d22/d47/f68 [958091,78295] 0 2024-08-31T05:21:01.164 INFO:tasks.workunit.client.1.smithi073.stdout:5/402: symlink dc/d3d/d55/l90 0 2024-08-31T05:21:01.165 INFO:tasks.workunit.client.1.smithi073.stdout:2/377: dread - d2/d9/f77 zero size 2024-08-31T05:21:01.167 INFO:tasks.workunit.client.1.smithi073.stdout:3/414: unlink da/d3c/d65/d2c/l3f 0 2024-08-31T05:21:01.169 INFO:tasks.workunit.client.1.smithi073.stdout:3/415: chown da/d3c/l3d 2 1 2024-08-31T05:21:01.170 INFO:tasks.workunit.client.1.smithi073.stdout:7/381: unlink d1/d11/d14/f5f 0 2024-08-31T05:21:01.170 INFO:tasks.workunit.client.1.smithi073.stdout:9/440: dwrite dc/d37/d42/f64 [0,4194304] 0 2024-08-31T05:21:01.173 INFO:tasks.workunit.client.1.smithi073.stdout:5/403: creat dc/d16/d1a/d87/f91 x:0 0 0 2024-08-31T05:21:01.173 INFO:tasks.workunit.client.1.smithi073.stdout:9/441: truncate dc/de/d11/f7a 1015906 0 2024-08-31T05:21:01.176 INFO:tasks.workunit.client.1.smithi073.stdout:9/442: rmdir dc/d37/d42/d8d/d52 39 2024-08-31T05:21:01.178 INFO:tasks.workunit.client.1.smithi073.stdout:3/416: dread da/d68/f69 [0,4194304] 0 2024-08-31T05:21:01.179 INFO:tasks.workunit.client.1.smithi073.stdout:4/369: dwrite d7/df/d13/d2e/f48 [4194304,4194304] 0 2024-08-31T05:21:01.180 INFO:tasks.workunit.client.1.smithi073.stdout:1/306: rename d5/d10/d1c/d27/c42 to d5/d17/d32/d37/c53 0 2024-08-31T05:21:01.180 INFO:tasks.workunit.client.1.smithi073.stdout:2/378: dwrite d2/d9/d3c/f46 [0,4194304] 0 2024-08-31T05:21:01.183 INFO:tasks.workunit.client.1.smithi073.stdout:9/443: creat dc/de/d66/d84/f90 x:0 0 0 2024-08-31T05:21:01.186 INFO:tasks.workunit.client.1.smithi073.stdout:2/379: truncate d2/d9/d66/d70/f74 118981 0 2024-08-31T05:21:01.187 INFO:tasks.workunit.client.1.smithi073.stdout:7/382: creat d1/d11/f7f x:0 0 0 2024-08-31T05:21:01.187 INFO:tasks.workunit.client.1.smithi073.stdout:1/307: mkdir d5/d26/d54 0 2024-08-31T05:21:01.188 INFO:tasks.workunit.client.1.smithi073.stdout:5/404: dwrite dc/f48 [0,4194304] 0 2024-08-31T05:21:01.192 INFO:tasks.workunit.client.1.smithi073.stdout:5/405: stat dc/d16/d1a/l3a 0 2024-08-31T05:21:01.194 INFO:tasks.workunit.client.1.smithi073.stdout:3/417: dwrite da/d3c/d65/d45/f55 [0,4194304] 0 2024-08-31T05:21:01.198 INFO:tasks.workunit.client.1.smithi073.stdout:3/418: dread - da/d3c/d65/f5c zero size 2024-08-31T05:21:01.198 INFO:tasks.workunit.client.1.smithi073.stdout:9/444: dread dc/de/d66/f67 [0,4194304] 0 2024-08-31T05:21:01.200 INFO:tasks.workunit.client.1.smithi073.stdout:5/406: mknod dc/d16/d3b/d7f/c92 0 2024-08-31T05:21:01.201 INFO:tasks.workunit.client.1.smithi073.stdout:2/380: dread d2/d9/d3c/f46 [0,4194304] 0 2024-08-31T05:21:01.203 INFO:tasks.workunit.client.1.smithi073.stdout:3/419: truncate da/d18/f38 5040047 0 2024-08-31T05:21:01.203 INFO:tasks.workunit.client.1.smithi073.stdout:9/445: unlink dc/c12 0 2024-08-31T05:21:01.204 INFO:tasks.workunit.client.1.smithi073.stdout:3/420: read da/d18/f38 [599505,385] 0 2024-08-31T05:21:01.205 INFO:tasks.workunit.client.1.smithi073.stdout:9/446: fsync dc/d37/d42/d8d/f4b 0 2024-08-31T05:21:01.206 INFO:tasks.workunit.client.1.smithi073.stdout:7/383: dread d1/f43 [0,4194304] 0 2024-08-31T05:21:01.208 INFO:tasks.workunit.client.1.smithi073.stdout:2/381: getdents d2 0 2024-08-31T05:21:01.210 INFO:tasks.workunit.client.1.smithi073.stdout:9/447: write dc/d37/d42/d8d/d52/d5b/f80 [437615,17203] 0 2024-08-31T05:21:01.212 INFO:tasks.workunit.client.1.smithi073.stdout:9/448: chown dc/d10/f4c 0 1 2024-08-31T05:21:01.213 INFO:tasks.workunit.client.1.smithi073.stdout:3/421: dwrite da/d68/f84 [0,4194304] 0 2024-08-31T05:21:01.214 INFO:tasks.workunit.client.1.smithi073.stdout:7/384: truncate d1/da/d15/d33/f50 874769 0 2024-08-31T05:21:01.216 INFO:tasks.workunit.client.1.smithi073.stdout:4/370: truncate d7/db/d11/f58 1774325 0 2024-08-31T05:21:01.227 INFO:tasks.workunit.client.1.smithi073.stdout:3/422: dwrite da/f15 [0,4194304] 0 2024-08-31T05:21:01.228 INFO:tasks.workunit.client.1.smithi073.stdout:9/449: dwrite dc/d37/d42/d8d/f39 [0,4194304] 0 2024-08-31T05:21:01.231 INFO:tasks.workunit.client.1.smithi073.stdout:7/385: truncate d1/da/d3e/d22/d47/f79 3991730 0 2024-08-31T05:21:01.235 INFO:tasks.workunit.client.1.smithi073.stdout:1/308: dread d5/f9 [0,4194304] 0 2024-08-31T05:21:01.238 INFO:tasks.workunit.client.1.smithi073.stdout:5/407: dread dc/d16/d3b/f77 [0,4194304] 0 2024-08-31T05:21:01.239 INFO:tasks.workunit.client.1.smithi073.stdout:4/371: dwrite d7/df/f25 [0,4194304] 0 2024-08-31T05:21:01.239 INFO:tasks.workunit.client.1.smithi073.stdout:1/309: fsync d5/d17/d32/d37/f3c 0 2024-08-31T05:21:01.239 INFO:tasks.workunit.client.1.smithi073.stdout:9/450: creat dc/d37/d42/d8d/d52/d5f/f91 x:0 0 0 2024-08-31T05:21:01.242 INFO:tasks.workunit.client.1.smithi073.stdout:2/382: dread d2/d9/df/f2e [0,4194304] 0 2024-08-31T05:21:01.243 INFO:tasks.workunit.client.1.smithi073.stdout:9/451: rmdir dc/de 39 2024-08-31T05:21:01.243 INFO:tasks.workunit.client.1.smithi073.stdout:5/408: mknod dc/d3d/d55/d84/d49/c93 0 2024-08-31T05:21:01.245 INFO:tasks.workunit.client.1.smithi073.stdout:7/386: rename d1/da/d3e/d22/d35/c4a to d1/da/d3e/d22/d5c/c80 0 2024-08-31T05:21:01.246 INFO:tasks.workunit.client.1.smithi073.stdout:1/310: mkdir d5/d26/d54/d55 0 2024-08-31T05:21:01.247 INFO:tasks.workunit.client.1.smithi073.stdout:2/383: symlink d2/d9/d66/l78 0 2024-08-31T05:21:01.248 INFO:tasks.workunit.client.1.smithi073.stdout:1/311: fsync d5/d10/d1b/f41 0 2024-08-31T05:21:01.249 INFO:tasks.workunit.client.1.smithi073.stdout:5/409: mkdir dc/d16/d1a/d87/d94 0 2024-08-31T05:21:01.251 INFO:tasks.workunit.client.1.smithi073.stdout:1/312: fdatasync d5/d17/d32/f3d 0 2024-08-31T05:21:01.253 INFO:tasks.workunit.client.1.smithi073.stdout:7/387: dwrite d1/d11/d14/f3c [0,4194304] 0 2024-08-31T05:21:01.256 INFO:tasks.workunit.client.1.smithi073.stdout:1/313: creat d5/d10/d33/f56 x:0 0 0 2024-08-31T05:21:01.258 INFO:tasks.workunit.client.1.smithi073.stdout:7/388: creat d1/da/d3e/d22/d6b/f81 x:0 0 0 2024-08-31T05:21:01.258 INFO:tasks.workunit.client.1.smithi073.stdout:9/452: dwrite dc/de/f1e [4194304,4194304] 0 2024-08-31T05:21:01.261 INFO:tasks.workunit.client.1.smithi073.stdout:9/453: write dc/d37/d42/d8d/f50 [2043050,47834] 0 2024-08-31T05:21:01.264 INFO:tasks.workunit.client.1.smithi073.stdout:1/314: creat d5/d17/f57 x:0 0 0 2024-08-31T05:21:01.264 INFO:tasks.workunit.client.1.smithi073.stdout:7/389: symlink d1/da/d3e/d22/d47/l82 0 2024-08-31T05:21:01.266 INFO:tasks.workunit.client.1.smithi073.stdout:1/315: creat d5/d26/f58 x:0 0 0 2024-08-31T05:21:01.267 INFO:tasks.workunit.client.1.smithi073.stdout:4/372: fsync d7/df/f25 0 2024-08-31T05:21:01.269 INFO:tasks.workunit.client.1.smithi073.stdout:5/410: dread dc/f17 [0,4194304] 0 2024-08-31T05:21:01.272 INFO:tasks.workunit.client.1.smithi073.stdout:4/373: fdatasync d7/df/d13/f44 0 2024-08-31T05:21:01.272 INFO:tasks.workunit.client.1.smithi073.stdout:1/316: readlink d5/d17/d2a/l48 0 2024-08-31T05:21:01.273 INFO:tasks.workunit.client.1.smithi073.stdout:9/454: dread dc/de/d66/f67 [0,4194304] 0 2024-08-31T05:21:01.274 INFO:tasks.workunit.client.1.smithi073.stdout:2/384: dread d2/d9/df/f1f [0,4194304] 0 2024-08-31T05:21:01.274 INFO:tasks.workunit.client.1.smithi073.stdout:1/317: mknod d5/d10/d33/d13/c59 0 2024-08-31T05:21:01.275 INFO:tasks.workunit.client.1.smithi073.stdout:7/390: getdents d1/da/d65 0 2024-08-31T05:21:01.276 INFO:tasks.workunit.client.1.smithi073.stdout:5/411: creat dc/d16/f95 x:0 0 0 2024-08-31T05:21:01.288 INFO:tasks.workunit.client.1.smithi073.stdout:8/420: sync 2024-08-31T05:21:01.288 INFO:tasks.workunit.client.1.smithi073.stdout:0/381: sync 2024-08-31T05:21:01.318 INFO:tasks.workunit.client.1.smithi073.stdout:4/374: rename d7/d24 to d7/d5d/d6b 0 2024-08-31T05:21:01.318 INFO:tasks.workunit.client.1.smithi073.stdout:7/391: mkdir d1/da/d3e/d22/d35/d83 0 2024-08-31T05:21:01.320 INFO:tasks.workunit.client.1.smithi073.stdout:5/412: stat dc/d16/d1a/l35 0 2024-08-31T05:21:01.320 INFO:tasks.workunit.client.1.smithi073.stdout:3/423: dread da/fb [4194304,4194304] 0 2024-08-31T05:21:01.321 INFO:tasks.workunit.client.1.smithi073.stdout:9/455: rename dc/d37/d42/c58 to dc/d10/c92 0 2024-08-31T05:21:01.321 INFO:tasks.workunit.client.1.smithi073.stdout:5/413: fsync dc/f48 0 2024-08-31T05:21:01.324 INFO:tasks.workunit.client.1.smithi073.stdout:1/318: dwrite d5/d10/d2e/f44 [0,4194304] 0 2024-08-31T05:21:01.325 INFO:tasks.workunit.client.1.smithi073.stdout:8/421: mknod d0/db/d1c/d24/c86 0 2024-08-31T05:21:01.325 INFO:tasks.workunit.client.1.smithi073.stdout:1/319: dread - d5/d17/f57 zero size 2024-08-31T05:21:01.327 INFO:tasks.workunit.client.1.smithi073.stdout:7/392: dread d1/d11/d14/f3c [0,4194304] 0 2024-08-31T05:21:01.327 INFO:tasks.workunit.client.1.smithi073.stdout:8/422: read d0/db/d44/d4e/f5c [3558927,21563] 0 2024-08-31T05:21:01.327 INFO:tasks.workunit.client.1.smithi073.stdout:0/382: rename d0/d15/d2c/d2e/f46 to d0/d58/f77 0 2024-08-31T05:21:01.328 INFO:tasks.workunit.client.1.smithi073.stdout:0/383: chown d0/f76 2421 1 2024-08-31T05:21:01.328 INFO:tasks.workunit.client.1.smithi073.stdout:3/424: unlink da/d3c/l3d 0 2024-08-31T05:21:01.329 INFO:tasks.workunit.client.1.smithi073.stdout:3/425: readlink da/d3c/d65/d45/l74 0 2024-08-31T05:21:01.329 INFO:tasks.workunit.client.1.smithi073.stdout:0/384: write d0/d15/d2c/d4d/d3c/f1f [1342636,7667] 0 2024-08-31T05:21:01.330 INFO:tasks.workunit.client.1.smithi073.stdout:0/385: chown d0/f1a 2929 1 2024-08-31T05:21:01.330 INFO:tasks.workunit.client.1.smithi073.stdout:3/426: write da/d18/f2a [186878,75068] 0 2024-08-31T05:21:01.330 INFO:tasks.workunit.client.1.smithi073.stdout:9/456: fsync dc/d37/d42/d8d/f74 0 2024-08-31T05:21:01.331 INFO:tasks.workunit.client.1.smithi073.stdout:9/457: readlink dc/l8f 0 2024-08-31T05:21:01.332 INFO:tasks.workunit.client.1.smithi073.stdout:4/375: readlink d7/df/d1b/d34/l3b 0 2024-08-31T05:21:01.332 INFO:tasks.workunit.client.1.smithi073.stdout:9/458: chown dc/de/l2b 417438 1 2024-08-31T05:21:01.334 INFO:tasks.workunit.client.1.smithi073.stdout:8/423: symlink d0/db/l87 0 2024-08-31T05:21:01.335 INFO:tasks.workunit.client.1.smithi073.stdout:8/424: write d0/db/d44/f4d [175553,30267] 0 2024-08-31T05:21:01.336 INFO:tasks.workunit.client.1.smithi073.stdout:3/427: write da/f14 [2307665,47383] 0 2024-08-31T05:21:01.336 INFO:tasks.workunit.client.1.smithi073.stdout:8/425: stat d0/c52 0 2024-08-31T05:21:01.340 INFO:tasks.workunit.client.1.smithi073.stdout:4/376: creat d7/d5d/f6c x:0 0 0 2024-08-31T05:21:01.341 INFO:tasks.workunit.client.1.smithi073.stdout:5/414: getdents dc/d16/d3b/d7f 0 2024-08-31T05:21:01.343 INFO:tasks.workunit.client.1.smithi073.stdout:5/415: rmdir dc/d53 39 2024-08-31T05:21:01.345 INFO:tasks.workunit.client.1.smithi073.stdout:0/386: dwrite d0/d15/d2c/d4d/f54 [0,4194304] 0 2024-08-31T05:21:01.347 INFO:tasks.workunit.client.1.smithi073.stdout:5/416: chown dc/d3d/d55/d84/d49/f71 477083 1 2024-08-31T05:21:01.348 INFO:tasks.workunit.client.1.smithi073.stdout:8/426: dwrite d0/db/d1c/d23/f41 [0,4194304] 0 2024-08-31T05:21:01.348 INFO:tasks.workunit.client.1.smithi073.stdout:0/387: stat d0/d15/d2c/d4d/d3c/c51 0 2024-08-31T05:21:01.349 INFO:tasks.workunit.client.1.smithi073.stdout:4/377: rename d7/db/d11 to d7/d1a/d5c/d6d 0 2024-08-31T05:21:01.349 INFO:tasks.workunit.client.1.smithi073.stdout:9/459: dread dc/d37/f6d [0,4194304] 0 2024-08-31T05:21:01.350 INFO:tasks.workunit.client.1.smithi073.stdout:8/427: write d0/f39 [1161485,7190] 0 2024-08-31T05:21:01.352 INFO:tasks.workunit.client.1.smithi073.stdout:0/388: creat d0/d15/d2c/d2e/d3d/f78 x:0 0 0 2024-08-31T05:21:01.353 INFO:tasks.workunit.client.1.smithi073.stdout:4/378: creat d7/d1a/d5c/d6d/f6e x:0 0 0 2024-08-31T05:21:01.355 INFO:tasks.workunit.client.1.smithi073.stdout:9/460: getdents dc/d10 0 2024-08-31T05:21:01.356 INFO:tasks.workunit.client.1.smithi073.stdout:0/389: fsync d0/d15/d2c/d4d/d3c/ff 0 2024-08-31T05:21:01.358 INFO:tasks.workunit.client.1.smithi073.stdout:8/428: getdents d0/db/d1c 0 2024-08-31T05:21:01.359 INFO:tasks.workunit.client.1.smithi073.stdout:5/417: dwrite dc/d16/d3b/f74 [0,4194304] 0 2024-08-31T05:21:01.360 INFO:tasks.workunit.client.1.smithi073.stdout:9/461: write dc/d37/d42/d8d/d52/d5f/f91 [902586,61224] 0 2024-08-31T05:21:01.361 INFO:tasks.workunit.client.1.smithi073.stdout:9/462: readlink dc/d37/l7f 0 2024-08-31T05:21:01.361 INFO:tasks.workunit.client.1.smithi073.stdout:8/429: mknod d0/db/c88 0 2024-08-31T05:21:01.364 INFO:tasks.workunit.client.1.smithi073.stdout:8/430: rmdir d0 39 2024-08-31T05:21:01.365 INFO:tasks.workunit.client.1.smithi073.stdout:5/418: truncate dc/d16/d3b/d3f/d4f/f6c 1036708 0 2024-08-31T05:21:01.366 INFO:tasks.workunit.client.1.smithi073.stdout:4/379: dread d7/d1a/d5c/f66 [0,4194304] 0 2024-08-31T05:21:01.368 INFO:tasks.workunit.client.1.smithi073.stdout:8/431: dread - d0/db/d44/d72/d79/f7f zero size 2024-08-31T05:21:01.369 INFO:tasks.workunit.client.1.smithi073.stdout:5/419: creat dc/d16/f96 x:0 0 0 2024-08-31T05:21:01.370 INFO:tasks.workunit.client.1.smithi073.stdout:8/432: chown d0/db/d1c/d24/f48 719284400 1 2024-08-31T05:21:01.370 INFO:tasks.workunit.client.1.smithi073.stdout:0/390: dwrite d0/d15/d2c/d4d/d3c/f6 [0,4194304] 0 2024-08-31T05:21:01.371 INFO:tasks.workunit.client.1.smithi073.stdout:8/433: read - d0/db/d1c/d24/f48 zero size 2024-08-31T05:21:01.371 INFO:tasks.workunit.client.1.smithi073.stdout:0/391: fdatasync d0/f1a 0 2024-08-31T05:21:01.373 INFO:tasks.workunit.client.1.smithi073.stdout:0/392: read d0/d15/d2c/d4d/d3c/f6 [348047,35347] 0 2024-08-31T05:21:01.374 INFO:tasks.workunit.client.1.smithi073.stdout:8/434: link d0/db/d1c/f1f d0/db/d1c/d2a/f89 0 2024-08-31T05:21:01.375 INFO:tasks.workunit.client.1.smithi073.stdout:0/393: unlink d0/f32 0 2024-08-31T05:21:01.376 INFO:tasks.workunit.client.1.smithi073.stdout:8/435: creat d0/db/d1c/d34/d68/f8a x:0 0 0 2024-08-31T05:21:01.376 INFO:tasks.workunit.client.1.smithi073.stdout:0/394: write d0/d15/d2c/d2e/f38 [4307780,15100] 0 2024-08-31T05:21:01.388 INFO:tasks.workunit.client.1.smithi073.stdout:0/395: dread d0/f26 [0,4194304] 0 2024-08-31T05:21:01.390 INFO:tasks.workunit.client.1.smithi073.stdout:0/396: mknod d0/d15/d2c/d4d/c79 0 2024-08-31T05:21:01.423 INFO:tasks.workunit.client.1.smithi073.stdout:6/334: sync 2024-08-31T05:21:01.435 INFO:tasks.workunit.client.1.smithi073.stdout:4/380: read d7/f46 [369800,43153] 0 2024-08-31T05:21:01.438 INFO:tasks.workunit.client.1.smithi073.stdout:0/397: creat d0/f7a x:0 0 0 2024-08-31T05:21:01.440 INFO:tasks.workunit.client.1.smithi073.stdout:0/398: mknod d0/d15/d2c/d4d/d3c/c7b 0 2024-08-31T05:21:01.441 INFO:tasks.workunit.client.1.smithi073.stdout:4/381: dwrite d7/db/f4f [0,4194304] 0 2024-08-31T05:21:01.445 INFO:tasks.workunit.client.1.smithi073.stdout:0/399: rename d0/d15/d2c/d2e/d3d/c4e to d0/d15/d2c/d2e/d3d/c7c 0 2024-08-31T05:21:01.450 INFO:tasks.workunit.client.1.smithi073.stdout:0/400: creat d0/d58/d63/f7d x:0 0 0 2024-08-31T05:21:01.452 INFO:tasks.workunit.client.1.smithi073.stdout:0/401: rmdir d0/d15/d2c/d41 39 2024-08-31T05:21:01.453 INFO:tasks.workunit.client.1.smithi073.stdout:7/393: dread d1/d11/d14/f29 [0,4194304] 0 2024-08-31T05:21:01.453 INFO:tasks.workunit.client.1.smithi073.stdout:0/402: creat d0/d58/d63/f7e x:0 0 0 2024-08-31T05:21:01.459 INFO:tasks.workunit.client.1.smithi073.stdout:0/403: getdents d0/d28/d4f 0 2024-08-31T05:21:01.460 INFO:tasks.workunit.client.1.smithi073.stdout:8/436: truncate d0/f5 2264060 0 2024-08-31T05:21:01.461 INFO:tasks.workunit.client.1.smithi073.stdout:8/437: write d0/db/d1c/d34/d38/f5b [1440033,69112] 0 2024-08-31T05:21:01.463 INFO:tasks.workunit.client.1.smithi073.stdout:8/438: write d0/db/d44/f84 [675112,38373] 0 2024-08-31T05:21:01.469 INFO:tasks.workunit.client.1.smithi073.stdout:4/382: write d7/db/f4e [3643504,82220] 0 2024-08-31T05:21:01.469 INFO:tasks.workunit.client.1.smithi073.stdout:9/463: dread f9 [0,4194304] 0 2024-08-31T05:21:01.469 INFO:tasks.workunit.client.1.smithi073.stdout:0/404: rename d0/d15/d2c/d2e/d3d to d0/d69/d7f 0 2024-08-31T05:21:01.469 INFO:tasks.workunit.client.1.smithi073.stdout:8/439: read d0/db/d44/d4e/f5c [2642758,115694] 0 2024-08-31T05:21:01.469 INFO:tasks.workunit.client.1.smithi073.stdout:7/394: write d1/da/d3e/d22/f27 [399264,60282] 0 2024-08-31T05:21:01.470 INFO:tasks.workunit.client.1.smithi073.stdout:8/440: chown d0/d62 1 1 2024-08-31T05:21:01.471 INFO:tasks.workunit.client.1.smithi073.stdout:6/335: dwrite d15/f29 [0,4194304] 0 2024-08-31T05:21:01.472 INFO:tasks.workunit.client.1.smithi073.stdout:9/464: symlink dc/d37/d42/d8d/d52/d5f/l93 0 2024-08-31T05:21:01.472 INFO:tasks.workunit.client.1.smithi073.stdout:6/336: stat d15/d17/f5e 0 2024-08-31T05:21:01.472 INFO:tasks.workunit.client.1.smithi073.stdout:8/441: readlink d0/db/d44/l59 0 2024-08-31T05:21:01.473 INFO:tasks.workunit.client.1.smithi073.stdout:6/337: stat d15/f19 0 2024-08-31T05:21:01.475 INFO:tasks.workunit.client.1.smithi073.stdout:6/338: chown d15/d17/d26/f2c 9849 1 2024-08-31T05:21:01.476 INFO:tasks.workunit.client.1.smithi073.stdout:9/465: creat dc/d37/d42/f94 x:0 0 0 2024-08-31T05:21:01.477 INFO:tasks.workunit.client.1.smithi073.stdout:8/442: read d0/db/d1c/d34/d38/f43 [3913709,44666] 0 2024-08-31T05:21:01.478 INFO:tasks.workunit.client.1.smithi073.stdout:0/405: getdents d0/d69/d7f/d68 0 2024-08-31T05:21:01.479 INFO:tasks.workunit.client.1.smithi073.stdout:6/339: rmdir d15/d1a/d1e 39 2024-08-31T05:21:01.482 INFO:tasks.workunit.client.1.smithi073.stdout:4/383: dread d7/d1a/d5c/d6d/f58 [0,4194304] 0 2024-08-31T05:21:01.483 INFO:tasks.workunit.client.1.smithi073.stdout:0/406: creat d0/d28/f80 x:0 0 0 2024-08-31T05:21:01.484 INFO:tasks.workunit.client.1.smithi073.stdout:6/340: mknod d15/d1a/d2b/c6d 0 2024-08-31T05:21:01.485 INFO:tasks.workunit.client.1.smithi073.stdout:9/466: mknod dc/c95 0 2024-08-31T05:21:01.486 INFO:tasks.workunit.client.1.smithi073.stdout:4/384: chown d7/df/l63 0 1 2024-08-31T05:21:01.490 INFO:tasks.workunit.client.1.smithi073.stdout:8/443: getdents d0 0 2024-08-31T05:21:01.493 INFO:tasks.workunit.client.1.smithi073.stdout:0/407: dwrite d0/d15/d2c/d4d/d3c/fa [0,4194304] 0 2024-08-31T05:21:01.495 INFO:tasks.workunit.client.1.smithi073.stdout:7/395: dread d1/da/f26 [0,4194304] 0 2024-08-31T05:21:01.495 INFO:tasks.workunit.client.1.smithi073.stdout:6/341: dwrite d15/d17/d26/d38/f3d [0,4194304] 0 2024-08-31T05:21:01.496 INFO:tasks.workunit.client.1.smithi073.stdout:0/408: chown d0/f5b 100 1 2024-08-31T05:21:01.497 INFO:tasks.workunit.client.1.smithi073.stdout:4/385: truncate d7/df/d13/d2e/f3a 3470540 0 2024-08-31T05:21:01.498 INFO:tasks.workunit.client.1.smithi073.stdout:9/467: dwrite dc/de/d66/f67 [0,4194304] 0 2024-08-31T05:21:01.498 INFO:tasks.workunit.client.1.smithi073.stdout:4/386: readlink d7/df/l63 0 2024-08-31T05:21:01.499 INFO:tasks.workunit.client.1.smithi073.stdout:0/409: fsync d0/d15/d2c/d4d/d3c/ff 0 2024-08-31T05:21:01.507 INFO:tasks.workunit.client.1.smithi073.stdout:8/444: dwrite d0/f17 [0,4194304] 0 2024-08-31T05:21:01.509 INFO:tasks.workunit.client.1.smithi073.stdout:0/410: rename d0/d69/d7f/f43 to d0/d69/d7f/d68/f81 0 2024-08-31T05:21:01.510 INFO:tasks.workunit.client.1.smithi073.stdout:4/387: dwrite d7/df/f3f [0,4194304] 0 2024-08-31T05:21:01.512 INFO:tasks.workunit.client.1.smithi073.stdout:8/445: creat d0/db/d1c/d34/d38/f8b x:0 0 0 2024-08-31T05:21:01.513 INFO:tasks.workunit.client.1.smithi073.stdout:0/411: write d0/f76 [4558356,1754] 0 2024-08-31T05:21:01.516 INFO:tasks.workunit.client.1.smithi073.stdout:8/446: mknod d0/db/d1c/d34/c8c 0 2024-08-31T05:21:01.517 INFO:tasks.workunit.client.1.smithi073.stdout:9/468: write dc/d10/f18 [2615450,90493] 0 2024-08-31T05:21:01.517 INFO:tasks.workunit.client.1.smithi073.stdout:0/412: dread - d0/d69/d7f/f78 zero size 2024-08-31T05:21:01.517 INFO:tasks.workunit.client.1.smithi073.stdout:6/342: truncate fa 1109797 0 2024-08-31T05:21:01.519 INFO:tasks.workunit.client.1.smithi073.stdout:8/447: dread - d0/db/d1c/d24/f6b zero size 2024-08-31T05:21:01.521 INFO:tasks.workunit.client.1.smithi073.stdout:0/413: write d0/d15/d2c/d40/f47 [1432126,53983] 0 2024-08-31T05:21:01.522 INFO:tasks.workunit.client.1.smithi073.stdout:6/343: dread - d15/d17/d26/d38/f40 zero size 2024-08-31T05:21:01.523 INFO:tasks.workunit.client.1.smithi073.stdout:4/388: dwrite d7/df/d1b/d34/f5f [0,4194304] 0 2024-08-31T05:21:01.524 INFO:tasks.workunit.client.1.smithi073.stdout:8/448: creat d0/d62/f8d x:0 0 0 2024-08-31T05:21:01.525 INFO:tasks.workunit.client.1.smithi073.stdout:9/469: read dc/de/d56/f7d [1385292,100541] 0 2024-08-31T05:21:01.531 INFO:tasks.workunit.client.1.smithi073.stdout:9/470: symlink dc/d37/d42/d8d/d52/l96 0 2024-08-31T05:21:01.531 INFO:tasks.workunit.client.1.smithi073.stdout:8/449: unlink d0/db/d1c/d2a/d58/c85 0 2024-08-31T05:21:01.532 INFO:tasks.workunit.client.1.smithi073.stdout:0/414: dwrite d0/d15/d2c/d40/f5a [4194304,4194304] 0 2024-08-31T05:21:01.532 INFO:tasks.workunit.client.1.smithi073.stdout:9/471: stat dc/d37/d42/d8d/c40 0 2024-08-31T05:21:01.534 INFO:tasks.workunit.client.1.smithi073.stdout:9/472: mkdir dc/d82/d97 0 2024-08-31T05:21:01.535 INFO:tasks.workunit.client.1.smithi073.stdout:8/450: dread d0/f5e [0,4194304] 0 2024-08-31T05:21:01.536 INFO:tasks.workunit.client.1.smithi073.stdout:0/415: creat d0/d15/f82 x:0 0 0 2024-08-31T05:21:01.539 INFO:tasks.workunit.client.1.smithi073.stdout:8/451: getdents d0/db/d1c/d34/d80 0 2024-08-31T05:21:01.540 INFO:tasks.workunit.client.1.smithi073.stdout:8/452: chown d0/f27 2563440 1 2024-08-31T05:21:01.541 INFO:tasks.workunit.client.1.smithi073.stdout:9/473: read dc/d37/d42/d8d/d52/d5f/f71 [247932,28137] 0 2024-08-31T05:21:01.542 INFO:tasks.workunit.client.1.smithi073.stdout:9/474: fsync dc/d37/d42/d8d/f39 0 2024-08-31T05:21:01.543 INFO:tasks.workunit.client.1.smithi073.stdout:9/475: fsync dc/f61 0 2024-08-31T05:21:01.545 INFO:tasks.workunit.client.1.smithi073.stdout:9/476: readlink dc/d37/l86 0 2024-08-31T05:21:01.547 INFO:tasks.workunit.client.1.smithi073.stdout:8/453: dwrite d0/db/d44/f84 [0,4194304] 0 2024-08-31T05:21:01.548 INFO:tasks.workunit.client.1.smithi073.stdout:8/454: chown d0/db/d1c/d34/d68/c7c 2094791 1 2024-08-31T05:21:01.555 INFO:tasks.workunit.client.1.smithi073.stdout:6/344: dread d15/d17/d26/f2c [0,4194304] 0 2024-08-31T05:21:01.557 INFO:tasks.workunit.client.1.smithi073.stdout:6/345: mkdir d15/d1a/d51/d6e 0 2024-08-31T05:21:01.558 INFO:tasks.workunit.client.1.smithi073.stdout:0/416: truncate d0/f1e 58259 0 2024-08-31T05:21:01.560 INFO:tasks.workunit.client.1.smithi073.stdout:0/417: dread - d0/d15/f82 zero size 2024-08-31T05:21:01.561 INFO:tasks.workunit.client.1.smithi073.stdout:6/346: getdents d15/d1a/d1e 0 2024-08-31T05:21:01.562 INFO:tasks.workunit.client.1.smithi073.stdout:0/418: symlink d0/d15/d2c/d40/d4a/l83 0 2024-08-31T05:21:01.563 INFO:tasks.workunit.client.1.smithi073.stdout:6/347: creat d15/d41/f6f x:0 0 0 2024-08-31T05:21:01.564 INFO:tasks.workunit.client.1.smithi073.stdout:0/419: creat d0/d15/d2c/d40/f84 x:0 0 0 2024-08-31T05:21:01.565 INFO:tasks.workunit.client.1.smithi073.stdout:0/420: stat d0/d15/d2c/d40/d4a/d6b 0 2024-08-31T05:21:01.565 INFO:tasks.workunit.client.1.smithi073.stdout:9/477: dread f7 [0,4194304] 0 2024-08-31T05:21:01.566 INFO:tasks.workunit.client.1.smithi073.stdout:6/348: creat d15/d1a/d51/f70 x:0 0 0 2024-08-31T05:21:01.566 INFO:tasks.workunit.client.1.smithi073.stdout:9/478: readlink dc/d37/d42/l45 0 2024-08-31T05:21:01.568 INFO:tasks.workunit.client.1.smithi073.stdout:6/349: creat d15/d1a/d2b/f71 x:0 0 0 2024-08-31T05:21:01.569 INFO:tasks.workunit.client.1.smithi073.stdout:0/421: read d0/d58/f6e [139575,67674] 0 2024-08-31T05:21:01.571 INFO:tasks.workunit.client.1.smithi073.stdout:6/350: mkdir d15/d1a/d51/d6e/d72 0 2024-08-31T05:21:01.572 INFO:tasks.workunit.client.1.smithi073.stdout:6/351: dread - d15/d1a/d2b/f71 zero size 2024-08-31T05:21:01.572 INFO:tasks.workunit.client.1.smithi073.stdout:6/352: chown d15/d1a/d2b/d2f/c56 796972439 1 2024-08-31T05:21:01.573 INFO:tasks.workunit.client.1.smithi073.stdout:9/479: link dc/d10/f7b dc/f98 0 2024-08-31T05:21:01.574 INFO:tasks.workunit.client.1.smithi073.stdout:9/480: readlink dc/l78 0 2024-08-31T05:21:01.575 INFO:tasks.workunit.client.1.smithi073.stdout:8/455: dread d0/fe [0,4194304] 0 2024-08-31T05:21:01.577 INFO:tasks.workunit.client.1.smithi073.stdout:9/481: symlink dc/d37/d42/d8d/l99 0 2024-08-31T05:21:01.577 INFO:tasks.workunit.client.1.smithi073.stdout:6/353: getdents d15/d17 0 2024-08-31T05:21:01.578 INFO:tasks.workunit.client.1.smithi073.stdout:8/456: symlink d0/db/d1c/d2a/d58/l8e 0 2024-08-31T05:21:01.578 INFO:tasks.workunit.client.1.smithi073.stdout:6/354: fdatasync d15/d17/f5c 0 2024-08-31T05:21:01.580 INFO:tasks.workunit.client.1.smithi073.stdout:0/422: dwrite d0/d15/d2c/d41/d52/f74 [0,4194304] 0 2024-08-31T05:21:01.585 INFO:tasks.workunit.client.1.smithi073.stdout:6/355: rename d15/d1a/f20 to d15/d1a/d51/d6e/d72/f73 0 2024-08-31T05:21:01.587 INFO:tasks.workunit.client.1.smithi073.stdout:0/423: symlink d0/d69/d7f/l85 0 2024-08-31T05:21:01.588 INFO:tasks.workunit.client.1.smithi073.stdout:9/482: dwrite dc/d37/d42/d8d/f50 [0,4194304] 0 2024-08-31T05:21:01.590 INFO:tasks.workunit.client.1.smithi073.stdout:8/457: dwrite d0/db/d1c/d34/f3d [4194304,4194304] 0 2024-08-31T05:21:01.591 INFO:tasks.workunit.client.1.smithi073.stdout:8/458: chown d0/db/d44/d72/d79/f7f 216 1 2024-08-31T05:21:01.592 INFO:tasks.workunit.client.1.smithi073.stdout:8/459: chown d0/db/d1c/d2a/d58 688 1 2024-08-31T05:21:01.593 INFO:tasks.workunit.client.1.smithi073.stdout:0/424: mkdir d0/d15/d2c/d40/d86 0 2024-08-31T05:21:01.595 INFO:tasks.workunit.client.1.smithi073.stdout:9/483: unlink dc/d10/f7b 0 2024-08-31T05:21:01.600 INFO:tasks.workunit.client.1.smithi073.stdout:0/425: creat d0/d15/d2c/d40/d4a/f87 x:0 0 0 2024-08-31T05:21:01.605 INFO:tasks.workunit.client.1.smithi073.stdout:9/484: mknod dc/de/d11/d85/c9a 0 2024-08-31T05:21:01.606 INFO:tasks.workunit.client.1.smithi073.stdout:9/485: chown dc/f3c 257649856 1 2024-08-31T05:21:01.607 INFO:tasks.workunit.client.1.smithi073.stdout:0/426: symlink d0/d15/d2c/d40/d4a/d6b/l88 0 2024-08-31T05:21:01.607 INFO:tasks.workunit.client.1.smithi073.stdout:0/427: chown d0/d58 201 1 2024-08-31T05:21:01.608 INFO:tasks.workunit.client.1.smithi073.stdout:6/356: truncate d15/d17/f3a 739626 0 2024-08-31T05:21:01.609 INFO:tasks.workunit.client.1.smithi073.stdout:0/428: mkdir d0/d89 0 2024-08-31T05:21:01.614 INFO:tasks.workunit.client.1.smithi073.stdout:0/429: dwrite d0/f5b [0,4194304] 0 2024-08-31T05:21:01.614 INFO:tasks.workunit.client.1.smithi073.stdout:0/430: stat d0/d15/d2c/d40 0 2024-08-31T05:21:01.616 INFO:tasks.workunit.client.1.smithi073.stdout:0/431: creat d0/d69/f8a x:0 0 0 2024-08-31T05:21:01.619 INFO:tasks.workunit.client.1.smithi073.stdout:5/420: sync 2024-08-31T05:21:01.619 INFO:tasks.workunit.client.1.smithi073.stdout:2/385: sync 2024-08-31T05:21:01.619 INFO:tasks.workunit.client.1.smithi073.stdout:3/428: sync 2024-08-31T05:21:01.619 INFO:tasks.workunit.client.1.smithi073.stdout:1/320: sync 2024-08-31T05:21:01.619 INFO:tasks.workunit.client.1.smithi073.stdout:0/432: creat d0/d15/d2c/d41/d52/f8b x:0 0 0 2024-08-31T05:21:01.620 INFO:tasks.workunit.client.1.smithi073.stdout:5/421: chown dc/d3d/d3e 132280075 1 2024-08-31T05:21:01.621 INFO:tasks.workunit.client.1.smithi073.stdout:0/433: dread - d0/d15/d2c/d40/f84 zero size 2024-08-31T05:21:01.621 INFO:tasks.workunit.client.1.smithi073.stdout:3/429: readlink da/lc 0 2024-08-31T05:21:01.623 INFO:tasks.workunit.client.1.smithi073.stdout:3/430: write da/d18/f85 [833761,19425] 0 2024-08-31T05:21:01.623 INFO:tasks.workunit.client.1.smithi073.stdout:8/460: truncate d0/f1a 4520652 0 2024-08-31T05:21:01.625 INFO:tasks.workunit.client.1.smithi073.stdout:5/422: dread dc/d16/d3b/f77 [0,4194304] 0 2024-08-31T05:21:01.626 INFO:tasks.workunit.client.1.smithi073.stdout:2/386: read d2/d9/d27/f2b [2707882,60741] 0 2024-08-31T05:21:01.628 INFO:tasks.workunit.client.1.smithi073.stdout:6/357: write d15/d17/d26/f67 [3604487,13268] 0 2024-08-31T05:21:01.629 INFO:tasks.workunit.client.1.smithi073.stdout:6/358: stat d15/d1a/d51 0 2024-08-31T05:21:01.629 INFO:tasks.workunit.client.1.smithi073.stdout:8/461: creat d0/db/d1c/d24/d73/f8f x:0 0 0 2024-08-31T05:21:01.631 INFO:tasks.workunit.client.1.smithi073.stdout:5/423: creat dc/d3d/d55/d84/d49/f97 x:0 0 0 2024-08-31T05:21:01.632 INFO:tasks.workunit.client.1.smithi073.stdout:3/431: link da/d3c/d65/d45/f55 da/d3c/d65/d40/d5d/f8b 0 2024-08-31T05:21:01.634 INFO:tasks.workunit.client.1.smithi073.stdout:3/432: fdatasync da/d3c/d5a/f66 0 2024-08-31T05:21:01.634 INFO:tasks.workunit.client.1.smithi073.stdout:2/387: mknod d2/d9/c79 0 2024-08-31T05:21:01.635 INFO:tasks.workunit.client.1.smithi073.stdout:1/321: write d5/f19 [1119904,6119] 0 2024-08-31T05:21:01.635 INFO:tasks.workunit.client.1.smithi073.stdout:5/424: mkdir dc/d16/d3b/d3f/d4f/d98 0 2024-08-31T05:21:01.636 INFO:tasks.workunit.client.1.smithi073.stdout:8/462: dwrite d0/db/f5a [0,4194304] 0 2024-08-31T05:21:01.640 INFO:tasks.workunit.client.1.smithi073.stdout:8/463: chown d0/db/d1c/c25 91007001 1 2024-08-31T05:21:01.640 INFO:tasks.workunit.client.1.smithi073.stdout:9/486: dread dc/d37/d42/d8d/f4b [0,4194304] 0 2024-08-31T05:21:01.641 INFO:tasks.workunit.client.1.smithi073.stdout:3/433: rename da/d18/f85 to da/d18/f8c 0 2024-08-31T05:21:01.641 INFO:tasks.workunit.client.1.smithi073.stdout:5/425: write dc/d53/f68 [2126315,93164] 0 2024-08-31T05:21:01.643 INFO:tasks.workunit.client.1.smithi073.stdout:8/464: dread - d0/db/d1c/d24/f74 zero size 2024-08-31T05:21:01.644 INFO:tasks.workunit.client.1.smithi073.stdout:9/487: chown dc/d37/d42/d8d/f50 11 1 2024-08-31T05:21:01.644 INFO:tasks.workunit.client.1.smithi073.stdout:8/465: fdatasync d0/f4 0 2024-08-31T05:21:01.645 INFO:tasks.workunit.client.1.smithi073.stdout:5/426: write dc/d3d/d55/d84/d49/f97 [602527,128522] 0 2024-08-31T05:21:01.645 INFO:tasks.workunit.client.1.smithi073.stdout:0/434: dwrite d0/d15/f37 [0,4194304] 0 2024-08-31T05:21:01.647 INFO:tasks.workunit.client.1.smithi073.stdout:7/396: sync 2024-08-31T05:21:01.647 INFO:tasks.workunit.client.1.smithi073.stdout:8/466: dread - d0/db/d1c/d34/d68/f8a zero size 2024-08-31T05:21:01.647 INFO:tasks.workunit.client.1.smithi073.stdout:4/389: sync 2024-08-31T05:21:01.648 INFO:tasks.workunit.client.1.smithi073.stdout:6/359: rename d15/d17/d26/l44 to d15/d1a/l74 0 2024-08-31T05:21:01.649 INFO:tasks.workunit.client.1.smithi073.stdout:5/427: mkdir dc/d16/d3b/d7f/d99 0 2024-08-31T05:21:01.650 INFO:tasks.workunit.client.1.smithi073.stdout:3/434: mknod da/d3c/d5a/d8a/c8d 0 2024-08-31T05:21:01.653 INFO:tasks.workunit.client.1.smithi073.stdout:8/467: truncate d0/db/d1c/d24/d73/f8f 29570 0 2024-08-31T05:21:01.676 INFO:tasks.workunit.client.1.smithi073.stdout:2/388: rename d2/d9/df/d36/f4c to d2/d9/df/d43/f7a 0 2024-08-31T05:21:01.678 INFO:tasks.workunit.client.1.smithi073.stdout:3/435: mkdir da/d3c/d65/d2c/d8e 0 2024-08-31T05:21:01.678 INFO:tasks.workunit.client.1.smithi073.stdout:0/435: dread d0/f26 [0,4194304] 0 2024-08-31T05:21:01.678 INFO:tasks.workunit.client.1.smithi073.stdout:2/389: stat d2/d9/df/d36/f5e 0 2024-08-31T05:21:01.679 INFO:tasks.workunit.client.1.smithi073.stdout:7/397: getdents d1/da/d38 0 2024-08-31T05:21:01.681 INFO:tasks.workunit.client.1.smithi073.stdout:0/436: stat d0/d28/d4f 0 2024-08-31T05:21:01.681 INFO:tasks.workunit.client.1.smithi073.stdout:1/322: dwrite f0 [0,4194304] 0 2024-08-31T05:21:01.681 INFO:tasks.workunit.client.1.smithi073.stdout:3/436: creat da/d3c/f8f x:0 0 0 2024-08-31T05:21:01.682 INFO:tasks.workunit.client.1.smithi073.stdout:2/390: write d2/d9/df/d36/f5e [237963,60165] 0 2024-08-31T05:21:01.683 INFO:tasks.workunit.client.1.smithi073.stdout:9/488: rename dc/d10/l24 to dc/de/d11/d85/l9b 0 2024-08-31T05:21:01.684 INFO:tasks.workunit.client.1.smithi073.stdout:9/489: truncate dc/d37/d42/f94 49133 0 2024-08-31T05:21:01.686 INFO:tasks.workunit.client.1.smithi073.stdout:7/398: mkdir d1/da/d38/d84 0 2024-08-31T05:21:01.688 INFO:tasks.workunit.client.1.smithi073.stdout:3/437: write da/f10 [704102,85618] 0 2024-08-31T05:21:01.689 INFO:tasks.workunit.client.1.smithi073.stdout:1/323: mknod d5/d26/c5a 0 2024-08-31T05:21:01.690 INFO:tasks.workunit.client.1.smithi073.stdout:0/437: fsync d0/d15/d2c/d4d/d3c/ff 0 2024-08-31T05:21:01.692 INFO:tasks.workunit.client.1.smithi073.stdout:9/490: dwrite dc/d37/d42/d8d/f50 [0,4194304] 0 2024-08-31T05:21:01.693 INFO:tasks.workunit.client.1.smithi073.stdout:1/324: truncate d5/d10/d1b/f41 1862501 0 2024-08-31T05:21:01.694 INFO:tasks.workunit.client.1.smithi073.stdout:5/428: truncate dc/d16/f2e 222491 0 2024-08-31T05:21:01.696 INFO:tasks.workunit.client.1.smithi073.stdout:7/399: creat d1/da/d38/f85 x:0 0 0 2024-08-31T05:21:01.697 INFO:tasks.workunit.client.1.smithi073.stdout:3/438: rename da/d3c/d65/d40/d5d/f6d to da/d3c/d5a/f90 0 2024-08-31T05:21:01.697 INFO:tasks.workunit.client.1.smithi073.stdout:7/400: chown d1/da/d15/d33/d44/d74 69 1 2024-08-31T05:21:01.698 INFO:tasks.workunit.client.1.smithi073.stdout:4/390: dread d7/df/d13/d2e/f36 [0,4194304] 0 2024-08-31T05:21:01.700 INFO:tasks.workunit.client.1.smithi073.stdout:2/391: symlink d2/d9/l7b 0 2024-08-31T05:21:01.703 INFO:tasks.workunit.client.1.smithi073.stdout:9/491: mknod dc/de/d66/c9c 0 2024-08-31T05:21:01.703 INFO:tasks.workunit.client.1.smithi073.stdout:8/468: link d0/db/d44/d4e/c40 d0/db/d1c/d34/d68/c90 0 2024-08-31T05:21:01.704 INFO:tasks.workunit.client.1.smithi073.stdout:9/492: dread - dc/d37/d42/f76 zero size 2024-08-31T05:21:01.705 INFO:tasks.workunit.client.1.smithi073.stdout:5/429: creat dc/d16/d3b/d3f/f9a x:0 0 0 2024-08-31T05:21:01.705 INFO:tasks.workunit.client.1.smithi073.stdout:5/430: chown dc/f14 102 1 2024-08-31T05:21:01.706 INFO:tasks.workunit.client.1.smithi073.stdout:7/401: creat d1/da/d65/f86 x:0 0 0 2024-08-31T05:21:01.707 INFO:tasks.workunit.client.1.smithi073.stdout:4/391: unlink d7/df/d1b/d34/l3b 0 2024-08-31T05:21:01.708 INFO:tasks.workunit.client.1.smithi073.stdout:4/392: stat d7/df/d13 0 2024-08-31T05:21:01.708 INFO:tasks.workunit.client.1.smithi073.stdout:9/493: rmdir dc/d37/d42/d8d/d52/d5f 39 2024-08-31T05:21:01.708 INFO:tasks.workunit.client.1.smithi073.stdout:4/393: chown d7/db/c22 7 1 2024-08-31T05:21:01.710 INFO:tasks.workunit.client.1.smithi073.stdout:4/394: write d7/d5d/f6c [641737,94333] 0 2024-08-31T05:21:01.710 INFO:tasks.workunit.client.1.smithi073.stdout:5/431: creat dc/d16/d1a/d87/f9b x:0 0 0 2024-08-31T05:21:01.710 INFO:tasks.workunit.client.1.smithi073.stdout:7/402: mkdir d1/da/d3e/d22/d5c/d87 0 2024-08-31T05:21:01.713 INFO:tasks.workunit.client.1.smithi073.stdout:8/469: mkdir d0/db/d44/d72/d75/d7e/d91 0 2024-08-31T05:21:01.714 INFO:tasks.workunit.client.1.smithi073.stdout:8/470: chown d0/db/d1c/f1f 92517 1 2024-08-31T05:21:01.714 INFO:tasks.workunit.client.1.smithi073.stdout:3/439: creat da/d3c/d65/f91 x:0 0 0 2024-08-31T05:21:01.715 INFO:tasks.workunit.client.1.smithi073.stdout:1/325: dread d5/d10/d33/fe [0,4194304] 0 2024-08-31T05:21:01.716 INFO:tasks.workunit.client.1.smithi073.stdout:9/494: creat dc/d37/d42/d8d/d52/d5b/f9d x:0 0 0 2024-08-31T05:21:01.717 INFO:tasks.workunit.client.1.smithi073.stdout:9/495: chown dc/de/f4f 4163 1 2024-08-31T05:21:01.718 INFO:tasks.workunit.client.1.smithi073.stdout:5/432: unlink dc/d16/d1a/f33 0 2024-08-31T05:21:01.721 INFO:tasks.workunit.client.1.smithi073.stdout:5/433: write dc/d16/d3b/d3f/d4f/f8b [324703,23746] 0 2024-08-31T05:21:01.721 INFO:tasks.workunit.client.1.smithi073.stdout:8/471: dwrite d0/db/d1c/d34/d38/f8b [0,4194304] 0 2024-08-31T05:21:01.722 INFO:tasks.workunit.client.1.smithi073.stdout:8/472: chown d0/db/d44 77671 1 2024-08-31T05:21:01.724 INFO:tasks.workunit.client.1.smithi073.stdout:7/403: rename d1/da/d3e/d22/d5c/d87 to d1/da/d38/d88 0 2024-08-31T05:21:01.724 INFO:tasks.workunit.client.1.smithi073.stdout:0/438: link d0/d15/d2c/d4d/d3c/c66 d0/d89/c8c 0 2024-08-31T05:21:01.724 INFO:tasks.workunit.client.1.smithi073.stdout:3/440: rename da/d3c/d65/d87 to da/d3c/d65/d87/d92 22 2024-08-31T05:21:01.725 INFO:tasks.workunit.client.1.smithi073.stdout:1/326: creat d5/d17/d2a/f5b x:0 0 0 2024-08-31T05:21:01.727 INFO:tasks.workunit.client.1.smithi073.stdout:9/496: unlink dc/de/c62 0 2024-08-31T05:21:01.732 INFO:tasks.workunit.client.1.smithi073.stdout:2/392: truncate d2/f4f 423348 0 2024-08-31T05:21:01.732 INFO:tasks.workunit.client.1.smithi073.stdout:4/395: dread d7/df/d13/d2e/f48 [4194304,4194304] 0 2024-08-31T05:21:01.733 INFO:tasks.workunit.client.1.smithi073.stdout:1/327: rename l3 to d5/d10/d33/l5c 0 2024-08-31T05:21:01.734 INFO:tasks.workunit.client.1.smithi073.stdout:1/328: chown d5/d10/d1c/l1d 0 1 2024-08-31T05:21:01.756 INFO:tasks.workunit.client.1.smithi073.stdout:5/434: link dc/d16/d3b/d3f/f50 dc/d3d/f9c 0 2024-08-31T05:21:01.756 INFO:tasks.workunit.client.1.smithi073.stdout:8/473: symlink d0/db/d1c/d24/l92 0 2024-08-31T05:21:01.757 INFO:tasks.workunit.client.1.smithi073.stdout:1/329: chown d5/d17 420291 1 2024-08-31T05:21:01.757 INFO:tasks.workunit.client.1.smithi073.stdout:0/439: mknod d0/d15/c8d 0 2024-08-31T05:21:01.757 INFO:tasks.workunit.client.1.smithi073.stdout:7/404: symlink d1/da/d3e/d22/d35/d83/l89 0 2024-08-31T05:21:01.759 INFO:tasks.workunit.client.1.smithi073.stdout:7/405: dread - d1/da/d3e/d22/d6b/f81 zero size 2024-08-31T05:21:01.759 INFO:tasks.workunit.client.1.smithi073.stdout:9/497: creat dc/d82/d97/f9e x:0 0 0 2024-08-31T05:21:01.759 INFO:tasks.workunit.client.1.smithi073.stdout:5/435: fsync dc/f17 0 2024-08-31T05:21:01.760 INFO:tasks.workunit.client.1.smithi073.stdout:4/396: mkdir d7/d1a/d5c/d6d/d59/d65/d6f 0 2024-08-31T05:21:01.760 INFO:tasks.workunit.client.1.smithi073.stdout:0/440: rename d0/d15/d2c/d2e to d0/d69/d8e 0 2024-08-31T05:21:01.761 INFO:tasks.workunit.client.1.smithi073.stdout:5/436: dread - dc/d16/d3b/d3f/f65 zero size 2024-08-31T05:21:01.762 INFO:tasks.workunit.client.1.smithi073.stdout:2/393: getdents d2/d9 0 2024-08-31T05:21:01.763 INFO:tasks.workunit.client.1.smithi073.stdout:9/498: unlink dc/d10/f4c 0 2024-08-31T05:21:01.765 INFO:tasks.workunit.client.1.smithi073.stdout:7/406: mknod d1/d11/c8a 0 2024-08-31T05:21:01.765 INFO:tasks.workunit.client.1.smithi073.stdout:9/499: chown dc/d37/d42/d8d/d52/d5b/f8a 109 1 2024-08-31T05:21:01.766 INFO:tasks.workunit.client.1.smithi073.stdout:8/474: rename d0/db/d1c/d34/d38/f5b to d0/d62/f93 0 2024-08-31T05:21:01.768 INFO:tasks.workunit.client.1.smithi073.stdout:4/397: dwrite d7/d1a/d5c/d6d/d2c/d2d/f5b [0,4194304] 0 2024-08-31T05:21:01.769 INFO:tasks.workunit.client.1.smithi073.stdout:2/394: rmdir d2/d9/d32/d56 39 2024-08-31T05:21:01.770 INFO:tasks.workunit.client.1.smithi073.stdout:2/395: readlink d2/d9/l6d 0 2024-08-31T05:21:01.774 INFO:tasks.workunit.client.1.smithi073.stdout:9/500: creat dc/d37/d42/d5a/f9f x:0 0 0 2024-08-31T05:21:01.775 INFO:tasks.workunit.client.1.smithi073.stdout:7/407: creat d1/da/d3e/d22/d5c/f8b x:0 0 0 2024-08-31T05:21:01.776 INFO:tasks.workunit.client.1.smithi073.stdout:0/441: creat d0/d69/d7f/d62/f8f x:0 0 0 2024-08-31T05:21:01.776 INFO:tasks.workunit.client.1.smithi073.stdout:9/501: write dc/d37/d42/f64 [352628,30743] 0 2024-08-31T05:21:01.777 INFO:tasks.workunit.client.1.smithi073.stdout:7/408: chown d1/da/d15/f4b 3717944 1 2024-08-31T05:21:01.778 INFO:tasks.workunit.client.1.smithi073.stdout:4/398: rename d7/d5d to d7/df/d13/d2e/d70 0 2024-08-31T05:21:01.778 INFO:tasks.workunit.client.1.smithi073.stdout:2/396: dwrite d2/f35 [0,4194304] 0 2024-08-31T05:21:01.778 INFO:tasks.workunit.client.1.smithi073.stdout:1/330: truncate d5/d10/d1b/f41 495202 0 2024-08-31T05:21:01.779 INFO:tasks.workunit.client.1.smithi073.stdout:5/437: creat dc/d16/d3b/d3f/d4f/d98/f9d x:0 0 0 2024-08-31T05:21:01.781 INFO:tasks.workunit.client.1.smithi073.stdout:1/331: dread - d5/d17/d32/d37/f3c zero size 2024-08-31T05:21:01.782 INFO:tasks.workunit.client.1.smithi073.stdout:0/442: chown d0/d15/d2c/d4d/d3c/f13 1821 1 2024-08-31T05:21:01.783 INFO:tasks.workunit.client.1.smithi073.stdout:1/332: readlink d5/d17/d2a/l48 0 2024-08-31T05:21:01.784 INFO:tasks.workunit.client.1.smithi073.stdout:1/333: write d5/d26/f46 [346618,22928] 0 2024-08-31T05:21:01.785 INFO:tasks.workunit.client.1.smithi073.stdout:7/409: mknod d1/da/d3e/c8c 0 2024-08-31T05:21:01.786 INFO:tasks.workunit.client.1.smithi073.stdout:8/475: dread d0/db/d44/d4e/f5c [0,4194304] 0 2024-08-31T05:21:01.787 INFO:tasks.workunit.client.1.smithi073.stdout:9/502: mkdir dc/d37/d42/d5a/da0 0 2024-08-31T05:21:01.788 INFO:tasks.workunit.client.1.smithi073.stdout:2/397: creat d2/d9/d32/d5d/f7c x:0 0 0 2024-08-31T05:21:01.793 INFO:tasks.workunit.client.1.smithi073.stdout:5/438: creat dc/d3d/d55/d84/d49/f9e x:0 0 0 2024-08-31T05:21:01.793 INFO:tasks.workunit.client.1.smithi073.stdout:5/439: chown dc/f48 0 1 2024-08-31T05:21:01.795 INFO:tasks.workunit.client.1.smithi073.stdout:8/476: rmdir d0/db/d44/d72/d75/d7e 39 2024-08-31T05:21:01.798 INFO:tasks.workunit.client.1.smithi073.stdout:9/503: rename dc/f3c to dc/d37/d42/fa1 0 2024-08-31T05:21:01.799 INFO:tasks.workunit.client.1.smithi073.stdout:0/443: mknod d0/d15/d2c/d40/d86/c90 0 2024-08-31T05:21:01.800 INFO:tasks.workunit.client.1.smithi073.stdout:5/440: symlink dc/d16/d1a/d87/l9f 0 2024-08-31T05:21:01.801 INFO:tasks.workunit.client.1.smithi073.stdout:1/334: mkdir d5/d17/d5d 0 2024-08-31T05:21:01.802 INFO:tasks.workunit.client.1.smithi073.stdout:5/441: truncate dc/d16/d1a/d87/f91 151285 0 2024-08-31T05:21:01.802 INFO:tasks.workunit.client.1.smithi073.stdout:4/399: readlink d7/df/l64 0 2024-08-31T05:21:01.803 INFO:tasks.workunit.client.1.smithi073.stdout:5/442: read fb [1551531,51983] 0 2024-08-31T05:21:01.804 INFO:tasks.workunit.client.1.smithi073.stdout:8/477: creat d0/db/d1c/d34/d38/f94 x:0 0 0 2024-08-31T05:21:01.806 INFO:tasks.workunit.client.1.smithi073.stdout:6/360: sync 2024-08-31T05:21:01.806 INFO:tasks.workunit.client.1.smithi073.stdout:2/398: symlink d2/d9/d27/d76/l7d 0 2024-08-31T05:21:01.808 INFO:tasks.workunit.client.1.smithi073.stdout:4/400: fsync d7/df/f21 0 2024-08-31T05:21:01.809 INFO:tasks.workunit.client.1.smithi073.stdout:7/410: creat d1/d11/f8d x:0 0 0 2024-08-31T05:21:01.809 INFO:tasks.workunit.client.1.smithi073.stdout:1/335: write d5/d17/f38 [11195594,63431] 0 2024-08-31T05:21:01.812 INFO:tasks.workunit.client.1.smithi073.stdout:2/399: mkdir d2/d9/d27/d76/d7e 0 2024-08-31T05:21:01.812 INFO:tasks.workunit.client.1.smithi073.stdout:5/443: dwrite dc/d3d/d55/d84/d49/f97 [0,4194304] 0 2024-08-31T05:21:01.813 INFO:tasks.workunit.client.1.smithi073.stdout:4/401: fsync d7/df/d1b/d34/f49 0 2024-08-31T05:21:01.814 INFO:tasks.workunit.client.1.smithi073.stdout:1/336: mknod d5/d10/d33/c5e 0 2024-08-31T05:21:01.817 INFO:tasks.workunit.client.1.smithi073.stdout:2/400: mkdir d2/d9/d7f 0 2024-08-31T05:21:01.817 INFO:tasks.workunit.client.1.smithi073.stdout:6/361: dwrite d15/f1f [0,4194304] 0 2024-08-31T05:21:01.820 INFO:tasks.workunit.client.1.smithi073.stdout:0/444: truncate d0/d15/d2c/d4d/f54 815292 0 2024-08-31T05:21:01.822 INFO:tasks.workunit.client.1.smithi073.stdout:2/401: mknod d2/c80 0 2024-08-31T05:21:01.823 INFO:tasks.workunit.client.1.smithi073.stdout:1/337: mkdir d5/d26/d54/d5f 0 2024-08-31T05:21:01.825 INFO:tasks.workunit.client.1.smithi073.stdout:7/411: dwrite d1/da/d3e/d22/d5c/f8b [0,4194304] 0 2024-08-31T05:21:01.827 INFO:tasks.workunit.client.1.smithi073.stdout:5/444: dwrite dc/d16/f7e [0,4194304] 0 2024-08-31T05:21:01.829 INFO:tasks.workunit.client.1.smithi073.stdout:0/445: mkdir d0/d69/d7f/d68/d91 0 2024-08-31T05:21:01.836 INFO:tasks.workunit.client.1.smithi073.stdout:5/445: dread dc/d16/d3b/d3f/f50 [0,4194304] 0 2024-08-31T05:21:01.855 INFO:tasks.workunit.client.1.smithi073.stdout:5/446: dread dc/d3d/d55/d84/f25 [4194304,4194304] 0 2024-08-31T05:21:01.882 INFO:tasks.workunit.client.1.smithi073.stdout:3/441: sync 2024-08-31T05:21:01.930 INFO:tasks.workunit.client.1.smithi073.stdout:9/504: sync 2024-08-31T05:21:01.971 INFO:tasks.workunit.client.1.smithi073.stdout:4/402: sync 2024-08-31T05:21:01.971 INFO:tasks.workunit.client.1.smithi073.stdout:8/478: sync 2024-08-31T05:21:01.972 INFO:tasks.workunit.client.1.smithi073.stdout:4/403: chown d7/df/d13/f2b 4131 1 2024-08-31T05:21:01.972 INFO:tasks.workunit.client.1.smithi073.stdout:4/404: fsync d7/df/d1b/f51 0 2024-08-31T05:21:01.981 INFO:tasks.workunit.client.1.smithi073.stdout:5/447: symlink dc/d3d/d55/la0 0 2024-08-31T05:21:01.981 INFO:tasks.workunit.client.1.smithi073.stdout:5/448: dread - dc/d16/d3b/f76 zero size 2024-08-31T05:21:01.983 INFO:tasks.workunit.client.1.smithi073.stdout:9/505: mkdir dc/de/d66/d84/da2 0 2024-08-31T05:21:01.984 INFO:tasks.workunit.client.1.smithi073.stdout:8/479: creat d0/db/d1c/d34/f95 x:0 0 0 2024-08-31T05:21:01.990 INFO:tasks.workunit.client.1.smithi073.stdout:0/446: rename d0/c42 to d0/d69/d8e/c92 0 2024-08-31T05:21:01.991 INFO:tasks.workunit.client.1.smithi073.stdout:0/447: dread - d0/d58/f70 zero size 2024-08-31T05:21:01.991 INFO:tasks.workunit.client.1.smithi073.stdout:6/362: dread d15/d1a/d1e/f25 [0,4194304] 0 2024-08-31T05:21:01.992 INFO:tasks.workunit.client.1.smithi073.stdout:6/363: write d15/d1a/d1e/f24 [1397815,13044] 0 2024-08-31T05:21:01.993 INFO:tasks.workunit.client.1.smithi073.stdout:3/442: creat da/d3c/d65/d2c/d8e/f93 x:0 0 0 2024-08-31T05:21:01.995 INFO:tasks.workunit.client.1.smithi073.stdout:5/449: symlink dc/d16/d1a/la1 0 2024-08-31T05:21:01.998 INFO:tasks.workunit.client.1.smithi073.stdout:8/480: fdatasync d0/db/d1c/d2a/f89 0 2024-08-31T05:21:01.999 INFO:tasks.workunit.client.1.smithi073.stdout:1/338: link d5/d10/d1b/c1e d5/d10/d1c/d27/c60 0 2024-08-31T05:21:02.000 INFO:tasks.workunit.client.1.smithi073.stdout:5/450: dwrite dc/f61 [0,4194304] 0 2024-08-31T05:21:02.004 INFO:tasks.workunit.client.1.smithi073.stdout:1/339: dread d5/d10/d33/fe [0,4194304] 0 2024-08-31T05:21:02.007 INFO:tasks.workunit.client.1.smithi073.stdout:3/443: mknod da/d3c/d67/c94 0 2024-08-31T05:21:02.012 INFO:tasks.workunit.client.1.smithi073.stdout:3/444: dwrite da/d3c/d65/d40/f44 [0,4194304] 0 2024-08-31T05:21:02.013 INFO:tasks.workunit.client.1.smithi073.stdout:9/506: symlink dc/d37/d42/d8d/d52/d5f/la3 0 2024-08-31T05:21:02.014 INFO:tasks.workunit.client.1.smithi073.stdout:9/507: chown dc/d37/d42/f59 4121328 1 2024-08-31T05:21:02.015 INFO:tasks.workunit.client.1.smithi073.stdout:7/412: getdents d1/d11 0 2024-08-31T05:21:02.017 INFO:tasks.workunit.client.1.smithi073.stdout:7/413: fdatasync d1/d11/f7f 0 2024-08-31T05:21:02.020 INFO:tasks.workunit.client.1.smithi073.stdout:9/508: dwrite dc/d37/d42/d8d/f74 [0,4194304] 0 2024-08-31T05:21:02.022 INFO:tasks.workunit.client.1.smithi073.stdout:9/509: write dc/d37/d42/f64 [4336305,81561] 0 2024-08-31T05:21:02.023 INFO:tasks.workunit.client.1.smithi073.stdout:5/451: creat dc/d3d/fa2 x:0 0 0 2024-08-31T05:21:02.026 INFO:tasks.workunit.client.1.smithi073.stdout:2/402: creat d2/d9/f81 x:0 0 0 2024-08-31T05:21:02.026 INFO:tasks.workunit.client.1.smithi073.stdout:6/364: mkdir d15/d75 0 2024-08-31T05:21:02.030 INFO:tasks.workunit.client.1.smithi073.stdout:8/481: dwrite d0/f5e [0,4194304] 0 2024-08-31T05:21:02.030 INFO:tasks.workunit.client.1.smithi073.stdout:6/365: dread - d15/d1a/d2b/f4c zero size 2024-08-31T05:21:02.030 INFO:tasks.workunit.client.1.smithi073.stdout:9/510: dread f7 [0,4194304] 0 2024-08-31T05:21:02.030 INFO:tasks.workunit.client.1.smithi073.stdout:3/445: mkdir da/d3c/d82/d95 0 2024-08-31T05:21:02.030 INFO:tasks.workunit.client.1.smithi073.stdout:8/482: write d0/f45 [264368,51814] 0 2024-08-31T05:21:02.031 INFO:tasks.workunit.client.1.smithi073.stdout:9/511: readlink dc/d37/d42/l6f 0 2024-08-31T05:21:02.032 INFO:tasks.workunit.client.1.smithi073.stdout:6/366: chown d15/d1a/d2b/d2f/d4b/c4f 327066152 1 2024-08-31T05:21:02.033 INFO:tasks.workunit.client.1.smithi073.stdout:7/414: symlink d1/da/d3e/d22/d47/l8e 0 2024-08-31T05:21:02.033 INFO:tasks.workunit.client.1.smithi073.stdout:8/483: truncate d0/db/d44/d4e/f63 228103 0 2024-08-31T05:21:02.034 INFO:tasks.workunit.client.1.smithi073.stdout:6/367: write d15/d17/d26/d38/f40 [34318,19190] 0 2024-08-31T05:21:02.035 INFO:tasks.workunit.client.1.smithi073.stdout:7/415: dread - d1/da/d15/d33/d44/d60/f7d zero size 2024-08-31T05:21:02.037 INFO:tasks.workunit.client.1.smithi073.stdout:4/405: getdents d7/df/d1b/d34 0 2024-08-31T05:21:02.042 INFO:tasks.workunit.client.1.smithi073.stdout:1/340: mkdir d5/d17/d5d/d61 0 2024-08-31T05:21:02.043 INFO:tasks.workunit.client.1.smithi073.stdout:6/368: dread d15/d17/d26/f34 [0,4194304] 0 2024-08-31T05:21:02.044 INFO:tasks.workunit.client.1.smithi073.stdout:6/369: write d15/d1a/d2b/d2f/d4b/f6b [172040,43273] 0 2024-08-31T05:21:02.045 INFO:tasks.workunit.client.1.smithi073.stdout:5/452: rename dc/d3d/l7d to dc/d16/d3b/d7f/d99/la3 0 2024-08-31T05:21:02.045 INFO:tasks.workunit.client.1.smithi073.stdout:5/453: read - dc/d53/f79 zero size 2024-08-31T05:21:02.047 INFO:tasks.workunit.client.1.smithi073.stdout:8/484: rmdir d0/db/d44/d72/d79 39 2024-08-31T05:21:02.048 INFO:tasks.workunit.client.1.smithi073.stdout:8/485: fdatasync d0/db/d1c/d34/d68/f8a 0 2024-08-31T05:21:02.050 INFO:tasks.workunit.client.1.smithi073.stdout:0/448: sync 2024-08-31T05:21:02.052 INFO:tasks.workunit.client.1.smithi073.stdout:2/403: mkdir d2/d9/d32/d5d/d82 0 2024-08-31T05:21:02.057 INFO:tasks.workunit.client.1.smithi073.stdout:3/446: rename da/d18/c4f to da/d3c/d65/d2c/d8e/c96 0 2024-08-31T05:21:02.061 INFO:tasks.workunit.client.1.smithi073.stdout:5/454: dread dc/d3d/d55/d84/f51 [0,4194304] 0 2024-08-31T05:21:02.062 INFO:tasks.workunit.client.1.smithi073.stdout:0/449: dread - d0/f33 zero size 2024-08-31T05:21:02.063 INFO:tasks.workunit.client.1.smithi073.stdout:5/455: readlink dc/d16/d1a/d87/l9f 0 2024-08-31T05:21:02.063 INFO:tasks.workunit.client.1.smithi073.stdout:4/406: mknod d7/d1a/d5c/c71 0 2024-08-31T05:21:02.064 INFO:tasks.workunit.client.1.smithi073.stdout:0/450: readlink d0/d15/d2c/l3b 0 2024-08-31T05:21:02.065 INFO:tasks.workunit.client.1.smithi073.stdout:5/456: dread - dc/f67 zero size 2024-08-31T05:21:02.065 INFO:tasks.workunit.client.1.smithi073.stdout:6/370: creat d15/d75/f76 x:0 0 0 2024-08-31T05:21:02.065 INFO:tasks.workunit.client.1.smithi073.stdout:3/447: mkdir da/d3c/d82/d97 0 2024-08-31T05:21:02.065 INFO:tasks.workunit.client.1.smithi073.stdout:7/416: dread d1/da/d3e/d22/d47/f79 [0,4194304] 0 2024-08-31T05:21:02.067 INFO:tasks.workunit.client.1.smithi073.stdout:2/404: fdatasync d2/d9/df/f29 0 2024-08-31T05:21:02.068 INFO:tasks.workunit.client.1.smithi073.stdout:8/486: dwrite d0/d62/f93 [0,4194304] 0 2024-08-31T05:21:02.068 INFO:tasks.workunit.client.1.smithi073.stdout:4/407: write d7/db/f19 [1524434,4304] 0 2024-08-31T05:21:02.069 INFO:tasks.workunit.client.1.smithi073.stdout:7/417: write d1/da/f32 [235497,51416] 0 2024-08-31T05:21:02.069 INFO:tasks.workunit.client.1.smithi073.stdout:9/512: rename dc/de/d56/f5c to dc/d37/d42/d8d/d52/fa4 0 2024-08-31T05:21:02.071 INFO:tasks.workunit.client.1.smithi073.stdout:3/448: chown da/d3c/d65/d40/d5d/f89 8 1 2024-08-31T05:21:02.072 INFO:tasks.workunit.client.1.smithi073.stdout:8/487: chown d0/db/d1c/d23/f2f 6 1 2024-08-31T05:21:02.073 INFO:tasks.workunit.client.1.smithi073.stdout:0/451: dread d0/d58/f6e [0,4194304] 0 2024-08-31T05:21:02.073 INFO:tasks.workunit.client.1.smithi073.stdout:5/457: mknod dc/d16/d3b/ca4 0 2024-08-31T05:21:02.074 INFO:tasks.workunit.client.1.smithi073.stdout:3/449: write da/d18/f5b [482759,33800] 0 2024-08-31T05:21:02.076 INFO:tasks.workunit.client.1.smithi073.stdout:8/488: write d0/db/d1c/d2a/d58/f66 [558491,130102] 0 2024-08-31T05:21:02.076 INFO:tasks.workunit.client.1.smithi073.stdout:2/405: chown d2/d9/d32/c45 3246726 1 2024-08-31T05:21:02.080 INFO:tasks.workunit.client.1.smithi073.stdout:6/371: mknod d15/d1a/d2b/d6a/c77 0 2024-08-31T05:21:02.081 INFO:tasks.workunit.client.1.smithi073.stdout:8/489: write d0/f1b [2536246,126240] 0 2024-08-31T05:21:02.081 INFO:tasks.workunit.client.1.smithi073.stdout:6/372: read - d15/d1a/d2b/f63 zero size 2024-08-31T05:21:02.081 INFO:tasks.workunit.client.1.smithi073.stdout:7/418: fsync d1/da/d65/f7e 0 2024-08-31T05:21:02.081 INFO:tasks.workunit.client.1.smithi073.stdout:4/408: symlink d7/df/d13/d2e/l72 0 2024-08-31T05:21:02.083 INFO:tasks.workunit.client.1.smithi073.stdout:0/452: creat d0/d58/f93 x:0 0 0 2024-08-31T05:21:02.085 INFO:tasks.workunit.client.1.smithi073.stdout:0/453: stat d0/d69/d8e/f3f 0 2024-08-31T05:21:02.086 INFO:tasks.workunit.client.1.smithi073.stdout:1/341: rename d5/d10/d33/d13/c14 to d5/d10/d2e/c62 0 2024-08-31T05:21:02.086 INFO:tasks.workunit.client.1.smithi073.stdout:7/419: dwrite d1/da/d3e/d22/d6b/f70 [0,4194304] 0 2024-08-31T05:21:02.089 INFO:tasks.workunit.client.1.smithi073.stdout:2/406: stat d2/d9/f24 0 2024-08-31T05:21:02.089 INFO:tasks.workunit.client.1.smithi073.stdout:1/342: chown d5/d17/d2a/f5b 6802 1 2024-08-31T05:21:02.089 INFO:tasks.workunit.client.1.smithi073.stdout:4/409: dwrite d7/db/f19 [0,4194304] 0 2024-08-31T05:21:02.089 INFO:tasks.workunit.client.1.smithi073.stdout:7/420: readlink d1/da/d3e/d22/d47/l6e 0 2024-08-31T05:21:02.091 INFO:tasks.workunit.client.1.smithi073.stdout:8/490: read d0/db/d1c/d24/f78 [103871,1313] 0 2024-08-31T05:21:02.092 INFO:tasks.workunit.client.1.smithi073.stdout:9/513: link dc/d37/d42/d8d/f57 dc/de/d66/d84/da2/fa5 0 2024-08-31T05:21:02.093 INFO:tasks.workunit.client.1.smithi073.stdout:7/421: write d1/da/d3e/d22/d47/f68 [1232619,91243] 0 2024-08-31T05:21:02.097 INFO:tasks.workunit.client.1.smithi073.stdout:5/458: rename dc/d3d/d55/d84/c63 to dc/d52/ca5 0 2024-08-31T05:21:02.098 INFO:tasks.workunit.client.1.smithi073.stdout:1/343: readlink d5/d10/d33/l5c 0 2024-08-31T05:21:02.099 INFO:tasks.workunit.client.1.smithi073.stdout:5/459: write dc/d16/f54 [2352310,39284] 0 2024-08-31T05:21:02.100 INFO:tasks.workunit.client.1.smithi073.stdout:0/454: truncate d0/d15/d2c/d4d/d3c/f13 532268 0 2024-08-31T05:21:02.101 INFO:tasks.workunit.client.1.smithi073.stdout:1/344: readlink d5/d10/d33/d13/l31 0 2024-08-31T05:21:02.101 INFO:tasks.workunit.client.1.smithi073.stdout:8/491: dwrite d0/f17 [0,4194304] 0 2024-08-31T05:21:02.102 INFO:tasks.workunit.client.1.smithi073.stdout:3/450: dread f9 [0,4194304] 0 2024-08-31T05:21:02.103 INFO:tasks.workunit.client.1.smithi073.stdout:0/455: write d0/f33 [114159,6367] 0 2024-08-31T05:21:02.103 INFO:tasks.workunit.client.1.smithi073.stdout:8/492: chown d0/db/d1c/d24/l92 872 1 2024-08-31T05:21:02.104 INFO:tasks.workunit.client.1.smithi073.stdout:4/410: mkdir d7/df/d13/d2e/d47/d4c/d73 0 2024-08-31T05:21:02.107 INFO:tasks.workunit.client.1.smithi073.stdout:9/514: creat dc/de/d11/fa6 x:0 0 0 2024-08-31T05:21:02.107 INFO:tasks.workunit.client.1.smithi073.stdout:2/407: creat d2/d9/d7f/f83 x:0 0 0 2024-08-31T05:21:02.109 INFO:tasks.workunit.client.1.smithi073.stdout:9/515: chown dc/d37/d42/fa1 350090219 1 2024-08-31T05:21:02.110 INFO:tasks.workunit.client.1.smithi073.stdout:7/422: unlink d1/cf 0 2024-08-31T05:21:02.111 INFO:tasks.workunit.client.1.smithi073.stdout:8/493: mknod d0/db/c96 0 2024-08-31T05:21:02.112 INFO:tasks.workunit.client.1.smithi073.stdout:6/373: getdents d15/d17/d26 0 2024-08-31T05:21:02.113 INFO:tasks.workunit.client.1.smithi073.stdout:4/411: creat d7/d1a/d5c/d6d/d59/f74 x:0 0 0 2024-08-31T05:21:02.114 INFO:tasks.workunit.client.1.smithi073.stdout:5/460: getdents dc/d16/d1a/d87/d94 0 2024-08-31T05:21:02.115 INFO:tasks.workunit.client.1.smithi073.stdout:3/451: rename da/d18/f38 to da/d3c/d82/d86/f98 0 2024-08-31T05:21:02.116 INFO:tasks.workunit.client.1.smithi073.stdout:1/345: dwrite d5/d10/d1c/f52 [0,4194304] 0 2024-08-31T05:21:02.117 INFO:tasks.workunit.client.1.smithi073.stdout:6/374: fsync d15/d1a/d1e/f66 0 2024-08-31T05:21:02.118 INFO:tasks.workunit.client.1.smithi073.stdout:0/456: dread d0/f33 [0,4194304] 0 2024-08-31T05:21:02.118 INFO:tasks.workunit.client.1.smithi073.stdout:4/412: fdatasync d7/df/d13/f2b 0 2024-08-31T05:21:02.119 INFO:tasks.workunit.client.1.smithi073.stdout:5/461: symlink dc/d16/d1a/d87/la6 0 2024-08-31T05:21:02.120 INFO:tasks.workunit.client.1.smithi073.stdout:2/408: mkdir d2/d9/d84 0 2024-08-31T05:21:02.121 INFO:tasks.workunit.client.1.smithi073.stdout:9/516: link dc/d37/d42/f94 dc/d37/d42/d5a/d89/fa7 0 2024-08-31T05:21:02.123 INFO:tasks.workunit.client.1.smithi073.stdout:3/452: dread da/d68/f6b [0,4194304] 0 2024-08-31T05:21:02.125 INFO:tasks.workunit.client.1.smithi073.stdout:6/375: creat d15/d75/f78 x:0 0 0 2024-08-31T05:21:02.126 INFO:tasks.workunit.client.1.smithi073.stdout:1/346: write d5/d17/d3f/f4e [1625623,118630] 0 2024-08-31T05:21:02.127 INFO:tasks.workunit.client.1.smithi073.stdout:8/494: dwrite d0/fe [0,4194304] 0 2024-08-31T05:21:02.130 INFO:tasks.workunit.client.1.smithi073.stdout:5/462: rename dc/f14 to dc/d3d/d55/d84/fa7 0 2024-08-31T05:21:02.132 INFO:tasks.workunit.client.1.smithi073.stdout:2/409: dwrite d2/d9/d32/f39 [0,4194304] 0 2024-08-31T05:21:02.133 INFO:tasks.workunit.client.1.smithi073.stdout:2/410: read - d2/d9/d7f/f83 zero size 2024-08-31T05:21:02.134 INFO:tasks.workunit.client.1.smithi073.stdout:3/453: creat da/d68/f99 x:0 0 0 2024-08-31T05:21:02.137 INFO:tasks.workunit.client.1.smithi073.stdout:7/423: getdents d1/da/d38 0 2024-08-31T05:21:02.139 INFO:tasks.workunit.client.1.smithi073.stdout:1/347: write d5/d10/d33/fe [2820229,41265] 0 2024-08-31T05:21:02.142 INFO:tasks.workunit.client.1.smithi073.stdout:1/348: write d5/f34 [67877,83383] 0 2024-08-31T05:21:02.142 INFO:tasks.workunit.client.1.smithi073.stdout:5/463: unlink dc/f17 0 2024-08-31T05:21:02.149 INFO:tasks.workunit.client.1.smithi073.stdout:1/349: unlink d5/d10/d33/f15 0 2024-08-31T05:21:02.150 INFO:tasks.workunit.client.1.smithi073.stdout:5/464: creat dc/d16/d1a/d87/fa8 x:0 0 0 2024-08-31T05:21:02.150 INFO:tasks.workunit.client.1.smithi073.stdout:0/457: getdents d0/d15/d2c/d4d 0 2024-08-31T05:21:02.151 INFO:tasks.workunit.client.1.smithi073.stdout:3/454: link da/d3c/f8f da/d3c/d65/d2c/d8e/f9a 0 2024-08-31T05:21:02.151 INFO:tasks.workunit.client.1.smithi073.stdout:5/465: chown dc/d16/d1a/f72 0 1 2024-08-31T05:21:02.152 INFO:tasks.workunit.client.1.smithi073.stdout:8/495: creat d0/db/d44/d72/d75/d7e/d91/f97 x:0 0 0 2024-08-31T05:21:02.153 INFO:tasks.workunit.client.1.smithi073.stdout:3/455: dread - da/d3c/d5a/f66 zero size 2024-08-31T05:21:02.153 INFO:tasks.workunit.client.1.smithi073.stdout:9/517: rename dc/d37/d42/d5a/f77 to dc/d37/d42/d8d/d52/fa8 0 2024-08-31T05:21:02.154 INFO:tasks.workunit.client.1.smithi073.stdout:2/411: creat d2/d9/f85 x:0 0 0 2024-08-31T05:21:02.155 INFO:tasks.workunit.client.1.smithi073.stdout:1/350: creat d5/d10/d1b/f63 x:0 0 0 2024-08-31T05:21:02.155 INFO:tasks.workunit.client.1.smithi073.stdout:8/496: chown d0/db/d44/f4d 0 1 2024-08-31T05:21:02.155 INFO:tasks.workunit.client.1.smithi073.stdout:4/413: dread d7/df/f25 [0,4194304] 0 2024-08-31T05:21:02.156 INFO:tasks.workunit.client.1.smithi073.stdout:0/458: symlink d0/d69/d8e/l94 0 2024-08-31T05:21:02.156 INFO:tasks.workunit.client.1.smithi073.stdout:6/376: dread fa [0,4194304] 0 2024-08-31T05:21:02.156 INFO:tasks.workunit.client.1.smithi073.stdout:3/456: dread - da/d3c/d65/d40/f57 zero size 2024-08-31T05:21:02.157 INFO:tasks.workunit.client.1.smithi073.stdout:5/466: creat dc/d3d/d55/d84/fa9 x:0 0 0 2024-08-31T05:21:02.160 INFO:tasks.workunit.client.1.smithi073.stdout:1/351: rmdir d5/d10/d33/d13 39 2024-08-31T05:21:02.160 INFO:tasks.workunit.client.1.smithi073.stdout:0/459: chown d0/d15/d2c/d40/d86/c90 5219 1 2024-08-31T05:21:02.160 INFO:tasks.workunit.client.1.smithi073.stdout:6/377: symlink d15/d17/d26/l79 0 2024-08-31T05:21:02.160 INFO:tasks.workunit.client.1.smithi073.stdout:9/518: write dc/d37/d42/d8d/d52/fa4 [321991,73242] 0 2024-08-31T05:21:02.162 INFO:tasks.workunit.client.1.smithi073.stdout:0/460: fdatasync d0/d15/f82 0 2024-08-31T05:21:02.165 INFO:tasks.workunit.client.1.smithi073.stdout:2/412: dread d2/f35 [0,4194304] 0 2024-08-31T05:21:02.165 INFO:tasks.workunit.client.1.smithi073.stdout:0/461: fdatasync d0/d69/d7f/f71 0 2024-08-31T05:21:02.166 INFO:tasks.workunit.client.1.smithi073.stdout:1/352: creat d5/d26/f64 x:0 0 0 2024-08-31T05:21:02.168 INFO:tasks.workunit.client.1.smithi073.stdout:2/413: chown d2/d9/df/f2e 303005 1 2024-08-31T05:21:02.168 INFO:tasks.workunit.client.1.smithi073.stdout:0/462: write d0/f5b [4353957,129539] 0 2024-08-31T05:21:02.170 INFO:tasks.workunit.client.1.smithi073.stdout:1/353: write d5/d10/d33/f30 [1926222,69523] 0 2024-08-31T05:21:02.170 INFO:tasks.workunit.client.1.smithi073.stdout:7/424: dread d1/d11/d14/f63 [0,4194304] 0 2024-08-31T05:21:02.170 INFO:tasks.workunit.client.1.smithi073.stdout:3/457: dwrite da/d18/f5b [0,4194304] 0 2024-08-31T05:21:02.171 INFO:tasks.workunit.client.1.smithi073.stdout:5/467: creat dc/d16/d1a/d87/d94/faa x:0 0 0 2024-08-31T05:21:02.174 INFO:tasks.workunit.client.1.smithi073.stdout:8/497: dread d0/f1b [0,4194304] 0 2024-08-31T05:21:02.175 INFO:tasks.workunit.client.1.smithi073.stdout:9/519: mknod dc/d37/d42/d5a/da0/ca9 0 2024-08-31T05:21:02.176 INFO:tasks.workunit.client.1.smithi073.stdout:2/414: symlink d2/d9/df/d36/l86 0 2024-08-31T05:21:02.177 INFO:tasks.workunit.client.1.smithi073.stdout:0/463: mknod d0/d15/d2c/d41/d52/c95 0 2024-08-31T05:21:02.178 INFO:tasks.workunit.client.1.smithi073.stdout:5/468: mkdir dc/d3d/dab 0 2024-08-31T05:21:02.179 INFO:tasks.workunit.client.1.smithi073.stdout:9/520: dread dc/d10/f26 [0,4194304] 0 2024-08-31T05:21:02.181 INFO:tasks.workunit.client.1.smithi073.stdout:7/425: mkdir d1/da/d3e/d22/d5c/d8f 0 2024-08-31T05:21:02.183 INFO:tasks.workunit.client.1.smithi073.stdout:4/414: link d7/d1a/d5c/d6d/d2c/d2d/l5e d7/df/d13/l75 0 2024-08-31T05:21:02.184 INFO:tasks.workunit.client.1.smithi073.stdout:4/415: write d7/db/f2a [2484173,130759] 0 2024-08-31T05:21:02.185 INFO:tasks.workunit.client.1.smithi073.stdout:3/458: dread da/d3c/d65/d40/d5d/f8b [0,4194304] 0 2024-08-31T05:21:02.186 INFO:tasks.workunit.client.1.smithi073.stdout:5/469: mknod dc/d3d/d3e/cac 0 2024-08-31T05:21:02.191 INFO:tasks.workunit.client.1.smithi073.stdout:1/354: rename d5/d26/f58 to d5/f65 0 2024-08-31T05:21:02.191 INFO:tasks.workunit.client.1.smithi073.stdout:3/459: dwrite da/d3c/d65/d40/d5d/f83 [0,4194304] 0 2024-08-31T05:21:02.192 INFO:tasks.workunit.client.1.smithi073.stdout:3/460: truncate da/f52 972141 0 2024-08-31T05:21:02.195 INFO:tasks.workunit.client.1.smithi073.stdout:5/470: mknod dc/d16/d1a/d87/cad 0 2024-08-31T05:21:02.197 INFO:tasks.workunit.client.1.smithi073.stdout:6/378: creat d15/d17/d26/f7a x:0 0 0 2024-08-31T05:21:02.199 INFO:tasks.workunit.client.1.smithi073.stdout:1/355: mknod d5/d17/d3f/c66 0 2024-08-31T05:21:02.200 INFO:tasks.workunit.client.1.smithi073.stdout:8/498: write d0/f27 [1398736,22427] 0 2024-08-31T05:21:02.201 INFO:tasks.workunit.client.1.smithi073.stdout:4/416: write d7/df/d1b/d34/f49 [1617082,9393] 0 2024-08-31T05:21:02.202 INFO:tasks.workunit.client.1.smithi073.stdout:4/417: chown d7/d1a/d5c 7 1 2024-08-31T05:21:02.202 INFO:tasks.workunit.client.1.smithi073.stdout:3/461: symlink da/l9b 0 2024-08-31T05:21:02.204 INFO:tasks.workunit.client.1.smithi073.stdout:3/462: readlink da/d3c/d65/d40/l7a 0 2024-08-31T05:21:02.204 INFO:tasks.workunit.client.1.smithi073.stdout:6/379: symlink d15/d17/d26/l7b 0 2024-08-31T05:21:02.205 INFO:tasks.workunit.client.1.smithi073.stdout:0/464: truncate d0/d15/d2c/d41/d52/f74 704890 0 2024-08-31T05:21:02.206 INFO:tasks.workunit.client.1.smithi073.stdout:7/426: truncate d1/da/d38/f4c 3829688 0 2024-08-31T05:21:02.206 INFO:tasks.workunit.client.1.smithi073.stdout:0/465: chown d0/d58 40541 1 2024-08-31T05:21:02.208 INFO:tasks.workunit.client.1.smithi073.stdout:8/499: dwrite d0/db/d1c/d34/d68/f8a [0,4194304] 0 2024-08-31T05:21:02.209 INFO:tasks.workunit.client.1.smithi073.stdout:4/418: getdents d7/df/d13/d2e/d47/d4c/d50 0 2024-08-31T05:21:02.210 INFO:tasks.workunit.client.1.smithi073.stdout:1/356: write d5/f25 [4783849,120050] 0 2024-08-31T05:21:02.212 INFO:tasks.workunit.client.1.smithi073.stdout:7/427: symlink d1/da/d15/d33/d44/d60/l90 0 2024-08-31T05:21:02.213 INFO:tasks.workunit.client.1.smithi073.stdout:8/500: stat d0/c14 0 2024-08-31T05:21:02.213 INFO:tasks.workunit.client.1.smithi073.stdout:6/380: dread d15/d17/d26/f45 [0,4194304] 0 2024-08-31T05:21:02.214 INFO:tasks.workunit.client.1.smithi073.stdout:0/466: symlink d0/d15/d2c/d41/l96 0 2024-08-31T05:21:02.216 INFO:tasks.workunit.client.1.smithi073.stdout:1/357: write d5/d10/d33/fe [255109,19455] 0 2024-08-31T05:21:02.216 INFO:tasks.workunit.client.1.smithi073.stdout:7/428: rmdir d1 39 2024-08-31T05:21:02.217 INFO:tasks.workunit.client.1.smithi073.stdout:3/463: dwrite da/f10 [4194304,4194304] 0 2024-08-31T05:21:02.218 INFO:tasks.workunit.client.1.smithi073.stdout:0/467: dread - d0/d15/d2c/d41/d52/f8b zero size 2024-08-31T05:21:02.219 INFO:tasks.workunit.client.1.smithi073.stdout:1/358: stat d5/d17/d2a/f5b 0 2024-08-31T05:21:02.225 INFO:tasks.workunit.client.1.smithi073.stdout:3/464: write f9 [4587842,40817] 0 2024-08-31T05:21:02.227 INFO:tasks.workunit.client.1.smithi073.stdout:7/429: mkdir d1/d11/d91 0 2024-08-31T05:21:02.227 INFO:tasks.workunit.client.1.smithi073.stdout:4/419: dwrite d7/df/d13/f16 [0,4194304] 0 2024-08-31T05:21:02.231 INFO:tasks.workunit.client.1.smithi073.stdout:1/359: getdents d5 0 2024-08-31T05:21:02.232 INFO:tasks.workunit.client.1.smithi073.stdout:6/381: dwrite d15/f19 [0,4194304] 0 2024-08-31T05:21:02.236 INFO:tasks.workunit.client.1.smithi073.stdout:8/501: dwrite d0/f1b [0,4194304] 0 2024-08-31T05:21:02.238 INFO:tasks.workunit.client.1.smithi073.stdout:1/360: mknod d5/d10/d1c/c67 0 2024-08-31T05:21:02.240 INFO:tasks.workunit.client.1.smithi073.stdout:7/430: getdents d1/da/d65 0 2024-08-31T05:21:02.254 INFO:tasks.workunit.client.1.smithi073.stdout:8/502: write d0/db/d44/f77 [1830450,88233] 0 2024-08-31T05:21:02.254 INFO:tasks.workunit.client.1.smithi073.stdout:3/465: truncate da/d3c/d65/d2c/d8e/f93 326114 0 2024-08-31T05:21:02.255 INFO:tasks.workunit.client.1.smithi073.stdout:7/431: chown d1/da/d3e 4935038 1 2024-08-31T05:21:02.256 INFO:tasks.workunit.client.1.smithi073.stdout:6/382: chown d15/d17/d26/d38/f40 3 1 2024-08-31T05:21:02.256 INFO:tasks.workunit.client.1.smithi073.stdout:1/361: mkdir d5/d17/d32/d68 0 2024-08-31T05:21:02.259 INFO:tasks.workunit.client.1.smithi073.stdout:1/362: dread - d5/d17/f57 zero size 2024-08-31T05:21:02.259 INFO:tasks.workunit.client.1.smithi073.stdout:4/420: dwrite d7/db/f4e [0,4194304] 0 2024-08-31T05:21:02.259 INFO:tasks.workunit.client.1.smithi073.stdout:0/468: dwrite d0/d15/d2c/d4d/d3c/f13 [0,4194304] 0 2024-08-31T05:21:02.259 INFO:tasks.workunit.client.1.smithi073.stdout:3/466: creat da/d3c/d65/d2c/d8e/f9c x:0 0 0 2024-08-31T05:21:02.261 INFO:tasks.workunit.client.1.smithi073.stdout:4/421: chown d7/df/d13/f2b 0 1 2024-08-31T05:21:02.261 INFO:tasks.workunit.client.1.smithi073.stdout:3/467: stat da/d3c/d65/d40/d5d/c88 0 2024-08-31T05:21:02.264 INFO:tasks.workunit.client.1.smithi073.stdout:6/383: mkdir d15/d1a/d51/d61/d7c 0 2024-08-31T05:21:02.264 INFO:tasks.workunit.client.1.smithi073.stdout:0/469: rmdir d0/d15 39 2024-08-31T05:21:02.268 INFO:tasks.workunit.client.1.smithi073.stdout:6/384: symlink d15/d1a/d2b/d6a/l7d 0 2024-08-31T05:21:02.268 INFO:tasks.workunit.client.1.smithi073.stdout:0/470: rename d0/d58/f93 to d0/d69/d7f/f97 0 2024-08-31T05:21:02.270 INFO:tasks.workunit.client.1.smithi073.stdout:1/363: rmdir d5/d10/d1c/d35 0 2024-08-31T05:21:02.271 INFO:tasks.workunit.client.1.smithi073.stdout:3/468: mknod da/d3c/d65/c9d 0 2024-08-31T05:21:02.273 INFO:tasks.workunit.client.1.smithi073.stdout:6/385: mkdir d15/d1a/d1e/d69/d7e 0 2024-08-31T05:21:02.273 INFO:tasks.workunit.client.1.smithi073.stdout:8/503: link d0/db/d1c/d23/l3a d0/db/d44/d72/d75/l98 0 2024-08-31T05:21:02.274 INFO:tasks.workunit.client.1.smithi073.stdout:4/422: dwrite d7/f46 [0,4194304] 0 2024-08-31T05:21:02.275 INFO:tasks.workunit.client.1.smithi073.stdout:0/471: rename d0/d69/d7f/l85 to d0/d28/l98 0 2024-08-31T05:21:02.276 INFO:tasks.workunit.client.1.smithi073.stdout:3/469: fdatasync da/fb 0 2024-08-31T05:21:02.277 INFO:tasks.workunit.client.1.smithi073.stdout:8/504: creat d0/db/d44/d72/d75/d7e/f99 x:0 0 0 2024-08-31T05:21:02.279 INFO:tasks.workunit.client.1.smithi073.stdout:0/472: fdatasync d0/d15/d2c/d40/f56 0 2024-08-31T05:21:02.280 INFO:tasks.workunit.client.1.smithi073.stdout:8/505: write d0/db/d44/f84 [2804976,40473] 0 2024-08-31T05:21:02.281 INFO:tasks.workunit.client.1.smithi073.stdout:6/386: creat d15/f7f x:0 0 0 2024-08-31T05:21:02.281 INFO:tasks.workunit.client.1.smithi073.stdout:4/423: dread d7/db/f19 [0,4194304] 0 2024-08-31T05:21:02.283 INFO:tasks.workunit.client.1.smithi073.stdout:0/473: mkdir d0/d69/d8e/d99 0 2024-08-31T05:21:02.286 INFO:tasks.workunit.client.1.smithi073.stdout:6/387: fsync d15/d17/d26/f67 0 2024-08-31T05:21:02.288 INFO:tasks.workunit.client.1.smithi073.stdout:6/388: chown d15/d75 12 1 2024-08-31T05:21:02.289 INFO:tasks.workunit.client.1.smithi073.stdout:6/389: readlink d15/l48 0 2024-08-31T05:21:02.290 INFO:tasks.workunit.client.1.smithi073.stdout:6/390: stat d15/l48 0 2024-08-31T05:21:02.290 INFO:tasks.workunit.client.1.smithi073.stdout:8/506: dwrite d0/d62/f8d [0,4194304] 0 2024-08-31T05:21:02.291 INFO:tasks.workunit.client.1.smithi073.stdout:4/424: dwrite d7/df/d1b/d34/f49 [0,4194304] 0 2024-08-31T05:21:02.292 INFO:tasks.workunit.client.1.smithi073.stdout:6/391: chown d15/d1a/d2b/d2f/f30 295 1 2024-08-31T05:21:02.295 INFO:tasks.workunit.client.1.smithi073.stdout:3/470: write da/d3c/d65/d45/f55 [2305791,78108] 0 2024-08-31T05:21:02.295 INFO:tasks.workunit.client.1.smithi073.stdout:0/474: write d0/d15/d2c/d4d/d3c/ff [3419292,69567] 0 2024-08-31T05:21:02.295 INFO:tasks.workunit.client.1.smithi073.stdout:8/507: write d0/db/d1c/d23/f26 [4623062,102266] 0 2024-08-31T05:21:02.296 INFO:tasks.workunit.client.1.smithi073.stdout:4/425: fsync d7/df/d13/d2e/d70/f6c 0 2024-08-31T05:21:02.298 INFO:tasks.workunit.client.1.smithi073.stdout:3/471: fdatasync da/d18/f5b 0 2024-08-31T05:21:02.298 INFO:tasks.workunit.client.1.smithi073.stdout:6/392: creat d15/d1a/d51/d61/f80 x:0 0 0 2024-08-31T05:21:02.300 INFO:tasks.workunit.client.1.smithi073.stdout:6/393: chown d15/d17/d26/f45 68 1 2024-08-31T05:21:02.302 INFO:tasks.workunit.client.1.smithi073.stdout:6/394: write d15/d17/d26/d38/f3d [2629312,1614] 0 2024-08-31T05:21:02.303 INFO:tasks.workunit.client.1.smithi073.stdout:3/472: mknod da/d3c/d67/c9e 0 2024-08-31T05:21:02.304 INFO:tasks.workunit.client.1.smithi073.stdout:8/508: mkdir d0/db/d1c/d34/d80/d9a 0 2024-08-31T05:21:02.306 INFO:tasks.workunit.client.1.smithi073.stdout:4/426: dwrite d7/d1a/d5c/d6d/d59/f74 [0,4194304] 0 2024-08-31T05:21:02.307 INFO:tasks.workunit.client.1.smithi073.stdout:6/395: creat d15/d1a/d51/d6e/d72/f81 x:0 0 0 2024-08-31T05:21:02.307 INFO:tasks.workunit.client.1.smithi073.stdout:3/473: chown da/d3c/d65/d40/d5d/f89 78 1 2024-08-31T05:21:02.311 INFO:tasks.workunit.client.1.smithi073.stdout:6/396: mknod d15/d1a/d1e/c82 0 2024-08-31T05:21:02.311 INFO:tasks.workunit.client.1.smithi073.stdout:3/474: creat da/d3c/d65/d40/f9f x:0 0 0 2024-08-31T05:21:02.313 INFO:tasks.workunit.client.1.smithi073.stdout:4/427: getdents d7/d1a/d5c/d6d/d59/d65 0 2024-08-31T05:21:02.315 INFO:tasks.workunit.client.1.smithi073.stdout:6/397: symlink d15/d1a/d51/d61/l83 0 2024-08-31T05:21:02.316 INFO:tasks.workunit.client.1.smithi073.stdout:8/509: dwrite d0/db/d1c/d24/f74 [0,4194304] 0 2024-08-31T05:21:02.328 INFO:tasks.workunit.client.1.smithi073.stdout:3/475: dwrite da/d3c/f5e [0,4194304] 0 2024-08-31T05:21:02.328 INFO:tasks.workunit.client.1.smithi073.stdout:6/398: getdents d15/d17/d26 0 2024-08-31T05:21:02.330 INFO:tasks.workunit.client.1.smithi073.stdout:6/399: stat d15/d1a/d2b/d2f/l4e 0 2024-08-31T05:21:02.333 INFO:tasks.workunit.client.1.smithi073.stdout:0/475: dwrite d0/d58/f6e [0,4194304] 0 2024-08-31T05:21:02.336 INFO:tasks.workunit.client.1.smithi073.stdout:8/510: dwrite d0/db/d44/f4d [4194304,4194304] 0 2024-08-31T05:21:02.341 INFO:tasks.workunit.client.1.smithi073.stdout:3/476: truncate da/d3c/d65/f20 3567391 0 2024-08-31T05:21:02.344 INFO:tasks.workunit.client.1.smithi073.stdout:0/476: dread d0/d58/f6e [0,4194304] 0 2024-08-31T05:21:02.345 INFO:tasks.workunit.client.1.smithi073.stdout:6/400: dwrite d15/d75/f78 [0,4194304] 0 2024-08-31T05:21:02.348 INFO:tasks.workunit.client.1.smithi073.stdout:6/401: dread - d15/d1a/d2b/f71 zero size 2024-08-31T05:21:02.348 INFO:tasks.workunit.client.1.smithi073.stdout:8/511: dwrite d0/db/d1c/d24/f53 [0,4194304] 0 2024-08-31T05:21:02.349 INFO:tasks.workunit.client.1.smithi073.stdout:2/415: sync 2024-08-31T05:21:02.350 INFO:tasks.workunit.client.1.smithi073.stdout:3/477: symlink da/d3c/d65/la0 0 2024-08-31T05:21:02.351 INFO:tasks.workunit.client.1.smithi073.stdout:0/477: creat d0/d15/d2c/d40/f9a x:0 0 0 2024-08-31T05:21:02.352 INFO:tasks.workunit.client.1.smithi073.stdout:3/478: chown da/d3c/d82/d95 13338227 1 2024-08-31T05:21:02.352 INFO:tasks.workunit.client.1.smithi073.stdout:3/479: stat da/f62 0 2024-08-31T05:21:02.353 INFO:tasks.workunit.client.1.smithi073.stdout:6/402: symlink d15/d1a/d2b/d2f/l84 0 2024-08-31T05:21:02.353 INFO:tasks.workunit.client.1.smithi073.stdout:6/403: chown d15/c42 2576 1 2024-08-31T05:21:02.353 INFO:tasks.workunit.client.1.smithi073.stdout:8/512: creat d0/db/d1c/d24/d73/f9b x:0 0 0 2024-08-31T05:21:02.353 INFO:tasks.workunit.client.1.smithi073.stdout:6/404: write d15/d1a/d1e/f24 [3205125,106581] 0 2024-08-31T05:21:02.360 INFO:tasks.workunit.client.1.smithi073.stdout:8/513: symlink d0/db/d44/d72/l9c 0 2024-08-31T05:21:02.362 INFO:tasks.workunit.client.1.smithi073.stdout:6/405: dwrite d15/d17/d26/f45 [0,4194304] 0 2024-08-31T05:21:02.364 INFO:tasks.workunit.client.1.smithi073.stdout:8/514: mkdir d0/db/d1c/d34/d68/d9d 0 2024-08-31T05:21:02.367 INFO:tasks.workunit.client.1.smithi073.stdout:8/515: dread d0/db/d44/f70 [0,4194304] 0 2024-08-31T05:21:02.370 INFO:tasks.workunit.client.1.smithi073.stdout:8/516: mkdir d0/db/d44/d9e 0 2024-08-31T05:21:02.371 INFO:tasks.workunit.client.1.smithi073.stdout:6/406: dwrite d15/d1a/d2b/d2f/f3f [4194304,4194304] 0 2024-08-31T05:21:02.394 INFO:tasks.workunit.client.1.smithi073.stdout:3/480: truncate da/f10 7626304 0 2024-08-31T05:21:02.395 INFO:tasks.workunit.client.1.smithi073.stdout:0/478: truncate d0/f29 329279 0 2024-08-31T05:21:02.397 INFO:tasks.workunit.client.1.smithi073.stdout:0/479: mkdir d0/d15/d9b 0 2024-08-31T05:21:02.399 INFO:tasks.workunit.client.1.smithi073.stdout:6/407: write fa [1747228,19398] 0 2024-08-31T05:21:02.400 INFO:tasks.workunit.client.1.smithi073.stdout:0/480: mkdir d0/d15/d2c/d4d/d3c/d9c 0 2024-08-31T05:21:02.400 INFO:tasks.workunit.client.1.smithi073.stdout:3/481: dwrite da/d3c/d65/d40/d5d/f8b [0,4194304] 0 2024-08-31T05:21:02.402 INFO:tasks.workunit.client.1.smithi073.stdout:0/481: write d0/d69/d7f/f71 [518829,44018] 0 2024-08-31T05:21:02.403 INFO:tasks.workunit.client.1.smithi073.stdout:3/482: write da/d68/f69 [638568,79060] 0 2024-08-31T05:21:02.405 INFO:tasks.workunit.client.1.smithi073.stdout:6/408: link d15/d17/d26/d38/f62 d15/d75/f85 0 2024-08-31T05:21:02.406 INFO:tasks.workunit.client.1.smithi073.stdout:6/409: truncate d15/d1a/d51/f70 474439 0 2024-08-31T05:21:02.407 INFO:tasks.workunit.client.1.smithi073.stdout:0/482: rename d0/d15/d2c/d40/f84 to d0/d69/d8e/d99/f9d 0 2024-08-31T05:21:02.408 INFO:tasks.workunit.client.1.smithi073.stdout:0/483: write d0/f33 [985509,68115] 0 2024-08-31T05:21:02.410 INFO:tasks.workunit.client.1.smithi073.stdout:6/410: getdents d15/d1a/d51/d6e/d72 0 2024-08-31T05:21:02.410 INFO:tasks.workunit.client.1.smithi073.stdout:0/484: truncate d0/d69/d7f/f97 608438 0 2024-08-31T05:21:02.410 INFO:tasks.workunit.client.1.smithi073.stdout:6/411: dread - d15/d1a/d2b/d2f/f30 zero size 2024-08-31T05:21:02.412 INFO:tasks.workunit.client.1.smithi073.stdout:0/485: symlink d0/d15/d2c/d40/l9e 0 2024-08-31T05:21:02.413 INFO:tasks.workunit.client.1.smithi073.stdout:6/412: creat d15/d17/d26/d38/f86 x:0 0 0 2024-08-31T05:21:02.415 INFO:tasks.workunit.client.1.smithi073.stdout:6/413: mkdir d15/d1a/d51/d6e/d72/d87 0 2024-08-31T05:21:02.425 INFO:tasks.workunit.client.1.smithi073.stdout:6/414: dread d15/d1a/d1e/f3e [0,4194304] 0 2024-08-31T05:21:02.426 INFO:tasks.workunit.client.1.smithi073.stdout:6/415: chown d15/d1a/l1c 2853 1 2024-08-31T05:21:02.428 INFO:tasks.workunit.client.1.smithi073.stdout:0/486: dread d0/d15/d2c/d40/f6d [0,4194304] 0 2024-08-31T05:21:02.428 INFO:tasks.workunit.client.1.smithi073.stdout:6/416: mkdir d15/d1a/d2b/d2f/d4b/d88 0 2024-08-31T05:21:02.431 INFO:tasks.workunit.client.1.smithi073.stdout:6/417: unlink d15/d1a/d1e/f25 0 2024-08-31T05:21:02.432 INFO:tasks.workunit.client.1.smithi073.stdout:0/487: fdatasync d0/d69/d8e/d99/f9d 0 2024-08-31T05:21:02.433 INFO:tasks.workunit.client.1.smithi073.stdout:6/418: mkdir d15/d41/d89 0 2024-08-31T05:21:02.434 INFO:tasks.workunit.client.1.smithi073.stdout:0/488: rename d0/d15/d2c/d4d/d3c/ff to d0/d15/d9b/f9f 0 2024-08-31T05:21:02.434 INFO:tasks.workunit.client.1.smithi073.stdout:6/419: read d15/d17/f65 [336337,88352] 0 2024-08-31T05:21:02.436 INFO:tasks.workunit.client.1.smithi073.stdout:6/420: write d15/d1a/d1e/f24 [9154571,83078] 0 2024-08-31T05:21:02.436 INFO:tasks.workunit.client.1.smithi073.stdout:0/489: mknod d0/d15/d2c/d40/ca0 0 2024-08-31T05:21:02.436 INFO:tasks.workunit.client.1.smithi073.stdout:6/421: fsync d15/f29 0 2024-08-31T05:21:02.439 INFO:tasks.workunit.client.1.smithi073.stdout:6/422: creat d15/d17/d26/d38/f8a x:0 0 0 2024-08-31T05:21:02.439 INFO:tasks.workunit.client.1.smithi073.stdout:6/423: stat d15/d17/d26/l79 0 2024-08-31T05:21:02.442 INFO:tasks.workunit.client.1.smithi073.stdout:0/490: dwrite d0/d15/d2c/d4d/d3c/f13 [0,4194304] 0 2024-08-31T05:21:02.442 INFO:tasks.workunit.client.1.smithi073.stdout:6/424: rmdir d15/d1a/d2b/d2f/d4b 39 2024-08-31T05:21:02.443 INFO:tasks.workunit.client.1.smithi073.stdout:0/491: write d0/d15/f37 [2946316,124129] 0 2024-08-31T05:21:02.444 INFO:tasks.workunit.client.1.smithi073.stdout:0/492: dread - d0/d58/d63/f7e zero size 2024-08-31T05:21:02.445 INFO:tasks.workunit.client.1.smithi073.stdout:6/425: chown d15/d1a/d2b/l39 635 1 2024-08-31T05:21:02.452 INFO:tasks.workunit.client.1.smithi073.stdout:0/493: dwrite d0/f21 [4194304,4194304] 0 2024-08-31T05:21:02.453 INFO:tasks.workunit.client.1.smithi073.stdout:0/494: write d0/d69/d7f/f78 [372539,130053] 0 2024-08-31T05:21:02.459 INFO:tasks.workunit.client.1.smithi073.stdout:0/495: rename d0/d15/d2c/d40/ca0 to d0/d69/d8e/d99/ca1 0 2024-08-31T05:21:02.463 INFO:tasks.workunit.client.1.smithi073.stdout:0/496: link d0/d15/d2c/d40/d4a/f87 d0/d15/d2c/d41/d52/fa2 0 2024-08-31T05:21:02.464 INFO:tasks.workunit.client.1.smithi073.stdout:9/521: sync 2024-08-31T05:21:02.465 INFO:tasks.workunit.client.1.smithi073.stdout:6/426: dread d15/d17/d26/f2c [0,4194304] 0 2024-08-31T05:21:02.465 INFO:tasks.workunit.client.1.smithi073.stdout:9/522: rmdir dc/d37/d42/d8d/d52/d5b 39 2024-08-31T05:21:02.472 INFO:tasks.workunit.client.1.smithi073.stdout:9/523: dwrite dc/de/d66/d84/f90 [0,4194304] 0 2024-08-31T05:21:02.472 INFO:tasks.workunit.client.1.smithi073.stdout:6/427: dwrite d15/d1a/d2b/d2f/d4b/f6b [0,4194304] 0 2024-08-31T05:21:02.475 INFO:tasks.workunit.client.1.smithi073.stdout:9/524: symlink dc/de/d66/laa 0 2024-08-31T05:21:02.477 INFO:tasks.workunit.client.1.smithi073.stdout:9/525: symlink dc/de/d56/lab 0 2024-08-31T05:21:02.480 INFO:tasks.workunit.client.1.smithi073.stdout:9/526: truncate dc/d10/f49 45170 0 2024-08-31T05:21:02.481 INFO:tasks.workunit.client.1.smithi073.stdout:6/428: dread d15/d17/d26/d38/f4a [0,4194304] 0 2024-08-31T05:21:02.481 INFO:tasks.workunit.client.1.smithi073.stdout:9/527: truncate dc/d37/d42/f76 756459 0 2024-08-31T05:21:02.482 INFO:tasks.workunit.client.1.smithi073.stdout:9/528: readlink dc/l3f 0 2024-08-31T05:21:02.483 INFO:tasks.workunit.client.1.smithi073.stdout:6/429: dread d15/d17/f65 [0,4194304] 0 2024-08-31T05:21:02.484 INFO:tasks.workunit.client.1.smithi073.stdout:9/529: rename dc to dc/d37/d42/d8d/d52/d5b/dac 22 2024-08-31T05:21:02.484 INFO:tasks.workunit.client.1.smithi073.stdout:6/430: readlink d15/d17/d26/d38/l55 0 2024-08-31T05:21:02.485 INFO:tasks.workunit.client.1.smithi073.stdout:6/431: chown d15/f36 7204652 1 2024-08-31T05:21:02.488 INFO:tasks.workunit.client.1.smithi073.stdout:9/530: mknod dc/de/d66/cad 0 2024-08-31T05:21:02.488 INFO:tasks.workunit.client.1.smithi073.stdout:6/432: rename fa to d15/d1a/d2b/d2f/d4b/d88/f8b 0 2024-08-31T05:21:02.489 INFO:tasks.workunit.client.1.smithi073.stdout:9/531: symlink dc/de/d66/d84/da2/lae 0 2024-08-31T05:21:02.489 INFO:tasks.workunit.client.1.smithi073.stdout:6/433: symlink d15/d1a/d2b/d2f/d4b/d88/l8c 0 2024-08-31T05:21:02.490 INFO:tasks.workunit.client.1.smithi073.stdout:6/434: write d15/d17/d26/d38/f5f [660948,7150] 0 2024-08-31T05:21:02.491 INFO:tasks.workunit.client.1.smithi073.stdout:9/532: getdents dc/d37/d42/d5a 0 2024-08-31T05:21:02.492 INFO:tasks.workunit.client.1.smithi073.stdout:9/533: dread - dc/de/d11/fa6 zero size 2024-08-31T05:21:02.492 INFO:tasks.workunit.client.1.smithi073.stdout:6/435: mknod d15/d17/d26/c8d 0 2024-08-31T05:21:02.494 INFO:tasks.workunit.client.1.smithi073.stdout:6/436: creat d15/d1a/d1e/d69/d7e/f8e x:0 0 0 2024-08-31T05:21:02.496 INFO:tasks.workunit.client.1.smithi073.stdout:6/437: rmdir d15/d1a/d2b/d2f/d4b/d88 39 2024-08-31T05:21:02.496 INFO:tasks.workunit.client.1.smithi073.stdout:6/438: fsync d15/d1a/d1e/f24 0 2024-08-31T05:21:02.502 INFO:tasks.workunit.client.1.smithi073.stdout:9/534: truncate dc/de/d66/f83 3002984 0 2024-08-31T05:21:02.503 INFO:tasks.workunit.client.1.smithi073.stdout:6/439: write fd [3144485,17276] 0 2024-08-31T05:21:02.506 INFO:tasks.workunit.client.1.smithi073.stdout:6/440: rename d15/f7f to d15/d1a/d2b/d2f/d4b/f8f 0 2024-08-31T05:21:02.507 INFO:tasks.workunit.client.1.smithi073.stdout:9/535: link dc/f98 dc/d37/d42/d8d/d52/faf 0 2024-08-31T05:21:02.508 INFO:tasks.workunit.client.1.smithi073.stdout:9/536: stat dc/de/d11/d85/c9a 0 2024-08-31T05:21:02.509 INFO:tasks.workunit.client.1.smithi073.stdout:6/441: link d15/d1a/d2b/f4c d15/d1a/d1e/d69/d7e/f90 0 2024-08-31T05:21:02.510 INFO:tasks.workunit.client.1.smithi073.stdout:9/537: rename dc/l8f to dc/d37/d42/d8d/d52/d5b/d73/lb0 0 2024-08-31T05:21:02.511 INFO:tasks.workunit.client.1.smithi073.stdout:9/538: write f5 [1058271,9199] 0 2024-08-31T05:21:02.511 INFO:tasks.workunit.client.1.smithi073.stdout:6/442: write d15/d1a/d2b/d2f/d4b/d88/f8b [2273271,120847] 0 2024-08-31T05:21:02.513 INFO:tasks.workunit.client.1.smithi073.stdout:9/539: write dc/d10/f29 [1885961,80338] 0 2024-08-31T05:21:02.514 INFO:tasks.workunit.client.1.smithi073.stdout:6/443: creat d15/d17/f91 x:0 0 0 2024-08-31T05:21:02.516 INFO:tasks.workunit.client.1.smithi073.stdout:9/540: getdents dc/de/d11 0 2024-08-31T05:21:02.523 INFO:tasks.workunit.client.1.smithi073.stdout:9/541: mkdir dc/d37/d42/d5a/da0/db1 0 2024-08-31T05:21:02.525 INFO:tasks.workunit.client.1.smithi073.stdout:6/444: dread d15/f29 [0,4194304] 0 2024-08-31T05:21:02.526 INFO:tasks.workunit.client.1.smithi073.stdout:9/542: creat dc/d37/d42/d8d/d52/d5b/fb2 x:0 0 0 2024-08-31T05:21:02.528 INFO:tasks.workunit.client.1.smithi073.stdout:9/543: rename dc/de/d11/f43 to dc/d10/fb3 0 2024-08-31T05:21:02.530 INFO:tasks.workunit.client.1.smithi073.stdout:9/544: mkdir dc/d37/d42/d5a/db4 0 2024-08-31T05:21:02.533 INFO:tasks.workunit.client.1.smithi073.stdout:6/445: dwrite d15/d17/d26/f34 [0,4194304] 0 2024-08-31T05:21:02.533 INFO:tasks.workunit.client.1.smithi073.stdout:6/446: readlink d15/d1a/d2b/d2f/d4b/d88/l8c 0 2024-08-31T05:21:02.534 INFO:tasks.workunit.client.1.smithi073.stdout:6/447: stat d15/d17/d26/d38/l55 0 2024-08-31T05:21:02.535 INFO:tasks.workunit.client.1.smithi073.stdout:9/545: rename dc/d37/d42/d5a/da0/db1 to dc/d37/db5 0 2024-08-31T05:21:02.540 INFO:tasks.workunit.client.1.smithi073.stdout:6/448: dwrite d15/d1a/d51/d61/f80 [0,4194304] 0 2024-08-31T05:21:02.543 INFO:tasks.workunit.client.1.smithi073.stdout:9/546: rename dc/de/d11/c2c to dc/d82/cb6 0 2024-08-31T05:21:02.546 INFO:tasks.workunit.client.1.smithi073.stdout:6/449: symlink d15/d41/l92 0 2024-08-31T05:21:02.550 INFO:tasks.workunit.client.1.smithi073.stdout:5/471: sync 2024-08-31T05:21:02.550 INFO:tasks.workunit.client.1.smithi073.stdout:7/432: sync 2024-08-31T05:21:02.551 INFO:tasks.workunit.client.1.smithi073.stdout:1/364: sync 2024-08-31T05:21:02.552 INFO:tasks.workunit.client.1.smithi073.stdout:7/433: chown d1/d11 118 1 2024-08-31T05:21:02.554 INFO:tasks.workunit.client.1.smithi073.stdout:1/365: write d5/fc [1120852,62209] 0 2024-08-31T05:21:02.558 INFO:tasks.workunit.client.1.smithi073.stdout:7/434: rename d1/da/d15/d33/c4e to d1/da/d3e/d22/d47/c92 0 2024-08-31T05:21:02.558 INFO:tasks.workunit.client.1.smithi073.stdout:5/472: dwrite dc/d16/d1a/f72 [0,4194304] 0 2024-08-31T05:21:02.559 INFO:tasks.workunit.client.1.smithi073.stdout:1/366: mkdir d5/d10/d1c/d69 0 2024-08-31T05:21:02.560 INFO:tasks.workunit.client.1.smithi073.stdout:1/367: read - d5/d10/d1b/f63 zero size 2024-08-31T05:21:02.562 INFO:tasks.workunit.client.1.smithi073.stdout:5/473: creat dc/d16/d4e/fae x:0 0 0 2024-08-31T05:21:02.564 INFO:tasks.workunit.client.1.smithi073.stdout:9/547: dread dc/d10/f33 [0,4194304] 0 2024-08-31T05:21:02.568 INFO:tasks.workunit.client.1.smithi073.stdout:6/450: write d15/d17/d26/d38/f62 [3514350,101145] 0 2024-08-31T05:21:02.572 INFO:tasks.workunit.client.1.smithi073.stdout:5/474: mknod dc/d3d/dab/caf 0 2024-08-31T05:21:02.572 INFO:tasks.workunit.client.1.smithi073.stdout:5/475: dread - dc/d16/d1a/d87/f9b zero size 2024-08-31T05:21:02.573 INFO:tasks.workunit.client.1.smithi073.stdout:7/435: link d1/da/d3e/d22/d5c/c78 d1/da/d15/d33/d44/d74/c93 0 2024-08-31T05:21:02.574 INFO:tasks.workunit.client.1.smithi073.stdout:6/451: readlink d15/d17/d26/l7b 0 2024-08-31T05:21:02.574 INFO:tasks.workunit.client.1.smithi073.stdout:7/436: write d1/da/d15/f4b [3251852,32718] 0 2024-08-31T05:21:02.574 INFO:tasks.workunit.client.1.smithi073.stdout:1/368: link d5/d10/d33/l5c d5/d10/d1c/d27/d51/l6a 0 2024-08-31T05:21:02.578 INFO:tasks.workunit.client.1.smithi073.stdout:1/369: getdents d5/d17/d32/d68 0 2024-08-31T05:21:02.580 INFO:tasks.workunit.client.1.smithi073.stdout:6/452: dread d15/d1a/d2b/d2f/d4b/f57 [0,4194304] 0 2024-08-31T05:21:02.581 INFO:tasks.workunit.client.1.smithi073.stdout:7/437: link d1/d11/f53 d1/da/f94 0 2024-08-31T05:21:02.581 INFO:tasks.workunit.client.1.smithi073.stdout:5/476: dwrite dc/d16/d4e/f5e [0,4194304] 0 2024-08-31T05:21:02.585 INFO:tasks.workunit.client.1.smithi073.stdout:6/453: chown d15/d17/d26/f2c 3473747 1 2024-08-31T05:21:02.591 INFO:tasks.workunit.client.1.smithi073.stdout:5/477: mknod dc/d16/cb0 0 2024-08-31T05:21:02.593 INFO:tasks.workunit.client.1.smithi073.stdout:1/370: link d5/d10/d1c/c67 d5/d17/d2a/c6b 0 2024-08-31T05:21:02.594 INFO:tasks.workunit.client.1.smithi073.stdout:1/371: write d5/d10/d1c/f50 [69887,15366] 0 2024-08-31T05:21:02.595 INFO:tasks.workunit.client.1.smithi073.stdout:5/478: chown dc/d3d/d3e/c59 123 1 2024-08-31T05:21:02.595 INFO:tasks.workunit.client.1.smithi073.stdout:1/372: dread - d5/d26/f64 zero size 2024-08-31T05:21:02.596 INFO:tasks.workunit.client.1.smithi073.stdout:6/454: rename d15/d17/d26/d38/l55 to d15/d1a/d2b/d2f/d4b/l93 0 2024-08-31T05:21:02.600 INFO:tasks.workunit.client.1.smithi073.stdout:9/548: dread dc/f98 [0,4194304] 0 2024-08-31T05:21:02.600 INFO:tasks.workunit.client.1.smithi073.stdout:1/373: dread d5/d10/d1c/f50 [0,4194304] 0 2024-08-31T05:21:02.603 INFO:tasks.workunit.client.1.smithi073.stdout:9/549: stat dc/f25 0 2024-08-31T05:21:02.607 INFO:tasks.workunit.client.1.smithi073.stdout:9/550: readlink dc/d10/l8c 0 2024-08-31T05:21:02.609 INFO:tasks.workunit.client.1.smithi073.stdout:1/374: readlink d5/d10/d1c/d27/d51/l6a 0 2024-08-31T05:21:02.611 INFO:tasks.workunit.client.1.smithi073.stdout:5/479: dwrite dc/d53/f79 [0,4194304] 0 2024-08-31T05:21:02.613 INFO:tasks.workunit.client.1.smithi073.stdout:6/455: dwrite d15/d1a/d51/f70 [0,4194304] 0 2024-08-31T05:21:02.614 INFO:tasks.workunit.client.1.smithi073.stdout:4/428: sync 2024-08-31T05:21:02.614 INFO:tasks.workunit.client.1.smithi073.stdout:7/438: dwrite d1/da/d3e/d22/d47/f51 [0,4194304] 0 2024-08-31T05:21:02.617 INFO:tasks.workunit.client.1.smithi073.stdout:1/375: creat d5/d26/d54/f6c x:0 0 0 2024-08-31T05:21:02.618 INFO:tasks.workunit.client.1.smithi073.stdout:6/456: rmdir d15/d1a/d1e/d69/d7e 39 2024-08-31T05:21:02.623 INFO:tasks.workunit.client.1.smithi073.stdout:9/551: getdents dc/d37/d42/d5a/d89 0 2024-08-31T05:21:02.626 INFO:tasks.workunit.client.1.smithi073.stdout:4/429: dwrite d7/d1a/d5c/d6d/f6e [0,4194304] 0 2024-08-31T05:21:02.630 INFO:tasks.workunit.client.1.smithi073.stdout:5/480: link dc/d16/d3b/d3f/d4f/c7c dc/d3d/d55/d84/d49/cb1 0 2024-08-31T05:21:02.637 INFO:tasks.workunit.client.1.smithi073.stdout:7/439: truncate d1/da/d3e/f1f 3717774 0 2024-08-31T05:21:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.637+0000 7fd389ded640 1 -- 172.21.15.67:0/4012781602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd384109bc0 msgr2=0x7fd3840731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.637+0000 7fd389ded640 1 --2- 172.21.15.67:0/4012781602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd384109bc0 0x7fd3840731b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009880 tx=0x7fd36c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:21:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.638+0000 7fd389ded640 1 -- 172.21.15.67:0/4012781602 shutdown_connections 2024-08-31T05:21:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.638+0000 7fd389ded640 1 --2- 172.21.15.67:0/4012781602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd384109bc0 0x7fd3840731b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.638+0000 7fd389ded640 1 --2- 172.21.15.67:0/4012781602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3841091f0 0x7fd3841095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.638+0000 7fd389ded640 1 -- 172.21.15.67:0/4012781602 >> 172.21.15.67:0/4012781602 conn(0x7fd38406e7f0 msgr2=0x7fd384070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.638+0000 7fd389ded640 1 -- 172.21.15.67:0/4012781602 shutdown_connections 2024-08-31T05:21:02.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.638+0000 7fd389ded640 1 -- 172.21.15.67:0/4012781602 wait complete. 2024-08-31T05:21:02.641 INFO:tasks.workunit.client.1.smithi073.stdout:7/440: symlink d1/d11/d91/l95 0 2024-08-31T05:21:02.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.638+0000 7fd389ded640 1 Processor -- start 2024-08-31T05:21:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.639+0000 7fd389ded640 1 -- start start 2024-08-31T05:21:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.639+0000 7fd389ded640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3841091f0 0x7fd38410bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.639+0000 7fd389ded640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd384109bc0 0x7fd38410a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.639+0000 7fd389ded640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd384112d60 con 0x7fd3841091f0 2024-08-31T05:21:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.639+0000 7fd389ded640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd384112be0 con 0x7fd384109bc0 2024-08-31T05:21:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.639+0000 7fd37bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd384109bc0 0x7fd38410a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.639+0000 7fd3837fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3841091f0 0x7fd38410bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.639+0000 7fd3837fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3841091f0 0x7fd38410bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54114/0 (socket says 172.21.15.67:54114) 2024-08-31T05:21:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.639+0000 7fd3837fe640 1 -- 172.21.15.67:0/3101847252 learned_addr learned my addr 172.21.15.67:0/3101847252 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:21:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.639+0000 7fd37bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd384109bc0 0x7fd38410a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:40346/0 (socket says 172.21.15.67:40346) 2024-08-31T05:21:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.639+0000 7fd3837fe640 1 -- 172.21.15.67:0/3101847252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd384109bc0 msgr2=0x7fd38410a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.639+0000 7fd3837fe640 1 --2- 172.21.15.67:0/3101847252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd384109bc0 0x7fd38410a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:02.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.639+0000 7fd3837fe640 1 -- 172.21.15.67:0/3101847252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38410a7a0 con 0x7fd3841091f0 2024-08-31T05:21:02.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.640+0000 7fd3837fe640 1 --2- 172.21.15.67:0/3101847252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3841091f0 0x7fd38410bba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd37400e940 tx=0x7fd37400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:02.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.640+0000 7fd3817fa640 1 -- 172.21.15.67:0/3101847252 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd37400cac0 con 0x7fd3841091f0 2024-08-31T05:21:02.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.640+0000 7fd389ded640 1 -- 172.21.15.67:0/3101847252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38410aa90 con 0x7fd3841091f0 2024-08-31T05:21:02.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.640+0000 7fd389ded640 1 -- 172.21.15.67:0/3101847252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd38410aff0 con 0x7fd3841091f0 2024-08-31T05:21:02.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.640+0000 7fd3817fa640 1 -- 172.21.15.67:0/3101847252 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd37400cc60 con 0x7fd3841091f0 2024-08-31T05:21:02.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.640+0000 7fd3817fa640 1 -- 172.21.15.67:0/3101847252 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd374003e30 con 0x7fd3841091f0 2024-08-31T05:21:02.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.641+0000 7fd389ded640 1 -- 172.21.15.67:0/3101847252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3640052c0 con 0x7fd3841091f0 2024-08-31T05:21:02.644 INFO:tasks.workunit.client.1.smithi073.stdout:9/552: dwrite dc/f98 [0,4194304] 0 2024-08-31T05:21:02.645 INFO:tasks.workunit.client.1.smithi073.stdout:9/553: symlink dc/de/d11/lb7 0 2024-08-31T05:21:02.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.642+0000 7fd3817fa640 1 -- 172.21.15.67:0/3101847252 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7fd374004000 con 0x7fd3841091f0 2024-08-31T05:21:02.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.643+0000 7fd3817fa640 1 --2- 172.21.15.67:0/3101847252 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fd370074130 0x7fd3700765f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:02.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.643+0000 7fd3817fa640 1 -- 172.21.15.67:0/3101847252 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7fd3740957d0 con 0x7fd3841091f0 2024-08-31T05:21:02.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.643+0000 7fd37bfff640 1 --2- 172.21.15.67:0/3101847252 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fd370074130 0x7fd3700765f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:02.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.644+0000 7fd37bfff640 1 --2- 172.21.15.67:0/3101847252 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fd370074130 0x7fd3700765f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd36c000c00 tx=0x7fd36c005a20 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:02.647 INFO:tasks.workunit.client.1.smithi073.stdout:7/441: dwrite d1/da/d65/f7e [0,4194304] 0 2024-08-31T05:21:02.648 INFO:tasks.workunit.client.1.smithi073.stdout:9/554: write dc/d10/fb3 [4451953,71544] 0 2024-08-31T05:21:02.649 INFO:tasks.workunit.client.1.smithi073.stdout:7/442: write d1/d11/f53 [5057489,122987] 0 2024-08-31T05:21:02.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.649+0000 7fd3817fa640 1 -- 172.21.15.67:0/3101847252 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fd37405d220 con 0x7fd3841091f0 2024-08-31T05:21:02.658 INFO:tasks.workunit.client.1.smithi073.stdout:9/555: dwrite dc/f25 [8388608,4194304] 0 2024-08-31T05:21:02.659 INFO:tasks.workunit.client.1.smithi073.stdout:4/430: dread d7/df/f3f [0,4194304] 0 2024-08-31T05:21:02.713 INFO:tasks.workunit.client.1.smithi073.stdout:9/556: mkdir dc/d37/d42/d5a/d89/db8 0 2024-08-31T05:21:02.714 INFO:tasks.workunit.client.1.smithi073.stdout:8/517: sync 2024-08-31T05:21:02.714 INFO:tasks.workunit.client.1.smithi073.stdout:2/416: sync 2024-08-31T05:21:02.714 INFO:tasks.workunit.client.1.smithi073.stdout:0/497: sync 2024-08-31T05:21:02.714 INFO:tasks.workunit.client.1.smithi073.stdout:3/483: sync 2024-08-31T05:21:02.716 INFO:tasks.workunit.client.1.smithi073.stdout:8/518: stat d0/db/d1c/d23/f41 0 2024-08-31T05:21:02.716 INFO:tasks.workunit.client.1.smithi073.stdout:3/484: chown da/d3c/d65/f5c 1 1 2024-08-31T05:21:02.717 INFO:tasks.workunit.client.1.smithi073.stdout:2/417: creat d2/f87 x:0 0 0 2024-08-31T05:21:02.718 INFO:tasks.workunit.client.1.smithi073.stdout:9/557: fdatasync dc/de/d66/f83 0 2024-08-31T05:21:02.719 INFO:tasks.workunit.client.1.smithi073.stdout:4/431: creat d7/df/d13/d2e/d47/d4c/d73/f76 x:0 0 0 2024-08-31T05:21:02.720 INFO:tasks.workunit.client.1.smithi073.stdout:9/558: write dc/d37/d42/d8d/d52/fa4 [184908,76043] 0 2024-08-31T05:21:02.721 INFO:tasks.workunit.client.1.smithi073.stdout:9/559: chown dc/de/d66/f83 94 1 2024-08-31T05:21:02.721 INFO:tasks.workunit.client.1.smithi073.stdout:3/485: creat da/d3c/d65/d45/fa1 x:0 0 0 2024-08-31T05:21:02.723 INFO:tasks.workunit.client.1.smithi073.stdout:9/560: dread dc/d27/f38 [0,4194304] 0 2024-08-31T05:21:02.726 INFO:tasks.workunit.client.1.smithi073.stdout:7/443: dread d1/d11/d14/f3c [0,4194304] 0 2024-08-31T05:21:02.731 INFO:tasks.workunit.client.1.smithi073.stdout:9/561: symlink dc/d37/d42/d8d/d52/d5f/lb9 0 2024-08-31T05:21:02.731 INFO:tasks.workunit.client.1.smithi073.stdout:3/486: dread da/f17 [0,4194304] 0 2024-08-31T05:21:02.737 INFO:tasks.workunit.client.1.smithi073.stdout:8/519: truncate d0/db/d1c/d2a/d58/f66 756616 0 2024-08-31T05:21:02.737 INFO:tasks.workunit.client.1.smithi073.stdout:3/487: fsync da/d3c/d82/d86/f98 0 2024-08-31T05:21:02.739 INFO:tasks.workunit.client.1.smithi073.stdout:0/498: getdents d0/d15/d2c/d4d/d3c 0 2024-08-31T05:21:02.740 INFO:tasks.workunit.client.1.smithi073.stdout:2/418: truncate d2/d9/df/f1f 2633068 0 2024-08-31T05:21:02.741 INFO:tasks.workunit.client.1.smithi073.stdout:4/432: truncate d7/df/d1b/d34/f5f 3520982 0 2024-08-31T05:21:02.741 INFO:tasks.workunit.client.1.smithi073.stdout:4/433: read d7/df/d13/d2e/f3a [586982,82873] 0 2024-08-31T05:21:02.742 INFO:tasks.workunit.client.1.smithi073.stdout:9/562: getdents dc/d37/d42/d5a/d89/db8 0 2024-08-31T05:21:02.742 INFO:tasks.workunit.client.1.smithi073.stdout:3/488: mkdir da/d18/da2 0 2024-08-31T05:21:02.743 INFO:tasks.workunit.client.1.smithi073.stdout:9/563: dread dc/d10/f49 [0,4194304] 0 2024-08-31T05:21:02.743 INFO:tasks.workunit.client.1.smithi073.stdout:8/520: creat d0/db/d1c/d34/d80/f9f x:0 0 0 2024-08-31T05:21:02.743 INFO:tasks.workunit.client.1.smithi073.stdout:0/499: fsync d0/d69/d7f/d68/f81 0 2024-08-31T05:21:02.744 INFO:tasks.workunit.client.1.smithi073.stdout:3/489: chown da/d3c/d65/d40/f9f 10924672 1 2024-08-31T05:21:02.744 INFO:tasks.workunit.client.1.smithi073.stdout:2/419: mkdir d2/d9/df/d43/d88 0 2024-08-31T05:21:02.745 INFO:tasks.workunit.client.1.smithi073.stdout:7/444: rmdir d1/da/d3e/d22/d5c/d8f 0 2024-08-31T05:21:02.745 INFO:tasks.workunit.client.1.smithi073.stdout:2/420: chown d2/d9/d32/d5d/f7c 5702672 1 2024-08-31T05:21:02.746 INFO:tasks.workunit.client.1.smithi073.stdout:7/445: fdatasync d1/da/d3e/d22/d6b/f81 0 2024-08-31T05:21:02.746 INFO:tasks.workunit.client.1.smithi073.stdout:8/521: read d0/db/d1c/d23/f41 [326759,109527] 0 2024-08-31T05:21:02.746 INFO:tasks.workunit.client.1.smithi073.stdout:4/434: unlink d7/d1a/d5c/d6d/d2c/d2d/f5b 0 2024-08-31T05:21:02.749 INFO:tasks.workunit.client.1.smithi073.stdout:9/564: rename dc/de/c4a to dc/de/d11/d85/cba 0 2024-08-31T05:21:02.752 INFO:tasks.workunit.client.1.smithi073.stdout:2/421: write d2/d9/d3c/f5c [225970,70414] 0 2024-08-31T05:21:02.754 INFO:tasks.workunit.client.1.smithi073.stdout:8/522: creat d0/d62/fa0 x:0 0 0 2024-08-31T05:21:02.758 INFO:tasks.workunit.client.1.smithi073.stdout:9/565: creat dc/de/d56/fbb x:0 0 0 2024-08-31T05:21:02.758 INFO:tasks.workunit.client.1.smithi073.stdout:2/422: dwrite f1 [0,4194304] 0 2024-08-31T05:21:02.759 INFO:tasks.workunit.client.1.smithi073.stdout:2/423: chown d2/d9/df/d36 87668896 1 2024-08-31T05:21:02.760 INFO:tasks.workunit.client.1.smithi073.stdout:9/566: write dc/d37/d42/d8d/f39 [4504112,93569] 0 2024-08-31T05:21:02.761 INFO:tasks.workunit.client.1.smithi073.stdout:4/435: dread d7/db/f4f [0,4194304] 0 2024-08-31T05:21:02.761 INFO:tasks.workunit.client.1.smithi073.stdout:8/523: rename d0/db/d1c/d24/f6b to d0/db/d1c/d34/d80/d9a/fa1 0 2024-08-31T05:21:02.763 INFO:tasks.workunit.client.1.smithi073.stdout:2/424: write d2/d9/d32/d5d/f7c [13753,60993] 0 2024-08-31T05:21:02.763 INFO:tasks.workunit.client.1.smithi073.stdout:4/436: stat d7/df/l43 0 2024-08-31T05:21:02.764 INFO:tasks.workunit.client.1.smithi073.stdout:8/524: fsync d0/db/d1c/d34/d68/f8a 0 2024-08-31T05:21:02.765 INFO:tasks.workunit.client.1.smithi073.stdout:8/525: chown d0/db/d1c/d23/f26 2 1 2024-08-31T05:21:02.766 INFO:tasks.workunit.client.1.smithi073.stdout:9/567: creat dc/d37/d42/d5a/fbc x:0 0 0 2024-08-31T05:21:02.766 INFO:tasks.workunit.client.1.smithi073.stdout:9/568: chown dc/d37/f54 5973912 1 2024-08-31T05:21:02.773 INFO:tasks.workunit.client.1.smithi073.stdout:8/526: mknod d0/db/d1c/d2a/ca2 0 2024-08-31T05:21:02.777 INFO:tasks.workunit.client.1.smithi073.stdout:8/527: mknod d0/db/d1c/d34/d38/ca3 0 2024-08-31T05:21:02.779 INFO:tasks.workunit.client.1.smithi073.stdout:2/425: link d2/d9/d32/d56/f63 d2/d9/d84/f89 0 2024-08-31T05:21:02.781 INFO:tasks.workunit.client.1.smithi073.stdout:2/426: rmdir d2/d9/d32/d56 39 2024-08-31T05:21:02.782 INFO:tasks.workunit.client.1.smithi073.stdout:2/427: readlink d2/l23 0 2024-08-31T05:21:02.782 INFO:tasks.workunit.client.1.smithi073.stdout:4/437: getdents d7/d1a/d5c/d6d/d59 0 2024-08-31T05:21:02.784 INFO:tasks.workunit.client.1.smithi073.stdout:2/428: readlink d2/d9/lc 0 2024-08-31T05:21:02.786 INFO:tasks.workunit.client.1.smithi073.stdout:9/569: dread f9 [0,4194304] 0 2024-08-31T05:21:02.786 INFO:tasks.workunit.client.1.smithi073.stdout:8/528: link d0/c46 d0/db/d1c/d34/d68/d9d/ca4 0 2024-08-31T05:21:02.787 INFO:tasks.workunit.client.1.smithi073.stdout:2/429: creat d2/d9/d32/d5d/d82/f8a x:0 0 0 2024-08-31T05:21:02.788 INFO:tasks.workunit.client.1.smithi073.stdout:9/570: creat dc/de/d66/fbd x:0 0 0 2024-08-31T05:21:02.789 INFO:tasks.workunit.client.1.smithi073.stdout:8/529: write d0/db/d1c/d34/f51 [2360116,80645] 0 2024-08-31T05:21:02.792 INFO:tasks.workunit.client.1.smithi073.stdout:9/571: dread dc/d37/d42/d8d/f39 [0,4194304] 0 2024-08-31T05:21:02.793 INFO:tasks.workunit.client.1.smithi073.stdout:2/430: rename d2/d9/d32/d56/l68 to d2/d9/df/l8b 0 2024-08-31T05:21:02.793 INFO:tasks.workunit.client.1.smithi073.stdout:9/572: readlink dc/d37/d42/d8d/d52/d5f/la3 0 2024-08-31T05:21:02.794 INFO:tasks.workunit.client.1.smithi073.stdout:2/431: stat d2/l3f 0 2024-08-31T05:21:02.796 INFO:tasks.workunit.client.1.smithi073.stdout:9/573: write dc/d37/d42/d8d/d52/d5b/f9d [897526,7466] 0 2024-08-31T05:21:02.798 INFO:tasks.workunit.client.1.smithi073.stdout:2/432: mknod d2/d9/d66/c8c 0 2024-08-31T05:21:02.799 INFO:tasks.workunit.client.1.smithi073.stdout:4/438: dwrite d7/d1a/d5c/f66 [0,4194304] 0 2024-08-31T05:21:02.800 INFO:tasks.workunit.client.1.smithi073.stdout:4/439: chown d7/df/d1b/d34/f49 140 1 2024-08-31T05:21:02.801 INFO:tasks.workunit.client.1.smithi073.stdout:2/433: unlink d2/d9/df/f22 0 2024-08-31T05:21:02.803 INFO:tasks.workunit.client.1.smithi073.stdout:8/530: dread d0/db/d1c/f1f [0,4194304] 0 2024-08-31T05:21:02.804 INFO:tasks.workunit.client.1.smithi073.stdout:9/574: write dc/d10/f26 [1168040,129937] 0 2024-08-31T05:21:02.805 INFO:tasks.workunit.client.1.smithi073.stdout:2/434: truncate d2/d9/d32/d5d/f71 153994 0 2024-08-31T05:21:02.807 INFO:tasks.workunit.client.1.smithi073.stdout:8/531: unlink d0/db/d44/l59 0 2024-08-31T05:21:02.807 INFO:tasks.workunit.client.1.smithi073.stdout:9/575: write dc/de/f4f [679860,92674] 0 2024-08-31T05:21:02.809 INFO:tasks.workunit.client.1.smithi073.stdout:1/376: sync 2024-08-31T05:21:02.809 INFO:tasks.workunit.client.1.smithi073.stdout:2/435: dread d2/d9/d66/d70/f74 [0,4194304] 0 2024-08-31T05:21:02.810 INFO:tasks.workunit.client.1.smithi073.stdout:8/532: chown d0/db/d1c/d34/d68/c7c 100998 1 2024-08-31T05:21:02.810 INFO:tasks.workunit.client.1.smithi073.stdout:4/440: dwrite d7/df/d1b/f1f [0,4194304] 0 2024-08-31T05:21:02.812 INFO:tasks.workunit.client.1.smithi073.stdout:9/576: rename dc/d37/f6e to dc/d82/fbe 0 2024-08-31T05:21:02.813 INFO:tasks.workunit.client.1.smithi073.stdout:1/377: mknod d5/d10/d1c/d27/c6d 0 2024-08-31T05:21:02.815 INFO:tasks.workunit.client.1.smithi073.stdout:1/378: fdatasync d5/f19 0 2024-08-31T05:21:02.815 INFO:tasks.workunit.client.1.smithi073.stdout:9/577: chown dc/d27/l6b 1584199641 1 2024-08-31T05:21:02.816 INFO:tasks.workunit.client.1.smithi073.stdout:4/441: creat d7/db/f77 x:0 0 0 2024-08-31T05:21:02.816 INFO:tasks.workunit.client.1.smithi073.stdout:8/533: fsync d0/f1a 0 2024-08-31T05:21:02.819 INFO:tasks.workunit.client.1.smithi073.stdout:9/578: creat dc/d27/fbf x:0 0 0 2024-08-31T05:21:02.819 INFO:tasks.workunit.client.1.smithi073.stdout:1/379: write d5/d10/d1c/f4b [266919,75372] 0 2024-08-31T05:21:02.822 INFO:tasks.workunit.client.1.smithi073.stdout:8/534: mknod d0/db/d1c/d34/d80/ca5 0 2024-08-31T05:21:02.822 INFO:tasks.workunit.client.1.smithi073.stdout:2/436: dwrite d2/d9/f85 [0,4194304] 0 2024-08-31T05:21:02.824 INFO:tasks.workunit.client.1.smithi073.stdout:1/380: write d5/d10/d1b/f63 [5682,91004] 0 2024-08-31T05:21:02.825 INFO:tasks.workunit.client.1.smithi073.stdout:2/437: write d2/d9/f81 [953920,125269] 0 2024-08-31T05:21:02.827 INFO:tasks.workunit.client.1.smithi073.stdout:4/442: dwrite d7/df/d13/f44 [0,4194304] 0 2024-08-31T05:21:02.827 INFO:tasks.workunit.client.1.smithi073.stdout:1/381: creat d5/d10/f6e x:0 0 0 2024-08-31T05:21:02.827 INFO:tasks.workunit.client.1.smithi073.stdout:9/579: link dc/d37/d42/d8d/c87 dc/d82/d97/cc0 0 2024-08-31T05:21:02.828 INFO:tasks.workunit.client.1.smithi073.stdout:9/580: chown dc/d10 0 1 2024-08-31T05:21:02.828 INFO:tasks.workunit.client.1.smithi073.stdout:4/443: readlink d7/df/l43 0 2024-08-31T05:21:02.828 INFO:tasks.workunit.client.1.smithi073.stdout:1/382: write d5/f34 [3779985,72048] 0 2024-08-31T05:21:02.832 INFO:tasks.workunit.client.1.smithi073.stdout:9/581: mkdir dc/d37/db5/dc1 0 2024-08-31T05:21:02.834 INFO:tasks.workunit.client.1.smithi073.stdout:4/444: unlink d7/fc 0 2024-08-31T05:21:02.836 INFO:tasks.workunit.client.1.smithi073.stdout:9/582: symlink dc/d82/lc2 0 2024-08-31T05:21:02.839 INFO:tasks.workunit.client.1.smithi073.stdout:9/583: fsync dc/f30 0 2024-08-31T05:21:02.839 INFO:tasks.workunit.client.1.smithi073.stdout:1/383: getdents d5/d17/d5d 0 2024-08-31T05:21:02.843 INFO:tasks.workunit.client.1.smithi073.stdout:9/584: fsync dc/d37/d42/d8d/d52/fa8 0 2024-08-31T05:21:02.844 INFO:tasks.workunit.client.1.smithi073.stdout:4/445: dwrite d7/df/d1b/f51 [0,4194304] 0 2024-08-31T05:21:02.855 INFO:tasks.workunit.client.1.smithi073.stdout:9/585: dwrite dc/d37/d42/d5a/f9f [0,4194304] 0 2024-08-31T05:21:02.856 INFO:tasks.workunit.client.1.smithi073.stdout:2/438: dwrite d2/d9/d32/d56/f63 [0,4194304] 0 2024-08-31T05:21:02.857 INFO:tasks.workunit.client.1.smithi073.stdout:6/457: sync 2024-08-31T05:21:02.857 INFO:tasks.workunit.client.1.smithi073.stdout:5/481: sync 2024-08-31T05:21:02.857 INFO:tasks.workunit.client.1.smithi073.stdout:8/535: dread d0/fe [0,4194304] 0 2024-08-31T05:21:02.859 INFO:tasks.workunit.client.1.smithi073.stdout:9/586: creat dc/d37/d42/fc3 x:0 0 0 2024-08-31T05:21:02.860 INFO:tasks.workunit.client.1.smithi073.stdout:6/458: fdatasync d15/d17/d26/f2c 0 2024-08-31T05:21:02.863 INFO:tasks.workunit.client.1.smithi073.stdout:9/587: mkdir dc/dc4 0 2024-08-31T05:21:02.865 INFO:tasks.workunit.client.1.smithi073.stdout:6/459: stat d15/d17/d26/f67 0 2024-08-31T05:21:02.865 INFO:tasks.workunit.client.1.smithi073.stdout:8/536: write d0/db/d1c/d34/d80/d9a/fa1 [157270,55954] 0 2024-08-31T05:21:02.867 INFO:tasks.workunit.client.1.smithi073.stdout:9/588: unlink dc/d10/fb3 0 2024-08-31T05:21:02.868 INFO:tasks.workunit.client.1.smithi073.stdout:5/482: dwrite dc/d3d/d55/f62 [0,4194304] 0 2024-08-31T05:21:02.870 INFO:tasks.workunit.client.1.smithi073.stdout:5/483: fsync dc/d16/f54 0 2024-08-31T05:21:02.870 INFO:tasks.workunit.client.1.smithi073.stdout:1/384: dread d5/d10/d2e/f44 [0,4194304] 0 2024-08-31T05:21:02.872 INFO:tasks.workunit.client.1.smithi073.stdout:6/460: creat d15/d1a/d2b/d6a/f94 x:0 0 0 2024-08-31T05:21:02.873 INFO:tasks.workunit.client.1.smithi073.stdout:5/484: write dc/d53/f68 [1745283,89128] 0 2024-08-31T05:21:02.873 INFO:tasks.workunit.client.1.smithi073.stdout:1/385: write d5/d17/f38 [3237536,120940] 0 2024-08-31T05:21:02.877 INFO:tasks.workunit.client.1.smithi073.stdout:8/537: link d0/db/d1c/d2a/l57 d0/la6 0 2024-08-31T05:21:02.878 INFO:tasks.workunit.client.1.smithi073.stdout:5/485: write dc/d3d/d55/d84/f8a [781053,1766] 0 2024-08-31T05:21:02.879 INFO:tasks.workunit.client.1.smithi073.stdout:6/461: mknod d15/d1a/d51/d61/d7c/c95 0 2024-08-31T05:21:02.880 INFO:tasks.workunit.client.1.smithi073.stdout:5/486: fsync dc/d16/d4e/f8e 0 2024-08-31T05:21:02.882 INFO:tasks.workunit.client.1.smithi073.stdout:9/589: dwrite dc/d37/d42/d8d/d52/d5b/fb2 [0,4194304] 0 2024-08-31T05:21:02.882 INFO:tasks.workunit.client.1.smithi073.stdout:1/386: unlink d5/d10/d1c/d27/c60 0 2024-08-31T05:21:02.883 INFO:tasks.workunit.client.1.smithi073.stdout:5/487: write dc/d16/d4e/f8e [889026,41394] 0 2024-08-31T05:21:02.884 INFO:tasks.workunit.client.1.smithi073.stdout:8/538: symlink d0/db/d44/d72/d75/d7e/la7 0 2024-08-31T05:21:02.885 INFO:tasks.workunit.client.1.smithi073.stdout:5/488: readlink dc/d16/d1a/d87/la6 0 2024-08-31T05:21:02.886 INFO:tasks.workunit.client.1.smithi073.stdout:9/590: unlink dc/c70 0 2024-08-31T05:21:02.886 INFO:tasks.workunit.client.1.smithi073.stdout:8/539: write d0/db/d1c/f20 [2302351,72132] 0 2024-08-31T05:21:02.887 INFO:tasks.workunit.client.1.smithi073.stdout:1/387: mkdir d5/d17/d32/d37/d6f 0 2024-08-31T05:21:02.889 INFO:tasks.workunit.client.1.smithi073.stdout:6/462: creat d15/d1a/d1e/d69/d7e/f96 x:0 0 0 2024-08-31T05:21:02.889 INFO:tasks.workunit.client.1.smithi073.stdout:8/540: chown d0/db/f5a 2232987 1 2024-08-31T05:21:02.890 INFO:tasks.workunit.client.1.smithi073.stdout:2/439: truncate d2/d9/d32/f47 379607 0 2024-08-31T05:21:02.890 INFO:tasks.workunit.client.1.smithi073.stdout:1/388: write d5/d10/f28 [1415419,34436] 0 2024-08-31T05:21:02.890 INFO:tasks.workunit.client.1.smithi073.stdout:5/489: read dc/d16/d3b/f74 [1604256,62221] 0 2024-08-31T05:21:02.891 INFO:tasks.workunit.client.1.smithi073.stdout:4/446: dread d7/db/f2a [0,4194304] 0 2024-08-31T05:21:02.891 INFO:tasks.workunit.client.1.smithi073.stdout:2/440: write f1 [3689384,46897] 0 2024-08-31T05:21:02.892 INFO:tasks.workunit.client.1.smithi073.stdout:0/500: sync 2024-08-31T05:21:02.892 INFO:tasks.workunit.client.1.smithi073.stdout:3/490: sync 2024-08-31T05:21:02.892 INFO:tasks.workunit.client.1.smithi073.stdout:7/446: sync 2024-08-31T05:21:02.892 INFO:tasks.workunit.client.1.smithi073.stdout:8/541: mkdir d0/da8 0 2024-08-31T05:21:02.896 INFO:tasks.workunit.client.1.smithi073.stdout:1/389: write d5/d10/d33/fe [4609044,33031] 0 2024-08-31T05:21:02.896 INFO:tasks.workunit.client.1.smithi073.stdout:7/447: mkdir d1/da/d96 0 2024-08-31T05:21:02.897 INFO:tasks.workunit.client.1.smithi073.stdout:0/501: stat d0/d15/d2c/d40/d4a/f4b 0 2024-08-31T05:21:02.899 INFO:tasks.workunit.client.1.smithi073.stdout:8/542: dread - d0/db/d44/d72/d79/f7f zero size 2024-08-31T05:21:02.899 INFO:tasks.workunit.client.1.smithi073.stdout:6/463: dread d15/f29 [0,4194304] 0 2024-08-31T05:21:02.900 INFO:tasks.workunit.client.1.smithi073.stdout:7/448: write d1/da/d3e/d22/d5c/f8b [2005402,39620] 0 2024-08-31T05:21:02.900 INFO:tasks.workunit.client.1.smithi073.stdout:6/464: readlink d15/d17/d26/l79 0 2024-08-31T05:21:02.901 INFO:tasks.workunit.client.1.smithi073.stdout:6/465: read - d15/d1a/d1e/d69/d7e/f96 zero size 2024-08-31T05:21:02.907 INFO:tasks.workunit.client.1.smithi073.stdout:9/591: dread dc/d37/d42/fa1 [4194304,4194304] 0 2024-08-31T05:21:02.920 INFO:tasks.workunit.client.1.smithi073.stdout:5/490: dread dc/f48 [0,4194304] 0 2024-08-31T05:21:02.922 INFO:tasks.workunit.client.1.smithi073.stdout:8/543: dread d0/f5e [0,4194304] 0 2024-08-31T05:21:02.925 INFO:tasks.workunit.client.1.smithi073.stdout:2/441: mknod d2/d9/df/d43/d88/c8d 0 2024-08-31T05:21:02.927 INFO:tasks.workunit.client.1.smithi073.stdout:4/447: creat d7/d1a/d5c/d6d/d59/d65/f78 x:0 0 0 2024-08-31T05:21:02.930 INFO:tasks.workunit.client.1.smithi073.stdout:2/442: dwrite d2/d9/d3c/f5c [0,4194304] 0 2024-08-31T05:21:02.932 INFO:tasks.workunit.client.1.smithi073.stdout:3/491: rename da/d3c/d65/d45/l74 to da/d3c/d82/la3 0 2024-08-31T05:21:02.934 INFO:tasks.workunit.client.1.smithi073.stdout:3/492: read da/f2f [971397,23700] 0 2024-08-31T05:21:02.935 INFO:tasks.workunit.client.1.smithi073.stdout:2/443: dread d2/d9/d32/d56/f63 [0,4194304] 0 2024-08-31T05:21:02.936 INFO:tasks.workunit.client.1.smithi073.stdout:3/493: write da/d3c/d65/d40/f57 [252735,14832] 0 2024-08-31T05:21:02.937 INFO:tasks.workunit.client.1.smithi073.stdout:3/494: dread - da/d3c/d5a/f66 zero size 2024-08-31T05:21:02.945 INFO:tasks.workunit.client.1.smithi073.stdout:6/466: unlink d15/d1a/d2b/d2f/d4b/d88/f8b 0 2024-08-31T05:21:02.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:02 smithi073 ceph-mon[24726]: pgmap v22: 65 pgs: 65 active+clean; 868 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 106 MiB/s wr, 297 op/s 2024-08-31T05:21:02.948 INFO:tasks.workunit.client.1.smithi073.stdout:1/390: mkdir d5/d17/d5d/d61/d70 0 2024-08-31T05:21:02.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.953+0000 7fd389ded640 1 -- 172.21.15.67:0/3101847252 --> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd364000bf0 con 0x7fd370074130 2024-08-31T05:21:02.955 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:02 smithi067 ceph-mon[17432]: pgmap v22: 65 pgs: 65 active+clean; 868 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 106 MiB/s wr, 297 op/s 2024-08-31T05:21:02.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.954+0000 7fd3817fa640 1 -- 172.21.15.67:0/3101847252 <== mgr.24383 v2:172.21.15.73:6828/1567621854 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fd364000bf0 con 0x7fd370074130 2024-08-31T05:21:02.956 INFO:tasks.workunit.client.1.smithi073.stdout:2/444: mknod d2/d9/d32/d56/c8e 0 2024-08-31T05:21:02.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.957+0000 7fd389ded640 1 -- 172.21.15.67:0/3101847252 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fd370074130 msgr2=0x7fd3700765f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:02.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.957+0000 7fd389ded640 1 --2- 172.21.15.67:0/3101847252 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fd370074130 0x7fd3700765f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd36c000c00 tx=0x7fd36c005a20 comp rx=0 tx=0).stop 2024-08-31T05:21:02.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.958+0000 7fd389ded640 1 -- 172.21.15.67:0/3101847252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3841091f0 msgr2=0x7fd38410bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:02.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.958+0000 7fd389ded640 1 --2- 172.21.15.67:0/3101847252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3841091f0 0x7fd38410bba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd37400e940 tx=0x7fd37400ee00 comp rx=0 tx=0).stop 2024-08-31T05:21:02.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.958+0000 7fd389ded640 1 -- 172.21.15.67:0/3101847252 shutdown_connections 2024-08-31T05:21:02.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.958+0000 7fd389ded640 1 --2- 172.21.15.67:0/3101847252 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fd370074130 0x7fd3700765f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:02.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.958+0000 7fd389ded640 1 --2- 172.21.15.67:0/3101847252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd384109bc0 0x7fd38410a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:02.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.958+0000 7fd389ded640 1 --2- 172.21.15.67:0/3101847252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3841091f0 0x7fd38410bba0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:02.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.958+0000 7fd389ded640 1 -- 172.21.15.67:0/3101847252 >> 172.21.15.67:0/3101847252 conn(0x7fd38406e7f0 msgr2=0x7fd38410e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:02.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.958+0000 7fd389ded640 1 -- 172.21.15.67:0/3101847252 shutdown_connections 2024-08-31T05:21:02.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:02.958+0000 7fd389ded640 1 -- 172.21.15.67:0/3101847252 wait complete. 2024-08-31T05:21:02.961 INFO:tasks.workunit.client.1.smithi073.stdout:3/495: creat da/d3c/d65/d40/fa4 x:0 0 0 2024-08-31T05:21:02.966 INFO:tasks.workunit.client.1.smithi073.stdout:1/391: symlink d5/d17/d32/l71 0 2024-08-31T05:21:02.970 INFO:tasks.workunit.client.1.smithi073.stdout:2/445: creat d2/d9/df/d43/d88/f8f x:0 0 0 2024-08-31T05:21:02.972 INFO:tasks.workunit.client.1.smithi073.stdout:3/496: symlink da/d3c/d65/d2c/d8e/la5 0 2024-08-31T05:21:02.973 INFO:tasks.workunit.client.1.smithi073.stdout:3/497: dread - da/d3c/d65/d40/d5d/f89 zero size 2024-08-31T05:21:02.973 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:21:02.975 INFO:tasks.workunit.client.1.smithi073.stdout:8/544: creat d0/db/d44/d72/fa9 x:0 0 0 2024-08-31T05:21:02.976 INFO:tasks.workunit.client.1.smithi073.stdout:1/392: dread d5/f34 [0,4194304] 0 2024-08-31T05:21:02.983 INFO:tasks.workunit.client.1.smithi073.stdout:1/393: read d5/f6 [1827772,84403] 0 2024-08-31T05:21:02.986 INFO:tasks.workunit.client.1.smithi073.stdout:6/467: getdents d15/d17/d26 0 2024-08-31T05:21:02.986 INFO:tasks.workunit.client.1.smithi073.stdout:6/468: dread - d15/f36 zero size 2024-08-31T05:21:02.987 INFO:tasks.workunit.client.1.smithi073.stdout:6/469: dread - d15/d1a/d2b/f4c zero size 2024-08-31T05:21:02.987 INFO:tasks.workunit.client.1.smithi073.stdout:6/470: chown d15 265040 1 2024-08-31T05:21:02.988 INFO:tasks.workunit.client.1.smithi073.stdout:8/545: creat d0/db/d1c/d24/faa x:0 0 0 2024-08-31T05:21:02.988 INFO:tasks.workunit.client.1.smithi073.stdout:6/471: dread - d15/d17/f91 zero size 2024-08-31T05:21:02.989 INFO:tasks.workunit.client.1.smithi073.stdout:8/546: chown d0/db/d1c/d34/d68/f8a 1 1 2024-08-31T05:21:02.989 INFO:tasks.workunit.client.1.smithi073.stdout:8/547: chown d0/db/d44/f6f 48962006 1 2024-08-31T05:21:02.990 INFO:tasks.workunit.client.1.smithi073.stdout:7/449: creat d1/d11/f97 x:0 0 0 2024-08-31T05:21:03.001 INFO:tasks.workunit.client.1.smithi073.stdout:0/502: creat d0/d15/d2c/d40/fa3 x:0 0 0 2024-08-31T05:21:03.003 INFO:tasks.workunit.client.1.smithi073.stdout:9/592: rename dc/d10/f49 to dc/de/d66/d84/da2/fc5 0 2024-08-31T05:21:03.003 INFO:tasks.workunit.client.1.smithi073.stdout:5/491: rename dc/d3d to dc/d3d/d55/d84/db2 22 2024-08-31T05:21:03.004 INFO:tasks.workunit.client.1.smithi073.stdout:5/492: stat dc/d3d/d55/d84 0 2024-08-31T05:21:03.006 INFO:tasks.workunit.client.1.smithi073.stdout:2/446: rename d2/d25/l2f to d2/d9/df/d43/l90 0 2024-08-31T05:21:03.006 INFO:tasks.workunit.client.1.smithi073.stdout:5/493: read dc/d16/f54 [2585709,119634] 0 2024-08-31T05:21:03.007 INFO:tasks.workunit.client.1.smithi073.stdout:0/503: dwrite d0/d15/d2c/d4d/d3c/f13 [4194304,4194304] 0 2024-08-31T05:21:03.008 INFO:tasks.workunit.client.1.smithi073.stdout:2/447: write d2/d9/d32/f39 [4464927,46706] 0 2024-08-31T05:21:03.008 INFO:tasks.workunit.client.1.smithi073.stdout:5/494: write dc/d3d/d55/d84/f41 [9246977,15028] 0 2024-08-31T05:21:03.013 INFO:tasks.workunit.client.1.smithi073.stdout:5/495: creat dc/d16/d1a/d87/d94/fb3 x:0 0 0 2024-08-31T05:21:03.015 INFO:tasks.workunit.client.1.smithi073.stdout:2/448: dread d2/d9/d32/d56/f63 [0,4194304] 0 2024-08-31T05:21:03.017 INFO:tasks.workunit.client.1.smithi073.stdout:5/496: creat dc/d16/d3b/fb4 x:0 0 0 2024-08-31T05:21:03.021 INFO:tasks.workunit.client.1.smithi073.stdout:5/497: mknod dc/d3d/d55/d84/d49/cb5 0 2024-08-31T05:21:03.027 INFO:tasks.workunit.client.1.smithi073.stdout:1/394: symlink d5/d10/d33/l72 0 2024-08-31T05:21:03.028 INFO:tasks.workunit.client.1.smithi073.stdout:5/498: dread dc/d3d/f9c [0,4194304] 0 2024-08-31T05:21:03.029 INFO:tasks.workunit.client.1.smithi073.stdout:5/499: write fb [2264855,110395] 0 2024-08-31T05:21:03.029 INFO:tasks.workunit.client.1.smithi073.stdout:2/449: dread d2/d9/df/f1f [0,4194304] 0 2024-08-31T05:21:03.030 INFO:tasks.workunit.client.1.smithi073.stdout:1/395: symlink d5/d10/d2e/l73 0 2024-08-31T05:21:03.031 INFO:tasks.workunit.client.1.smithi073.stdout:2/450: dread - d2/d9/d3c/f40 zero size 2024-08-31T05:21:03.033 INFO:tasks.workunit.client.1.smithi073.stdout:2/451: write d2/d9/df/d43/d88/f8f [407018,57063] 0 2024-08-31T05:21:03.033 INFO:tasks.workunit.client.1.smithi073.stdout:1/396: fsync d5/f34 0 2024-08-31T05:21:03.033 INFO:tasks.workunit.client.1.smithi073.stdout:5/500: dread dc/d3d/d55/d84/f8a [0,4194304] 0 2024-08-31T05:21:03.036 INFO:tasks.workunit.client.1.smithi073.stdout:1/397: symlink d5/d10/d1c/d27/l74 0 2024-08-31T05:21:03.036 INFO:tasks.workunit.client.1.smithi073.stdout:1/398: fsync d5/f25 0 2024-08-31T05:21:03.040 INFO:tasks.workunit.client.1.smithi073.stdout:1/399: creat d5/d10/d1c/d27/f75 x:0 0 0 2024-08-31T05:21:03.041 INFO:tasks.workunit.client.1.smithi073.stdout:3/498: write da/d3c/f8f [439399,26692] 0 2024-08-31T05:21:03.042 INFO:tasks.workunit.client.1.smithi073.stdout:3/499: write da/d3c/d65/d40/d5d/f80 [118549,44058] 0 2024-08-31T05:21:03.043 INFO:tasks.workunit.client.1.smithi073.stdout:1/400: mknod d5/d26/d54/d5f/c76 0 2024-08-31T05:21:03.046 INFO:tasks.workunit.client.1.smithi073.stdout:3/500: unlink da/d3c/d82/d86/f98 0 2024-08-31T05:21:03.046 INFO:tasks.workunit.client.1.smithi073.stdout:3/501: chown da/d3c/l72 0 1 2024-08-31T05:21:03.047 INFO:tasks.workunit.client.1.smithi073.stdout:1/401: creat d5/d26/f77 x:0 0 0 2024-08-31T05:21:03.048 INFO:tasks.workunit.client.1.smithi073.stdout:4/448: mkdir d7/df/d79 0 2024-08-31T05:21:03.050 INFO:tasks.workunit.client.1.smithi073.stdout:1/402: write d5/d10/d2e/f44 [1472428,46872] 0 2024-08-31T05:21:03.050 INFO:tasks.workunit.client.1.smithi073.stdout:8/548: write d0/db/d1c/f1f [4072779,87957] 0 2024-08-31T05:21:03.052 INFO:tasks.workunit.client.1.smithi073.stdout:3/502: mknod da/d3c/d65/ca6 0 2024-08-31T05:21:03.053 INFO:tasks.workunit.client.1.smithi073.stdout:3/503: write da/d3c/d65/d45/fa1 [413438,118835] 0 2024-08-31T05:21:03.053 INFO:tasks.workunit.client.1.smithi073.stdout:4/449: mkdir d7/df/d79/d7a 0 2024-08-31T05:21:03.055 INFO:tasks.workunit.client.1.smithi073.stdout:8/549: creat d0/d62/fab x:0 0 0 2024-08-31T05:21:03.057 INFO:tasks.workunit.client.1.smithi073.stdout:3/504: dread da/d3c/d67/f6f [0,4194304] 0 2024-08-31T05:21:03.058 INFO:tasks.workunit.client.1.smithi073.stdout:4/450: creat d7/d1a/d5c/d6d/d2c/f7b x:0 0 0 2024-08-31T05:21:03.059 INFO:tasks.workunit.client.1.smithi073.stdout:8/550: mkdir d0/db/d44/d72/d75/d7e/d91/dac 0 2024-08-31T05:21:03.060 INFO:tasks.workunit.client.1.smithi073.stdout:8/551: dread d0/db/d1c/d24/d73/f8f [0,4194304] 0 2024-08-31T05:21:03.060 INFO:tasks.workunit.client.1.smithi073.stdout:4/451: fsync d7/df/f25 0 2024-08-31T05:21:03.063 INFO:tasks.workunit.client.1.smithi073.stdout:1/403: symlink d5/d17/l78 0 2024-08-31T05:21:03.064 INFO:tasks.workunit.client.1.smithi073.stdout:3/505: creat da/d3c/d82/d97/fa7 x:0 0 0 2024-08-31T05:21:03.065 INFO:tasks.workunit.client.1.smithi073.stdout:9/593: truncate f9 2945397 0 2024-08-31T05:21:03.065 INFO:tasks.workunit.client.1.smithi073.stdout:3/506: read - da/d3c/d67/f81 zero size 2024-08-31T05:21:03.067 INFO:tasks.workunit.client.1.smithi073.stdout:4/452: mknod d7/db/c7c 0 2024-08-31T05:21:03.070 INFO:tasks.workunit.client.1.smithi073.stdout:1/404: rename d5/d17/d32/d68 to d5/d17/d3f/d79 0 2024-08-31T05:21:03.071 INFO:tasks.workunit.client.1.smithi073.stdout:1/405: chown d5/d10/d33/c5e 92494913 1 2024-08-31T05:21:03.074 INFO:tasks.workunit.client.1.smithi073.stdout:8/552: dread d0/f5 [0,4194304] 0 2024-08-31T05:21:03.078 INFO:tasks.workunit.client.1.smithi073.stdout:5/501: symlink dc/d16/lb6 0 2024-08-31T05:21:03.079 INFO:tasks.workunit.client.1.smithi073.stdout:5/502: readlink dc/d3d/d55/d84/l27 0 2024-08-31T05:21:03.079 INFO:tasks.workunit.client.1.smithi073.stdout:0/504: dwrite d0/f29 [0,4194304] 0 2024-08-31T05:21:03.081 INFO:tasks.workunit.client.1.smithi073.stdout:7/450: creat d1/da/f98 x:0 0 0 2024-08-31T05:21:03.082 INFO:tasks.workunit.client.1.smithi073.stdout:5/503: mkdir dc/d16/d1a/db7 0 2024-08-31T05:21:03.083 INFO:tasks.workunit.client.1.smithi073.stdout:4/453: dread d7/db/f19 [0,4194304] 0 2024-08-31T05:21:03.083 INFO:tasks.workunit.client.1.smithi073.stdout:2/452: truncate f1 3655711 0 2024-08-31T05:21:03.085 INFO:tasks.workunit.client.1.smithi073.stdout:7/451: creat d1/da/f99 x:0 0 0 2024-08-31T05:21:03.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.084+0000 7ff77307b640 1 -- 172.21.15.67:0/2357680248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76c100620 msgr2=0x7ff76c100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:03.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.084+0000 7ff77307b640 1 --2- 172.21.15.67:0/2357680248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76c100620 0x7ff76c100a20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff760009880 tx=0x7ff76002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.084+0000 7ff77307b640 1 -- 172.21.15.67:0/2357680248 shutdown_connections 2024-08-31T05:21:03.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.084+0000 7ff77307b640 1 --2- 172.21.15.67:0/2357680248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff76c101820 0x7ff76c101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.084+0000 7ff77307b640 1 --2- 172.21.15.67:0/2357680248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76c100620 0x7ff76c100a20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.084+0000 7ff77307b640 1 -- 172.21.15.67:0/2357680248 >> 172.21.15.67:0/2357680248 conn(0x7ff76c0fbdd0 msgr2=0x7ff76c0fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:03.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.085+0000 7ff77307b640 1 -- 172.21.15.67:0/2357680248 shutdown_connections 2024-08-31T05:21:03.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.085+0000 7ff77307b640 1 -- 172.21.15.67:0/2357680248 wait complete. 2024-08-31T05:21:03.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.085+0000 7ff77307b640 1 Processor -- start 2024-08-31T05:21:03.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.085+0000 7ff77307b640 1 -- start start 2024-08-31T05:21:03.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.086+0000 7ff77307b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76c100620 0x7ff76c196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:03.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.086+0000 7ff77307b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff76c101820 0x7ff76c196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:03.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.086+0000 7ff77307b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1094c0 con 0x7ff76c100620 2024-08-31T05:21:03.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.086+0000 7ff77307b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c109340 con 0x7ff76c101820 2024-08-31T05:21:03.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.086+0000 7ff770e17640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76c100620 0x7ff76c196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:03.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.086+0000 7ff770e17640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76c100620 0x7ff76c196210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54134/0 (socket says 172.21.15.67:54134) 2024-08-31T05:21:03.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.086+0000 7ff770e17640 1 -- 172.21.15.67:0/2350038940 learned_addr learned my addr 172.21.15.67:0/2350038940 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:21:03.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.086+0000 7ff76bfff640 1 --2- 172.21.15.67:0/2350038940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff76c101820 0x7ff76c196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:03.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.086+0000 7ff770e17640 1 -- 172.21.15.67:0/2350038940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff76c101820 msgr2=0x7ff76c196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:03.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.086+0000 7ff770e17640 1 --2- 172.21.15.67:0/2350038940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff76c101820 0x7ff76c196750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.086+0000 7ff770e17640 1 -- 172.21.15.67:0/2350038940 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c196dd0 con 0x7ff76c100620 2024-08-31T05:21:03.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.086+0000 7ff76bfff640 1 --2- 172.21.15.67:0/2350038940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff76c101820 0x7ff76c196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:21:03.090 INFO:tasks.workunit.client.1.smithi073.stdout:4/454: truncate d7/db/f69 41404 0 2024-08-31T05:21:03.090 INFO:tasks.workunit.client.1.smithi073.stdout:2/453: chown d2/d9/c6c 219160 1 2024-08-31T05:21:03.090 INFO:tasks.workunit.client.1.smithi073.stdout:5/504: symlink dc/d16/d3b/d3f/lb8 0 2024-08-31T05:21:03.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.087+0000 7ff770e17640 1 --2- 172.21.15.67:0/2350038940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76c100620 0x7ff76c196210 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff760009230 tx=0x7ff7600048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:03.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.087+0000 7ff769ffb640 1 -- 172.21.15.67:0/2350038940 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff760035070 con 0x7ff76c100620 2024-08-31T05:21:03.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.087+0000 7ff77307b640 1 -- 172.21.15.67:0/2350038940 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c06a260 con 0x7ff76c100620 2024-08-31T05:21:03.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.087+0000 7ff77307b640 1 -- 172.21.15.67:0/2350038940 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c06a870 con 0x7ff76c100620 2024-08-31T05:21:03.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.087+0000 7ff769ffb640 1 -- 172.21.15.67:0/2350038940 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7600044d0 con 0x7ff76c100620 2024-08-31T05:21:03.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.088+0000 7ff769ffb640 1 -- 172.21.15.67:0/2350038940 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff760031a30 con 0x7ff76c100620 2024-08-31T05:21:03.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.089+0000 7ff7577fe640 1 -- 172.21.15.67:0/2350038940 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff76c100a20 con 0x7ff76c100620 2024-08-31T05:21:03.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.090+0000 7ff769ffb640 1 -- 172.21.15.67:0/2350038940 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7ff760031bd0 con 0x7ff76c100620 2024-08-31T05:21:03.092 INFO:tasks.workunit.client.1.smithi073.stdout:7/452: unlink d1/da/d15/d33/d44/c6d 0 2024-08-31T05:21:03.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.090+0000 7ff769ffb640 1 --2- 172.21.15.67:0/2350038940 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7ff75c073fa0 0x7ff75c076460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:03.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.091+0000 7ff769ffb640 1 -- 172.21.15.67:0/2350038940 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7ff76003e070 con 0x7ff76c100620 2024-08-31T05:21:03.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.091+0000 7ff76bfff640 1 --2- 172.21.15.67:0/2350038940 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7ff75c073fa0 0x7ff75c076460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:03.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.091+0000 7ff76bfff640 1 --2- 172.21.15.67:0/2350038940 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7ff75c073fa0 0x7ff75c076460 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff758006fd0 tx=0x7ff758008040 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:03.094 INFO:tasks.workunit.client.1.smithi073.stdout:9/594: dread dc/d10/f29 [0,4194304] 0 2024-08-31T05:21:03.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.096+0000 7ff769ffb640 1 -- 172.21.15.67:0/2350038940 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7ff76007f510 con 0x7ff76c100620 2024-08-31T05:21:03.101 INFO:tasks.workunit.client.1.smithi073.stdout:8/553: dread d0/f39 [4194304,4194304] 0 2024-08-31T05:21:03.101 INFO:tasks.workunit.client.1.smithi073.stdout:9/595: dread dc/d37/d42/f59 [0,4194304] 0 2024-08-31T05:21:03.101 INFO:tasks.workunit.client.1.smithi073.stdout:7/453: creat d1/da/d3e/d22/d6b/f9a x:0 0 0 2024-08-31T05:21:03.101 INFO:tasks.workunit.client.1.smithi073.stdout:1/406: dread d5/d17/d3f/f4e [0,4194304] 0 2024-08-31T05:21:03.101 INFO:tasks.workunit.client.1.smithi073.stdout:6/472: sync 2024-08-31T05:21:03.102 INFO:tasks.workunit.client.1.smithi073.stdout:7/454: stat d1/da/d15/l45 0 2024-08-31T05:21:03.102 INFO:tasks.workunit.client.1.smithi073.stdout:6/473: fsync d15/d17/f5c 0 2024-08-31T05:21:03.106 INFO:tasks.workunit.client.1.smithi073.stdout:8/554: dwrite d0/db/d1c/f20 [0,4194304] 0 2024-08-31T05:21:03.106 INFO:tasks.workunit.client.1.smithi073.stdout:9/596: mknod dc/d27/cc6 0 2024-08-31T05:21:03.107 INFO:tasks.workunit.client.1.smithi073.stdout:4/455: link l4 d7/db/l7d 0 2024-08-31T05:21:03.110 INFO:tasks.workunit.client.1.smithi073.stdout:5/505: truncate dc/d52/f58 1633030 0 2024-08-31T05:21:03.111 INFO:tasks.workunit.client.1.smithi073.stdout:7/455: creat d1/da/d15/d33/d44/d60/f9b x:0 0 0 2024-08-31T05:21:03.111 INFO:tasks.workunit.client.1.smithi073.stdout:2/454: rmdir d2/d9/d65 0 2024-08-31T05:21:03.114 INFO:tasks.workunit.client.1.smithi073.stdout:9/597: readlink dc/de/d11/d85/l9b 0 2024-08-31T05:21:03.116 INFO:tasks.workunit.client.1.smithi073.stdout:2/455: readlink d2/d25/l49 0 2024-08-31T05:21:03.117 INFO:tasks.workunit.client.1.smithi073.stdout:1/407: creat d5/d10/d1c/d69/f7a x:0 0 0 2024-08-31T05:21:03.118 INFO:tasks.workunit.client.1.smithi073.stdout:6/474: mkdir d15/d1a/d2b/d2f/d4b/d97 0 2024-08-31T05:21:03.121 INFO:tasks.workunit.client.1.smithi073.stdout:3/507: dwrite da/d18/f1f [0,4194304] 0 2024-08-31T05:21:03.123 INFO:tasks.workunit.client.1.smithi073.stdout:4/456: dwrite d7/d1a/d5c/d6d/d2c/f7b [0,4194304] 0 2024-08-31T05:21:03.124 INFO:tasks.workunit.client.1.smithi073.stdout:0/505: truncate d0/d69/d7f/f78 120608 0 2024-08-31T05:21:03.124 INFO:tasks.workunit.client.1.smithi073.stdout:5/506: write dc/d3d/d55/d84/fa7 [1510998,48614] 0 2024-08-31T05:21:03.125 INFO:tasks.workunit.client.1.smithi073.stdout:1/408: write d5/d10/d2e/f44 [4322274,76772] 0 2024-08-31T05:21:03.129 INFO:tasks.workunit.client.1.smithi073.stdout:2/456: rename d2/d25/c5b to d2/d9/d66/d70/c91 0 2024-08-31T05:21:03.129 INFO:tasks.workunit.client.1.smithi073.stdout:1/409: chown d5/d10/d1b/f63 144 1 2024-08-31T05:21:03.130 INFO:tasks.workunit.client.1.smithi073.stdout:0/506: chown d0/d15/d2c/d4d/d3c/c24 30487031 1 2024-08-31T05:21:03.131 INFO:tasks.workunit.client.1.smithi073.stdout:8/555: dread d0/db/d1c/d34/d38/f43 [0,4194304] 0 2024-08-31T05:21:03.132 INFO:tasks.workunit.client.1.smithi073.stdout:6/475: creat d15/d17/d26/d38/f98 x:0 0 0 2024-08-31T05:21:03.134 INFO:tasks.workunit.client.1.smithi073.stdout:2/457: dread d2/d9/d32/d5d/f71 [0,4194304] 0 2024-08-31T05:21:03.135 INFO:tasks.workunit.client.1.smithi073.stdout:9/598: dwrite dc/d37/d42/d8d/d52/d5f/f91 [0,4194304] 0 2024-08-31T05:21:03.135 INFO:tasks.workunit.client.1.smithi073.stdout:6/476: read - d15/d1a/d2b/d2f/f30 zero size 2024-08-31T05:21:03.136 INFO:tasks.workunit.client.1.smithi073.stdout:3/508: write da/f61 [1956772,68790] 0 2024-08-31T05:21:03.136 INFO:tasks.workunit.client.1.smithi073.stdout:1/410: truncate d5/d10/d33/f56 756350 0 2024-08-31T05:21:03.138 INFO:tasks.workunit.client.1.smithi073.stdout:1/411: readlink d5/d17/d2a/l48 0 2024-08-31T05:21:03.142 INFO:tasks.workunit.client.1.smithi073.stdout:6/477: dread d15/f29 [0,4194304] 0 2024-08-31T05:21:03.144 INFO:tasks.workunit.client.1.smithi073.stdout:4/457: rename d7/d1a/d5c/d6d/d59/d65/f78 to d7/df/d13/d2e/d70/d6b/f7e 0 2024-08-31T05:21:03.145 INFO:tasks.workunit.client.1.smithi073.stdout:0/507: symlink d0/d28/d4f/la4 0 2024-08-31T05:21:03.146 INFO:tasks.workunit.client.1.smithi073.stdout:2/458: mkdir d2/d25/d92 0 2024-08-31T05:21:03.149 INFO:tasks.workunit.client.1.smithi073.stdout:9/599: creat dc/d27/fc7 x:0 0 0 2024-08-31T05:21:03.152 INFO:tasks.workunit.client.1.smithi073.stdout:9/600: dread dc/f25 [8388608,4194304] 0 2024-08-31T05:21:03.158 INFO:tasks.workunit.client.1.smithi073.stdout:9/601: dwrite dc/f25 [8388608,4194304] 0 2024-08-31T05:21:03.161 INFO:tasks.workunit.client.1.smithi073.stdout:7/456: getdents d1/da/d3e/d22/d6b 0 2024-08-31T05:21:03.161 INFO:tasks.workunit.client.1.smithi073.stdout:7/457: chown d1/da/d15/f58 1166081 1 2024-08-31T05:21:03.166 INFO:tasks.workunit.client.1.smithi073.stdout:3/509: dread da/d68/f84 [0,4194304] 0 2024-08-31T05:21:03.167 INFO:tasks.workunit.client.1.smithi073.stdout:0/508: dread d0/f5b [0,4194304] 0 2024-08-31T05:21:03.169 INFO:tasks.workunit.client.1.smithi073.stdout:5/507: truncate dc/d53/f79 58273 0 2024-08-31T05:21:03.169 INFO:tasks.workunit.client.1.smithi073.stdout:5/508: readlink dc/d16/d1a/la1 0 2024-08-31T05:21:03.170 INFO:tasks.workunit.client.1.smithi073.stdout:1/412: write d5/f9 [4446856,22263] 0 2024-08-31T05:21:03.171 INFO:tasks.workunit.client.1.smithi073.stdout:6/478: mkdir d15/d1a/d2b/d2f/d99 0 2024-08-31T05:21:03.171 INFO:tasks.workunit.client.1.smithi073.stdout:1/413: read - d5/d17/d2a/f5b zero size 2024-08-31T05:21:03.172 INFO:tasks.workunit.client.1.smithi073.stdout:9/602: creat dc/de/d11/fc8 x:0 0 0 2024-08-31T05:21:03.173 INFO:tasks.workunit.client.1.smithi073.stdout:7/458: unlink d1/da/d3e/d22/d6b/f9a 0 2024-08-31T05:21:03.173 INFO:tasks.workunit.client.1.smithi073.stdout:1/414: chown d5/d10/d33/l5c 1147 1 2024-08-31T05:21:03.174 INFO:tasks.workunit.client.1.smithi073.stdout:7/459: chown d1/da/d3e/d22/d6b 4 1 2024-08-31T05:21:03.180 INFO:tasks.workunit.client.1.smithi073.stdout:2/459: dwrite d2/d9/d27/f2b [0,4194304] 0 2024-08-31T05:21:03.181 INFO:tasks.workunit.client.1.smithi073.stdout:1/415: dwrite f0 [0,4194304] 0 2024-08-31T05:21:03.183 INFO:tasks.workunit.client.1.smithi073.stdout:1/416: write d5/d10/f28 [5031266,128440] 0 2024-08-31T05:21:03.183 INFO:tasks.workunit.client.1.smithi073.stdout:9/603: link dc/l3f dc/de/d11/d85/lc9 0 2024-08-31T05:21:03.183 INFO:tasks.workunit.client.1.smithi073.stdout:2/460: write d2/d9/f85 [4537878,103913] 0 2024-08-31T05:21:03.184 INFO:tasks.workunit.client.1.smithi073.stdout:5/509: dread dc/d16/d3b/f73 [0,4194304] 0 2024-08-31T05:21:03.186 INFO:tasks.workunit.client.1.smithi073.stdout:8/556: truncate d0/db/d1c/d34/d38/f43 3063498 0 2024-08-31T05:21:03.186 INFO:tasks.workunit.client.1.smithi073.stdout:0/509: getdents d0/d15/d2c/d41 0 2024-08-31T05:21:03.189 INFO:tasks.workunit.client.1.smithi073.stdout:7/460: rmdir d1/da/d38/d88 0 2024-08-31T05:21:03.190 INFO:tasks.workunit.client.1.smithi073.stdout:2/461: creat d2/d25/f93 x:0 0 0 2024-08-31T05:21:03.191 INFO:tasks.workunit.client.1.smithi073.stdout:9/604: rmdir dc/d37/d42/d5a/d89 39 2024-08-31T05:21:03.199 INFO:tasks.workunit.client.1.smithi073.stdout:4/458: truncate d7/f46 2122151 0 2024-08-31T05:21:03.200 INFO:tasks.workunit.client.1.smithi073.stdout:1/417: rename d5/d17/d32/d37/c53 to d5/d26/d54/c7b 0 2024-08-31T05:21:03.201 INFO:tasks.workunit.client.1.smithi073.stdout:4/459: fsync d7/df/d13/d2e/f31 0 2024-08-31T05:21:03.202 INFO:tasks.workunit.client.1.smithi073.stdout:7/461: link d1/da/f7b d1/da/d3e/d22/d35/f9c 0 2024-08-31T05:21:03.202 INFO:tasks.workunit.client.1.smithi073.stdout:6/479: write d15/d1a/d1e/d69/d7e/f90 [874782,84353] 0 2024-08-31T05:21:03.202 INFO:tasks.workunit.client.1.smithi073.stdout:1/418: stat d5/d17/d2a 0 2024-08-31T05:21:03.203 INFO:tasks.workunit.client.1.smithi073.stdout:3/510: dwrite da/d3c/d65/d2c/f48 [0,4194304] 0 2024-08-31T05:21:03.204 INFO:tasks.workunit.client.1.smithi073.stdout:1/419: fsync d5/f7 0 2024-08-31T05:21:03.206 INFO:tasks.workunit.client.1.smithi073.stdout:3/511: write da/d18/f1f [742976,60523] 0 2024-08-31T05:21:03.212 INFO:tasks.workunit.client.1.smithi073.stdout:1/420: creat d5/d26/d54/d5f/f7c x:0 0 0 2024-08-31T05:21:03.213 INFO:tasks.workunit.client.1.smithi073.stdout:1/421: dread d5/d10/d1b/f63 [0,4194304] 0 2024-08-31T05:21:03.214 INFO:tasks.workunit.client.1.smithi073.stdout:0/510: rename d0/d69/d7f/f78 to d0/d15/d2c/d40/d86/fa5 0 2024-08-31T05:21:03.215 INFO:tasks.workunit.client.1.smithi073.stdout:2/462: write d2/d9/df/f1f [2500710,97109] 0 2024-08-31T05:21:03.216 INFO:tasks.workunit.client.1.smithi073.stdout:7/462: read d1/da/d15/d33/f50 [240721,93891] 0 2024-08-31T05:21:03.216 INFO:tasks.workunit.client.1.smithi073.stdout:2/463: write d2/d9/f85 [3658074,62716] 0 2024-08-31T05:21:03.218 INFO:tasks.workunit.client.1.smithi073.stdout:2/464: read - d2/d9/d32/d56/f75 zero size 2024-08-31T05:21:03.221 INFO:tasks.workunit.client.1.smithi073.stdout:6/480: rename d15/d1a/d2b/d6a/c77 to d15/d1a/d51/d6e/d72/c9a 0 2024-08-31T05:21:03.222 INFO:tasks.workunit.client.1.smithi073.stdout:0/511: rmdir d0/d28/d4f 39 2024-08-31T05:21:03.223 INFO:tasks.workunit.client.1.smithi073.stdout:0/512: chown d0/d69/f8a 49647 1 2024-08-31T05:21:03.225 INFO:tasks.workunit.client.1.smithi073.stdout:0/513: write d0/d69/d7f/f6a [500222,23330] 0 2024-08-31T05:21:03.225 INFO:tasks.workunit.client.1.smithi073.stdout:7/463: mknod d1/da/d15/d33/c9d 0 2024-08-31T05:21:03.226 INFO:tasks.workunit.client.1.smithi073.stdout:2/465: mkdir d2/d9/d66/d94 0 2024-08-31T05:21:03.228 INFO:tasks.workunit.client.1.smithi073.stdout:9/605: dwrite dc/d37/d42/d5a/d89/fa7 [0,4194304] 0 2024-08-31T05:21:03.230 INFO:tasks.workunit.client.1.smithi073.stdout:2/466: read d2/d9/df/d36/f5e [245260,81848] 0 2024-08-31T05:21:03.231 INFO:tasks.workunit.client.1.smithi073.stdout:1/422: rename d5/f3e to d5/d17/d3f/f7d 0 2024-08-31T05:21:03.233 INFO:tasks.workunit.client.1.smithi073.stdout:7/464: mkdir d1/da/d65/d9e 0 2024-08-31T05:21:03.234 INFO:tasks.workunit.client.1.smithi073.stdout:5/510: dread dc/d16/d1a/f72 [0,4194304] 0 2024-08-31T05:21:03.235 INFO:tasks.workunit.client.1.smithi073.stdout:3/512: getdents da/d3c/d5a 0 2024-08-31T05:21:03.235 INFO:tasks.workunit.client.1.smithi073.stdout:0/514: dwrite d0/d69/d8e/f38 [0,4194304] 0 2024-08-31T05:21:03.235 INFO:tasks.workunit.client.1.smithi073.stdout:2/467: read d2/d9/df/f53 [420129,69855] 0 2024-08-31T05:21:03.237 INFO:tasks.workunit.client.1.smithi073.stdout:5/511: fdatasync dc/d3d/fa2 0 2024-08-31T05:21:03.237 INFO:tasks.workunit.client.1.smithi073.stdout:3/513: fsync da/d3c/f60 0 2024-08-31T05:21:03.239 INFO:tasks.workunit.client.1.smithi073.stdout:0/515: chown d0/d15/d2c/d40/d4a/f87 0 1 2024-08-31T05:21:03.240 INFO:tasks.workunit.client.1.smithi073.stdout:6/481: rename d15/d1a/d51/d6e/d72 to d15/d17/d26/d38/d9b 0 2024-08-31T05:21:03.245 INFO:tasks.workunit.client.1.smithi073.stdout:2/468: dwrite d2/d25/f93 [0,4194304] 0 2024-08-31T05:21:03.245 INFO:tasks.workunit.client.1.smithi073.stdout:3/514: dwrite f9 [0,4194304] 0 2024-08-31T05:21:03.248 INFO:tasks.workunit.client.1.smithi073.stdout:9/606: link dc/de/d11/d85/l9b dc/de/d56/lca 0 2024-08-31T05:21:03.248 INFO:tasks.workunit.client.1.smithi073.stdout:3/515: write da/d68/f99 [261052,15603] 0 2024-08-31T05:21:03.249 INFO:tasks.workunit.client.1.smithi073.stdout:3/516: chown da/fb 176801195 1 2024-08-31T05:21:03.249 INFO:tasks.workunit.client.1.smithi073.stdout:9/607: write dc/d27/f2e [209659,119493] 0 2024-08-31T05:21:03.250 INFO:tasks.workunit.client.1.smithi073.stdout:0/516: write d0/d58/f6e [1545551,43399] 0 2024-08-31T05:21:03.253 INFO:tasks.workunit.client.1.smithi073.stdout:7/465: link d1/d11/f53 d1/da/d3e/d22/d35/d83/f9f 0 2024-08-31T05:21:03.255 INFO:tasks.workunit.client.1.smithi073.stdout:2/469: symlink d2/d25/l95 0 2024-08-31T05:21:03.257 INFO:tasks.workunit.client.1.smithi073.stdout:6/482: symlink d15/d1a/d2b/d2f/l9c 0 2024-08-31T05:21:03.257 INFO:tasks.workunit.client.1.smithi073.stdout:1/423: dwrite d5/d10/f6e [0,4194304] 0 2024-08-31T05:21:03.257 INFO:tasks.workunit.client.1.smithi073.stdout:6/483: dread - d15/d1a/d2b/f71 zero size 2024-08-31T05:21:03.258 INFO:tasks.workunit.client.1.smithi073.stdout:9/608: symlink dc/de/d11/d85/lcb 0 2024-08-31T05:21:03.258 INFO:tasks.workunit.client.1.smithi073.stdout:0/517: creat d0/d69/d7f/d62/fa6 x:0 0 0 2024-08-31T05:21:03.259 INFO:tasks.workunit.client.1.smithi073.stdout:6/484: chown d15/d1a/d2b/d2f/d4b/f8f 1983772 1 2024-08-31T05:21:03.259 INFO:tasks.workunit.client.1.smithi073.stdout:0/518: dread - d0/d15/d2c/d41/d52/f8b zero size 2024-08-31T05:21:03.260 INFO:tasks.workunit.client.1.smithi073.stdout:6/485: chown d15/d17/d26/d38/f86 600 1 2024-08-31T05:21:03.260 INFO:tasks.workunit.client.1.smithi073.stdout:6/486: stat d15/d1a/d2b/d6a/f94 0 2024-08-31T05:21:03.262 INFO:tasks.workunit.client.1.smithi073.stdout:6/487: read d15/d17/d26/d38/f3d [1204729,40762] 0 2024-08-31T05:21:03.265 INFO:tasks.workunit.client.1.smithi073.stdout:2/470: rename d2/l3f to d2/d25/d92/l96 0 2024-08-31T05:21:03.269 INFO:tasks.workunit.client.1.smithi073.stdout:3/517: link da/d3c/d67/f7c da/d3c/d65/d87/fa8 0 2024-08-31T05:21:03.271 INFO:tasks.workunit.client.1.smithi073.stdout:5/512: getdents dc/d3d 0 2024-08-31T05:21:03.272 INFO:tasks.workunit.client.1.smithi073.stdout:5/513: chown dc/d53/f82 11934519 1 2024-08-31T05:21:03.272 INFO:tasks.workunit.client.1.smithi073.stdout:7/466: mknod d1/d11/ca0 0 2024-08-31T05:21:03.273 INFO:tasks.workunit.client.1.smithi073.stdout:5/514: dread - dc/d16/d1a/d87/d94/fb3 zero size 2024-08-31T05:21:03.273 INFO:tasks.workunit.client.1.smithi073.stdout:6/488: rename d15/f19 to d15/d17/d26/d38/d9b/f9d 0 2024-08-31T05:21:03.274 INFO:tasks.workunit.client.1.smithi073.stdout:1/424: unlink d5/f7 0 2024-08-31T05:21:03.275 INFO:tasks.workunit.client.1.smithi073.stdout:2/471: mkdir d2/d9/d27/d76/d97 0 2024-08-31T05:21:03.276 INFO:tasks.workunit.client.1.smithi073.stdout:9/609: symlink dc/d37/db5/dc1/lcc 0 2024-08-31T05:21:03.276 INFO:tasks.workunit.client.1.smithi073.stdout:0/519: mknod d0/d89/ca7 0 2024-08-31T05:21:03.276 INFO:tasks.workunit.client.1.smithi073.stdout:2/472: chown d2/d25/f93 7 1 2024-08-31T05:21:03.277 INFO:tasks.workunit.client.1.smithi073.stdout:3/518: symlink da/d3c/d5a/la9 0 2024-08-31T05:21:03.282 INFO:tasks.workunit.client.1.smithi073.stdout:3/519: creat da/d3c/d67/faa x:0 0 0 2024-08-31T05:21:03.283 INFO:tasks.workunit.client.1.smithi073.stdout:6/489: dread d15/f22 [0,4194304] 0 2024-08-31T05:21:03.292 INFO:tasks.workunit.client.1.smithi073.stdout:7/467: getdents d1/da/d3e 0 2024-08-31T05:21:03.292 INFO:tasks.workunit.client.1.smithi073.stdout:7/468: readlink d1/da/d3e/d22/l23 0 2024-08-31T05:21:03.293 INFO:tasks.workunit.client.1.smithi073.stdout:7/469: chown d1/da/d3e 39221184 1 2024-08-31T05:21:03.293 INFO:tasks.workunit.client.1.smithi073.stdout:5/515: getdents dc/d16/d1a 0 2024-08-31T05:21:03.294 INFO:tasks.workunit.client.1.smithi073.stdout:1/425: rmdir d5/d17/d3f/d79 0 2024-08-31T05:21:03.296 INFO:tasks.workunit.client.1.smithi073.stdout:0/520: dread d0/d15/d2c/d4d/d3c/f6 [0,4194304] 0 2024-08-31T05:21:03.296 INFO:tasks.workunit.client.1.smithi073.stdout:6/490: dread d15/d17/d26/f45 [0,4194304] 0 2024-08-31T05:21:03.298 INFO:tasks.workunit.client.1.smithi073.stdout:5/516: rmdir dc/d16/d3b/d7f/d99 39 2024-08-31T05:21:03.299 INFO:tasks.workunit.client.1.smithi073.stdout:1/426: dread d5/d10/d33/f56 [0,4194304] 0 2024-08-31T05:21:03.300 INFO:tasks.workunit.client.1.smithi073.stdout:2/473: write d2/d9/df/f53 [786804,127384] 0 2024-08-31T05:21:03.300 INFO:tasks.workunit.client.1.smithi073.stdout:0/521: chown d0/d69/d8e/d99/ca1 8096462 1 2024-08-31T05:21:03.300 INFO:tasks.workunit.client.1.smithi073.stdout:8/557: sync 2024-08-31T05:21:03.301 INFO:tasks.workunit.client.1.smithi073.stdout:0/522: stat d0/d58/d63/f7e 0 2024-08-31T05:21:03.301 INFO:tasks.workunit.client.1.smithi073.stdout:5/517: dread dc/d16/d3b/d3f/f50 [0,4194304] 0 2024-08-31T05:21:03.301 INFO:tasks.workunit.client.1.smithi073.stdout:8/558: dread - d0/db/d1c/d24/faa zero size 2024-08-31T05:21:03.304 INFO:tasks.workunit.client.1.smithi073.stdout:9/610: truncate dc/d37/d42/d8d/d52/d5f/f71 34689 0 2024-08-31T05:21:03.305 INFO:tasks.workunit.client.1.smithi073.stdout:2/474: dread d2/d9/d32/d56/f63 [0,4194304] 0 2024-08-31T05:21:03.306 INFO:tasks.workunit.client.1.smithi073.stdout:7/470: rename d1/d11/f7f to d1/da/d3e/d22/d47/fa1 0 2024-08-31T05:21:03.306 INFO:tasks.workunit.client.1.smithi073.stdout:3/520: truncate da/d3c/d65/d40/d5d/f8b 671462 0 2024-08-31T05:21:03.312 INFO:tasks.workunit.client.1.smithi073.stdout:5/518: mknod dc/d16/d1a/cb9 0 2024-08-31T05:21:03.314 INFO:tasks.workunit.client.1.smithi073.stdout:8/559: unlink d0/db/d44/d72/fa9 0 2024-08-31T05:21:03.315 INFO:tasks.workunit.client.1.smithi073.stdout:0/523: dwrite d0/d15/d2c/d40/f6d [0,4194304] 0 2024-08-31T05:21:03.315 INFO:tasks.workunit.client.1.smithi073.stdout:8/560: stat d0/db/d44/f4d 0 2024-08-31T05:21:03.316 INFO:tasks.workunit.client.1.smithi073.stdout:0/524: stat d0/d15/d9b/f9f 0 2024-08-31T05:21:03.317 INFO:tasks.workunit.client.1.smithi073.stdout:9/611: mkdir dc/d37/d42/d5a/da0/dcd 0 2024-08-31T05:21:03.317 INFO:tasks.workunit.client.1.smithi073.stdout:6/491: truncate d15/d17/d26/d38/d9b/f9d 1383048 0 2024-08-31T05:21:03.318 INFO:tasks.workunit.client.1.smithi073.stdout:8/561: read d0/db/d1c/d34/f3d [6699760,3662] 0 2024-08-31T05:21:03.319 INFO:tasks.workunit.client.1.smithi073.stdout:2/475: readlink d2/d9/l6d 0 2024-08-31T05:21:03.320 INFO:tasks.workunit.client.1.smithi073.stdout:6/492: write d15/d1a/d1e/d69/d7e/f96 [285776,94525] 0 2024-08-31T05:21:03.320 INFO:tasks.workunit.client.1.smithi073.stdout:7/471: symlink d1/da/la2 0 2024-08-31T05:21:03.320 INFO:tasks.workunit.client.1.smithi073.stdout:6/493: readlink d15/l21 0 2024-08-31T05:21:03.321 INFO:tasks.workunit.client.1.smithi073.stdout:3/521: rename da/d3c/l72 to da/d3c/d82/d86/lab 0 2024-08-31T05:21:03.322 INFO:tasks.workunit.client.1.smithi073.stdout:7/472: write d1/da/d15/d33/d44/d60/f7d [999782,97161] 0 2024-08-31T05:21:03.327 INFO:tasks.workunit.client.1.smithi073.stdout:5/519: symlink dc/d3d/dab/lba 0 2024-08-31T05:21:03.328 INFO:tasks.workunit.client.1.smithi073.stdout:9/612: symlink dc/d37/d42/d5a/da0/lce 0 2024-08-31T05:21:03.329 INFO:tasks.workunit.client.1.smithi073.stdout:0/525: creat d0/d69/fa8 x:0 0 0 2024-08-31T05:21:03.330 INFO:tasks.workunit.client.1.smithi073.stdout:2/476: creat d2/d9/d3c/f98 x:0 0 0 2024-08-31T05:21:03.330 INFO:tasks.workunit.client.1.smithi073.stdout:7/473: stat d1/da/d38/f4c 0 2024-08-31T05:21:03.331 INFO:tasks.workunit.client.1.smithi073.stdout:7/474: fdatasync d1/da/d3e/f52 0 2024-08-31T05:21:03.332 INFO:tasks.workunit.client.1.smithi073.stdout:5/520: unlink dc/d16/lb6 0 2024-08-31T05:21:03.332 INFO:tasks.workunit.client.1.smithi073.stdout:6/494: mkdir d15/d1a/d2b/d2f/d99/d9e 0 2024-08-31T05:21:03.334 INFO:tasks.workunit.client.1.smithi073.stdout:7/475: fsync d1/d11/d14/f63 0 2024-08-31T05:21:03.335 INFO:tasks.workunit.client.1.smithi073.stdout:2/477: mknod d2/d9/d32/c99 0 2024-08-31T05:21:03.338 INFO:tasks.workunit.client.1.smithi073.stdout:6/495: mkdir d15/d1a/d2b/d2f/d4b/d88/d9f 0 2024-08-31T05:21:03.338 INFO:tasks.workunit.client.1.smithi073.stdout:0/526: dwrite d0/f26 [4194304,4194304] 0 2024-08-31T05:21:03.341 INFO:tasks.workunit.client.1.smithi073.stdout:6/496: fsync d15/d17/d26/f2c 0 2024-08-31T05:21:03.341 INFO:tasks.workunit.client.1.smithi073.stdout:0/527: fdatasync d0/f29 0 2024-08-31T05:21:03.343 INFO:tasks.workunit.client.1.smithi073.stdout:7/476: rename d1/d11/c8a to d1/da/d96/ca3 0 2024-08-31T05:21:03.344 INFO:tasks.workunit.client.1.smithi073.stdout:1/427: dwrite d5/d17/f2f [4194304,4194304] 0 2024-08-31T05:21:03.344 INFO:tasks.workunit.client.1.smithi073.stdout:6/497: chown d15/l21 28 1 2024-08-31T05:21:03.346 INFO:tasks.workunit.client.1.smithi073.stdout:5/521: rename dc/d16/d3b/d7f/c92 to dc/d16/d3b/d7f/cbb 0 2024-08-31T05:21:03.348 INFO:tasks.workunit.client.1.smithi073.stdout:6/498: chown d15/d1a/d2b/d2f/f6c 42 1 2024-08-31T05:21:03.349 INFO:tasks.workunit.client.1.smithi073.stdout:2/478: rename d2/d9/df/c4b to d2/d9/d27/d76/d97/c9a 0 2024-08-31T05:21:03.349 INFO:tasks.workunit.client.1.smithi073.stdout:6/499: readlink d15/d1a/d2b/d2f/l4e 0 2024-08-31T05:21:03.350 INFO:tasks.workunit.client.1.smithi073.stdout:0/528: creat d0/d69/d8e/d99/fa9 x:0 0 0 2024-08-31T05:21:03.350 INFO:tasks.workunit.client.1.smithi073.stdout:6/500: dread - d15/d75/f76 zero size 2024-08-31T05:21:03.351 INFO:tasks.workunit.client.1.smithi073.stdout:6/501: dread - d15/d17/d26/f7a zero size 2024-08-31T05:21:03.351 INFO:tasks.workunit.client.1.smithi073.stdout:0/529: write d0/d15/d2c/d40/fa3 [974856,68318] 0 2024-08-31T05:21:03.355 INFO:tasks.workunit.client.1.smithi073.stdout:7/477: rename d1/da/d3e/f1f to d1/da/d96/fa4 0 2024-08-31T05:21:03.356 INFO:tasks.workunit.client.1.smithi073.stdout:1/428: mkdir d5/d10/d33/d13/d7e 0 2024-08-31T05:21:03.357 INFO:tasks.workunit.client.1.smithi073.stdout:6/502: fdatasync d15/d17/f65 0 2024-08-31T05:21:03.359 INFO:tasks.workunit.client.1.smithi073.stdout:0/530: mknod d0/d15/d2c/d41/d52/caa 0 2024-08-31T05:21:03.360 INFO:tasks.workunit.client.1.smithi073.stdout:1/429: rmdir d5/d10/d1c/d27/d51 39 2024-08-31T05:21:03.361 INFO:tasks.workunit.client.1.smithi073.stdout:2/479: dread d2/f4f [0,4194304] 0 2024-08-31T05:21:03.364 INFO:tasks.workunit.client.1.smithi073.stdout:2/480: truncate d2/d9/df/f53 1557003 0 2024-08-31T05:21:03.364 INFO:tasks.workunit.client.1.smithi073.stdout:1/430: chown d5/f6 50 1 2024-08-31T05:21:03.366 INFO:tasks.workunit.client.1.smithi073.stdout:9/613: dwrite dc/de/d66/d84/da2/fc5 [0,4194304] 0 2024-08-31T05:21:03.368 INFO:tasks.workunit.client.1.smithi073.stdout:0/531: truncate d0/d28/f30 634082 0 2024-08-31T05:21:03.369 INFO:tasks.workunit.client.1.smithi073.stdout:5/522: getdents dc/d3d 0 2024-08-31T05:21:03.375 INFO:tasks.workunit.client.1.smithi073.stdout:0/532: dwrite d0/d69/d7f/d62/f8f [0,4194304] 0 2024-08-31T05:21:03.379 INFO:tasks.workunit.client.1.smithi073.stdout:9/614: creat dc/dc4/fcf x:0 0 0 2024-08-31T05:21:03.379 INFO:tasks.workunit.client.1.smithi073.stdout:6/503: truncate d15/d17/d26/d38/f3d 2610989 0 2024-08-31T05:21:03.381 INFO:tasks.workunit.client.1.smithi073.stdout:9/615: read dc/d10/f18 [1719008,44033] 0 2024-08-31T05:21:03.381 INFO:tasks.workunit.client.1.smithi073.stdout:0/533: rename d0/d15/f82 to d0/d69/fab 0 2024-08-31T05:21:03.382 INFO:tasks.workunit.client.1.smithi073.stdout:6/504: read d15/d1a/d2b/d2f/f6c [3131546,63900] 0 2024-08-31T05:21:03.383 INFO:tasks.workunit.client.1.smithi073.stdout:9/616: write dc/d37/d42/d5a/f9f [4190289,111327] 0 2024-08-31T05:21:03.384 INFO:tasks.workunit.client.1.smithi073.stdout:9/617: write dc/d27/fbf [811667,30249] 0 2024-08-31T05:21:03.385 INFO:tasks.workunit.client.1.smithi073.stdout:9/618: chown dc/d37/f5e 72583162 1 2024-08-31T05:21:03.386 INFO:tasks.workunit.client.1.smithi073.stdout:9/619: truncate dc/d37/d42/fc3 359183 0 2024-08-31T05:21:03.386 INFO:tasks.workunit.client.1.smithi073.stdout:0/534: symlink d0/d15/d9b/lac 0 2024-08-31T05:21:03.389 INFO:tasks.workunit.client.1.smithi073.stdout:2/481: fsync d2/d9/d3c/f57 0 2024-08-31T05:21:03.390 INFO:tasks.workunit.client.1.smithi073.stdout:1/431: dread d5/f9 [0,4194304] 0 2024-08-31T05:21:03.390 INFO:tasks.workunit.client.1.smithi073.stdout:2/482: dread - d2/d9/d7f/f83 zero size 2024-08-31T05:21:03.391 INFO:tasks.workunit.client.1.smithi073.stdout:1/432: readlink d5/d10/d2e/l73 0 2024-08-31T05:21:03.391 INFO:tasks.workunit.client.1.smithi073.stdout:0/535: creat d0/d15/d2c/d40/d4a/fad x:0 0 0 2024-08-31T05:21:03.392 INFO:tasks.workunit.client.1.smithi073.stdout:0/536: dread - d0/d69/d8e/d99/fa9 zero size 2024-08-31T05:21:03.395 INFO:tasks.workunit.client.1.smithi073.stdout:5/523: write dc/d16/f2e [174599,33904] 0 2024-08-31T05:21:03.396 INFO:tasks.workunit.client.1.smithi073.stdout:9/620: mkdir dc/d37/d42/d5a/dd0 0 2024-08-31T05:21:03.396 INFO:tasks.workunit.client.1.smithi073.stdout:4/460: sync 2024-08-31T05:21:03.396 INFO:tasks.workunit.client.1.smithi073.stdout:2/483: mkdir d2/d9/d27/d9b 0 2024-08-31T05:21:03.398 INFO:tasks.workunit.client.1.smithi073.stdout:6/505: link d15/d1a/d2b/d2f/l9c d15/d1a/d2b/d2f/d99/la0 0 2024-08-31T05:21:03.398 INFO:tasks.workunit.client.1.smithi073.stdout:9/621: write dc/de/d11/fc8 [568111,9681] 0 2024-08-31T05:21:03.399 INFO:tasks.workunit.client.1.smithi073.stdout:1/433: symlink d5/d10/d33/d13/d7e/l7f 0 2024-08-31T05:21:03.400 INFO:tasks.workunit.client.1.smithi073.stdout:6/506: chown d15/d1a/d51/d61/d7c 0 1 2024-08-31T05:21:03.402 INFO:tasks.workunit.client.1.smithi073.stdout:4/461: creat d7/df/d13/d2e/d70/d6b/f7f x:0 0 0 2024-08-31T05:21:03.402 INFO:tasks.workunit.client.1.smithi073.stdout:0/537: dwrite d0/d15/d2c/d4d/d3c/f6 [0,4194304] 0 2024-08-31T05:21:03.403 INFO:tasks.workunit.client.1.smithi073.stdout:6/507: write d15/d17/d26/d38/f8a [123513,29263] 0 2024-08-31T05:21:03.403 INFO:tasks.workunit.client.1.smithi073.stdout:5/524: symlink dc/d52/lbc 0 2024-08-31T05:21:03.404 INFO:tasks.workunit.client.1.smithi073.stdout:9/622: mknod dc/de/d66/d84/da2/cd1 0 2024-08-31T05:21:03.408 INFO:tasks.workunit.client.1.smithi073.stdout:1/434: dwrite d5/d10/d1c/f52 [0,4194304] 0 2024-08-31T05:21:03.409 INFO:tasks.workunit.client.1.smithi073.stdout:5/525: rmdir dc/d16/d1a/d87/d94 39 2024-08-31T05:21:03.413 INFO:tasks.workunit.client.1.smithi073.stdout:5/526: fdatasync dc/d53/f82 0 2024-08-31T05:21:03.413 INFO:tasks.workunit.client.1.smithi073.stdout:4/462: link d7/df/f25 d7/df/d13/d53/f80 0 2024-08-31T05:21:03.414 INFO:tasks.workunit.client.1.smithi073.stdout:6/508: dread d15/d17/d26/f2c [0,4194304] 0 2024-08-31T05:21:03.414 INFO:tasks.workunit.client.1.smithi073.stdout:5/527: read - dc/d53/f5c zero size 2024-08-31T05:21:03.415 INFO:tasks.workunit.client.1.smithi073.stdout:9/623: truncate dc/d37/d42/d8d/d52/d5f/f71 903768 0 2024-08-31T05:21:03.415 INFO:tasks.workunit.client.1.smithi073.stdout:1/435: dread d5/f9 [0,4194304] 0 2024-08-31T05:21:03.416 INFO:tasks.workunit.client.1.smithi073.stdout:4/463: write d7/df/d1b/f1f [1000796,98321] 0 2024-08-31T05:21:03.416 INFO:tasks.workunit.client.1.smithi073.stdout:5/528: chown dc/d52/lbc 425 1 2024-08-31T05:21:03.417 INFO:tasks.workunit.client.1.smithi073.stdout:4/464: fsync d7/d1a/f29 0 2024-08-31T05:21:03.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.418+0000 7ff7577fe640 1 -- 172.21.15.67:0/2350038940 --> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff76c06ac30 con 0x7ff75c073fa0 2024-08-31T05:21:03.421 INFO:tasks.workunit.client.1.smithi073.stdout:9/624: symlink dc/de/d66/ld2 0 2024-08-31T05:21:03.422 INFO:tasks.workunit.client.1.smithi073.stdout:1/436: rename d5/d10/d2e to d5/d17/d2a/d80 0 2024-08-31T05:21:03.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.420+0000 7ff769ffb640 1 -- 172.21.15.67:0/2350038940 <== mgr.24383 v2:172.21.15.73:6828/1567621854 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7ff76c06ac30 con 0x7ff75c073fa0 2024-08-31T05:21:03.422 INFO:tasks.workunit.client.1.smithi073.stdout:4/465: readlink l4 0 2024-08-31T05:21:03.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.423+0000 7ff7577fe640 1 -- 172.21.15.67:0/2350038940 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7ff75c073fa0 msgr2=0x7ff75c076460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:03.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.423+0000 7ff7577fe640 1 --2- 172.21.15.67:0/2350038940 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7ff75c073fa0 0x7ff75c076460 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff758006fd0 tx=0x7ff758008040 comp rx=0 tx=0).stop 2024-08-31T05:21:03.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.423+0000 7ff7577fe640 1 -- 172.21.15.67:0/2350038940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76c100620 msgr2=0x7ff76c196210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:03.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.423+0000 7ff7577fe640 1 --2- 172.21.15.67:0/2350038940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76c100620 0x7ff76c196210 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff760009230 tx=0x7ff7600048f0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.423+0000 7ff7577fe640 1 -- 172.21.15.67:0/2350038940 shutdown_connections 2024-08-31T05:21:03.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.423+0000 7ff7577fe640 1 --2- 172.21.15.67:0/2350038940 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7ff75c073fa0 0x7ff75c076460 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.423+0000 7ff7577fe640 1 --2- 172.21.15.67:0/2350038940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff76c101820 0x7ff76c196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.423+0000 7ff7577fe640 1 --2- 172.21.15.67:0/2350038940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff76c100620 0x7ff76c196210 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.423+0000 7ff7577fe640 1 -- 172.21.15.67:0/2350038940 >> 172.21.15.67:0/2350038940 conn(0x7ff76c0fbdd0 msgr2=0x7ff76c0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:03.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.423+0000 7ff7577fe640 1 -- 172.21.15.67:0/2350038940 shutdown_connections 2024-08-31T05:21:03.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.423+0000 7ff7577fe640 1 -- 172.21.15.67:0/2350038940 wait complete. 2024-08-31T05:21:03.426 INFO:tasks.workunit.client.1.smithi073.stdout:5/529: dwrite dc/d3d/d55/d84/fa7 [0,4194304] 0 2024-08-31T05:21:03.426 INFO:tasks.workunit.client.1.smithi073.stdout:4/466: read - d7/df/d13/d2e/d70/d6b/f7e zero size 2024-08-31T05:21:03.426 INFO:tasks.workunit.client.1.smithi073.stdout:1/437: creat d5/d17/f81 x:0 0 0 2024-08-31T05:21:03.428 INFO:tasks.workunit.client.1.smithi073.stdout:5/530: fdatasync dc/d3d/d55/d84/f51 0 2024-08-31T05:21:03.430 INFO:tasks.workunit.client.1.smithi073.stdout:4/467: creat d7/f81 x:0 0 0 2024-08-31T05:21:03.430 INFO:tasks.workunit.client.1.smithi073.stdout:9/625: dwrite dc/d37/d42/d5a/d89/fa7 [0,4194304] 0 2024-08-31T05:21:03.432 INFO:tasks.workunit.client.1.smithi073.stdout:9/626: write dc/dc4/fcf [1043962,63558] 0 2024-08-31T05:21:03.432 INFO:tasks.workunit.client.1.smithi073.stdout:0/538: dread d0/d28/f30 [0,4194304] 0 2024-08-31T05:21:03.435 INFO:tasks.workunit.client.1.smithi073.stdout:4/468: symlink d7/df/d13/d53/l82 0 2024-08-31T05:21:03.435 INFO:tasks.workunit.client.1.smithi073.stdout:5/531: write dc/d52/f70 [484966,71645] 0 2024-08-31T05:21:03.436 INFO:tasks.workunit.client.1.smithi073.stdout:9/627: read dc/de/d66/f83 [219894,99701] 0 2024-08-31T05:21:03.437 INFO:tasks.workunit.client.1.smithi073.stdout:5/532: readlink l0 0 2024-08-31T05:21:03.439 INFO:tasks.workunit.client.1.smithi073.stdout:5/533: dread - dc/d3d/d55/d84/d49/f8f zero size 2024-08-31T05:21:03.440 INFO:tasks.workunit.client.1.smithi073.stdout:9/628: mkdir dc/d37/d42/d5a/d89/db8/dd3 0 2024-08-31T05:21:03.442 INFO:tasks.workunit.client.1.smithi073.stdout:5/534: mkdir dc/d3d/d55/d84/dbd 0 2024-08-31T05:21:03.443 INFO:tasks.workunit.client.1.smithi073.stdout:5/535: write dc/d16/d3b/f76 [376748,23717] 0 2024-08-31T05:21:03.444 INFO:tasks.workunit.client.1.smithi073.stdout:5/536: stat dc/l88 0 2024-08-31T05:21:03.445 INFO:tasks.workunit.client.1.smithi073.stdout:5/537: write dc/d52/f70 [1063670,76870] 0 2024-08-31T05:21:03.447 INFO:tasks.workunit.client.1.smithi073.stdout:9/629: dwrite dc/d37/d42/d8d/d52/d5b/f80 [0,4194304] 0 2024-08-31T05:21:03.448 INFO:tasks.workunit.client.1.smithi073.stdout:5/538: symlink dc/d3d/d3e/lbe 0 2024-08-31T05:21:03.452 INFO:tasks.workunit.client.1.smithi073.stdout:4/469: truncate d7/db/f19 2118802 0 2024-08-31T05:21:03.454 INFO:tasks.workunit.client.1.smithi073.stdout:6/509: dread d15/d17/d26/d38/f3d [0,4194304] 0 2024-08-31T05:21:03.454 INFO:tasks.workunit.client.1.smithi073.stdout:9/630: dread dc/d37/d42/d8d/d52/d5b/f80 [0,4194304] 0 2024-08-31T05:21:03.457 INFO:tasks.workunit.client.1.smithi073.stdout:5/539: link dc/d16/d3b/d3f/f9a dc/d16/d1a/d87/d94/fbf 0 2024-08-31T05:21:03.460 INFO:tasks.workunit.client.1.smithi073.stdout:5/540: truncate dc/d3d/d55/d84/f2c 1053858 0 2024-08-31T05:21:03.460 INFO:tasks.workunit.client.1.smithi073.stdout:4/470: dwrite d7/df/d13/d2e/f48 [4194304,4194304] 0 2024-08-31T05:21:03.464 INFO:tasks.workunit.client.1.smithi073.stdout:5/541: getdents dc/d3d/d55/d84/dbd 0 2024-08-31T05:21:03.464 INFO:tasks.workunit.client.1.smithi073.stdout:4/471: rename d7/df/d13/l75 to d7/d1a/d5c/d62/l83 0 2024-08-31T05:21:03.466 INFO:tasks.workunit.client.1.smithi073.stdout:5/542: creat dc/d3d/d55/d84/fc0 x:0 0 0 2024-08-31T05:21:03.466 INFO:tasks.workunit.client.1.smithi073.stdout:5/543: fsync dc/d53/f5c 0 2024-08-31T05:21:03.471 INFO:tasks.workunit.client.1.smithi073.stdout:6/510: write d15/d17/d26/f67 [4027719,52631] 0 2024-08-31T05:21:03.473 INFO:tasks.workunit.client.1.smithi073.stdout:4/472: truncate d7/df/d13/d2e/f31 3224441 0 2024-08-31T05:21:03.473 INFO:tasks.workunit.client.1.smithi073.stdout:5/544: mkdir dc/d16/d1a/db7/dc1 0 2024-08-31T05:21:03.474 INFO:tasks.workunit.client.1.smithi073.stdout:5/545: stat dc/d16/d1a/f72 0 2024-08-31T05:21:03.476 INFO:tasks.workunit.client.1.smithi073.stdout:4/473: creat d7/df/d13/d2e/d47/d4c/d73/f84 x:0 0 0 2024-08-31T05:21:03.477 INFO:tasks.workunit.client.1.smithi073.stdout:5/546: creat dc/fc2 x:0 0 0 2024-08-31T05:21:03.479 INFO:tasks.workunit.client.1.smithi073.stdout:5/547: truncate dc/fc2 702273 0 2024-08-31T05:21:03.479 INFO:tasks.workunit.client.1.smithi073.stdout:5/548: stat dc/d16/d3b/l86 0 2024-08-31T05:21:03.480 INFO:tasks.workunit.client.1.smithi073.stdout:5/549: dread - dc/d16/f95 zero size 2024-08-31T05:21:03.482 INFO:tasks.workunit.client.1.smithi073.stdout:4/474: dwrite d7/d1a/d5c/d6d/d59/f74 [0,4194304] 0 2024-08-31T05:21:03.484 INFO:tasks.workunit.client.1.smithi073.stdout:5/550: creat dc/d3d/d55/fc3 x:0 0 0 2024-08-31T05:21:03.486 INFO:tasks.workunit.client.1.smithi073.stdout:5/551: mkdir dc/d16/d3b/d3f/d4f/dc4 0 2024-08-31T05:21:03.489 INFO:tasks.workunit.client.1.smithi073.stdout:5/552: link dc/d16/d1a/l29 dc/d16/d3b/lc5 0 2024-08-31T05:21:03.492 INFO:tasks.workunit.client.1.smithi073.stdout:5/553: chown dc/d3d/d55/d84/f51 0 1 2024-08-31T05:21:03.493 INFO:tasks.workunit.client.1.smithi073.stdout:5/554: mkdir dc/d16/d3b/dc6 0 2024-08-31T05:21:03.493 INFO:tasks.workunit.client.1.smithi073.stdout:5/555: symlink dc/d3d/d55/lc7 0 2024-08-31T05:21:03.494 INFO:tasks.workunit.client.1.smithi073.stdout:5/556: truncate dc/d16/d1a/d87/fa8 641281 0 2024-08-31T05:21:03.494 INFO:tasks.workunit.client.1.smithi073.stdout:5/557: stat dc/d3d/d55/d84/d49/c93 0 2024-08-31T05:21:03.499 INFO:tasks.workunit.client.1.smithi073.stdout:5/558: dwrite dc/d3d/d55/f62 [0,4194304] 0 2024-08-31T05:21:03.499 INFO:tasks.workunit.client.1.smithi073.stdout:3/522: sync 2024-08-31T05:21:03.499 INFO:tasks.workunit.client.1.smithi073.stdout:3/523: stat da/d18/f8c 0 2024-08-31T05:21:03.500 INFO:tasks.workunit.client.1.smithi073.stdout:3/524: fdatasync da/fb 0 2024-08-31T05:21:03.500 INFO:tasks.workunit.client.1.smithi073.stdout:5/559: write dc/d16/d4e/f8e [1821179,106386] 0 2024-08-31T05:21:03.503 INFO:tasks.workunit.client.1.smithi073.stdout:5/560: mknod dc/d3d/d55/d84/cc8 0 2024-08-31T05:21:03.504 INFO:tasks.workunit.client.1.smithi073.stdout:5/561: chown dc/d52/lbc 12124 1 2024-08-31T05:21:03.507 INFO:tasks.workunit.client.1.smithi073.stdout:3/525: link da/d3c/d5a/l64 da/d3c/d82/lac 0 2024-08-31T05:21:03.508 INFO:tasks.workunit.client.1.smithi073.stdout:5/562: symlink dc/d52/lc9 0 2024-08-31T05:21:03.508 INFO:tasks.workunit.client.1.smithi073.stdout:5/563: fsync dc/f61 0 2024-08-31T05:21:03.508 INFO:tasks.workunit.client.1.smithi073.stdout:3/526: mkdir da/d3c/d5a/d8a/dad 0 2024-08-31T05:21:03.509 INFO:tasks.workunit.client.1.smithi073.stdout:5/564: fdatasync dc/d16/d1a/d87/f9b 0 2024-08-31T05:21:03.509 INFO:tasks.workunit.client.1.smithi073.stdout:5/565: chown dc/d16/d3b/d3f/f65 230 1 2024-08-31T05:21:03.510 INFO:tasks.workunit.client.1.smithi073.stdout:3/527: creat da/d18/fae x:0 0 0 2024-08-31T05:21:03.511 INFO:tasks.workunit.client.1.smithi073.stdout:3/528: write da/d18/f5b [589776,64245] 0 2024-08-31T05:21:03.511 INFO:tasks.workunit.client.1.smithi073.stdout:5/566: chown dc/d3d/d55/d84/f2c 0 1 2024-08-31T05:21:03.512 INFO:tasks.workunit.client.1.smithi073.stdout:3/529: write da/f62 [446994,65530] 0 2024-08-31T05:21:03.515 INFO:tasks.workunit.client.1.smithi073.stdout:5/567: symlink dc/d16/d3b/d7f/lca 0 2024-08-31T05:21:03.519 INFO:tasks.workunit.client.1.smithi073.stdout:5/568: dread dc/d16/f2e [0,4194304] 0 2024-08-31T05:21:03.520 INFO:tasks.workunit.client.1.smithi073.stdout:5/569: symlink dc/d3d/d55/lcb 0 2024-08-31T05:21:03.523 INFO:tasks.workunit.client.1.smithi073.stdout:3/530: dread da/f43 [0,4194304] 0 2024-08-31T05:21:03.524 INFO:tasks.workunit.client.1.smithi073.stdout:5/570: write dc/d3d/f9c [1240584,78920] 0 2024-08-31T05:21:03.526 INFO:tasks.workunit.client.1.smithi073.stdout:5/571: mkdir dc/d3d/d55/d84/dcc 0 2024-08-31T05:21:03.527 INFO:tasks.workunit.client.1.smithi073.stdout:3/531: getdents da/d3c/d65/d2c/d8e 0 2024-08-31T05:21:03.527 INFO:tasks.workunit.client.1.smithi073.stdout:5/572: readlink dc/d3d/d55/d84/l1d 0 2024-08-31T05:21:03.528 INFO:tasks.workunit.client.1.smithi073.stdout:3/532: write da/d3c/d67/f6f [1744971,59222] 0 2024-08-31T05:21:03.531 INFO:tasks.workunit.client.1.smithi073.stdout:3/533: mkdir da/d18/da2/daf 0 2024-08-31T05:21:03.533 INFO:tasks.workunit.client.1.smithi073.stdout:3/534: symlink da/d68/lb0 0 2024-08-31T05:21:03.533 INFO:tasks.workunit.client.1.smithi073.stdout:5/573: dwrite dc/d3d/d55/d84/d49/f81 [0,4194304] 0 2024-08-31T05:21:03.533 INFO:tasks.workunit.client.1.smithi073.stdout:3/535: chown f9 0 1 2024-08-31T05:21:03.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.536+0000 7fa5d278d640 1 -- 172.21.15.67:0/3107506305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5cc102190 msgr2=0x7fa5cc104580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:03.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.536+0000 7fa5d278d640 1 --2- 172.21.15.67:0/3107506305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5cc102190 0x7fa5cc104580 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0098b0 tx=0x7fa5bc02a4d0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.536+0000 7fa5d278d640 1 -- 172.21.15.67:0/3107506305 shutdown_connections 2024-08-31T05:21:03.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.536+0000 7fa5d278d640 1 --2- 172.21.15.67:0/3107506305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5cc104ac0 0x7fa5cc106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.536+0000 7fa5d278d640 1 --2- 172.21.15.67:0/3107506305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5cc102190 0x7fa5cc104580 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.536+0000 7fa5d278d640 1 -- 172.21.15.67:0/3107506305 >> 172.21.15.67:0/3107506305 conn(0x7fa5cc0fbdb0 msgr2=0x7fa5cc0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:03.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.536+0000 7fa5d278d640 1 -- 172.21.15.67:0/3107506305 shutdown_connections 2024-08-31T05:21:03.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.536+0000 7fa5d278d640 1 -- 172.21.15.67:0/3107506305 wait complete. 2024-08-31T05:21:03.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.536+0000 7fa5d278d640 1 Processor -- start 2024-08-31T05:21:03.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.537+0000 7fa5d278d640 1 -- start start 2024-08-31T05:21:03.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.537+0000 7fa5d278d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5cc102190 0x7fa5cc1994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:03.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.537+0000 7fa5d278d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5cc104ac0 0x7fa5cc1999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:03.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.537+0000 7fa5d278d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc10a580 con 0x7fa5cc104ac0 2024-08-31T05:21:03.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.537+0000 7fa5d278d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc10a400 con 0x7fa5cc102190 2024-08-31T05:21:03.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.537+0000 7fa5c3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5cc104ac0 0x7fa5cc1999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:03.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.537+0000 7fa5c3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5cc104ac0 0x7fa5cc1999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54144/0 (socket says 172.21.15.67:54144) 2024-08-31T05:21:03.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.537+0000 7fa5c3fff640 1 -- 172.21.15.67:0/3844427171 learned_addr learned my addr 172.21.15.67:0/3844427171 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:21:03.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.537+0000 7fa5c3fff640 1 -- 172.21.15.67:0/3844427171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5cc102190 msgr2=0x7fa5cc1994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:03.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.537+0000 7fa5c3fff640 1 --2- 172.21.15.67:0/3844427171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5cc102190 0x7fa5cc1994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.537+0000 7fa5c3fff640 1 -- 172.21.15.67:0/3844427171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc19a060 con 0x7fa5cc104ac0 2024-08-31T05:21:03.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.538+0000 7fa5c3fff640 1 --2- 172.21.15.67:0/3844427171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5cc104ac0 0x7fa5cc1999e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400d6c0 tx=0x7fa5b400db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:03.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.538+0000 7fa5c9ffb640 1 -- 172.21.15.67:0/3844427171 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa5b4017070 con 0x7fa5cc104ac0 2024-08-31T05:21:03.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.538+0000 7fa5d278d640 1 -- 172.21.15.67:0/3844427171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5cc19eaa0 con 0x7fa5cc104ac0 2024-08-31T05:21:03.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.538+0000 7fa5c9ffb640 1 -- 172.21.15.67:0/3844427171 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa5b40054e0 con 0x7fa5cc104ac0 2024-08-31T05:21:03.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.538+0000 7fa5c9ffb640 1 -- 172.21.15.67:0/3844427171 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa5b4020060 con 0x7fa5cc104ac0 2024-08-31T05:21:03.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.538+0000 7fa5d278d640 1 -- 172.21.15.67:0/3844427171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5cc19efd0 con 0x7fa5cc104ac0 2024-08-31T05:21:03.543 INFO:tasks.workunit.client.1.smithi073.stdout:5/574: dwrite fb [0,4194304] 0 2024-08-31T05:21:03.543 INFO:tasks.workunit.client.1.smithi073.stdout:3/536: dwrite da/d3c/d65/d2c/d8e/f9a [0,4194304] 0 2024-08-31T05:21:03.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.540+0000 7fa5d278d640 1 -- 172.21.15.67:0/3844427171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5cc102570 con 0x7fa5cc104ac0 2024-08-31T05:21:03.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.540+0000 7fa5c9ffb640 1 -- 172.21.15.67:0/3844427171 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7fa5b4005020 con 0x7fa5cc104ac0 2024-08-31T05:21:03.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.540+0000 7fa5c9ffb640 1 --2- 172.21.15.67:0/3844427171 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fa5b8073fa0 0x7fa5b8076460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:03.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.540+0000 7fa5c9ffb640 1 -- 172.21.15.67:0/3844427171 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7fa5b4094f30 con 0x7fa5cc104ac0 2024-08-31T05:21:03.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.540+0000 7fa5cbfff640 1 --2- 172.21.15.67:0/3844427171 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fa5b8073fa0 0x7fa5b8076460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:03.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.541+0000 7fa5cbfff640 1 --2- 172.21.15.67:0/3844427171 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fa5b8073fa0 0x7fa5b8076460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc02a9f0 tx=0x7fa5bc000bc0 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:03.545 INFO:tasks.workunit.client.1.smithi073.stdout:3/537: dread - da/d3c/d5a/f66 zero size 2024-08-31T05:21:03.546 INFO:tasks.workunit.client.1.smithi073.stdout:3/538: fdatasync da/f15 0 2024-08-31T05:21:03.550 INFO:tasks.workunit.client.1.smithi073.stdout:5/575: link dc/ce dc/d3d/d55/d84/ccd 0 2024-08-31T05:21:03.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.549+0000 7fa5c9ffb640 1 -- 172.21.15.67:0/3844427171 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fa5b405c8e0 con 0x7fa5cc104ac0 2024-08-31T05:21:03.554 INFO:tasks.workunit.client.1.smithi073.stdout:3/539: link da/d3c/d65/l7d da/lb1 0 2024-08-31T05:21:03.557 INFO:tasks.workunit.client.1.smithi073.stdout:5/576: dwrite dc/d16/d1a/f1f [0,4194304] 0 2024-08-31T05:21:03.560 INFO:tasks.workunit.client.1.smithi073.stdout:5/577: creat dc/d16/d3b/dc6/fce x:0 0 0 2024-08-31T05:21:03.563 INFO:tasks.workunit.client.1.smithi073.stdout:5/578: dread dc/d16/d3b/d3f/d4f/f8b [0,4194304] 0 2024-08-31T05:21:03.565 INFO:tasks.workunit.client.1.smithi073.stdout:5/579: rmdir dc/d3d/d55/d84/d49 39 2024-08-31T05:21:03.566 INFO:tasks.workunit.client.1.smithi073.stdout:3/540: dread da/f17 [0,4194304] 0 2024-08-31T05:21:03.571 INFO:tasks.workunit.client.1.smithi073.stdout:5/580: dwrite dc/d3d/d55/fc3 [0,4194304] 0 2024-08-31T05:21:03.573 INFO:tasks.workunit.client.1.smithi073.stdout:3/541: rename da/d3c/d67/f7c to da/d3c/d65/fb2 0 2024-08-31T05:21:03.575 INFO:tasks.workunit.client.1.smithi073.stdout:3/542: creat da/d3c/d5a/d8a/fb3 x:0 0 0 2024-08-31T05:21:03.577 INFO:tasks.workunit.client.1.smithi073.stdout:3/543: stat da/f10 0 2024-08-31T05:21:03.581 INFO:tasks.workunit.client.1.smithi073.stdout:5/581: read dc/d16/d1a/f28 [3220432,78054] 0 2024-08-31T05:21:03.583 INFO:tasks.workunit.client.1.smithi073.stdout:3/544: creat da/fb4 x:0 0 0 2024-08-31T05:21:03.584 INFO:tasks.workunit.client.1.smithi073.stdout:5/582: truncate dc/d3d/d55/d84/f2c 918010 0 2024-08-31T05:21:03.585 INFO:tasks.workunit.client.1.smithi073.stdout:3/545: creat da/d3c/d82/d86/fb5 x:0 0 0 2024-08-31T05:21:03.593 INFO:tasks.workunit.client.1.smithi073.stdout:7/478: sync 2024-08-31T05:21:03.593 INFO:tasks.workunit.client.1.smithi073.stdout:8/562: sync 2024-08-31T05:21:03.596 INFO:tasks.workunit.client.1.smithi073.stdout:8/563: fsync d0/db/d1c/d24/d73/f8f 0 2024-08-31T05:21:03.598 INFO:tasks.workunit.client.1.smithi073.stdout:7/479: symlink d1/da/d65/d9e/la5 0 2024-08-31T05:21:03.602 INFO:tasks.workunit.client.1.smithi073.stdout:8/564: rename d0/c35 to d0/db/d1c/d34/d80/cad 0 2024-08-31T05:21:03.603 INFO:tasks.workunit.client.1.smithi073.stdout:5/583: truncate dc/d16/d1a/f1f 1794707 0 2024-08-31T05:21:03.604 INFO:tasks.workunit.client.1.smithi073.stdout:7/480: readlink d1/da/d3e/d22/d5c/l76 0 2024-08-31T05:21:03.605 INFO:tasks.workunit.client.1.smithi073.stdout:3/546: write da/d3c/d65/d40/d5d/f8b [1238672,107273] 0 2024-08-31T05:21:03.610 INFO:tasks.workunit.client.1.smithi073.stdout:3/547: rmdir da/d3c/d65/d45 39 2024-08-31T05:21:03.610 INFO:tasks.workunit.client.1.smithi073.stdout:5/584: dwrite dc/d16/f7e [0,4194304] 0 2024-08-31T05:21:03.619 INFO:tasks.workunit.client.1.smithi073.stdout:5/585: rename dc/l7a to dc/d16/d3b/dc6/lcf 0 2024-08-31T05:21:03.621 INFO:tasks.workunit.client.1.smithi073.stdout:7/481: getdents d1/d11 0 2024-08-31T05:21:03.621 INFO:tasks.workunit.client.1.smithi073.stdout:7/482: readlink d1/da/d15/l45 0 2024-08-31T05:21:03.624 INFO:tasks.workunit.client.1.smithi073.stdout:5/586: rename dc/d16/d1a/f28 to dc/d3d/fd0 0 2024-08-31T05:21:03.626 INFO:tasks.workunit.client.1.smithi073.stdout:7/483: symlink d1/da/d65/d9e/la6 0 2024-08-31T05:21:03.626 INFO:tasks.workunit.client.1.smithi073.stdout:7/484: fsync d1/da/d38/f85 0 2024-08-31T05:21:03.627 INFO:tasks.workunit.client.1.smithi073.stdout:3/548: getdents da/d68 0 2024-08-31T05:21:03.628 INFO:tasks.workunit.client.1.smithi073.stdout:3/549: chown da/d3c/d65/fb2 298419521 1 2024-08-31T05:21:03.629 INFO:tasks.workunit.client.1.smithi073.stdout:7/485: fdatasync d1/da/f94 0 2024-08-31T05:21:03.631 INFO:tasks.workunit.client.1.smithi073.stdout:3/550: creat da/d3c/d67/fb6 x:0 0 0 2024-08-31T05:21:03.633 INFO:tasks.workunit.client.1.smithi073.stdout:7/486: creat d1/da/d3e/d22/d35/fa7 x:0 0 0 2024-08-31T05:21:03.634 INFO:tasks.workunit.client.1.smithi073.stdout:3/551: mkdir da/d3c/d67/db7 0 2024-08-31T05:21:03.635 INFO:tasks.workunit.client.1.smithi073.stdout:7/487: rmdir d1/da/d65 39 2024-08-31T05:21:03.636 INFO:tasks.workunit.client.1.smithi073.stdout:3/552: rmdir da/d18 39 2024-08-31T05:21:03.637 INFO:tasks.workunit.client.1.smithi073.stdout:3/553: write da/d3c/f5e [1972153,26983] 0 2024-08-31T05:21:03.638 INFO:tasks.workunit.client.1.smithi073.stdout:3/554: write da/d3c/d65/d40/f9f [242095,84729] 0 2024-08-31T05:21:03.639 INFO:tasks.workunit.client.1.smithi073.stdout:3/555: fsync da/d3c/d65/d2c/d8e/f9c 0 2024-08-31T05:21:03.641 INFO:tasks.workunit.client.1.smithi073.stdout:3/556: mkdir da/d3c/d5a/db8 0 2024-08-31T05:21:03.643 INFO:tasks.workunit.client.1.smithi073.stdout:3/557: fdatasync da/d18/f2a 0 2024-08-31T05:21:03.644 INFO:tasks.workunit.client.1.smithi073.stdout:5/587: dwrite dc/d3d/d55/d84/d49/f97 [4194304,4194304] 0 2024-08-31T05:21:03.644 INFO:tasks.workunit.client.1.smithi073.stdout:3/558: write da/d68/f6b [1914826,44070] 0 2024-08-31T05:21:03.648 INFO:tasks.workunit.client.1.smithi073.stdout:3/559: mkdir da/d3c/d82/d95/db9 0 2024-08-31T05:21:03.650 INFO:tasks.workunit.client.1.smithi073.stdout:3/560: chown da/d3c/d67/l6c 1152 1 2024-08-31T05:21:03.651 INFO:tasks.workunit.client.1.smithi073.stdout:5/588: dwrite dc/d3d/d55/d84/f34 [0,4194304] 0 2024-08-31T05:21:03.652 INFO:tasks.workunit.client.1.smithi073.stdout:5/589: dread - dc/d16/d1a/d87/d94/fb3 zero size 2024-08-31T05:21:03.654 INFO:tasks.workunit.client.1.smithi073.stdout:5/590: rmdir dc/d16/d3b/d3f 39 2024-08-31T05:21:03.662 INFO:tasks.workunit.client.1.smithi073.stdout:3/561: dread da/d3c/d65/d45/f55 [0,4194304] 0 2024-08-31T05:21:03.665 INFO:tasks.workunit.client.1.smithi073.stdout:3/562: mknod da/d3c/d65/d2c/d8e/cba 0 2024-08-31T05:21:03.671 INFO:tasks.workunit.client.1.smithi073.stdout:3/563: dread da/d3c/d65/d40/f57 [0,4194304] 0 2024-08-31T05:21:03.679 INFO:tasks.workunit.client.1.smithi073.stdout:5/591: dread dc/f61 [0,4194304] 0 2024-08-31T05:21:03.679 INFO:tasks.workunit.client.1.smithi073.stdout:5/592: dread - dc/d16/d1a/d87/f9b zero size 2024-08-31T05:21:03.684 INFO:tasks.workunit.client.1.smithi073.stdout:5/593: dwrite dc/fc2 [0,4194304] 0 2024-08-31T05:21:03.684 INFO:tasks.workunit.client.1.smithi073.stdout:5/594: readlink dc/d3d/dab/lba 0 2024-08-31T05:21:03.686 INFO:tasks.workunit.client.1.smithi073.stdout:5/595: write dc/d3d/d55/d84/d49/f9e [531558,129550] 0 2024-08-31T05:21:03.687 INFO:tasks.workunit.client.1.smithi073.stdout:5/596: chown dc/d16/cb0 7002919 1 2024-08-31T05:21:03.688 INFO:tasks.workunit.client.1.smithi073.stdout:5/597: chown dc/d16/d3b/ca4 87157503 1 2024-08-31T05:21:03.690 INFO:tasks.workunit.client.1.smithi073.stdout:5/598: unlink dc/d16/f2a 0 2024-08-31T05:21:03.693 INFO:tasks.workunit.client.1.smithi073.stdout:5/599: truncate dc/d16/f54 1955900 0 2024-08-31T05:21:03.696 INFO:tasks.workunit.client.1.smithi073.stdout:5/600: dread dc/d3d/d55/fc3 [0,4194304] 0 2024-08-31T05:21:03.698 INFO:tasks.workunit.client.1.smithi073.stdout:5/601: readlink dc/d16/d3b/dc6/lcf 0 2024-08-31T05:21:03.698 INFO:tasks.workunit.client.1.smithi073.stdout:5/602: fsync dc/d3d/f4c 0 2024-08-31T05:21:03.701 INFO:tasks.workunit.client.1.smithi073.stdout:9/631: sync 2024-08-31T05:21:03.701 INFO:tasks.workunit.client.1.smithi073.stdout:1/438: sync 2024-08-31T05:21:03.701 INFO:tasks.workunit.client.1.smithi073.stdout:6/511: sync 2024-08-31T05:21:03.701 INFO:tasks.workunit.client.1.smithi073.stdout:4/475: sync 2024-08-31T05:21:03.701 INFO:tasks.workunit.client.1.smithi073.stdout:2/484: sync 2024-08-31T05:21:03.701 INFO:tasks.workunit.client.1.smithi073.stdout:0/539: sync 2024-08-31T05:21:03.702 INFO:tasks.workunit.client.1.smithi073.stdout:5/603: symlink dc/d16/d3b/d3f/d4f/d98/ld1 0 2024-08-31T05:21:03.702 INFO:tasks.workunit.client.1.smithi073.stdout:4/476: chown d7/db/f77 675553805 1 2024-08-31T05:21:03.703 INFO:tasks.workunit.client.1.smithi073.stdout:2/485: fsync d2/d9/df/f1a 0 2024-08-31T05:21:03.703 INFO:tasks.workunit.client.1.smithi073.stdout:5/604: fsync dc/f67 0 2024-08-31T05:21:03.703 INFO:tasks.workunit.client.1.smithi073.stdout:6/512: chown d15/d1a/d2b/l39 63066 1 2024-08-31T05:21:03.703 INFO:tasks.workunit.client.1.smithi073.stdout:1/439: creat d5/d10/d33/d13/f82 x:0 0 0 2024-08-31T05:21:03.704 INFO:tasks.workunit.client.1.smithi073.stdout:6/513: truncate d15/f49 96756 0 2024-08-31T05:21:03.706 INFO:tasks.workunit.client.1.smithi073.stdout:2/486: mknod d2/d9/d3c/c9c 0 2024-08-31T05:21:03.706 INFO:tasks.workunit.client.1.smithi073.stdout:4/477: mknod d7/df/c85 0 2024-08-31T05:21:03.708 INFO:tasks.workunit.client.1.smithi073.stdout:5/605: read dc/d16/d3b/f76 [349181,64512] 0 2024-08-31T05:21:03.708 INFO:tasks.workunit.client.1.smithi073.stdout:1/440: creat d5/d10/d1c/f83 x:0 0 0 2024-08-31T05:21:03.712 INFO:tasks.workunit.client.1.smithi073.stdout:6/514: rmdir d15/d1a/d51 39 2024-08-31T05:21:03.712 INFO:tasks.workunit.client.1.smithi073.stdout:1/441: creat d5/d10/d33/d13/f84 x:0 0 0 2024-08-31T05:21:03.712 INFO:tasks.workunit.client.1.smithi073.stdout:5/606: chown dc/d16/d3b/lc5 4287296 1 2024-08-31T05:21:03.712 INFO:tasks.workunit.client.1.smithi073.stdout:6/515: mkdir d15/d17/da1 0 2024-08-31T05:21:03.714 INFO:tasks.workunit.client.1.smithi073.stdout:2/487: dread d2/d9/df/d36/f5e [0,4194304] 0 2024-08-31T05:21:03.717 INFO:tasks.workunit.client.1.smithi073.stdout:5/607: unlink dc/d16/d3b/d3f/l4d 0 2024-08-31T05:21:03.717 INFO:tasks.workunit.client.1.smithi073.stdout:4/478: dwrite d7/df/d13/d2e/d47/d4c/d73/f84 [0,4194304] 0 2024-08-31T05:21:03.722 INFO:tasks.workunit.client.1.smithi073.stdout:9/632: dwrite dc/de/d66/d84/da2/fa5 [0,4194304] 0 2024-08-31T05:21:03.726 INFO:tasks.workunit.client.1.smithi073.stdout:2/488: rename d2/d9/df/d36/l86 to d2/d9/d32/l9d 0 2024-08-31T05:21:03.731 INFO:tasks.workunit.client.1.smithi073.stdout:9/633: chown dc/de/d11/d85/lc9 1036513 1 2024-08-31T05:21:03.731 INFO:tasks.workunit.client.1.smithi073.stdout:1/442: dwrite d5/d17/d2a/f3b [0,4194304] 0 2024-08-31T05:21:03.732 INFO:tasks.workunit.client.1.smithi073.stdout:6/516: dwrite d15/d1a/d1e/d69/d7e/f8e [0,4194304] 0 2024-08-31T05:21:03.734 INFO:tasks.workunit.client.1.smithi073.stdout:6/517: write d15/f36 [76115,92491] 0 2024-08-31T05:21:03.736 INFO:tasks.workunit.client.1.smithi073.stdout:2/489: symlink d2/d9/d27/d9b/l9e 0 2024-08-31T05:21:03.736 INFO:tasks.workunit.client.1.smithi073.stdout:6/518: chown d15/d41/f6f 116852580 1 2024-08-31T05:21:03.741 INFO:tasks.workunit.client.1.smithi073.stdout:2/490: read - d2/d9/f77 zero size 2024-08-31T05:21:03.743 INFO:tasks.workunit.client.1.smithi073.stdout:1/443: getdents d5/d17/d3f 0 2024-08-31T05:21:03.743 INFO:tasks.workunit.client.1.smithi073.stdout:9/634: dwrite dc/d27/fc7 [0,4194304] 0 2024-08-31T05:21:03.745 INFO:tasks.workunit.client.1.smithi073.stdout:5/608: dread dc/d52/f58 [0,4194304] 0 2024-08-31T05:21:03.745 INFO:tasks.workunit.client.1.smithi073.stdout:6/519: creat d15/d1a/d51/fa2 x:0 0 0 2024-08-31T05:21:03.745 INFO:tasks.workunit.client.1.smithi073.stdout:4/479: dread d7/db/f19 [0,4194304] 0 2024-08-31T05:21:03.747 INFO:tasks.workunit.client.1.smithi073.stdout:4/480: fsync d7/db/f4e 0 2024-08-31T05:21:03.748 INFO:tasks.workunit.client.1.smithi073.stdout:4/481: readlink d7/df/d1b/d34/l42 0 2024-08-31T05:21:03.754 INFO:tasks.workunit.client.1.smithi073.stdout:6/520: mknod d15/d1a/d1e/d69/ca3 0 2024-08-31T05:21:03.756 INFO:tasks.workunit.client.1.smithi073.stdout:9/635: rename dc/de/d11/lb7 to dc/d37/d42/d5a/ld4 0 2024-08-31T05:21:03.758 INFO:tasks.workunit.client.1.smithi073.stdout:2/491: dwrite d2/f2c [4194304,4194304] 0 2024-08-31T05:21:03.758 INFO:tasks.workunit.client.1.smithi073.stdout:1/444: link d5/d10/d33/d13/d7e/l7f d5/d10/d33/d13/l85 0 2024-08-31T05:21:03.759 INFO:tasks.workunit.client.1.smithi073.stdout:6/521: mknod d15/d1a/d51/ca4 0 2024-08-31T05:21:03.760 INFO:tasks.workunit.client.1.smithi073.stdout:5/609: rename dc/d52 to dc/d3d/d55/d84/d49/dd2 0 2024-08-31T05:21:03.761 INFO:tasks.workunit.client.1.smithi073.stdout:5/610: write dc/f61 [1474013,128448] 0 2024-08-31T05:21:03.762 INFO:tasks.workunit.client.1.smithi073.stdout:9/636: unlink dc/d37/d42/fc3 0 2024-08-31T05:21:03.763 INFO:tasks.workunit.client.1.smithi073.stdout:9/637: stat dc/d37/d42/d8d/d52/fa4 0 2024-08-31T05:21:03.769 INFO:tasks.workunit.client.1.smithi073.stdout:6/522: rename d15/d1a/d2b/c6d to d15/d1a/d51/d6e/ca5 0 2024-08-31T05:21:03.770 INFO:tasks.workunit.client.1.smithi073.stdout:4/482: dwrite d7/df/d13/d2e/f3a [0,4194304] 0 2024-08-31T05:21:03.772 INFO:tasks.workunit.client.1.smithi073.stdout:4/483: write d7/df/d1b/d34/f49 [1475209,75970] 0 2024-08-31T05:21:03.772 INFO:tasks.workunit.client.1.smithi073.stdout:9/638: rmdir dc/de/d66 39 2024-08-31T05:21:03.775 INFO:tasks.workunit.client.1.smithi073.stdout:4/484: write d7/db/f69 [627020,74564] 0 2024-08-31T05:21:03.775 INFO:tasks.workunit.client.1.smithi073.stdout:2/492: write d2/f4f [379878,14668] 0 2024-08-31T05:21:03.777 INFO:tasks.workunit.client.1.smithi073.stdout:6/523: dread d15/d1a/d1e/d69/d7e/f8e [0,4194304] 0 2024-08-31T05:21:03.777 INFO:tasks.workunit.client.1.smithi073.stdout:8/565: sync 2024-08-31T05:21:03.780 INFO:tasks.workunit.client.1.smithi073.stdout:1/445: rmdir d5/d17/d5d/d61/d70 0 2024-08-31T05:21:03.781 INFO:tasks.workunit.client.1.smithi073.stdout:2/493: mkdir d2/d9/d32/d5d/d9f 0 2024-08-31T05:21:03.783 INFO:tasks.workunit.client.1.smithi073.stdout:6/524: mkdir d15/d1a/d51/d61/d7c/da6 0 2024-08-31T05:21:03.784 INFO:tasks.workunit.client.1.smithi073.stdout:8/566: dwrite d0/db/d44/d72/d75/d7e/f99 [0,4194304] 0 2024-08-31T05:21:03.785 INFO:tasks.workunit.client.1.smithi073.stdout:9/639: symlink dc/de/ld5 0 2024-08-31T05:21:03.786 INFO:tasks.workunit.client.1.smithi073.stdout:5/611: link dc/d16/d3b/d3f/d4f/c7c dc/d16/d1a/db7/dc1/cd3 0 2024-08-31T05:21:03.787 INFO:tasks.workunit.client.1.smithi073.stdout:1/446: chown d5/f65 0 1 2024-08-31T05:21:03.788 INFO:tasks.workunit.client.1.smithi073.stdout:6/525: rename d15/d41/c50 to d15/d41/d89/ca7 0 2024-08-31T05:21:03.789 INFO:tasks.workunit.client.1.smithi073.stdout:6/526: write fd [5194519,9064] 0 2024-08-31T05:21:03.789 INFO:tasks.workunit.client.1.smithi073.stdout:5/612: dread dc/d3d/f9c [0,4194304] 0 2024-08-31T05:21:03.791 INFO:tasks.workunit.client.1.smithi073.stdout:9/640: mknod dc/de/d11/d85/cd6 0 2024-08-31T05:21:03.793 INFO:tasks.workunit.client.1.smithi073.stdout:9/641: read dc/d37/d42/f64 [4066176,62681] 0 2024-08-31T05:21:03.795 INFO:tasks.workunit.client.1.smithi073.stdout:4/485: write d7/d1a/d5c/d6d/f58 [2562014,129896] 0 2024-08-31T05:21:03.796 INFO:tasks.workunit.client.1.smithi073.stdout:1/447: unlink d5/d10/d33/f56 0 2024-08-31T05:21:03.803 INFO:tasks.workunit.client.1.smithi073.stdout:2/494: creat d2/d9/fa0 x:0 0 0 2024-08-31T05:21:03.806 INFO:tasks.workunit.client.1.smithi073.stdout:4/486: mkdir d7/d1a/d5c/d6d/d59/d86 0 2024-08-31T05:21:03.807 INFO:tasks.workunit.client.1.smithi073.stdout:8/567: dwrite d0/db/f22 [0,4194304] 0 2024-08-31T05:21:03.808 INFO:tasks.workunit.client.1.smithi073.stdout:1/448: write d5/d26/f77 [6554,104265] 0 2024-08-31T05:21:03.809 INFO:tasks.workunit.client.1.smithi073.stdout:6/527: creat d15/d1a/d51/d61/d7c/da6/fa8 x:0 0 0 2024-08-31T05:21:03.811 INFO:tasks.workunit.client.1.smithi073.stdout:9/642: creat dc/d37/d42/d5a/d89/db8/dd3/fd7 x:0 0 0 2024-08-31T05:21:03.811 INFO:tasks.workunit.client.1.smithi073.stdout:6/528: fsync d15/d1a/d51/d61/f80 0 2024-08-31T05:21:03.813 INFO:tasks.workunit.client.1.smithi073.stdout:6/529: chown d15/d17 0 1 2024-08-31T05:21:03.814 INFO:tasks.workunit.client.1.smithi073.stdout:5/613: creat dc/d3d/d55/d84/d49/dd2/fd4 x:0 0 0 2024-08-31T05:21:03.815 INFO:tasks.workunit.client.1.smithi073.stdout:6/530: dread - d15/d1a/d2b/f63 zero size 2024-08-31T05:21:03.816 INFO:tasks.workunit.client.1.smithi073.stdout:4/487: dwrite d7/d1a/d5c/d6d/f6e [0,4194304] 0 2024-08-31T05:21:03.818 INFO:tasks.workunit.client.1.smithi073.stdout:5/614: dread dc/d16/f6f [0,4194304] 0 2024-08-31T05:21:03.818 INFO:tasks.workunit.client.1.smithi073.stdout:9/643: unlink dc/d37/d42/d8d/d52/d5b/f8a 0 2024-08-31T05:21:03.819 INFO:tasks.workunit.client.1.smithi073.stdout:7/488: sync 2024-08-31T05:21:03.819 INFO:tasks.workunit.client.1.smithi073.stdout:0/540: sync 2024-08-31T05:21:03.819 INFO:tasks.workunit.client.1.smithi073.stdout:3/564: sync 2024-08-31T05:21:03.820 INFO:tasks.workunit.client.1.smithi073.stdout:1/449: dwrite d5/d17/d2a/d80/f44 [4194304,4194304] 0 2024-08-31T05:21:03.821 INFO:tasks.workunit.client.1.smithi073.stdout:3/565: dread - da/d18/fae zero size 2024-08-31T05:21:03.822 INFO:tasks.workunit.client.1.smithi073.stdout:2/495: getdents d2/d9/d32/d5d/d82 0 2024-08-31T05:21:03.824 INFO:tasks.workunit.client.1.smithi073.stdout:3/566: truncate da/d3c/d65/d40/d5d/f80 827171 0 2024-08-31T05:21:03.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:03 smithi067 ceph-mon[17432]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:03.839 INFO:tasks.workunit.client.1.smithi073.stdout:4/488: creat d7/df/d13/d2e/d47/d4c/d73/f87 x:0 0 0 2024-08-31T05:21:03.839 INFO:tasks.workunit.client.1.smithi073.stdout:5/615: rmdir dc/d16/d1a/db7 39 2024-08-31T05:21:03.840 INFO:tasks.workunit.client.1.smithi073.stdout:0/541: unlink d0/d69/d8e/d99/f9d 0 2024-08-31T05:21:03.840 INFO:tasks.workunit.client.1.smithi073.stdout:1/450: mknod d5/d10/c86 0 2024-08-31T05:21:03.840 INFO:tasks.workunit.client.1.smithi073.stdout:6/531: creat d15/d1a/d2b/d2f/d99/d9e/fa9 x:0 0 0 2024-08-31T05:21:03.841 INFO:tasks.workunit.client.1.smithi073.stdout:3/567: mknod da/d3c/d65/d2c/d8e/cbb 0 2024-08-31T05:21:03.842 INFO:tasks.workunit.client.1.smithi073.stdout:1/451: write d5/d10/d1c/d27/f75 [16987,37447] 0 2024-08-31T05:21:03.843 INFO:tasks.workunit.client.1.smithi073.stdout:2/496: rename d2/d9/d66/d94 to d2/d9/d32/d5d/da1 0 2024-08-31T05:21:03.843 INFO:tasks.workunit.client.1.smithi073.stdout:8/568: getdents d0/db/d44/d72/d75/d7e/d91 0 2024-08-31T05:21:03.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.843+0000 7fa5d278d640 1 -- 172.21.15.67:0/3844427171 --> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa5cc062490 con 0x7fa5b8073fa0 2024-08-31T05:21:03.847 INFO:tasks.workunit.client.1.smithi073.stdout:1/452: chown d5/d10/d1c/d27/c29 7844 1 2024-08-31T05:21:03.847 INFO:tasks.workunit.client.1.smithi073.stdout:5/616: fsync dc/d3d/d55/d84/f2c 0 2024-08-31T05:21:03.847 INFO:tasks.workunit.client.1.smithi073.stdout:0/542: write d0/d15/d9b/f9f [1094406,5370] 0 2024-08-31T05:21:03.847 INFO:tasks.workunit.client.1.smithi073.stdout:3/568: mkdir da/d18/da2/daf/dbc 0 2024-08-31T05:21:03.848 INFO:tasks.workunit.client.1.smithi073.stdout:8/569: readlink d0/db/d1c/d34/d68/l69 0 2024-08-31T05:21:03.848 INFO:tasks.workunit.client.1.smithi073.stdout:9/644: getdents dc/d37/d42/d5a/d89/db8 0 2024-08-31T05:21:03.848 INFO:tasks.workunit.client.1.smithi073.stdout:8/570: stat d0/l21 0 2024-08-31T05:21:03.849 INFO:tasks.workunit.client.1.smithi073.stdout:2/497: mknod d2/d9/df/d43/ca2 0 2024-08-31T05:21:03.852 INFO:tasks.workunit.client.1.smithi073.stdout:1/453: read d5/d10/d33/fe [2726129,38250] 0 2024-08-31T05:21:03.853 INFO:tasks.workunit.client.1.smithi073.stdout:5/617: mkdir dc/d3d/dab/dd5 0 2024-08-31T05:21:03.854 INFO:tasks.workunit.client.1.smithi073.stdout:8/571: read - d0/db/d44/d72/d75/d7e/d91/f97 zero size 2024-08-31T05:21:03.854 INFO:tasks.workunit.client.1.smithi073.stdout:4/489: dwrite d7/df/d13/d2e/d70/d6b/f7f [0,4194304] 0 2024-08-31T05:21:03.856 INFO:tasks.workunit.client.1.smithi073.stdout:2/498: mkdir d2/d9/d32/d5d/da3 0 2024-08-31T05:21:03.856 INFO:tasks.workunit.client.1.smithi073.stdout:8/572: read - d0/d62/fa0 zero size 2024-08-31T05:21:03.858 INFO:tasks.workunit.client.1.smithi073.stdout:1/454: mknod d5/d10/d1c/d69/c87 0 2024-08-31T05:21:03.858 INFO:tasks.workunit.client.1.smithi073.stdout:5/618: fdatasync dc/d16/d3b/f76 0 2024-08-31T05:21:03.859 INFO:tasks.workunit.client.1.smithi073.stdout:6/532: dread d15/d1a/d2b/d2f/f64 [0,4194304] 0 2024-08-31T05:21:03.860 INFO:tasks.workunit.client.1.smithi073.stdout:4/490: mkdir d7/df/d13/d53/d88 0 2024-08-31T05:21:03.861 INFO:tasks.workunit.client.1.smithi073.stdout:8/573: write d0/db/d44/d72/d79/f7f [418747,101166] 0 2024-08-31T05:21:03.862 INFO:tasks.workunit.client.1.smithi073.stdout:9/645: dread dc/de/d66/d84/da2/fa5 [0,4194304] 0 2024-08-31T05:21:03.862 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:21:03.863 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (6m) 31s ago 7m 25.1M - 0.25.0 c8568f914cd2 cad2b6757f0e 2024-08-31T05:21:03.863 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 starting - - - - 2024-08-31T05:21:03.863 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (7m) 32s ago 7m 5263k - 19.1.1-242-g244a32d3 395b9209a980 d95ba11fe269 2024-08-31T05:21:03.863 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (8m) 31s ago 8m 6895k - 19.1.1-242-g244a32d3 395b9209a980 a47c71179c57 2024-08-31T05:21:03.863 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (7m) 32s ago 7m 6895k - 19.1.1-242-g244a32d3 395b9209a980 5f2ce08c4451 2024-08-31T05:21:03.863 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (6m) 31s ago 7m 76.3M - 9.4.12 2bacad6d85d8 ac51e53c0deb 2024-08-31T05:21:03.863 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (2m) 31s ago 2m 126M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:21:03.863 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (2m) 31s ago 2m 141M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:21:03.863 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (2m) 32s ago 2m 12.3M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:21:03.863 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (2m) 32s ago 2m 14.1M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:21:03.863 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:9283,8765,8443 running (9m) 31s ago 9m 281M - 19.1.1-242-g244a32d3 395b9209a980 436d56f83ade 2024-08-31T05:21:03.863 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (59s) 32s ago 7m 564M - 19.3.0-4560-gd19e6118 79f4cde5e369 d18b213f9418 2024-08-31T05:21:03.863 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (9m) 31s ago 9m 53.8M 2048M 19.1.1-242-g244a32d3 395b9209a980 7082a38c8108 2024-08-31T05:21:03.864 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (6m) 32s ago 6m 38.1M 2048M 19.1.1-242-g244a32d3 395b9209a980 30ccf0ed274b 2024-08-31T05:21:03.864 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (7m) 31s ago 7m 16.8M - 1.5.0 0da6a335fe13 d7c795c5bd95 2024-08-31T05:21:03.864 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (7m) 32s ago 7m 16.4M - 1.5.0 0da6a335fe13 f718603a0e92 2024-08-31T05:21:03.864 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (5m) 31s ago 5m 72.9M 1216M 19.1.1-242-g244a32d3 395b9209a980 b9f3f60b65f9 2024-08-31T05:21:03.864 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (5m) 31s ago 5m 82.7M 1216M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:21:03.864 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (4m) 31s ago 4m 72.1M 1216M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:21:03.864 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (4m) 32s ago 4m 88.5M 2240M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:21:03.864 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (4m) 32s ago 4m 84.1M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:21:03.864 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (3m) 32s ago 3m 76.5M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:21:03.864 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (5m) 31s ago 7m 60.5M - 2.43.0 a07b618ecd1d 9a2383a57b2c 2024-08-31T05:21:03.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.860+0000 7fa5c9ffb640 1 -- 172.21.15.67:0/3844427171 <== mgr.24383 v2:172.21.15.73:6828/1567621854 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fa5cc062490 con 0x7fa5b8073fa0 2024-08-31T05:21:03.865 INFO:tasks.workunit.client.1.smithi073.stdout:2/499: creat d2/d9/d27/d76/d97/fa4 x:0 0 0 2024-08-31T05:21:03.866 INFO:tasks.workunit.client.1.smithi073.stdout:1/455: mkdir d5/d10/d1b/d88 0 2024-08-31T05:21:03.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.863+0000 7fa5d278d640 1 -- 172.21.15.67:0/3844427171 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fa5b8073fa0 msgr2=0x7fa5b8076460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:03.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.863+0000 7fa5d278d640 1 --2- 172.21.15.67:0/3844427171 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fa5b8073fa0 0x7fa5b8076460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc02a9f0 tx=0x7fa5bc000bc0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.863+0000 7fa5d278d640 1 -- 172.21.15.67:0/3844427171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5cc104ac0 msgr2=0x7fa5cc1999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:03.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.863+0000 7fa5d278d640 1 --2- 172.21.15.67:0/3844427171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5cc104ac0 0x7fa5cc1999e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400d6c0 tx=0x7fa5b400db80 comp rx=0 tx=0).stop 2024-08-31T05:21:03.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.863+0000 7fa5d278d640 1 -- 172.21.15.67:0/3844427171 shutdown_connections 2024-08-31T05:21:03.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.863+0000 7fa5d278d640 1 --2- 172.21.15.67:0/3844427171 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fa5b8073fa0 0x7fa5b8076460 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.863+0000 7fa5d278d640 1 --2- 172.21.15.67:0/3844427171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5cc104ac0 0x7fa5cc1999e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.863+0000 7fa5d278d640 1 --2- 172.21.15.67:0/3844427171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5cc102190 0x7fa5cc1994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.863+0000 7fa5d278d640 1 -- 172.21.15.67:0/3844427171 >> 172.21.15.67:0/3844427171 conn(0x7fa5cc0fbdb0 msgr2=0x7fa5cc1017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:03.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.864+0000 7fa5d278d640 1 -- 172.21.15.67:0/3844427171 shutdown_connections 2024-08-31T05:21:03.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.864+0000 7fa5d278d640 1 -- 172.21.15.67:0/3844427171 wait complete. 2024-08-31T05:21:03.869 INFO:tasks.workunit.client.1.smithi073.stdout:1/456: write d5/d17/d2a/f3b [4746787,69747] 0 2024-08-31T05:21:03.869 INFO:tasks.workunit.client.1.smithi073.stdout:6/533: unlink d15/d17/d26/l3c 0 2024-08-31T05:21:03.869 INFO:tasks.workunit.client.1.smithi073.stdout:0/543: link d0/d69/d7f/c7c d0/d15/d2c/d40/d4a/d6b/cae 0 2024-08-31T05:21:03.869 INFO:tasks.workunit.client.1.smithi073.stdout:1/457: chown d5/d10/d1c/d27/c29 36961200 1 2024-08-31T05:21:03.869 INFO:tasks.workunit.client.1.smithi073.stdout:4/491: mkdir d7/d1a/d5c/d6d/d59/d65/d89 0 2024-08-31T05:21:03.870 INFO:tasks.workunit.client.1.smithi073.stdout:8/574: symlink d0/db/d1c/d34/d80/lae 0 2024-08-31T05:21:03.870 INFO:tasks.workunit.client.1.smithi073.stdout:0/544: dread - d0/d15/d2c/d40/f9a zero size 2024-08-31T05:21:03.870 INFO:tasks.workunit.client.1.smithi073.stdout:1/458: stat d5/d10/d33/l72 0 2024-08-31T05:21:03.870 INFO:tasks.workunit.client.1.smithi073.stdout:6/534: symlink d15/d1a/d2b/laa 0 2024-08-31T05:21:03.871 INFO:tasks.workunit.client.1.smithi073.stdout:9/646: getdents dc/d37/d42/d5a/db4 0 2024-08-31T05:21:03.871 INFO:tasks.workunit.client.1.smithi073.stdout:8/575: truncate d0/db/d1c/d24/f74 4790816 0 2024-08-31T05:21:03.873 INFO:tasks.workunit.client.1.smithi073.stdout:5/619: creat dc/d16/d1a/fd6 x:0 0 0 2024-08-31T05:21:03.875 INFO:tasks.workunit.client.1.smithi073.stdout:9/647: write dc/d37/d42/d5a/fbc [211286,3400] 0 2024-08-31T05:21:03.875 INFO:tasks.workunit.client.1.smithi073.stdout:9/648: stat f7 0 2024-08-31T05:21:03.876 INFO:tasks.workunit.client.1.smithi073.stdout:8/576: fdatasync d0/db/d1c/d34/f3d 0 2024-08-31T05:21:03.879 INFO:tasks.workunit.client.1.smithi073.stdout:0/545: dwrite d0/d15/d2c/d41/d52/f55 [0,4194304] 0 2024-08-31T05:21:03.882 INFO:tasks.workunit.client.1.smithi073.stdout:5/620: dwrite dc/d3d/fa2 [0,4194304] 0 2024-08-31T05:21:03.885 INFO:tasks.workunit.client.1.smithi073.stdout:4/492: rmdir d7/d1a/d5c/d6d/d59/d65/d89 0 2024-08-31T05:21:03.885 INFO:tasks.workunit.client.1.smithi073.stdout:4/493: stat d7/df/d1b/d34/l4d 0 2024-08-31T05:21:03.894 INFO:tasks.workunit.client.1.smithi073.stdout:0/546: creat d0/d15/d2c/d41/faf x:0 0 0 2024-08-31T05:21:03.894 INFO:tasks.workunit.client.1.smithi073.stdout:9/649: mkdir dc/de/dd8 0 2024-08-31T05:21:03.898 INFO:tasks.workunit.client.1.smithi073.stdout:5/621: creat dc/d3d/d55/d84/dbd/fd7 x:0 0 0 2024-08-31T05:21:03.902 INFO:tasks.workunit.client.1.smithi073.stdout:6/535: getdents d15/d17/d26/d38 0 2024-08-31T05:21:03.903 INFO:tasks.workunit.client.1.smithi073.stdout:9/650: getdents dc/d37 0 2024-08-31T05:21:03.904 INFO:tasks.workunit.client.1.smithi073.stdout:5/622: getdents dc 0 2024-08-31T05:21:03.905 INFO:tasks.workunit.client.1.smithi073.stdout:9/651: chown dc/d37/d42/fa1 246269423 1 2024-08-31T05:21:03.905 INFO:tasks.workunit.client.1.smithi073.stdout:1/459: dread d5/fc [0,4194304] 0 2024-08-31T05:21:03.905 INFO:tasks.workunit.client.1.smithi073.stdout:9/652: readlink dc/de/l2b 0 2024-08-31T05:21:03.906 INFO:tasks.workunit.client.1.smithi073.stdout:1/460: chown d5/d26/d54/d5f/c76 47156229 1 2024-08-31T05:21:03.906 INFO:tasks.workunit.client.1.smithi073.stdout:5/623: creat dc/d16/d3b/d3f/d4f/fd8 x:0 0 0 2024-08-31T05:21:03.907 INFO:tasks.workunit.client.1.smithi073.stdout:1/461: dread - d5/d10/d33/d13/f82 zero size 2024-08-31T05:21:03.907 INFO:tasks.workunit.client.1.smithi073.stdout:5/624: fdatasync dc/d16/d3b/d3f/d4f/f7b 0 2024-08-31T05:21:03.908 INFO:tasks.workunit.client.1.smithi073.stdout:5/625: chown dc/d16/cb0 51818 1 2024-08-31T05:21:03.908 INFO:tasks.workunit.client.1.smithi073.stdout:1/462: fsync d5/d10/d33/f36 0 2024-08-31T05:21:03.908 INFO:tasks.workunit.client.1.smithi073.stdout:6/536: rename d15/d17/d26/d38/f8a to d15/d1a/d2b/d2f/d4b/d97/fab 0 2024-08-31T05:21:03.910 INFO:tasks.workunit.client.1.smithi073.stdout:8/577: truncate d0/d62/f8d 1031515 0 2024-08-31T05:21:03.917 INFO:tasks.workunit.client.1.smithi073.stdout:1/463: write d5/f65 [812816,26773] 0 2024-08-31T05:21:03.917 INFO:tasks.workunit.client.1.smithi073.stdout:8/578: fdatasync d0/db/d1c/d34/d38/f8b 0 2024-08-31T05:21:03.917 INFO:tasks.workunit.client.1.smithi073.stdout:9/653: getdents dc/d37/d42 0 2024-08-31T05:21:03.917 INFO:tasks.workunit.client.1.smithi073.stdout:0/547: mknod d0/d15/d2c/d41/d52/cb0 0 2024-08-31T05:21:03.919 INFO:tasks.workunit.client.1.smithi073.stdout:4/494: dread d7/df/d13/d2e/f36 [0,4194304] 0 2024-08-31T05:21:03.920 INFO:tasks.workunit.client.1.smithi073.stdout:6/537: dwrite d15/f36 [0,4194304] 0 2024-08-31T05:21:03.922 INFO:tasks.workunit.client.1.smithi073.stdout:5/626: dwrite dc/d53/f82 [0,4194304] 0 2024-08-31T05:21:03.922 INFO:tasks.workunit.client.1.smithi073.stdout:9/654: read - dc/d37/d42/d5a/d89/db8/dd3/fd7 zero size 2024-08-31T05:21:03.923 INFO:tasks.workunit.client.1.smithi073.stdout:8/579: creat d0/db/d1c/d2a/d58/faf x:0 0 0 2024-08-31T05:21:03.925 INFO:tasks.workunit.client.1.smithi073.stdout:6/538: fsync d15/d17/d26/d38/f40 0 2024-08-31T05:21:03.925 INFO:tasks.workunit.client.1.smithi073.stdout:8/580: chown d0/db/d44/d72/d79 4981066 1 2024-08-31T05:21:03.926 INFO:tasks.workunit.client.1.smithi073.stdout:4/495: mknod d7/df/d13/d2e/d70/c8a 0 2024-08-31T05:21:03.929 INFO:tasks.workunit.client.1.smithi073.stdout:1/464: dwrite d5/d17/f2f [0,4194304] 0 2024-08-31T05:21:03.931 INFO:tasks.workunit.client.1.smithi073.stdout:1/465: write d5/d10/d33/d13/f82 [116728,102025] 0 2024-08-31T05:21:03.935 INFO:tasks.workunit.client.1.smithi073.stdout:0/548: write d0/d15/d2c/d41/d52/f74 [297529,119560] 0 2024-08-31T05:21:03.936 INFO:tasks.workunit.client.1.smithi073.stdout:9/655: mkdir dc/de/dd8/dd9 0 2024-08-31T05:21:03.939 INFO:tasks.workunit.client.1.smithi073.stdout:5/627: creat dc/d16/d1a/db7/dc1/fd9 x:0 0 0 2024-08-31T05:21:03.939 INFO:tasks.workunit.client.1.smithi073.stdout:6/539: dread d15/d1a/d2b/f4c [0,4194304] 0 2024-08-31T05:21:03.941 INFO:tasks.workunit.client.1.smithi073.stdout:1/466: symlink d5/d26/d54/d55/l89 0 2024-08-31T05:21:03.942 INFO:tasks.workunit.client.1.smithi073.stdout:9/656: mkdir dc/d37/d42/d5a/dda 0 2024-08-31T05:21:03.943 INFO:tasks.workunit.client.1.smithi073.stdout:4/496: getdents d7/df/d13 0 2024-08-31T05:21:03.944 INFO:tasks.workunit.client.1.smithi073.stdout:0/549: getdents d0/d15/d2c/d41 0 2024-08-31T05:21:03.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:03 smithi073 ceph-mon[24726]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:03.948 INFO:tasks.workunit.client.1.smithi073.stdout:5/628: rename dc/d16/d1a/l47 to dc/d16/d3b/lda 0 2024-08-31T05:21:03.949 INFO:tasks.workunit.client.1.smithi073.stdout:6/540: getdents d15/d1a/d2b/d2f/d4b/d88 0 2024-08-31T05:21:03.950 INFO:tasks.workunit.client.1.smithi073.stdout:4/497: dwrite d7/df/d13/d2e/d70/f6c [0,4194304] 0 2024-08-31T05:21:03.952 INFO:tasks.workunit.client.1.smithi073.stdout:0/550: creat d0/d15/fb1 x:0 0 0 2024-08-31T05:21:03.953 INFO:tasks.workunit.client.1.smithi073.stdout:0/551: fsync d0/d15/d2c/d4d/d3c/f6 0 2024-08-31T05:21:03.953 INFO:tasks.workunit.client.1.smithi073.stdout:5/629: symlink dc/d16/d3b/d7f/d99/ldb 0 2024-08-31T05:21:03.955 INFO:tasks.workunit.client.1.smithi073.stdout:5/630: dread - dc/d16/d3b/d3f/f9a zero size 2024-08-31T05:21:03.956 INFO:tasks.workunit.client.1.smithi073.stdout:6/541: creat d15/d1a/fac x:0 0 0 2024-08-31T05:21:03.956 INFO:tasks.workunit.client.1.smithi073.stdout:6/542: readlink d15/l21 0 2024-08-31T05:21:03.959 INFO:tasks.workunit.client.1.smithi073.stdout:0/552: unlink d0/d15/d2c/d41/d52/f74 0 2024-08-31T05:21:03.959 INFO:tasks.workunit.client.1.smithi073.stdout:0/553: dread - d0/d15/d2c/d41/faf zero size 2024-08-31T05:21:03.960 INFO:tasks.workunit.client.1.smithi073.stdout:0/554: dread - d0/d15/d2c/d40/d4a/f64 zero size 2024-08-31T05:21:03.964 INFO:tasks.workunit.client.1.smithi073.stdout:1/467: write d5/d10/d1b/f63 [1018938,100123] 0 2024-08-31T05:21:03.965 INFO:tasks.workunit.client.1.smithi073.stdout:9/657: write f9 [3991630,62903] 0 2024-08-31T05:21:03.968 INFO:tasks.workunit.client.1.smithi073.stdout:6/543: dwrite d15/d17/d26/f2c [0,4194304] 0 2024-08-31T05:21:03.970 INFO:tasks.workunit.client.1.smithi073.stdout:5/631: truncate dc/d3d/d55/d84/f34 1430975 0 2024-08-31T05:21:03.971 INFO:tasks.workunit.client.1.smithi073.stdout:9/658: write dc/d37/d42/d8d/d52/faf [61234,2555] 0 2024-08-31T05:21:03.971 INFO:tasks.workunit.client.1.smithi073.stdout:6/544: creat d15/d17/d26/d38/d9b/fad x:0 0 0 2024-08-31T05:21:03.974 INFO:tasks.workunit.client.1.smithi073.stdout:5/632: creat dc/d3d/dab/fdc x:0 0 0 2024-08-31T05:21:03.975 INFO:tasks.workunit.client.1.smithi073.stdout:1/468: dread d5/d10/d1c/f52 [0,4194304] 0 2024-08-31T05:21:03.976 INFO:tasks.workunit.client.1.smithi073.stdout:9/659: mknod dc/d37/cdb 0 2024-08-31T05:21:03.977 INFO:tasks.workunit.client.1.smithi073.stdout:9/660: readlink dc/d37/d42/l45 0 2024-08-31T05:21:03.977 INFO:tasks.workunit.client.1.smithi073.stdout:1/469: chown d5/d10/d1b/f63 4634642 1 2024-08-31T05:21:03.977 INFO:tasks.workunit.client.1.smithi073.stdout:7/489: sync 2024-08-31T05:21:03.977 INFO:tasks.workunit.client.1.smithi073.stdout:6/545: mkdir d15/d17/da1/dae 0 2024-08-31T05:21:03.979 INFO:tasks.workunit.client.1.smithi073.stdout:5/633: dread dc/d16/d1a/f1f [0,4194304] 0 2024-08-31T05:21:03.979 INFO:tasks.workunit.client.1.smithi073.stdout:1/470: dread - d5/d10/d1c/d69/f7a zero size 2024-08-31T05:21:03.980 INFO:tasks.workunit.client.1.smithi073.stdout:0/555: dread d0/f29 [0,4194304] 0 2024-08-31T05:21:03.980 INFO:tasks.workunit.client.1.smithi073.stdout:6/546: write d15/d17/d26/f34 [4309325,48744] 0 2024-08-31T05:21:03.981 INFO:tasks.workunit.client.1.smithi073.stdout:5/634: dread - dc/d16/d1a/fd6 zero size 2024-08-31T05:21:03.986 INFO:tasks.workunit.client.1.smithi073.stdout:9/661: dwrite dc/d37/f5e [0,4194304] 0 2024-08-31T05:21:03.986 INFO:tasks.workunit.client.1.smithi073.stdout:5/635: creat dc/fdd x:0 0 0 2024-08-31T05:21:03.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.986+0000 7f1ee77a8640 1 -- 172.21.15.67:0/1838055661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ee0102920 msgr2=0x7f1ee0102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:03.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.986+0000 7f1ee77a8640 1 --2- 172.21.15.67:0/1838055661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ee0102920 0x7f1ee0102da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ed00097e0 tx=0x7f1ed002a3f0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.986+0000 7f1ee77a8640 1 -- 172.21.15.67:0/1838055661 shutdown_connections 2024-08-31T05:21:03.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.986+0000 7f1ee77a8640 1 --2- 172.21.15.67:0/1838055661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ee0102920 0x7f1ee0102da0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.986+0000 7f1ee77a8640 1 --2- 172.21.15.67:0/1838055661 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ee0101720 0x7f1ee0101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.986+0000 7f1ee77a8640 1 -- 172.21.15.67:0/1838055661 >> 172.21.15.67:0/1838055661 conn(0x7f1ee00fceb0 msgr2=0x7f1ee00ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:03.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.986+0000 7f1ee77a8640 1 -- 172.21.15.67:0/1838055661 shutdown_connections 2024-08-31T05:21:03.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.986+0000 7f1ee77a8640 1 -- 172.21.15.67:0/1838055661 wait complete. 2024-08-31T05:21:03.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.987+0000 7f1ee77a8640 1 Processor -- start 2024-08-31T05:21:03.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.987+0000 7f1ee77a8640 1 -- start start 2024-08-31T05:21:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.988+0000 7f1ee77a8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ee0101720 0x7f1ee0197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.988+0000 7f1ee77a8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ee0102920 0x7f1ee0197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.988+0000 7f1ee77a8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee010a540 con 0x7f1ee0102920 2024-08-31T05:21:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.988+0000 7f1ee77a8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee010a3c0 con 0x7f1ee0101720 2024-08-31T05:21:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.988+0000 7f1ee4d43640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ee0102920 0x7f1ee0197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.988+0000 7f1ee4d43640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ee0102920 0x7f1ee0197780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54158/0 (socket says 172.21.15.67:54158) 2024-08-31T05:21:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.988+0000 7f1ee4d43640 1 -- 172.21.15.67:0/877628972 learned_addr learned my addr 172.21.15.67:0/877628972 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:21:03.991 INFO:tasks.workunit.client.1.smithi073.stdout:6/547: fsync d15/d1a/d2b/d2f/d4b/f8f 0 2024-08-31T05:21:03.991 INFO:tasks.workunit.client.1.smithi073.stdout:7/490: getdents d1/da/d3e/d22/d35/d83 0 2024-08-31T05:21:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.988+0000 7f1ee5544640 1 --2- 172.21.15.67:0/877628972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ee0101720 0x7f1ee0197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.989+0000 7f1ee4d43640 1 -- 172.21.15.67:0/877628972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ee0101720 msgr2=0x7f1ee0197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.989+0000 7f1ee4d43640 1 --2- 172.21.15.67:0/877628972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ee0101720 0x7f1ee0197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.989+0000 7f1ee4d43640 1 -- 172.21.15.67:0/877628972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee0197e00 con 0x7f1ee0102920 2024-08-31T05:21:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.989+0000 7f1ee4d43640 1 --2- 172.21.15.67:0/877628972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ee0102920 0x7f1ee0197780 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009900 tx=0x7f1ed00043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.989+0000 7f1ed67fc640 1 -- 172.21.15.67:0/877628972 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ed0040070 con 0x7f1ee0102920 2024-08-31T05:21:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.989+0000 7f1ee77a8640 1 -- 172.21.15.67:0/877628972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee019c7e0 con 0x7f1ee0102920 2024-08-31T05:21:03.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.989+0000 7f1ed67fc640 1 -- 172.21.15.67:0/877628972 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1ed0030c00 con 0x7f1ee0102920 2024-08-31T05:21:03.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.990+0000 7f1ed67fc640 1 -- 172.21.15.67:0/877628972 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ed0003b50 con 0x7f1ee0102920 2024-08-31T05:21:03.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.990+0000 7f1ee77a8640 1 -- 172.21.15.67:0/877628972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee019cd70 con 0x7f1ee0102920 2024-08-31T05:21:03.993 INFO:tasks.workunit.client.1.smithi073.stdout:9/662: rmdir dc/d37/d42/d8d/d52/d5f 39 2024-08-31T05:21:03.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.991+0000 7f1ee77a8640 1 -- 172.21.15.67:0/877628972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee0101b20 con 0x7f1ee0102920 2024-08-31T05:21:03.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.992+0000 7f1ed67fc640 1 -- 172.21.15.67:0/877628972 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7f1ed0039040 con 0x7f1ee0102920 2024-08-31T05:21:03.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.992+0000 7f1ed67fc640 1 --2- 172.21.15.67:0/877628972 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f1ecc073f50 0x7f1ecc076410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:03.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.992+0000 7f1ed67fc640 1 -- 172.21.15.67:0/877628972 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f1ed00b6640 con 0x7f1ee0102920 2024-08-31T05:21:03.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.993+0000 7f1ee5544640 1 --2- 172.21.15.67:0/877628972 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f1ecc073f50 0x7f1ecc076410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:03.997 INFO:tasks.workunit.client.1.smithi073.stdout:1/471: truncate f0 2353562 0 2024-08-31T05:21:03.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:03.995+0000 7f1ee5544640 1 --2- 172.21.15.67:0/877628972 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f1ecc073f50 0x7f1ecc076410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0096c0 tx=0x7f1edc009260 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:03.998 INFO:tasks.workunit.client.1.smithi073.stdout:9/663: mkdir dc/d27/ddc 0 2024-08-31T05:21:03.998 INFO:tasks.workunit.client.1.smithi073.stdout:6/548: write d15/f47 [1520618,96407] 0 2024-08-31T05:21:03.999 INFO:tasks.workunit.client.1.smithi073.stdout:9/664: chown dc/d37/d42/d8d/d52/l96 6 1 2024-08-31T05:21:04.000 INFO:tasks.workunit.client.1.smithi073.stdout:6/549: creat d15/d17/faf x:0 0 0 2024-08-31T05:21:04.001 INFO:tasks.workunit.client.1.smithi073.stdout:5/636: symlink dc/d16/d1a/db7/lde 0 2024-08-31T05:21:04.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.000+0000 7f1ed67fc640 1 -- 172.21.15.67:0/877628972 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f1ed0082200 con 0x7f1ee0102920 2024-08-31T05:21:04.002 INFO:tasks.workunit.client.1.smithi073.stdout:5/637: stat dc/d16/f54 0 2024-08-31T05:21:04.003 INFO:tasks.workunit.client.1.smithi073.stdout:9/665: getdents dc/d82/d97 0 2024-08-31T05:21:04.003 INFO:tasks.workunit.client.1.smithi073.stdout:6/550: truncate d15/d17/d26/d38/d9b/f73 4223143 0 2024-08-31T05:21:04.003 INFO:tasks.workunit.client.1.smithi073.stdout:9/666: chown dc/d27/cc6 5290986 1 2024-08-31T05:21:04.004 INFO:tasks.workunit.client.1.smithi073.stdout:6/551: chown d15/d1a/d2b/d2f/l84 1198826 1 2024-08-31T05:21:04.006 INFO:tasks.workunit.client.1.smithi073.stdout:5/638: creat dc/d3d/d55/d84/dcc/fdf x:0 0 0 2024-08-31T05:21:04.006 INFO:tasks.workunit.client.1.smithi073.stdout:6/552: truncate d15/d1a/d2b/f63 963507 0 2024-08-31T05:21:04.007 INFO:tasks.workunit.client.1.smithi073.stdout:9/667: dread dc/d37/d42/f94 [0,4194304] 0 2024-08-31T05:21:04.013 INFO:tasks.workunit.client.1.smithi073.stdout:5/639: dwrite dc/d3d/d55/d84/d49/f97 [0,4194304] 0 2024-08-31T05:21:04.015 INFO:tasks.workunit.client.1.smithi073.stdout:9/668: dwrite dc/d37/d42/d5a/fbc [0,4194304] 0 2024-08-31T05:21:04.015 INFO:tasks.workunit.client.1.smithi073.stdout:6/553: rename d15/d17/d26 to d15/d17/da1/dae/db0 0 2024-08-31T05:21:04.017 INFO:tasks.workunit.client.1.smithi073.stdout:9/669: fdatasync dc/de/d11/fa6 0 2024-08-31T05:21:04.019 INFO:tasks.workunit.client.1.smithi073.stdout:6/554: dread - d15/d17/da1/dae/db0/d38/d9b/fad zero size 2024-08-31T05:21:04.022 INFO:tasks.workunit.client.1.smithi073.stdout:9/670: creat dc/d37/d42/d5a/d89/db8/dd3/fdd x:0 0 0 2024-08-31T05:21:04.023 INFO:tasks.workunit.client.1.smithi073.stdout:9/671: write dc/d37/d42/f76 [735593,34772] 0 2024-08-31T05:21:04.027 INFO:tasks.workunit.client.1.smithi073.stdout:6/555: link d15/d1a/d2b/d2f/d4b/d97/fab d15/d1a/d1e/d69/d7e/fb1 0 2024-08-31T05:21:04.027 INFO:tasks.workunit.client.1.smithi073.stdout:5/640: truncate dc/d16/d3b/f74 3657826 0 2024-08-31T05:21:04.028 INFO:tasks.workunit.client.1.smithi073.stdout:6/556: write d15/d17/f5c [785509,35024] 0 2024-08-31T05:21:04.028 INFO:tasks.workunit.client.1.smithi073.stdout:5/641: truncate dc/d16/f96 187518 0 2024-08-31T05:21:04.029 INFO:tasks.workunit.client.1.smithi073.stdout:5/642: chown dc/d16/d3b/d3f/f50 5 1 2024-08-31T05:21:04.060 INFO:tasks.workunit.client.1.smithi073.stdout:5/643: write dc/f61 [2463360,101128] 0 2024-08-31T05:21:04.060 INFO:tasks.workunit.client.1.smithi073.stdout:9/672: unlink dc/d37/d42/d8d/c87 0 2024-08-31T05:21:04.060 INFO:tasks.workunit.client.1.smithi073.stdout:6/557: rename d15/d1a/d2b/l5a to d15/d1a/d1e/lb2 0 2024-08-31T05:21:04.062 INFO:tasks.workunit.client.1.smithi073.stdout:5/644: write dc/d53/f82 [924915,121489] 0 2024-08-31T05:21:04.063 INFO:tasks.workunit.client.1.smithi073.stdout:6/558: rmdir d15/d1a/d2b/d6a 39 2024-08-31T05:21:04.065 INFO:tasks.workunit.client.1.smithi073.stdout:5/645: fdatasync dc/d3d/f9c 0 2024-08-31T05:21:04.066 INFO:tasks.workunit.client.1.smithi073.stdout:9/673: dwrite dc/d27/fc7 [0,4194304] 0 2024-08-31T05:21:04.067 INFO:tasks.workunit.client.1.smithi073.stdout:5/646: dread - dc/d3d/d55/d84/d49/f8f zero size 2024-08-31T05:21:04.070 INFO:tasks.workunit.client.1.smithi073.stdout:9/674: symlink dc/d37/d42/d8d/d52/d5b/lde 0 2024-08-31T05:21:04.070 INFO:tasks.workunit.client.1.smithi073.stdout:5/647: truncate dc/d16/d1a/db7/dc1/fd9 357400 0 2024-08-31T05:21:04.078 INFO:tasks.workunit.client.1.smithi073.stdout:9/675: creat dc/d37/d42/d5a/fdf x:0 0 0 2024-08-31T05:21:04.080 INFO:tasks.workunit.client.1.smithi073.stdout:6/559: dread d15/d1a/d1e/f24 [4194304,4194304] 0 2024-08-31T05:21:04.082 INFO:tasks.workunit.client.1.smithi073.stdout:5/648: getdents dc/d16/d1a/d87/d94 0 2024-08-31T05:21:04.083 INFO:tasks.workunit.client.1.smithi073.stdout:5/649: fsync dc/d16/d3b/dc6/fce 0 2024-08-31T05:21:04.084 INFO:tasks.workunit.client.1.smithi073.stdout:6/560: mkdir d15/d1a/d2b/d2f/d99/db3 0 2024-08-31T05:21:04.087 INFO:tasks.workunit.client.1.smithi073.stdout:9/676: truncate dc/d37/d42/d8d/f57 1891513 0 2024-08-31T05:21:04.089 INFO:tasks.workunit.client.1.smithi073.stdout:5/650: dwrite dc/d16/d3b/fb4 [0,4194304] 0 2024-08-31T05:21:04.095 INFO:tasks.workunit.client.1.smithi073.stdout:5/651: dread dc/d16/d3b/fb4 [0,4194304] 0 2024-08-31T05:21:04.095 INFO:tasks.workunit.client.1.smithi073.stdout:5/652: chown dc/d16/f2e 12700 1 2024-08-31T05:21:04.097 INFO:tasks.workunit.client.1.smithi073.stdout:5/653: mknod dc/d3d/d55/d84/d49/ce0 0 2024-08-31T05:21:04.099 INFO:tasks.workunit.client.1.smithi073.stdout:5/654: truncate dc/d3d/d55/d84/d49/f71 5152186 0 2024-08-31T05:21:04.099 INFO:tasks.workunit.client.1.smithi073.stdout:9/677: dread dc/d37/d42/d8d/f57 [0,4194304] 0 2024-08-31T05:21:04.101 INFO:tasks.workunit.client.1.smithi073.stdout:5/655: unlink dc/d16/d1a/c44 0 2024-08-31T05:21:04.102 INFO:tasks.workunit.client.1.smithi073.stdout:5/656: write dc/d3d/d55/d84/f41 [5839447,68405] 0 2024-08-31T05:21:04.103 INFO:tasks.workunit.client.1.smithi073.stdout:3/569: sync 2024-08-31T05:21:04.104 INFO:tasks.workunit.client.1.smithi073.stdout:3/570: chown da/f62 915 1 2024-08-31T05:21:04.104 INFO:tasks.workunit.client.1.smithi073.stdout:5/657: mkdir dc/d16/d1a/db7/dc1/de1 0 2024-08-31T05:21:04.106 INFO:tasks.workunit.client.1.smithi073.stdout:3/571: mknod da/cbd 0 2024-08-31T05:21:04.106 INFO:tasks.workunit.client.1.smithi073.stdout:3/572: fsync da/d3c/d67/f73 0 2024-08-31T05:21:04.112 INFO:tasks.workunit.client.1.smithi073.stdout:5/658: write dc/d16/f54 [1665051,39239] 0 2024-08-31T05:21:04.112 INFO:tasks.workunit.client.1.smithi073.stdout:3/573: dwrite f9 [4194304,4194304] 0 2024-08-31T05:21:04.113 INFO:tasks.workunit.client.1.smithi073.stdout:5/659: dread dc/d16/d1a/db7/dc1/fd9 [0,4194304] 0 2024-08-31T05:21:04.113 INFO:tasks.workunit.client.1.smithi073.stdout:3/574: fsync da/d3c/d65/d87/fa8 0 2024-08-31T05:21:04.114 INFO:tasks.workunit.client.1.smithi073.stdout:3/575: fdatasync da/f15 0 2024-08-31T05:21:04.115 INFO:tasks.workunit.client.1.smithi073.stdout:3/576: chown da/d3c/d65/c3b 4896 1 2024-08-31T05:21:04.118 INFO:tasks.workunit.client.1.smithi073.stdout:3/577: mknod da/d3c/d82/d86/cbe 0 2024-08-31T05:21:04.121 INFO:tasks.workunit.client.1.smithi073.stdout:3/578: creat da/d18/da2/daf/fbf x:0 0 0 2024-08-31T05:21:04.122 INFO:tasks.workunit.client.1.smithi073.stdout:3/579: chown da/d18/f2a 1 1 2024-08-31T05:21:04.126 INFO:tasks.workunit.client.1.smithi073.stdout:3/580: chown da/d3c/d65/ca6 79376 1 2024-08-31T05:21:04.126 INFO:tasks.workunit.client.1.smithi073.stdout:5/660: dwrite fb [0,4194304] 0 2024-08-31T05:21:04.183 INFO:tasks.workunit.client.1.smithi073.stdout:3/581: read da/d3c/d65/f3a [541037,129301] 0 2024-08-31T05:21:04.190 INFO:tasks.workunit.client.1.smithi073.stdout:5/661: dread f9 [0,4194304] 0 2024-08-31T05:21:04.196 INFO:tasks.workunit.client.1.smithi073.stdout:5/662: dwrite dc/f39 [0,4194304] 0 2024-08-31T05:21:04.197 INFO:tasks.workunit.client.1.smithi073.stdout:5/663: write dc/d3d/d55/fc3 [1903407,40435] 0 2024-08-31T05:21:04.198 INFO:tasks.workunit.client.1.smithi073.stdout:5/664: stat dc/d3d/d55/d84/f8a 0 2024-08-31T05:21:04.199 INFO:tasks.workunit.client.1.smithi073.stdout:5/665: write dc/d3d/d55/d84/fa9 [817685,21369] 0 2024-08-31T05:21:04.204 INFO:tasks.workunit.client.1.smithi073.stdout:5/666: dwrite dc/d3d/d55/d84/f51 [0,4194304] 0 2024-08-31T05:21:04.211 INFO:tasks.workunit.client.1.smithi073.stdout:5/667: dwrite dc/d16/d3b/f76 [0,4194304] 0 2024-08-31T05:21:04.215 INFO:tasks.workunit.client.1.smithi073.stdout:5/668: write dc/d3d/d55/d84/f8a [1400358,71458] 0 2024-08-31T05:21:04.221 INFO:tasks.workunit.client.1.smithi073.stdout:5/669: read dc/d3d/d55/d84/d49/dd2/f70 [460464,50141] 0 2024-08-31T05:21:04.224 INFO:tasks.workunit.client.1.smithi073.stdout:5/670: rename dc/d16/f54 to dc/d3d/d3e/fe2 0 2024-08-31T05:21:04.225 INFO:tasks.workunit.client.1.smithi073.stdout:5/671: read dc/f39 [3731403,130528] 0 2024-08-31T05:21:04.226 INFO:tasks.workunit.client.1.smithi073.stdout:5/672: fdatasync dc/d16/d3b/d3f/f50 0 2024-08-31T05:21:04.228 INFO:tasks.workunit.client.1.smithi073.stdout:5/673: mknod dc/d3d/d55/d84/dcc/ce3 0 2024-08-31T05:21:04.230 INFO:tasks.workunit.client.1.smithi073.stdout:5/674: creat dc/d16/d3b/fe4 x:0 0 0 2024-08-31T05:21:04.233 INFO:tasks.workunit.client.1.smithi073.stdout:5/675: chown dc/d3d/d55/d84/f34 2016 1 2024-08-31T05:21:04.233 INFO:tasks.workunit.client.1.smithi073.stdout:5/676: dread - dc/d16/d4e/fae zero size 2024-08-31T05:21:04.233 INFO:tasks.workunit.client.1.smithi073.stdout:5/677: dread - dc/d16/d1a/fd6 zero size 2024-08-31T05:21:04.233 INFO:tasks.workunit.client.1.smithi073.stdout:5/678: chown dc/l6e 3 1 2024-08-31T05:21:04.236 INFO:tasks.workunit.client.1.smithi073.stdout:5/679: creat dc/d16/d3b/d7f/fe5 x:0 0 0 2024-08-31T05:21:04.238 INFO:tasks.workunit.client.1.smithi073.stdout:5/680: rename dc/d16/cb0 to dc/d16/d3b/d3f/d4f/ce6 0 2024-08-31T05:21:04.246 INFO:tasks.workunit.client.1.smithi073.stdout:5/681: dwrite dc/d3d/d55/d84/f2c [0,4194304] 0 2024-08-31T05:21:04.248 INFO:tasks.workunit.client.1.smithi073.stdout:5/682: chown dc/d16/d3b/d7f/cbb 101018946 1 2024-08-31T05:21:04.249 INFO:tasks.workunit.client.1.smithi073.stdout:5/683: chown dc/d3d/d55/d84/d49/dd2/lbc 120530847 1 2024-08-31T05:21:04.254 INFO:tasks.workunit.client.1.smithi073.stdout:5/684: dwrite dc/d16/f96 [0,4194304] 0 2024-08-31T05:21:04.257 INFO:tasks.workunit.client.1.smithi073.stdout:5/685: fsync dc/f67 0 2024-08-31T05:21:04.257 INFO:tasks.workunit.client.1.smithi073.stdout:5/686: write dc/d3d/f4c [1858430,9407] 0 2024-08-31T05:21:04.260 INFO:tasks.workunit.client.1.smithi073.stdout:5/687: write dc/d16/f2e [251535,67725] 0 2024-08-31T05:21:04.261 INFO:tasks.workunit.client.1.smithi073.stdout:2/500: sync 2024-08-31T05:21:04.267 INFO:tasks.workunit.client.1.smithi073.stdout:5/688: write dc/d16/d3b/f74 [562012,130900] 0 2024-08-31T05:21:04.267 INFO:tasks.workunit.client.1.smithi073.stdout:2/501: truncate d2/d9/f81 930152 0 2024-08-31T05:21:04.269 INFO:tasks.workunit.client.1.smithi073.stdout:5/689: dread dc/d16/d3b/d3f/d4f/f6c [0,4194304] 0 2024-08-31T05:21:04.271 INFO:tasks.workunit.client.1.smithi073.stdout:5/690: chown dc/d16/d3b/d3f 69912989 1 2024-08-31T05:21:04.274 INFO:tasks.workunit.client.1.smithi073.stdout:2/502: dwrite d2/d9/d66/d70/f72 [0,4194304] 0 2024-08-31T05:21:04.277 INFO:tasks.workunit.client.1.smithi073.stdout:2/503: symlink d2/d9/df/la5 0 2024-08-31T05:21:04.279 INFO:tasks.workunit.client.1.smithi073.stdout:5/691: truncate dc/d3d/d55/d84/d49/f71 1183404 0 2024-08-31T05:21:04.281 INFO:tasks.workunit.client.1.smithi073.stdout:2/504: rename d2/d9/d32/d56 to d2/d9/d27/d9b/da6 0 2024-08-31T05:21:04.282 INFO:tasks.workunit.client.1.smithi073.stdout:5/692: dread f9 [0,4194304] 0 2024-08-31T05:21:04.284 INFO:tasks.workunit.client.1.smithi073.stdout:5/693: mknod dc/d3d/d3e/ce7 0 2024-08-31T05:21:04.285 INFO:tasks.workunit.client.1.smithi073.stdout:5/694: write dc/f67 [583469,122532] 0 2024-08-31T05:21:04.285 INFO:tasks.workunit.client.1.smithi073.stdout:2/505: rmdir d2/d9/d32/d5d/da3 0 2024-08-31T05:21:04.287 INFO:tasks.workunit.client.1.smithi073.stdout:5/695: mknod dc/d3d/dab/dd5/ce8 0 2024-08-31T05:21:04.287 INFO:tasks.workunit.client.1.smithi073.stdout:5/696: readlink dc/d3d/d55/d84/d49/l5d 0 2024-08-31T05:21:04.290 INFO:tasks.workunit.client.1.smithi073.stdout:5/697: rename dc/d3d/d55/l78 to dc/d16/d4e/le9 0 2024-08-31T05:21:04.291 INFO:tasks.workunit.client.1.smithi073.stdout:5/698: write dc/d3d/d3e/fe2 [1271589,25162] 0 2024-08-31T05:21:04.293 INFO:tasks.workunit.client.1.smithi073.stdout:5/699: truncate dc/d3d/d55/d84/dbd/fd7 773286 0 2024-08-31T05:21:04.293 INFO:tasks.workunit.client.1.smithi073.stdout:5/700: stat dc/d16/d1a/l29 0 2024-08-31T05:21:04.308 INFO:tasks.workunit.client.1.smithi073.stdout:5/701: dread dc/d3d/d55/d84/d49/f71 [0,4194304] 0 2024-08-31T05:21:04.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.316+0000 7f1ee77a8640 1 -- 172.21.15.67:0/877628972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1ee0062b90 con 0x7f1ee0102920 2024-08-31T05:21:04.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.317+0000 7f1ed67fc640 1 -- 172.21.15.67:0/877628972 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f1ed0084720 con 0x7f1ee0102920 2024-08-31T05:21:04.319 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:21:04.319 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:21:04.319 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2 2024-08-31T05:21:04.319 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:21:04.319 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:21:04.319 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 1, 2024-08-31T05:21:04.319 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 1 2024-08-31T05:21:04.319 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:21:04.319 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:21:04.319 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 6 2024-08-31T05:21:04.319 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:21:04.320 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:21:04.320 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:21:04.320 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:21:04.320 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:21:04.320 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 13, 2024-08-31T05:21:04.320 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 1 2024-08-31T05:21:04.320 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:21:04.320 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:21:04.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.319+0000 7f1ee77a8640 1 -- 172.21.15.67:0/877628972 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f1ecc073f50 msgr2=0x7f1ecc076410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.319+0000 7f1ee77a8640 1 --2- 172.21.15.67:0/877628972 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f1ecc073f50 0x7f1ecc076410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0096c0 tx=0x7f1edc009260 comp rx=0 tx=0).stop 2024-08-31T05:21:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.319+0000 7f1ee77a8640 1 -- 172.21.15.67:0/877628972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ee0102920 msgr2=0x7f1ee0197780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.319+0000 7f1ee77a8640 1 --2- 172.21.15.67:0/877628972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ee0102920 0x7f1ee0197780 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009900 tx=0x7f1ed00043b0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.320+0000 7f1ee77a8640 1 -- 172.21.15.67:0/877628972 shutdown_connections 2024-08-31T05:21:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.320+0000 7f1ee77a8640 1 --2- 172.21.15.67:0/877628972 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f1ecc073f50 0x7f1ecc076410 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.320+0000 7f1ee77a8640 1 --2- 172.21.15.67:0/877628972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ee0102920 0x7f1ee0197780 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.320+0000 7f1ee77a8640 1 --2- 172.21.15.67:0/877628972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ee0101720 0x7f1ee0197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.320+0000 7f1ee77a8640 1 -- 172.21.15.67:0/877628972 >> 172.21.15.67:0/877628972 conn(0x7f1ee00fceb0 msgr2=0x7f1ee0105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.320+0000 7f1ee77a8640 1 -- 172.21.15.67:0/877628972 shutdown_connections 2024-08-31T05:21:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.320+0000 7f1ee77a8640 1 -- 172.21.15.67:0/877628972 wait complete. 2024-08-31T05:21:04.371 INFO:tasks.workunit.client.1.smithi073.stdout:8/581: sync 2024-08-31T05:21:04.372 INFO:tasks.workunit.client.1.smithi073.stdout:4/498: sync 2024-08-31T05:21:04.373 INFO:tasks.workunit.client.1.smithi073.stdout:4/499: mkdir d7/df/d13/d53/d8b 0 2024-08-31T05:21:04.374 INFO:tasks.workunit.client.1.smithi073.stdout:4/500: dread - d7/db/f77 zero size 2024-08-31T05:21:04.374 INFO:tasks.workunit.client.1.smithi073.stdout:4/501: chown d7/f81 690 1 2024-08-31T05:21:04.375 INFO:tasks.workunit.client.1.smithi073.stdout:8/582: mkdir d0/db/d1c/d24/d73/db0 0 2024-08-31T05:21:04.375 INFO:tasks.workunit.client.1.smithi073.stdout:4/502: truncate d7/db/f77 242234 0 2024-08-31T05:21:04.377 INFO:tasks.workunit.client.1.smithi073.stdout:8/583: symlink d0/db/d1c/d2a/lb1 0 2024-08-31T05:21:04.377 INFO:tasks.workunit.client.1.smithi073.stdout:8/584: stat d0/db/d1c/d34/d38/f64 0 2024-08-31T05:21:04.379 INFO:tasks.workunit.client.1.smithi073.stdout:4/503: rename d7/df/f3f to d7/d1a/d5c/d6d/d59/d86/f8c 0 2024-08-31T05:21:04.380 INFO:tasks.workunit.client.1.smithi073.stdout:4/504: truncate d7/d1a/d5c/d6d/d2c/f7b 4749425 0 2024-08-31T05:21:04.380 INFO:tasks.workunit.client.1.smithi073.stdout:8/585: symlink d0/db/d44/d9e/lb2 0 2024-08-31T05:21:04.381 INFO:tasks.workunit.client.1.smithi073.stdout:8/586: truncate d0/db/d44/d72/d79/f83 133411 0 2024-08-31T05:21:04.382 INFO:tasks.workunit.client.1.smithi073.stdout:4/505: unlink d7/d1a/d5c/l6a 0 2024-08-31T05:21:04.385 INFO:tasks.workunit.client.1.smithi073.stdout:8/587: rename d0/d62/fa0 to d0/db/d44/d72/d75/d7e/fb3 0 2024-08-31T05:21:04.386 INFO:tasks.workunit.client.1.smithi073.stdout:4/506: creat d7/d1a/d5c/d6d/f8d x:0 0 0 2024-08-31T05:21:04.387 INFO:tasks.workunit.client.1.smithi073.stdout:8/588: mkdir d0/d62/db4 0 2024-08-31T05:21:04.389 INFO:tasks.workunit.client.1.smithi073.stdout:4/507: unlink d7/db/f19 0 2024-08-31T05:21:04.392 INFO:tasks.workunit.client.1.smithi073.stdout:4/508: symlink d7/df/d13/d2e/d47/d4c/d50/l8e 0 2024-08-31T05:21:04.393 INFO:tasks.workunit.client.1.smithi073.stdout:4/509: write d7/d1a/d5c/d6d/d2c/f7b [4246159,100038] 0 2024-08-31T05:21:04.408 INFO:tasks.workunit.client.1.smithi073.stdout:8/589: dwrite d0/db/d1c/d34/d38/f42 [0,4194304] 0 2024-08-31T05:21:04.409 INFO:tasks.workunit.client.1.smithi073.stdout:4/510: dwrite d7/f46 [0,4194304] 0 2024-08-31T05:21:04.409 INFO:tasks.workunit.client.1.smithi073.stdout:8/590: chown d0/f5 1284934917 1 2024-08-31T05:21:04.411 INFO:tasks.workunit.client.1.smithi073.stdout:8/591: rmdir d0/db/d44/d4e 39 2024-08-31T05:21:04.416 INFO:tasks.workunit.client.1.smithi073.stdout:4/511: write d7/df/d13/f2b [2502420,116280] 0 2024-08-31T05:21:04.416 INFO:tasks.workunit.client.1.smithi073.stdout:8/592: write d0/d62/f8d [2013976,13986] 0 2024-08-31T05:21:04.419 INFO:tasks.workunit.client.1.smithi073.stdout:8/593: symlink d0/db/d1c/d34/lb5 0 2024-08-31T05:21:04.421 INFO:tasks.workunit.client.1.smithi073.stdout:6/561: sync 2024-08-31T05:21:04.421 INFO:tasks.workunit.client.1.smithi073.stdout:3/582: sync 2024-08-31T05:21:04.421 INFO:tasks.workunit.client.1.smithi073.stdout:7/491: sync 2024-08-31T05:21:04.421 INFO:tasks.workunit.client.1.smithi073.stdout:2/506: sync 2024-08-31T05:21:04.422 INFO:tasks.workunit.client.1.smithi073.stdout:9/678: sync 2024-08-31T05:21:04.422 INFO:tasks.workunit.client.1.smithi073.stdout:0/556: sync 2024-08-31T05:21:04.422 INFO:tasks.workunit.client.1.smithi073.stdout:1/472: sync 2024-08-31T05:21:04.424 INFO:tasks.workunit.client.1.smithi073.stdout:6/562: truncate fd 5775027 0 2024-08-31T05:21:04.424 INFO:tasks.workunit.client.1.smithi073.stdout:1/473: chown d5/d10/d1b 961 1 2024-08-31T05:21:04.426 INFO:tasks.workunit.client.1.smithi073.stdout:7/492: stat d1/da/d3e/d22/d47/l82 0 2024-08-31T05:21:04.427 INFO:tasks.workunit.client.1.smithi073.stdout:4/512: dwrite d7/d1a/f29 [0,4194304] 0 2024-08-31T05:21:04.428 INFO:tasks.workunit.client.1.smithi073.stdout:3/583: symlink da/d3c/d82/d95/db9/lc0 0 2024-08-31T05:21:04.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.432+0000 7f94099e2640 1 -- 172.21.15.67:0/3074449404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404100600 msgr2=0x7f9404100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:04.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.432+0000 7f94099e2640 1 --2- 172.21.15.67:0/3074449404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404100600 0x7f9404100a00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009880 tx=0x7f93f402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.432+0000 7f94099e2640 1 -- 172.21.15.67:0/3074449404 shutdown_connections 2024-08-31T05:21:04.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.432+0000 7f94099e2640 1 --2- 172.21.15.67:0/3074449404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9404101800 0x7f9404101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.432+0000 7f94099e2640 1 --2- 172.21.15.67:0/3074449404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404100600 0x7f9404100a00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.432+0000 7f94099e2640 1 -- 172.21.15.67:0/3074449404 >> 172.21.15.67:0/3074449404 conn(0x7f94040fbdb0 msgr2=0x7f94040fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:04.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.432+0000 7f94099e2640 1 -- 172.21.15.67:0/3074449404 shutdown_connections 2024-08-31T05:21:04.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.432+0000 7f94099e2640 1 -- 172.21.15.67:0/3074449404 wait complete. 2024-08-31T05:21:04.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.433+0000 7f94099e2640 1 Processor -- start 2024-08-31T05:21:04.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.433+0000 7f94099e2640 1 -- start start 2024-08-31T05:21:04.438 INFO:tasks.workunit.client.1.smithi073.stdout:0/557: getdents d0/d28 0 2024-08-31T05:21:04.438 INFO:tasks.workunit.client.1.smithi073.stdout:7/493: chown d1/da/d65/f86 43476 1 2024-08-31T05:21:04.438 INFO:tasks.workunit.client.1.smithi073.stdout:1/474: write d5/d26/d54/f6c [588926,115353] 0 2024-08-31T05:21:04.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.433+0000 7f94099e2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9404100600 0x7f94041972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:04.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.433+0000 7f94099e2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404101800 0x7f9404197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:04.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.433+0000 7f94099e2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9404109440 con 0x7f9404101800 2024-08-31T05:21:04.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.433+0000 7f94099e2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f94041092c0 con 0x7f9404100600 2024-08-31T05:21:04.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.433+0000 7f94027fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404101800 0x7f9404197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:04.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.434+0000 7f94027fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404101800 0x7f9404197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54184/0 (socket says 172.21.15.67:54184) 2024-08-31T05:21:04.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.434+0000 7f94027fc640 1 -- 172.21.15.67:0/17812025 learned_addr learned my addr 172.21.15.67:0/17812025 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:21:04.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.434+0000 7f94027fc640 1 -- 172.21.15.67:0/17812025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9404100600 msgr2=0x7f94041972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:04.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.434+0000 7f94027fc640 1 --2- 172.21.15.67:0/17812025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9404100600 0x7f94041972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.434+0000 7f94027fc640 1 -- 172.21.15.67:0/17812025 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9404197e80 con 0x7f9404101800 2024-08-31T05:21:04.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.434+0000 7f94027fc640 1 --2- 172.21.15.67:0/17812025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404101800 0x7f9404197800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f93f800d6f0 tx=0x7f93f800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:04.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.435+0000 7f94089e0640 1 -- 172.21.15.67:0/17812025 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93f8017070 con 0x7f9404101800 2024-08-31T05:21:04.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.435+0000 7f94089e0640 1 -- 172.21.15.67:0/17812025 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f93f800de00 con 0x7f9404101800 2024-08-31T05:21:04.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.435+0000 7f94089e0640 1 -- 172.21.15.67:0/17812025 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93f8004bb0 con 0x7f9404101800 2024-08-31T05:21:04.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.435+0000 7f94099e2640 1 -- 172.21.15.67:0/17812025 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9404102a80 con 0x7f9404101800 2024-08-31T05:21:04.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.435+0000 7f94099e2640 1 -- 172.21.15.67:0/17812025 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9404102fb0 con 0x7f9404101800 2024-08-31T05:21:04.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.436+0000 7f94099e2640 1 -- 172.21.15.67:0/17812025 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9404100a00 con 0x7f9404101800 2024-08-31T05:21:04.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.437+0000 7f94089e0640 1 -- 172.21.15.67:0/17812025 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7f93f8009a30 con 0x7f9404101800 2024-08-31T05:21:04.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.438+0000 7f94089e0640 1 --2- 172.21.15.67:0/17812025 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f93ec073fa0 0x7f93ec076460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:04.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.438+0000 7f94089e0640 1 -- 172.21.15.67:0/17812025 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f93f8095010 con 0x7f9404101800 2024-08-31T05:21:04.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.439+0000 7f9402ffd640 1 --2- 172.21.15.67:0/17812025 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f93ec073fa0 0x7f93ec076460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:04.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.439+0000 7f9402ffd640 1 --2- 172.21.15.67:0/17812025 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f93ec073fa0 0x7f93ec076460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93f402a9c0 tx=0x7f93f4000bc0 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:04.443 INFO:tasks.workunit.client.1.smithi073.stdout:8/594: dread d0/db/d44/d72/d75/d7e/f99 [0,4194304] 0 2024-08-31T05:21:04.444 INFO:tasks.workunit.client.1.smithi073.stdout:4/513: creat d7/df/d13/d2e/d70/d6b/f8f x:0 0 0 2024-08-31T05:21:04.444 INFO:tasks.workunit.client.1.smithi073.stdout:2/507: dwrite d2/d9/f2a [0,4194304] 0 2024-08-31T05:21:04.444 INFO:tasks.workunit.client.1.smithi073.stdout:6/563: getdents d15/d41 0 2024-08-31T05:21:04.444 INFO:tasks.workunit.client.1.smithi073.stdout:7/494: truncate d1/f43 589307 0 2024-08-31T05:21:04.445 INFO:tasks.workunit.client.1.smithi073.stdout:0/558: creat d0/d69/d7f/d62/fb2 x:0 0 0 2024-08-31T05:21:04.447 INFO:tasks.workunit.client.1.smithi073.stdout:4/514: stat d7/d1a/d5c/d62/l83 0 2024-08-31T05:21:04.448 INFO:tasks.workunit.client.1.smithi073.stdout:2/508: write d2/f87 [323388,66282] 0 2024-08-31T05:21:04.449 INFO:tasks.workunit.client.1.smithi073.stdout:6/564: truncate d15/f22 1514478 0 2024-08-31T05:21:04.449 INFO:tasks.workunit.client.1.smithi073.stdout:3/584: dwrite da/f15 [0,4194304] 0 2024-08-31T05:21:04.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.448+0000 7f94089e0640 1 -- 172.21.15.67:0/17812025 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f93f805cae0 con 0x7f9404101800 2024-08-31T05:21:04.454 INFO:tasks.workunit.client.1.smithi073.stdout:0/559: chown d0/d69/d7f/f71 15 1 2024-08-31T05:21:04.454 INFO:tasks.workunit.client.1.smithi073.stdout:7/495: stat d1/da/d3e/d22/l5e 0 2024-08-31T05:21:04.455 INFO:tasks.workunit.client.1.smithi073.stdout:2/509: mkdir d2/d9/d27/d9b/da7 0 2024-08-31T05:21:04.457 INFO:tasks.workunit.client.1.smithi073.stdout:6/565: dread - d15/d75/f76 zero size 2024-08-31T05:21:04.460 INFO:tasks.workunit.client.1.smithi073.stdout:1/475: dwrite d5/f25 [4194304,4194304] 0 2024-08-31T05:21:04.461 INFO:tasks.workunit.client.1.smithi073.stdout:9/679: dread dc/d37/d42/d8d/f74 [0,4194304] 0 2024-08-31T05:21:04.464 INFO:tasks.workunit.client.1.smithi073.stdout:0/560: creat d0/d69/d7f/d68/d91/fb3 x:0 0 0 2024-08-31T05:21:04.464 INFO:tasks.workunit.client.1.smithi073.stdout:6/566: write d15/d17/f5e [9958,124449] 0 2024-08-31T05:21:04.470 INFO:tasks.workunit.client.1.smithi073.stdout:1/476: write d5/d17/f2f [377959,93648] 0 2024-08-31T05:21:04.470 INFO:tasks.workunit.client.1.smithi073.stdout:5/702: sync 2024-08-31T05:21:04.471 INFO:tasks.workunit.client.1.smithi073.stdout:0/561: dread - d0/d28/f80 zero size 2024-08-31T05:21:04.471 INFO:tasks.workunit.client.1.smithi073.stdout:9/680: rmdir dc/d37/d42/d8d 39 2024-08-31T05:21:04.476 INFO:tasks.workunit.client.1.smithi073.stdout:4/515: dwrite d7/f81 [0,4194304] 0 2024-08-31T05:21:04.477 INFO:tasks.workunit.client.1.smithi073.stdout:3/585: dwrite da/d68/f69 [0,4194304] 0 2024-08-31T05:21:04.478 INFO:tasks.workunit.client.1.smithi073.stdout:5/703: chown dc/d3d/d55/d84/fa9 525392690 1 2024-08-31T05:21:04.481 INFO:tasks.workunit.client.1.smithi073.stdout:8/595: dread d0/db/f5a [0,4194304] 0 2024-08-31T05:21:04.482 INFO:tasks.workunit.client.1.smithi073.stdout:9/681: write dc/de/d66/d84/f90 [4614090,15299] 0 2024-08-31T05:21:04.483 INFO:tasks.workunit.client.1.smithi073.stdout:1/477: creat d5/d17/d32/d37/f8a x:0 0 0 2024-08-31T05:21:04.484 INFO:tasks.workunit.client.1.smithi073.stdout:2/510: dwrite d2/d9/d32/d5d/f7c [0,4194304] 0 2024-08-31T05:21:04.485 INFO:tasks.workunit.client.1.smithi073.stdout:8/596: chown d0/db 935744 1 2024-08-31T05:21:04.486 INFO:tasks.workunit.client.1.smithi073.stdout:6/567: getdents d15/d17/da1/dae/db0/d38/d9b/d87 0 2024-08-31T05:21:04.487 INFO:tasks.workunit.client.1.smithi073.stdout:5/704: write dc/d3d/d55/d84/f8a [2499430,94529] 0 2024-08-31T05:21:04.488 INFO:tasks.workunit.client.1.smithi073.stdout:7/496: dwrite d1/da/d38/f4c [0,4194304] 0 2024-08-31T05:21:04.495 INFO:tasks.workunit.client.1.smithi073.stdout:0/562: dwrite d0/f26 [4194304,4194304] 0 2024-08-31T05:21:04.496 INFO:tasks.workunit.client.1.smithi073.stdout:2/511: write d2/d9/d27/f33 [696947,19496] 0 2024-08-31T05:21:04.497 INFO:tasks.workunit.client.1.smithi073.stdout:5/705: mkdir dc/d3d/d55/d84/dcc/dea 0 2024-08-31T05:21:04.498 INFO:tasks.workunit.client.1.smithi073.stdout:1/478: truncate d5/d17/d32/d37/f8a 82135 0 2024-08-31T05:21:04.498 INFO:tasks.workunit.client.1.smithi073.stdout:7/497: dread - d1/da/d3e/d22/f75 zero size 2024-08-31T05:21:04.502 INFO:tasks.workunit.client.1.smithi073.stdout:8/597: getdents d0/d62 0 2024-08-31T05:21:04.504 INFO:tasks.workunit.client.1.smithi073.stdout:2/512: write d2/d9/f77 [42455,29563] 0 2024-08-31T05:21:04.505 INFO:tasks.workunit.client.1.smithi073.stdout:6/568: link d15/d17/f65 d15/d75/fb4 0 2024-08-31T05:21:04.507 INFO:tasks.workunit.client.1.smithi073.stdout:3/586: dwrite da/d3c/d5a/f66 [0,4194304] 0 2024-08-31T05:21:04.508 INFO:tasks.workunit.client.1.smithi073.stdout:0/563: write d0/d15/d2c/d41/d52/f55 [1512369,69540] 0 2024-08-31T05:21:04.510 INFO:tasks.workunit.client.1.smithi073.stdout:8/598: symlink d0/db/d44/d72/d75/d7e/lb6 0 2024-08-31T05:21:04.514 INFO:tasks.workunit.client.1.smithi073.stdout:6/569: rmdir d15/d17/da1/dae/db0 39 2024-08-31T05:21:04.515 INFO:tasks.workunit.client.1.smithi073.stdout:0/564: stat d0/d15/d2c/d40/d4a/fad 0 2024-08-31T05:21:04.516 INFO:tasks.workunit.client.1.smithi073.stdout:8/599: write d0/db/d44/f70 [251461,17457] 0 2024-08-31T05:21:04.517 INFO:tasks.workunit.client.1.smithi073.stdout:7/498: truncate d1/da/d3e/d22/d35/f9c 479945 0 2024-08-31T05:21:04.519 INFO:tasks.workunit.client.1.smithi073.stdout:5/706: dwrite dc/d3d/fa2 [4194304,4194304] 0 2024-08-31T05:21:04.519 INFO:tasks.workunit.client.1.smithi073.stdout:0/565: dread - d0/d58/f70 zero size 2024-08-31T05:21:04.520 INFO:tasks.workunit.client.1.smithi073.stdout:2/513: link d2/d9/df/f1a d2/d9/d27/d9b/da7/fa8 0 2024-08-31T05:21:04.521 INFO:tasks.workunit.client.1.smithi073.stdout:1/479: dwrite d5/d17/f57 [0,4194304] 0 2024-08-31T05:21:04.522 INFO:tasks.workunit.client.1.smithi073.stdout:5/707: readlink dc/d16/d3b/d7f/lca 0 2024-08-31T05:21:04.524 INFO:tasks.workunit.client.1.smithi073.stdout:8/600: mknod d0/db/d44/d72/cb7 0 2024-08-31T05:21:04.525 INFO:tasks.workunit.client.1.smithi073.stdout:5/708: chown dc/d16/d1a/fd6 4 1 2024-08-31T05:21:04.525 INFO:tasks.workunit.client.1.smithi073.stdout:0/566: truncate d0/d69/d7f/f97 1199635 0 2024-08-31T05:21:04.525 INFO:tasks.workunit.client.1.smithi073.stdout:1/480: dread - d5/d26/d54/d5f/f7c zero size 2024-08-31T05:21:04.528 INFO:tasks.workunit.client.1.smithi073.stdout:7/499: truncate d1/da/d15/d33/f50 542513 0 2024-08-31T05:21:04.532 INFO:tasks.workunit.client.1.smithi073.stdout:8/601: read d0/db/d1c/d2a/f30 [3780791,71309] 0 2024-08-31T05:21:04.533 INFO:tasks.workunit.client.1.smithi073.stdout:0/567: creat d0/d15/d2c/d4d/d3c/fb4 x:0 0 0 2024-08-31T05:21:04.533 INFO:tasks.workunit.client.1.smithi073.stdout:6/570: creat d15/d17/da1/dae/db0/d38/d9b/d87/fb5 x:0 0 0 2024-08-31T05:21:04.536 INFO:tasks.workunit.client.1.smithi073.stdout:7/500: mkdir d1/da/d3e/d22/d47/da8 0 2024-08-31T05:21:04.537 INFO:tasks.workunit.client.1.smithi073.stdout:1/481: dwrite d5/d26/f64 [0,4194304] 0 2024-08-31T05:21:04.539 INFO:tasks.workunit.client.1.smithi073.stdout:2/514: dwrite d2/d9/df/d43/f7a [0,4194304] 0 2024-08-31T05:21:04.540 INFO:tasks.workunit.client.1.smithi073.stdout:8/602: write d0/db/d1c/d23/f26 [2571784,44016] 0 2024-08-31T05:21:04.543 INFO:tasks.workunit.client.1.smithi073.stdout:0/568: symlink d0/d15/d2c/d40/d4a/d6b/lb5 0 2024-08-31T05:21:04.545 INFO:tasks.workunit.client.1.smithi073.stdout:1/482: mknod d5/d17/d32/c8b 0 2024-08-31T05:21:04.546 INFO:tasks.workunit.client.1.smithi073.stdout:4/516: dread d7/df/d13/d2e/f48 [4194304,4194304] 0 2024-08-31T05:21:04.547 INFO:tasks.workunit.client.1.smithi073.stdout:2/515: mknod d2/d9/d3c/ca9 0 2024-08-31T05:21:04.551 INFO:tasks.workunit.client.1.smithi073.stdout:1/483: creat d5/d17/d5d/d61/f8c x:0 0 0 2024-08-31T05:21:04.556 INFO:tasks.workunit.client.1.smithi073.stdout:6/571: dwrite d15/d1a/d2b/d2f/d4b/f8f [0,4194304] 0 2024-08-31T05:21:04.556 INFO:tasks.workunit.client.1.smithi073.stdout:2/516: mkdir d2/d9/d32/daa 0 2024-08-31T05:21:04.560 INFO:tasks.workunit.client.1.smithi073.stdout:8/603: dwrite d0/db/f5a [0,4194304] 0 2024-08-31T05:21:04.564 INFO:tasks.workunit.client.1.smithi073.stdout:4/517: dwrite d7/df/f25 [0,4194304] 0 2024-08-31T05:21:04.568 INFO:tasks.workunit.client.1.smithi073.stdout:1/484: dread d5/d10/d1b/f63 [0,4194304] 0 2024-08-31T05:21:04.570 INFO:tasks.workunit.client.1.smithi073.stdout:3/587: dread da/ff [0,4194304] 0 2024-08-31T05:21:04.570 INFO:tasks.workunit.client.1.smithi073.stdout:2/517: rename d2/d9/d32 to d2/d9/d7f/dab 0 2024-08-31T05:21:04.572 INFO:tasks.workunit.client.1.smithi073.stdout:5/709: dread dc/d16/d1a/f72 [0,4194304] 0 2024-08-31T05:21:04.575 INFO:tasks.workunit.client.1.smithi073.stdout:1/485: fsync d5/d10/d1c/f52 0 2024-08-31T05:21:04.577 INFO:tasks.workunit.client.1.smithi073.stdout:2/518: creat d2/d25/fac x:0 0 0 2024-08-31T05:21:04.577 INFO:tasks.workunit.client.1.smithi073.stdout:6/572: dwrite d15/d17/da1/dae/db0/d38/f62 [4194304,4194304] 0 2024-08-31T05:21:04.578 INFO:tasks.workunit.client.1.smithi073.stdout:8/604: dwrite d0/db/d1c/f20 [0,4194304] 0 2024-08-31T05:21:04.579 INFO:tasks.workunit.client.1.smithi073.stdout:1/486: chown d5/f9 149592494 1 2024-08-31T05:21:04.581 INFO:tasks.workunit.client.1.smithi073.stdout:2/519: dread - d2/d9/d7f/dab/d5d/d82/f8a zero size 2024-08-31T05:21:04.582 INFO:tasks.workunit.client.1.smithi073.stdout:8/605: write d0/db/d1c/d24/faa [390752,92718] 0 2024-08-31T05:21:04.582 INFO:tasks.workunit.client.1.smithi073.stdout:6/573: chown d15/d1a/d2b/d2f/d4b/d97 54 1 2024-08-31T05:21:04.584 INFO:tasks.workunit.client.1.smithi073.stdout:3/588: rename da/d3c/d65/d40/l79 to da/d3c/d5a/lc1 0 2024-08-31T05:21:04.584 INFO:tasks.workunit.client.1.smithi073.stdout:1/487: write d5/d17/d2a/f5b [294227,113783] 0 2024-08-31T05:21:04.587 INFO:tasks.workunit.client.1.smithi073.stdout:2/520: truncate d2/d9/d7f/f83 545735 0 2024-08-31T05:21:04.587 INFO:tasks.workunit.client.1.smithi073.stdout:6/574: mkdir d15/d17/db6 0 2024-08-31T05:21:04.588 INFO:tasks.workunit.client.1.smithi073.stdout:6/575: chown d15/l48 11 1 2024-08-31T05:21:04.588 INFO:tasks.workunit.client.1.smithi073.stdout:3/589: mkdir da/d3c/d65/d2c/d8e/dc2 0 2024-08-31T05:21:04.589 INFO:tasks.workunit.client.1.smithi073.stdout:6/576: read - d15/d17/da1/dae/db0/d38/d9b/f81 zero size 2024-08-31T05:21:04.593 INFO:tasks.workunit.client.1.smithi073.stdout:1/488: rename d5/d10/d33/d13/f82 to d5/d26/d54/d55/f8d 0 2024-08-31T05:21:04.604 INFO:tasks.workunit.client.1.smithi073.stdout:5/710: dwrite dc/d16/f6f [0,4194304] 0 2024-08-31T05:21:04.604 INFO:tasks.workunit.client.1.smithi073.stdout:8/606: rename d0/db/d44/d72/d75/l98 to d0/db/d44/d72/d75/d7e/lb8 0 2024-08-31T05:21:04.608 INFO:tasks.workunit.client.1.smithi073.stdout:3/590: rename da/lc to da/d3c/d65/d87/lc3 0 2024-08-31T05:21:04.609 INFO:tasks.workunit.client.1.smithi073.stdout:3/591: fdatasync da/fb4 0 2024-08-31T05:21:04.610 INFO:tasks.workunit.client.1.smithi073.stdout:5/711: mkdir dc/d16/d1a/db7/deb 0 2024-08-31T05:21:04.613 INFO:tasks.workunit.client.1.smithi073.stdout:2/521: getdents d2/d9/df 0 2024-08-31T05:21:04.613 INFO:tasks.workunit.client.1.smithi073.stdout:4/518: dread d7/df/d13/d2e/d70/d6b/f7f [0,4194304] 0 2024-08-31T05:21:04.614 INFO:tasks.workunit.client.1.smithi073.stdout:2/522: truncate d2/d9/f77 278228 0 2024-08-31T05:21:04.614 INFO:tasks.workunit.client.1.smithi073.stdout:3/592: creat da/d18/da2/fc4 x:0 0 0 2024-08-31T05:21:04.615 INFO:tasks.workunit.client.1.smithi073.stdout:3/593: dread - da/d3c/d67/faa zero size 2024-08-31T05:21:04.615 INFO:tasks.workunit.client.1.smithi073.stdout:8/607: truncate d0/db/d44/f6f 120450 0 2024-08-31T05:21:04.616 INFO:tasks.workunit.client.1.smithi073.stdout:1/489: getdents d5/d10/d1c/d27 0 2024-08-31T05:21:04.617 INFO:tasks.workunit.client.1.smithi073.stdout:8/608: write d0/db/d44/f70 [1262949,99979] 0 2024-08-31T05:21:04.618 INFO:tasks.workunit.client.1.smithi073.stdout:8/609: stat d0/db/d1c/d24/c86 0 2024-08-31T05:21:04.618 INFO:tasks.workunit.client.1.smithi073.stdout:4/519: creat d7/db/f90 x:0 0 0 2024-08-31T05:21:04.620 INFO:tasks.workunit.client.1.smithi073.stdout:3/594: write da/d3c/d65/f3a [721709,19068] 0 2024-08-31T05:21:04.622 INFO:tasks.workunit.client.1.smithi073.stdout:5/712: getdents dc/d16/d1a/db7/deb 0 2024-08-31T05:21:04.623 INFO:tasks.workunit.client.1.smithi073.stdout:3/595: chown da/d3c/d65/d40/d5d/f89 63094714 1 2024-08-31T05:21:04.624 INFO:tasks.workunit.client.1.smithi073.stdout:1/490: dwrite d5/d26/d54/d5f/f7c [0,4194304] 0 2024-08-31T05:21:04.624 INFO:tasks.workunit.client.1.smithi073.stdout:8/610: fdatasync d0/db/d1c/d24/f32 0 2024-08-31T05:21:04.625 INFO:tasks.workunit.client.1.smithi073.stdout:9/682: sync 2024-08-31T05:21:04.626 INFO:tasks.workunit.client.1.smithi073.stdout:3/596: write da/d3c/d65/d40/f44 [2114422,23845] 0 2024-08-31T05:21:04.628 INFO:tasks.workunit.client.1.smithi073.stdout:8/611: chown d0/db/d44/d72/d75/d7e/d91/dac 233114 1 2024-08-31T05:21:04.629 INFO:tasks.workunit.client.1.smithi073.stdout:2/523: creat d2/d9/d27/d9b/da7/fad x:0 0 0 2024-08-31T05:21:04.629 INFO:tasks.workunit.client.1.smithi073.stdout:4/520: mknod d7/df/d13/c91 0 2024-08-31T05:21:04.630 INFO:tasks.workunit.client.1.smithi073.stdout:5/713: creat dc/d16/d3b/d3f/fec x:0 0 0 2024-08-31T05:21:04.632 INFO:tasks.workunit.client.1.smithi073.stdout:3/597: chown da/d3c/d67 186 1 2024-08-31T05:21:04.635 INFO:tasks.workunit.client.1.smithi073.stdout:1/491: rename d5/d10/d1c/d69/f7a to d5/d17/d32/d37/f8e 0 2024-08-31T05:21:04.636 INFO:tasks.workunit.client.1.smithi073.stdout:2/524: chown d2/d9/d27/d9b/da6/c67 2575 1 2024-08-31T05:21:04.637 INFO:tasks.workunit.client.1.smithi073.stdout:6/577: dread d15/d1a/d51/d61/f80 [0,4194304] 0 2024-08-31T05:21:04.641 INFO:tasks.workunit.client.1.smithi073.stdout:5/714: read dc/d3d/d55/d84/f25 [4802034,58856] 0 2024-08-31T05:21:04.641 INFO:tasks.workunit.client.1.smithi073.stdout:3/598: chown da/d3c/d82/la3 193999 1 2024-08-31T05:21:04.642 INFO:tasks.workunit.client.1.smithi073.stdout:2/525: dwrite d2/d25/fac [0,4194304] 0 2024-08-31T05:21:04.643 INFO:tasks.workunit.client.1.smithi073.stdout:4/521: rename d7/df/d13/d2e/d70/d6b/f7f to d7/df/d79/d7a/f92 0 2024-08-31T05:21:04.650 INFO:tasks.workunit.client.1.smithi073.stdout:5/715: unlink dc/d3d/fa2 0 2024-08-31T05:21:04.654 INFO:tasks.workunit.client.1.smithi073.stdout:2/526: symlink d2/d25/d92/lae 0 2024-08-31T05:21:04.660 INFO:tasks.workunit.client.1.smithi073.stdout:5/716: write dc/d16/d3b/f73 [864505,122799] 0 2024-08-31T05:21:04.661 INFO:tasks.workunit.client.1.smithi073.stdout:9/683: link dc/c2d dc/d37/d42/d5a/dda/ce0 0 2024-08-31T05:21:04.661 INFO:tasks.workunit.client.1.smithi073.stdout:5/717: write dc/d16/d3b/fe4 [981317,44899] 0 2024-08-31T05:21:04.662 INFO:tasks.workunit.client.1.smithi073.stdout:3/599: creat da/d3c/d5a/db8/fc5 x:0 0 0 2024-08-31T05:21:04.665 INFO:tasks.workunit.client.1.smithi073.stdout:2/527: creat d2/d9/d27/d76/d97/faf x:0 0 0 2024-08-31T05:21:04.666 INFO:tasks.workunit.client.1.smithi073.stdout:8/612: getdents d0/db/d1c/d34/d80 0 2024-08-31T05:21:04.667 INFO:tasks.workunit.client.1.smithi073.stdout:6/578: creat d15/d17/da1/dae/fb7 x:0 0 0 2024-08-31T05:21:04.667 INFO:tasks.workunit.client.1.smithi073.stdout:9/684: symlink dc/de/d66/d84/le1 0 2024-08-31T05:21:04.668 INFO:tasks.workunit.client.1.smithi073.stdout:5/718: write dc/d16/d3b/fb4 [1906756,6835] 0 2024-08-31T05:21:04.669 INFO:tasks.workunit.client.1.smithi073.stdout:1/492: link d5/d17/d2a/d80/c62 d5/d26/c8f 0 2024-08-31T05:21:04.670 INFO:tasks.workunit.client.1.smithi073.stdout:1/493: chown d5/d10/d33/d13/l31 0 1 2024-08-31T05:21:04.670 INFO:tasks.workunit.client.1.smithi073.stdout:5/719: chown dc/d16/d3b/d3f/d4f/d98/ld1 1 1 2024-08-31T05:21:04.671 INFO:tasks.workunit.client.1.smithi073.stdout:6/579: mknod d15/d1a/d51/cb8 0 2024-08-31T05:21:04.672 INFO:tasks.workunit.client.1.smithi073.stdout:3/600: creat da/d3c/d67/db7/fc6 x:0 0 0 2024-08-31T05:21:04.673 INFO:tasks.workunit.client.1.smithi073.stdout:3/601: chown da/d18/c1a 13 1 2024-08-31T05:21:04.676 INFO:tasks.workunit.client.1.smithi073.stdout:4/522: getdents d7/d1a/d5c/d6d/d2c/d2d 0 2024-08-31T05:21:04.677 INFO:tasks.workunit.client.1.smithi073.stdout:5/720: creat dc/d3d/d55/fed x:0 0 0 2024-08-31T05:21:04.678 INFO:tasks.workunit.client.1.smithi073.stdout:6/580: mknod d15/d1a/d2b/d2f/d99/cb9 0 2024-08-31T05:21:04.679 INFO:tasks.workunit.client.1.smithi073.stdout:9/685: dwrite dc/d37/d42/d8d/d52/d5b/f9d [0,4194304] 0 2024-08-31T05:21:04.680 INFO:tasks.workunit.client.1.smithi073.stdout:4/523: symlink d7/df/d13/d53/l93 0 2024-08-31T05:21:04.683 INFO:tasks.workunit.client.1.smithi073.stdout:6/581: unlink d15/f46 0 2024-08-31T05:21:04.683 INFO:tasks.workunit.client.1.smithi073.stdout:8/613: write d0/f5e [4817596,13731] 0 2024-08-31T05:21:04.683 INFO:tasks.workunit.client.1.smithi073.stdout:9/686: creat dc/d37/fe2 x:0 0 0 2024-08-31T05:21:04.684 INFO:tasks.workunit.client.1.smithi073.stdout:6/582: fsync d15/d1a/f52 0 2024-08-31T05:21:04.685 INFO:tasks.workunit.client.1.smithi073.stdout:1/494: dread d5/f9 [0,4194304] 0 2024-08-31T05:21:04.685 INFO:tasks.workunit.client.1.smithi073.stdout:3/602: creat da/fc7 x:0 0 0 2024-08-31T05:21:04.686 INFO:tasks.workunit.client.1.smithi073.stdout:1/495: readlink d5/d10/d33/l5c 0 2024-08-31T05:21:04.687 INFO:tasks.workunit.client.1.smithi073.stdout:5/721: creat dc/d3d/d55/d84/dcc/dea/fee x:0 0 0 2024-08-31T05:21:04.689 INFO:tasks.workunit.client.1.smithi073.stdout:8/614: creat d0/db/d1c/fb9 x:0 0 0 2024-08-31T05:21:04.690 INFO:tasks.workunit.client.1.smithi073.stdout:2/528: dwrite d2/d9/d7f/dab/f47 [0,4194304] 0 2024-08-31T05:21:04.690 INFO:tasks.workunit.client.1.smithi073.stdout:3/603: rmdir da/d3c/d67 39 2024-08-31T05:21:04.692 INFO:tasks.workunit.client.1.smithi073.stdout:3/604: dread - da/d3c/d65/d40/d5d/f89 zero size 2024-08-31T05:21:04.694 INFO:tasks.workunit.client.1.smithi073.stdout:5/722: unlink dc/d16/d1a/l2f 0 2024-08-31T05:21:04.694 INFO:tasks.workunit.client.1.smithi073.stdout:6/583: dread d15/d17/f3a [0,4194304] 0 2024-08-31T05:21:04.697 INFO:tasks.workunit.client.1.smithi073.stdout:2/529: creat d2/d9/d7f/fb0 x:0 0 0 2024-08-31T05:21:04.697 INFO:tasks.workunit.client.1.smithi073.stdout:6/584: fsync d15/d1a/d51/fa2 0 2024-08-31T05:21:04.697 INFO:tasks.workunit.client.1.smithi073.stdout:5/723: write dc/d3d/f4c [285559,67996] 0 2024-08-31T05:21:04.700 INFO:tasks.workunit.client.1.smithi073.stdout:9/687: link dc/de/d11/d85/c9a dc/dc4/ce3 0 2024-08-31T05:21:04.701 INFO:tasks.workunit.client.1.smithi073.stdout:1/496: dwrite d5/d17/d32/d37/f8e [0,4194304] 0 2024-08-31T05:21:04.704 INFO:tasks.workunit.client.1.smithi073.stdout:2/530: write d2/d9/d27/f2b [61689,9178] 0 2024-08-31T05:21:04.706 INFO:tasks.workunit.client.1.smithi073.stdout:7/501: sync 2024-08-31T05:21:04.708 INFO:tasks.workunit.client.1.smithi073.stdout:3/605: dwrite da/d3c/d65/d40/d5d/f83 [4194304,4194304] 0 2024-08-31T05:21:04.709 INFO:tasks.workunit.client.1.smithi073.stdout:2/531: chown d2/d9/d27/l2d 3024525 1 2024-08-31T05:21:04.713 INFO:tasks.workunit.client.1.smithi073.stdout:1/497: write d5/f9 [4261750,81875] 0 2024-08-31T05:21:04.717 INFO:tasks.workunit.client.1.smithi073.stdout:3/606: truncate da/d3c/f71 1030043 0 2024-08-31T05:21:04.719 INFO:tasks.workunit.client.1.smithi073.stdout:8/615: dread d0/db/d1c/d24/d73/f8f [0,4194304] 0 2024-08-31T05:21:04.719 INFO:tasks.workunit.client.1.smithi073.stdout:2/532: write d2/d9/d3c/f73 [427371,97194] 0 2024-08-31T05:21:04.719 INFO:tasks.workunit.client.1.smithi073.stdout:6/585: getdents d15/d17/da1/dae/db0/d38/d9b 0 2024-08-31T05:21:04.720 INFO:tasks.workunit.client.1.smithi073.stdout:4/524: dread d7/d1a/d5c/d6d/f58 [0,4194304] 0 2024-08-31T05:21:04.721 INFO:tasks.workunit.client.1.smithi073.stdout:5/724: dwrite dc/d3d/d55/d84/d49/dd2/fd4 [0,4194304] 0 2024-08-31T05:21:04.721 INFO:tasks.workunit.client.1.smithi073.stdout:1/498: write d5/f19 [3401574,82607] 0 2024-08-31T05:21:04.723 INFO:tasks.workunit.client.1.smithi073.stdout:1/499: fdatasync d5/d17/f57 0 2024-08-31T05:21:04.723 INFO:tasks.workunit.client.1.smithi073.stdout:3/607: mknod da/d3c/d82/cc8 0 2024-08-31T05:21:04.726 INFO:tasks.workunit.client.1.smithi073.stdout:3/608: chown da/f62 37151776 1 2024-08-31T05:21:04.726 INFO:tasks.workunit.client.1.smithi073.stdout:5/725: symlink dc/d3d/dab/lef 0 2024-08-31T05:21:04.726 INFO:tasks.workunit.client.1.smithi073.stdout:6/586: truncate d15/d17/f3a 1056824 0 2024-08-31T05:21:04.728 INFO:tasks.workunit.client.1.smithi073.stdout:3/609: write da/fb [2892223,8433] 0 2024-08-31T05:21:04.728 INFO:tasks.workunit.client.1.smithi073.stdout:4/525: creat d7/d1a/d5c/d6d/d59/d65/f94 x:0 0 0 2024-08-31T05:21:04.730 INFO:tasks.workunit.client.1.smithi073.stdout:8/616: dread d0/db/d44/f71 [0,4194304] 0 2024-08-31T05:21:04.732 INFO:tasks.workunit.client.1.smithi073.stdout:4/526: symlink d7/db/l95 0 2024-08-31T05:21:04.734 INFO:tasks.workunit.client.1.smithi073.stdout:7/502: write d1/da/d3e/d22/d47/f79 [204399,71924] 0 2024-08-31T05:21:04.736 INFO:tasks.workunit.client.1.smithi073.stdout:5/726: rename dc/d16/d3b/d7f/fe5 to dc/d16/d1a/d87/d94/ff0 0 2024-08-31T05:21:04.737 INFO:tasks.workunit.client.1.smithi073.stdout:4/527: rmdir d7/df/d13/d2e/d70 39 2024-08-31T05:21:04.738 INFO:tasks.workunit.client.1.smithi073.stdout:3/610: link da/d3c/d5a/db8/fc5 da/d3c/d82/fc9 0 2024-08-31T05:21:04.738 INFO:tasks.workunit.client.1.smithi073.stdout:2/533: dwrite d2/f2c [4194304,4194304] 0 2024-08-31T05:21:04.741 INFO:tasks.workunit.client.1.smithi073.stdout:4/528: fdatasync d7/df/d1b/d34/f49 0 2024-08-31T05:21:04.744 INFO:tasks.workunit.client.1.smithi073.stdout:7/503: write d1/da/d3e/d22/f75 [585479,2747] 0 2024-08-31T05:21:04.746 INFO:tasks.workunit.client.1.smithi073.stdout:6/587: dwrite d15/d17/da1/dae/db0/d38/f5f [0,4194304] 0 2024-08-31T05:21:04.749 INFO:tasks.workunit.client.1.smithi073.stdout:9/688: dwrite dc/d37/d42/d8d/f57 [0,4194304] 0 2024-08-31T05:21:04.752 INFO:tasks.workunit.client.1.smithi073.stdout:4/529: mknod d7/c96 0 2024-08-31T05:21:04.753 INFO:tasks.workunit.client.1.smithi073.stdout:3/611: truncate da/d3c/d65/fb2 1040126 0 2024-08-31T05:21:04.755 INFO:tasks.workunit.client.1.smithi073.stdout:6/588: creat d15/d17/fba x:0 0 0 2024-08-31T05:21:04.755 INFO:tasks.workunit.client.1.smithi073.stdout:9/689: mkdir dc/d82/de4 0 2024-08-31T05:21:04.757 INFO:tasks.workunit.client.1.smithi073.stdout:7/504: write d1/da/d15/d33/d44/f66 [456845,99876] 0 2024-08-31T05:21:04.760 INFO:tasks.workunit.client.1.smithi073.stdout:1/500: dread d5/d10/d33/f30 [0,4194304] 0 2024-08-31T05:21:04.761 INFO:tasks.workunit.client.1.smithi073.stdout:9/690: unlink dc/f61 0 2024-08-31T05:21:04.761 INFO:tasks.workunit.client.1.smithi073.stdout:5/727: dwrite dc/d16/d3b/d3f/f65 [0,4194304] 0 2024-08-31T05:21:04.762 INFO:tasks.workunit.client.1.smithi073.stdout:2/534: dwrite d2/d9/df/f64 [0,4194304] 0 2024-08-31T05:21:04.762 INFO:tasks.workunit.client.1.smithi073.stdout:3/612: mknod da/d3c/d65/d87/cca 0 2024-08-31T05:21:04.765 INFO:tasks.workunit.client.1.smithi073.stdout:3/613: truncate da/d3c/d65/d40/f44 5191149 0 2024-08-31T05:21:04.765 INFO:tasks.workunit.client.1.smithi073.stdout:4/530: mknod d7/d1a/d5c/d6d/d59/d65/c97 0 2024-08-31T05:21:04.767 INFO:tasks.workunit.client.1.smithi073.stdout:5/728: creat dc/d3d/d55/d84/dbd/ff1 x:0 0 0 2024-08-31T05:21:04.772 INFO:tasks.workunit.client.1.smithi073.stdout:1/501: creat d5/d10/d33/f90 x:0 0 0 2024-08-31T05:21:04.773 INFO:tasks.workunit.client.1.smithi073.stdout:1/502: readlink d5/d17/d2a/d80/l73 0 2024-08-31T05:21:04.775 INFO:tasks.workunit.client.1.smithi073.stdout:2/535: rmdir d2/d9/d7f/dab/d5d/d9f 0 2024-08-31T05:21:04.777 INFO:tasks.workunit.client.1.smithi073.stdout:7/505: getdents d1/da/d38 0 2024-08-31T05:21:04.777 INFO:tasks.workunit.client.1.smithi073.stdout:7/506: chown d1/da/d3e/c1e 1849835970 1 2024-08-31T05:21:04.778 INFO:tasks.workunit.client.1.smithi073.stdout:5/729: creat dc/d16/d3b/d3f/d4f/dc4/ff2 x:0 0 0 2024-08-31T05:21:04.779 INFO:tasks.workunit.client.1.smithi073.stdout:5/730: dread - dc/d16/d4e/fae zero size 2024-08-31T05:21:04.782 INFO:tasks.workunit.client.1.smithi073.stdout:1/503: rename d5/d10/c49 to d5/d17/d2a/d80/c91 0 2024-08-31T05:21:04.782 INFO:tasks.workunit.client.1.smithi073.stdout:1/504: chown d5/d10/d33/f36 14614636 1 2024-08-31T05:21:04.782 INFO:tasks.workunit.client.1.smithi073.stdout:1/505: chown d5 7 1 2024-08-31T05:21:04.791 INFO:tasks.workunit.client.1.smithi073.stdout:2/536: getdents d2 0 2024-08-31T05:21:04.791 INFO:tasks.workunit.client.1.smithi073.stdout:1/506: dwrite d5/d17/d3f/f7d [0,4194304] 0 2024-08-31T05:21:04.794 INFO:tasks.workunit.client.1.smithi073.stdout:2/537: chown d2/d25/d92/l96 53524640 1 2024-08-31T05:21:04.796 INFO:tasks.workunit.client.1.smithi073.stdout:2/538: readlink d2/d9/df/d36/l48 0 2024-08-31T05:21:04.796 INFO:tasks.workunit.client.1.smithi073.stdout:1/507: mknod d5/d17/d3f/c92 0 2024-08-31T05:21:04.798 INFO:tasks.workunit.client.1.smithi073.stdout:3/614: truncate da/f61 4152900 0 2024-08-31T05:21:04.799 INFO:tasks.workunit.client.1.smithi073.stdout:2/539: symlink d2/d9/df/d36/lb1 0 2024-08-31T05:21:04.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.801+0000 7f94099e2640 1 -- 172.21.15.67:0/17812025 --> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f940406a200 con 0x7f93ec073fa0 2024-08-31T05:21:04.803 INFO:tasks.workunit.client.1.smithi073.stdout:3/615: mknod da/d3c/d65/d2c/d8e/ccb 0 2024-08-31T05:21:04.803 INFO:tasks.workunit.client.1.smithi073.stdout:9/691: dwrite dc/d10/f53 [0,4194304] 0 2024-08-31T05:21:04.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.802+0000 7f94089e0640 1 -- 172.21.15.67:0/17812025 <== mgr.24383 v2:172.21.15.73:6828/1567621854 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f940406a200 con 0x7f93ec073fa0 2024-08-31T05:21:04.804 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:21:04.804 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:21:04.804 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:21:04.804 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-31T05:21:04.804 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [], 2024-08-31T05:21:04.805 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "1/2 daemons upgraded", 2024-08-31T05:21:04.805 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-08-31T05:21:04.805 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:21:04.805 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:21:04.806 INFO:tasks.workunit.client.1.smithi073.stdout:3/616: read da/d68/f69 [2523325,130613] 0 2024-08-31T05:21:04.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.806+0000 7f94099e2640 1 -- 172.21.15.67:0/17812025 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f93ec073fa0 msgr2=0x7f93ec076460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:04.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.806+0000 7f94099e2640 1 --2- 172.21.15.67:0/17812025 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f93ec073fa0 0x7f93ec076460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93f402a9c0 tx=0x7f93f4000bc0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.806+0000 7f94099e2640 1 -- 172.21.15.67:0/17812025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404101800 msgr2=0x7f9404197800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:04.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.806+0000 7f94099e2640 1 --2- 172.21.15.67:0/17812025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404101800 0x7f9404197800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f93f800d6f0 tx=0x7f93f800dbb0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.806+0000 7f94099e2640 1 -- 172.21.15.67:0/17812025 shutdown_connections 2024-08-31T05:21:04.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.806+0000 7f94099e2640 1 --2- 172.21.15.67:0/17812025 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f93ec073fa0 0x7f93ec076460 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.806+0000 7f94099e2640 1 --2- 172.21.15.67:0/17812025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404101800 0x7f9404197800 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.806+0000 7f94099e2640 1 --2- 172.21.15.67:0/17812025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9404100600 0x7f94041972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.806+0000 7f94099e2640 1 -- 172.21.15.67:0/17812025 >> 172.21.15.67:0/17812025 conn(0x7f94040fbdb0 msgr2=0x7f9404069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:04.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.806+0000 7f94099e2640 1 -- 172.21.15.67:0/17812025 shutdown_connections 2024-08-31T05:21:04.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:04.806+0000 7f94099e2640 1 -- 172.21.15.67:0/17812025 wait complete. 2024-08-31T05:21:04.809 INFO:tasks.workunit.client.1.smithi073.stdout:3/617: fsync da/d3c/f71 0 2024-08-31T05:21:04.810 INFO:tasks.workunit.client.1.smithi073.stdout:1/508: getdents d5/d17/d3f 0 2024-08-31T05:21:04.811 INFO:tasks.workunit.client.1.smithi073.stdout:2/540: dwrite d2/d9/fa0 [0,4194304] 0 2024-08-31T05:21:04.813 INFO:tasks.workunit.client.1.smithi073.stdout:7/507: dwrite d1/f2e [0,4194304] 0 2024-08-31T05:21:04.815 INFO:tasks.workunit.client.1.smithi073.stdout:5/731: dread dc/f48 [0,4194304] 0 2024-08-31T05:21:04.817 INFO:tasks.workunit.client.1.smithi073.stdout:3/618: fdatasync da/f29 0 2024-08-31T05:21:04.817 INFO:tasks.workunit.client.1.smithi073.stdout:2/541: rmdir d2/d9/d27 39 2024-08-31T05:21:04.818 INFO:tasks.workunit.client.1.smithi073.stdout:3/619: chown da/c24 112131909 1 2024-08-31T05:21:04.819 INFO:tasks.workunit.client.1.smithi073.stdout:1/509: rename d5/d10/d1c/d69 to d5/d17/d2a/d80/d93 0 2024-08-31T05:21:04.819 INFO:tasks.workunit.client.1.smithi073.stdout:0/569: sync 2024-08-31T05:21:04.821 INFO:tasks.workunit.client.1.smithi073.stdout:0/570: write d0/f33 [1056217,75090] 0 2024-08-31T05:21:04.821 INFO:tasks.workunit.client.1.smithi073.stdout:5/732: write dc/fc2 [1898521,87975] 0 2024-08-31T05:21:04.823 INFO:tasks.workunit.client.1.smithi073.stdout:5/733: truncate dc/d16/f95 449146 0 2024-08-31T05:21:04.824 INFO:tasks.workunit.client.1.smithi073.stdout:1/510: unlink d5/d17/d32/l4f 0 2024-08-31T05:21:04.827 INFO:tasks.workunit.client.1.smithi073.stdout:2/542: rename d2/d9/d3c/f46 to d2/d9/d7f/dab/d5d/da1/fb2 0 2024-08-31T05:21:04.829 INFO:tasks.workunit.client.1.smithi073.stdout:3/620: truncate da/f2f 1400269 0 2024-08-31T05:21:04.830 INFO:tasks.workunit.client.1.smithi073.stdout:5/734: chown dc/d3d/fd0 2146 1 2024-08-31T05:21:04.831 INFO:tasks.workunit.client.1.smithi073.stdout:0/571: mkdir d0/d15/d2c/d4d/d3c/d9c/db6 0 2024-08-31T05:21:04.832 INFO:tasks.workunit.client.1.smithi073.stdout:1/511: dwrite d5/f65 [0,4194304] 0 2024-08-31T05:21:04.834 INFO:tasks.workunit.client.1.smithi073.stdout:9/692: truncate dc/dc4/fcf 704952 0 2024-08-31T05:21:04.836 INFO:tasks.workunit.client.1.smithi073.stdout:3/621: unlink c8 0 2024-08-31T05:21:04.837 INFO:tasks.workunit.client.1.smithi073.stdout:0/572: mknod d0/d58/cb7 0 2024-08-31T05:21:04.838 INFO:tasks.workunit.client.1.smithi073.stdout:5/735: symlink dc/d16/lf3 0 2024-08-31T05:21:04.838 INFO:tasks.workunit.client.1.smithi073.stdout:3/622: chown da/c13 0 1 2024-08-31T05:21:04.842 INFO:tasks.workunit.client.1.smithi073.stdout:3/623: write da/d18/da2/daf/fbf [266174,15328] 0 2024-08-31T05:21:04.843 INFO:tasks.workunit.client.1.smithi073.stdout:9/693: creat dc/d37/d42/d8d/d52/fe5 x:0 0 0 2024-08-31T05:21:04.844 INFO:tasks.workunit.client.1.smithi073.stdout:1/512: dwrite d5/d10/d33/d13/f84 [0,4194304] 0 2024-08-31T05:21:04.847 INFO:tasks.workunit.client.1.smithi073.stdout:1/513: fsync d5/d26/d54/f6c 0 2024-08-31T05:21:04.848 INFO:tasks.workunit.client.1.smithi073.stdout:3/624: unlink da/fb4 0 2024-08-31T05:21:04.851 INFO:tasks.workunit.client.1.smithi073.stdout:7/508: dwrite d1/da/d65/f7e [0,4194304] 0 2024-08-31T05:21:04.853 INFO:tasks.workunit.client.1.smithi073.stdout:5/736: link dc/d3d/d55/d84/dcc/ce3 dc/d16/d3b/d7f/d99/cf4 0 2024-08-31T05:21:04.855 INFO:tasks.workunit.client.1.smithi073.stdout:9/694: creat dc/d37/d42/d8d/d52/d5f/fe6 x:0 0 0 2024-08-31T05:21:04.858 INFO:tasks.workunit.client.1.smithi073.stdout:2/543: dread d2/d9/d27/d9b/da7/fa8 [0,4194304] 0 2024-08-31T05:21:04.859 INFO:tasks.workunit.client.1.smithi073.stdout:3/625: rmdir da/d3c/d67/db7 39 2024-08-31T05:21:04.859 INFO:tasks.workunit.client.1.smithi073.stdout:1/514: dwrite d5/d17/d32/d37/f3c [0,4194304] 0 2024-08-31T05:21:04.860 INFO:tasks.workunit.client.1.smithi073.stdout:7/509: rename d1/da/d38 to d1/da/d65/da9 0 2024-08-31T05:21:04.861 INFO:tasks.workunit.client.1.smithi073.stdout:9/695: write dc/d37/d42/d8d/d52/d5f/fe6 [529345,78351] 0 2024-08-31T05:21:04.862 INFO:tasks.workunit.client.1.smithi073.stdout:0/573: write d0/f1e [220778,2439] 0 2024-08-31T05:21:04.863 INFO:tasks.workunit.client.1.smithi073.stdout:1/515: dread - d5/d17/d5d/d61/f8c zero size 2024-08-31T05:21:04.865 INFO:tasks.workunit.client.1.smithi073.stdout:3/626: chown da/d3c/d67/db7/fc6 16 1 2024-08-31T05:21:04.866 INFO:tasks.workunit.client.1.smithi073.stdout:2/544: creat d2/d9/d7f/dab/d5d/fb3 x:0 0 0 2024-08-31T05:21:04.867 INFO:tasks.workunit.client.1.smithi073.stdout:7/510: symlink d1/d11/d91/laa 0 2024-08-31T05:21:04.868 INFO:tasks.workunit.client.1.smithi073.stdout:9/696: creat dc/de/d11/d85/fe7 x:0 0 0 2024-08-31T05:21:04.871 INFO:tasks.workunit.client.1.smithi073.stdout:5/737: rename dc/d16/d4e/f5e to dc/d16/ff5 0 2024-08-31T05:21:04.872 INFO:tasks.workunit.client.1.smithi073.stdout:7/511: fdatasync d1/d11/d14/f29 0 2024-08-31T05:21:04.873 INFO:tasks.workunit.client.1.smithi073.stdout:9/697: rmdir dc/d37/db5/dc1 39 2024-08-31T05:21:04.876 INFO:tasks.workunit.client.1.smithi073.stdout:2/545: mkdir d2/d9/d27/d76/d7e/db4 0 2024-08-31T05:21:04.876 INFO:tasks.workunit.client.1.smithi073.stdout:1/516: dwrite d5/d10/d33/f90 [0,4194304] 0 2024-08-31T05:21:04.878 INFO:tasks.workunit.client.1.smithi073.stdout:5/738: mkdir dc/d16/d3b/d3f/d4f/d98/df6 0 2024-08-31T05:21:04.879 INFO:tasks.workunit.client.1.smithi073.stdout:9/698: unlink dc/de/d11/f7a 0 2024-08-31T05:21:04.879 INFO:tasks.workunit.client.1.smithi073.stdout:1/517: read d5/d26/f64 [2727153,93611] 0 2024-08-31T05:21:04.881 INFO:tasks.workunit.client.1.smithi073.stdout:2/546: chown d2/d9/l7b 4101417 1 2024-08-31T05:21:04.885 INFO:tasks.workunit.client.1.smithi073.stdout:7/512: dwrite d1/da/f98 [0,4194304] 0 2024-08-31T05:21:04.890 INFO:tasks.workunit.client.1.smithi073.stdout:2/547: dread d2/d9/df/f64 [0,4194304] 0 2024-08-31T05:21:04.892 INFO:tasks.workunit.client.1.smithi073.stdout:5/739: dwrite dc/d16/ff5 [0,4194304] 0 2024-08-31T05:21:04.893 INFO:tasks.workunit.client.1.smithi073.stdout:3/627: dread da/d3c/d65/d40/f44 [0,4194304] 0 2024-08-31T05:21:04.895 INFO:tasks.workunit.client.1.smithi073.stdout:7/513: mknod d1/cab 0 2024-08-31T05:21:04.896 INFO:tasks.workunit.client.1.smithi073.stdout:0/574: dread d0/d69/d7f/d62/f8f [0,4194304] 0 2024-08-31T05:21:04.896 INFO:tasks.workunit.client.1.smithi073.stdout:9/699: mkdir dc/d37/d42/d8d/de8 0 2024-08-31T05:21:04.898 INFO:tasks.workunit.client.1.smithi073.stdout:2/548: mkdir d2/d9/d27/d76/db5 0 2024-08-31T05:21:04.898 INFO:tasks.workunit.client.1.smithi073.stdout:5/740: mknod dc/d16/d3b/dc6/cf7 0 2024-08-31T05:21:04.899 INFO:tasks.workunit.client.1.smithi073.stdout:3/628: creat da/d3c/d65/d87/fcc x:0 0 0 2024-08-31T05:21:04.900 INFO:tasks.workunit.client.1.smithi073.stdout:3/629: chown da/d68/f7e 674 1 2024-08-31T05:21:04.900 INFO:tasks.workunit.client.1.smithi073.stdout:3/630: fsync da/f29 0 2024-08-31T05:21:04.902 INFO:tasks.workunit.client.1.smithi073.stdout:9/700: dread dc/d27/f38 [0,4194304] 0 2024-08-31T05:21:04.903 INFO:tasks.workunit.client.1.smithi073.stdout:9/701: fsync dc/d37/d42/d8d/f4b 0 2024-08-31T05:21:04.904 INFO:tasks.workunit.client.1.smithi073.stdout:7/514: mkdir d1/d11/d14/dac 0 2024-08-31T05:21:04.907 INFO:tasks.workunit.client.1.smithi073.stdout:2/549: rmdir d2/d9/d84 39 2024-08-31T05:21:04.908 INFO:tasks.workunit.client.1.smithi073.stdout:2/550: write d2/f87 [732408,86270] 0 2024-08-31T05:21:04.908 INFO:tasks.workunit.client.1.smithi073.stdout:2/551: readlink d2/l59 0 2024-08-31T05:21:04.909 INFO:tasks.workunit.client.1.smithi073.stdout:3/631: mkdir da/d3c/d65/d45/dcd 0 2024-08-31T05:21:04.910 INFO:tasks.workunit.client.1.smithi073.stdout:7/515: creat d1/da/d96/fad x:0 0 0 2024-08-31T05:21:04.911 INFO:tasks.workunit.client.1.smithi073.stdout:5/741: symlink dc/d3d/d55/d84/lf8 0 2024-08-31T05:21:04.912 INFO:tasks.workunit.client.1.smithi073.stdout:2/552: mkdir d2/d9/d7f/db6 0 2024-08-31T05:21:04.912 INFO:tasks.workunit.client.1.smithi073.stdout:9/702: mknod dc/d37/d42/d5a/ce9 0 2024-08-31T05:21:04.914 INFO:tasks.workunit.client.1.smithi073.stdout:3/632: creat da/d3c/d82/d97/fce x:0 0 0 2024-08-31T05:21:04.917 INFO:tasks.workunit.client.1.smithi073.stdout:7/516: mknod d1/da/d65/cae 0 2024-08-31T05:21:04.917 INFO:tasks.workunit.client.1.smithi073.stdout:5/742: rmdir dc/d3d/d55 39 2024-08-31T05:21:04.917 INFO:tasks.workunit.client.1.smithi073.stdout:0/575: link d0/d15/d2c/d40/d4a/d6b/cae d0/d28/d4f/cb8 0 2024-08-31T05:21:04.917 INFO:tasks.workunit.client.1.smithi073.stdout:7/517: chown d1/da/f99 45517 1 2024-08-31T05:21:04.918 INFO:tasks.workunit.client.1.smithi073.stdout:3/633: truncate da/d3c/f71 781512 0 2024-08-31T05:21:04.920 INFO:tasks.workunit.client.1.smithi073.stdout:7/518: fsync d1/da/d65/da9/f4c 0 2024-08-31T05:21:04.920 INFO:tasks.workunit.client.1.smithi073.stdout:1/518: dread d5/f25 [0,4194304] 0 2024-08-31T05:21:04.920 INFO:tasks.workunit.client.1.smithi073.stdout:9/703: getdents dc/de/d11 0 2024-08-31T05:21:04.921 INFO:tasks.workunit.client.1.smithi073.stdout:7/519: dread - d1/d11/f8d zero size 2024-08-31T05:21:04.923 INFO:tasks.workunit.client.1.smithi073.stdout:1/519: fsync d5/d17/d3f/f7d 0 2024-08-31T05:21:04.925 INFO:tasks.workunit.client.1.smithi073.stdout:7/520: dread - d1/da/d65/f86 zero size 2024-08-31T05:21:04.925 INFO:tasks.workunit.client.1.smithi073.stdout:3/634: rmdir da/d3c/d5a/d8a/dad 0 2024-08-31T05:21:04.929 INFO:tasks.workunit.client.1.smithi073.stdout:5/743: dwrite dc/d16/d3b/f73 [0,4194304] 0 2024-08-31T05:21:04.930 INFO:tasks.workunit.client.1.smithi073.stdout:3/635: write da/d3c/d65/d45/f56 [3005412,87212] 0 2024-08-31T05:21:04.930 INFO:tasks.workunit.client.1.smithi073.stdout:9/704: rename dc/de/d11/d85/lcb to dc/de/d11/lea 0 2024-08-31T05:21:04.931 INFO:tasks.workunit.client.1.smithi073.stdout:0/576: dwrite d0/d15/d2c/d41/d52/f8b [0,4194304] 0 2024-08-31T05:21:04.933 INFO:tasks.workunit.client.1.smithi073.stdout:1/520: symlink d5/d26/d54/d5f/l94 0 2024-08-31T05:21:04.933 INFO:tasks.workunit.client.1.smithi073.stdout:7/521: creat d1/d11/faf x:0 0 0 2024-08-31T05:21:04.935 INFO:tasks.workunit.client.1.smithi073.stdout:1/521: stat d5/d17/f57 0 2024-08-31T05:21:04.938 INFO:tasks.workunit.client.1.smithi073.stdout:3/636: write da/d18/f2a [4010817,111773] 0 2024-08-31T05:21:04.938 INFO:tasks.workunit.client.1.smithi073.stdout:2/553: dread d2/f2c [0,4194304] 0 2024-08-31T05:21:04.941 INFO:tasks.workunit.client.1.smithi073.stdout:9/705: symlink dc/dc4/leb 0 2024-08-31T05:21:04.944 INFO:tasks.workunit.client.1.smithi073.stdout:2/554: chown d2/d9/d27/l38 20674 1 2024-08-31T05:21:04.945 INFO:tasks.workunit.client.1.smithi073.stdout:2/555: chown d2/d9/fa0 175701145 1 2024-08-31T05:21:04.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:04 smithi073 ceph-mon[24726]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:04.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:04 smithi073 ceph-mon[24726]: pgmap v23: 65 pgs: 65 active+clean; 868 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 MiB/s rd, 105 MiB/s wr, 255 op/s 2024-08-31T05:21:04.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:04 smithi073 ceph-mon[24726]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:04.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:04 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/877628972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:21:04.947 INFO:tasks.workunit.client.1.smithi073.stdout:1/522: getdents d5/d10/d1c 0 2024-08-31T05:21:04.947 INFO:tasks.workunit.client.1.smithi073.stdout:0/577: dwrite d0/d28/f80 [0,4194304] 0 2024-08-31T05:21:04.950 INFO:tasks.workunit.client.1.smithi073.stdout:0/578: chown d0/d69/d7f/d68/c6f 383 1 2024-08-31T05:21:04.952 INFO:tasks.workunit.client.1.smithi073.stdout:3/637: dwrite da/d3c/f8f [0,4194304] 0 2024-08-31T05:21:04.954 INFO:tasks.workunit.client.1.smithi073.stdout:1/523: truncate d5/d17/d32/d37/f8a 392827 0 2024-08-31T05:21:04.955 INFO:tasks.workunit.client.1.smithi073.stdout:2/556: link d2/d9/df/d43/f7a d2/d9/df/d43/fb7 0 2024-08-31T05:21:04.956 INFO:tasks.workunit.client.1.smithi073.stdout:5/744: dwrite dc/d3d/f9c [0,4194304] 0 2024-08-31T05:21:04.957 INFO:tasks.workunit.client.1.smithi073.stdout:7/522: truncate d1/da/d15/d33/f42 3395772 0 2024-08-31T05:21:04.958 INFO:tasks.workunit.client.1.smithi073.stdout:2/557: chown d2/d9/df/l4e 1310544 1 2024-08-31T05:21:04.959 INFO:tasks.workunit.client.1.smithi073.stdout:1/524: mknod d5/d17/d2a/c95 0 2024-08-31T05:21:04.960 INFO:tasks.workunit.client.1.smithi073.stdout:9/706: write dc/d37/d42/d8d/d52/d5f/f71 [1148728,30305] 0 2024-08-31T05:21:04.962 INFO:tasks.workunit.client.1.smithi073.stdout:0/579: creat d0/d15/d2c/fb9 x:0 0 0 2024-08-31T05:21:04.962 INFO:tasks.workunit.client.1.smithi073.stdout:9/707: chown dc/d10/f29 22260186 1 2024-08-31T05:21:04.963 INFO:tasks.workunit.client.1.smithi073.stdout:3/638: rename da/lb1 to da/d3c/d82/lcf 0 2024-08-31T05:21:04.966 INFO:tasks.workunit.client.1.smithi073.stdout:1/525: creat d5/d17/d3f/f96 x:0 0 0 2024-08-31T05:21:04.970 INFO:tasks.workunit.client.1.smithi073.stdout:0/580: creat d0/d15/d2c/d4d/d3c/fba x:0 0 0 2024-08-31T05:21:04.973 INFO:tasks.workunit.client.1.smithi073.stdout:1/526: dwrite d5/d10/f6e [4194304,4194304] 0 2024-08-31T05:21:04.975 INFO:tasks.workunit.client.1.smithi073.stdout:7/523: rename d1/da/d3e/c59 to d1/da/d3e/d22/d47/cb0 0 2024-08-31T05:21:04.975 INFO:tasks.workunit.client.1.smithi073.stdout:9/708: mknod dc/d37/d42/d8d/de8/cec 0 2024-08-31T05:21:04.975 INFO:tasks.workunit.client.1.smithi073.stdout:8/617: sync 2024-08-31T05:21:04.975 INFO:tasks.workunit.client.1.smithi073.stdout:4/531: sync 2024-08-31T05:21:04.976 INFO:tasks.workunit.client.1.smithi073.stdout:6/589: sync 2024-08-31T05:21:04.976 INFO:tasks.workunit.client.1.smithi073.stdout:0/581: symlink d0/d69/d8e/lbb 0 2024-08-31T05:21:04.977 INFO:tasks.workunit.client.1.smithi073.stdout:6/590: fdatasync d15/f47 0 2024-08-31T05:21:04.978 INFO:tasks.workunit.client.1.smithi073.stdout:7/524: mkdir d1/da/d3e/db1 0 2024-08-31T05:21:04.980 INFO:tasks.workunit.client.1.smithi073.stdout:3/639: link da/d3c/d5a/db8/fc5 da/d3c/d82/d97/fd0 0 2024-08-31T05:21:04.981 INFO:tasks.workunit.client.1.smithi073.stdout:2/558: getdents d2/d9/d66/d70 0 2024-08-31T05:21:04.982 INFO:tasks.workunit.client.1.smithi073.stdout:0/582: dread d0/d15/d2c/d40/f56 [0,4194304] 0 2024-08-31T05:21:04.983 INFO:tasks.workunit.client.1.smithi073.stdout:9/709: creat dc/d37/db5/dc1/fed x:0 0 0 2024-08-31T05:21:04.984 INFO:tasks.workunit.client.1.smithi073.stdout:7/525: write d1/da/d3e/d22/d47/f51 [4108443,88222] 0 2024-08-31T05:21:04.986 INFO:tasks.workunit.client.1.smithi073.stdout:4/532: mknod d7/df/d13/d2e/d70/c98 0 2024-08-31T05:21:04.986 INFO:tasks.workunit.client.1.smithi073.stdout:2/559: chown d2/d9/df/d36/l44 55 1 2024-08-31T05:21:04.987 INFO:tasks.workunit.client.1.smithi073.stdout:3/640: rmdir da/d3c/d67/db7 39 2024-08-31T05:21:04.988 INFO:tasks.workunit.client.1.smithi073.stdout:9/710: rmdir dc/de/dd8 39 2024-08-31T05:21:04.989 INFO:tasks.workunit.client.1.smithi073.stdout:7/526: chown d1/da/d3e/c54 0 1 2024-08-31T05:21:04.991 INFO:tasks.workunit.client.1.smithi073.stdout:1/527: dwrite d5/d17/f2f [0,4194304] 0 2024-08-31T05:21:04.991 INFO:tasks.workunit.client.1.smithi073.stdout:0/583: write d0/d15/d2c/d4d/d3c/fb4 [176716,71073] 0 2024-08-31T05:21:04.994 INFO:tasks.workunit.client.1.smithi073.stdout:4/533: unlink d7/df/d13/d2e/d70/d6b/c27 0 2024-08-31T05:21:04.996 INFO:tasks.workunit.client.1.smithi073.stdout:2/560: dread d2/d9/d3c/f73 [0,4194304] 0 2024-08-31T05:21:04.996 INFO:tasks.workunit.client.1.smithi073.stdout:6/591: dwrite d15/f47 [0,4194304] 0 2024-08-31T05:21:04.996 INFO:tasks.workunit.client.1.smithi073.stdout:9/711: mknod dc/d37/d42/d5a/d89/cee 0 2024-08-31T05:21:04.997 INFO:tasks.workunit.client.1.smithi073.stdout:1/528: chown d5/d10/d33/fe 2970670 1 2024-08-31T05:21:04.997 INFO:tasks.workunit.client.1.smithi073.stdout:7/527: mkdir d1/da/db2 0 2024-08-31T05:21:05.003 INFO:tasks.workunit.client.1.smithi073.stdout:7/528: mknod d1/da/cb3 0 2024-08-31T05:21:05.003 INFO:tasks.workunit.client.1.smithi073.stdout:5/745: dread dc/d3d/d55/d84/d49/f97 [4194304,4194304] 0 2024-08-31T05:21:05.005 INFO:tasks.workunit.client.1.smithi073.stdout:2/561: write d2/d9/df/f3e [848237,118641] 0 2024-08-31T05:21:05.008 INFO:tasks.workunit.client.1.smithi073.stdout:5/746: unlink dc/d3d/dab/lef 0 2024-08-31T05:21:05.009 INFO:tasks.workunit.client.1.smithi073.stdout:6/592: creat d15/d1a/d2b/d2f/d4b/d88/fbb x:0 0 0 2024-08-31T05:21:05.009 INFO:tasks.workunit.client.1.smithi073.stdout:8/618: dread d0/f39 [0,4194304] 0 2024-08-31T05:21:05.009 INFO:tasks.workunit.client.1.smithi073.stdout:2/562: mknod d2/d9/df/d36/cb8 0 2024-08-31T05:21:05.010 INFO:tasks.workunit.client.1.smithi073.stdout:7/529: chown d1/d11/d14/c20 1283053288 1 2024-08-31T05:21:05.012 INFO:tasks.workunit.client.1.smithi073.stdout:2/563: symlink d2/d25/lb9 0 2024-08-31T05:21:05.012 INFO:tasks.workunit.client.1.smithi073.stdout:5/747: getdents dc/d16/d1a/db7/deb 0 2024-08-31T05:21:05.013 INFO:tasks.workunit.client.1.smithi073.stdout:3/641: dread da/d3c/f5e [0,4194304] 0 2024-08-31T05:21:05.014 INFO:tasks.workunit.client.1.smithi073.stdout:7/530: fdatasync d1/d11/d14/f63 0 2024-08-31T05:21:05.015 INFO:tasks.workunit.client.1.smithi073.stdout:8/619: creat d0/db/d1c/fba x:0 0 0 2024-08-31T05:21:05.016 INFO:tasks.workunit.client.1.smithi073.stdout:3/642: chown da/d3c/d67/c9e 269 1 2024-08-31T05:21:05.018 INFO:tasks.workunit.client.1.smithi073.stdout:2/564: write d2/d9/d27/d9b/da7/fa8 [4132804,32863] 0 2024-08-31T05:21:05.020 INFO:tasks.workunit.client.1.smithi073.stdout:7/531: write d1/da/d15/d33/d44/d60/f9b [829797,66123] 0 2024-08-31T05:21:05.021 INFO:tasks.workunit.client.1.smithi073.stdout:2/565: fdatasync d2/d9/df/f3e 0 2024-08-31T05:21:05.022 INFO:tasks.workunit.client.1.smithi073.stdout:8/620: symlink d0/db/d44/d9e/lbb 0 2024-08-31T05:21:05.024 INFO:tasks.workunit.client.1.smithi073.stdout:7/532: fsync d1/da/d15/f24 0 2024-08-31T05:21:05.027 INFO:tasks.workunit.client.1.smithi073.stdout:3/643: creat da/d3c/d65/d45/dcd/fd1 x:0 0 0 2024-08-31T05:21:05.027 INFO:tasks.workunit.client.1.smithi073.stdout:5/748: dwrite dc/d16/d3b/d3f/fec [0,4194304] 0 2024-08-31T05:21:05.027 INFO:tasks.workunit.client.1.smithi073.stdout:0/584: dread d0/f76 [0,4194304] 0 2024-08-31T05:21:05.028 INFO:tasks.workunit.client.1.smithi073.stdout:8/621: write d0/db/d44/f4d [5929696,85958] 0 2024-08-31T05:21:05.033 INFO:tasks.workunit.client.1.smithi073.stdout:3/644: mkdir da/d3c/d65/d40/d5d/dd2 0 2024-08-31T05:21:05.033 INFO:tasks.workunit.client.1.smithi073.stdout:0/585: rmdir d0/d69 39 2024-08-31T05:21:05.034 INFO:tasks.workunit.client.1.smithi073.stdout:6/593: dread d15/d1a/d1e/d69/d7e/f8e [0,4194304] 0 2024-08-31T05:21:05.036 INFO:tasks.workunit.client.1.smithi073.stdout:8/622: write d0/db/d1c/d24/f48 [3601941,56454] 0 2024-08-31T05:21:05.038 INFO:tasks.workunit.client.1.smithi073.stdout:7/533: creat d1/da/d15/d33/d44/d74/fb4 x:0 0 0 2024-08-31T05:21:05.040 INFO:tasks.workunit.client.1.smithi073.stdout:0/586: creat d0/d15/d2c/d41/fbc x:0 0 0 2024-08-31T05:21:05.040 INFO:tasks.workunit.client.1.smithi073.stdout:4/534: dread d7/df/d1b/f51 [0,4194304] 0 2024-08-31T05:21:05.040 INFO:tasks.workunit.client.1.smithi073.stdout:5/749: rename l0 to dc/d16/d3b/d7f/d99/lf9 0 2024-08-31T05:21:05.041 INFO:tasks.workunit.client.1.smithi073.stdout:6/594: creat d15/d17/da1/fbc x:0 0 0 2024-08-31T05:21:05.041 INFO:tasks.workunit.client.1.smithi073.stdout:3/645: dread da/d3c/d65/d45/f55 [0,4194304] 0 2024-08-31T05:21:05.042 INFO:tasks.workunit.client.1.smithi073.stdout:2/566: write d2/d9/f81 [1312187,61599] 0 2024-08-31T05:21:05.042 INFO:tasks.workunit.client.1.smithi073.stdout:8/623: creat d0/fbc x:0 0 0 2024-08-31T05:21:05.043 INFO:tasks.workunit.client.1.smithi073.stdout:7/534: mknod d1/da/d3e/d22/d47/cb5 0 2024-08-31T05:21:05.043 INFO:tasks.workunit.client.1.smithi073.stdout:4/535: chown d7/df/d13/d2e/d47 1860099 1 2024-08-31T05:21:05.044 INFO:tasks.workunit.client.1.smithi073.stdout:0/587: chown d0/d15/d2c/d40/d4a/fad 13889 1 2024-08-31T05:21:05.044 INFO:tasks.workunit.client.1.smithi073.stdout:5/750: mknod dc/cfa 0 2024-08-31T05:21:05.045 INFO:tasks.workunit.client.1.smithi073.stdout:7/535: dread - d1/d11/faf zero size 2024-08-31T05:21:05.046 INFO:tasks.workunit.client.1.smithi073.stdout:6/595: chown d15/d17/da1/dae/db0/d38/d9b/f73 6843 1 2024-08-31T05:21:05.047 INFO:tasks.workunit.client.1.smithi073.stdout:7/536: write d1/da/d3e/d22/d6b/f81 [373424,3411] 0 2024-08-31T05:21:05.049 INFO:tasks.workunit.client.1.smithi073.stdout:5/751: chown dc/d3d/d55/d84/fc0 30826971 1 2024-08-31T05:21:05.050 INFO:tasks.workunit.client.1.smithi073.stdout:2/567: rename d2/d9/f2a to d2/d9/d27/d9b/da6/fba 0 2024-08-31T05:21:05.054 INFO:tasks.workunit.client.1.smithi073.stdout:5/752: mknod dc/d3d/d55/d84/dcc/cfb 0 2024-08-31T05:21:05.058 INFO:tasks.workunit.client.1.smithi073.stdout:4/536: rename d7/d1a/d5c/d6d/d59/d86/f8c to d7/df/d13/d53/d8b/f99 0 2024-08-31T05:21:05.059 INFO:tasks.workunit.client.1.smithi073.stdout:3/646: dread da/d3c/f42 [0,4194304] 0 2024-08-31T05:21:05.059 INFO:tasks.workunit.client.1.smithi073.stdout:2/568: creat d2/d9/d66/d70/fbb x:0 0 0 2024-08-31T05:21:05.061 INFO:tasks.workunit.client.1.smithi073.stdout:2/569: write d2/d9/d7f/dab/d5d/f7c [3298566,12107] 0 2024-08-31T05:21:05.061 INFO:tasks.workunit.client.1.smithi073.stdout:8/624: truncate d0/f1b 1719786 0 2024-08-31T05:21:05.062 INFO:tasks.workunit.client.1.smithi073.stdout:0/588: getdents d0/d15/d2c/d4d 0 2024-08-31T05:21:05.063 INFO:tasks.workunit.client.1.smithi073.stdout:6/596: rename d15/l27 to d15/d1a/d2b/d2f/d4b/d97/lbd 0 2024-08-31T05:21:05.064 INFO:tasks.workunit.client.1.smithi073.stdout:6/597: chown d15/d17/da1/dae/db0/d38/d9b/d87/fb5 1 1 2024-08-31T05:21:05.065 INFO:tasks.workunit.client.1.smithi073.stdout:6/598: write d15/d1a/f5b [5895749,78835] 0 2024-08-31T05:21:05.065 INFO:tasks.workunit.client.1.smithi073.stdout:2/570: rmdir d2/d9/df/d43 39 2024-08-31T05:21:05.066 INFO:tasks.workunit.client.1.smithi073.stdout:2/571: fdatasync d2/d9/d7f/fb0 0 2024-08-31T05:21:05.069 INFO:tasks.workunit.client.1.smithi073.stdout:0/589: creat d0/d58/fbd x:0 0 0 2024-08-31T05:21:05.072 INFO:tasks.workunit.client.1.smithi073.stdout:5/753: dwrite dc/d16/d1a/f72 [0,4194304] 0 2024-08-31T05:21:05.073 INFO:tasks.workunit.client.1.smithi073.stdout:3/647: symlink da/d3c/d65/d40/d5d/dd2/ld3 0 2024-08-31T05:21:05.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:04 smithi067 ceph-mon[17432]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:05.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:04 smithi067 ceph-mon[17432]: pgmap v23: 65 pgs: 65 active+clean; 868 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 MiB/s rd, 105 MiB/s wr, 255 op/s 2024-08-31T05:21:05.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:04 smithi067 ceph-mon[17432]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:04 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/877628972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:21:05.075 INFO:tasks.workunit.client.1.smithi073.stdout:7/537: link d1/da/d3e/d22/l5e d1/d11/lb6 0 2024-08-31T05:21:05.076 INFO:tasks.workunit.client.1.smithi073.stdout:6/599: rmdir d15/d17/da1/dae/db0 39 2024-08-31T05:21:05.077 INFO:tasks.workunit.client.1.smithi073.stdout:6/600: chown d15/d1a/f5b 214 1 2024-08-31T05:21:05.078 INFO:tasks.workunit.client.1.smithi073.stdout:4/537: truncate d7/df/d13/d2e/f3a 29877 0 2024-08-31T05:21:05.079 INFO:tasks.workunit.client.1.smithi073.stdout:0/590: symlink d0/d15/d2c/d4d/lbe 0 2024-08-31T05:21:05.080 INFO:tasks.workunit.client.1.smithi073.stdout:8/625: dwrite d0/db/d1c/f3b [0,4194304] 0 2024-08-31T05:21:05.080 INFO:tasks.workunit.client.1.smithi073.stdout:5/754: fdatasync dc/d16/f2b 0 2024-08-31T05:21:05.084 INFO:tasks.workunit.client.1.smithi073.stdout:3/648: write da/d68/f84 [3551043,109372] 0 2024-08-31T05:21:05.087 INFO:tasks.workunit.client.1.smithi073.stdout:0/591: dwrite d0/f7a [0,4194304] 0 2024-08-31T05:21:05.092 INFO:tasks.workunit.client.1.smithi073.stdout:0/592: dwrite d0/d15/d2c/d40/f9a [0,4194304] 0 2024-08-31T05:21:05.125 INFO:tasks.workunit.client.1.smithi073.stdout:1/529: sync 2024-08-31T05:21:05.125 INFO:tasks.workunit.client.1.smithi073.stdout:9/712: sync 2024-08-31T05:21:05.126 INFO:tasks.workunit.client.1.smithi073.stdout:1/530: write d5/d10/d33/f30 [12422920,70708] 0 2024-08-31T05:21:05.128 INFO:tasks.workunit.client.1.smithi073.stdout:9/713: dread dc/d37/d42/d8d/f57 [0,4194304] 0 2024-08-31T05:21:05.216 INFO:tasks.workunit.client.1.smithi073.stdout:6/601: mkdir d15/d17/da1/dbe 0 2024-08-31T05:21:05.216 INFO:tasks.workunit.client.1.smithi073.stdout:2/572: symlink d2/d9/d7f/dab/lbc 0 2024-08-31T05:21:05.216 INFO:tasks.workunit.client.1.smithi073.stdout:6/602: chown d15/d1a/d1e/f66 30230 1 2024-08-31T05:21:05.217 INFO:tasks.workunit.client.1.smithi073.stdout:5/755: write dc/d3d/d55/d84/d49/dd2/f70 [1320133,111822] 0 2024-08-31T05:21:05.218 INFO:tasks.workunit.client.1.smithi073.stdout:5/756: fsync dc/d3d/d55/d84/d49/f81 0 2024-08-31T05:21:05.219 INFO:tasks.workunit.client.1.smithi073.stdout:7/538: rename d1/da/d15/d33/d44/d60/c7a to d1/d11/d14/dac/cb7 0 2024-08-31T05:21:05.219 INFO:tasks.workunit.client.1.smithi073.stdout:5/757: readlink dc/d16/d4e/l57 0 2024-08-31T05:21:05.219 INFO:tasks.workunit.client.1.smithi073.stdout:4/538: rename d7/d1a/d5c/d6d to d7/d1a/d5c/d6d/d59/d65/d9a 22 2024-08-31T05:21:05.220 INFO:tasks.workunit.client.1.smithi073.stdout:2/573: read d2/d9/df/f53 [1228278,114333] 0 2024-08-31T05:21:05.220 INFO:tasks.workunit.client.1.smithi073.stdout:4/539: chown d7 0 1 2024-08-31T05:21:05.221 INFO:tasks.workunit.client.1.smithi073.stdout:3/649: creat da/d3c/d82/d97/fd4 x:0 0 0 2024-08-31T05:21:05.223 INFO:tasks.workunit.client.1.smithi073.stdout:0/593: fsync d0/d69/d7f/d62/fb2 0 2024-08-31T05:21:05.225 INFO:tasks.workunit.client.1.smithi073.stdout:9/714: mknod dc/d37/d42/d8d/d52/d5b/cef 0 2024-08-31T05:21:05.227 INFO:tasks.workunit.client.1.smithi073.stdout:8/626: mknod d0/db/d1c/d2a/cbd 0 2024-08-31T05:21:05.228 INFO:tasks.workunit.client.1.smithi073.stdout:6/603: creat d15/d1a/d51/d61/fbf x:0 0 0 2024-08-31T05:21:05.230 INFO:tasks.workunit.client.1.smithi073.stdout:2/574: dread d2/d9/df/f53 [0,4194304] 0 2024-08-31T05:21:05.230 INFO:tasks.workunit.client.1.smithi073.stdout:5/758: unlink dc/d16/d3b/c40 0 2024-08-31T05:21:05.231 INFO:tasks.workunit.client.1.smithi073.stdout:4/540: unlink d7/df/c85 0 2024-08-31T05:21:05.233 INFO:tasks.workunit.client.1.smithi073.stdout:3/650: creat da/d3c/d65/d87/fd5 x:0 0 0 2024-08-31T05:21:05.233 INFO:tasks.workunit.client.1.smithi073.stdout:2/575: chown d2/d9/d27/d9b/da7/fad 137912002 1 2024-08-31T05:21:05.234 INFO:tasks.workunit.client.1.smithi073.stdout:6/604: rmdir d15/d1a/d51/d61 39 2024-08-31T05:21:05.235 INFO:tasks.workunit.client.1.smithi073.stdout:7/539: symlink d1/da/db2/lb8 0 2024-08-31T05:21:05.235 INFO:tasks.workunit.client.1.smithi073.stdout:2/576: fsync d2/d9/f77 0 2024-08-31T05:21:05.237 INFO:tasks.workunit.client.1.smithi073.stdout:9/715: creat dc/d37/d42/d5a/dd0/ff0 x:0 0 0 2024-08-31T05:21:05.237 INFO:tasks.workunit.client.1.smithi073.stdout:8/627: dwrite d0/db/d1c/d2a/d58/faf [0,4194304] 0 2024-08-31T05:21:05.239 INFO:tasks.workunit.client.1.smithi073.stdout:1/531: getdents d5/d17/d2a/d80/d93 0 2024-08-31T05:21:05.241 INFO:tasks.workunit.client.1.smithi073.stdout:3/651: fdatasync da/d3c/d82/fc9 0 2024-08-31T05:21:05.242 INFO:tasks.workunit.client.1.smithi073.stdout:2/577: symlink d2/d9/d27/d76/lbd 0 2024-08-31T05:21:05.243 INFO:tasks.workunit.client.1.smithi073.stdout:7/540: chown d1/da/d15/d33/d44/d74/c93 75714 1 2024-08-31T05:21:05.243 INFO:tasks.workunit.client.1.smithi073.stdout:6/605: mknod d15/d1a/d51/cc0 0 2024-08-31T05:21:05.243 INFO:tasks.workunit.client.1.smithi073.stdout:5/759: dwrite dc/d3d/d55/d84/f51 [0,4194304] 0 2024-08-31T05:21:05.245 INFO:tasks.workunit.client.1.smithi073.stdout:3/652: chown da/d3c/d65/d40/f44 7739300 1 2024-08-31T05:21:05.246 INFO:tasks.workunit.client.1.smithi073.stdout:9/716: read dc/d37/d42/d8d/f4b [3567083,80586] 0 2024-08-31T05:21:05.246 INFO:tasks.workunit.client.1.smithi073.stdout:3/653: write da/d3c/d65/d45/fa1 [1547861,68022] 0 2024-08-31T05:21:05.248 INFO:tasks.workunit.client.1.smithi073.stdout:8/628: symlink d0/db/d1c/d24/lbe 0 2024-08-31T05:21:05.248 INFO:tasks.workunit.client.1.smithi073.stdout:9/717: chown dc/de/c16 1 1 2024-08-31T05:21:05.249 INFO:tasks.workunit.client.1.smithi073.stdout:2/578: symlink d2/d25/lbe 0 2024-08-31T05:21:05.253 INFO:tasks.workunit.client.1.smithi073.stdout:4/541: getdents d7/d1a/d5c/d6d/d2c 0 2024-08-31T05:21:05.255 INFO:tasks.workunit.client.1.smithi073.stdout:4/542: readlink d7/df/l64 0 2024-08-31T05:21:05.255 INFO:tasks.workunit.client.1.smithi073.stdout:5/760: write dc/d3d/d55/d84/d49/f71 [1143726,73668] 0 2024-08-31T05:21:05.256 INFO:tasks.workunit.client.1.smithi073.stdout:3/654: fsync da/d3c/f5e 0 2024-08-31T05:21:05.258 INFO:tasks.workunit.client.1.smithi073.stdout:1/532: creat d5/d17/d32/d37/d6f/f97 x:0 0 0 2024-08-31T05:21:05.259 INFO:tasks.workunit.client.1.smithi073.stdout:9/718: symlink dc/d37/d42/d8d/de8/lf1 0 2024-08-31T05:21:05.259 INFO:tasks.workunit.client.1.smithi073.stdout:5/761: readlink dc/d16/d1a/l35 0 2024-08-31T05:21:05.263 INFO:tasks.workunit.client.1.smithi073.stdout:6/606: dwrite d15/d1a/d51/d61/f80 [0,4194304] 0 2024-08-31T05:21:05.265 INFO:tasks.workunit.client.1.smithi073.stdout:4/543: creat d7/df/d13/d2e/d70/f9b x:0 0 0 2024-08-31T05:21:05.265 INFO:tasks.workunit.client.1.smithi073.stdout:7/541: dwrite d1/d11/f53 [4194304,4194304] 0 2024-08-31T05:21:05.265 INFO:tasks.workunit.client.1.smithi073.stdout:1/533: write d5/d10/d33/f36 [7943251,82048] 0 2024-08-31T05:21:05.269 INFO:tasks.workunit.client.1.smithi073.stdout:5/762: chown dc/d16/d3b/dc6/cf7 129600350 1 2024-08-31T05:21:05.272 INFO:tasks.workunit.client.1.smithi073.stdout:3/655: link da/d3c/d65/d45/fa1 da/d3c/d5a/fd6 0 2024-08-31T05:21:05.275 INFO:tasks.workunit.client.1.smithi073.stdout:5/763: chown dc/d3d/d55/fc3 0 1 2024-08-31T05:21:05.276 INFO:tasks.workunit.client.1.smithi073.stdout:7/542: symlink d1/da/d15/lb9 0 2024-08-31T05:21:05.276 INFO:tasks.workunit.client.1.smithi073.stdout:4/544: symlink d7/d1a/d5c/d6d/d59/d65/l9c 0 2024-08-31T05:21:05.277 INFO:tasks.workunit.client.1.smithi073.stdout:8/629: dwrite d0/db/d1c/d23/f26 [4194304,4194304] 0 2024-08-31T05:21:05.278 INFO:tasks.workunit.client.1.smithi073.stdout:3/656: mknod da/d68/cd7 0 2024-08-31T05:21:05.282 INFO:tasks.workunit.client.1.smithi073.stdout:6/607: rename d15/d1a/d2b/f4c to d15/d1a/d2b/d2f/fc1 0 2024-08-31T05:21:05.282 INFO:tasks.workunit.client.1.smithi073.stdout:2/579: dwrite d2/d9/d27/d9b/da6/fba [0,4194304] 0 2024-08-31T05:21:05.282 INFO:tasks.workunit.client.1.smithi073.stdout:7/543: mkdir d1/da/db2/dba 0 2024-08-31T05:21:05.285 INFO:tasks.workunit.client.1.smithi073.stdout:9/719: dwrite dc/d37/db5/dc1/fed [0,4194304] 0 2024-08-31T05:21:05.285 INFO:tasks.workunit.client.1.smithi073.stdout:5/764: creat dc/d16/d3b/d3f/d4f/ffc x:0 0 0 2024-08-31T05:21:05.285 INFO:tasks.workunit.client.1.smithi073.stdout:8/630: rmdir d0/db/d1c/d23 39 2024-08-31T05:21:05.287 INFO:tasks.workunit.client.1.smithi073.stdout:6/608: read - d15/d1a/d2b/d2f/f30 zero size 2024-08-31T05:21:05.288 INFO:tasks.workunit.client.1.smithi073.stdout:3/657: unlink da/d3c/d65/d40/d5d/f83 0 2024-08-31T05:21:05.296 INFO:tasks.workunit.client.1.smithi073.stdout:6/609: write d15/f1f [1829209,108961] 0 2024-08-31T05:21:05.296 INFO:tasks.workunit.client.1.smithi073.stdout:9/720: write dc/d37/d42/d8d/d52/fe5 [776526,34968] 0 2024-08-31T05:21:05.296 INFO:tasks.workunit.client.1.smithi073.stdout:1/534: rename d5/d17/d2a/f5b to d5/d10/d33/d13/d7e/f98 0 2024-08-31T05:21:05.296 INFO:tasks.workunit.client.1.smithi073.stdout:3/658: unlink da/f15 0 2024-08-31T05:21:05.297 INFO:tasks.workunit.client.1.smithi073.stdout:2/580: truncate d2/d9/d27/d9b/da6/f75 949949 0 2024-08-31T05:21:05.299 INFO:tasks.workunit.client.1.smithi073.stdout:1/535: read d5/d10/d1c/f4b [204118,62014] 0 2024-08-31T05:21:05.299 INFO:tasks.workunit.client.1.smithi073.stdout:4/545: getdents d7/df 0 2024-08-31T05:21:05.300 INFO:tasks.workunit.client.1.smithi073.stdout:3/659: write da/f62 [751593,49867] 0 2024-08-31T05:21:05.301 INFO:tasks.workunit.client.1.smithi073.stdout:2/581: read d2/d9/d66/d70/f74 [86238,73920] 0 2024-08-31T05:21:05.302 INFO:tasks.workunit.client.1.smithi073.stdout:3/660: chown da/d3c/d65/d40/c7f 6316 1 2024-08-31T05:21:05.303 INFO:tasks.workunit.client.1.smithi073.stdout:6/610: unlink d15/d1a/d2b/d2f/c54 0 2024-08-31T05:21:05.303 INFO:tasks.workunit.client.1.smithi073.stdout:2/582: read - d2/d9/df/f62 zero size 2024-08-31T05:21:05.305 INFO:tasks.workunit.client.1.smithi073.stdout:2/583: write d2/d9/d7f/dab/d5d/fb3 [756657,96992] 0 2024-08-31T05:21:05.307 INFO:tasks.workunit.client.1.smithi073.stdout:4/546: dwrite d7/df/d13/f44 [0,4194304] 0 2024-08-31T05:21:05.310 INFO:tasks.workunit.client.1.smithi073.stdout:1/536: readlink d5/d10/d33/d13/l85 0 2024-08-31T05:21:05.311 INFO:tasks.workunit.client.1.smithi073.stdout:4/547: read d7/db/f4e [2559313,8620] 0 2024-08-31T05:21:05.312 INFO:tasks.workunit.client.1.smithi073.stdout:5/765: link dc/d16/d3b/d3f/d4f/l60 dc/d16/d1a/lfd 0 2024-08-31T05:21:05.312 INFO:tasks.workunit.client.1.smithi073.stdout:7/544: getdents d1/da/d3e/d22 0 2024-08-31T05:21:05.316 INFO:tasks.workunit.client.1.smithi073.stdout:5/766: readlink dc/l22 0 2024-08-31T05:21:05.319 INFO:tasks.workunit.client.1.smithi073.stdout:2/584: dwrite d2/d9/d27/d76/d97/fa4 [0,4194304] 0 2024-08-31T05:21:05.320 INFO:tasks.workunit.client.1.smithi073.stdout:7/545: mkdir d1/da/d3e/db1/dbb 0 2024-08-31T05:21:05.320 INFO:tasks.workunit.client.1.smithi073.stdout:4/548: chown d7/d1a/d5c/d6d/d2c/d2d/l5e 38231 1 2024-08-31T05:21:05.321 INFO:tasks.workunit.client.1.smithi073.stdout:8/631: dread d0/db/d1c/d24/f53 [0,4194304] 0 2024-08-31T05:21:05.323 INFO:tasks.workunit.client.1.smithi073.stdout:3/661: dwrite da/ff [4194304,4194304] 0 2024-08-31T05:21:05.329 INFO:tasks.workunit.client.1.smithi073.stdout:4/549: rename d7/df/d13/d2e/d47/d4c/d50 to d7/df/d13/d53/d88/d9d 0 2024-08-31T05:21:05.330 INFO:tasks.workunit.client.1.smithi073.stdout:2/585: creat d2/d9/d27/d76/d97/fbf x:0 0 0 2024-08-31T05:21:05.337 INFO:tasks.workunit.client.1.smithi073.stdout:3/662: symlink da/d3c/d65/d45/ld8 0 2024-08-31T05:21:05.338 INFO:tasks.workunit.client.1.smithi073.stdout:1/537: write d5/d10/d1b/f41 [1542607,88084] 0 2024-08-31T05:21:05.339 INFO:tasks.workunit.client.1.smithi073.stdout:4/550: chown d7/df/d13/d2e/d70/c8a 2 1 2024-08-31T05:21:05.340 INFO:tasks.workunit.client.1.smithi073.stdout:9/721: dread dc/f25 [4194304,4194304] 0 2024-08-31T05:21:05.340 INFO:tasks.workunit.client.1.smithi073.stdout:2/586: unlink d2/d25/l49 0 2024-08-31T05:21:05.341 INFO:tasks.workunit.client.1.smithi073.stdout:5/767: dwrite dc/d3d/d55/d84/d49/dd2/f70 [0,4194304] 0 2024-08-31T05:21:05.341 INFO:tasks.workunit.client.1.smithi073.stdout:1/538: chown d5/d17/d3f/c92 2 1 2024-08-31T05:21:05.341 INFO:tasks.workunit.client.1.smithi073.stdout:8/632: creat d0/db/d44/d4e/fbf x:0 0 0 2024-08-31T05:21:05.342 INFO:tasks.workunit.client.1.smithi073.stdout:9/722: chown dc/d37/db5 91850220 1 2024-08-31T05:21:05.344 INFO:tasks.workunit.client.1.smithi073.stdout:7/546: getdents d1/da/d15/d33/d44 0 2024-08-31T05:21:05.347 INFO:tasks.workunit.client.1.smithi073.stdout:4/551: truncate d7/db/f4f 4790521 0 2024-08-31T05:21:05.347 INFO:tasks.workunit.client.1.smithi073.stdout:8/633: read d0/db/d1c/d24/f78 [110167,70711] 0 2024-08-31T05:21:05.350 INFO:tasks.workunit.client.1.smithi073.stdout:9/723: unlink dc/d37/d42/l63 0 2024-08-31T05:21:05.351 INFO:tasks.workunit.client.1.smithi073.stdout:3/663: dwrite da/d3c/d67/faa [0,4194304] 0 2024-08-31T05:21:05.351 INFO:tasks.workunit.client.1.smithi073.stdout:5/768: mknod dc/d3d/d55/d84/dcc/dea/cfe 0 2024-08-31T05:21:05.351 INFO:tasks.workunit.client.1.smithi073.stdout:8/634: write d0/db/d1c/d24/faa [748204,526] 0 2024-08-31T05:21:05.358 INFO:tasks.workunit.client.1.smithi073.stdout:1/539: rename d5/d10/d33/c12 to d5/d26/c99 0 2024-08-31T05:21:05.358 INFO:tasks.workunit.client.1.smithi073.stdout:4/552: creat d7/df/d13/f9e x:0 0 0 2024-08-31T05:21:05.358 INFO:tasks.workunit.client.1.smithi073.stdout:1/540: truncate d5/f65 4385873 0 2024-08-31T05:21:05.358 INFO:tasks.workunit.client.1.smithi073.stdout:9/724: rmdir dc/de/d56 39 2024-08-31T05:21:05.359 INFO:tasks.workunit.client.1.smithi073.stdout:9/725: chown dc/de/f1e 161 1 2024-08-31T05:21:05.360 INFO:tasks.workunit.client.1.smithi073.stdout:0/594: sync 2024-08-31T05:21:05.360 INFO:tasks.workunit.client.1.smithi073.stdout:5/769: dwrite dc/d16/d1a/d87/d94/fb3 [0,4194304] 0 2024-08-31T05:21:05.361 INFO:tasks.workunit.client.1.smithi073.stdout:4/553: mkdir d7/d1a/d5c/d62/d9f 0 2024-08-31T05:21:05.362 INFO:tasks.workunit.client.1.smithi073.stdout:0/595: read - d0/d69/d7f/d62/fa6 zero size 2024-08-31T05:21:05.362 INFO:tasks.workunit.client.1.smithi073.stdout:4/554: write d7/df/d13/f16 [4769681,113557] 0 2024-08-31T05:21:05.365 INFO:tasks.workunit.client.1.smithi073.stdout:1/541: creat d5/d10/d1c/d27/f9a x:0 0 0 2024-08-31T05:21:05.369 INFO:tasks.workunit.client.1.smithi073.stdout:2/587: getdents d2/d25 0 2024-08-31T05:21:05.370 INFO:tasks.workunit.client.1.smithi073.stdout:2/588: dread - d2/d9/d66/d70/fbb zero size 2024-08-31T05:21:05.372 INFO:tasks.workunit.client.1.smithi073.stdout:0/596: mkdir d0/d69/d7f/d62/dbf 0 2024-08-31T05:21:05.373 INFO:tasks.workunit.client.1.smithi073.stdout:8/635: creat d0/db/d44/d72/fc0 x:0 0 0 2024-08-31T05:21:05.375 INFO:tasks.workunit.client.1.smithi073.stdout:9/726: symlink dc/d37/d42/d5a/lf2 0 2024-08-31T05:21:05.375 INFO:tasks.workunit.client.1.smithi073.stdout:8/636: write d0/db/d1c/d24/d73/f9b [220619,117167] 0 2024-08-31T05:21:05.378 INFO:tasks.workunit.client.1.smithi073.stdout:5/770: dwrite dc/d53/f82 [0,4194304] 0 2024-08-31T05:21:05.380 INFO:tasks.workunit.client.1.smithi073.stdout:1/542: rename d5/f34 to d5/d26/d54/f9b 0 2024-08-31T05:21:05.382 INFO:tasks.workunit.client.1.smithi073.stdout:7/547: truncate d1/d11/d14/f3c 1173972 0 2024-08-31T05:21:05.382 INFO:tasks.workunit.client.1.smithi073.stdout:8/637: truncate d0/db/d44/d72/d79/f83 860758 0 2024-08-31T05:21:05.383 INFO:tasks.workunit.client.1.smithi073.stdout:3/664: truncate da/d3c/d65/d2c/d8e/f9a 3363755 0 2024-08-31T05:21:05.385 INFO:tasks.workunit.client.1.smithi073.stdout:3/665: read - da/d3c/d65/d87/fd5 zero size 2024-08-31T05:21:05.386 INFO:tasks.workunit.client.1.smithi073.stdout:9/727: dwrite dc/d37/d42/d8d/f39 [0,4194304] 0 2024-08-31T05:21:05.386 INFO:tasks.workunit.client.1.smithi073.stdout:7/548: read d1/da/d65/f7e [466758,66514] 0 2024-08-31T05:21:05.386 INFO:tasks.workunit.client.1.smithi073.stdout:5/771: rename dc/d3d/d55/d84 to dc/d3d/dab/dff 0 2024-08-31T05:21:05.398 INFO:tasks.workunit.client.1.smithi073.stdout:0/597: dread d0/d69/d7f/f65 [0,4194304] 0 2024-08-31T05:21:05.399 INFO:tasks.workunit.client.1.smithi073.stdout:3/666: mkdir da/d3c/d67/dd9 0 2024-08-31T05:21:05.400 INFO:tasks.workunit.client.1.smithi073.stdout:5/772: fdatasync dc/d53/f79 0 2024-08-31T05:21:05.401 INFO:tasks.workunit.client.1.smithi073.stdout:5/773: dread - dc/fdd zero size 2024-08-31T05:21:05.401 INFO:tasks.workunit.client.1.smithi073.stdout:1/543: chown d5/d26/c5a 66 1 2024-08-31T05:21:05.402 INFO:tasks.workunit.client.1.smithi073.stdout:5/774: write dc/d3d/d3e/fe2 [2750620,123833] 0 2024-08-31T05:21:05.402 INFO:tasks.workunit.client.1.smithi073.stdout:0/598: creat d0/d69/d8e/fc0 x:0 0 0 2024-08-31T05:21:05.403 INFO:tasks.workunit.client.1.smithi073.stdout:7/549: link d1/da/d3e/c1e d1/da/d3e/d22/d47/da8/cbc 0 2024-08-31T05:21:05.405 INFO:tasks.workunit.client.1.smithi073.stdout:3/667: mkdir da/d3c/dda 0 2024-08-31T05:21:05.407 INFO:tasks.workunit.client.1.smithi073.stdout:1/544: creat d5/d17/d2a/f9c x:0 0 0 2024-08-31T05:21:05.407 INFO:tasks.workunit.client.1.smithi073.stdout:7/550: truncate d1/da/d96/fa4 2845197 0 2024-08-31T05:21:05.407 INFO:tasks.workunit.client.1.smithi073.stdout:1/545: dread - d5/d17/d32/d37/d6f/f97 zero size 2024-08-31T05:21:05.408 INFO:tasks.workunit.client.1.smithi073.stdout:7/551: fsync d1/f2e 0 2024-08-31T05:21:05.408 INFO:tasks.workunit.client.1.smithi073.stdout:3/668: symlink da/d3c/d67/dd9/ldb 0 2024-08-31T05:21:05.409 INFO:tasks.workunit.client.1.smithi073.stdout:1/546: mknod d5/d17/d5d/d61/c9d 0 2024-08-31T05:21:05.410 INFO:tasks.workunit.client.1.smithi073.stdout:3/669: truncate da/d3c/f60 2068659 0 2024-08-31T05:21:05.410 INFO:tasks.workunit.client.1.smithi073.stdout:1/547: chown d5/d17/d2a/l48 4090 1 2024-08-31T05:21:05.410 INFO:tasks.workunit.client.1.smithi073.stdout:7/552: symlink d1/da/d15/d33/d44/d74/lbd 0 2024-08-31T05:21:05.417 INFO:tasks.workunit.client.1.smithi073.stdout:1/548: dwrite d5/f25 [4194304,4194304] 0 2024-08-31T05:21:05.417 INFO:tasks.workunit.client.1.smithi073.stdout:1/549: chown d5/d17/d2a/d80/l73 23 1 2024-08-31T05:21:05.418 INFO:tasks.workunit.client.1.smithi073.stdout:1/550: chown d5/d10/c22 1030124024 1 2024-08-31T05:21:05.422 INFO:tasks.workunit.client.1.smithi073.stdout:5/775: dread dc/d3d/d55/fc3 [0,4194304] 0 2024-08-31T05:21:05.424 INFO:tasks.workunit.client.1.smithi073.stdout:5/776: symlink dc/d16/d3b/d3f/d4f/d98/l100 0 2024-08-31T05:21:05.426 INFO:tasks.workunit.client.1.smithi073.stdout:5/777: creat dc/d3d/d55/f101 x:0 0 0 2024-08-31T05:21:05.430 INFO:tasks.workunit.client.1.smithi073.stdout:3/670: dread da/d3c/d67/f73 [0,4194304] 0 2024-08-31T05:21:05.431 INFO:tasks.workunit.client.1.smithi073.stdout:5/778: dread dc/d16/d3b/d3f/d4f/f8b [0,4194304] 0 2024-08-31T05:21:05.433 INFO:tasks.workunit.client.1.smithi073.stdout:5/779: read dc/d3d/dab/dff/d49/f81 [1251851,60709] 0 2024-08-31T05:21:05.433 INFO:tasks.workunit.client.1.smithi073.stdout:5/780: fsync dc/d3d/d55/fed 0 2024-08-31T05:21:05.436 INFO:tasks.workunit.client.1.smithi073.stdout:5/781: mkdir dc/d3d/dab/dff/d49/dd2/d102 0 2024-08-31T05:21:05.436 INFO:tasks.workunit.client.1.smithi073.stdout:5/782: dread - dc/fdd zero size 2024-08-31T05:21:05.438 INFO:tasks.workunit.client.1.smithi073.stdout:5/783: creat dc/d16/d1a/f103 x:0 0 0 2024-08-31T05:21:05.439 INFO:tasks.workunit.client.1.smithi073.stdout:7/553: dread d1/da/d15/f58 [0,4194304] 0 2024-08-31T05:21:05.439 INFO:tasks.workunit.client.1.smithi073.stdout:5/784: dread - dc/d16/d3b/d3f/d4f/ffc zero size 2024-08-31T05:21:05.440 INFO:tasks.workunit.client.1.smithi073.stdout:7/554: mkdir d1/dbe 0 2024-08-31T05:21:05.442 INFO:tasks.workunit.client.1.smithi073.stdout:7/555: unlink d1/da/f34 0 2024-08-31T05:21:05.443 INFO:tasks.workunit.client.1.smithi073.stdout:7/556: write d1/da/d3e/f52 [4147286,24792] 0 2024-08-31T05:21:05.445 INFO:tasks.workunit.client.1.smithi073.stdout:5/785: dwrite dc/d16/d3b/d3f/d4f/f7b [0,4194304] 0 2024-08-31T05:21:05.447 INFO:tasks.workunit.client.1.smithi073.stdout:7/557: creat d1/da/d3e/d22/d47/da8/fbf x:0 0 0 2024-08-31T05:21:05.448 INFO:tasks.workunit.client.1.smithi073.stdout:5/786: symlink dc/d16/d1a/db7/deb/l104 0 2024-08-31T05:21:05.449 INFO:tasks.workunit.client.1.smithi073.stdout:6/611: sync 2024-08-31T05:21:05.449 INFO:tasks.workunit.client.1.smithi073.stdout:5/787: read - dc/d16/d1a/d87/d94/faa zero size 2024-08-31T05:21:05.450 INFO:tasks.workunit.client.1.smithi073.stdout:3/671: dread da/d3c/d65/d2c/f48 [0,4194304] 0 2024-08-31T05:21:05.450 INFO:tasks.workunit.client.1.smithi073.stdout:5/788: fsync dc/d16/f96 0 2024-08-31T05:21:05.451 INFO:tasks.workunit.client.1.smithi073.stdout:5/789: readlink dc/d3d/l46 0 2024-08-31T05:21:05.454 INFO:tasks.workunit.client.1.smithi073.stdout:6/612: write d15/d1a/d2b/d6a/f94 [42375,55775] 0 2024-08-31T05:21:05.454 INFO:tasks.workunit.client.1.smithi073.stdout:3/672: unlink da/d3c/c53 0 2024-08-31T05:21:05.454 INFO:tasks.workunit.client.1.smithi073.stdout:5/790: mknod dc/d16/d3b/c105 0 2024-08-31T05:21:05.454 INFO:tasks.workunit.client.1.smithi073.stdout:6/613: mknod d15/d17/da1/dae/db0/d38/d9b/d87/cc2 0 2024-08-31T05:21:05.455 INFO:tasks.workunit.client.1.smithi073.stdout:3/673: creat da/d3c/d67/db7/fdc x:0 0 0 2024-08-31T05:21:05.457 INFO:tasks.workunit.client.1.smithi073.stdout:5/791: unlink dc/d3d/dab/dff/dcc/ce3 0 2024-08-31T05:21:05.458 INFO:tasks.workunit.client.1.smithi073.stdout:3/674: creat da/d68/fdd x:0 0 0 2024-08-31T05:21:05.458 INFO:tasks.workunit.client.1.smithi073.stdout:5/792: read dc/d16/d3b/d3f/d4f/f8b [45127,118080] 0 2024-08-31T05:21:05.460 INFO:tasks.workunit.client.1.smithi073.stdout:3/675: symlink da/d18/da2/daf/dbc/lde 0 2024-08-31T05:21:05.460 INFO:tasks.workunit.client.1.smithi073.stdout:3/676: stat da/d68/f84 0 2024-08-31T05:21:05.463 INFO:tasks.workunit.client.1.smithi073.stdout:5/793: dwrite dc/d16/d4e/f8e [0,4194304] 0 2024-08-31T05:21:05.464 INFO:tasks.workunit.client.1.smithi073.stdout:5/794: truncate dc/d3d/d55/f101 573516 0 2024-08-31T05:21:05.467 INFO:tasks.workunit.client.1.smithi073.stdout:5/795: symlink dc/d3d/d55/l106 0 2024-08-31T05:21:05.473 INFO:tasks.workunit.client.1.smithi073.stdout:5/796: dwrite dc/d16/d1a/d87/f91 [0,4194304] 0 2024-08-31T05:21:05.474 INFO:tasks.workunit.client.1.smithi073.stdout:5/797: dread - dc/d3d/dab/dff/dcc/dea/fee zero size 2024-08-31T05:21:05.479 INFO:tasks.workunit.client.1.smithi073.stdout:5/798: rename dc/d16/f95 to dc/d3d/dab/dff/d49/dd2/f107 0 2024-08-31T05:21:05.480 INFO:tasks.workunit.client.1.smithi073.stdout:5/799: write dc/d16/d3b/d3f/d4f/d98/f9d [987644,34399] 0 2024-08-31T05:21:05.482 INFO:tasks.workunit.client.1.smithi073.stdout:5/800: creat dc/d3d/dab/dd5/f108 x:0 0 0 2024-08-31T05:21:05.483 INFO:tasks.workunit.client.1.smithi073.stdout:5/801: chown dc/d3d/dab/dff/d49/dd2/f107 19900 1 2024-08-31T05:21:05.489 INFO:tasks.workunit.client.1.smithi073.stdout:4/555: sync 2024-08-31T05:21:05.567 INFO:tasks.workunit.client.1.smithi073.stdout:5/802: sync 2024-08-31T05:21:05.568 INFO:tasks.workunit.client.1.smithi073.stdout:4/556: rmdir d7/d1a/d5c/d6d/d59/d65/d6f 0 2024-08-31T05:21:05.570 INFO:tasks.workunit.client.1.smithi073.stdout:5/803: mknod dc/d3d/dab/dff/dcc/dea/c109 0 2024-08-31T05:21:05.570 INFO:tasks.workunit.client.1.smithi073.stdout:5/804: readlink dc/d16/d1a/d87/la6 0 2024-08-31T05:21:05.571 INFO:tasks.workunit.client.1.smithi073.stdout:4/557: creat d7/d1a/fa0 x:0 0 0 2024-08-31T05:21:05.572 INFO:tasks.workunit.client.1.smithi073.stdout:5/805: dread dc/d16/d3b/d3f/d4f/f8b [0,4194304] 0 2024-08-31T05:21:05.575 INFO:tasks.workunit.client.1.smithi073.stdout:4/558: rename d7/df/c40 to d7/df/d13/d53/d88/ca1 0 2024-08-31T05:21:05.577 INFO:tasks.workunit.client.1.smithi073.stdout:4/559: write d7/d1a/d5c/d6d/d2c/f7b [3285106,10677] 0 2024-08-31T05:21:05.579 INFO:tasks.workunit.client.1.smithi073.stdout:9/728: write dc/d10/f18 [1654162,31425] 0 2024-08-31T05:21:05.581 INFO:tasks.workunit.client.1.smithi073.stdout:9/729: write dc/d10/f18 [2386839,11489] 0 2024-08-31T05:21:05.581 INFO:tasks.workunit.client.1.smithi073.stdout:2/589: dread d2/d9/f24 [0,4194304] 0 2024-08-31T05:21:05.583 INFO:tasks.workunit.client.1.smithi073.stdout:5/806: rmdir dc/d16/d1a/db7/dc1/de1 0 2024-08-31T05:21:05.586 INFO:tasks.workunit.client.1.smithi073.stdout:2/590: truncate d2/d9/d7f/dab/d5d/f71 972874 0 2024-08-31T05:21:05.589 INFO:tasks.workunit.client.1.smithi073.stdout:5/807: dwrite dc/d16/ff5 [0,4194304] 0 2024-08-31T05:21:05.589 INFO:tasks.workunit.client.1.smithi073.stdout:2/591: symlink d2/d9/d7f/dab/d5d/lc0 0 2024-08-31T05:21:05.590 INFO:tasks.workunit.client.1.smithi073.stdout:9/730: link dc/d37/db5/dc1/lcc dc/de/lf3 0 2024-08-31T05:21:05.593 INFO:tasks.workunit.client.1.smithi073.stdout:2/592: chown d2/d9/d7f/dab/l9d 22269600 1 2024-08-31T05:21:05.595 INFO:tasks.workunit.client.1.smithi073.stdout:8/638: dwrite d0/db/d1c/d34/d38/f43 [0,4194304] 0 2024-08-31T05:21:05.608 INFO:tasks.workunit.client.1.smithi073.stdout:1/551: truncate d5/d17/d3f/f4e 9731446 0 2024-08-31T05:21:05.608 INFO:tasks.workunit.client.1.smithi073.stdout:0/599: dread d0/d15/d2c/d4d/d3c/f6 [0,4194304] 0 2024-08-31T05:21:05.610 INFO:tasks.workunit.client.1.smithi073.stdout:8/639: dwrite d0/db/d44/f70 [0,4194304] 0 2024-08-31T05:21:05.613 INFO:tasks.workunit.client.1.smithi073.stdout:9/731: dwrite dc/de/d56/f7d [0,4194304] 0 2024-08-31T05:21:05.614 INFO:tasks.workunit.client.1.smithi073.stdout:8/640: dread - d0/db/d1c/fb9 zero size 2024-08-31T05:21:05.614 INFO:tasks.workunit.client.1.smithi073.stdout:0/600: truncate d0/d58/d63/f7d 141287 0 2024-08-31T05:21:05.619 INFO:tasks.workunit.client.1.smithi073.stdout:8/641: mknod d0/d62/cc1 0 2024-08-31T05:21:05.620 INFO:tasks.workunit.client.1.smithi073.stdout:2/593: dread d2/d9/fa0 [0,4194304] 0 2024-08-31T05:21:05.621 INFO:tasks.workunit.client.1.smithi073.stdout:9/732: mknod dc/d37/d42/d8d/de8/cf4 0 2024-08-31T05:21:05.621 INFO:tasks.workunit.client.1.smithi073.stdout:6/614: truncate d15/d17/da1/dae/db0/d38/f5f 2103950 0 2024-08-31T05:21:05.623 INFO:tasks.workunit.client.1.smithi073.stdout:7/558: dwrite d1/da/d15/d33/f50 [0,4194304] 0 2024-08-31T05:21:05.624 INFO:tasks.workunit.client.1.smithi073.stdout:9/733: fdatasync dc/de/d11/fc8 0 2024-08-31T05:21:05.626 INFO:tasks.workunit.client.1.smithi073.stdout:0/601: rename d0/f76 to d0/d28/fc1 0 2024-08-31T05:21:05.629 INFO:tasks.workunit.client.1.smithi073.stdout:0/602: chown d0/d69/fa8 0 1 2024-08-31T05:21:05.629 INFO:tasks.workunit.client.1.smithi073.stdout:8/642: mknod d0/db/d44/d4e/cc2 0 2024-08-31T05:21:05.630 INFO:tasks.workunit.client.1.smithi073.stdout:3/677: write da/f2f [625871,114126] 0 2024-08-31T05:21:05.634 INFO:tasks.workunit.client.1.smithi073.stdout:8/643: readlink d0/db/d1c/d2a/lb1 0 2024-08-31T05:21:05.636 INFO:tasks.workunit.client.1.smithi073.stdout:5/808: getdents dc/d3d/dab/dff/d49/dd2 0 2024-08-31T05:21:05.638 INFO:tasks.workunit.client.1.smithi073.stdout:6/615: dwrite d15/d1a/d2b/d2f/d4b/d88/fbb [0,4194304] 0 2024-08-31T05:21:05.638 INFO:tasks.workunit.client.1.smithi073.stdout:7/559: dwrite d1/da/d3e/d22/f75 [0,4194304] 0 2024-08-31T05:21:05.639 INFO:tasks.workunit.client.1.smithi073.stdout:9/734: fsync dc/d37/d42/d8d/f57 0 2024-08-31T05:21:05.639 INFO:tasks.workunit.client.1.smithi073.stdout:6/616: readlink d15/d17/l53 0 2024-08-31T05:21:05.641 INFO:tasks.workunit.client.1.smithi073.stdout:7/560: dread - d1/da/d3e/d22/d47/da8/fbf zero size 2024-08-31T05:21:05.642 INFO:tasks.workunit.client.1.smithi073.stdout:6/617: chown d15/d1a/d1e/f37 0 1 2024-08-31T05:21:05.643 INFO:tasks.workunit.client.1.smithi073.stdout:9/735: chown dc/d37/d42/d8d/f74 2076639 1 2024-08-31T05:21:05.643 INFO:tasks.workunit.client.1.smithi073.stdout:3/678: dread da/d3c/f5e [0,4194304] 0 2024-08-31T05:21:05.645 INFO:tasks.workunit.client.1.smithi073.stdout:7/561: chown d1/da/d3e/d22/d47 80 1 2024-08-31T05:21:05.646 INFO:tasks.workunit.client.1.smithi073.stdout:7/562: stat d1/da/d3e/c54 0 2024-08-31T05:21:05.647 INFO:tasks.workunit.client.1.smithi073.stdout:5/809: dwrite dc/d53/f82 [0,4194304] 0 2024-08-31T05:21:05.653 INFO:tasks.workunit.client.1.smithi073.stdout:9/736: creat dc/de/d11/ff5 x:0 0 0 2024-08-31T05:21:05.654 INFO:tasks.workunit.client.1.smithi073.stdout:9/737: chown dc/l78 1402456 1 2024-08-31T05:21:05.655 INFO:tasks.workunit.client.1.smithi073.stdout:9/738: write dc/d27/fc7 [4956116,102819] 0 2024-08-31T05:21:05.655 INFO:tasks.workunit.client.1.smithi073.stdout:3/679: symlink da/d18/da2/daf/ldf 0 2024-08-31T05:21:05.661 INFO:tasks.workunit.client.1.smithi073.stdout:4/560: dread - d7/df/d13/d2e/d47/d4c/d73/f76 zero size 2024-08-31T05:21:05.661 INFO:tasks.workunit.client.1.smithi073.stdout:5/810: creat dc/d3d/dab/dff/dbd/f10a x:0 0 0 2024-08-31T05:21:05.662 INFO:tasks.workunit.client.1.smithi073.stdout:8/644: getdents d0/db/d1c/d34 0 2024-08-31T05:21:05.667 INFO:tasks.workunit.client.1.smithi073.stdout:3/680: dwrite da/d3c/d65/f3a [0,4194304] 0 2024-08-31T05:21:05.669 INFO:tasks.workunit.client.1.smithi073.stdout:8/645: dread d0/db/d1c/f3b [0,4194304] 0 2024-08-31T05:21:05.669 INFO:tasks.workunit.client.1.smithi073.stdout:9/739: link dc/d37/d42/d8d/d52/d5f/f91 dc/d37/d42/d5a/da0/dcd/ff6 0 2024-08-31T05:21:05.671 INFO:tasks.workunit.client.1.smithi073.stdout:2/594: dread d2/d25/f93 [0,4194304] 0 2024-08-31T05:21:05.673 INFO:tasks.workunit.client.1.smithi073.stdout:3/681: dread da/d3c/f71 [0,4194304] 0 2024-08-31T05:21:05.674 INFO:tasks.workunit.client.1.smithi073.stdout:4/561: rename d7/df/d1b/d34/f5f to d7/df/d1b/fa2 0 2024-08-31T05:21:05.674 INFO:tasks.workunit.client.1.smithi073.stdout:8/646: rmdir d0/db/d1c/d34 39 2024-08-31T05:21:05.676 INFO:tasks.workunit.client.1.smithi073.stdout:9/740: rename dc/de/d66/f83 to dc/d27/ddc/ff7 0 2024-08-31T05:21:05.676 INFO:tasks.workunit.client.1.smithi073.stdout:4/562: dread - d7/df/d13/d2e/d70/d6b/f8f zero size 2024-08-31T05:21:05.677 INFO:tasks.workunit.client.1.smithi073.stdout:2/595: mknod d2/d9/df/cc1 0 2024-08-31T05:21:05.677 INFO:tasks.workunit.client.1.smithi073.stdout:8/647: chown d0/db/d1c/d24/f48 6 1 2024-08-31T05:21:05.679 INFO:tasks.workunit.client.1.smithi073.stdout:9/741: write dc/d37/f5e [3044687,86654] 0 2024-08-31T05:21:05.683 INFO:tasks.workunit.client.1.smithi073.stdout:2/596: mknod d2/cc2 0 2024-08-31T05:21:05.683 INFO:tasks.workunit.client.1.smithi073.stdout:3/682: dwrite da/d3c/d65/d87/fd5 [0,4194304] 0 2024-08-31T05:21:05.685 INFO:tasks.workunit.client.1.smithi073.stdout:2/597: stat d2/d9/d7f/dab/d5d/lc0 0 2024-08-31T05:21:05.687 INFO:tasks.workunit.client.1.smithi073.stdout:1/552: dwrite d5/fc [4194304,4194304] 0 2024-08-31T05:21:05.687 INFO:tasks.workunit.client.1.smithi073.stdout:8/648: symlink d0/db/d1c/d24/d73/lc3 0 2024-08-31T05:21:05.688 INFO:tasks.workunit.client.1.smithi073.stdout:8/649: chown d0/db/d44/d9e/lbb 491 1 2024-08-31T05:21:05.690 INFO:tasks.workunit.client.1.smithi073.stdout:4/563: creat d7/df/d13/d2e/fa3 x:0 0 0 2024-08-31T05:21:05.694 INFO:tasks.workunit.client.1.smithi073.stdout:1/553: mkdir d5/d26/d54/d9e 0 2024-08-31T05:21:05.695 INFO:tasks.workunit.client.1.smithi073.stdout:1/554: stat d5/fc 0 2024-08-31T05:21:05.697 INFO:tasks.workunit.client.1.smithi073.stdout:9/742: creat dc/de/dd8/ff8 x:0 0 0 2024-08-31T05:21:05.699 INFO:tasks.workunit.client.1.smithi073.stdout:4/564: fdatasync d7/df/d13/d2e/f48 0 2024-08-31T05:21:05.699 INFO:tasks.workunit.client.1.smithi073.stdout:7/563: write d1/da/d3e/d22/d35/f9c [438662,59753] 0 2024-08-31T05:21:05.700 INFO:tasks.workunit.client.1.smithi073.stdout:7/564: chown d1/d11/d14/f29 11362412 1 2024-08-31T05:21:05.702 INFO:tasks.workunit.client.1.smithi073.stdout:1/555: mkdir d5/d17/d3f/d9f 0 2024-08-31T05:21:05.704 INFO:tasks.workunit.client.1.smithi073.stdout:8/650: symlink d0/db/d1c/d34/d80/d9a/lc4 0 2024-08-31T05:21:05.704 INFO:tasks.workunit.client.1.smithi073.stdout:4/565: symlink d7/d1a/d5c/d6d/d59/d86/la4 0 2024-08-31T05:21:05.706 INFO:tasks.workunit.client.1.smithi073.stdout:8/651: stat d0/db/d1c/d34/l6a 0 2024-08-31T05:21:05.707 INFO:tasks.workunit.client.1.smithi073.stdout:6/618: dwrite d15/d17/f3a [0,4194304] 0 2024-08-31T05:21:05.709 INFO:tasks.workunit.client.1.smithi073.stdout:6/619: stat d15/d1a/d2b/d2f 0 2024-08-31T05:21:05.714 INFO:tasks.workunit.client.1.smithi073.stdout:8/652: creat d0/db/fc5 x:0 0 0 2024-08-31T05:21:05.714 INFO:tasks.workunit.client.1.smithi073.stdout:2/598: getdents d2/d9/df 0 2024-08-31T05:21:05.715 INFO:tasks.workunit.client.1.smithi073.stdout:4/566: mknod d7/d1a/d5c/d6d/d59/d65/ca5 0 2024-08-31T05:21:05.716 INFO:tasks.workunit.client.1.smithi073.stdout:5/811: dwrite dc/d16/d3b/d3f/f9a [0,4194304] 0 2024-08-31T05:21:05.717 INFO:tasks.workunit.client.1.smithi073.stdout:8/653: stat d0/db/d1c/d2a/cbd 0 2024-08-31T05:21:05.717 INFO:tasks.workunit.client.1.smithi073.stdout:5/812: readlink dc/d3d/d55/lcb 0 2024-08-31T05:21:05.718 INFO:tasks.workunit.client.1.smithi073.stdout:9/743: getdents dc/d37/d42/d5a/dda 0 2024-08-31T05:21:05.720 INFO:tasks.workunit.client.1.smithi073.stdout:5/813: write dc/d3d/dab/dff/fa7 [4723764,78858] 0 2024-08-31T05:21:05.720 INFO:tasks.workunit.client.1.smithi073.stdout:6/620: mknod d15/d1a/d2b/d2f/d99/d9e/cc3 0 2024-08-31T05:21:05.722 INFO:tasks.workunit.client.1.smithi073.stdout:2/599: symlink d2/d9/df/lc3 0 2024-08-31T05:21:05.723 INFO:tasks.workunit.client.1.smithi073.stdout:4/567: mkdir d7/d1a/d5c/d6d/d2c/d2d/da6 0 2024-08-31T05:21:05.726 INFO:tasks.workunit.client.1.smithi073.stdout:1/556: getdents d5/d17/d32 0 2024-08-31T05:21:05.726 INFO:tasks.workunit.client.1.smithi073.stdout:4/568: write d7/df/d13/d2e/d47/d4c/d73/f87 [110574,36085] 0 2024-08-31T05:21:05.727 INFO:tasks.workunit.client.1.smithi073.stdout:0/603: truncate d0/d28/f2d 7312871 0 2024-08-31T05:21:05.729 INFO:tasks.workunit.client.1.smithi073.stdout:3/683: dread da/d3c/f60 [0,4194304] 0 2024-08-31T05:21:05.730 INFO:tasks.workunit.client.1.smithi073.stdout:4/569: chown d7/df/d13/d2e/fa3 247955798 1 2024-08-31T05:21:05.731 INFO:tasks.workunit.client.1.smithi073.stdout:7/565: dread d1/da/d15/d33/f42 [0,4194304] 0 2024-08-31T05:21:05.732 INFO:tasks.workunit.client.1.smithi073.stdout:2/600: dwrite d2/d9/d3c/f57 [0,4194304] 0 2024-08-31T05:21:05.732 INFO:tasks.workunit.client.1.smithi073.stdout:8/654: creat d0/da8/fc6 x:0 0 0 2024-08-31T05:21:05.732 INFO:tasks.workunit.client.1.smithi073.stdout:3/684: read - da/d3c/d67/db7/fc6 zero size 2024-08-31T05:21:05.734 INFO:tasks.workunit.client.1.smithi073.stdout:4/570: truncate d7/d1a/f29 4896131 0 2024-08-31T05:21:05.736 INFO:tasks.workunit.client.1.smithi073.stdout:0/604: creat d0/d15/d2c/d40/d4a/d6b/fc2 x:0 0 0 2024-08-31T05:21:05.738 INFO:tasks.workunit.client.1.smithi073.stdout:6/621: link d15/d1a/d2b/d2f/f3f d15/d17/da1/dae/db0/d38/d9b/fc4 0 2024-08-31T05:21:05.739 INFO:tasks.workunit.client.1.smithi073.stdout:5/814: fsync dc/d3d/dab/dff/fa7 0 2024-08-31T05:21:05.739 INFO:tasks.workunit.client.1.smithi073.stdout:6/622: write d15/d1a/d51/d61/f80 [1486134,123570] 0 2024-08-31T05:21:05.744 INFO:tasks.workunit.client.1.smithi073.stdout:0/605: creat d0/d69/d8e/fc3 x:0 0 0 2024-08-31T05:21:05.744 INFO:tasks.workunit.client.1.smithi073.stdout:3/685: dread da/d68/f6b [0,4194304] 0 2024-08-31T05:21:05.746 INFO:tasks.workunit.client.1.smithi073.stdout:5/815: dread dc/d16/ff5 [0,4194304] 0 2024-08-31T05:21:05.748 INFO:tasks.workunit.client.1.smithi073.stdout:8/655: symlink d0/db/d1c/d24/d73/db0/lc7 0 2024-08-31T05:21:05.750 INFO:tasks.workunit.client.1.smithi073.stdout:6/623: dwrite d15/d1a/d2b/d2f/f30 [0,4194304] 0 2024-08-31T05:21:05.752 INFO:tasks.workunit.client.1.smithi073.stdout:1/557: getdents d5/d10 0 2024-08-31T05:21:05.753 INFO:tasks.workunit.client.1.smithi073.stdout:9/744: dwrite dc/d37/d42/f64 [0,4194304] 0 2024-08-31T05:21:05.753 INFO:tasks.workunit.client.1.smithi073.stdout:0/606: mknod d0/d15/d2c/d40/cc4 0 2024-08-31T05:21:05.755 INFO:tasks.workunit.client.1.smithi073.stdout:9/745: chown dc/d37/d42 0 1 2024-08-31T05:21:05.756 INFO:tasks.workunit.client.1.smithi073.stdout:5/816: chown dc/cd 1 1 2024-08-31T05:21:05.757 INFO:tasks.workunit.client.1.smithi073.stdout:0/607: stat d0/d69/d7f/f97 0 2024-08-31T05:21:05.757 INFO:tasks.workunit.client.1.smithi073.stdout:3/686: creat da/d3c/d65/d40/fe0 x:0 0 0 2024-08-31T05:21:05.757 INFO:tasks.workunit.client.1.smithi073.stdout:1/558: read d5/d17/d32/d37/f3c [3101428,13188] 0 2024-08-31T05:21:05.758 INFO:tasks.workunit.client.1.smithi073.stdout:7/566: write d1/da/d65/f7e [4789873,42442] 0 2024-08-31T05:21:05.759 INFO:tasks.workunit.client.1.smithi073.stdout:2/601: dread d2/f35 [0,4194304] 0 2024-08-31T05:21:05.759 INFO:tasks.workunit.client.1.smithi073.stdout:4/571: getdents d7/d1a/d5c/d6d/d2c 0 2024-08-31T05:21:05.762 INFO:tasks.workunit.client.1.smithi073.stdout:7/567: chown d1/da/d65/cae 6 1 2024-08-31T05:21:05.762 INFO:tasks.workunit.client.1.smithi073.stdout:4/572: write d7/db/f69 [1590473,43279] 0 2024-08-31T05:21:05.764 INFO:tasks.workunit.client.1.smithi073.stdout:9/746: mkdir dc/d82/df9 0 2024-08-31T05:21:05.764 INFO:tasks.workunit.client.1.smithi073.stdout:7/568: write d1/d11/d14/f5b [984002,123295] 0 2024-08-31T05:21:05.764 INFO:tasks.workunit.client.1.smithi073.stdout:9/747: stat dc/d10 0 2024-08-31T05:21:05.764 INFO:tasks.workunit.client.1.smithi073.stdout:0/608: creat d0/d15/d9b/fc5 x:0 0 0 2024-08-31T05:21:05.765 INFO:tasks.workunit.client.1.smithi073.stdout:7/569: truncate d1/f43 5080506 0 2024-08-31T05:21:05.769 INFO:tasks.workunit.client.1.smithi073.stdout:2/602: readlink d2/d9/df/d36/l60 0 2024-08-31T05:21:05.770 INFO:tasks.workunit.client.1.smithi073.stdout:2/603: chown d2/d9/d27/d9b/l9e 11265 1 2024-08-31T05:21:05.771 INFO:tasks.workunit.client.1.smithi073.stdout:0/609: dwrite d0/d69/d8e/d99/fa9 [0,4194304] 0 2024-08-31T05:21:05.774 INFO:tasks.workunit.client.1.smithi073.stdout:3/687: truncate da/d3c/d82/fc9 583690 0 2024-08-31T05:21:05.775 INFO:tasks.workunit.client.1.smithi073.stdout:5/817: mknod dc/d3d/c10b 0 2024-08-31T05:21:05.775 INFO:tasks.workunit.client.1.smithi073.stdout:8/656: dread d0/db/d44/f77 [0,4194304] 0 2024-08-31T05:21:05.775 INFO:tasks.workunit.client.1.smithi073.stdout:4/573: mknod d7/df/d13/ca7 0 2024-08-31T05:21:05.776 INFO:tasks.workunit.client.1.smithi073.stdout:9/748: unlink dc/d37/d42/d8d/d52/d5f/lb9 0 2024-08-31T05:21:05.777 INFO:tasks.workunit.client.1.smithi073.stdout:7/570: write d1/da/f26 [53557,34933] 0 2024-08-31T05:21:05.778 INFO:tasks.workunit.client.1.smithi073.stdout:7/571: readlink d1/d11/d91/laa 0 2024-08-31T05:21:05.779 INFO:tasks.workunit.client.1.smithi073.stdout:1/559: unlink d5/d17/d2a/d80/c91 0 2024-08-31T05:21:05.779 INFO:tasks.workunit.client.1.smithi073.stdout:7/572: write d1/da/d3e/d22/d5c/f8b [3895098,101421] 0 2024-08-31T05:21:05.780 INFO:tasks.workunit.client.1.smithi073.stdout:1/560: chown d5/d26/d54/d5f/f7c 1 1 2024-08-31T05:21:05.781 INFO:tasks.workunit.client.1.smithi073.stdout:6/624: rename d15/d1a/d1e/d69/d7e/f90 to d15/d1a/d2b/d2f/fc5 0 2024-08-31T05:21:05.783 INFO:tasks.workunit.client.1.smithi073.stdout:1/561: truncate d5/d17/d32/f3d 1873 0 2024-08-31T05:21:05.783 INFO:tasks.workunit.client.1.smithi073.stdout:0/610: chown d0/d89/c8c 63 1 2024-08-31T05:21:05.785 INFO:tasks.workunit.client.1.smithi073.stdout:2/604: dread d2/d9/d7f/dab/d5d/f71 [0,4194304] 0 2024-08-31T05:21:05.786 INFO:tasks.workunit.client.1.smithi073.stdout:3/688: symlink da/d3c/dda/le1 0 2024-08-31T05:21:05.787 INFO:tasks.workunit.client.1.smithi073.stdout:9/749: write dc/f25 [7649359,78299] 0 2024-08-31T05:21:05.789 INFO:tasks.workunit.client.1.smithi073.stdout:2/605: stat d2/d9/d27/d76/d7e/db4 0 2024-08-31T05:21:05.790 INFO:tasks.workunit.client.1.smithi073.stdout:3/689: write da/d18/f4d [1280692,130266] 0 2024-08-31T05:21:05.792 INFO:tasks.workunit.client.1.smithi073.stdout:4/574: creat d7/fa8 x:0 0 0 2024-08-31T05:21:05.792 INFO:tasks.workunit.client.1.smithi073.stdout:8/657: link d0/db/d1c/c4f d0/db/d44/d9e/cc8 0 2024-08-31T05:21:05.793 INFO:tasks.workunit.client.1.smithi073.stdout:7/573: dwrite d1/da/d65/f86 [0,4194304] 0 2024-08-31T05:21:05.793 INFO:tasks.workunit.client.1.smithi073.stdout:5/818: dread dc/d16/ff5 [0,4194304] 0 2024-08-31T05:21:05.793 INFO:tasks.workunit.client.1.smithi073.stdout:9/750: write dc/de/d11/d85/fe7 [6486,84398] 0 2024-08-31T05:21:05.794 INFO:tasks.workunit.client.1.smithi073.stdout:3/690: rmdir da 39 2024-08-31T05:21:05.794 INFO:tasks.workunit.client.1.smithi073.stdout:2/606: dread - d2/d9/d27/d9b/da7/fad zero size 2024-08-31T05:21:05.796 INFO:tasks.workunit.client.1.smithi073.stdout:0/611: mkdir d0/d15/d2c/d4d/d3c/d9c/db6/dc6 0 2024-08-31T05:21:05.796 INFO:tasks.workunit.client.1.smithi073.stdout:7/574: chown d1/da/d3e/c54 142931 1 2024-08-31T05:21:05.797 INFO:tasks.workunit.client.1.smithi073.stdout:5/819: stat dc/d16/f7e 0 2024-08-31T05:21:05.799 INFO:tasks.workunit.client.1.smithi073.stdout:7/575: mkdir d1/dc0 0 2024-08-31T05:21:05.801 INFO:tasks.workunit.client.1.smithi073.stdout:0/612: fdatasync d0/f5b 0 2024-08-31T05:21:05.803 INFO:tasks.workunit.client.1.smithi073.stdout:9/751: rename dc/de/d11/fa6 to dc/d82/de4/ffa 0 2024-08-31T05:21:05.803 INFO:tasks.workunit.client.1.smithi073.stdout:9/752: chown dc/c95 130042658 1 2024-08-31T05:21:05.806 INFO:tasks.workunit.client.1.smithi073.stdout:5/820: creat dc/d16/d3b/dc6/f10c x:0 0 0 2024-08-31T05:21:05.807 INFO:tasks.workunit.client.1.smithi073.stdout:5/821: stat dc/d3d/dab/dff/c31 0 2024-08-31T05:21:05.809 INFO:tasks.workunit.client.1.smithi073.stdout:3/691: mkdir da/d3c/d65/d2c/d8e/de2 0 2024-08-31T05:21:05.810 INFO:tasks.workunit.client.1.smithi073.stdout:3/692: dread - da/d3c/d65/d2c/d8e/f9c zero size 2024-08-31T05:21:05.811 INFO:tasks.workunit.client.1.smithi073.stdout:3/693: stat da/d3c/d65/d40/f57 0 2024-08-31T05:21:05.811 INFO:tasks.workunit.client.1.smithi073.stdout:0/613: write d0/d15/d2c/d40/d4a/f4b [3048977,71989] 0 2024-08-31T05:21:05.812 INFO:tasks.workunit.client.1.smithi073.stdout:9/753: mknod dc/de/d11/d85/cfb 0 2024-08-31T05:21:05.814 INFO:tasks.workunit.client.1.smithi073.stdout:4/575: getdents d7 0 2024-08-31T05:21:05.817 INFO:tasks.workunit.client.1.smithi073.stdout:1/562: dread d5/d10/f6e [0,4194304] 0 2024-08-31T05:21:05.819 INFO:tasks.workunit.client.1.smithi073.stdout:0/614: mkdir d0/d58/dc7 0 2024-08-31T05:21:05.820 INFO:tasks.workunit.client.1.smithi073.stdout:5/822: write dc/d3d/fd0 [4051957,1354] 0 2024-08-31T05:21:05.821 INFO:tasks.workunit.client.1.smithi073.stdout:8/658: truncate d0/db/d1c/d24/faa 345538 0 2024-08-31T05:21:05.826 INFO:tasks.workunit.client.1.smithi073.stdout:2/607: dread d2/d9/df/f2e [0,4194304] 0 2024-08-31T05:21:05.829 INFO:tasks.workunit.client.1.smithi073.stdout:0/615: write d0/d69/d8e/f3f [1741892,27340] 0 2024-08-31T05:21:05.834 INFO:tasks.workunit.client.1.smithi073.stdout:6/625: dwrite d15/d17/da1/dae/db0/d38/f5f [0,4194304] 0 2024-08-31T05:21:05.835 INFO:tasks.workunit.client.1.smithi073.stdout:3/694: dwrite da/d68/f99 [0,4194304] 0 2024-08-31T05:21:05.835 INFO:tasks.workunit.client.1.smithi073.stdout:2/608: chown d2/d25/l95 6 1 2024-08-31T05:21:05.875 INFO:tasks.workunit.client.1.smithi073.stdout:9/754: dwrite dc/d10/f53 [4194304,4194304] 0 2024-08-31T05:21:05.877 INFO:tasks.workunit.client.1.smithi073.stdout:7/576: dwrite d1/da/f72 [0,4194304] 0 2024-08-31T05:21:05.879 INFO:tasks.workunit.client.1.smithi073.stdout:4/576: dwrite d7/db/f69 [0,4194304] 0 2024-08-31T05:21:05.879 INFO:tasks.workunit.client.1.smithi073.stdout:3/695: write da/f29 [4036165,51449] 0 2024-08-31T05:21:05.879 INFO:tasks.workunit.client.1.smithi073.stdout:2/609: readlink d2/d9/df/d36/lb1 0 2024-08-31T05:21:05.880 INFO:tasks.workunit.client.1.smithi073.stdout:8/659: rename d0/db/d1c/d34/f95 to d0/db/d1c/d23/fc9 0 2024-08-31T05:21:05.882 INFO:tasks.workunit.client.1.smithi073.stdout:0/616: mkdir d0/d15/d2c/d4d/d3c/d9c/dc8 0 2024-08-31T05:21:05.884 INFO:tasks.workunit.client.1.smithi073.stdout:9/755: symlink dc/de/d11/lfc 0 2024-08-31T05:21:05.884 INFO:tasks.workunit.client.1.smithi073.stdout:7/577: fsync d1/da/d15/d33/d44/d60/f7d 0 2024-08-31T05:21:05.886 INFO:tasks.workunit.client.1.smithi073.stdout:5/823: dread f9 [0,4194304] 0 2024-08-31T05:21:05.886 INFO:tasks.workunit.client.1.smithi073.stdout:4/577: mkdir d7/df/da9 0 2024-08-31T05:21:05.888 INFO:tasks.workunit.client.1.smithi073.stdout:3/696: creat da/d3c/dda/fe3 x:0 0 0 2024-08-31T05:21:05.890 INFO:tasks.workunit.client.1.smithi073.stdout:8/660: mknod d0/db/d1c/cca 0 2024-08-31T05:21:05.891 INFO:tasks.workunit.client.1.smithi073.stdout:8/661: fdatasync d0/d62/fab 0 2024-08-31T05:21:05.892 INFO:tasks.workunit.client.1.smithi073.stdout:2/610: unlink d2/d9/d7f/dab/d5d/f7c 0 2024-08-31T05:21:05.893 INFO:tasks.workunit.client.1.smithi073.stdout:0/617: dwrite d0/f1e [0,4194304] 0 2024-08-31T05:21:05.894 INFO:tasks.workunit.client.1.smithi073.stdout:6/626: link d15/d1a/d1e/d69/d7e/f8e d15/d1a/d2b/d2f/d99/db3/fc6 0 2024-08-31T05:21:05.896 INFO:tasks.workunit.client.1.smithi073.stdout:5/824: mknod dc/d16/d1a/d87/d94/c10d 0 2024-08-31T05:21:05.899 INFO:tasks.workunit.client.1.smithi073.stdout:4/578: creat d7/df/d79/d7a/faa x:0 0 0 2024-08-31T05:21:05.905 INFO:tasks.workunit.client.1.smithi073.stdout:7/578: dwrite d1/d11/f97 [0,4194304] 0 2024-08-31T05:21:05.912 INFO:tasks.workunit.client.1.smithi073.stdout:6/627: dwrite d15/d41/f6f [0,4194304] 0 2024-08-31T05:21:05.915 INFO:tasks.workunit.client.1.smithi073.stdout:2/611: write d2/d9/f24 [2209727,103139] 0 2024-08-31T05:21:05.916 INFO:tasks.workunit.client.1.smithi073.stdout:5/825: dwrite dc/d3d/d55/fed [0,4194304] 0 2024-08-31T05:21:05.916 INFO:tasks.workunit.client.1.smithi073.stdout:9/756: dread dc/d37/d42/d5a/d89/fa7 [0,4194304] 0 2024-08-31T05:21:05.917 INFO:tasks.workunit.client.1.smithi073.stdout:0/618: chown d0/d15/d2c/d41/d52/f8b 0 1 2024-08-31T05:21:05.917 INFO:tasks.workunit.client.1.smithi073.stdout:4/579: mknod d7/df/cab 0 2024-08-31T05:21:05.919 INFO:tasks.workunit.client.1.smithi073.stdout:6/628: read d15/d17/f3a [2467669,97749] 0 2024-08-31T05:21:05.923 INFO:tasks.workunit.client.1.smithi073.stdout:7/579: dwrite d1/da/d15/f24 [0,4194304] 0 2024-08-31T05:21:05.924 INFO:tasks.workunit.client.1.smithi073.stdout:3/697: dwrite da/f17 [0,4194304] 0 2024-08-31T05:21:05.929 INFO:tasks.workunit.client.1.smithi073.stdout:8/662: dread d0/db/d1c/d34/d38/f42 [0,4194304] 0 2024-08-31T05:21:05.930 INFO:tasks.workunit.client.1.smithi073.stdout:3/698: chown da/d3c/d65/d40/c4b 4 1 2024-08-31T05:21:05.932 INFO:tasks.workunit.client.1.smithi073.stdout:5/826: creat dc/d3d/dab/f10e x:0 0 0 2024-08-31T05:21:05.933 INFO:tasks.workunit.client.1.smithi073.stdout:3/699: write da/f62 [1450946,66648] 0 2024-08-31T05:21:05.934 INFO:tasks.workunit.client.1.smithi073.stdout:0/619: creat d0/d28/d4f/fc9 x:0 0 0 2024-08-31T05:21:05.937 INFO:tasks.workunit.client.1.smithi073.stdout:9/757: fsync dc/d27/ddc/ff7 0 2024-08-31T05:21:05.938 INFO:tasks.workunit.client.1.smithi073.stdout:3/700: chown da/d3c/d65/d40/fa4 35 1 2024-08-31T05:21:05.939 INFO:tasks.workunit.client.1.smithi073.stdout:2/612: mkdir d2/d9/d7f/dab/dc4 0 2024-08-31T05:21:05.940 INFO:tasks.workunit.client.1.smithi073.stdout:9/758: chown dc/de/c16 1283561 1 2024-08-31T05:21:05.940 INFO:tasks.workunit.client.1.smithi073.stdout:4/580: dwrite d7/df/d13/f2b [0,4194304] 0 2024-08-31T05:21:05.942 INFO:tasks.workunit.client.1.smithi073.stdout:0/620: unlink d0/d15/d2c/d4d/lbe 0 2024-08-31T05:21:05.943 INFO:tasks.workunit.client.1.smithi073.stdout:6/629: creat d15/d17/da1/dae/db0/fc7 x:0 0 0 2024-08-31T05:21:05.944 INFO:tasks.workunit.client.1.smithi073.stdout:3/701: creat da/d3c/d65/d40/d5d/fe4 x:0 0 0 2024-08-31T05:21:05.945 INFO:tasks.workunit.client.1.smithi073.stdout:2/613: rmdir d2/d9/d27/d9b/da7 39 2024-08-31T05:21:05.946 INFO:tasks.workunit.client.1.smithi073.stdout:4/581: creat d7/df/d79/fac x:0 0 0 2024-08-31T05:21:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:05 smithi073 ceph-mon[24726]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:05.947 INFO:tasks.workunit.client.1.smithi073.stdout:6/630: write d15/d17/da1/dae/db0/d38/f98 [186953,91975] 0 2024-08-31T05:21:05.947 INFO:tasks.workunit.client.1.smithi073.stdout:9/759: creat dc/de/d66/d84/ffd x:0 0 0 2024-08-31T05:21:05.947 INFO:tasks.workunit.client.1.smithi073.stdout:3/702: creat da/d3c/d65/d45/fe5 x:0 0 0 2024-08-31T05:21:05.948 INFO:tasks.workunit.client.1.smithi073.stdout:9/760: readlink dc/de/d66/d84/l88 0 2024-08-31T05:21:05.953 INFO:tasks.workunit.client.1.smithi073.stdout:8/663: link d0/db/d1c/c4f d0/db/d1c/d34/d68/d9d/ccb 0 2024-08-31T05:21:05.954 INFO:tasks.workunit.client.1.smithi073.stdout:4/582: mknod d7/df/d1b/d34/cad 0 2024-08-31T05:21:05.954 INFO:tasks.workunit.client.1.smithi073.stdout:6/631: dwrite d15/d17/f5c [0,4194304] 0 2024-08-31T05:21:05.957 INFO:tasks.workunit.client.1.smithi073.stdout:3/703: rename da/cbd to da/d3c/d65/ce6 0 2024-08-31T05:21:05.960 INFO:tasks.workunit.client.1.smithi073.stdout:4/583: symlink d7/df/d13/d53/lae 0 2024-08-31T05:21:05.963 INFO:tasks.workunit.client.1.smithi073.stdout:3/704: rename da/d68/c6e to da/d3c/d5a/ce7 0 2024-08-31T05:21:05.964 INFO:tasks.workunit.client.1.smithi073.stdout:4/584: fdatasync d7/d1a/d5c/d6d/d59/f74 0 2024-08-31T05:21:05.965 INFO:tasks.workunit.client.1.smithi073.stdout:7/580: dread d1/d11/d14/f29 [0,4194304] 0 2024-08-31T05:21:05.965 INFO:tasks.workunit.client.1.smithi073.stdout:6/632: dwrite d15/d17/f5c [0,4194304] 0 2024-08-31T05:21:05.966 INFO:tasks.workunit.client.1.smithi073.stdout:1/563: sync 2024-08-31T05:21:05.968 INFO:tasks.workunit.client.1.smithi073.stdout:6/633: readlink d15/d17/l53 0 2024-08-31T05:21:05.969 INFO:tasks.workunit.client.1.smithi073.stdout:8/664: dwrite d0/db/d1c/d34/d38/f42 [0,4194304] 0 2024-08-31T05:21:05.972 INFO:tasks.workunit.client.1.smithi073.stdout:1/564: write d5/d26/d54/f6c [1455356,70325] 0 2024-08-31T05:21:05.974 INFO:tasks.workunit.client.1.smithi073.stdout:6/634: mkdir d15/d75/dc8 0 2024-08-31T05:21:05.980 INFO:tasks.workunit.client.1.smithi073.stdout:8/665: rename d0/db/d1c/d24/f32 to d0/db/d1c/d24/d73/fcc 0 2024-08-31T05:21:05.980 INFO:tasks.workunit.client.1.smithi073.stdout:1/565: dread d5/d17/d32/d37/f8a [0,4194304] 0 2024-08-31T05:21:05.980 INFO:tasks.workunit.client.1.smithi073.stdout:5/827: dread dc/d16/f96 [0,4194304] 0 2024-08-31T05:21:05.982 INFO:tasks.workunit.client.1.smithi073.stdout:4/585: dwrite d7/d1a/d5c/d6d/f6e [0,4194304] 0 2024-08-31T05:21:05.982 INFO:tasks.workunit.client.1.smithi073.stdout:7/581: dwrite d1/da/d15/d33/d44/d74/fb4 [0,4194304] 0 2024-08-31T05:21:05.983 INFO:tasks.workunit.client.1.smithi073.stdout:8/666: write d0/db/d44/f84 [556759,57734] 0 2024-08-31T05:21:05.987 INFO:tasks.workunit.client.1.smithi073.stdout:0/621: truncate d0/d15/d2c/d41/d52/f8b 1612848 0 2024-08-31T05:21:05.989 INFO:tasks.workunit.client.1.smithi073.stdout:8/667: unlink d0/db/c16 0 2024-08-31T05:21:05.992 INFO:tasks.workunit.client.1.smithi073.stdout:8/668: fdatasync d0/db/d1c/fb9 0 2024-08-31T05:21:05.992 INFO:tasks.workunit.client.1.smithi073.stdout:7/582: creat d1/da/d3e/d22/d35/d83/fc1 x:0 0 0 2024-08-31T05:21:05.994 INFO:tasks.workunit.client.1.smithi073.stdout:0/622: rmdir d0/d89 39 2024-08-31T05:21:05.994 INFO:tasks.workunit.client.1.smithi073.stdout:5/828: dwrite dc/d3d/dab/fdc [0,4194304] 0 2024-08-31T05:21:05.998 INFO:tasks.workunit.client.1.smithi073.stdout:4/586: rename d7/df/d13/d53/d8b/f99 to d7/df/d79/faf 0 2024-08-31T05:21:05.999 INFO:tasks.workunit.client.1.smithi073.stdout:1/566: dwrite d5/d10/f6e [4194304,4194304] 0 2024-08-31T05:21:06.001 INFO:tasks.workunit.client.1.smithi073.stdout:7/583: read d1/da/d15/d33/d44/f66 [46521,74546] 0 2024-08-31T05:21:06.002 INFO:tasks.workunit.client.1.smithi073.stdout:7/584: stat d1/da/db2 0 2024-08-31T05:21:06.004 INFO:tasks.workunit.client.1.smithi073.stdout:1/567: truncate d5/d10/d1c/d27/f75 824191 0 2024-08-31T05:21:06.006 INFO:tasks.workunit.client.1.smithi073.stdout:0/623: mknod d0/d28/cca 0 2024-08-31T05:21:06.007 INFO:tasks.workunit.client.1.smithi073.stdout:8/669: link d0/db/d1c/d34/d38/f8b d0/db/d1c/d24/d73/fcd 0 2024-08-31T05:21:06.008 INFO:tasks.workunit.client.1.smithi073.stdout:8/670: chown d0/db/d1c/d34/l6a 19486 1 2024-08-31T05:21:06.008 INFO:tasks.workunit.client.1.smithi073.stdout:7/585: symlink d1/da/d3e/d22/lc2 0 2024-08-31T05:21:06.009 INFO:tasks.workunit.client.1.smithi073.stdout:1/568: write d5/d10/d1c/f50 [448211,67952] 0 2024-08-31T05:21:06.011 INFO:tasks.workunit.client.1.smithi073.stdout:0/624: creat d0/d15/d2c/d4d/d3c/d9c/db6/fcb x:0 0 0 2024-08-31T05:21:06.011 INFO:tasks.workunit.client.1.smithi073.stdout:1/569: write d5/f25 [5441418,79818] 0 2024-08-31T05:21:06.013 INFO:tasks.workunit.client.1.smithi073.stdout:0/625: dread d0/d69/d8e/f57 [0,4194304] 0 2024-08-31T05:21:06.015 INFO:tasks.workunit.client.1.smithi073.stdout:1/570: truncate d5/f6 1186652 0 2024-08-31T05:21:06.016 INFO:tasks.workunit.client.1.smithi073.stdout:1/571: write d5/d17/f81 [1006693,36578] 0 2024-08-31T05:21:06.017 INFO:tasks.workunit.client.1.smithi073.stdout:0/626: write d0/d69/d8e/f57 [595380,22671] 0 2024-08-31T05:21:06.019 INFO:tasks.workunit.client.1.smithi073.stdout:1/572: creat d5/d26/d54/d5f/fa0 x:0 0 0 2024-08-31T05:21:06.020 INFO:tasks.workunit.client.1.smithi073.stdout:6/635: dread d15/d17/da1/dae/db0/d38/d9b/fc4 [4194304,4194304] 0 2024-08-31T05:21:06.021 INFO:tasks.workunit.client.1.smithi073.stdout:0/627: truncate d0/d15/d2c/d40/d4a/f87 585322 0 2024-08-31T05:21:06.021 INFO:tasks.workunit.client.1.smithi073.stdout:1/573: write d5/d10/d1b/f63 [928471,79923] 0 2024-08-31T05:21:06.023 INFO:tasks.workunit.client.1.smithi073.stdout:1/574: chown d5/d17/d5d/d61/c9d 0 1 2024-08-31T05:21:06.025 INFO:tasks.workunit.client.1.smithi073.stdout:1/575: rmdir d5/d10/d1c 39 2024-08-31T05:21:06.029 INFO:tasks.workunit.client.1.smithi073.stdout:4/587: dread d7/db/f4f [0,4194304] 0 2024-08-31T05:21:06.030 INFO:tasks.workunit.client.1.smithi073.stdout:1/576: write d5/d10/d33/fe [625711,125120] 0 2024-08-31T05:21:06.033 INFO:tasks.workunit.client.1.smithi073.stdout:4/588: creat d7/df/d13/d53/d88/d9d/fb0 x:0 0 0 2024-08-31T05:21:06.034 INFO:tasks.workunit.client.1.smithi073.stdout:5/829: truncate dc/d16/d1a/d87/fa8 349109 0 2024-08-31T05:21:06.036 INFO:tasks.workunit.client.1.smithi073.stdout:7/586: truncate d1/da/d15/f24 4131285 0 2024-08-31T05:21:06.036 INFO:tasks.workunit.client.1.smithi073.stdout:5/830: dread - dc/d3d/dab/dff/dbd/ff1 zero size 2024-08-31T05:21:06.037 INFO:tasks.workunit.client.1.smithi073.stdout:1/577: dwrite d5/d26/d54/d5f/fa0 [0,4194304] 0 2024-08-31T05:21:06.039 INFO:tasks.workunit.client.1.smithi073.stdout:0/628: truncate d0/d69/d8e/f38 2230149 0 2024-08-31T05:21:06.039 INFO:tasks.workunit.client.1.smithi073.stdout:1/578: stat d5/d17/d5d 0 2024-08-31T05:21:06.041 INFO:tasks.workunit.client.1.smithi073.stdout:5/831: dread - dc/d3d/dab/dff/dbd/ff1 zero size 2024-08-31T05:21:06.042 INFO:tasks.workunit.client.1.smithi073.stdout:1/579: stat d5/d17/d2a 0 2024-08-31T05:21:06.042 INFO:tasks.workunit.client.1.smithi073.stdout:6/636: truncate d15/d1a/d2b/d2f/d4b/d88/fbb 1830170 0 2024-08-31T05:21:06.044 INFO:tasks.workunit.client.1.smithi073.stdout:4/589: dwrite d7/df/d79/d7a/faa [0,4194304] 0 2024-08-31T05:21:06.051 INFO:tasks.workunit.client.1.smithi073.stdout:5/832: symlink dc/d3d/dab/l10f 0 2024-08-31T05:21:06.053 INFO:tasks.workunit.client.1.smithi073.stdout:4/590: write d7/df/d13/f2b [4435440,115283] 0 2024-08-31T05:21:06.056 INFO:tasks.workunit.client.1.smithi073.stdout:7/587: dwrite d1/d11/f97 [0,4194304] 0 2024-08-31T05:21:06.056 INFO:tasks.workunit.client.1.smithi073.stdout:0/629: dwrite d0/d15/d2c/d41/faf [0,4194304] 0 2024-08-31T05:21:06.058 INFO:tasks.workunit.client.1.smithi073.stdout:1/580: rename d5/d10/c86 to d5/d17/d5d/d61/ca1 0 2024-08-31T05:21:06.059 INFO:tasks.workunit.client.1.smithi073.stdout:4/591: unlink d7/df/d13/c91 0 2024-08-31T05:21:06.060 INFO:tasks.workunit.client.1.smithi073.stdout:0/630: truncate d0/d15/d2c/d40/d4a/f87 1561633 0 2024-08-31T05:21:06.061 INFO:tasks.workunit.client.1.smithi073.stdout:1/581: write d5/d17/f57 [1115488,26448] 0 2024-08-31T05:21:06.061 INFO:tasks.workunit.client.1.smithi073.stdout:6/637: getdents d15/d75 0 2024-08-31T05:21:06.063 INFO:tasks.workunit.client.1.smithi073.stdout:7/588: creat d1/da/d65/fc3 x:0 0 0 2024-08-31T05:21:06.063 INFO:tasks.workunit.client.1.smithi073.stdout:4/592: chown d7/d1a/d5c/d6d/d59/d65/c97 38435114 1 2024-08-31T05:21:06.064 INFO:tasks.workunit.client.1.smithi073.stdout:4/593: fsync d7/db/f4e 0 2024-08-31T05:21:06.066 INFO:tasks.workunit.client.1.smithi073.stdout:5/833: rename dc/d16/d1a/db7/dc1/fd9 to dc/d3d/dab/dff/d49/dd2/f110 0 2024-08-31T05:21:06.066 INFO:tasks.workunit.client.1.smithi073.stdout:5/834: stat dc/d16/l83 0 2024-08-31T05:21:06.068 INFO:tasks.workunit.client.1.smithi073.stdout:1/582: mknod d5/d17/d3f/ca2 0 2024-08-31T05:21:06.070 INFO:tasks.workunit.client.1.smithi073.stdout:6/638: symlink d15/d1a/d2b/d2f/d4b/d97/lc9 0 2024-08-31T05:21:06.070 INFO:tasks.workunit.client.1.smithi073.stdout:0/631: symlink d0/d69/d8e/d99/lcc 0 2024-08-31T05:21:06.072 INFO:tasks.workunit.client.1.smithi073.stdout:4/594: creat d7/d1a/d5c/d6d/d59/fb1 x:0 0 0 2024-08-31T05:21:06.074 INFO:tasks.workunit.client.1.smithi073.stdout:6/639: mknod d15/d41/d89/cca 0 2024-08-31T05:21:06.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:05 smithi067 ceph-mon[17432]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:06.074 INFO:tasks.workunit.client.1.smithi073.stdout:0/632: mkdir d0/d69/d7f/d68/d91/dcd 0 2024-08-31T05:21:06.075 INFO:tasks.workunit.client.1.smithi073.stdout:4/595: mkdir d7/df/d13/db2 0 2024-08-31T05:21:06.076 INFO:tasks.workunit.client.1.smithi073.stdout:1/583: symlink d5/d10/d33/la3 0 2024-08-31T05:21:06.079 INFO:tasks.workunit.client.1.smithi073.stdout:0/633: creat d0/d28/fce x:0 0 0 2024-08-31T05:21:06.080 INFO:tasks.workunit.client.1.smithi073.stdout:1/584: read d5/d17/d2a/d80/f44 [1775598,53046] 0 2024-08-31T05:21:06.081 INFO:tasks.workunit.client.1.smithi073.stdout:6/640: dwrite d15/d1a/d51/d61/d7c/da6/fa8 [0,4194304] 0 2024-08-31T05:21:06.082 INFO:tasks.workunit.client.1.smithi073.stdout:1/585: write d5/d10/f28 [361114,105410] 0 2024-08-31T05:21:06.082 INFO:tasks.workunit.client.1.smithi073.stdout:0/634: chown d0/d15/d2c/d4d/d3c/c24 1751 1 2024-08-31T05:21:06.089 INFO:tasks.workunit.client.1.smithi073.stdout:1/586: dwrite d5/d17/d3f/f7d [0,4194304] 0 2024-08-31T05:21:06.094 INFO:tasks.workunit.client.1.smithi073.stdout:5/835: truncate f9 2355699 0 2024-08-31T05:21:06.096 INFO:tasks.workunit.client.1.smithi073.stdout:0/635: fsync d0/d15/d2c/d40/d4a/f87 0 2024-08-31T05:21:06.097 INFO:tasks.workunit.client.1.smithi073.stdout:6/641: read d15/d1a/d2b/d2f/d99/db3/fc6 [2356142,77398] 0 2024-08-31T05:21:06.098 INFO:tasks.workunit.client.1.smithi073.stdout:5/836: write dc/d16/d3b/dc6/f10c [450314,20465] 0 2024-08-31T05:21:06.099 INFO:tasks.workunit.client.1.smithi073.stdout:0/636: mknod d0/d15/d9b/ccf 0 2024-08-31T05:21:06.099 INFO:tasks.workunit.client.1.smithi073.stdout:7/589: dread d1/da/d3e/d22/d6b/f70 [0,4194304] 0 2024-08-31T05:21:06.099 INFO:tasks.workunit.client.1.smithi073.stdout:2/614: sync 2024-08-31T05:21:06.100 INFO:tasks.workunit.client.1.smithi073.stdout:5/837: readlink dc/d16/d3b/d3f/d4f/l60 0 2024-08-31T05:21:06.101 INFO:tasks.workunit.client.1.smithi073.stdout:7/590: readlink d1/da/d3e/d22/d47/l57 0 2024-08-31T05:21:06.104 INFO:tasks.workunit.client.1.smithi073.stdout:2/615: dread d2/d9/d3c/f57 [0,4194304] 0 2024-08-31T05:21:06.104 INFO:tasks.workunit.client.1.smithi073.stdout:0/637: rename d0/d69/d8e/c3a to d0/d15/d2c/d40/d4a/d6b/cd0 0 2024-08-31T05:21:06.105 INFO:tasks.workunit.client.1.smithi073.stdout:0/638: dread - d0/d69/d8e/fc3 zero size 2024-08-31T05:21:06.106 INFO:tasks.workunit.client.1.smithi073.stdout:5/838: mkdir dc/d3d/dab/dff/d49/dd2/d111 0 2024-08-31T05:21:06.106 INFO:tasks.workunit.client.1.smithi073.stdout:2/616: dread - d2/d9/d7f/fb0 zero size 2024-08-31T05:21:06.106 INFO:tasks.workunit.client.1.smithi073.stdout:7/591: truncate d1/da/d96/fa4 1106214 0 2024-08-31T05:21:06.108 INFO:tasks.workunit.client.1.smithi073.stdout:2/617: creat d2/d9/d3c/fc5 x:0 0 0 2024-08-31T05:21:06.108 INFO:tasks.workunit.client.1.smithi073.stdout:5/839: mknod dc/d16/d1a/c112 0 2024-08-31T05:21:06.109 INFO:tasks.workunit.client.1.smithi073.stdout:2/618: read d2/d9/d3c/f57 [335212,26142] 0 2024-08-31T05:21:06.109 INFO:tasks.workunit.client.1.smithi073.stdout:5/840: read dc/d3d/d55/f101 [242854,130729] 0 2024-08-31T05:21:06.110 INFO:tasks.workunit.client.1.smithi073.stdout:0/639: link d0/d69/fab d0/d15/d2c/fd1 0 2024-08-31T05:21:06.111 INFO:tasks.workunit.client.1.smithi073.stdout:7/592: mknod d1/dbe/cc4 0 2024-08-31T05:21:06.111 INFO:tasks.workunit.client.1.smithi073.stdout:5/841: stat dc/d16/d1a/cb9 0 2024-08-31T05:21:06.111 INFO:tasks.workunit.client.1.smithi073.stdout:0/640: stat d0/d69/d7f/d68/c6f 0 2024-08-31T05:21:06.112 INFO:tasks.workunit.client.1.smithi073.stdout:5/842: fsync dc/d16/d1a/d87/d94/fbf 0 2024-08-31T05:21:06.113 INFO:tasks.workunit.client.1.smithi073.stdout:0/641: chown d0/d69/d8e/d99 0 1 2024-08-31T05:21:06.114 INFO:tasks.workunit.client.1.smithi073.stdout:2/619: mkdir d2/d9/d27/d76/db5/dc6 0 2024-08-31T05:21:06.115 INFO:tasks.workunit.client.1.smithi073.stdout:5/843: write dc/d3d/dab/fdc [4582266,67499] 0 2024-08-31T05:21:06.115 INFO:tasks.workunit.client.1.smithi073.stdout:0/642: stat d0/d15/d2c/d40 0 2024-08-31T05:21:06.115 INFO:tasks.workunit.client.1.smithi073.stdout:1/587: dread d5/f9 [0,4194304] 0 2024-08-31T05:21:06.115 INFO:tasks.workunit.client.1.smithi073.stdout:7/593: creat d1/da/d3e/d22/d35/d83/fc5 x:0 0 0 2024-08-31T05:21:06.116 INFO:tasks.workunit.client.1.smithi073.stdout:6/642: truncate d15/d1a/d2b/d2f/f30 1056439 0 2024-08-31T05:21:06.117 INFO:tasks.workunit.client.1.smithi073.stdout:7/594: write d1/da/f26 [3039279,2447] 0 2024-08-31T05:21:06.118 INFO:tasks.workunit.client.1.smithi073.stdout:0/643: rmdir d0/d15 39 2024-08-31T05:21:06.125 INFO:tasks.workunit.client.1.smithi073.stdout:2/620: dwrite d2/d9/d3c/f73 [0,4194304] 0 2024-08-31T05:21:06.125 INFO:tasks.workunit.client.1.smithi073.stdout:7/595: dread d1/d11/f97 [0,4194304] 0 2024-08-31T05:21:06.126 INFO:tasks.workunit.client.1.smithi073.stdout:1/588: rename d5/f19 to d5/d10/d33/d13/fa4 0 2024-08-31T05:21:06.128 INFO:tasks.workunit.client.1.smithi073.stdout:2/621: dread - d2/d9/d3c/fc5 zero size 2024-08-31T05:21:06.128 INFO:tasks.workunit.client.1.smithi073.stdout:5/844: dwrite fb [0,4194304] 0 2024-08-31T05:21:06.128 INFO:tasks.workunit.client.1.smithi073.stdout:7/596: fsync d1/da/f94 0 2024-08-31T05:21:06.130 INFO:tasks.workunit.client.1.smithi073.stdout:6/643: rename d15/d1a/d2b/d2f/d4b/c4f to d15/d1a/d2b/d2f/d99/db3/ccb 0 2024-08-31T05:21:06.132 INFO:tasks.workunit.client.1.smithi073.stdout:7/597: dread d1/da/f72 [0,4194304] 0 2024-08-31T05:21:06.134 INFO:tasks.workunit.client.1.smithi073.stdout:7/598: write d1/da/d15/d33/f50 [5009789,11406] 0 2024-08-31T05:21:06.137 INFO:tasks.workunit.client.1.smithi073.stdout:5/845: fsync dc/d3d/dab/dff/d49/f97 0 2024-08-31T05:21:06.137 INFO:tasks.workunit.client.1.smithi073.stdout:6/644: mknod d15/d1a/d1e/ccc 0 2024-08-31T05:21:06.141 INFO:tasks.workunit.client.1.smithi073.stdout:2/622: symlink d2/d9/d27/d9b/lc7 0 2024-08-31T05:21:06.141 INFO:tasks.workunit.client.1.smithi073.stdout:7/599: dwrite d1/d11/faf [0,4194304] 0 2024-08-31T05:21:06.142 INFO:tasks.workunit.client.1.smithi073.stdout:7/600: chown d1/da/d65/da9/d84 0 1 2024-08-31T05:21:06.144 INFO:tasks.workunit.client.1.smithi073.stdout:7/601: chown d1/da/d15/f5a 956136272 1 2024-08-31T05:21:06.145 INFO:tasks.workunit.client.1.smithi073.stdout:5/846: mkdir dc/d16/d3b/dc6/d113 0 2024-08-31T05:21:06.146 INFO:tasks.workunit.client.1.smithi073.stdout:2/623: dread d2/f35 [0,4194304] 0 2024-08-31T05:21:06.146 INFO:tasks.workunit.client.1.smithi073.stdout:6/645: creat d15/d41/d89/fcd x:0 0 0 2024-08-31T05:21:06.147 INFO:tasks.workunit.client.1.smithi073.stdout:6/646: rename d15 to d15/d17/dce 22 2024-08-31T05:21:06.147 INFO:tasks.workunit.client.1.smithi073.stdout:1/589: fdatasync d5/d26/d54/f6c 0 2024-08-31T05:21:06.147 INFO:tasks.workunit.client.1.smithi073.stdout:7/602: mkdir d1/da/d3e/d22/d5c/dc6 0 2024-08-31T05:21:06.152 INFO:tasks.workunit.client.1.smithi073.stdout:1/590: fdatasync d5/d10/d1c/f4b 0 2024-08-31T05:21:06.154 INFO:tasks.workunit.client.1.smithi073.stdout:7/603: rename d1/da/d3e/d22/d5c/c80 to d1/d11/d14/dac/cc7 0 2024-08-31T05:21:06.155 INFO:tasks.workunit.client.1.smithi073.stdout:2/624: truncate d2/d9/df/d43/fb7 1813544 0 2024-08-31T05:21:06.155 INFO:tasks.workunit.client.1.smithi073.stdout:1/591: mkdir d5/d26/da5 0 2024-08-31T05:21:06.156 INFO:tasks.workunit.client.1.smithi073.stdout:2/625: chown d2/c80 2802 1 2024-08-31T05:21:06.156 INFO:tasks.workunit.client.1.smithi073.stdout:7/604: dread - d1/da/d65/da9/f85 zero size 2024-08-31T05:21:06.159 INFO:tasks.workunit.client.1.smithi073.stdout:1/592: write d5/d17/d2a/f3b [1657410,60151] 0 2024-08-31T05:21:06.161 INFO:tasks.workunit.client.1.smithi073.stdout:7/605: getdents d1/da/d3e/d22/d5c/dc6 0 2024-08-31T05:21:06.161 INFO:tasks.workunit.client.1.smithi073.stdout:1/593: mknod d5/d17/d5d/ca6 0 2024-08-31T05:21:06.163 INFO:tasks.workunit.client.1.smithi073.stdout:5/847: dread dc/d16/f7e [0,4194304] 0 2024-08-31T05:21:06.164 INFO:tasks.workunit.client.1.smithi073.stdout:7/606: rename d1/da/d3e/d22/d35/fa7 to d1/dbe/fc8 0 2024-08-31T05:21:06.166 INFO:tasks.workunit.client.1.smithi073.stdout:1/594: creat d5/d10/d33/fa7 x:0 0 0 2024-08-31T05:21:06.170 INFO:tasks.workunit.client.1.smithi073.stdout:2/626: write d2/d9/df/f53 [2604701,36406] 0 2024-08-31T05:21:06.171 INFO:tasks.workunit.client.1.smithi073.stdout:5/848: dwrite dc/d16/d1a/d87/d94/fbf [0,4194304] 0 2024-08-31T05:21:06.177 INFO:tasks.workunit.client.1.smithi073.stdout:7/607: dwrite d1/da/f7b [0,4194304] 0 2024-08-31T05:21:06.177 INFO:tasks.workunit.client.1.smithi073.stdout:1/595: link d5/d10/f6e d5/d26/d54/d5f/fa8 0 2024-08-31T05:21:06.178 INFO:tasks.workunit.client.1.smithi073.stdout:2/627: symlink d2/d9/df/d43/lc8 0 2024-08-31T05:21:06.180 INFO:tasks.workunit.client.1.smithi073.stdout:2/628: chown d2/d9/d3c/f5c 32 1 2024-08-31T05:21:06.180 INFO:tasks.workunit.client.1.smithi073.stdout:1/596: mknod d5/d10/d33/ca9 0 2024-08-31T05:21:06.184 INFO:tasks.workunit.client.1.smithi073.stdout:5/849: dwrite fb [4194304,4194304] 0 2024-08-31T05:21:06.184 INFO:tasks.workunit.client.1.smithi073.stdout:1/597: creat d5/d10/d1c/d27/d51/faa x:0 0 0 2024-08-31T05:21:06.184 INFO:tasks.workunit.client.1.smithi073.stdout:1/598: rmdir d5/d17/d32 39 2024-08-31T05:21:06.188 INFO:tasks.workunit.client.1.smithi073.stdout:5/850: getdents dc/d3d/dab/dff/dcc/dea 0 2024-08-31T05:21:06.190 INFO:tasks.workunit.client.1.smithi073.stdout:1/599: rename d5/d10/d1c/d27/f75 to d5/d17/d32/d37/d6f/fab 0 2024-08-31T05:21:06.191 INFO:tasks.workunit.client.1.smithi073.stdout:1/600: chown d5/d10/d33/fa7 48796826 1 2024-08-31T05:21:06.191 INFO:tasks.workunit.client.1.smithi073.stdout:1/601: readlink d5/d17/d32/l71 0 2024-08-31T05:21:06.193 INFO:tasks.workunit.client.1.smithi073.stdout:1/602: mknod d5/d26/d54/d55/cac 0 2024-08-31T05:21:06.194 INFO:tasks.workunit.client.1.smithi073.stdout:5/851: rename dc/d3d/dab/dff/d49/c80 to dc/d3d/dab/dff/c114 0 2024-08-31T05:21:06.195 INFO:tasks.workunit.client.1.smithi073.stdout:2/629: fdatasync d2/d9/df/d43/fb7 0 2024-08-31T05:21:06.196 INFO:tasks.workunit.client.1.smithi073.stdout:5/852: dread - dc/d16/d1a/d87/f9b zero size 2024-08-31T05:21:06.196 INFO:tasks.workunit.client.1.smithi073.stdout:1/603: fdatasync d5/d17/d32/d37/f3c 0 2024-08-31T05:21:06.198 INFO:tasks.workunit.client.1.smithi073.stdout:5/853: write dc/d16/d3b/dc6/fce [838804,68212] 0 2024-08-31T05:21:06.200 INFO:tasks.workunit.client.1.smithi073.stdout:7/608: dwrite d1/da/d15/f21 [0,4194304] 0 2024-08-31T05:21:06.202 INFO:tasks.workunit.client.1.smithi073.stdout:7/609: write d1/da/f26 [4762336,28733] 0 2024-08-31T05:21:06.204 INFO:tasks.workunit.client.1.smithi073.stdout:1/604: dread d5/d17/d32/d37/d6f/fab [0,4194304] 0 2024-08-31T05:21:06.205 INFO:tasks.workunit.client.1.smithi073.stdout:5/854: rename dc/d16/d3b/dc6/d113 to dc/d16/d1a/db7/deb/d115 0 2024-08-31T05:21:06.210 INFO:tasks.workunit.client.1.smithi073.stdout:1/605: truncate d5/d10/d33/f30 4478869 0 2024-08-31T05:21:06.211 INFO:tasks.workunit.client.1.smithi073.stdout:1/606: dread - d5/d10/d1c/f83 zero size 2024-08-31T05:21:06.212 INFO:tasks.workunit.client.1.smithi073.stdout:5/855: rename dc/d16/d3b/lc5 to dc/d3d/dab/dff/d49/dd2/d102/l116 0 2024-08-31T05:21:06.224 INFO:tasks.workunit.client.1.smithi073.stdout:2/630: dread d2/d9/df/f64 [0,4194304] 0 2024-08-31T05:21:06.226 INFO:tasks.workunit.client.1.smithi073.stdout:2/631: readlink d2/l8 0 2024-08-31T05:21:06.226 INFO:tasks.workunit.client.1.smithi073.stdout:2/632: readlink d2/l20 0 2024-08-31T05:21:06.227 INFO:tasks.workunit.client.1.smithi073.stdout:2/633: read d2/d9/d7f/dab/f47 [1577051,50788] 0 2024-08-31T05:21:06.229 INFO:tasks.workunit.client.1.smithi073.stdout:2/634: write d2/d9/d66/d70/fbb [149298,52247] 0 2024-08-31T05:21:06.231 INFO:tasks.workunit.client.1.smithi073.stdout:2/635: mkdir d2/d9/d66/d70/dc9 0 2024-08-31T05:21:06.241 INFO:tasks.workunit.client.1.smithi073.stdout:2/636: link d2/d9/df/d43/d88/c8d d2/d9/df/d36/cca 0 2024-08-31T05:21:06.241 INFO:tasks.workunit.client.1.smithi073.stdout:2/637: rename d2/d9/d27/d9b/da6/c8e to d2/d9/d66/d70/dc9/ccb 0 2024-08-31T05:21:06.242 INFO:tasks.workunit.client.1.smithi073.stdout:5/856: dread dc/d3d/dab/dff/d49/dd2/f70 [0,4194304] 0 2024-08-31T05:21:06.243 INFO:tasks.workunit.client.1.smithi073.stdout:2/638: write d2/d9/df/f2e [879365,3608] 0 2024-08-31T05:21:06.243 INFO:tasks.workunit.client.1.smithi073.stdout:5/857: rename dc/d16/d1a/l35 to dc/d53/l117 0 2024-08-31T05:21:06.243 INFO:tasks.workunit.client.1.smithi073.stdout:2/639: write d2/d9/d7f/fb0 [138422,44183] 0 2024-08-31T05:21:06.243 INFO:tasks.workunit.client.1.smithi073.stdout:2/640: write d2/d9/d27/d9b/da7/fa8 [4026719,87160] 0 2024-08-31T05:21:06.247 INFO:tasks.workunit.client.1.smithi073.stdout:5/858: rename dc/d16/d1a/d87/cad to dc/d3d/c118 0 2024-08-31T05:21:06.247 INFO:tasks.workunit.client.1.smithi073.stdout:5/859: fdatasync fb 0 2024-08-31T05:21:06.248 INFO:tasks.workunit.client.1.smithi073.stdout:5/860: mkdir dc/d16/d3b/d119 0 2024-08-31T05:21:06.250 INFO:tasks.workunit.client.1.smithi073.stdout:5/861: rename dc/d3d/dab/dff/d49/dd2/f70 to dc/d3d/d3e/f11a 0 2024-08-31T05:21:06.252 INFO:tasks.workunit.client.1.smithi073.stdout:5/862: rename dc/d16/d3b/d3f/d4f/c8d to dc/d3d/dab/c11b 0 2024-08-31T05:21:06.253 INFO:tasks.workunit.client.1.smithi073.stdout:2/641: dread d2/d9/d27/f33 [0,4194304] 0 2024-08-31T05:21:06.253 INFO:tasks.workunit.client.1.smithi073.stdout:5/863: mknod dc/d16/d3b/c11c 0 2024-08-31T05:21:06.262 INFO:tasks.workunit.client.1.smithi073.stdout:2/642: write d2/d9/f85 [3211514,59364] 0 2024-08-31T05:21:06.262 INFO:tasks.workunit.client.1.smithi073.stdout:9/761: sync 2024-08-31T05:21:06.262 INFO:tasks.workunit.client.1.smithi073.stdout:8/671: sync 2024-08-31T05:21:06.262 INFO:tasks.workunit.client.1.smithi073.stdout:3/705: sync 2024-08-31T05:21:06.263 INFO:tasks.workunit.client.1.smithi073.stdout:2/643: symlink d2/d9/d66/d70/dc9/lcc 0 2024-08-31T05:21:06.263 INFO:tasks.workunit.client.1.smithi073.stdout:3/706: chown da/d3c/d5a/d8a 118249 1 2024-08-31T05:21:06.264 INFO:tasks.workunit.client.1.smithi073.stdout:9/762: read - dc/d37/d42/d8d/d52/fa8 zero size 2024-08-31T05:21:06.264 INFO:tasks.workunit.client.1.smithi073.stdout:3/707: rmdir da/d3c/d65/d2c 39 2024-08-31T05:21:06.265 INFO:tasks.workunit.client.1.smithi073.stdout:2/644: creat d2/d9/d7f/dab/d5d/d82/fcd x:0 0 0 2024-08-31T05:21:06.268 INFO:tasks.workunit.client.1.smithi073.stdout:5/864: dwrite dc/d3d/dab/dff/f41 [4194304,4194304] 0 2024-08-31T05:21:06.268 INFO:tasks.workunit.client.1.smithi073.stdout:3/708: symlink da/d3c/d5a/db8/le8 0 2024-08-31T05:21:06.269 INFO:tasks.workunit.client.1.smithi073.stdout:8/672: dwrite d0/da8/fc6 [0,4194304] 0 2024-08-31T05:21:06.269 INFO:tasks.workunit.client.1.smithi073.stdout:5/865: rmdir dc/d53 39 2024-08-31T05:21:06.270 INFO:tasks.workunit.client.1.smithi073.stdout:3/709: unlink da/d3c/d65/d2c/d8e/cbb 0 2024-08-31T05:21:06.271 INFO:tasks.workunit.client.1.smithi073.stdout:2/645: dread d2/d9/df/d43/d88/f8f [0,4194304] 0 2024-08-31T05:21:06.273 INFO:tasks.workunit.client.1.smithi073.stdout:5/866: unlink dc/d3d/dab/dff/l1d 0 2024-08-31T05:21:06.275 INFO:tasks.workunit.client.1.smithi073.stdout:8/673: creat d0/db/d44/d72/d75/d7e/d91/dac/fce x:0 0 0 2024-08-31T05:21:06.276 INFO:tasks.workunit.client.1.smithi073.stdout:8/674: fsync d0/db/d1c/fb9 0 2024-08-31T05:21:06.276 INFO:tasks.workunit.client.1.smithi073.stdout:9/763: truncate dc/d37/d42/fa1 5100538 0 2024-08-31T05:21:06.277 INFO:tasks.workunit.client.1.smithi073.stdout:9/764: chown dc/d82/de4 467076 1 2024-08-31T05:21:06.279 INFO:tasks.workunit.client.1.smithi073.stdout:3/710: mknod da/d18/ce9 0 2024-08-31T05:21:06.279 INFO:tasks.workunit.client.1.smithi073.stdout:9/765: fsync dc/de/d11/ff5 0 2024-08-31T05:21:06.279 INFO:tasks.workunit.client.1.smithi073.stdout:3/711: dread - da/d3c/d65/d87/fcc zero size 2024-08-31T05:21:06.279 INFO:tasks.workunit.client.1.smithi073.stdout:2/646: creat d2/d9/d27/d76/db5/fce x:0 0 0 2024-08-31T05:21:06.280 INFO:tasks.workunit.client.1.smithi073.stdout:2/647: fdatasync d2/d9/d3c/f40 0 2024-08-31T05:21:06.284 INFO:tasks.workunit.client.1.smithi073.stdout:2/648: creat d2/d9/d27/d9b/da6/fcf x:0 0 0 2024-08-31T05:21:06.285 INFO:tasks.workunit.client.1.smithi073.stdout:3/712: link da/d18/fae da/d3c/d82/d86/fea 0 2024-08-31T05:21:06.286 INFO:tasks.workunit.client.1.smithi073.stdout:5/867: getdents dc/d16/d1a/db7/deb 0 2024-08-31T05:21:06.286 INFO:tasks.workunit.client.1.smithi073.stdout:2/649: unlink d2/d25/l5f 0 2024-08-31T05:21:06.288 INFO:tasks.workunit.client.1.smithi073.stdout:5/868: chown dc/d16/d3b/d3f/d4f/c7c 1816 1 2024-08-31T05:21:06.289 INFO:tasks.workunit.client.1.smithi073.stdout:5/869: fsync dc/d3d/dab/dff/f41 0 2024-08-31T05:21:06.289 INFO:tasks.workunit.client.1.smithi073.stdout:5/870: chown dc/d16 547237285 1 2024-08-31T05:21:06.290 INFO:tasks.workunit.client.1.smithi073.stdout:3/713: rename da/d3c/d65/d2c/d8e/de2 to da/d3c/d65/d45/deb 0 2024-08-31T05:21:06.290 INFO:tasks.workunit.client.1.smithi073.stdout:5/871: write dc/d16/d4e/f8e [3193323,38874] 0 2024-08-31T05:21:06.293 INFO:tasks.workunit.client.1.smithi073.stdout:2/650: symlink d2/d9/d7f/dab/d5d/ld0 0 2024-08-31T05:21:06.294 INFO:tasks.workunit.client.1.smithi073.stdout:2/651: write d2/d9/f24 [3261388,2596] 0 2024-08-31T05:21:06.299 INFO:tasks.workunit.client.1.smithi073.stdout:8/675: truncate d0/f27 1244221 0 2024-08-31T05:21:06.300 INFO:tasks.workunit.client.1.smithi073.stdout:2/652: write d2/d9/df/f62 [407354,16385] 0 2024-08-31T05:21:06.300 INFO:tasks.workunit.client.1.smithi073.stdout:8/676: rmdir d0/d62 39 2024-08-31T05:21:06.301 INFO:tasks.workunit.client.1.smithi073.stdout:9/766: dread dc/d37/d42/d8d/f39 [0,4194304] 0 2024-08-31T05:21:06.302 INFO:tasks.workunit.client.1.smithi073.stdout:8/677: write d0/db/d1c/d24/f74 [730001,89511] 0 2024-08-31T05:21:06.304 INFO:tasks.workunit.client.1.smithi073.stdout:8/678: write d0/db/d44/d4e/f63 [441245,125672] 0 2024-08-31T05:21:06.305 INFO:tasks.workunit.client.1.smithi073.stdout:9/767: symlink dc/de/d66/d84/lfe 0 2024-08-31T05:21:06.307 INFO:tasks.workunit.client.1.smithi073.stdout:2/653: mkdir d2/d9/d27/d76/db5/dc6/dd1 0 2024-08-31T05:21:06.309 INFO:tasks.workunit.client.1.smithi073.stdout:9/768: creat dc/d37/db5/dc1/fff x:0 0 0 2024-08-31T05:21:06.315 INFO:tasks.workunit.client.1.smithi073.stdout:2/654: dread d2/d9/df/f53 [0,4194304] 0 2024-08-31T05:21:06.321 INFO:tasks.workunit.client.1.smithi073.stdout:2/655: dwrite d2/d25/f93 [0,4194304] 0 2024-08-31T05:21:06.323 INFO:tasks.workunit.client.1.smithi073.stdout:2/656: creat d2/d9/d7f/fd2 x:0 0 0 2024-08-31T05:21:06.325 INFO:tasks.workunit.client.1.smithi073.stdout:9/769: dread dc/d27/fc7 [0,4194304] 0 2024-08-31T05:21:06.391 INFO:tasks.workunit.client.1.smithi073.stdout:4/596: sync 2024-08-31T05:21:06.391 INFO:tasks.workunit.client.1.smithi073.stdout:0/644: sync 2024-08-31T05:21:06.392 INFO:tasks.workunit.client.1.smithi073.stdout:0/645: mknod d0/d69/d7f/d68/cd2 0 2024-08-31T05:21:06.394 INFO:tasks.workunit.client.1.smithi073.stdout:4/597: rename d7/df/d13/d53/l93 to d7/df/d13/d2e/d47/lb3 0 2024-08-31T05:21:06.395 INFO:tasks.workunit.client.1.smithi073.stdout:0/646: symlink d0/d15/d2c/d40/ld3 0 2024-08-31T05:21:06.396 INFO:tasks.workunit.client.1.smithi073.stdout:0/647: chown d0/d69/d7f/d68/f81 0 1 2024-08-31T05:21:06.431 INFO:tasks.workunit.client.0.smithi067.stdout:2/18: sync 2024-08-31T05:21:06.436 INFO:tasks.workunit.client.1.smithi073.stdout:4/598: dwrite d7/d1a/d5c/d6d/f8d [0,4194304] 0 2024-08-31T05:21:06.438 INFO:tasks.workunit.client.0.smithi067.stdout:2/19: dwrite f1 [0,4194304] 0 2024-08-31T05:21:06.438 INFO:tasks.workunit.client.1.smithi073.stdout:4/599: dread d7/db/f77 [0,4194304] 0 2024-08-31T05:21:06.450 INFO:tasks.workunit.client.1.smithi073.stdout:0/648: dread d0/d15/d2c/d4d/d3c/f1f [0,4194304] 0 2024-08-31T05:21:06.453 INFO:tasks.workunit.client.1.smithi073.stdout:0/649: creat d0/d69/d7f/d68/d91/dcd/fd4 x:0 0 0 2024-08-31T05:21:06.462 INFO:tasks.workunit.client.1.smithi073.stdout:0/650: dread d0/f33 [0,4194304] 0 2024-08-31T05:21:06.463 INFO:tasks.workunit.client.0.smithi067.stdout:2/20: fsync f1 0 2024-08-31T05:21:06.465 INFO:tasks.workunit.client.1.smithi073.stdout:0/651: rename d0/d69/d8e/f57 to d0/d15/d2c/d4d/d3c/fd5 0 2024-08-31T05:21:06.466 INFO:tasks.workunit.client.1.smithi073.stdout:0/652: write d0/d69/f8a [914559,66142] 0 2024-08-31T05:21:06.471 INFO:tasks.workunit.client.1.smithi073.stdout:0/653: dwrite d0/d69/d8e/fc0 [0,4194304] 0 2024-08-31T05:21:06.473 INFO:tasks.workunit.client.1.smithi073.stdout:0/654: creat d0/d15/d9b/fd6 x:0 0 0 2024-08-31T05:21:06.474 INFO:tasks.workunit.client.1.smithi073.stdout:0/655: chown d0/d69/d8e/d99/fa9 371 1 2024-08-31T05:21:06.476 INFO:tasks.workunit.client.1.smithi073.stdout:0/656: stat d0/d15/d2c/d4d/d3c/fa 0 2024-08-31T05:21:06.479 INFO:tasks.workunit.client.1.smithi073.stdout:6/647: sync 2024-08-31T05:21:06.481 INFO:tasks.workunit.client.1.smithi073.stdout:6/648: mknod d15/d1a/d2b/d2f/d4b/d88/ccf 0 2024-08-31T05:21:06.483 INFO:tasks.workunit.client.1.smithi073.stdout:6/649: creat d15/d1a/d2b/d2f/d4b/d97/fd0 x:0 0 0 2024-08-31T05:21:06.484 INFO:tasks.workunit.client.1.smithi073.stdout:6/650: fdatasync d15/d17/da1/dae/db0/d38/d9b/fad 0 2024-08-31T05:21:06.484 INFO:tasks.workunit.client.1.smithi073.stdout:0/657: truncate d0/d15/d2c/d40/f9a 2229838 0 2024-08-31T05:21:06.485 INFO:tasks.workunit.client.1.smithi073.stdout:6/651: fsync d15/d1a/d2b/d2f/d4b/f57 0 2024-08-31T05:21:06.487 INFO:tasks.workunit.client.1.smithi073.stdout:6/652: creat d15/d75/fd1 x:0 0 0 2024-08-31T05:21:06.487 INFO:tasks.workunit.client.1.smithi073.stdout:0/658: mknod d0/d28/d4f/cd7 0 2024-08-31T05:21:06.489 INFO:tasks.workunit.client.1.smithi073.stdout:6/653: mknod d15/d17/da1/dae/cd2 0 2024-08-31T05:21:06.491 INFO:tasks.workunit.client.1.smithi073.stdout:6/654: read d15/d1a/d1e/d69/d7e/f8e [793590,30756] 0 2024-08-31T05:21:06.492 INFO:tasks.workunit.client.1.smithi073.stdout:6/655: write d15/d17/da1/dae/db0/f2c [3896536,2002] 0 2024-08-31T05:21:06.493 INFO:tasks.workunit.client.1.smithi073.stdout:6/656: chown d15/d1a/d51/f70 6971 1 2024-08-31T05:21:06.495 INFO:tasks.workunit.client.1.smithi073.stdout:6/657: dread d15/d17/f5e [0,4194304] 0 2024-08-31T05:21:06.498 INFO:tasks.workunit.client.1.smithi073.stdout:0/659: dwrite d0/d15/d2c/d4d/d3c/fa [4194304,4194304] 0 2024-08-31T05:21:06.499 INFO:tasks.workunit.client.1.smithi073.stdout:6/658: link d15/d1a/d2b/c58 d15/d17/da1/dae/cd3 0 2024-08-31T05:21:06.501 INFO:tasks.workunit.client.1.smithi073.stdout:0/660: link d0/d69/fa8 d0/d15/d2c/d4d/d3c/d9c/dc8/fd8 0 2024-08-31T05:21:06.503 INFO:tasks.workunit.client.1.smithi073.stdout:6/659: dread d15/d1a/d2b/d2f/d4b/d97/fab [0,4194304] 0 2024-08-31T05:21:06.505 INFO:tasks.workunit.client.1.smithi073.stdout:6/660: dread d15/d1a/d2b/d2f/d4b/d97/fab [0,4194304] 0 2024-08-31T05:21:06.507 INFO:tasks.workunit.client.1.smithi073.stdout:0/661: dwrite d0/d15/f37 [0,4194304] 0 2024-08-31T05:21:06.509 INFO:tasks.workunit.client.1.smithi073.stdout:0/662: truncate d0/d15/d2c/d40/d4a/d6b/fc2 487783 0 2024-08-31T05:21:06.510 INFO:tasks.workunit.client.1.smithi073.stdout:0/663: dread - d0/d28/d4f/fc9 zero size 2024-08-31T05:21:06.511 INFO:tasks.workunit.client.1.smithi073.stdout:6/661: link d15/d17/da1/dae/db0/d38/d9b/f73 d15/d1a/d51/d6e/fd4 0 2024-08-31T05:21:06.515 INFO:tasks.workunit.client.1.smithi073.stdout:0/664: rename d0/d15/d9b/fd6 to d0/fd9 0 2024-08-31T05:21:06.520 INFO:tasks.workunit.client.1.smithi073.stdout:0/665: rename d0/d15/d2c/d40/d4a/d6b/cae to d0/d58/cda 0 2024-08-31T05:21:06.522 INFO:tasks.workunit.client.1.smithi073.stdout:0/666: mkdir d0/d15/d2c/d40/d4a/ddb 0 2024-08-31T05:21:06.522 INFO:tasks.workunit.client.1.smithi073.stdout:6/662: dwrite d15/d1a/d2b/d2f/d99/db3/fc6 [0,4194304] 0 2024-08-31T05:21:06.523 INFO:tasks.workunit.client.1.smithi073.stdout:6/663: write d15/d17/f5c [4365430,107490] 0 2024-08-31T05:21:06.528 INFO:tasks.workunit.client.1.smithi073.stdout:0/667: link d0/d28/d4f/l5e d0/d28/ldc 0 2024-08-31T05:21:06.557 INFO:tasks.workunit.client.0.smithi067.stdout:3/22: sync 2024-08-31T05:21:06.558 INFO:tasks.workunit.client.0.smithi067.stdout:0/50: sync 2024-08-31T05:21:06.558 INFO:tasks.workunit.client.0.smithi067.stdout:7/17: sync 2024-08-31T05:21:06.558 INFO:tasks.workunit.client.0.smithi067.stdout:9/10: sync 2024-08-31T05:21:06.558 INFO:tasks.workunit.client.0.smithi067.stdout:1/19: sync 2024-08-31T05:21:06.558 INFO:tasks.workunit.client.0.smithi067.stdout:4/3: sync 2024-08-31T05:21:06.558 INFO:tasks.workunit.client.0.smithi067.stdout:6/27: sync 2024-08-31T05:21:06.558 INFO:tasks.workunit.client.0.smithi067.stdout:5/18: sync 2024-08-31T05:21:06.558 INFO:tasks.workunit.client.0.smithi067.stdout:8/66: sync 2024-08-31T05:21:06.558 INFO:tasks.workunit.client.0.smithi067.stdout:8/67: chown d0 513 1 2024-08-31T05:21:06.560 INFO:tasks.workunit.client.0.smithi067.stdout:3/23: dread f4 [0,4194304] 0 2024-08-31T05:21:06.560 INFO:tasks.workunit.client.0.smithi067.stdout:3/24: rmdir - no directory 2024-08-31T05:21:06.561 INFO:tasks.workunit.client.0.smithi067.stdout:7/18: creat f5 x:0 0 0 2024-08-31T05:21:06.561 INFO:tasks.workunit.client.0.smithi067.stdout:4/4: symlink l1 0 2024-08-31T05:21:06.562 INFO:tasks.workunit.client.0.smithi067.stdout:7/19: write f5 [936420,36330] 0 2024-08-31T05:21:06.562 INFO:tasks.workunit.client.1.smithi073.stdout:7/610: sync 2024-08-31T05:21:06.565 INFO:tasks.workunit.client.0.smithi067.stdout:0/51: symlink d1/d8/l14 0 2024-08-31T05:21:06.567 INFO:tasks.workunit.client.0.smithi067.stdout:3/25: mknod c8 0 2024-08-31T05:21:06.567 INFO:tasks.workunit.client.1.smithi073.stdout:7/611: dread - d1/da/d3e/d22/d35/d83/fc1 zero size 2024-08-31T05:21:06.568 INFO:tasks.workunit.client.0.smithi067.stdout:6/28: write f3 [2750358,82897] 0 2024-08-31T05:21:06.569 INFO:tasks.workunit.client.0.smithi067.stdout:4/5: dread - f0 zero size 2024-08-31T05:21:06.569 INFO:tasks.workunit.client.1.smithi073.stdout:7/612: read d1/f43 [2475499,44570] 0 2024-08-31T05:21:06.570 INFO:tasks.workunit.client.0.smithi067.stdout:7/20: creat f6 x:0 0 0 2024-08-31T05:21:06.570 INFO:tasks.workunit.client.0.smithi067.stdout:7/21: rmdir - no directory 2024-08-31T05:21:06.570 INFO:tasks.workunit.client.0.smithi067.stdout:6/29: write f3 [1431618,5813] 0 2024-08-31T05:21:06.572 INFO:tasks.workunit.client.1.smithi073.stdout:0/668: mknod d0/d69/d7f/d62/dbf/cdd 0 2024-08-31T05:21:06.574 INFO:tasks.workunit.client.1.smithi073.stdout:7/613: chown d1/d11/d14/dac/cc7 44768339 1 2024-08-31T05:21:06.575 INFO:tasks.workunit.client.0.smithi067.stdout:0/52: creat d1/dd/f15 x:0 0 0 2024-08-31T05:21:06.576 INFO:tasks.workunit.client.0.smithi067.stdout:9/11: dwrite f0 [0,4194304] 0 2024-08-31T05:21:06.579 INFO:tasks.workunit.client.0.smithi067.stdout:4/6: mkdir d2 0 2024-08-31T05:21:06.579 INFO:tasks.workunit.client.1.smithi073.stdout:7/614: dwrite d1/f2e [4194304,4194304] 0 2024-08-31T05:21:06.580 INFO:tasks.workunit.client.0.smithi067.stdout:5/19: dwrite f6 [0,4194304] 0 2024-08-31T05:21:06.580 INFO:tasks.workunit.client.0.smithi067.stdout:4/7: chown d2 53 1 2024-08-31T05:21:06.580 INFO:tasks.workunit.client.0.smithi067.stdout:3/26: dread f1 [0,4194304] 0 2024-08-31T05:21:06.581 INFO:tasks.workunit.client.0.smithi067.stdout:0/53: truncate d1/dd/f15 754532 0 2024-08-31T05:21:06.582 INFO:tasks.workunit.client.0.smithi067.stdout:1/20: link d3/l8 d3/l9 0 2024-08-31T05:21:06.586 INFO:tasks.workunit.client.0.smithi067.stdout:6/30: truncate f8 818426 0 2024-08-31T05:21:06.587 INFO:tasks.workunit.client.0.smithi067.stdout:8/68: truncate d0/f9 2004022 0 2024-08-31T05:21:06.587 INFO:tasks.workunit.client.1.smithi073.stdout:7/615: rmdir d1/da/d3e/d22/d35/d83 39 2024-08-31T05:21:06.594 INFO:tasks.workunit.client.0.smithi067.stdout:3/27: unlink f1 0 2024-08-31T05:21:06.596 INFO:tasks.workunit.client.0.smithi067.stdout:0/54: creat d1/d8/f16 x:0 0 0 2024-08-31T05:21:06.597 INFO:tasks.workunit.client.1.smithi073.stdout:7/616: link d1/c2d d1/da/d3e/d22/d5c/dc6/cc9 0 2024-08-31T05:21:06.599 INFO:tasks.workunit.client.0.smithi067.stdout:6/31: rename c0 to ca 0 2024-08-31T05:21:06.600 INFO:tasks.workunit.client.0.smithi067.stdout:1/21: dread f1 [0,4194304] 0 2024-08-31T05:21:06.602 INFO:tasks.workunit.client.0.smithi067.stdout:7/22: link f3 f7 0 2024-08-31T05:21:06.603 INFO:tasks.workunit.client.1.smithi073.stdout:7/617: link d1/da/cb3 d1/d11/d14/dac/cca 0 2024-08-31T05:21:06.604 INFO:tasks.workunit.client.0.smithi067.stdout:3/28: write f6 [653391,46609] 0 2024-08-31T05:21:06.604 INFO:tasks.workunit.client.0.smithi067.stdout:0/55: rmdir d1 39 2024-08-31T05:21:06.605 INFO:tasks.workunit.client.0.smithi067.stdout:6/32: symlink lb 0 2024-08-31T05:21:06.606 INFO:tasks.workunit.client.0.smithi067.stdout:6/33: stat f9 0 2024-08-31T05:21:06.607 INFO:tasks.workunit.client.0.smithi067.stdout:1/22: rename d3/l4 to d3/la 0 2024-08-31T05:21:06.609 INFO:tasks.workunit.client.0.smithi067.stdout:9/12: rmdir d1 0 2024-08-31T05:21:06.610 INFO:tasks.workunit.client.1.smithi073.stdout:7/618: getdents d1/dc0 0 2024-08-31T05:21:06.611 INFO:tasks.workunit.client.0.smithi067.stdout:7/23: unlink c0 0 2024-08-31T05:21:06.614 INFO:tasks.workunit.client.0.smithi067.stdout:3/29: rename l0 to l9 0 2024-08-31T05:21:06.621 INFO:tasks.workunit.client.0.smithi067.stdout:1/23: truncate f1 1213924 0 2024-08-31T05:21:06.622 INFO:tasks.workunit.client.0.smithi067.stdout:1/24: readlink d3/l9 0 2024-08-31T05:21:06.623 INFO:tasks.workunit.client.0.smithi067.stdout:1/25: chown d3/f7 29053 1 2024-08-31T05:21:06.624 INFO:tasks.workunit.client.0.smithi067.stdout:9/13: creat f2 x:0 0 0 2024-08-31T05:21:06.624 INFO:tasks.workunit.client.0.smithi067.stdout:9/14: rmdir - no directory 2024-08-31T05:21:06.624 INFO:tasks.workunit.client.0.smithi067.stdout:9/15: readlink - no filename 2024-08-31T05:21:06.626 INFO:tasks.workunit.client.0.smithi067.stdout:9/16: write f2 [521970,111910] 0 2024-08-31T05:21:06.626 INFO:tasks.workunit.client.0.smithi067.stdout:4/8: dwrite f0 [0,4194304] 0 2024-08-31T05:21:06.628 INFO:tasks.workunit.client.0.smithi067.stdout:0/56: rename d1/df/da to d1/df/d17 0 2024-08-31T05:21:06.628 INFO:tasks.workunit.client.0.smithi067.stdout:0/57: readlink d1/d8/l14 0 2024-08-31T05:21:06.629 INFO:tasks.workunit.client.0.smithi067.stdout:0/58: chown d1/df/c9 2 1 2024-08-31T05:21:06.630 INFO:tasks.workunit.client.0.smithi067.stdout:3/30: creat fa x:0 0 0 2024-08-31T05:21:06.630 INFO:tasks.workunit.client.0.smithi067.stdout:3/31: truncate f6 1346478 0 2024-08-31T05:21:06.633 INFO:tasks.workunit.client.0.smithi067.stdout:7/24: dread f3 [0,4194304] 0 2024-08-31T05:21:06.635 INFO:tasks.workunit.client.1.smithi073.stdout:1/607: sync 2024-08-31T05:21:06.635 INFO:tasks.workunit.client.1.smithi073.stdout:3/714: sync 2024-08-31T05:21:06.636 INFO:tasks.workunit.client.1.smithi073.stdout:1/608: dread - d5/d17/d2a/f9c zero size 2024-08-31T05:21:06.638 INFO:tasks.workunit.client.0.smithi067.stdout:4/9: unlink l1 0 2024-08-31T05:21:06.638 INFO:tasks.workunit.client.0.smithi067.stdout:4/10: chown d2 117 1 2024-08-31T05:21:06.643 INFO:tasks.workunit.client.0.smithi067.stdout:9/17: rename f2 to f3 0 2024-08-31T05:21:06.643 INFO:tasks.workunit.client.1.smithi073.stdout:1/609: rmdir d5/d10/d1c/d27 39 2024-08-31T05:21:06.644 INFO:tasks.workunit.client.0.smithi067.stdout:3/32: dwrite fa [0,4194304] 0 2024-08-31T05:21:06.645 INFO:tasks.workunit.client.0.smithi067.stdout:0/59: mkdir d1/dd/d18 0 2024-08-31T05:21:06.647 INFO:tasks.workunit.client.1.smithi073.stdout:3/715: rename da/d3c/d82/d86/fb5 to da/d3c/d65/d40/fec 0 2024-08-31T05:21:06.648 INFO:tasks.workunit.client.0.smithi067.stdout:6/34: chown f8 2936601 1 2024-08-31T05:21:06.648 INFO:tasks.workunit.client.1.smithi073.stdout:3/716: chown da/f12 4 1 2024-08-31T05:21:06.648 INFO:tasks.workunit.client.0.smithi067.stdout:6/35: chown f3 4308 1 2024-08-31T05:21:06.652 INFO:tasks.workunit.client.1.smithi073.stdout:7/619: dwrite d1/da/d15/f24 [0,4194304] 0 2024-08-31T05:21:06.653 INFO:tasks.workunit.client.0.smithi067.stdout:1/26: fsync d3/f5 0 2024-08-31T05:21:06.653 INFO:tasks.workunit.client.1.smithi073.stdout:7/620: stat d1/da/d3e/d22/d6b/f81 0 2024-08-31T05:21:06.654 INFO:tasks.workunit.client.0.smithi067.stdout:0/60: dwrite d1/dd/f15 [0,4194304] 0 2024-08-31T05:21:06.654 INFO:tasks.workunit.client.1.smithi073.stdout:3/717: mkdir da/d18/ded 0 2024-08-31T05:21:06.658 INFO:tasks.workunit.client.1.smithi073.stdout:7/621: unlink d1/da/d15/f58 0 2024-08-31T05:21:06.663 INFO:tasks.workunit.client.0.smithi067.stdout:3/33: mkdir db 0 2024-08-31T05:21:06.665 INFO:tasks.workunit.client.1.smithi073.stdout:3/718: getdents da/d3c/d67/db7 0 2024-08-31T05:21:06.666 INFO:tasks.workunit.client.1.smithi073.stdout:3/719: write da/d3c/d67/db7/fdc [346790,47918] 0 2024-08-31T05:21:06.667 INFO:tasks.workunit.client.0.smithi067.stdout:6/36: creat fc x:0 0 0 2024-08-31T05:21:06.670 INFO:tasks.workunit.client.0.smithi067.stdout:0/61: mkdir d1/df/d17/d19 0 2024-08-31T05:21:06.671 INFO:tasks.workunit.client.0.smithi067.stdout:9/18: dwrite f3 [0,4194304] 0 2024-08-31T05:21:06.672 INFO:tasks.workunit.client.0.smithi067.stdout:6/37: rename fc to fd 0 2024-08-31T05:21:06.676 INFO:tasks.workunit.client.0.smithi067.stdout:4/11: rmdir d2 0 2024-08-31T05:21:06.678 INFO:tasks.workunit.client.0.smithi067.stdout:3/34: creat db/fc x:0 0 0 2024-08-31T05:21:06.679 INFO:tasks.workunit.client.0.smithi067.stdout:7/25: getdents . 0 2024-08-31T05:21:06.681 INFO:tasks.workunit.client.1.smithi073.stdout:1/610: write d5/d26/f64 [3079566,32359] 0 2024-08-31T05:21:06.681 INFO:tasks.workunit.client.1.smithi073.stdout:1/611: chown d5/d10/d33/l72 114270689 1 2024-08-31T05:21:06.682 INFO:tasks.workunit.client.0.smithi067.stdout:6/38: symlink le 0 2024-08-31T05:21:06.684 INFO:tasks.workunit.client.1.smithi073.stdout:1/612: creat d5/d10/d1b/fad x:0 0 0 2024-08-31T05:21:06.684 INFO:tasks.workunit.client.0.smithi067.stdout:4/12: mknod c3 0 2024-08-31T05:21:06.686 INFO:tasks.workunit.client.0.smithi067.stdout:3/35: rename fa to db/fd 0 2024-08-31T05:21:06.689 INFO:tasks.workunit.client.1.smithi073.stdout:7/622: dread d1/da/f94 [0,4194304] 0 2024-08-31T05:21:06.690 INFO:tasks.workunit.client.0.smithi067.stdout:8/69: truncate d0/f9 2597646 0 2024-08-31T05:21:06.690 INFO:tasks.workunit.client.1.smithi073.stdout:7/623: chown d1/da/d15/d33/d44/d74/c93 2 1 2024-08-31T05:21:06.694 INFO:tasks.workunit.client.1.smithi073.stdout:5/872: sync 2024-08-31T05:21:06.694 INFO:tasks.workunit.client.1.smithi073.stdout:2/657: sync 2024-08-31T05:21:06.695 INFO:tasks.workunit.client.0.smithi067.stdout:4/13: mkdir d4 0 2024-08-31T05:21:06.695 INFO:tasks.workunit.client.1.smithi073.stdout:8/679: sync 2024-08-31T05:21:06.695 INFO:tasks.workunit.client.1.smithi073.stdout:6/664: sync 2024-08-31T05:21:06.696 INFO:tasks.workunit.client.1.smithi073.stdout:9/770: sync 2024-08-31T05:21:06.696 INFO:tasks.workunit.client.1.smithi073.stdout:0/669: sync 2024-08-31T05:21:06.696 INFO:tasks.workunit.client.1.smithi073.stdout:4/600: sync 2024-08-31T05:21:06.696 INFO:tasks.workunit.client.0.smithi067.stdout:3/36: rmdir db 39 2024-08-31T05:21:06.697 INFO:tasks.workunit.client.0.smithi067.stdout:1/27: write f0 [3190099,51540] 0 2024-08-31T05:21:06.698 INFO:tasks.workunit.client.1.smithi073.stdout:6/665: dread - d15/d17/da1/dae/fb7 zero size 2024-08-31T05:21:06.698 INFO:tasks.workunit.client.1.smithi073.stdout:6/666: stat d15/d1a/d51/cb8 0 2024-08-31T05:21:06.699 INFO:tasks.workunit.client.0.smithi067.stdout:0/62: rmdir d1/df/d17/d19 0 2024-08-31T05:21:06.700 INFO:tasks.workunit.client.0.smithi067.stdout:0/63: chown d1/df/f13 4 1 2024-08-31T05:21:06.700 INFO:tasks.workunit.client.1.smithi073.stdout:0/670: dread d0/d69/d7f/f6a [0,4194304] 0 2024-08-31T05:21:06.701 INFO:tasks.workunit.client.1.smithi073.stdout:2/658: rename d2/d9/df/f53 to d2/d9/d3c/fd3 0 2024-08-31T05:21:06.702 INFO:tasks.workunit.client.1.smithi073.stdout:3/720: dread da/d68/f7e [0,4194304] 0 2024-08-31T05:21:06.702 INFO:tasks.workunit.client.0.smithi067.stdout:8/70: fsync d0/d2/f3 0 2024-08-31T05:21:06.703 INFO:tasks.workunit.client.1.smithi073.stdout:7/624: link d1/da/d3e/d22/l23 d1/da/d3e/d22/d47/lcb 0 2024-08-31T05:21:06.705 INFO:tasks.workunit.client.1.smithi073.stdout:7/625: write d1/da/d15/d33/d44/d60/f9b [1673339,102143] 0 2024-08-31T05:21:06.706 INFO:tasks.workunit.client.0.smithi067.stdout:6/39: link f3 ff 0 2024-08-31T05:21:06.707 INFO:tasks.workunit.client.0.smithi067.stdout:6/40: chown lb 1812606911 1 2024-08-31T05:21:06.710 INFO:tasks.workunit.client.0.smithi067.stdout:2/21: sync 2024-08-31T05:21:06.710 INFO:tasks.workunit.client.0.smithi067.stdout:9/19: dwrite f3 [4194304,4194304] 0 2024-08-31T05:21:06.711 INFO:tasks.workunit.client.1.smithi073.stdout:1/613: write d5/d17/d2a/d80/f44 [2319095,98464] 0 2024-08-31T05:21:06.711 INFO:tasks.workunit.client.1.smithi073.stdout:1/614: chown d5/d17/d32 1743 1 2024-08-31T05:21:06.711 INFO:tasks.workunit.client.1.smithi073.stdout:9/771: rmdir dc/d37/d42/d5a/da0 39 2024-08-31T05:21:06.712 INFO:tasks.workunit.client.0.smithi067.stdout:2/22: readlink l0 0 2024-08-31T05:21:06.712 INFO:tasks.workunit.client.0.smithi067.stdout:3/37: fdatasync db/fc 0 2024-08-31T05:21:06.712 INFO:tasks.workunit.client.0.smithi067.stdout:9/20: chown f0 30877 1 2024-08-31T05:21:06.713 INFO:tasks.workunit.client.0.smithi067.stdout:2/23: fsync f1 0 2024-08-31T05:21:06.714 INFO:tasks.workunit.client.0.smithi067.stdout:3/38: dread - db/fc zero size 2024-08-31T05:21:06.715 INFO:tasks.workunit.client.1.smithi073.stdout:4/601: symlink d7/df/d1b/d34/lb4 0 2024-08-31T05:21:06.715 INFO:tasks.workunit.client.0.smithi067.stdout:9/21: write f3 [2831635,99679] 0 2024-08-31T05:21:06.715 INFO:tasks.workunit.client.1.smithi073.stdout:4/602: chown d7/df/d79/d7a/faa 4185389 1 2024-08-31T05:21:06.716 INFO:tasks.workunit.client.0.smithi067.stdout:0/64: truncate d1/df/f13 653855 0 2024-08-31T05:21:06.719 INFO:tasks.workunit.client.0.smithi067.stdout:7/26: dwrite f3 [0,4194304] 0 2024-08-31T05:21:06.720 INFO:tasks.workunit.client.1.smithi073.stdout:6/667: mknod d15/d1a/d1e/cd5 0 2024-08-31T05:21:06.720 INFO:tasks.workunit.client.0.smithi067.stdout:7/27: read f7 [4003678,117203] 0 2024-08-31T05:21:06.721 INFO:tasks.workunit.client.1.smithi073.stdout:6/668: readlink d15/l28 0 2024-08-31T05:21:06.723 INFO:tasks.workunit.client.1.smithi073.stdout:0/671: creat d0/d15/d2c/d41/d52/fde x:0 0 0 2024-08-31T05:21:06.724 INFO:tasks.workunit.client.0.smithi067.stdout:4/14: symlink d4/l5 0 2024-08-31T05:21:06.724 INFO:tasks.workunit.client.1.smithi073.stdout:0/672: stat d0/d69/d8e/lbb 0 2024-08-31T05:21:06.724 INFO:tasks.workunit.client.1.smithi073.stdout:9/772: dread dc/d10/f33 [0,4194304] 0 2024-08-31T05:21:06.726 INFO:tasks.workunit.client.0.smithi067.stdout:6/41: creat f10 x:0 0 0 2024-08-31T05:21:06.727 INFO:tasks.workunit.client.1.smithi073.stdout:9/773: chown dc/d37/d42/d8d/d52/d5b/d73 2724 1 2024-08-31T05:21:06.728 INFO:tasks.workunit.client.1.smithi073.stdout:3/721: fdatasync da/d3c/d65/d40/f57 0 2024-08-31T05:21:06.733 INFO:tasks.workunit.client.0.smithi067.stdout:3/39: chown l9 1 1 2024-08-31T05:21:06.734 INFO:tasks.workunit.client.1.smithi073.stdout:0/673: dwrite d0/d15/d2c/fb9 [0,4194304] 0 2024-08-31T05:21:06.734 INFO:tasks.workunit.client.0.smithi067.stdout:9/22: creat f4 x:0 0 0 2024-08-31T05:21:06.734 INFO:tasks.workunit.client.0.smithi067.stdout:9/23: chown f4 527601 1 2024-08-31T05:21:06.735 INFO:tasks.workunit.client.1.smithi073.stdout:0/674: truncate d0/d15/d2c/d41/d52/fde 842910 0 2024-08-31T05:21:06.735 INFO:tasks.workunit.client.1.smithi073.stdout:6/669: rmdir d15/d41/d89 39 2024-08-31T05:21:06.736 INFO:tasks.workunit.client.0.smithi067.stdout:0/65: rename d1/c12 to d1/d8/c1a 0 2024-08-31T05:21:06.736 INFO:tasks.workunit.client.0.smithi067.stdout:0/66: chown d1 311 1 2024-08-31T05:21:06.737 INFO:tasks.workunit.client.1.smithi073.stdout:0/675: write d0/d15/d2c/d40/d4a/f87 [1876013,56706] 0 2024-08-31T05:21:06.740 INFO:tasks.workunit.client.1.smithi073.stdout:0/676: fdatasync d0/d69/d8e/fc3 0 2024-08-31T05:21:06.741 INFO:tasks.workunit.client.0.smithi067.stdout:5/20: sync 2024-08-31T05:21:06.741 INFO:tasks.workunit.client.1.smithi073.stdout:2/659: link d2/d9/d7f/f83 d2/d9/df/d36/fd4 0 2024-08-31T05:21:06.742 INFO:tasks.workunit.client.0.smithi067.stdout:5/21: write f6 [3861147,5007] 0 2024-08-31T05:21:06.745 INFO:tasks.workunit.client.0.smithi067.stdout:4/15: mknod d4/c6 0 2024-08-31T05:21:06.746 INFO:tasks.workunit.client.0.smithi067.stdout:6/42: dread - f9 zero size 2024-08-31T05:21:06.748 INFO:tasks.workunit.client.1.smithi073.stdout:1/615: link d5/d17/f57 d5/d10/d33/d13/d7e/fae 0 2024-08-31T05:21:06.749 INFO:tasks.workunit.client.1.smithi073.stdout:1/616: fdatasync d5/d26/d54/d5f/fa0 0 2024-08-31T05:21:06.752 INFO:tasks.workunit.client.1.smithi073.stdout:9/774: dread dc/d27/f2e [0,4194304] 0 2024-08-31T05:21:06.753 INFO:tasks.workunit.client.1.smithi073.stdout:8/680: write d0/db/d1c/d2a/d58/f66 [253847,45669] 0 2024-08-31T05:21:06.753 INFO:tasks.workunit.client.0.smithi067.stdout:9/24: mkdir d5 0 2024-08-31T05:21:06.754 INFO:tasks.workunit.client.1.smithi073.stdout:1/617: read d5/d10/d33/d13/fa4 [2034666,123243] 0 2024-08-31T05:21:06.756 INFO:tasks.workunit.client.0.smithi067.stdout:0/67: mknod d1/dd/c1b 0 2024-08-31T05:21:06.758 INFO:tasks.workunit.client.1.smithi073.stdout:1/618: read d5/d26/d54/d55/f8d [97166,108422] 0 2024-08-31T05:21:06.760 INFO:tasks.workunit.client.1.smithi073.stdout:0/677: creat d0/d69/d7f/d62/dbf/fdf x:0 0 0 2024-08-31T05:21:06.761 INFO:tasks.workunit.client.0.smithi067.stdout:1/28: dwrite f2 [0,4194304] 0 2024-08-31T05:21:06.761 INFO:tasks.workunit.client.1.smithi073.stdout:0/678: stat d0/d15/d2c/d40/f6d 0 2024-08-31T05:21:06.762 INFO:tasks.workunit.client.0.smithi067.stdout:9/25: dread f3 [4194304,4194304] 0 2024-08-31T05:21:06.763 INFO:tasks.workunit.client.0.smithi067.stdout:9/26: read f3 [4844303,102480] 0 2024-08-31T05:21:06.764 INFO:tasks.workunit.client.1.smithi073.stdout:7/626: write d1/d11/f64 [257833,115388] 0 2024-08-31T05:21:06.766 INFO:tasks.workunit.client.0.smithi067.stdout:9/27: read f0 [4062030,127894] 0 2024-08-31T05:21:06.767 INFO:tasks.workunit.client.1.smithi073.stdout:2/660: dread d2/d9/d27/d9b/da6/fba [0,4194304] 0 2024-08-31T05:21:06.768 INFO:tasks.workunit.client.1.smithi073.stdout:3/722: rename da/d3c/d5a/l64 to da/d3c/d5a/lee 0 2024-08-31T05:21:06.769 INFO:tasks.workunit.client.0.smithi067.stdout:9/28: write f0 [4136063,128755] 0 2024-08-31T05:21:06.771 INFO:tasks.workunit.client.0.smithi067.stdout:8/71: dwrite d0/f9 [0,4194304] 0 2024-08-31T05:21:06.772 INFO:tasks.workunit.client.0.smithi067.stdout:9/29: read f0 [3327794,26619] 0 2024-08-31T05:21:06.773 INFO:tasks.workunit.client.0.smithi067.stdout:1/29: dread f1 [0,4194304] 0 2024-08-31T05:21:06.774 INFO:tasks.workunit.client.1.smithi073.stdout:4/603: truncate d7/db/f2a 113768 0 2024-08-31T05:21:06.775 INFO:tasks.workunit.client.1.smithi073.stdout:5/873: getdents dc/d16/d3b/d7f/d99 0 2024-08-31T05:21:06.775 INFO:tasks.workunit.client.0.smithi067.stdout:1/30: read f1 [3254982,14618] 0 2024-08-31T05:21:06.776 INFO:tasks.workunit.client.1.smithi073.stdout:3/723: dwrite da/d3c/f5e [0,4194304] 0 2024-08-31T05:21:06.776 INFO:tasks.workunit.client.1.smithi073.stdout:2/661: read d2/d9/d7f/dab/d5d/da1/fb2 [2159450,49602] 0 2024-08-31T05:21:06.776 INFO:tasks.workunit.client.1.smithi073.stdout:9/775: creat dc/de/d56/f100 x:0 0 0 2024-08-31T05:21:06.777 INFO:tasks.workunit.client.0.smithi067.stdout:6/43: mknod c11 0 2024-08-31T05:21:06.777 INFO:tasks.workunit.client.1.smithi073.stdout:3/724: readlink da/d3c/d65/d40/l46 0 2024-08-31T05:21:06.778 INFO:tasks.workunit.client.1.smithi073.stdout:9/776: fdatasync dc/d37/db5/dc1/fed 0 2024-08-31T05:21:06.782 INFO:tasks.workunit.client.1.smithi073.stdout:1/619: mkdir d5/d17/d32/daf 0 2024-08-31T05:21:06.783 INFO:tasks.workunit.client.0.smithi067.stdout:3/40: dwrite f4 [0,4194304] 0 2024-08-31T05:21:06.786 INFO:tasks.workunit.client.1.smithi073.stdout:0/679: mkdir d0/d15/d2c/d4d/d3c/d9c/db6/de0 0 2024-08-31T05:21:06.787 INFO:tasks.workunit.client.0.smithi067.stdout:5/22: write f4 [1455329,42990] 0 2024-08-31T05:21:06.787 INFO:tasks.workunit.client.1.smithi073.stdout:7/627: fdatasync d1/da/d15/d33/f50 0 2024-08-31T05:21:06.789 INFO:tasks.workunit.client.0.smithi067.stdout:7/28: truncate f7 1528758 0 2024-08-31T05:21:06.790 INFO:tasks.workunit.client.1.smithi073.stdout:5/874: symlink dc/d3d/d3e/l11d 0 2024-08-31T05:21:06.795 INFO:tasks.workunit.client.1.smithi073.stdout:2/662: rmdir d2/d9/d66/d70/dc9 39 2024-08-31T05:21:06.797 INFO:tasks.workunit.client.1.smithi073.stdout:5/875: truncate dc/d3d/dab/dff/dbd/f10a 815860 0 2024-08-31T05:21:06.799 INFO:tasks.workunit.client.1.smithi073.stdout:4/604: dwrite d7/db/f4f [4194304,4194304] 0 2024-08-31T05:21:06.802 INFO:tasks.workunit.client.0.smithi067.stdout:1/31: unlink d3/f7 0 2024-08-31T05:21:06.803 INFO:tasks.workunit.client.1.smithi073.stdout:7/628: dwrite d1/da/d96/fad [0,4194304] 0 2024-08-31T05:21:06.804 INFO:tasks.workunit.client.1.smithi073.stdout:7/629: readlink d1/da/d15/d33/d44/d60/l90 0 2024-08-31T05:21:06.806 INFO:tasks.workunit.client.1.smithi073.stdout:7/630: readlink d1/da/d15/d33/d44/d60/l90 0 2024-08-31T05:21:06.808 INFO:tasks.workunit.client.1.smithi073.stdout:6/670: creat d15/d17/da1/dae/fd6 x:0 0 0 2024-08-31T05:21:06.809 INFO:tasks.workunit.client.1.smithi073.stdout:1/620: symlink d5/d17/d32/d37/d6f/lb0 0 2024-08-31T05:21:06.809 INFO:tasks.workunit.client.0.smithi067.stdout:2/24: getdents . 0 2024-08-31T05:21:06.813 INFO:tasks.workunit.client.1.smithi073.stdout:2/663: rename d2/d9 to d2/d9/d7f/dab/dd5 22 2024-08-31T05:21:06.815 INFO:tasks.workunit.client.0.smithi067.stdout:3/41: rename l5 to db/le 0 2024-08-31T05:21:06.818 INFO:tasks.workunit.client.0.smithi067.stdout:5/23: creat f9 x:0 0 0 2024-08-31T05:21:06.820 INFO:tasks.workunit.client.1.smithi073.stdout:6/671: read d15/d17/f65 [66976,48121] 0 2024-08-31T05:21:06.820 INFO:tasks.workunit.client.1.smithi073.stdout:4/605: unlink d7/d1a/f29 0 2024-08-31T05:21:06.822 INFO:tasks.workunit.client.1.smithi073.stdout:0/680: dread d0/d69/d7f/d62/f8f [0,4194304] 0 2024-08-31T05:21:06.822 INFO:tasks.workunit.client.0.smithi067.stdout:8/72: dwrite d0/d2/f3 [0,4194304] 0 2024-08-31T05:21:06.822 INFO:tasks.workunit.client.1.smithi073.stdout:8/681: write d0/f27 [295514,64615] 0 2024-08-31T05:21:06.823 INFO:tasks.workunit.client.1.smithi073.stdout:4/606: write d7/df/d13/d2e/d70/d6b/f8f [383333,32048] 0 2024-08-31T05:21:06.823 INFO:tasks.workunit.client.1.smithi073.stdout:0/681: fsync d0/d28/d4f/fc9 0 2024-08-31T05:21:06.824 INFO:tasks.workunit.client.1.smithi073.stdout:4/607: stat d7/df/d13/d53 0 2024-08-31T05:21:06.825 INFO:tasks.workunit.client.1.smithi073.stdout:9/777: rmdir dc/d82/d97 39 2024-08-31T05:21:06.825 INFO:tasks.workunit.client.0.smithi067.stdout:9/30: getdents d5 0 2024-08-31T05:21:06.826 INFO:tasks.workunit.client.0.smithi067.stdout:9/31: truncate f4 948430 0 2024-08-31T05:21:06.831 INFO:tasks.workunit.client.1.smithi073.stdout:1/621: unlink d5/d10/d33/l72 0 2024-08-31T05:21:06.836 INFO:tasks.workunit.client.1.smithi073.stdout:3/725: truncate da/f29 2104376 0 2024-08-31T05:21:06.837 INFO:tasks.workunit.client.0.smithi067.stdout:3/42: symlink db/lf 0 2024-08-31T05:21:06.838 INFO:tasks.workunit.client.1.smithi073.stdout:2/664: creat d2/d9/d27/d76/d7e/fd6 x:0 0 0 2024-08-31T05:21:06.840 INFO:tasks.workunit.client.1.smithi073.stdout:5/876: mknod dc/d3d/dab/dff/c11e 0 2024-08-31T05:21:06.841 INFO:tasks.workunit.client.1.smithi073.stdout:5/877: write dc/d16/f2e [991191,43840] 0 2024-08-31T05:21:06.842 INFO:tasks.workunit.client.0.smithi067.stdout:4/16: getdents d4 0 2024-08-31T05:21:06.844 INFO:tasks.workunit.client.1.smithi073.stdout:6/672: symlink d15/d1a/d2b/d2f/d4b/d97/ld7 0 2024-08-31T05:21:06.844 INFO:tasks.workunit.client.1.smithi073.stdout:8/682: dread d0/db/d1c/d2a/d58/faf [0,4194304] 0 2024-08-31T05:21:06.846 INFO:tasks.workunit.client.1.smithi073.stdout:6/673: read d15/d1a/d2b/d2f/d4b/f8f [3282455,54223] 0 2024-08-31T05:21:06.847 INFO:tasks.workunit.client.1.smithi073.stdout:6/674: stat d15/d1a/d2b/d2f/f64 0 2024-08-31T05:21:06.851 INFO:tasks.workunit.client.0.smithi067.stdout:6/44: dwrite f8 [0,4194304] 0 2024-08-31T05:21:06.853 INFO:tasks.workunit.client.1.smithi073.stdout:9/778: rmdir dc/d37/d42/d8d/d52 39 2024-08-31T05:21:06.855 INFO:tasks.workunit.client.0.smithi067.stdout:2/25: link f1 f2 0 2024-08-31T05:21:06.857 INFO:tasks.workunit.client.0.smithi067.stdout:3/43: fsync db/fd 0 2024-08-31T05:21:06.860 INFO:tasks.workunit.client.0.smithi067.stdout:1/32: truncate f0 3319526 0 2024-08-31T05:21:06.860 INFO:tasks.workunit.client.1.smithi073.stdout:3/726: dread da/d3c/d82/fc9 [0,4194304] 0 2024-08-31T05:21:06.860 INFO:tasks.workunit.client.0.smithi067.stdout:1/33: chown d3/l9 214 1 2024-08-31T05:21:06.863 INFO:tasks.workunit.client.0.smithi067.stdout:4/17: creat d4/f7 x:0 0 0 2024-08-31T05:21:06.863 INFO:tasks.workunit.client.1.smithi073.stdout:3/727: dread da/d18/f8c [0,4194304] 0 2024-08-31T05:21:06.864 INFO:tasks.workunit.client.0.smithi067.stdout:4/18: dread - d4/f7 zero size 2024-08-31T05:21:06.864 INFO:tasks.workunit.client.1.smithi073.stdout:3/728: write da/d68/f84 [2668407,125097] 0 2024-08-31T05:21:06.865 INFO:tasks.workunit.client.0.smithi067.stdout:1/34: dread f1 [0,4194304] 0 2024-08-31T05:21:06.865 INFO:tasks.workunit.client.0.smithi067.stdout:8/73: symlink d0/d4/de/l10 0 2024-08-31T05:21:06.866 INFO:tasks.workunit.client.1.smithi073.stdout:6/675: unlink d15/d1a/f5b 0 2024-08-31T05:21:06.871 INFO:tasks.workunit.client.1.smithi073.stdout:4/608: link d7/d1a/d5c/f66 d7/d1a/fb5 0 2024-08-31T05:21:06.873 INFO:tasks.workunit.client.0.smithi067.stdout:6/45: stat c5 0 2024-08-31T05:21:06.873 INFO:tasks.workunit.client.0.smithi067.stdout:6/46: dread - f10 zero size 2024-08-31T05:21:06.874 INFO:tasks.workunit.client.1.smithi073.stdout:6/676: dwrite d15/d1a/d2b/d2f/d4b/f57 [0,4194304] 0 2024-08-31T05:21:06.874 INFO:tasks.workunit.client.1.smithi073.stdout:6/677: stat d15/f22 0 2024-08-31T05:21:06.874 INFO:tasks.workunit.client.0.smithi067.stdout:6/47: chown fd 380 1 2024-08-31T05:21:06.875 INFO:tasks.workunit.client.0.smithi067.stdout:6/48: chown ff 748019798 1 2024-08-31T05:21:06.875 INFO:tasks.workunit.client.0.smithi067.stdout:6/49: fsync f8 0 2024-08-31T05:21:06.875 INFO:tasks.workunit.client.0.smithi067.stdout:6/50: chown ff 754285610 1 2024-08-31T05:21:06.875 INFO:tasks.workunit.client.0.smithi067.stdout:2/26: creat f3 x:0 0 0 2024-08-31T05:21:06.876 INFO:tasks.workunit.client.1.smithi073.stdout:1/622: mkdir d5/d17/d32/daf/db1 0 2024-08-31T05:21:06.876 INFO:tasks.workunit.client.0.smithi067.stdout:3/44: creat db/f10 x:0 0 0 2024-08-31T05:21:06.877 INFO:tasks.workunit.client.0.smithi067.stdout:3/45: truncate db/fc 127951 0 2024-08-31T05:21:06.878 INFO:tasks.workunit.client.1.smithi073.stdout:7/631: rename d1/dbe to d1/d11/dcc 0 2024-08-31T05:21:06.882 INFO:tasks.workunit.client.1.smithi073.stdout:5/878: mknod dc/d16/c11f 0 2024-08-31T05:21:06.882 INFO:tasks.workunit.client.0.smithi067.stdout:7/29: write f3 [760483,44796] 0 2024-08-31T05:21:06.884 INFO:tasks.workunit.client.0.smithi067.stdout:8/74: rmdir d0/d2/da 39 2024-08-31T05:21:06.886 INFO:tasks.workunit.client.0.smithi067.stdout:9/32: rmdir d5 0 2024-08-31T05:21:06.887 INFO:tasks.workunit.client.0.smithi067.stdout:3/46: dwrite f4 [4194304,4194304] 0 2024-08-31T05:21:06.888 INFO:tasks.workunit.client.0.smithi067.stdout:7/30: fsync f7 0 2024-08-31T05:21:06.891 INFO:tasks.workunit.client.0.smithi067.stdout:6/51: symlink l12 0 2024-08-31T05:21:06.893 INFO:tasks.workunit.client.0.smithi067.stdout:7/31: dread f7 [0,4194304] 0 2024-08-31T05:21:06.894 INFO:tasks.workunit.client.1.smithi073.stdout:4/609: mkdir d7/d1a/d5c/d6d/d2c/d2d/db6 0 2024-08-31T05:21:06.897 INFO:tasks.workunit.client.0.smithi067.stdout:9/33: dwrite f4 [0,4194304] 0 2024-08-31T05:21:06.900 INFO:tasks.workunit.client.0.smithi067.stdout:5/24: getdents . 0 2024-08-31T05:21:06.901 INFO:tasks.workunit.client.1.smithi073.stdout:6/678: unlink d15/d1a/l74 0 2024-08-31T05:21:06.901 INFO:tasks.workunit.client.1.smithi073.stdout:6/679: chown d15/d75/dc8 23 1 2024-08-31T05:21:06.906 INFO:tasks.workunit.client.1.smithi073.stdout:2/665: rename d2/d25/l95 to d2/d9/d27/d9b/da6/ld7 0 2024-08-31T05:21:06.909 INFO:tasks.workunit.client.0.smithi067.stdout:4/19: rename d4/f7 to d4/f8 0 2024-08-31T05:21:06.910 INFO:tasks.workunit.client.0.smithi067.stdout:4/20: chown f0 4284481 1 2024-08-31T05:21:06.911 INFO:tasks.workunit.client.1.smithi073.stdout:3/729: symlink da/d3c/d67/lef 0 2024-08-31T05:21:06.911 INFO:tasks.workunit.client.1.smithi073.stdout:2/666: dwrite d2/d9/d7f/dab/f39 [0,4194304] 0 2024-08-31T05:21:06.913 INFO:tasks.workunit.client.1.smithi073.stdout:0/682: link d0/d15/d2c/d40/f9a d0/d28/d4f/fe1 0 2024-08-31T05:21:06.913 INFO:tasks.workunit.client.1.smithi073.stdout:9/779: write dc/d37/d42/d5a/da0/dcd/ff6 [2250937,83852] 0 2024-08-31T05:21:06.914 INFO:tasks.workunit.client.0.smithi067.stdout:8/75: creat d0/d4/de/f11 x:0 0 0 2024-08-31T05:21:06.914 INFO:tasks.workunit.client.1.smithi073.stdout:4/610: readlink d7/df/l63 0 2024-08-31T05:21:06.918 INFO:tasks.workunit.client.1.smithi073.stdout:6/680: unlink d15/d1a/d2b/d2f/d4b/f8f 0 2024-08-31T05:21:06.918 INFO:tasks.workunit.client.0.smithi067.stdout:3/47: mkdir db/d11 0 2024-08-31T05:21:06.918 INFO:tasks.workunit.client.0.smithi067.stdout:3/48: chown db/lf 13 1 2024-08-31T05:21:06.919 INFO:tasks.workunit.client.1.smithi073.stdout:6/681: dread - d15/d1a/d2b/f71 zero size 2024-08-31T05:21:06.919 INFO:tasks.workunit.client.0.smithi067.stdout:6/52: fsync f7 0 2024-08-31T05:21:06.922 INFO:tasks.workunit.client.0.smithi067.stdout:2/27: rename f3 to f4 0 2024-08-31T05:21:06.925 INFO:tasks.workunit.client.0.smithi067.stdout:7/32: creat f8 x:0 0 0 2024-08-31T05:21:06.926 INFO:tasks.workunit.client.1.smithi073.stdout:9/780: symlink dc/d82/de4/l101 0 2024-08-31T05:21:06.927 INFO:tasks.workunit.client.0.smithi067.stdout:5/25: rename l5 to la 0 2024-08-31T05:21:06.929 INFO:tasks.workunit.client.1.smithi073.stdout:4/611: creat d7/d1a/d5c/d6d/d59/d86/fb7 x:0 0 0 2024-08-31T05:21:06.930 INFO:tasks.workunit.client.0.smithi067.stdout:4/21: mkdir d4/d9 0 2024-08-31T05:21:06.936 INFO:tasks.workunit.client.0.smithi067.stdout:5/26: dwrite f4 [0,4194304] 0 2024-08-31T05:21:06.937 INFO:tasks.workunit.client.0.smithi067.stdout:5/27: dread - f9 zero size 2024-08-31T05:21:06.939 INFO:tasks.workunit.client.0.smithi067.stdout:6/53: mkdir d13 0 2024-08-31T05:21:06.939 INFO:tasks.workunit.client.0.smithi067.stdout:5/28: write f6 [122434,123985] 0 2024-08-31T05:21:06.941 INFO:tasks.workunit.client.0.smithi067.stdout:4/22: dwrite f0 [0,4194304] 0 2024-08-31T05:21:06.941 INFO:tasks.workunit.client.1.smithi073.stdout:2/667: unlink d2/d9/d27/d76/d97/c9a 0 2024-08-31T05:21:06.943 INFO:tasks.workunit.client.0.smithi067.stdout:2/28: unlink f2 0 2024-08-31T05:21:06.945 INFO:tasks.workunit.client.1.smithi073.stdout:0/683: symlink d0/d15/le2 0 2024-08-31T05:21:06.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:06 smithi073 ceph-mon[24726]: pgmap v24: 65 pgs: 65 active+clean; 1.4 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 55 MiB/s rd, 198 MiB/s wr, 451 op/s 2024-08-31T05:21:06.946 INFO:tasks.workunit.client.1.smithi073.stdout:3/730: write da/f12 [542704,111770] 0 2024-08-31T05:21:06.947 INFO:tasks.workunit.client.1.smithi073.stdout:0/684: fdatasync d0/d15/d2c/d41/faf 0 2024-08-31T05:21:06.951 INFO:tasks.workunit.client.1.smithi073.stdout:8/683: rename d0/db/d1c/d34/d38/c7d to d0/db/d44/ccf 0 2024-08-31T05:21:06.952 INFO:tasks.workunit.client.1.smithi073.stdout:4/612: dread d7/db/f2a [0,4194304] 0 2024-08-31T05:21:06.953 INFO:tasks.workunit.client.1.smithi073.stdout:8/684: write d0/f4 [5517661,90327] 0 2024-08-31T05:21:06.953 INFO:tasks.workunit.client.1.smithi073.stdout:1/623: truncate d5/fc 364719 0 2024-08-31T05:21:06.954 INFO:tasks.workunit.client.1.smithi073.stdout:4/613: chown d7/df/d13/db2 4 1 2024-08-31T05:21:06.954 INFO:tasks.workunit.client.0.smithi067.stdout:1/35: getdents d3 0 2024-08-31T05:21:06.955 INFO:tasks.workunit.client.1.smithi073.stdout:1/624: write d5/d10/d1b/f41 [956160,116573] 0 2024-08-31T05:21:06.955 INFO:tasks.workunit.client.0.smithi067.stdout:8/76: symlink d0/d2/l12 0 2024-08-31T05:21:06.956 INFO:tasks.workunit.client.1.smithi073.stdout:9/781: symlink dc/d82/l102 0 2024-08-31T05:21:06.957 INFO:tasks.workunit.client.0.smithi067.stdout:3/49: getdents db/d11 0 2024-08-31T05:21:06.957 INFO:tasks.workunit.client.0.smithi067.stdout:8/77: write d0/d4/de/f11 [92775,48715] 0 2024-08-31T05:21:06.958 INFO:tasks.workunit.client.1.smithi073.stdout:9/782: read dc/f98 [4046707,88740] 0 2024-08-31T05:21:06.958 INFO:tasks.workunit.client.0.smithi067.stdout:8/78: write d0/d2/f3 [4028500,102388] 0 2024-08-31T05:21:06.961 INFO:tasks.workunit.client.1.smithi073.stdout:0/685: creat d0/d69/d7f/d62/dbf/fe3 x:0 0 0 2024-08-31T05:21:06.963 INFO:tasks.workunit.client.1.smithi073.stdout:7/632: rename d1/da/d3e/f52 to d1/da/d3e/d22/d5c/fcd 0 2024-08-31T05:21:06.965 INFO:tasks.workunit.client.1.smithi073.stdout:6/682: link d15/d1a/d2b/laa d15/d17/da1/dae/db0/d38/ld8 0 2024-08-31T05:21:06.967 INFO:tasks.workunit.client.0.smithi067.stdout:8/79: dwrite d0/d4/de/f11 [0,4194304] 0 2024-08-31T05:21:06.970 INFO:tasks.workunit.client.0.smithi067.stdout:7/33: link f6 f9 0 2024-08-31T05:21:06.971 INFO:tasks.workunit.client.1.smithi073.stdout:2/668: fsync f1 0 2024-08-31T05:21:06.977 INFO:tasks.workunit.client.1.smithi073.stdout:4/614: dread d7/df/d13/d2e/f3a [0,4194304] 0 2024-08-31T05:21:06.978 INFO:tasks.workunit.client.1.smithi073.stdout:1/625: dread d5/d10/d33/f36 [0,4194304] 0 2024-08-31T05:21:06.979 INFO:tasks.workunit.client.0.smithi067.stdout:3/50: mkdir db/d12 0 2024-08-31T05:21:06.979 INFO:tasks.workunit.client.0.smithi067.stdout:3/51: read - db/f10 zero size 2024-08-31T05:21:06.980 INFO:tasks.workunit.client.1.smithi073.stdout:9/783: mkdir dc/d37/d42/d5a/d89/d103 0 2024-08-31T05:21:06.981 INFO:tasks.workunit.client.1.smithi073.stdout:9/784: fsync dc/d37/d42/f64 0 2024-08-31T05:21:06.982 INFO:tasks.workunit.client.1.smithi073.stdout:3/731: write da/d3c/d65/f5c [757967,13379] 0 2024-08-31T05:21:06.983 INFO:tasks.workunit.client.1.smithi073.stdout:3/732: read - da/d3c/d65/d40/d5d/f89 zero size 2024-08-31T05:21:06.984 INFO:tasks.workunit.client.0.smithi067.stdout:5/29: write f2 [372358,97795] 0 2024-08-31T05:21:06.984 INFO:tasks.workunit.client.0.smithi067.stdout:5/30: dread - f7 zero size 2024-08-31T05:21:06.986 INFO:tasks.workunit.client.0.smithi067.stdout:4/23: write d4/f8 [89335,67151] 0 2024-08-31T05:21:06.992 INFO:tasks.workunit.client.1.smithi073.stdout:7/633: symlink d1/d11/d14/dac/lce 0 2024-08-31T05:21:06.993 INFO:tasks.workunit.client.1.smithi073.stdout:3/733: dwrite da/fb [4194304,4194304] 0 2024-08-31T05:21:06.993 INFO:tasks.workunit.client.1.smithi073.stdout:3/734: truncate da/d3c/d67/db7/fdc 551951 0 2024-08-31T05:21:06.994 INFO:tasks.workunit.client.0.smithi067.stdout:2/29: fdatasync f1 0 2024-08-31T05:21:06.994 INFO:tasks.workunit.client.0.smithi067.stdout:1/36: write d3/f6 [872409,41736] 0 2024-08-31T05:21:06.994 INFO:tasks.workunit.client.0.smithi067.stdout:1/37: chown d3 1 1 2024-08-31T05:21:06.994 INFO:tasks.workunit.client.1.smithi073.stdout:2/669: fdatasync d2/d9/d3c/fd3 0 2024-08-31T05:21:06.995 INFO:tasks.workunit.client.0.smithi067.stdout:7/34: symlink la 0 2024-08-31T05:21:06.996 INFO:tasks.workunit.client.0.smithi067.stdout:9/34: getdents . 0 2024-08-31T05:21:07.000 INFO:tasks.workunit.client.0.smithi067.stdout:3/52: rename l7 to db/l13 0 2024-08-31T05:21:07.001 INFO:tasks.workunit.client.0.smithi067.stdout:3/53: fsync db/fc 0 2024-08-31T05:21:07.003 INFO:tasks.workunit.client.0.smithi067.stdout:6/54: rmdir d13 0 2024-08-31T05:21:07.004 INFO:tasks.workunit.client.0.smithi067.stdout:6/55: readlink le 0 2024-08-31T05:21:07.006 INFO:tasks.workunit.client.0.smithi067.stdout:3/54: dread f6 [0,4194304] 0 2024-08-31T05:21:07.007 INFO:tasks.workunit.client.1.smithi073.stdout:4/615: dread d7/f46 [0,4194304] 0 2024-08-31T05:21:07.008 INFO:tasks.workunit.client.1.smithi073.stdout:4/616: chown d7/df/d13 23055433 1 2024-08-31T05:21:07.012 INFO:tasks.workunit.client.0.smithi067.stdout:9/35: creat f6 x:0 0 0 2024-08-31T05:21:07.016 INFO:tasks.workunit.client.0.smithi067.stdout:4/24: rename d4/f8 to d4/d9/fa 0 2024-08-31T05:21:07.016 INFO:tasks.workunit.client.0.smithi067.stdout:1/38: dwrite f2 [0,4194304] 0 2024-08-31T05:21:07.018 INFO:tasks.workunit.client.1.smithi073.stdout:0/686: truncate d0/f1e 3120546 0 2024-08-31T05:21:07.019 INFO:tasks.workunit.client.1.smithi073.stdout:0/687: write d0/f5b [1296232,76147] 0 2024-08-31T05:21:07.020 INFO:tasks.workunit.client.0.smithi067.stdout:2/30: write f4 [301167,38067] 0 2024-08-31T05:21:07.021 INFO:tasks.workunit.client.1.smithi073.stdout:0/688: chown d0/f7a 5 1 2024-08-31T05:21:07.022 INFO:tasks.workunit.client.0.smithi067.stdout:6/56: creat f14 x:0 0 0 2024-08-31T05:21:07.023 INFO:tasks.workunit.client.1.smithi073.stdout:6/683: truncate d15/d17/f5c 3586228 0 2024-08-31T05:21:07.024 INFO:tasks.workunit.client.0.smithi067.stdout:3/55: creat db/f14 x:0 0 0 2024-08-31T05:21:07.026 INFO:tasks.workunit.client.1.smithi073.stdout:4/617: symlink d7/lb8 0 2024-08-31T05:21:07.026 INFO:tasks.workunit.client.0.smithi067.stdout:8/80: link d0/d2/d6/lb d0/d2/dc/l13 0 2024-08-31T05:21:07.028 INFO:tasks.workunit.client.1.smithi073.stdout:7/634: symlink d1/da/d15/lcf 0 2024-08-31T05:21:07.028 INFO:tasks.workunit.client.1.smithi073.stdout:3/735: dwrite da/d3c/d65/d2c/f48 [0,4194304] 0 2024-08-31T05:21:07.029 INFO:tasks.workunit.client.0.smithi067.stdout:9/36: rename f0 to f7 0 2024-08-31T05:21:07.030 INFO:tasks.workunit.client.0.smithi067.stdout:7/35: dwrite f6 [0,4194304] 0 2024-08-31T05:21:07.032 INFO:tasks.workunit.client.0.smithi067.stdout:9/37: truncate f6 882888 0 2024-08-31T05:21:07.032 INFO:tasks.workunit.client.0.smithi067.stdout:7/36: write f8 [997989,92885] 0 2024-08-31T05:21:07.037 INFO:tasks.workunit.client.0.smithi067.stdout:8/81: dread d0/d4/de/f11 [0,4194304] 0 2024-08-31T05:21:07.038 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:06 smithi067 ceph-mon[17432]: pgmap v24: 65 pgs: 65 active+clean; 1.4 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 55 MiB/s rd, 198 MiB/s wr, 451 op/s 2024-08-31T05:21:07.039 INFO:tasks.workunit.client.1.smithi073.stdout:7/635: dread d1/da/d3e/d22/f27 [0,4194304] 0 2024-08-31T05:21:07.039 INFO:tasks.workunit.client.1.smithi073.stdout:5/879: rename dc/d16/d1a/d87/fa8 to dc/d16/d1a/f120 0 2024-08-31T05:21:07.040 INFO:tasks.workunit.client.0.smithi067.stdout:2/31: symlink l5 0 2024-08-31T05:21:07.043 INFO:tasks.workunit.client.1.smithi073.stdout:9/785: creat dc/d37/d42/d8d/d52/f104 x:0 0 0 2024-08-31T05:21:07.044 INFO:tasks.workunit.client.0.smithi067.stdout:7/37: dwrite f7 [0,4194304] 0 2024-08-31T05:21:07.044 INFO:tasks.workunit.client.1.smithi073.stdout:9/786: dread - dc/d37/d42/d5a/d89/db8/dd3/fdd zero size 2024-08-31T05:21:07.045 INFO:tasks.workunit.client.1.smithi073.stdout:9/787: chown dc/d37/d42/d8d/d52/d5f/f71 390193 1 2024-08-31T05:21:07.046 INFO:tasks.workunit.client.1.smithi073.stdout:9/788: fdatasync dc/d37/d42/d5a/da0/dcd/ff6 0 2024-08-31T05:21:07.047 INFO:tasks.workunit.client.0.smithi067.stdout:9/38: symlink l8 0 2024-08-31T05:21:07.047 INFO:tasks.workunit.client.1.smithi073.stdout:7/636: mknod d1/d11/dcc/cd0 0 2024-08-31T05:21:07.047 INFO:tasks.workunit.client.0.smithi067.stdout:9/39: write f4 [1358631,573] 0 2024-08-31T05:21:07.049 INFO:tasks.workunit.client.0.smithi067.stdout:9/40: chown f4 434 1 2024-08-31T05:21:07.051 INFO:tasks.workunit.client.1.smithi073.stdout:3/736: unlink da/d3c/d65/ce6 0 2024-08-31T05:21:07.055 INFO:tasks.workunit.client.1.smithi073.stdout:8/685: rename d0/db/d1c/d24/c4a to d0/db/d1c/d34/d68/d9d/cd0 0 2024-08-31T05:21:07.061 INFO:tasks.workunit.client.1.smithi073.stdout:6/684: creat d15/d1a/d2b/d2f/d4b/fd9 x:0 0 0 2024-08-31T05:21:07.067 INFO:tasks.workunit.client.1.smithi073.stdout:7/637: fsync d1/da/d3e/d22/d5c/fcd 0 2024-08-31T05:21:07.068 INFO:tasks.workunit.client.1.smithi073.stdout:7/638: fdatasync d1/da/d3e/d22/d35/f9c 0 2024-08-31T05:21:07.069 INFO:tasks.workunit.client.1.smithi073.stdout:2/670: dwrite d2/d9/df/f3b [0,4194304] 0 2024-08-31T05:21:07.071 INFO:tasks.workunit.client.1.smithi073.stdout:3/737: mknod da/d3c/d82/d86/cf0 0 2024-08-31T05:21:07.075 INFO:tasks.workunit.client.1.smithi073.stdout:0/689: rename d0/d28/d4f to d0/d15/d2c/d4d/d3c/d9c/de4 0 2024-08-31T05:21:07.076 INFO:tasks.workunit.client.1.smithi073.stdout:0/690: dread d0/d58/d63/f7d [0,4194304] 0 2024-08-31T05:21:07.078 INFO:tasks.workunit.client.1.smithi073.stdout:8/686: fsync d0/db/d1c/d2a/d58/f7a 0 2024-08-31T05:21:07.080 INFO:tasks.workunit.client.1.smithi073.stdout:6/685: creat d15/d1a/d2b/d2f/d99/fda x:0 0 0 2024-08-31T05:21:07.081 INFO:tasks.workunit.client.1.smithi073.stdout:5/880: creat dc/d3d/dab/dff/d49/dd2/d111/f121 x:0 0 0 2024-08-31T05:21:07.101 INFO:tasks.workunit.client.1.smithi073.stdout:6/686: truncate d15/d17/da1/dae/db0/d38/d9b/f81 353854 0 2024-08-31T05:21:07.101 INFO:tasks.workunit.client.1.smithi073.stdout:9/789: mkdir dc/d37/d42/d5a/da0/dcd/d105 0 2024-08-31T05:21:07.102 INFO:tasks.workunit.client.1.smithi073.stdout:7/639: unlink d1/da/d3e/d22/f75 0 2024-08-31T05:21:07.102 INFO:tasks.workunit.client.1.smithi073.stdout:5/881: write dc/d3d/dab/fdc [3271207,2518] 0 2024-08-31T05:21:07.103 INFO:tasks.workunit.client.1.smithi073.stdout:4/618: mkdir d7/d1a/d5c/d6d/d59/d65/db9 0 2024-08-31T05:21:07.103 INFO:tasks.workunit.client.1.smithi073.stdout:7/640: write d1/da/f7b [3760893,105727] 0 2024-08-31T05:21:07.141 INFO:tasks.workunit.client.0.smithi067.stdout:2/32: mknod c6 0 2024-08-31T05:21:07.141 INFO:tasks.workunit.client.0.smithi067.stdout:3/56: mknod db/d11/c15 0 2024-08-31T05:21:07.142 INFO:tasks.workunit.client.0.smithi067.stdout:7/38: creat fb x:0 0 0 2024-08-31T05:21:07.142 INFO:tasks.workunit.client.0.smithi067.stdout:6/57: write f3 [4841083,42555] 0 2024-08-31T05:21:07.143 INFO:tasks.workunit.client.0.smithi067.stdout:9/41: mknod c9 0 2024-08-31T05:21:07.143 INFO:tasks.workunit.client.0.smithi067.stdout:2/33: write f4 [1080373,94888] 0 2024-08-31T05:21:07.143 INFO:tasks.workunit.client.0.smithi067.stdout:8/82: mkdir d0/d2/da/d14 0 2024-08-31T05:21:07.144 INFO:tasks.workunit.client.0.smithi067.stdout:7/39: read f9 [3030404,36454] 0 2024-08-31T05:21:07.144 INFO:tasks.workunit.client.0.smithi067.stdout:9/42: fdatasync f4 0 2024-08-31T05:21:07.145 INFO:tasks.workunit.client.0.smithi067.stdout:1/39: write f0 [1815430,95299] 0 2024-08-31T05:21:07.146 INFO:tasks.workunit.client.1.smithi073.stdout:6/687: mkdir d15/d1a/d51/d6e/ddb 0 2024-08-31T05:21:07.147 INFO:tasks.workunit.client.1.smithi073.stdout:3/738: rename da/d3c/d65/l7d to da/d3c/d67/dd9/lf1 0 2024-08-31T05:21:07.147 INFO:tasks.workunit.client.0.smithi067.stdout:2/34: write f4 [2127945,89443] 0 2024-08-31T05:21:07.148 INFO:tasks.workunit.client.1.smithi073.stdout:1/626: sync 2024-08-31T05:21:07.148 INFO:tasks.workunit.client.1.smithi073.stdout:7/641: chown d1/da/d15/c3d 0 1 2024-08-31T05:21:07.148 INFO:tasks.workunit.client.0.smithi067.stdout:2/35: read f4 [2134050,32549] 0 2024-08-31T05:21:07.150 INFO:tasks.workunit.client.0.smithi067.stdout:7/40: mknod cc 0 2024-08-31T05:21:07.151 INFO:tasks.workunit.client.1.smithi073.stdout:3/739: fsync da/d3c/d65/d2c/d8e/f9c 0 2024-08-31T05:21:07.151 INFO:tasks.workunit.client.0.smithi067.stdout:7/41: stat f3 0 2024-08-31T05:21:07.151 INFO:tasks.workunit.client.0.smithi067.stdout:8/83: dread d0/f9 [0,4194304] 0 2024-08-31T05:21:07.151 INFO:tasks.workunit.client.1.smithi073.stdout:1/627: read d5/d10/d33/f90 [2191497,35922] 0 2024-08-31T05:21:07.152 INFO:tasks.workunit.client.1.smithi073.stdout:5/882: rename dc/d16/d3b/f73 to dc/d16/d1a/db7/deb/d115/f122 0 2024-08-31T05:21:07.152 INFO:tasks.workunit.client.1.smithi073.stdout:9/790: dwrite dc/d37/d42/f64 [4194304,4194304] 0 2024-08-31T05:21:07.153 INFO:tasks.workunit.client.0.smithi067.stdout:1/40: mkdir d3/db 0 2024-08-31T05:21:07.155 INFO:tasks.workunit.client.0.smithi067.stdout:9/43: creat fa x:0 0 0 2024-08-31T05:21:07.156 INFO:tasks.workunit.client.1.smithi073.stdout:8/687: getdents d0/db/d1c/d2a/d58 0 2024-08-31T05:21:07.159 INFO:tasks.workunit.client.1.smithi073.stdout:6/688: mkdir d15/d1a/d51/d61/ddc 0 2024-08-31T05:21:07.160 INFO:tasks.workunit.client.0.smithi067.stdout:3/57: creat db/d12/f16 x:0 0 0 2024-08-31T05:21:07.168 INFO:tasks.workunit.client.0.smithi067.stdout:2/36: unlink l0 0 2024-08-31T05:21:07.168 INFO:tasks.workunit.client.1.smithi073.stdout:1/628: dread d5/f65 [4194304,4194304] 0 2024-08-31T05:21:07.169 INFO:tasks.workunit.client.0.smithi067.stdout:8/84: truncate d0/d4/de/f11 1245121 0 2024-08-31T05:21:07.169 INFO:tasks.workunit.client.1.smithi073.stdout:9/791: truncate dc/d27/f38 751035 0 2024-08-31T05:21:07.171 INFO:tasks.workunit.client.0.smithi067.stdout:1/41: unlink f0 0 2024-08-31T05:21:07.172 INFO:tasks.workunit.client.0.smithi067.stdout:8/85: dread d0/f9 [0,4194304] 0 2024-08-31T05:21:07.173 INFO:tasks.workunit.client.0.smithi067.stdout:9/44: mknod cb 0 2024-08-31T05:21:07.173 INFO:tasks.workunit.client.0.smithi067.stdout:8/86: write d0/d2/f3 [15866,120411] 0 2024-08-31T05:21:07.174 INFO:tasks.workunit.client.0.smithi067.stdout:8/87: chown d0/d2/da 2915143 1 2024-08-31T05:21:07.180 INFO:tasks.workunit.client.0.smithi067.stdout:3/58: mkdir db/d17 0 2024-08-31T05:21:07.184 INFO:tasks.workunit.client.0.smithi067.stdout:2/37: creat f7 x:0 0 0 2024-08-31T05:21:07.189 INFO:tasks.workunit.client.0.smithi067.stdout:1/42: creat d3/fc x:0 0 0 2024-08-31T05:21:07.191 INFO:tasks.workunit.client.0.smithi067.stdout:6/58: truncate ff 226242 0 2024-08-31T05:21:07.192 INFO:tasks.workunit.client.0.smithi067.stdout:9/45: mknod cc 0 2024-08-31T05:21:07.192 INFO:tasks.workunit.client.0.smithi067.stdout:9/46: truncate f6 1675592 0 2024-08-31T05:21:07.198 INFO:tasks.workunit.client.0.smithi067.stdout:3/59: creat db/d12/f18 x:0 0 0 2024-08-31T05:21:07.198 INFO:tasks.workunit.client.0.smithi067.stdout:2/38: symlink l8 0 2024-08-31T05:21:07.198 INFO:tasks.workunit.client.0.smithi067.stdout:1/43: mkdir d3/dd 0 2024-08-31T05:21:07.199 INFO:tasks.workunit.client.0.smithi067.stdout:6/59: symlink l15 0 2024-08-31T05:21:07.199 INFO:tasks.workunit.client.0.smithi067.stdout:8/88: dwrite d0/f9 [0,4194304] 0 2024-08-31T05:21:07.200 INFO:tasks.workunit.client.0.smithi067.stdout:9/47: mkdir dd 0 2024-08-31T05:21:07.201 INFO:tasks.workunit.client.0.smithi067.stdout:9/48: fsync f6 0 2024-08-31T05:21:07.203 INFO:tasks.workunit.client.0.smithi067.stdout:2/39: symlink l9 0 2024-08-31T05:21:07.204 INFO:tasks.workunit.client.0.smithi067.stdout:9/49: fsync f6 0 2024-08-31T05:21:07.205 INFO:tasks.workunit.client.0.smithi067.stdout:3/60: dwrite db/fd [0,4194304] 0 2024-08-31T05:21:07.206 INFO:tasks.workunit.client.0.smithi067.stdout:6/60: unlink f8 0 2024-08-31T05:21:07.209 INFO:tasks.workunit.client.0.smithi067.stdout:8/89: dread d0/d2/f3 [0,4194304] 0 2024-08-31T05:21:07.210 INFO:tasks.workunit.client.0.smithi067.stdout:2/40: unlink f7 0 2024-08-31T05:21:07.211 INFO:tasks.workunit.client.0.smithi067.stdout:0/68: sync 2024-08-31T05:21:07.212 INFO:tasks.workunit.client.0.smithi067.stdout:6/61: write fd [506021,84477] 0 2024-08-31T05:21:07.212 INFO:tasks.workunit.client.0.smithi067.stdout:6/62: rmdir - no directory 2024-08-31T05:21:07.213 INFO:tasks.workunit.client.0.smithi067.stdout:6/63: dread - f7 zero size 2024-08-31T05:21:07.213 INFO:tasks.workunit.client.0.smithi067.stdout:3/61: creat db/d11/f19 x:0 0 0 2024-08-31T05:21:07.215 INFO:tasks.workunit.client.0.smithi067.stdout:1/44: rmdir d3/db 0 2024-08-31T05:21:07.216 INFO:tasks.workunit.client.0.smithi067.stdout:9/50: getdents dd 0 2024-08-31T05:21:07.216 INFO:tasks.workunit.client.0.smithi067.stdout:1/45: chown d3/f6 1740433 1 2024-08-31T05:21:07.217 INFO:tasks.workunit.client.0.smithi067.stdout:6/64: mknod c16 0 2024-08-31T05:21:07.217 INFO:tasks.workunit.client.0.smithi067.stdout:1/46: write d3/fc [798459,94757] 0 2024-08-31T05:21:07.218 INFO:tasks.workunit.client.0.smithi067.stdout:3/62: mknod db/d17/c1a 0 2024-08-31T05:21:07.219 INFO:tasks.workunit.client.0.smithi067.stdout:6/65: mknod c17 0 2024-08-31T05:21:07.220 INFO:tasks.workunit.client.0.smithi067.stdout:3/63: dread db/fc [0,4194304] 0 2024-08-31T05:21:07.220 INFO:tasks.workunit.client.0.smithi067.stdout:6/66: dread - f10 zero size 2024-08-31T05:21:07.221 INFO:tasks.workunit.client.0.smithi067.stdout:8/90: creat d0/d2/f15 x:0 0 0 2024-08-31T05:21:07.221 INFO:tasks.workunit.client.0.smithi067.stdout:3/64: dread - db/d11/f19 zero size 2024-08-31T05:21:07.222 INFO:tasks.workunit.client.0.smithi067.stdout:2/41: dread f4 [0,4194304] 0 2024-08-31T05:21:07.223 INFO:tasks.workunit.client.0.smithi067.stdout:2/42: read f1 [1490571,29903] 0 2024-08-31T05:21:07.225 INFO:tasks.workunit.client.0.smithi067.stdout:8/91: creat d0/d2/dc/f16 x:0 0 0 2024-08-31T05:21:07.226 INFO:tasks.workunit.client.0.smithi067.stdout:3/65: mknod db/d17/c1b 0 2024-08-31T05:21:07.228 INFO:tasks.workunit.client.0.smithi067.stdout:3/66: chown l2 2 1 2024-08-31T05:21:07.228 INFO:tasks.workunit.client.0.smithi067.stdout:6/67: dread f1 [0,4194304] 0 2024-08-31T05:21:07.229 INFO:tasks.workunit.client.0.smithi067.stdout:6/68: readlink l15 0 2024-08-31T05:21:07.229 INFO:tasks.workunit.client.0.smithi067.stdout:3/67: fsync db/f10 0 2024-08-31T05:21:07.229 INFO:tasks.workunit.client.1.smithi073.stdout:8/688: creat d0/db/d1c/d2a/d58/fd1 x:0 0 0 2024-08-31T05:21:07.230 INFO:tasks.workunit.client.1.smithi073.stdout:6/689: creat d15/d1a/d51/d61/fdd x:0 0 0 2024-08-31T05:21:07.230 INFO:tasks.workunit.client.1.smithi073.stdout:4/619: write d7/df/f56 [2463956,103255] 0 2024-08-31T05:21:07.230 INFO:tasks.workunit.client.1.smithi073.stdout:8/689: stat d0/c1e 0 2024-08-31T05:21:07.230 INFO:tasks.workunit.client.1.smithi073.stdout:6/690: chown d15/d17/fba 1487 1 2024-08-31T05:21:07.230 INFO:tasks.workunit.client.1.smithi073.stdout:1/629: write d5/d26/d54/d5f/fa8 [715704,51760] 0 2024-08-31T05:21:07.231 INFO:tasks.workunit.client.1.smithi073.stdout:1/630: read - d5/d10/d1c/f83 zero size 2024-08-31T05:21:07.232 INFO:tasks.workunit.client.1.smithi073.stdout:6/691: write d15/d1a/d2b/d2f/d4b/f6b [760462,57047] 0 2024-08-31T05:21:07.232 INFO:tasks.workunit.client.1.smithi073.stdout:9/792: creat dc/de/d56/f106 x:0 0 0 2024-08-31T05:21:07.232 INFO:tasks.workunit.client.1.smithi073.stdout:1/631: chown d5/d17/d32/d37/f8a 5 1 2024-08-31T05:21:07.233 INFO:tasks.workunit.client.0.smithi067.stdout:8/92: rmdir d0/d2/da 39 2024-08-31T05:21:07.235 INFO:tasks.workunit.client.0.smithi067.stdout:8/93: write d0/d2/dc/f16 [256324,15171] 0 2024-08-31T05:21:07.236 INFO:tasks.workunit.client.0.smithi067.stdout:3/68: dwrite db/d12/f18 [0,4194304] 0 2024-08-31T05:21:07.237 INFO:tasks.workunit.client.0.smithi067.stdout:8/94: write d0/f9 [5044160,3194] 0 2024-08-31T05:21:07.239 INFO:tasks.workunit.client.1.smithi073.stdout:8/690: mkdir d0/db/d1c/d34/d68/dd2 0 2024-08-31T05:21:07.240 INFO:tasks.workunit.client.1.smithi073.stdout:4/620: write d7/df/d13/d2e/d70/d6b/f7e [916645,4316] 0 2024-08-31T05:21:07.242 INFO:tasks.workunit.client.0.smithi067.stdout:3/69: symlink db/d17/l1c 0 2024-08-31T05:21:07.245 INFO:tasks.workunit.client.0.smithi067.stdout:8/95: symlink d0/d2/dc/l17 0 2024-08-31T05:21:07.246 INFO:tasks.workunit.client.1.smithi073.stdout:9/793: rmdir dc/d37/d42/d8d/d52 39 2024-08-31T05:21:07.247 INFO:tasks.workunit.client.0.smithi067.stdout:3/70: mknod db/c1d 0 2024-08-31T05:21:07.249 INFO:tasks.workunit.client.0.smithi067.stdout:3/71: dread db/fc [0,4194304] 0 2024-08-31T05:21:07.249 INFO:tasks.workunit.client.1.smithi073.stdout:1/632: mkdir d5/d26/d54/db2 0 2024-08-31T05:21:07.250 INFO:tasks.workunit.client.0.smithi067.stdout:8/96: readlink d0/l1 0 2024-08-31T05:21:07.250 INFO:tasks.workunit.client.1.smithi073.stdout:7/642: getdents d1/da/d3e/db1 0 2024-08-31T05:21:07.252 INFO:tasks.workunit.client.1.smithi073.stdout:3/740: getdents da/d3c/d82/d86 0 2024-08-31T05:21:07.253 INFO:tasks.workunit.client.1.smithi073.stdout:3/741: readlink da/d3c/d65/d2c/d8e/la5 0 2024-08-31T05:21:07.254 INFO:tasks.workunit.client.0.smithi067.stdout:8/97: symlink d0/d4/de/l18 0 2024-08-31T05:21:07.255 INFO:tasks.workunit.client.1.smithi073.stdout:8/691: mknod d0/db/d44/d9e/cd3 0 2024-08-31T05:21:07.256 INFO:tasks.workunit.client.1.smithi073.stdout:4/621: mknod d7/d1a/d5c/d6d/d59/d86/cba 0 2024-08-31T05:21:07.256 INFO:tasks.workunit.client.1.smithi073.stdout:8/692: stat d0/db/d1c/d34 0 2024-08-31T05:21:07.256 INFO:tasks.workunit.client.1.smithi073.stdout:7/643: dwrite d1/da/d3e/d22/d47/da8/fbf [0,4194304] 0 2024-08-31T05:21:07.258 INFO:tasks.workunit.client.1.smithi073.stdout:9/794: mknod dc/d37/d42/d8d/de8/c107 0 2024-08-31T05:21:07.258 INFO:tasks.workunit.client.1.smithi073.stdout:4/622: chown d7/d1a/d5c/d6d/d59/d86/fb7 1989110 1 2024-08-31T05:21:07.258 INFO:tasks.workunit.client.1.smithi073.stdout:9/795: fsync dc/de/dd8/ff8 0 2024-08-31T05:21:07.259 INFO:tasks.workunit.client.0.smithi067.stdout:3/72: dwrite db/fd [4194304,4194304] 0 2024-08-31T05:21:07.262 INFO:tasks.workunit.client.0.smithi067.stdout:3/73: write db/d11/f19 [448837,53731] 0 2024-08-31T05:21:07.263 INFO:tasks.workunit.client.1.smithi073.stdout:3/742: creat da/d3c/d5a/db8/ff2 x:0 0 0 2024-08-31T05:21:07.264 INFO:tasks.workunit.client.1.smithi073.stdout:3/743: write da/d3c/d65/d45/f56 [271129,23538] 0 2024-08-31T05:21:07.265 INFO:tasks.workunit.client.0.smithi067.stdout:8/98: symlink d0/d4/de/l19 0 2024-08-31T05:21:07.265 INFO:tasks.workunit.client.0.smithi067.stdout:1/47: dwrite d3/f5 [0,4194304] 0 2024-08-31T05:21:07.269 INFO:tasks.workunit.client.0.smithi067.stdout:2/43: dwrite f1 [4194304,4194304] 0 2024-08-31T05:21:07.271 INFO:tasks.workunit.client.1.smithi073.stdout:2/671: sync 2024-08-31T05:21:07.271 INFO:tasks.workunit.client.1.smithi073.stdout:2/672: readlink d2/d9/d27/d76/lbd 0 2024-08-31T05:21:07.272 INFO:tasks.workunit.client.1.smithi073.stdout:2/673: chown d2/d9/f24 48 1 2024-08-31T05:21:07.273 INFO:tasks.workunit.client.1.smithi073.stdout:2/674: chown d2/d9/d7f/f83 217 1 2024-08-31T05:21:07.273 INFO:tasks.workunit.client.0.smithi067.stdout:3/74: mknod db/d17/c1e 0 2024-08-31T05:21:07.281 INFO:tasks.workunit.client.0.smithi067.stdout:2/44: dwrite f1 [0,4194304] 0 2024-08-31T05:21:07.282 INFO:tasks.workunit.client.1.smithi073.stdout:4/623: creat d7/d1a/d5c/d6d/d2c/fbb x:0 0 0 2024-08-31T05:21:07.283 INFO:tasks.workunit.client.0.smithi067.stdout:2/45: dread f1 [0,4194304] 0 2024-08-31T05:21:07.284 INFO:tasks.workunit.client.1.smithi073.stdout:9/796: chown dc/d37/d42/d8d/d52/d5f/f91 2543938 1 2024-08-31T05:21:07.286 INFO:tasks.workunit.client.0.smithi067.stdout:3/75: creat db/d12/f1f x:0 0 0 2024-08-31T05:21:07.287 INFO:tasks.workunit.client.0.smithi067.stdout:8/99: mknod d0/d2/da/c1a 0 2024-08-31T05:21:07.288 INFO:tasks.workunit.client.0.smithi067.stdout:1/48: creat d3/dd/fe x:0 0 0 2024-08-31T05:21:07.293 INFO:tasks.workunit.client.1.smithi073.stdout:8/693: write d0/f1a [2335787,78322] 0 2024-08-31T05:21:07.295 INFO:tasks.workunit.client.0.smithi067.stdout:3/76: rename db/d17/c1a to db/c20 0 2024-08-31T05:21:07.297 INFO:tasks.workunit.client.0.smithi067.stdout:3/77: write db/d12/f16 [180621,35328] 0 2024-08-31T05:21:07.297 INFO:tasks.workunit.client.0.smithi067.stdout:3/78: chown db/d17 2884379 1 2024-08-31T05:21:07.297 INFO:tasks.workunit.client.1.smithi073.stdout:2/675: dwrite d2/d9/df/f1a [0,4194304] 0 2024-08-31T05:21:07.298 INFO:tasks.workunit.client.1.smithi073.stdout:1/633: truncate d5/d17/d3f/f7d 1992676 0 2024-08-31T05:21:07.298 INFO:tasks.workunit.client.1.smithi073.stdout:2/676: chown d2/d9/d3c/ca9 6483810 1 2024-08-31T05:21:07.298 INFO:tasks.workunit.client.1.smithi073.stdout:1/634: write d5/d10/d1b/f41 [1217309,17540] 0 2024-08-31T05:21:07.299 INFO:tasks.workunit.client.0.smithi067.stdout:8/100: creat d0/d2/d6/f1b x:0 0 0 2024-08-31T05:21:07.301 INFO:tasks.workunit.client.1.smithi073.stdout:6/692: getdents d15/d1a/d1e 0 2024-08-31T05:21:07.303 INFO:tasks.workunit.client.1.smithi073.stdout:1/635: read d5/d10/d33/d13/d7e/fae [3693844,20696] 0 2024-08-31T05:21:07.303 INFO:tasks.workunit.client.1.smithi073.stdout:7/644: link d1/da/d3e/d22/d47/l82 d1/da/db2/dba/ld1 0 2024-08-31T05:21:07.305 INFO:tasks.workunit.client.1.smithi073.stdout:2/677: dwrite d2/d9/d27/d9b/da6/fcf [0,4194304] 0 2024-08-31T05:21:07.306 INFO:tasks.workunit.client.0.smithi067.stdout:8/101: stat d0/d4/de/f11 0 2024-08-31T05:21:07.306 INFO:tasks.workunit.client.1.smithi073.stdout:1/636: write d5/d10/d1b/fad [142556,121213] 0 2024-08-31T05:21:07.307 INFO:tasks.workunit.client.0.smithi067.stdout:3/79: dwrite db/f10 [0,4194304] 0 2024-08-31T05:21:07.308 INFO:tasks.workunit.client.0.smithi067.stdout:3/80: chown db/d17/c1b 341428 1 2024-08-31T05:21:07.309 INFO:tasks.workunit.client.0.smithi067.stdout:1/49: link d3/l9 d3/lf 0 2024-08-31T05:21:07.312 INFO:tasks.workunit.client.0.smithi067.stdout:3/81: readlink db/le 0 2024-08-31T05:21:07.314 INFO:tasks.workunit.client.1.smithi073.stdout:7/645: dwrite d1/da/d65/f7e [4194304,4194304] 0 2024-08-31T05:21:07.315 INFO:tasks.workunit.client.0.smithi067.stdout:2/46: write f4 [2164500,115681] 0 2024-08-31T05:21:07.317 INFO:tasks.workunit.client.0.smithi067.stdout:2/47: read f4 [446661,74857] 0 2024-08-31T05:21:07.319 INFO:tasks.workunit.client.0.smithi067.stdout:1/50: dwrite f1 [0,4194304] 0 2024-08-31T05:21:07.320 INFO:tasks.workunit.client.1.smithi073.stdout:0/691: sync 2024-08-31T05:21:07.322 INFO:tasks.workunit.client.0.smithi067.stdout:3/82: dread db/fd [0,4194304] 0 2024-08-31T05:21:07.323 INFO:tasks.workunit.client.1.smithi073.stdout:4/624: dread d7/df/d79/faf [0,4194304] 0 2024-08-31T05:21:07.324 INFO:tasks.workunit.client.1.smithi073.stdout:3/744: truncate da/d3c/d67/db7/fdc 117671 0 2024-08-31T05:21:07.328 INFO:tasks.workunit.client.1.smithi073.stdout:8/694: symlink d0/db/d44/ld4 0 2024-08-31T05:21:07.332 INFO:tasks.workunit.client.0.smithi067.stdout:1/51: dwrite d3/f6 [0,4194304] 0 2024-08-31T05:21:07.333 INFO:tasks.workunit.client.0.smithi067.stdout:1/52: chown d3 2500 1 2024-08-31T05:21:07.334 INFO:tasks.workunit.client.0.smithi067.stdout:8/102: link d0/d4/de/f11 d0/d2/dc/f1c 0 2024-08-31T05:21:07.334 INFO:tasks.workunit.client.1.smithi073.stdout:0/692: creat d0/d15/d9b/fe5 x:0 0 0 2024-08-31T05:21:07.335 INFO:tasks.workunit.client.1.smithi073.stdout:4/625: creat d7/d1a/d5c/d6d/d59/d86/fbc x:0 0 0 2024-08-31T05:21:07.339 INFO:tasks.workunit.client.1.smithi073.stdout:9/797: getdents dc/d37/d42/d8d 0 2024-08-31T05:21:07.340 INFO:tasks.workunit.client.1.smithi073.stdout:0/693: read d0/f29 [2757777,5141] 0 2024-08-31T05:21:07.340 INFO:tasks.workunit.client.0.smithi067.stdout:1/53: rename d3/fc to d3/f10 0 2024-08-31T05:21:07.341 INFO:tasks.workunit.client.0.smithi067.stdout:8/103: mkdir d0/d4/de/d1d 0 2024-08-31T05:21:07.345 INFO:tasks.workunit.client.0.smithi067.stdout:1/54: dread f2 [0,4194304] 0 2024-08-31T05:21:07.346 INFO:tasks.workunit.client.1.smithi073.stdout:4/626: rmdir d7/d1a/d5c/d6d 39 2024-08-31T05:21:07.348 INFO:tasks.workunit.client.0.smithi067.stdout:1/55: creat d3/f11 x:0 0 0 2024-08-31T05:21:07.349 INFO:tasks.workunit.client.1.smithi073.stdout:2/678: dread d2/f19 [0,4194304] 0 2024-08-31T05:21:07.350 INFO:tasks.workunit.client.1.smithi073.stdout:7/646: dread d1/da/d3e/d22/d5c/f8b [0,4194304] 0 2024-08-31T05:21:07.350 INFO:tasks.workunit.client.1.smithi073.stdout:7/647: stat d1/da/la2 0 2024-08-31T05:21:07.353 INFO:tasks.workunit.client.0.smithi067.stdout:1/56: dread d3/f5 [0,4194304] 0 2024-08-31T05:21:07.354 INFO:tasks.workunit.client.1.smithi073.stdout:1/637: dread d5/d10/d33/f30 [0,4194304] 0 2024-08-31T05:21:07.354 INFO:tasks.workunit.client.0.smithi067.stdout:1/57: write f1 [2217875,111300] 0 2024-08-31T05:21:07.358 INFO:tasks.workunit.client.0.smithi067.stdout:1/58: creat d3/dd/f12 x:0 0 0 2024-08-31T05:21:07.360 INFO:tasks.workunit.client.1.smithi073.stdout:5/883: sync 2024-08-31T05:21:07.366 INFO:tasks.workunit.client.0.smithi067.stdout:3/83: write f6 [2061541,91415] 0 2024-08-31T05:21:07.369 INFO:tasks.workunit.client.0.smithi067.stdout:3/84: dread db/d12/f16 [0,4194304] 0 2024-08-31T05:21:07.369 INFO:tasks.workunit.client.1.smithi073.stdout:6/693: dwrite d15/d1a/d2b/d2f/d4b/d88/fbb [0,4194304] 0 2024-08-31T05:21:07.369 INFO:tasks.workunit.client.1.smithi073.stdout:6/694: readlink d15/l21 0 2024-08-31T05:21:07.370 INFO:tasks.workunit.client.1.smithi073.stdout:8/695: creat d0/db/d44/d72/d75/fd5 x:0 0 0 2024-08-31T05:21:07.371 INFO:tasks.workunit.client.0.smithi067.stdout:2/48: truncate f1 5477930 0 2024-08-31T05:21:07.376 INFO:tasks.workunit.client.0.smithi067.stdout:3/85: rename db/d11 to db/d12/d21 0 2024-08-31T05:21:07.377 INFO:tasks.workunit.client.1.smithi073.stdout:3/745: dwrite da/d68/f69 [0,4194304] 0 2024-08-31T05:21:07.377 INFO:tasks.workunit.client.1.smithi073.stdout:3/746: fdatasync da/d18/f2a 0 2024-08-31T05:21:07.377 INFO:tasks.workunit.client.1.smithi073.stdout:0/694: fdatasync d0/d15/d2c/d4d/f54 0 2024-08-31T05:21:07.379 INFO:tasks.workunit.client.0.smithi067.stdout:2/49: mknod ca 0 2024-08-31T05:21:07.389 INFO:tasks.workunit.client.1.smithi073.stdout:8/696: symlink d0/db/d1c/d24/d73/db0/ld6 0 2024-08-31T05:21:07.389 INFO:tasks.workunit.client.0.smithi067.stdout:8/104: dwrite d0/d2/dc/f1c [0,4194304] 0 2024-08-31T05:21:07.392 INFO:tasks.workunit.client.1.smithi073.stdout:6/695: rename d15/d17/da1/dae/db0/l79 to d15/d1a/d1e/d69/d7e/lde 0 2024-08-31T05:21:07.401 INFO:tasks.workunit.client.0.smithi067.stdout:8/105: dwrite d0/d4/de/f11 [0,4194304] 0 2024-08-31T05:21:07.401 INFO:tasks.workunit.client.1.smithi073.stdout:6/696: dread d15/d1a/d2b/d6a/f94 [0,4194304] 0 2024-08-31T05:21:07.402 INFO:tasks.workunit.client.1.smithi073.stdout:3/747: creat da/d3c/d65/d45/deb/ff3 x:0 0 0 2024-08-31T05:21:07.402 INFO:tasks.workunit.client.1.smithi073.stdout:0/695: unlink d0/d15/d2c/d4d/d3c/f13 0 2024-08-31T05:21:07.405 INFO:tasks.workunit.client.1.smithi073.stdout:1/638: creat d5/d17/d3f/d9f/fb3 x:0 0 0 2024-08-31T05:21:07.405 INFO:tasks.workunit.client.1.smithi073.stdout:6/697: dwrite d15/d1a/d1e/f24 [8388608,4194304] 0 2024-08-31T05:21:07.408 INFO:tasks.workunit.client.0.smithi067.stdout:8/106: creat d0/d2/f1e x:0 0 0 2024-08-31T05:21:07.409 INFO:tasks.workunit.client.0.smithi067.stdout:1/59: dwrite d3/f6 [4194304,4194304] 0 2024-08-31T05:21:07.409 INFO:tasks.workunit.client.1.smithi073.stdout:0/696: dwrite d0/f7a [0,4194304] 0 2024-08-31T05:21:07.410 INFO:tasks.workunit.client.0.smithi067.stdout:1/60: readlink d3/la 0 2024-08-31T05:21:07.414 INFO:tasks.workunit.client.1.smithi073.stdout:9/798: dwrite dc/d37/f54 [0,4194304] 0 2024-08-31T05:21:07.417 INFO:tasks.workunit.client.0.smithi067.stdout:8/107: mkdir d0/d2/da/dd/d1f 0 2024-08-31T05:21:07.418 INFO:tasks.workunit.client.0.smithi067.stdout:8/108: chown d0/d4/de/l19 5664152 1 2024-08-31T05:21:07.420 INFO:tasks.workunit.client.0.smithi067.stdout:1/61: creat d3/f13 x:0 0 0 2024-08-31T05:21:07.422 INFO:tasks.workunit.client.1.smithi073.stdout:3/748: dwrite da/d3c/d65/d45/f55 [0,4194304] 0 2024-08-31T05:21:07.422 INFO:tasks.workunit.client.0.smithi067.stdout:3/86: write db/fd [5005189,107015] 0 2024-08-31T05:21:07.423 INFO:tasks.workunit.client.0.smithi067.stdout:8/109: dread d0/d2/dc/f16 [0,4194304] 0 2024-08-31T05:21:07.424 INFO:tasks.workunit.client.1.smithi073.stdout:3/749: truncate da/d18/da2/fc4 810791 0 2024-08-31T05:21:07.425 INFO:tasks.workunit.client.0.smithi067.stdout:8/110: fdatasync d0/d2/f1e 0 2024-08-31T05:21:07.426 INFO:tasks.workunit.client.0.smithi067.stdout:1/62: readlink d3/lf 0 2024-08-31T05:21:07.428 INFO:tasks.workunit.client.0.smithi067.stdout:2/50: truncate f4 2096514 0 2024-08-31T05:21:07.433 INFO:tasks.workunit.client.0.smithi067.stdout:8/111: creat d0/d4/f20 x:0 0 0 2024-08-31T05:21:07.434 INFO:tasks.workunit.client.1.smithi073.stdout:4/627: write d7/df/d1b/fa2 [3833598,1579] 0 2024-08-31T05:21:07.434 INFO:tasks.workunit.client.1.smithi073.stdout:0/697: rmdir d0/d15/d2c/d4d/d3c/d9c/dc8 39 2024-08-31T05:21:07.435 INFO:tasks.workunit.client.0.smithi067.stdout:8/112: write d0/d4/de/f11 [485360,70362] 0 2024-08-31T05:21:07.435 INFO:tasks.workunit.client.0.smithi067.stdout:8/113: readlink d0/d2/d6/lb 0 2024-08-31T05:21:07.436 INFO:tasks.workunit.client.0.smithi067.stdout:8/114: readlink d0/d2/d6/l7 0 2024-08-31T05:21:07.437 INFO:tasks.workunit.client.1.smithi073.stdout:9/799: mkdir dc/d37/d42/d8d/d52/d5b/d108 0 2024-08-31T05:21:07.438 INFO:tasks.workunit.client.0.smithi067.stdout:2/51: mkdir db 0 2024-08-31T05:21:07.441 INFO:tasks.workunit.client.1.smithi073.stdout:0/698: dwrite d0/d15/d2c/d41/d52/fa2 [0,4194304] 0 2024-08-31T05:21:07.441 INFO:tasks.workunit.client.1.smithi073.stdout:7/648: getdents d1/da/d3e/d22/d35 0 2024-08-31T05:21:07.444 INFO:tasks.workunit.client.1.smithi073.stdout:3/750: creat da/d3c/d82/d95/ff4 x:0 0 0 2024-08-31T05:21:07.445 INFO:tasks.workunit.client.1.smithi073.stdout:3/751: stat da/d3c/d65/d45/l54 0 2024-08-31T05:21:07.445 INFO:tasks.workunit.client.1.smithi073.stdout:5/884: getdents dc/d16/d3b/d3f/d4f/dc4 0 2024-08-31T05:21:07.447 INFO:tasks.workunit.client.1.smithi073.stdout:3/752: chown da/d3c/d65/d87/fd5 64 1 2024-08-31T05:21:07.447 INFO:tasks.workunit.client.1.smithi073.stdout:7/649: dread d1/f2e [4194304,4194304] 0 2024-08-31T05:21:07.449 INFO:tasks.workunit.client.0.smithi067.stdout:8/115: mknod d0/d2/c21 0 2024-08-31T05:21:07.451 INFO:tasks.workunit.client.1.smithi073.stdout:9/800: write dc/d27/fc7 [5732937,51458] 0 2024-08-31T05:21:07.453 INFO:tasks.workunit.client.0.smithi067.stdout:8/116: dread d0/d4/de/f11 [0,4194304] 0 2024-08-31T05:21:07.454 INFO:tasks.workunit.client.1.smithi073.stdout:5/885: rmdir dc/d16 39 2024-08-31T05:21:07.454 INFO:tasks.workunit.client.1.smithi073.stdout:1/639: link d5/d26/d54/d55/l89 d5/d17/d32/daf/db1/lb4 0 2024-08-31T05:21:07.454 INFO:tasks.workunit.client.1.smithi073.stdout:7/650: dwrite d1/da/d3e/d22/d35/d83/fc5 [0,4194304] 0 2024-08-31T05:21:07.455 INFO:tasks.workunit.client.1.smithi073.stdout:3/753: fsync da/d3c/d82/fc9 0 2024-08-31T05:21:07.456 INFO:tasks.workunit.client.1.smithi073.stdout:7/651: write d1/da/f94 [2204621,27445] 0 2024-08-31T05:21:07.458 INFO:tasks.workunit.client.1.smithi073.stdout:4/628: rename d7/d1a/d5c/d6d/d59/d65/f94 to d7/df/d13/db2/fbd 0 2024-08-31T05:21:07.468 INFO:tasks.workunit.client.1.smithi073.stdout:1/640: chown d5/d10/d1c/d27 8502 1 2024-08-31T05:21:07.470 INFO:tasks.workunit.client.0.smithi067.stdout:3/87: truncate db/f10 2698987 0 2024-08-31T05:21:07.472 INFO:tasks.workunit.client.1.smithi073.stdout:3/754: fdatasync da/d3c/d82/d97/fd0 0 2024-08-31T05:21:07.473 INFO:tasks.workunit.client.1.smithi073.stdout:3/755: write da/d68/f99 [4301606,2147] 0 2024-08-31T05:21:07.474 INFO:tasks.workunit.client.1.smithi073.stdout:3/756: chown da/d3c/d5a/d8a/c8d 84 1 2024-08-31T05:21:07.475 INFO:tasks.workunit.client.1.smithi073.stdout:3/757: read - da/d3c/d65/d2c/d8e/f9c zero size 2024-08-31T05:21:07.475 INFO:tasks.workunit.client.1.smithi073.stdout:4/629: fdatasync d7/df/d13/db2/fbd 0 2024-08-31T05:21:07.478 INFO:tasks.workunit.client.0.smithi067.stdout:2/52: dread f1 [0,4194304] 0 2024-08-31T05:21:07.478 INFO:tasks.workunit.client.0.smithi067.stdout:3/88: link db/le db/d17/l22 0 2024-08-31T05:21:07.481 INFO:tasks.workunit.client.0.smithi067.stdout:8/117: truncate d0/f9 2426191 0 2024-08-31T05:21:07.481 INFO:tasks.workunit.client.1.smithi073.stdout:7/652: getdents d1/da/d3e/db1/dbb 0 2024-08-31T05:21:07.484 INFO:tasks.workunit.client.1.smithi073.stdout:9/801: dwrite f7 [0,4194304] 0 2024-08-31T05:21:07.484 INFO:tasks.workunit.client.1.smithi073.stdout:0/699: truncate d0/f21 5898217 0 2024-08-31T05:21:07.485 INFO:tasks.workunit.client.0.smithi067.stdout:8/118: creat d0/d2/da/f22 x:0 0 0 2024-08-31T05:21:07.489 INFO:tasks.workunit.client.1.smithi073.stdout:7/653: mknod d1/d11/dcc/cd2 0 2024-08-31T05:21:07.490 INFO:tasks.workunit.client.1.smithi073.stdout:5/886: rename dc/d16/d1a/d87/d94/faa to dc/d3d/dab/dff/f123 0 2024-08-31T05:21:07.496 INFO:tasks.workunit.client.1.smithi073.stdout:0/700: dwrite d0/d69/d8e/fc3 [0,4194304] 0 2024-08-31T05:21:07.496 INFO:tasks.workunit.client.1.smithi073.stdout:9/802: dwrite dc/d37/f54 [0,4194304] 0 2024-08-31T05:21:07.497 INFO:tasks.workunit.client.1.smithi073.stdout:9/803: stat dc/l78 0 2024-08-31T05:21:07.498 INFO:tasks.workunit.client.0.smithi067.stdout:8/119: rmdir d0/d2/da/d14 0 2024-08-31T05:21:07.499 INFO:tasks.workunit.client.1.smithi073.stdout:0/701: chown d0/d15/d2c/d40/d4a/l5d 1917372 1 2024-08-31T05:21:07.500 INFO:tasks.workunit.client.0.smithi067.stdout:8/120: chown d0/d2/f15 501 1 2024-08-31T05:21:07.501 INFO:tasks.workunit.client.1.smithi073.stdout:1/641: rename d5/d10/d33/c5e to d5/d26/da5/cb5 0 2024-08-31T05:21:07.503 INFO:tasks.workunit.client.1.smithi073.stdout:3/758: dread da/d3c/d65/f20 [0,4194304] 0 2024-08-31T05:21:07.505 INFO:tasks.workunit.client.1.smithi073.stdout:7/654: dwrite d1/da/f72 [4194304,4194304] 0 2024-08-31T05:21:07.506 INFO:tasks.workunit.client.1.smithi073.stdout:3/759: write da/d3c/d65/d2c/d8e/f9c [809304,2775] 0 2024-08-31T05:21:07.508 INFO:tasks.workunit.client.0.smithi067.stdout:2/53: truncate f4 2543679 0 2024-08-31T05:21:07.509 INFO:tasks.workunit.client.1.smithi073.stdout:0/702: rmdir d0/d15/d2c/d4d 39 2024-08-31T05:21:07.511 INFO:tasks.workunit.client.0.smithi067.stdout:8/121: symlink d0/d4/de/d1d/l23 0 2024-08-31T05:21:07.515 INFO:tasks.workunit.client.0.smithi067.stdout:8/122: fsync d0/d2/dc/f1c 0 2024-08-31T05:21:07.520 INFO:tasks.workunit.client.1.smithi073.stdout:7/655: getdents d1/dc0 0 2024-08-31T05:21:07.520 INFO:tasks.workunit.client.1.smithi073.stdout:3/760: creat da/ff5 x:0 0 0 2024-08-31T05:21:07.521 INFO:tasks.workunit.client.0.smithi067.stdout:8/123: creat d0/d2/f24 x:0 0 0 2024-08-31T05:21:07.521 INFO:tasks.workunit.client.0.smithi067.stdout:8/124: chown d0/d4/de/d1d/l23 209834 1 2024-08-31T05:21:07.521 INFO:tasks.workunit.client.1.smithi073.stdout:7/656: link d1/da/d3e/d22/d5c/fcd d1/da/d15/d33/d44/d74/fd3 0 2024-08-31T05:21:07.522 INFO:tasks.workunit.client.0.smithi067.stdout:8/125: mknod d0/d4/c25 0 2024-08-31T05:21:07.523 INFO:tasks.workunit.client.1.smithi073.stdout:3/761: dread da/d3c/d65/d40/d5d/f8b [0,4194304] 0 2024-08-31T05:21:07.524 INFO:tasks.workunit.client.0.smithi067.stdout:8/126: fdatasync d0/d2/f3 0 2024-08-31T05:21:07.524 INFO:tasks.workunit.client.1.smithi073.stdout:3/762: truncate da/d3c/d67/fb6 83273 0 2024-08-31T05:21:07.525 INFO:tasks.workunit.client.1.smithi073.stdout:7/657: readlink d1/da/db2/dba/ld1 0 2024-08-31T05:21:07.526 INFO:tasks.workunit.client.1.smithi073.stdout:7/658: write d1/da/d65/fc3 [703858,16729] 0 2024-08-31T05:21:07.526 INFO:tasks.workunit.client.0.smithi067.stdout:8/127: mknod d0/d4/de/c26 0 2024-08-31T05:21:07.528 INFO:tasks.workunit.client.1.smithi073.stdout:3/763: mkdir da/d3c/d65/d40/d5d/df6 0 2024-08-31T05:21:07.528 INFO:tasks.workunit.client.1.smithi073.stdout:9/804: write dc/f30 [545352,62548] 0 2024-08-31T05:21:07.529 INFO:tasks.workunit.client.1.smithi073.stdout:7/659: write d1/da/d3e/d22/d47/fa1 [471138,86359] 0 2024-08-31T05:21:07.530 INFO:tasks.workunit.client.1.smithi073.stdout:9/805: chown dc/d37/f5e 1900 1 2024-08-31T05:21:07.530 INFO:tasks.workunit.client.0.smithi067.stdout:8/128: rename d0/d2/f3 to d0/d2/d6/f27 0 2024-08-31T05:21:07.531 INFO:tasks.workunit.client.1.smithi073.stdout:9/806: write dc/d37/d42/d8d/f50 [7125352,43480] 0 2024-08-31T05:21:07.534 INFO:tasks.workunit.client.1.smithi073.stdout:7/660: fsync d1/da/d15/d33/f50 0 2024-08-31T05:21:07.534 INFO:tasks.workunit.client.1.smithi073.stdout:5/887: write dc/d16/d1a/f120 [874135,57628] 0 2024-08-31T05:21:07.535 INFO:tasks.workunit.client.0.smithi067.stdout:8/129: mkdir d0/d2/dc/d28 0 2024-08-31T05:21:07.536 INFO:tasks.workunit.client.1.smithi073.stdout:7/661: chown d1/lb 1 1 2024-08-31T05:21:07.536 INFO:tasks.workunit.client.0.smithi067.stdout:8/130: chown d0/d4/de/l19 35055 1 2024-08-31T05:21:07.538 INFO:tasks.workunit.client.1.smithi073.stdout:9/807: creat dc/d37/d42/d8d/f109 x:0 0 0 2024-08-31T05:21:07.538 INFO:tasks.workunit.client.1.smithi073.stdout:1/642: write d5/d17/d3f/f7d [479692,2952] 0 2024-08-31T05:21:07.539 INFO:tasks.workunit.client.1.smithi073.stdout:1/643: chown d5/d26/f46 41969819 1 2024-08-31T05:21:07.540 INFO:tasks.workunit.client.0.smithi067.stdout:8/131: unlink d0/d2/dc/f1c 0 2024-08-31T05:21:07.544 INFO:tasks.workunit.client.1.smithi073.stdout:5/888: creat dc/d16/d3b/d3f/f124 x:0 0 0 2024-08-31T05:21:07.546 INFO:tasks.workunit.client.1.smithi073.stdout:8/697: sync 2024-08-31T05:21:07.546 INFO:tasks.workunit.client.1.smithi073.stdout:2/679: sync 2024-08-31T05:21:07.547 INFO:tasks.workunit.client.1.smithi073.stdout:7/662: dread d1/da/d3e/d22/f27 [0,4194304] 0 2024-08-31T05:21:07.550 INFO:tasks.workunit.client.0.smithi067.stdout:2/54: write f4 [45403,22692] 0 2024-08-31T05:21:07.552 INFO:tasks.workunit.client.1.smithi073.stdout:8/698: creat d0/db/d1c/d34/fd7 x:0 0 0 2024-08-31T05:21:07.552 INFO:tasks.workunit.client.1.smithi073.stdout:3/764: write da/d3c/d65/d45/fa1 [1462197,6519] 0 2024-08-31T05:21:07.554 INFO:tasks.workunit.client.1.smithi073.stdout:7/663: dread d1/da/d15/d33/d44/f66 [0,4194304] 0 2024-08-31T05:21:07.554 INFO:tasks.workunit.client.1.smithi073.stdout:2/680: dwrite d2/d9/d3c/fc5 [0,4194304] 0 2024-08-31T05:21:07.555 INFO:tasks.workunit.client.1.smithi073.stdout:8/699: fdatasync d0/db/d1c/d2a/f89 0 2024-08-31T05:21:07.557 INFO:tasks.workunit.client.1.smithi073.stdout:5/889: creat dc/d16/d1a/f125 x:0 0 0 2024-08-31T05:21:07.558 INFO:tasks.workunit.client.0.smithi067.stdout:8/132: write d0/d2/dc/f16 [1150747,112462] 0 2024-08-31T05:21:07.560 INFO:tasks.workunit.client.1.smithi073.stdout:3/765: mkdir da/d3c/dda/df7 0 2024-08-31T05:21:07.561 INFO:tasks.workunit.client.1.smithi073.stdout:1/644: dwrite d5/f25 [4194304,4194304] 0 2024-08-31T05:21:07.561 INFO:tasks.workunit.client.1.smithi073.stdout:8/700: mknod d0/db/cd8 0 2024-08-31T05:21:07.563 INFO:tasks.workunit.client.1.smithi073.stdout:7/664: creat d1/da/d3e/db1/fd4 x:0 0 0 2024-08-31T05:21:07.564 INFO:tasks.workunit.client.0.smithi067.stdout:2/55: truncate f4 327015 0 2024-08-31T05:21:07.564 INFO:tasks.workunit.client.1.smithi073.stdout:3/766: chown da/d18/da2/daf/ldf 967 1 2024-08-31T05:21:07.564 INFO:tasks.workunit.client.1.smithi073.stdout:5/890: read dc/d16/d3b/d3f/d4f/f8b [290276,8138] 0 2024-08-31T05:21:07.565 INFO:tasks.workunit.client.1.smithi073.stdout:2/681: mknod d2/d9/df/d43/d88/cd8 0 2024-08-31T05:21:07.565 INFO:tasks.workunit.client.1.smithi073.stdout:3/767: fdatasync da/d68/f84 0 2024-08-31T05:21:07.566 INFO:tasks.workunit.client.1.smithi073.stdout:9/808: symlink dc/d37/d42/d8d/d52/d5b/l10a 0 2024-08-31T05:21:07.566 INFO:tasks.workunit.client.0.smithi067.stdout:8/133: dread d0/d4/de/f11 [0,4194304] 0 2024-08-31T05:21:07.567 INFO:tasks.workunit.client.1.smithi073.stdout:2/682: fsync d2/d9/f77 0 2024-08-31T05:21:07.567 INFO:tasks.workunit.client.0.smithi067.stdout:8/134: chown d0/d2/da/dd/cf 1316760 1 2024-08-31T05:21:07.570 INFO:tasks.workunit.client.1.smithi073.stdout:1/645: creat d5/d26/d54/d9e/fb6 x:0 0 0 2024-08-31T05:21:07.573 INFO:tasks.workunit.client.1.smithi073.stdout:9/809: creat dc/de/d56/f10b x:0 0 0 2024-08-31T05:21:07.575 INFO:tasks.workunit.client.1.smithi073.stdout:2/683: creat d2/d9/d27/d76/db5/dc6/dd1/fd9 x:0 0 0 2024-08-31T05:21:07.577 INFO:tasks.workunit.client.1.smithi073.stdout:8/701: getdents d0/db/d1c/d24/d73 0 2024-08-31T05:21:07.577 INFO:tasks.workunit.client.1.smithi073.stdout:1/646: unlink d5/f6 0 2024-08-31T05:21:07.580 INFO:tasks.workunit.client.1.smithi073.stdout:2/684: mknod d2/d9/d7f/dab/daa/cda 0 2024-08-31T05:21:07.581 INFO:tasks.workunit.client.1.smithi073.stdout:1/647: symlink d5/d17/d3f/lb7 0 2024-08-31T05:21:07.584 INFO:tasks.workunit.client.1.smithi073.stdout:3/768: dread da/f29 [0,4194304] 0 2024-08-31T05:21:07.585 INFO:tasks.workunit.client.1.smithi073.stdout:3/769: write da/d3c/d67/f81 [840711,82771] 0 2024-08-31T05:21:07.586 INFO:tasks.workunit.client.1.smithi073.stdout:1/648: dread d5/d17/f81 [0,4194304] 0 2024-08-31T05:21:07.586 INFO:tasks.workunit.client.0.smithi067.stdout:8/135: write d0/d4/de/f11 [2356525,3221] 0 2024-08-31T05:21:07.587 INFO:tasks.workunit.client.0.smithi067.stdout:8/136: chown d0/l1 14 1 2024-08-31T05:21:07.587 INFO:tasks.workunit.client.1.smithi073.stdout:7/665: write d1/da/d15/d33/d44/d74/fd3 [4073042,43331] 0 2024-08-31T05:21:07.588 INFO:tasks.workunit.client.0.smithi067.stdout:8/137: fdatasync d0/d2/f1e 0 2024-08-31T05:21:07.588 INFO:tasks.workunit.client.1.smithi073.stdout:1/649: truncate d5/d10/d1b/fad 821296 0 2024-08-31T05:21:07.591 INFO:tasks.workunit.client.1.smithi073.stdout:5/891: dread dc/d16/ff5 [0,4194304] 0 2024-08-31T05:21:07.594 INFO:tasks.workunit.client.1.smithi073.stdout:7/666: unlink d1/d11/ca0 0 2024-08-31T05:21:07.594 INFO:tasks.workunit.client.0.smithi067.stdout:8/138: mknod d0/d2/da/dd/d1f/c29 0 2024-08-31T05:21:07.594 INFO:tasks.workunit.client.0.smithi067.stdout:2/56: write f4 [1151659,25354] 0 2024-08-31T05:21:07.595 INFO:tasks.workunit.client.0.smithi067.stdout:8/139: chown d0/d2/da/c1a 0 1 2024-08-31T05:21:07.596 INFO:tasks.workunit.client.1.smithi073.stdout:9/810: dwrite dc/f75 [0,4194304] 0 2024-08-31T05:21:07.596 INFO:tasks.workunit.client.1.smithi073.stdout:1/650: creat d5/d17/d32/d37/d6f/fb8 x:0 0 0 2024-08-31T05:21:07.596 INFO:tasks.workunit.client.1.smithi073.stdout:2/685: write d2/d9/d66/d70/f74 [18027,66511] 0 2024-08-31T05:21:07.597 INFO:tasks.workunit.client.0.smithi067.stdout:8/140: write d0/d2/d6/f1b [608747,23703] 0 2024-08-31T05:21:07.599 INFO:tasks.workunit.client.1.smithi073.stdout:2/686: read d2/d9/d27/d9b/da7/fa8 [1610563,15459] 0 2024-08-31T05:21:07.600 INFO:tasks.workunit.client.1.smithi073.stdout:5/892: creat dc/d16/d3b/dc6/f126 x:0 0 0 2024-08-31T05:21:07.602 INFO:tasks.workunit.client.1.smithi073.stdout:2/687: read d2/d9/d27/f33 [484749,103754] 0 2024-08-31T05:21:07.602 INFO:tasks.workunit.client.1.smithi073.stdout:5/893: truncate dc/d3d/d55/fed 4374529 0 2024-08-31T05:21:07.602 INFO:tasks.workunit.client.0.smithi067.stdout:2/57: dwrite f4 [0,4194304] 0 2024-08-31T05:21:07.605 INFO:tasks.workunit.client.0.smithi067.stdout:2/58: dread f1 [4194304,4194304] 0 2024-08-31T05:21:07.610 INFO:tasks.workunit.client.1.smithi073.stdout:2/688: rmdir d2/d9/d27 39 2024-08-31T05:21:07.614 INFO:tasks.workunit.client.1.smithi073.stdout:5/894: rename dc/d3d/dab/dff/d49/f71 to dc/d3d/dab/dff/d49/f127 0 2024-08-31T05:21:07.614 INFO:tasks.workunit.client.1.smithi073.stdout:1/651: creat d5/d26/da5/fb9 x:0 0 0 2024-08-31T05:21:07.615 INFO:tasks.workunit.client.0.smithi067.stdout:8/141: link d0/d4/c25 d0/d2/c2a 0 2024-08-31T05:21:07.616 INFO:tasks.workunit.client.1.smithi073.stdout:3/770: dread da/d18/f4d [0,4194304] 0 2024-08-31T05:21:07.616 INFO:tasks.workunit.client.1.smithi073.stdout:7/667: creat d1/da/fd5 x:0 0 0 2024-08-31T05:21:07.620 INFO:tasks.workunit.client.1.smithi073.stdout:5/895: dwrite dc/d16/d3b/d3f/d4f/f7b [0,4194304] 0 2024-08-31T05:21:07.621 INFO:tasks.workunit.client.1.smithi073.stdout:1/652: rename d5/d10 to d5/d26/da5/dba 0 2024-08-31T05:21:07.622 INFO:tasks.workunit.client.0.smithi067.stdout:2/59: write f1 [3908822,42395] 0 2024-08-31T05:21:07.627 INFO:tasks.workunit.client.1.smithi073.stdout:7/668: mkdir d1/da/d15/d33/d44/d74/dd6 0 2024-08-31T05:21:07.628 INFO:tasks.workunit.client.0.smithi067.stdout:8/142: link d0/d4/c25 d0/d4/c2b 0 2024-08-31T05:21:07.629 INFO:tasks.workunit.client.1.smithi073.stdout:7/669: write d1/da/d3e/d22/d47/f79 [1968120,1910] 0 2024-08-31T05:21:07.630 INFO:tasks.workunit.client.1.smithi073.stdout:2/689: rename d2/d9/l6d to d2/d9/d27/d76/ldb 0 2024-08-31T05:21:07.631 INFO:tasks.workunit.client.0.smithi067.stdout:2/60: dwrite f1 [4194304,4194304] 0 2024-08-31T05:21:07.633 INFO:tasks.workunit.client.1.smithi073.stdout:5/896: fdatasync dc/f39 0 2024-08-31T05:21:07.636 INFO:tasks.workunit.client.0.smithi067.stdout:8/143: unlink d0/d4/de/d1d/l23 0 2024-08-31T05:21:07.636 INFO:tasks.workunit.client.0.smithi067.stdout:8/144: dread - d0/d2/f24 zero size 2024-08-31T05:21:07.639 INFO:tasks.workunit.client.1.smithi073.stdout:2/690: mkdir d2/d9/d27/d9b/da7/ddc 0 2024-08-31T05:21:07.639 INFO:tasks.workunit.client.0.smithi067.stdout:2/61: mknod db/cc 0 2024-08-31T05:21:07.640 INFO:tasks.workunit.client.1.smithi073.stdout:5/897: dwrite dc/d16/d3b/d3f/d4f/fd8 [0,4194304] 0 2024-08-31T05:21:07.641 INFO:tasks.workunit.client.0.smithi067.stdout:8/145: mkdir d0/d4/de/d1d/d2c 0 2024-08-31T05:21:07.641 INFO:tasks.workunit.client.1.smithi073.stdout:5/898: readlink dc/d3d/d3e/lbe 0 2024-08-31T05:21:07.643 INFO:tasks.workunit.client.1.smithi073.stdout:7/670: creat d1/da/d65/da9/d84/fd7 x:0 0 0 2024-08-31T05:21:07.644 INFO:tasks.workunit.client.0.smithi067.stdout:2/62: mkdir db/dd 0 2024-08-31T05:21:07.645 INFO:tasks.workunit.client.0.smithi067.stdout:8/146: symlink d0/d2/d6/l2d 0 2024-08-31T05:21:07.646 INFO:tasks.workunit.client.0.smithi067.stdout:8/147: readlink d0/d2/d6/lb 0 2024-08-31T05:21:07.647 INFO:tasks.workunit.client.0.smithi067.stdout:2/63: symlink db/le 0 2024-08-31T05:21:07.647 INFO:tasks.workunit.client.0.smithi067.stdout:8/148: chown d0/d2/dc/d28 165 1 2024-08-31T05:21:07.649 INFO:tasks.workunit.client.1.smithi073.stdout:7/671: creat d1/da/d96/fd8 x:0 0 0 2024-08-31T05:21:07.650 INFO:tasks.workunit.client.1.smithi073.stdout:7/672: stat d1/da/d3e/d22/d47 0 2024-08-31T05:21:07.652 INFO:tasks.workunit.client.1.smithi073.stdout:7/673: fsync d1/da/d15/f5a 0 2024-08-31T05:21:07.653 INFO:tasks.workunit.client.1.smithi073.stdout:5/899: getdents dc/d16/d3b/d7f 0 2024-08-31T05:21:07.660 INFO:tasks.workunit.client.1.smithi073.stdout:6/698: sync 2024-08-31T05:21:07.660 INFO:tasks.workunit.client.1.smithi073.stdout:4/630: sync 2024-08-31T05:21:07.661 INFO:tasks.workunit.client.1.smithi073.stdout:3/771: write da/d3c/d65/d2c/f2e [3887168,111635] 0 2024-08-31T05:21:07.662 INFO:tasks.workunit.client.1.smithi073.stdout:1/653: write d5/d26/da5/dba/d33/f90 [3382888,61392] 0 2024-08-31T05:21:07.662 INFO:tasks.workunit.client.1.smithi073.stdout:5/900: write fb [213231,6581] 0 2024-08-31T05:21:07.662 INFO:tasks.workunit.client.1.smithi073.stdout:7/674: readlink d1/da/d15/d33/d44/d60/l90 0 2024-08-31T05:21:07.663 INFO:tasks.workunit.client.1.smithi073.stdout:3/772: chown da/d3c/dda/fe3 67358088 1 2024-08-31T05:21:07.664 INFO:tasks.workunit.client.1.smithi073.stdout:1/654: chown d5/d26/da5 322424933 1 2024-08-31T05:21:07.664 INFO:tasks.workunit.client.1.smithi073.stdout:4/631: chown d7/df/d13/d2e/l72 3 1 2024-08-31T05:21:07.664 INFO:tasks.workunit.client.1.smithi073.stdout:1/655: readlink d5/d17/l78 0 2024-08-31T05:21:07.665 INFO:tasks.workunit.client.1.smithi073.stdout:6/699: symlink d15/d1a/d2b/d2f/d4b/d88/d9f/ldf 0 2024-08-31T05:21:07.665 INFO:tasks.workunit.client.1.smithi073.stdout:4/632: fsync d7/df/d1b/d34/f49 0 2024-08-31T05:21:07.665 INFO:tasks.workunit.client.1.smithi073.stdout:3/773: creat da/d18/da2/ff8 x:0 0 0 2024-08-31T05:21:07.667 INFO:tasks.workunit.client.1.smithi073.stdout:4/633: stat d7/db/f2a 0 2024-08-31T05:21:07.667 INFO:tasks.workunit.client.1.smithi073.stdout:3/774: stat da/d3c/d67/dd9/ldb 0 2024-08-31T05:21:07.670 INFO:tasks.workunit.client.1.smithi073.stdout:7/675: link d1/d11/d14/dac/cc7 d1/da/d15/d33/d44/d74/cd9 0 2024-08-31T05:21:07.671 INFO:tasks.workunit.client.1.smithi073.stdout:1/656: rename d5/d26/da5/dba/f6e to d5/d17/d2a/d80/d93/fbb 0 2024-08-31T05:21:07.675 INFO:tasks.workunit.client.1.smithi073.stdout:7/676: dwrite d1/da/f98 [4194304,4194304] 0 2024-08-31T05:21:07.730 INFO:tasks.workunit.client.0.smithi067.stdout:5/31: sync 2024-08-31T05:21:07.730 INFO:tasks.workunit.client.0.smithi067.stdout:4/25: sync 2024-08-31T05:21:07.731 INFO:tasks.workunit.client.0.smithi067.stdout:5/32: dread - f9 zero size 2024-08-31T05:21:07.733 INFO:tasks.workunit.client.0.smithi067.stdout:4/26: dread f0 [0,4194304] 0 2024-08-31T05:21:07.735 INFO:tasks.workunit.client.1.smithi073.stdout:6/700: symlink d15/d1a/d2b/le0 0 2024-08-31T05:21:07.735 INFO:tasks.workunit.client.1.smithi073.stdout:6/701: stat d15/d1a/d2b/d2f/d4b/d88/d9f/ldf 0 2024-08-31T05:21:07.738 INFO:tasks.workunit.client.0.smithi067.stdout:5/33: mkdir db 0 2024-08-31T05:21:07.739 INFO:tasks.workunit.client.0.smithi067.stdout:5/34: dread - f7 zero size 2024-08-31T05:21:07.740 INFO:tasks.workunit.client.0.smithi067.stdout:4/27: dwrite f0 [4194304,4194304] 0 2024-08-31T05:21:07.757 INFO:tasks.workunit.client.1.smithi073.stdout:0/703: sync 2024-08-31T05:21:07.757 INFO:tasks.workunit.client.1.smithi073.stdout:8/702: sync 2024-08-31T05:21:07.758 INFO:tasks.workunit.client.1.smithi073.stdout:0/704: dread - d0/d15/d2c/d40/d4a/fad zero size 2024-08-31T05:21:07.775 INFO:tasks.workunit.client.1.smithi073.stdout:5/901: link dc/d3d/dab/c11b dc/d16/d3b/d7f/d99/c128 0 2024-08-31T05:21:07.782 INFO:tasks.workunit.client.1.smithi073.stdout:8/703: creat d0/db/d1c/d34/d68/fd9 x:0 0 0 2024-08-31T05:21:07.784 INFO:tasks.workunit.client.0.smithi067.stdout:5/35: dwrite f7 [0,4194304] 0 2024-08-31T05:21:07.785 INFO:tasks.workunit.client.1.smithi073.stdout:5/902: chown dc/f61 10373015 1 2024-08-31T05:21:07.786 INFO:tasks.workunit.client.0.smithi067.stdout:4/28: dwrite f0 [4194304,4194304] 0 2024-08-31T05:21:07.788 INFO:tasks.workunit.client.1.smithi073.stdout:8/704: dwrite d0/db/d1c/fb9 [0,4194304] 0 2024-08-31T05:21:07.790 INFO:tasks.workunit.client.0.smithi067.stdout:5/36: mknod db/cc 0 2024-08-31T05:21:07.791 INFO:tasks.workunit.client.1.smithi073.stdout:6/702: mkdir d15/d17/da1/dae/db0/de1 0 2024-08-31T05:21:07.792 INFO:tasks.workunit.client.1.smithi073.stdout:1/657: creat d5/d26/da5/dba/d1c/fbc x:0 0 0 2024-08-31T05:21:07.792 INFO:tasks.workunit.client.1.smithi073.stdout:5/903: dwrite dc/d3d/dab/dff/dbd/fd7 [0,4194304] 0 2024-08-31T05:21:07.792 INFO:tasks.workunit.client.0.smithi067.stdout:4/29: mknod d4/d9/cb 0 2024-08-31T05:21:07.795 INFO:tasks.workunit.client.0.smithi067.stdout:5/37: mknod db/cd 0 2024-08-31T05:21:07.795 INFO:tasks.workunit.client.1.smithi073.stdout:7/677: truncate d1/da/f94 4008750 0 2024-08-31T05:21:07.795 INFO:tasks.workunit.client.1.smithi073.stdout:4/634: getdents d7/d1a/d5c/d6d/d2c/d2d 0 2024-08-31T05:21:07.796 INFO:tasks.workunit.client.1.smithi073.stdout:7/678: chown d1/da/d15/d33/d44 12761614 1 2024-08-31T05:21:07.799 INFO:tasks.workunit.client.0.smithi067.stdout:5/38: mkdir db/de 0 2024-08-31T05:21:07.800 INFO:tasks.workunit.client.0.smithi067.stdout:5/39: stat db/cd 0 2024-08-31T05:21:07.802 INFO:tasks.workunit.client.1.smithi073.stdout:0/705: rename d0/d69/d7f/d68/d91/dcd to d0/d15/d2c/d4d/d3c/d9c/db6/de6 0 2024-08-31T05:21:07.805 INFO:tasks.workunit.client.1.smithi073.stdout:4/635: mknod d7/d1a/d5c/d6d/d2c/d2d/cbe 0 2024-08-31T05:21:07.806 INFO:tasks.workunit.client.1.smithi073.stdout:1/658: write d5/f25 [6832358,33674] 0 2024-08-31T05:21:07.806 INFO:tasks.workunit.client.1.smithi073.stdout:0/706: stat d0/d15/d2c/d40/l9e 0 2024-08-31T05:21:07.806 INFO:tasks.workunit.client.1.smithi073.stdout:6/703: write d15/d17/f3a [1618663,1104] 0 2024-08-31T05:21:07.809 INFO:tasks.workunit.client.0.smithi067.stdout:4/30: dwrite d4/d9/fa [0,4194304] 0 2024-08-31T05:21:07.809 INFO:tasks.workunit.client.0.smithi067.stdout:5/40: dread f7 [0,4194304] 0 2024-08-31T05:21:07.810 INFO:tasks.workunit.client.1.smithi073.stdout:7/679: dread d1/da/f72 [4194304,4194304] 0 2024-08-31T05:21:07.810 INFO:tasks.workunit.client.1.smithi073.stdout:8/705: mkdir d0/db/d1c/dda 0 2024-08-31T05:21:07.810 INFO:tasks.workunit.client.1.smithi073.stdout:1/659: chown d5/d26/da5/dba/d1c/f50 0 1 2024-08-31T05:21:07.811 INFO:tasks.workunit.client.0.smithi067.stdout:4/31: rename f0 to d4/d9/fc 0 2024-08-31T05:21:07.811 INFO:tasks.workunit.client.1.smithi073.stdout:1/660: stat d5/d26/da5/dba/d33/f30 0 2024-08-31T05:21:07.812 INFO:tasks.workunit.client.1.smithi073.stdout:4/636: creat d7/df/d13/db2/fbf x:0 0 0 2024-08-31T05:21:07.816 INFO:tasks.workunit.client.1.smithi073.stdout:0/707: dwrite d0/d15/d2c/d4d/d3c/fa [4194304,4194304] 0 2024-08-31T05:21:07.816 INFO:tasks.workunit.client.0.smithi067.stdout:4/32: unlink d4/c6 0 2024-08-31T05:21:07.818 INFO:tasks.workunit.client.1.smithi073.stdout:6/704: fdatasync d15/d1a/d1e/f37 0 2024-08-31T05:21:07.821 INFO:tasks.workunit.client.1.smithi073.stdout:1/661: rmdir d5/d17/d32/d37 39 2024-08-31T05:21:07.821 INFO:tasks.workunit.client.1.smithi073.stdout:6/705: write d15/d17/da1/dae/db0/d38/d9b/f81 [705902,105432] 0 2024-08-31T05:21:07.823 INFO:tasks.workunit.client.0.smithi067.stdout:5/41: link la db/lf 0 2024-08-31T05:21:07.823 INFO:tasks.workunit.client.0.smithi067.stdout:5/42: stat db 0 2024-08-31T05:21:07.823 INFO:tasks.workunit.client.1.smithi073.stdout:4/637: creat d7/db/fc0 x:0 0 0 2024-08-31T05:21:07.825 INFO:tasks.workunit.client.1.smithi073.stdout:8/706: symlink d0/db/d44/ldb 0 2024-08-31T05:21:07.827 INFO:tasks.workunit.client.1.smithi073.stdout:8/707: fdatasync d0/db/d44/d4e/f63 0 2024-08-31T05:21:07.829 INFO:tasks.workunit.client.1.smithi073.stdout:4/638: creat d7/df/d13/d2e/d47/d4c/fc1 x:0 0 0 2024-08-31T05:21:07.829 INFO:tasks.workunit.client.0.smithi067.stdout:5/43: rmdir db/de 0 2024-08-31T05:21:07.830 INFO:tasks.workunit.client.0.smithi067.stdout:5/44: dread - f9 zero size 2024-08-31T05:21:07.830 INFO:tasks.workunit.client.0.smithi067.stdout:5/45: fsync f4 0 2024-08-31T05:21:07.830 INFO:tasks.workunit.client.1.smithi073.stdout:0/708: symlink d0/d15/d2c/d41/le7 0 2024-08-31T05:21:07.831 INFO:tasks.workunit.client.1.smithi073.stdout:1/662: dwrite d5/d26/da5/dba/d33/fe [0,4194304] 0 2024-08-31T05:21:07.831 INFO:tasks.workunit.client.1.smithi073.stdout:4/639: chown d7/df/l63 0 1 2024-08-31T05:21:07.833 INFO:tasks.workunit.client.1.smithi073.stdout:0/709: stat d0/d58/d63/f7e 0 2024-08-31T05:21:07.833 INFO:tasks.workunit.client.1.smithi073.stdout:6/706: dwrite d15/d75/fd1 [0,4194304] 0 2024-08-31T05:21:07.834 INFO:tasks.workunit.client.0.smithi067.stdout:5/46: dread f4 [0,4194304] 0 2024-08-31T05:21:07.834 INFO:tasks.workunit.client.1.smithi073.stdout:8/708: mkdir d0/db/d1c/d24/d73/ddc 0 2024-08-31T05:21:07.835 INFO:tasks.workunit.client.1.smithi073.stdout:8/709: stat d0/db/d1c/d24 0 2024-08-31T05:21:07.836 INFO:tasks.workunit.client.1.smithi073.stdout:1/663: symlink d5/d17/d32/daf/lbd 0 2024-08-31T05:21:07.836 INFO:tasks.workunit.client.0.smithi067.stdout:5/47: symlink db/l10 0 2024-08-31T05:21:07.837 INFO:tasks.workunit.client.0.smithi067.stdout:5/48: chown f6 1 1 2024-08-31T05:21:07.837 INFO:tasks.workunit.client.1.smithi073.stdout:5/904: dread dc/d3d/dab/dff/fa7 [4194304,4194304] 0 2024-08-31T05:21:07.838 INFO:tasks.workunit.client.1.smithi073.stdout:5/905: write dc/d3d/dab/dff/dbd/fd7 [2104008,120057] 0 2024-08-31T05:21:07.848 INFO:tasks.workunit.client.1.smithi073.stdout:3/775: sync 2024-08-31T05:21:07.848 INFO:tasks.workunit.client.1.smithi073.stdout:2/691: sync 2024-08-31T05:21:07.848 INFO:tasks.workunit.client.1.smithi073.stdout:9/811: sync 2024-08-31T05:21:07.858 INFO:tasks.workunit.client.0.smithi067.stdout:4/33: truncate d4/d9/fa 1921490 0 2024-08-31T05:21:07.858 INFO:tasks.workunit.client.0.smithi067.stdout:4/34: chown d4/d9 0 1 2024-08-31T05:21:07.859 INFO:tasks.workunit.client.0.smithi067.stdout:4/35: fsync d4/d9/fc 0 2024-08-31T05:21:07.860 INFO:tasks.workunit.client.0.smithi067.stdout:4/36: chown c3 1380 1 2024-08-31T05:21:07.860 INFO:tasks.workunit.client.1.smithi073.stdout:0/710: mkdir d0/d15/d2c/d41/de8 0 2024-08-31T05:21:07.860 INFO:tasks.workunit.client.1.smithi073.stdout:1/664: rmdir d5/d17/d2a/d80 39 2024-08-31T05:21:07.861 INFO:tasks.workunit.client.0.smithi067.stdout:4/37: chown d4/d9/cb 4024884 1 2024-08-31T05:21:07.862 INFO:tasks.workunit.client.1.smithi073.stdout:5/906: write dc/d16/d3b/dc6/fce [1371681,93229] 0 2024-08-31T05:21:07.862 INFO:tasks.workunit.client.1.smithi073.stdout:3/776: chown da/d68/f99 0 1 2024-08-31T05:21:07.864 INFO:tasks.workunit.client.1.smithi073.stdout:3/777: fdatasync da/d18/f2a 0 2024-08-31T05:21:07.864 INFO:tasks.workunit.client.0.smithi067.stdout:4/38: rename d4/l5 to d4/ld 0 2024-08-31T05:21:07.865 INFO:tasks.workunit.client.0.smithi067.stdout:4/39: stat c3 0 2024-08-31T05:21:07.867 INFO:tasks.workunit.client.1.smithi073.stdout:6/707: truncate d15/d1a/d2b/d2f/f6c 764517 0 2024-08-31T05:21:07.868 INFO:tasks.workunit.client.0.smithi067.stdout:4/40: symlink d4/d9/le 0 2024-08-31T05:21:07.869 INFO:tasks.workunit.client.1.smithi073.stdout:2/692: mkdir d2/d9/d27/d9b/da6/ddd 0 2024-08-31T05:21:07.869 INFO:tasks.workunit.client.1.smithi073.stdout:8/710: dwrite d0/db/d1c/d2a/d58/faf [0,4194304] 0 2024-08-31T05:21:07.870 INFO:tasks.workunit.client.1.smithi073.stdout:1/665: symlink d5/d17/d3f/d9f/lbe 0 2024-08-31T05:21:07.871 INFO:tasks.workunit.client.0.smithi067.stdout:4/41: creat d4/d9/ff x:0 0 0 2024-08-31T05:21:07.872 INFO:tasks.workunit.client.1.smithi073.stdout:7/680: dwrite d1/f43 [4194304,4194304] 0 2024-08-31T05:21:07.874 INFO:tasks.workunit.client.1.smithi073.stdout:0/711: rename d0/d15/d2c/d4d/d3c/f1f to d0/d15/d2c/d4d/d3c/d9c/dc8/fe9 0 2024-08-31T05:21:07.876 INFO:tasks.workunit.client.1.smithi073.stdout:3/778: symlink da/d3c/d5a/lf9 0 2024-08-31T05:21:07.877 INFO:tasks.workunit.client.1.smithi073.stdout:3/779: dread - da/d3c/d65/d40/d5d/f89 zero size 2024-08-31T05:21:07.880 INFO:tasks.workunit.client.1.smithi073.stdout:5/907: symlink dc/d16/d3b/d119/l129 0 2024-08-31T05:21:07.880 INFO:tasks.workunit.client.0.smithi067.stdout:4/42: dwrite d4/d9/fc [0,4194304] 0 2024-08-31T05:21:07.882 INFO:tasks.workunit.client.1.smithi073.stdout:2/693: unlink d2/d9/d66/l78 0 2024-08-31T05:21:07.883 INFO:tasks.workunit.client.1.smithi073.stdout:2/694: readlink d2/l59 0 2024-08-31T05:21:07.884 INFO:tasks.workunit.client.1.smithi073.stdout:8/711: creat d0/db/d1c/d34/d38/fdd x:0 0 0 2024-08-31T05:21:07.885 INFO:tasks.workunit.client.1.smithi073.stdout:1/666: creat d5/d26/da5/dba/d33/d13/d7e/fbf x:0 0 0 2024-08-31T05:21:07.886 INFO:tasks.workunit.client.0.smithi067.stdout:4/43: rename d4/d9/ff to d4/f10 0 2024-08-31T05:21:07.887 INFO:tasks.workunit.client.0.smithi067.stdout:4/44: truncate d4/f10 1019343 0 2024-08-31T05:21:07.887 INFO:tasks.workunit.client.1.smithi073.stdout:7/681: truncate d1/da/d3e/d22/d47/f68 2056454 0 2024-08-31T05:21:07.889 INFO:tasks.workunit.client.1.smithi073.stdout:7/682: write d1/da/d3e/db1/fd4 [417641,78147] 0 2024-08-31T05:21:07.890 INFO:tasks.workunit.client.0.smithi067.stdout:4/45: mknod d4/d9/c11 0 2024-08-31T05:21:07.891 INFO:tasks.workunit.client.1.smithi073.stdout:6/708: symlink d15/d1a/d2b/d2f/d4b/le2 0 2024-08-31T05:21:07.894 INFO:tasks.workunit.client.1.smithi073.stdout:1/667: readlink d5/d17/d2a/d80/l73 0 2024-08-31T05:21:07.895 INFO:tasks.workunit.client.1.smithi073.stdout:7/683: creat d1/fda x:0 0 0 2024-08-31T05:21:07.897 INFO:tasks.workunit.client.1.smithi073.stdout:9/812: getdents dc/d82/d97 0 2024-08-31T05:21:07.897 INFO:tasks.workunit.client.1.smithi073.stdout:6/709: dread d15/d1a/d2b/d2f/fc1 [0,4194304] 0 2024-08-31T05:21:07.898 INFO:tasks.workunit.client.1.smithi073.stdout:9/813: chown dc/d37 559579829 1 2024-08-31T05:21:07.898 INFO:tasks.workunit.client.1.smithi073.stdout:2/695: dwrite d2/d9/df/f64 [4194304,4194304] 0 2024-08-31T05:21:07.900 INFO:tasks.workunit.client.1.smithi073.stdout:2/696: chown d2/d9/df/d43/d88/cd8 72337 1 2024-08-31T05:21:07.901 INFO:tasks.workunit.client.1.smithi073.stdout:2/697: readlink d2/d9/df/d43/lc8 0 2024-08-31T05:21:07.931 INFO:tasks.workunit.client.1.smithi073.stdout:4/640: sync 2024-08-31T05:21:07.937 INFO:tasks.workunit.client.1.smithi073.stdout:3/780: link da/fb da/d3c/d65/ffa 0 2024-08-31T05:21:07.941 INFO:tasks.workunit.client.1.smithi073.stdout:3/781: dread da/d68/f6b [0,4194304] 0 2024-08-31T05:21:07.944 INFO:tasks.workunit.client.1.smithi073.stdout:7/684: dwrite d1/da/d3e/d22/d5c/f8b [0,4194304] 0 2024-08-31T05:21:07.946 INFO:tasks.workunit.client.1.smithi073.stdout:3/782: dread da/d3c/d65/d40/d5d/f8b [0,4194304] 0 2024-08-31T05:21:07.951 INFO:tasks.workunit.client.1.smithi073.stdout:9/814: dwrite dc/d82/fbe [0,4194304] 0 2024-08-31T05:21:07.952 INFO:tasks.workunit.client.1.smithi073.stdout:9/815: write dc/d37/d42/d8d/d52/fa8 [728910,8008] 0 2024-08-31T05:21:07.953 INFO:tasks.workunit.client.1.smithi073.stdout:2/698: creat d2/d9/d27/d76/fde x:0 0 0 2024-08-31T05:21:07.954 INFO:tasks.workunit.client.1.smithi073.stdout:2/699: write d2/d25/f93 [87288,26866] 0 2024-08-31T05:21:07.956 INFO:tasks.workunit.client.0.smithi067.stdout:4/46: link d4/ld d4/d9/l12 0 2024-08-31T05:21:07.964 INFO:tasks.workunit.client.0.smithi067.stdout:4/47: mkdir d4/d13 0 2024-08-31T05:21:07.969 INFO:tasks.workunit.client.0.smithi067.stdout:4/48: mkdir d4/d14 0 2024-08-31T05:21:07.972 INFO:tasks.workunit.client.1.smithi073.stdout:7/685: dwrite d1/da/d15/d33/d44/f66 [0,4194304] 0 2024-08-31T05:21:07.973 INFO:tasks.workunit.client.1.smithi073.stdout:7/686: chown d1/da/d15/d33/f50 74 1 2024-08-31T05:21:07.973 INFO:tasks.workunit.client.1.smithi073.stdout:0/712: dwrite d0/d15/d2c/d40/f9a [0,4194304] 0 2024-08-31T05:21:07.975 INFO:tasks.workunit.client.1.smithi073.stdout:8/712: write d0/f5 [1489960,29945] 0 2024-08-31T05:21:07.976 INFO:tasks.workunit.client.0.smithi067.stdout:4/49: dwrite d4/d9/fc [0,4194304] 0 2024-08-31T05:21:07.977 INFO:tasks.workunit.client.1.smithi073.stdout:8/713: readlink d0/db/d1c/d24/lbe 0 2024-08-31T05:21:07.978 INFO:tasks.workunit.client.1.smithi073.stdout:8/714: chown d0/db/d44/d72/d75/d7e/d91 28 1 2024-08-31T05:21:07.985 INFO:tasks.workunit.client.1.smithi073.stdout:2/700: mkdir d2/d9/d27/d76/ddf 0 2024-08-31T05:21:07.989 INFO:tasks.workunit.client.0.smithi067.stdout:4/50: mknod d4/d9/c15 0 2024-08-31T05:21:07.992 INFO:tasks.workunit.client.1.smithi073.stdout:1/668: getdents d5 0 2024-08-31T05:21:07.996 INFO:tasks.workunit.client.1.smithi073.stdout:3/783: creat da/d3c/d65/d2c/d8e/dc2/ffb x:0 0 0 2024-08-31T05:21:07.997 INFO:tasks.workunit.client.1.smithi073.stdout:3/784: write da/d3c/d65/d40/fa4 [129980,24467] 0 2024-08-31T05:21:07.999 INFO:tasks.workunit.client.1.smithi073.stdout:7/687: creat d1/da/db2/fdb x:0 0 0 2024-08-31T05:21:07.999 INFO:tasks.workunit.client.1.smithi073.stdout:7/688: chown d1/da/d3e/d22/d35/l4d 867227 1 2024-08-31T05:21:08.001 INFO:tasks.workunit.client.1.smithi073.stdout:8/715: creat d0/da8/fde x:0 0 0 2024-08-31T05:21:08.001 INFO:tasks.workunit.client.0.smithi067.stdout:4/51: dwrite d4/d9/fa [0,4194304] 0 2024-08-31T05:21:08.003 INFO:tasks.workunit.client.1.smithi073.stdout:8/716: chown d0/db/d1c/d24/d73/fcd 82 1 2024-08-31T05:21:08.005 INFO:tasks.workunit.client.1.smithi073.stdout:8/717: dread - d0/db/d1c/d34/fd7 zero size 2024-08-31T05:21:08.006 INFO:tasks.workunit.client.0.smithi067.stdout:4/52: mkdir d4/d16 0 2024-08-31T05:21:08.008 INFO:tasks.workunit.client.1.smithi073.stdout:0/713: dwrite d0/fd9 [0,4194304] 0 2024-08-31T05:21:08.008 INFO:tasks.workunit.client.1.smithi073.stdout:1/669: fdatasync d5/d17/f81 0 2024-08-31T05:21:08.008 INFO:tasks.workunit.client.1.smithi073.stdout:3/785: truncate da/d3c/f71 58081 0 2024-08-31T05:21:08.013 INFO:tasks.workunit.client.0.smithi067.stdout:4/53: mknod d4/c17 0 2024-08-31T05:21:08.014 INFO:tasks.workunit.client.1.smithi073.stdout:0/714: chown d0/d15/d2c/d41/d52 46 1 2024-08-31T05:21:08.014 INFO:tasks.workunit.client.1.smithi073.stdout:2/701: dwrite d2/d9/df/f3e [0,4194304] 0 2024-08-31T05:21:08.014 INFO:tasks.workunit.client.1.smithi073.stdout:0/715: truncate d0/d28/fce 803278 0 2024-08-31T05:21:08.014 INFO:tasks.workunit.client.1.smithi073.stdout:7/689: creat d1/da/d65/da9/fdc x:0 0 0 2024-08-31T05:21:08.020 INFO:tasks.workunit.client.1.smithi073.stdout:4/641: getdents d7/df/d13/d53/d88 0 2024-08-31T05:21:08.020 INFO:tasks.workunit.client.1.smithi073.stdout:2/702: dwrite d2/d9/d7f/dab/d5d/d82/fcd [0,4194304] 0 2024-08-31T05:21:08.021 INFO:tasks.workunit.client.1.smithi073.stdout:4/642: write d7/df/d79/fac [671911,77] 0 2024-08-31T05:21:08.027 INFO:tasks.workunit.client.1.smithi073.stdout:1/670: dread - d5/d17/d32/d37/d6f/f97 zero size 2024-08-31T05:21:08.028 INFO:tasks.workunit.client.0.smithi067.stdout:4/54: link d4/d9/l12 d4/l18 0 2024-08-31T05:21:08.029 INFO:tasks.workunit.client.0.smithi067.stdout:4/55: write d4/d9/fa [1261996,43362] 0 2024-08-31T05:21:08.030 INFO:tasks.workunit.client.1.smithi073.stdout:3/786: mknod da/d3c/d65/d40/d5d/cfc 0 2024-08-31T05:21:08.031 INFO:tasks.workunit.client.1.smithi073.stdout:0/716: fdatasync d0/f33 0 2024-08-31T05:21:08.033 INFO:tasks.workunit.client.1.smithi073.stdout:0/717: truncate d0/d15/d2c/d41/d52/fde 1234691 0 2024-08-31T05:21:08.035 INFO:tasks.workunit.client.0.smithi067.stdout:4/56: write d4/f10 [1824621,113552] 0 2024-08-31T05:21:08.036 INFO:tasks.workunit.client.1.smithi073.stdout:9/816: getdents dc/de/d11 0 2024-08-31T05:21:08.038 INFO:tasks.workunit.client.1.smithi073.stdout:2/703: mkdir d2/d9/d7f/dab/d5d/da1/de0 0 2024-08-31T05:21:08.047 INFO:tasks.workunit.client.0.smithi067.stdout:4/57: rmdir d4/d16 0 2024-08-31T05:21:08.048 INFO:tasks.workunit.client.1.smithi073.stdout:0/718: mknod d0/d69/d8e/d99/cea 0 2024-08-31T05:21:08.051 INFO:tasks.workunit.client.0.smithi067.stdout:4/58: mknod d4/d14/c19 0 2024-08-31T05:21:08.051 INFO:tasks.workunit.client.0.smithi067.stdout:4/59: write d4/f10 [254015,11426] 0 2024-08-31T05:21:08.052 INFO:tasks.workunit.client.0.smithi067.stdout:4/60: chown c3 172380798 1 2024-08-31T05:21:08.058 INFO:tasks.workunit.client.1.smithi073.stdout:8/718: getdents d0/db/d1c/d34/d80/d9a 0 2024-08-31T05:21:08.059 INFO:tasks.workunit.client.0.smithi067.stdout:4/61: dwrite d4/d9/fa [0,4194304] 0 2024-08-31T05:21:08.060 INFO:tasks.workunit.client.1.smithi073.stdout:5/908: creat dc/d16/d1a/d87/f12a x:0 0 0 2024-08-31T05:21:08.061 INFO:tasks.workunit.client.1.smithi073.stdout:5/909: write dc/d16/f2e [36353,89503] 0 2024-08-31T05:21:08.061 INFO:tasks.workunit.client.1.smithi073.stdout:7/690: getdents d1/da/d3e/d22 0 2024-08-31T05:21:08.066 INFO:tasks.workunit.client.1.smithi073.stdout:8/719: mknod d0/db/d44/d4e/cdf 0 2024-08-31T05:21:08.066 INFO:tasks.workunit.client.1.smithi073.stdout:1/671: getdents d5/d26/d54/d9e 0 2024-08-31T05:21:08.070 INFO:tasks.workunit.client.1.smithi073.stdout:7/691: dwrite d1/da/d3e/db1/fd4 [0,4194304] 0 2024-08-31T05:21:08.071 INFO:tasks.workunit.client.1.smithi073.stdout:2/704: getdents d2/d25 0 2024-08-31T05:21:08.073 INFO:tasks.workunit.client.1.smithi073.stdout:0/719: rename d0/d69/d7f/c7c to d0/d15/d2c/d4d/d3c/d9c/ceb 0 2024-08-31T05:21:08.074 INFO:tasks.workunit.client.1.smithi073.stdout:8/720: mknod d0/db/d1c/d24/d73/ce0 0 2024-08-31T05:21:08.075 INFO:tasks.workunit.client.1.smithi073.stdout:0/720: write d0/d69/d7f/d62/dbf/fdf [565266,41524] 0 2024-08-31T05:21:08.075 INFO:tasks.workunit.client.0.smithi067.stdout:4/62: fsync d4/d9/fa 0 2024-08-31T05:21:08.076 INFO:tasks.workunit.client.1.smithi073.stdout:1/672: creat d5/d26/d54/d9e/fc0 x:0 0 0 2024-08-31T05:21:08.079 INFO:tasks.workunit.client.1.smithi073.stdout:7/692: truncate d1/d11/d14/f63 409423 0 2024-08-31T05:21:08.079 INFO:tasks.workunit.client.1.smithi073.stdout:3/787: creat da/d3c/d5a/ffd x:0 0 0 2024-08-31T05:21:08.080 INFO:tasks.workunit.client.1.smithi073.stdout:2/705: fdatasync d2/d9/df/d43/fb7 0 2024-08-31T05:21:08.080 INFO:tasks.workunit.client.1.smithi073.stdout:1/673: dread d5/d26/da5/dba/d1c/f4b [0,4194304] 0 2024-08-31T05:21:08.082 INFO:tasks.workunit.client.0.smithi067.stdout:4/63: rename d4/d9/fc to d4/d13/f1a 0 2024-08-31T05:21:08.084 INFO:tasks.workunit.client.1.smithi073.stdout:0/721: rename d0/d28/cca to d0/d69/d7f/d62/cec 0 2024-08-31T05:21:08.087 INFO:tasks.workunit.client.1.smithi073.stdout:1/674: dwrite d5/d17/d32/d37/f8e [0,4194304] 0 2024-08-31T05:21:08.087 INFO:tasks.workunit.client.0.smithi067.stdout:7/42: sync 2024-08-31T05:21:08.088 INFO:tasks.workunit.client.1.smithi073.stdout:1/675: dread - d5/d26/da5/dba/d33/fa7 zero size 2024-08-31T05:21:08.090 INFO:tasks.workunit.client.1.smithi073.stdout:6/710: truncate d15/d1a/d2b/d2f/d99/db3/fc6 2074454 0 2024-08-31T05:21:08.092 INFO:tasks.workunit.client.1.smithi073.stdout:6/711: write d15/d17/da1/dae/fb7 [324448,84475] 0 2024-08-31T05:21:08.094 INFO:tasks.workunit.client.1.smithi073.stdout:2/706: symlink d2/d9/d7f/dab/daa/le1 0 2024-08-31T05:21:08.094 INFO:tasks.workunit.client.0.smithi067.stdout:7/43: dread f8 [0,4194304] 0 2024-08-31T05:21:08.095 INFO:tasks.workunit.client.1.smithi073.stdout:5/910: dread dc/d16/d3b/f77 [0,4194304] 0 2024-08-31T05:21:08.096 INFO:tasks.workunit.client.1.smithi073.stdout:8/721: rename d0/db/d44/d4e/l61 to d0/db/d1c/d34/d68/dd2/le1 0 2024-08-31T05:21:08.098 INFO:tasks.workunit.client.1.smithi073.stdout:0/722: rmdir d0/d69/d7f/d68/d91 39 2024-08-31T05:21:08.098 INFO:tasks.workunit.client.1.smithi073.stdout:4/643: sync 2024-08-31T05:21:08.099 INFO:tasks.workunit.client.0.smithi067.stdout:7/44: dread f7 [0,4194304] 0 2024-08-31T05:21:08.099 INFO:tasks.workunit.client.0.smithi067.stdout:7/45: rmdir - no directory 2024-08-31T05:21:08.100 INFO:tasks.workunit.client.1.smithi073.stdout:8/722: chown d0/db/d44/d72/d75/d7e/d91/dac/fce 873357 1 2024-08-31T05:21:08.101 INFO:tasks.workunit.client.1.smithi073.stdout:2/707: dwrite d2/d9/df/f62 [0,4194304] 0 2024-08-31T05:21:08.102 INFO:tasks.workunit.client.1.smithi073.stdout:8/723: fdatasync d0/db/d44/f4d 0 2024-08-31T05:21:08.102 INFO:tasks.workunit.client.1.smithi073.stdout:2/708: chown d2/d9/d3c/f98 140227240 1 2024-08-31T05:21:08.103 INFO:tasks.workunit.client.1.smithi073.stdout:6/712: unlink d15/d17/faf 0 2024-08-31T05:21:08.106 INFO:tasks.workunit.client.0.smithi067.stdout:7/46: dwrite fb [0,4194304] 0 2024-08-31T05:21:08.109 INFO:tasks.workunit.client.0.smithi067.stdout:7/47: write f5 [441452,1139] 0 2024-08-31T05:21:08.109 INFO:tasks.workunit.client.1.smithi073.stdout:1/676: dread d5/d26/d54/d5f/fa0 [0,4194304] 0 2024-08-31T05:21:08.114 INFO:tasks.workunit.client.1.smithi073.stdout:4/644: truncate f5 2118303 0 2024-08-31T05:21:08.115 INFO:tasks.workunit.client.1.smithi073.stdout:4/645: chown d7/d1a/fb5 4243571 1 2024-08-31T05:21:08.118 INFO:tasks.workunit.client.0.smithi067.stdout:7/48: rename f8 to fd 0 2024-08-31T05:21:08.122 INFO:tasks.workunit.client.1.smithi073.stdout:6/713: mkdir d15/d1a/d2b/d2f/d4b/d97/de3 0 2024-08-31T05:21:08.124 INFO:tasks.workunit.client.1.smithi073.stdout:8/724: dread d0/f45 [0,4194304] 0 2024-08-31T05:21:08.125 INFO:tasks.workunit.client.1.smithi073.stdout:1/677: dread d5/d26/da5/dba/d1b/f41 [0,4194304] 0 2024-08-31T05:21:08.125 INFO:tasks.workunit.client.1.smithi073.stdout:5/911: creat dc/d16/d3b/d3f/d4f/d98/df6/f12b x:0 0 0 2024-08-31T05:21:08.126 INFO:tasks.workunit.client.1.smithi073.stdout:5/912: chown dc/d3d/dab/dff/lf8 103 1 2024-08-31T05:21:08.127 INFO:tasks.workunit.client.1.smithi073.stdout:0/723: mknod d0/d69/d7f/d68/d91/ced 0 2024-08-31T05:21:08.128 INFO:tasks.workunit.client.1.smithi073.stdout:7/693: getdents d1/d11/d14 0 2024-08-31T05:21:08.128 INFO:tasks.workunit.client.1.smithi073.stdout:0/724: write d0/d15/fb1 [637855,93660] 0 2024-08-31T05:21:08.131 INFO:tasks.workunit.client.1.smithi073.stdout:9/817: unlink dc/d37/d42/d8d/d52/fa8 0 2024-08-31T05:21:08.133 INFO:tasks.workunit.client.1.smithi073.stdout:9/818: write dc/d37/d42/d8d/d52/d5b/fb2 [548952,56010] 0 2024-08-31T05:21:08.134 INFO:tasks.workunit.client.1.smithi073.stdout:1/678: mknod d5/d26/da5/dba/d1b/cc1 0 2024-08-31T05:21:08.137 INFO:tasks.workunit.client.1.smithi073.stdout:1/679: write d5/d26/da5/dba/d1c/f52 [1934467,107390] 0 2024-08-31T05:21:08.139 INFO:tasks.workunit.client.1.smithi073.stdout:9/819: dwrite dc/de/d11/ff5 [0,4194304] 0 2024-08-31T05:21:08.140 INFO:tasks.workunit.client.1.smithi073.stdout:4/646: creat d7/df/fc2 x:0 0 0 2024-08-31T05:21:08.142 INFO:tasks.workunit.client.1.smithi073.stdout:0/725: creat d0/d15/d2c/d41/de8/fee x:0 0 0 2024-08-31T05:21:08.145 INFO:tasks.workunit.client.1.smithi073.stdout:7/694: fsync d1/da/d3e/d22/d47/f68 0 2024-08-31T05:21:08.147 INFO:tasks.workunit.client.1.smithi073.stdout:1/680: mkdir d5/d17/d3f/dc2 0 2024-08-31T05:21:08.147 INFO:tasks.workunit.client.1.smithi073.stdout:6/714: dread d15/d17/da1/dae/db0/f67 [0,4194304] 0 2024-08-31T05:21:08.150 INFO:tasks.workunit.client.1.smithi073.stdout:4/647: rename d7/d1a/d5c/d6d/d2c/d2d/db6 to d7/df/d13/d53/d88/d9d/dc3 0 2024-08-31T05:21:08.151 INFO:tasks.workunit.client.1.smithi073.stdout:0/726: mknod d0/d15/d2c/d40/d4a/cef 0 2024-08-31T05:21:08.151 INFO:tasks.workunit.client.1.smithi073.stdout:0/727: fdatasync d0/d15/d2c/d41/faf 0 2024-08-31T05:21:08.152 INFO:tasks.workunit.client.1.smithi073.stdout:0/728: fdatasync d0/d15/d2c/d4d/d3c/d9c/db6/fcb 0 2024-08-31T05:21:08.157 INFO:tasks.workunit.client.1.smithi073.stdout:6/715: creat d15/d17/da1/dae/db0/d38/d9b/d87/fe4 x:0 0 0 2024-08-31T05:21:08.158 INFO:tasks.workunit.client.1.smithi073.stdout:4/648: mknod d7/d1a/d5c/d62/cc4 0 2024-08-31T05:21:08.158 INFO:tasks.workunit.client.1.smithi073.stdout:6/716: readlink d15/d1a/d2b/d2f/d4b/d88/l8c 0 2024-08-31T05:21:08.158 INFO:tasks.workunit.client.1.smithi073.stdout:5/913: link dc/d16/d3b/l89 dc/d16/d3b/d3f/d4f/d98/df6/l12c 0 2024-08-31T05:21:08.159 INFO:tasks.workunit.client.1.smithi073.stdout:6/717: chown d15/d17/da1/dbe 26652837 1 2024-08-31T05:21:08.159 INFO:tasks.workunit.client.1.smithi073.stdout:0/729: mknod d0/d69/d8e/cf0 0 2024-08-31T05:21:08.159 INFO:tasks.workunit.client.1.smithi073.stdout:6/718: fdatasync d15/d1a/fac 0 2024-08-31T05:21:08.160 INFO:tasks.workunit.client.1.smithi073.stdout:7/695: link d1/d11/d14/f5b d1/fdd 0 2024-08-31T05:21:08.162 INFO:tasks.workunit.client.1.smithi073.stdout:4/649: stat d7/c4b 0 2024-08-31T05:21:08.165 INFO:tasks.workunit.client.1.smithi073.stdout:6/719: unlink d15/d1a/d2b/d2f/d4b/d88/l8c 0 2024-08-31T05:21:08.166 INFO:tasks.workunit.client.1.smithi073.stdout:9/820: link dc/de/d11/lea dc/d37/d42/d8d/de8/l10c 0 2024-08-31T05:21:08.166 INFO:tasks.workunit.client.1.smithi073.stdout:6/720: dread - d15/d17/da1/fbc zero size 2024-08-31T05:21:08.167 INFO:tasks.workunit.client.1.smithi073.stdout:4/650: rmdir d7/df/d13/db2 39 2024-08-31T05:21:08.168 INFO:tasks.workunit.client.1.smithi073.stdout:5/914: dwrite dc/d3d/dab/dff/f123 [0,4194304] 0 2024-08-31T05:21:08.169 INFO:tasks.workunit.client.1.smithi073.stdout:6/721: write d15/d1a/d51/d61/d7c/da6/fa8 [1801295,63727] 0 2024-08-31T05:21:08.170 INFO:tasks.workunit.client.1.smithi073.stdout:1/681: getdents d5/d17/d32/daf/db1 0 2024-08-31T05:21:08.173 INFO:tasks.workunit.client.1.smithi073.stdout:3/788: rmdir da/d3c/d67 39 2024-08-31T05:21:08.175 INFO:tasks.workunit.client.1.smithi073.stdout:7/696: creat d1/d11/fde x:0 0 0 2024-08-31T05:21:08.176 INFO:tasks.workunit.client.1.smithi073.stdout:9/821: dread dc/de/d11/ff5 [0,4194304] 0 2024-08-31T05:21:08.177 INFO:tasks.workunit.client.1.smithi073.stdout:4/651: dwrite d7/df/d13/f2b [4194304,4194304] 0 2024-08-31T05:21:08.178 INFO:tasks.workunit.client.1.smithi073.stdout:9/822: read - dc/d37/d42/d5a/fdf zero size 2024-08-31T05:21:08.180 INFO:tasks.workunit.client.1.smithi073.stdout:5/915: mknod dc/d16/d3b/d3f/d4f/dc4/c12d 0 2024-08-31T05:21:08.181 INFO:tasks.workunit.client.1.smithi073.stdout:1/682: mkdir d5/d26/da5/dba/d1b/dc3 0 2024-08-31T05:21:08.189 INFO:tasks.workunit.client.1.smithi073.stdout:5/916: symlink dc/d16/d3b/d3f/l12e 0 2024-08-31T05:21:08.191 INFO:tasks.workunit.client.1.smithi073.stdout:1/683: dread d5/d17/d32/d37/f8a [0,4194304] 0 2024-08-31T05:21:08.193 INFO:tasks.workunit.client.1.smithi073.stdout:6/722: creat d15/fe5 x:0 0 0 2024-08-31T05:21:08.194 INFO:tasks.workunit.client.1.smithi073.stdout:5/917: write dc/d16/d1a/db7/deb/d115/f122 [2220351,112517] 0 2024-08-31T05:21:08.195 INFO:tasks.workunit.client.1.smithi073.stdout:3/789: symlink da/d3c/d67/lfe 0 2024-08-31T05:21:08.196 INFO:tasks.workunit.client.1.smithi073.stdout:1/684: unlink d5/d17/d32/d37/f3c 0 2024-08-31T05:21:08.197 INFO:tasks.workunit.client.1.smithi073.stdout:4/652: rmdir d7/df/d13/d53/d8b 0 2024-08-31T05:21:08.200 INFO:tasks.workunit.client.1.smithi073.stdout:4/653: dread d7/df/d13/d2e/d47/d4c/d73/f87 [0,4194304] 0 2024-08-31T05:21:08.203 INFO:tasks.workunit.client.1.smithi073.stdout:7/697: dread d1/da/d3e/d22/d35/f9c [0,4194304] 0 2024-08-31T05:21:08.206 INFO:tasks.workunit.client.0.smithi067.stdout:7/49: write f9 [4551045,78692] 0 2024-08-31T05:21:08.206 INFO:tasks.workunit.client.1.smithi073.stdout:2/709: write d2/d9/d27/d9b/da7/fa8 [3853511,95688] 0 2024-08-31T05:21:08.207 INFO:tasks.workunit.client.1.smithi073.stdout:7/698: chown d1/da/d3e/c1e 14163194 1 2024-08-31T05:21:08.209 INFO:tasks.workunit.client.1.smithi073.stdout:5/918: creat dc/d3d/dab/dff/f12f x:0 0 0 2024-08-31T05:21:08.210 INFO:tasks.workunit.client.0.smithi067.stdout:7/50: dread f9 [0,4194304] 0 2024-08-31T05:21:08.210 INFO:tasks.workunit.client.0.smithi067.stdout:7/51: stat f5 0 2024-08-31T05:21:08.211 INFO:tasks.workunit.client.0.smithi067.stdout:7/52: fdatasync f5 0 2024-08-31T05:21:08.211 INFO:tasks.workunit.client.1.smithi073.stdout:1/685: creat d5/d26/da5/dba/fc4 x:0 0 0 2024-08-31T05:21:08.212 INFO:tasks.workunit.client.1.smithi073.stdout:4/654: symlink d7/d1a/d5c/d6d/d59/d65/db9/lc5 0 2024-08-31T05:21:08.215 INFO:tasks.workunit.client.1.smithi073.stdout:2/710: rename d2/d9/d66/d70/c91 to d2/d9/d27/d76/d97/ce2 0 2024-08-31T05:21:08.216 INFO:tasks.workunit.client.1.smithi073.stdout:8/725: sync 2024-08-31T05:21:08.216 INFO:tasks.workunit.client.0.smithi067.stdout:7/53: dread f5 [0,4194304] 0 2024-08-31T05:21:08.217 INFO:tasks.workunit.client.1.smithi073.stdout:3/790: dread da/d3c/d65/d40/f44 [0,4194304] 0 2024-08-31T05:21:08.217 INFO:tasks.workunit.client.1.smithi073.stdout:7/699: mkdir d1/da/d3e/d22/d6b/ddf 0 2024-08-31T05:21:08.217 INFO:tasks.workunit.client.1.smithi073.stdout:8/726: chown d0/db/d1c/d24/lbe 59 1 2024-08-31T05:21:08.220 INFO:tasks.workunit.client.0.smithi067.stdout:7/54: write f5 [935479,87797] 0 2024-08-31T05:21:08.221 INFO:tasks.workunit.client.0.smithi067.stdout:7/55: dread f6 [0,4194304] 0 2024-08-31T05:21:08.221 INFO:tasks.workunit.client.1.smithi073.stdout:3/791: truncate da/d3c/d65/d87/fcc 176923 0 2024-08-31T05:21:08.221 INFO:tasks.workunit.client.1.smithi073.stdout:5/919: rmdir dc/d16/d3b 39 2024-08-31T05:21:08.221 INFO:tasks.workunit.client.1.smithi073.stdout:1/686: rmdir d5/d17/d32/daf 39 2024-08-31T05:21:08.223 INFO:tasks.workunit.client.0.smithi067.stdout:7/56: mknod ce 0 2024-08-31T05:21:08.224 INFO:tasks.workunit.client.1.smithi073.stdout:7/700: rmdir d1/da/d3e/d22/d47 39 2024-08-31T05:21:08.225 INFO:tasks.workunit.client.1.smithi073.stdout:3/792: fsync da/d3c/d65/d45/f55 0 2024-08-31T05:21:08.225 INFO:tasks.workunit.client.1.smithi073.stdout:3/793: readlink da/d3c/d67/lef 0 2024-08-31T05:21:08.226 INFO:tasks.workunit.client.1.smithi073.stdout:1/687: write d5/d26/d54/d55/f8d [33282,120155] 0 2024-08-31T05:21:08.227 INFO:tasks.workunit.client.0.smithi067.stdout:7/57: dread f6 [0,4194304] 0 2024-08-31T05:21:08.227 INFO:tasks.workunit.client.0.smithi067.stdout:7/58: rmdir - no directory 2024-08-31T05:21:08.228 INFO:tasks.workunit.client.1.smithi073.stdout:2/711: rename d2/d9/df/la5 to d2/d9/d27/d76/d97/le3 0 2024-08-31T05:21:08.229 INFO:tasks.workunit.client.1.smithi073.stdout:2/712: chown d2/d9/fa0 2645 1 2024-08-31T05:21:08.230 INFO:tasks.workunit.client.0.smithi067.stdout:7/59: symlink lf 0 2024-08-31T05:21:08.232 INFO:tasks.workunit.client.0.smithi067.stdout:7/60: dread f5 [0,4194304] 0 2024-08-31T05:21:08.234 INFO:tasks.workunit.client.0.smithi067.stdout:7/61: dread f5 [0,4194304] 0 2024-08-31T05:21:08.235 INFO:tasks.workunit.client.1.smithi073.stdout:3/794: mknod da/d3c/d82/d95/cff 0 2024-08-31T05:21:08.236 INFO:tasks.workunit.client.1.smithi073.stdout:1/688: rename d5/d26/c2c to d5/d26/da5/dba/d1c/d27/d51/cc5 0 2024-08-31T05:21:08.237 INFO:tasks.workunit.client.1.smithi073.stdout:1/689: chown d5/d26/da5/dba/d1c 5340 1 2024-08-31T05:21:08.239 INFO:tasks.workunit.client.1.smithi073.stdout:3/795: symlink da/d18/da2/daf/l100 0 2024-08-31T05:21:08.239 INFO:tasks.workunit.client.1.smithi073.stdout:8/727: dread d0/f17 [0,4194304] 0 2024-08-31T05:21:08.239 INFO:tasks.workunit.client.1.smithi073.stdout:8/728: stat d0/c14 0 2024-08-31T05:21:08.240 INFO:tasks.workunit.client.1.smithi073.stdout:3/796: read da/d18/da2/fc4 [80248,20630] 0 2024-08-31T05:21:08.240 INFO:tasks.workunit.client.1.smithi073.stdout:7/701: creat d1/da/d15/fe0 x:0 0 0 2024-08-31T05:21:08.242 INFO:tasks.workunit.client.1.smithi073.stdout:0/730: write d0/d28/f30 [8250,39264] 0 2024-08-31T05:21:08.243 INFO:tasks.workunit.client.1.smithi073.stdout:1/690: symlink d5/d17/d3f/d9f/lc6 0 2024-08-31T05:21:08.244 INFO:tasks.workunit.client.0.smithi067.stdout:7/62: link c4 c10 0 2024-08-31T05:21:08.247 INFO:tasks.workunit.client.1.smithi073.stdout:3/797: rename da/d3c/d65/f3a to da/d3c/d65/d40/d5d/dd2/f101 0 2024-08-31T05:21:08.247 INFO:tasks.workunit.client.1.smithi073.stdout:8/729: truncate d0/db/d1c/d24/d73/f8f 358796 0 2024-08-31T05:21:08.248 INFO:tasks.workunit.client.0.smithi067.stdout:7/63: creat f11 x:0 0 0 2024-08-31T05:21:08.249 INFO:tasks.workunit.client.1.smithi073.stdout:2/713: dread d2/d9/d84/f89 [0,4194304] 0 2024-08-31T05:21:08.249 INFO:tasks.workunit.client.1.smithi073.stdout:7/702: dwrite d1/da/fd5 [0,4194304] 0 2024-08-31T05:21:08.250 INFO:tasks.workunit.client.1.smithi073.stdout:0/731: truncate d0/d15/d2c/d4d/d3c/d9c/db6/de6/fd4 305359 0 2024-08-31T05:21:08.251 INFO:tasks.workunit.client.1.smithi073.stdout:7/703: chown d1/da/f32 35988 1 2024-08-31T05:21:08.252 INFO:tasks.workunit.client.1.smithi073.stdout:1/691: dread d5/d26/da5/dba/d1c/f50 [0,4194304] 0 2024-08-31T05:21:08.253 INFO:tasks.workunit.client.1.smithi073.stdout:1/692: chown d5/d26/da5/dba/c24 631214 1 2024-08-31T05:21:08.254 INFO:tasks.workunit.client.1.smithi073.stdout:9/823: write dc/d82/d97/f9e [652544,125878] 0 2024-08-31T05:21:08.255 INFO:tasks.workunit.client.0.smithi067.stdout:7/64: dwrite fb [0,4194304] 0 2024-08-31T05:21:08.256 INFO:tasks.workunit.client.1.smithi073.stdout:3/798: dwrite da/fc7 [0,4194304] 0 2024-08-31T05:21:08.256 INFO:tasks.workunit.client.1.smithi073.stdout:9/824: write dc/d10/f53 [4052651,27050] 0 2024-08-31T05:21:08.258 INFO:tasks.workunit.client.1.smithi073.stdout:2/714: write d2/d9/df/f1f [2511903,25508] 0 2024-08-31T05:21:08.266 INFO:tasks.workunit.client.0.smithi067.stdout:7/65: dwrite f9 [0,4194304] 0 2024-08-31T05:21:08.266 INFO:tasks.workunit.client.1.smithi073.stdout:6/723: write d15/d1a/d2b/d6a/f94 [735697,52347] 0 2024-08-31T05:21:08.267 INFO:tasks.workunit.client.1.smithi073.stdout:6/724: write d15/d17/da1/dae/db0/d38/f86 [77196,83748] 0 2024-08-31T05:21:08.267 INFO:tasks.workunit.client.1.smithi073.stdout:1/693: mkdir d5/d17/d32/d37/d6f/dc7 0 2024-08-31T05:21:08.269 INFO:tasks.workunit.client.0.smithi067.stdout:7/66: symlink l12 0 2024-08-31T05:21:08.270 INFO:tasks.workunit.client.1.smithi073.stdout:6/725: truncate d15/d17/da1/dae/db0/d38/f40 959577 0 2024-08-31T05:21:08.271 INFO:tasks.workunit.client.1.smithi073.stdout:3/799: mknod da/d3c/d65/d87/c102 0 2024-08-31T05:21:08.273 INFO:tasks.workunit.client.0.smithi067.stdout:7/67: dread fb [0,4194304] 0 2024-08-31T05:21:08.282 INFO:tasks.workunit.client.1.smithi073.stdout:5/920: truncate dc/d3d/f9c 2266748 0 2024-08-31T05:21:08.286 INFO:tasks.workunit.client.1.smithi073.stdout:0/732: creat d0/d15/d2c/d4d/d3c/d9c/ff1 x:0 0 0 2024-08-31T05:21:08.287 INFO:tasks.workunit.client.1.smithi073.stdout:0/733: truncate d0/d69/fa8 235337 0 2024-08-31T05:21:08.288 INFO:tasks.workunit.client.1.smithi073.stdout:0/734: write d0/d69/d8e/fc0 [2475107,7652] 0 2024-08-31T05:21:08.289 INFO:tasks.workunit.client.1.smithi073.stdout:5/921: chown dc/d16/d3b/d3f/f124 6789 1 2024-08-31T05:21:08.290 INFO:tasks.workunit.client.1.smithi073.stdout:0/735: write d0/d15/d2c/d41/de8/fee [146452,118964] 0 2024-08-31T05:21:08.292 INFO:tasks.workunit.client.1.smithi073.stdout:7/704: getdents d1/da/d65/da9 0 2024-08-31T05:21:08.292 INFO:tasks.workunit.client.1.smithi073.stdout:0/736: write d0/d69/d8e/f3f [2890,25882] 0 2024-08-31T05:21:08.293 INFO:tasks.workunit.client.1.smithi073.stdout:6/726: dread fd [0,4194304] 0 2024-08-31T05:21:08.293 INFO:tasks.workunit.client.1.smithi073.stdout:1/694: creat d5/d17/d32/fc8 x:0 0 0 2024-08-31T05:21:08.296 INFO:tasks.workunit.client.1.smithi073.stdout:0/737: creat d0/d69/d7f/d62/dbf/ff2 x:0 0 0 2024-08-31T05:21:08.296 INFO:tasks.workunit.client.1.smithi073.stdout:6/727: mkdir d15/d1a/d2b/d2f/d4b/d97/de6 0 2024-08-31T05:21:08.297 INFO:tasks.workunit.client.1.smithi073.stdout:0/738: write d0/d15/d2c/d4d/d3c/d9c/de4/fe1 [3355558,97112] 0 2024-08-31T05:21:08.300 INFO:tasks.workunit.client.1.smithi073.stdout:1/695: link d5/d26/da5/dba/c22 d5/d26/d54/d55/cc9 0 2024-08-31T05:21:08.300 INFO:tasks.workunit.client.1.smithi073.stdout:7/705: getdents d1/da/d3e/d22/d47/da8 0 2024-08-31T05:21:08.301 INFO:tasks.workunit.client.1.smithi073.stdout:6/728: truncate d15/d1a/d2b/d2f/f30 1684535 0 2024-08-31T05:21:08.305 INFO:tasks.workunit.client.1.smithi073.stdout:1/696: dwrite d5/d26/d54/d9e/fc0 [0,4194304] 0 2024-08-31T05:21:08.307 INFO:tasks.workunit.client.1.smithi073.stdout:1/697: write d5/d17/d3f/d9f/fb3 [933500,55834] 0 2024-08-31T05:21:08.309 INFO:tasks.workunit.client.1.smithi073.stdout:7/706: mkdir d1/da/d15/d33/d44/d60/de1 0 2024-08-31T05:21:08.311 INFO:tasks.workunit.client.1.smithi073.stdout:9/825: read dc/d37/d42/d8d/f50 [2390750,26075] 0 2024-08-31T05:21:08.313 INFO:tasks.workunit.client.1.smithi073.stdout:6/729: unlink d15/d41/d89/fcd 0 2024-08-31T05:21:08.313 INFO:tasks.workunit.client.1.smithi073.stdout:6/730: chown d15/d1a/d2b 503630974 1 2024-08-31T05:21:08.313 INFO:tasks.workunit.client.1.smithi073.stdout:2/715: dread d2/d9/d7f/dab/d5d/fb3 [0,4194304] 0 2024-08-31T05:21:08.314 INFO:tasks.workunit.client.1.smithi073.stdout:9/826: dread f7 [0,4194304] 0 2024-08-31T05:21:08.319 INFO:tasks.workunit.client.1.smithi073.stdout:7/707: mkdir d1/da/d3e/d22/d6b/ddf/de2 0 2024-08-31T05:21:08.321 INFO:tasks.workunit.client.1.smithi073.stdout:1/698: link d5/d26/da5/dba/d1b/fad d5/d17/fca 0 2024-08-31T05:21:08.322 INFO:tasks.workunit.client.1.smithi073.stdout:6/731: symlink d15/d41/le7 0 2024-08-31T05:21:08.323 INFO:tasks.workunit.client.1.smithi073.stdout:1/699: symlink d5/d26/da5/dba/d33/d13/lcb 0 2024-08-31T05:21:08.325 INFO:tasks.workunit.client.1.smithi073.stdout:1/700: mknod d5/d26/d54/ccc 0 2024-08-31T05:21:08.326 INFO:tasks.workunit.client.1.smithi073.stdout:9/827: getdents dc/de/d66/d84/da2 0 2024-08-31T05:21:08.327 INFO:tasks.workunit.client.1.smithi073.stdout:2/716: dread d2/f4f [0,4194304] 0 2024-08-31T05:21:08.328 INFO:tasks.workunit.client.1.smithi073.stdout:1/701: dread - d5/d17/d32/d37/d6f/fb8 zero size 2024-08-31T05:21:08.328 INFO:tasks.workunit.client.1.smithi073.stdout:8/730: dwrite d0/db/d1c/d34/d38/f60 [0,4194304] 0 2024-08-31T05:21:08.330 INFO:tasks.workunit.client.1.smithi073.stdout:8/731: fdatasync d0/f4 0 2024-08-31T05:21:08.332 INFO:tasks.workunit.client.0.smithi067.stdout:7/68: truncate f9 2703877 0 2024-08-31T05:21:08.333 INFO:tasks.workunit.client.1.smithi073.stdout:2/717: creat d2/d9/d7f/dab/d5d/da1/de0/fe4 x:0 0 0 2024-08-31T05:21:08.334 INFO:tasks.workunit.client.1.smithi073.stdout:8/732: truncate d0/db/d1c/d2a/f30 2935790 0 2024-08-31T05:21:08.336 INFO:tasks.workunit.client.1.smithi073.stdout:8/733: stat d0/db/d1c/d23/fc9 0 2024-08-31T05:21:08.336 INFO:tasks.workunit.client.1.smithi073.stdout:1/702: link d5/d17/d32/fc8 d5/d17/d2a/d80/d93/fcd 0 2024-08-31T05:21:08.337 INFO:tasks.workunit.client.1.smithi073.stdout:8/734: fsync d0/db/d44/d72/d79/f83 0 2024-08-31T05:21:08.337 INFO:tasks.workunit.client.1.smithi073.stdout:8/735: readlink d0/db/d1c/d24/lbe 0 2024-08-31T05:21:08.339 INFO:tasks.workunit.client.1.smithi073.stdout:2/718: rename d2/d9/d27/d9b/da7/ddc to d2/d9/d7f/de5 0 2024-08-31T05:21:08.343 INFO:tasks.workunit.client.1.smithi073.stdout:1/703: fsync d5/d26/da5/dba/d1c/f4b 0 2024-08-31T05:21:08.344 INFO:tasks.workunit.client.1.smithi073.stdout:3/800: write da/d3c/f8f [1288699,34490] 0 2024-08-31T05:21:08.346 INFO:tasks.workunit.client.1.smithi073.stdout:8/736: truncate d0/db/d1c/f20 5190177 0 2024-08-31T05:21:08.353 INFO:tasks.workunit.client.1.smithi073.stdout:1/704: creat d5/d17/d3f/d9f/fce x:0 0 0 2024-08-31T05:21:08.354 INFO:tasks.workunit.client.1.smithi073.stdout:2/719: dwrite d2/d9/d7f/dab/d5d/d82/f8a [0,4194304] 0 2024-08-31T05:21:08.354 INFO:tasks.workunit.client.1.smithi073.stdout:5/922: truncate dc/d3d/dab/dff/f123 3960077 0 2024-08-31T05:21:08.357 INFO:tasks.workunit.client.1.smithi073.stdout:9/828: dread dc/d37/d42/d8d/d52/d5b/fb2 [0,4194304] 0 2024-08-31T05:21:08.359 INFO:tasks.workunit.client.1.smithi073.stdout:5/923: chown dc/d3d/d3e/c59 19271649 1 2024-08-31T05:21:08.362 INFO:tasks.workunit.client.1.smithi073.stdout:6/732: dread d15/f1f [0,4194304] 0 2024-08-31T05:21:08.364 INFO:tasks.workunit.client.1.smithi073.stdout:0/739: dwrite d0/d15/d2c/d40/f47 [0,4194304] 0 2024-08-31T05:21:08.364 INFO:tasks.workunit.client.1.smithi073.stdout:5/924: truncate dc/d16/d3b/d3f/d4f/ffc 890764 0 2024-08-31T05:21:08.371 INFO:tasks.workunit.client.1.smithi073.stdout:0/740: dwrite d0/d69/f8a [0,4194304] 0 2024-08-31T05:21:08.373 INFO:tasks.workunit.client.1.smithi073.stdout:3/801: mknod da/d3c/d65/d2c/d8e/dc2/c103 0 2024-08-31T05:21:08.375 INFO:tasks.workunit.client.1.smithi073.stdout:1/705: mknod d5/d17/d5d/ccf 0 2024-08-31T05:21:08.376 INFO:tasks.workunit.client.1.smithi073.stdout:4/655: write f5 [2343113,70422] 0 2024-08-31T05:21:08.378 INFO:tasks.workunit.client.1.smithi073.stdout:8/737: rename d0/db/d1c/d2a/cbd to d0/db/d1c/d34/d80/d9a/ce2 0 2024-08-31T05:21:08.381 INFO:tasks.workunit.client.1.smithi073.stdout:5/925: creat dc/d16/d3b/dc6/f130 x:0 0 0 2024-08-31T05:21:08.382 INFO:tasks.workunit.client.1.smithi073.stdout:8/738: write d0/db/d44/d72/d75/d7e/d91/f97 [646940,89192] 0 2024-08-31T05:21:08.383 INFO:tasks.workunit.client.1.smithi073.stdout:3/802: creat da/d18/da2/f104 x:0 0 0 2024-08-31T05:21:08.384 INFO:tasks.workunit.client.1.smithi073.stdout:1/706: creat d5/d17/d2a/d80/fd0 x:0 0 0 2024-08-31T05:21:08.385 INFO:tasks.workunit.client.1.smithi073.stdout:5/926: dread - dc/d3d/dab/dff/dcc/dea/fee zero size 2024-08-31T05:21:08.385 INFO:tasks.workunit.client.1.smithi073.stdout:2/720: dread d2/d25/fac [0,4194304] 0 2024-08-31T05:21:08.386 INFO:tasks.workunit.client.1.smithi073.stdout:4/656: dwrite d7/df/d1b/fa2 [0,4194304] 0 2024-08-31T05:21:08.386 INFO:tasks.workunit.client.1.smithi073.stdout:5/927: stat dc/d3d/d55/f62 0 2024-08-31T05:21:08.387 INFO:tasks.workunit.client.1.smithi073.stdout:1/707: readlink d5/d26/da5/dba/d1c/d27/l74 0 2024-08-31T05:21:08.390 INFO:tasks.workunit.client.1.smithi073.stdout:4/657: read - d7/df/d13/d2e/fa3 zero size 2024-08-31T05:21:08.390 INFO:tasks.workunit.client.1.smithi073.stdout:1/708: dread - d5/d26/da5/dba/d33/fa7 zero size 2024-08-31T05:21:08.391 INFO:tasks.workunit.client.1.smithi073.stdout:3/803: mknod da/d3c/d82/d95/c105 0 2024-08-31T05:21:08.393 INFO:tasks.workunit.client.1.smithi073.stdout:2/721: truncate d2/d9/d7f/dab/f42 1804309 0 2024-08-31T05:21:08.396 INFO:tasks.workunit.client.1.smithi073.stdout:6/733: rename d15/d1a/d2b/d2f/d4b/d97/fd0 to d15/d1a/d51/fe8 0 2024-08-31T05:21:08.396 INFO:tasks.workunit.client.1.smithi073.stdout:8/739: dread d0/db/d1c/d23/f2f [0,4194304] 0 2024-08-31T05:21:08.396 INFO:tasks.workunit.client.1.smithi073.stdout:3/804: rmdir da/d3c/d82/d95/db9 39 2024-08-31T05:21:08.398 INFO:tasks.workunit.client.1.smithi073.stdout:5/928: dwrite dc/d16/f6f [0,4194304] 0 2024-08-31T05:21:08.399 INFO:tasks.workunit.client.1.smithi073.stdout:2/722: write d2/d9/d84/f89 [1830414,45556] 0 2024-08-31T05:21:08.400 INFO:tasks.workunit.client.1.smithi073.stdout:8/740: chown d0/db/d1c/d34/d68/l69 19309 1 2024-08-31T05:21:08.401 INFO:tasks.workunit.client.1.smithi073.stdout:0/741: rename d0/d15/d2c/d4d/d3c/d9c/db6/de6/fd4 to d0/d15/d2c/d4d/d3c/d9c/db6/ff3 0 2024-08-31T05:21:08.402 INFO:tasks.workunit.client.1.smithi073.stdout:5/929: write dc/d16/d3b/d3f/fec [1790216,42368] 0 2024-08-31T05:21:08.403 INFO:tasks.workunit.client.1.smithi073.stdout:6/734: truncate d15/d17/da1/dae/db0/fc7 196786 0 2024-08-31T05:21:08.404 INFO:tasks.workunit.client.1.smithi073.stdout:0/742: readlink d0/d15/d2c/d41/le7 0 2024-08-31T05:21:08.404 INFO:tasks.workunit.client.1.smithi073.stdout:6/735: dread - d15/fe5 zero size 2024-08-31T05:21:08.406 INFO:tasks.workunit.client.1.smithi073.stdout:2/723: chown d2/d9/cb 86877 1 2024-08-31T05:21:08.406 INFO:tasks.workunit.client.1.smithi073.stdout:2/724: stat d2/d9/d27/d76/lbd 0 2024-08-31T05:21:08.407 INFO:tasks.workunit.client.1.smithi073.stdout:1/709: rename d5/d26/da5/dba/d1c/d27/c6d to d5/d17/d3f/cd1 0 2024-08-31T05:21:08.407 INFO:tasks.workunit.client.1.smithi073.stdout:2/725: stat d2/d9/d3c/f73 0 2024-08-31T05:21:08.408 INFO:tasks.workunit.client.1.smithi073.stdout:8/741: symlink d0/db/d1c/d24/d73/le3 0 2024-08-31T05:21:08.409 INFO:tasks.workunit.client.1.smithi073.stdout:8/742: chown d0/db/d1c/d34/c8c 118167654 1 2024-08-31T05:21:08.410 INFO:tasks.workunit.client.1.smithi073.stdout:5/930: mknod dc/d16/d1a/db7/deb/c131 0 2024-08-31T05:21:08.414 INFO:tasks.workunit.client.1.smithi073.stdout:6/736: mknod d15/d1a/d1e/d69/d7e/ce9 0 2024-08-31T05:21:08.416 INFO:tasks.workunit.client.1.smithi073.stdout:8/743: dwrite d0/db/d44/d72/d75/d7e/d91/f97 [0,4194304] 0 2024-08-31T05:21:08.416 INFO:tasks.workunit.client.1.smithi073.stdout:2/726: mknod d2/d9/df/d36/ce6 0 2024-08-31T05:21:08.416 INFO:tasks.workunit.client.1.smithi073.stdout:7/708: sync 2024-08-31T05:21:08.417 INFO:tasks.workunit.client.1.smithi073.stdout:6/737: chown d15/d17/da1/dae/db0/d38/d9b/d87/fb5 67812013 1 2024-08-31T05:21:08.418 INFO:tasks.workunit.client.1.smithi073.stdout:5/931: creat dc/d16/d1a/db7/dc1/f132 x:0 0 0 2024-08-31T05:21:08.418 INFO:tasks.workunit.client.1.smithi073.stdout:6/738: write d15/d1a/d1e/f24 [8846992,9404] 0 2024-08-31T05:21:08.420 INFO:tasks.workunit.client.1.smithi073.stdout:2/727: mkdir d2/d25/d92/de7 0 2024-08-31T05:21:08.423 INFO:tasks.workunit.client.1.smithi073.stdout:6/739: truncate d15/d1a/d2b/f71 679752 0 2024-08-31T05:21:08.423 INFO:tasks.workunit.client.1.smithi073.stdout:1/710: symlink d5/d17/d32/d37/d6f/dc7/ld2 0 2024-08-31T05:21:08.428 INFO:tasks.workunit.client.1.smithi073.stdout:4/658: dread d7/df/d1b/f1f [0,4194304] 0 2024-08-31T05:21:08.429 INFO:tasks.workunit.client.1.smithi073.stdout:1/711: dread d5/d17/d32/d37/f8a [0,4194304] 0 2024-08-31T05:21:08.429 INFO:tasks.workunit.client.1.smithi073.stdout:7/709: mkdir d1/da/d15/d33/d44/d74/dd6/de3 0 2024-08-31T05:21:08.429 INFO:tasks.workunit.client.1.smithi073.stdout:9/829: dwrite dc/d37/d42/d8d/f57 [0,4194304] 0 2024-08-31T05:21:08.429 INFO:tasks.workunit.client.1.smithi073.stdout:2/728: symlink d2/d9/d7f/dab/d5d/da1/de0/le8 0 2024-08-31T05:21:08.431 INFO:tasks.workunit.client.1.smithi073.stdout:2/729: write d2/d9/df/f3b [3215176,121674] 0 2024-08-31T05:21:08.433 INFO:tasks.workunit.client.1.smithi073.stdout:4/659: mkdir d7/df/d13/d2e/d47/dc6 0 2024-08-31T05:21:08.434 INFO:tasks.workunit.client.1.smithi073.stdout:9/830: fdatasync f7 0 2024-08-31T05:21:08.435 INFO:tasks.workunit.client.1.smithi073.stdout:3/805: truncate da/f12 64906 0 2024-08-31T05:21:08.436 INFO:tasks.workunit.client.1.smithi073.stdout:3/806: dread - da/d3c/d65/d40/fec zero size 2024-08-31T05:21:08.437 INFO:tasks.workunit.client.1.smithi073.stdout:7/710: dwrite d1/da/d15/f21 [0,4194304] 0 2024-08-31T05:21:08.437 INFO:tasks.workunit.client.1.smithi073.stdout:0/743: write d0/d69/d7f/d68/f81 [815465,108476] 0 2024-08-31T05:21:08.443 INFO:tasks.workunit.client.1.smithi073.stdout:4/660: mkdir d7/df/d13/d53/d88/dc7 0 2024-08-31T05:21:08.444 INFO:tasks.workunit.client.1.smithi073.stdout:9/831: mknod dc/d82/d97/c10d 0 2024-08-31T05:21:08.446 INFO:tasks.workunit.client.1.smithi073.stdout:1/712: symlink d5/d26/da5/dba/ld3 0 2024-08-31T05:21:08.451 INFO:tasks.workunit.client.1.smithi073.stdout:8/744: write d0/db/d1c/d24/d73/f8f [1173191,41069] 0 2024-08-31T05:21:08.452 INFO:tasks.workunit.client.1.smithi073.stdout:0/744: read d0/d28/f80 [100938,39950] 0 2024-08-31T05:21:08.452 INFO:tasks.workunit.client.1.smithi073.stdout:4/661: creat d7/df/d1b/d34/fc8 x:0 0 0 2024-08-31T05:21:08.453 INFO:tasks.workunit.client.1.smithi073.stdout:8/745: fsync d0/db/d1c/d34/fd7 0 2024-08-31T05:21:08.454 INFO:tasks.workunit.client.1.smithi073.stdout:4/662: fdatasync d7/d1a/d5c/d6d/f8d 0 2024-08-31T05:21:08.455 INFO:tasks.workunit.client.1.smithi073.stdout:3/807: creat da/d3c/d82/d95/db9/f106 x:0 0 0 2024-08-31T05:21:08.455 INFO:tasks.workunit.client.1.smithi073.stdout:7/711: dread d1/fdd [0,4194304] 0 2024-08-31T05:21:08.458 INFO:tasks.workunit.client.1.smithi073.stdout:7/712: write d1/d11/fde [756441,46999] 0 2024-08-31T05:21:08.458 INFO:tasks.workunit.client.1.smithi073.stdout:1/713: symlink d5/d26/da5/dba/ld4 0 2024-08-31T05:21:08.458 INFO:tasks.workunit.client.1.smithi073.stdout:2/730: dread d2/d9/d27/f2b [0,4194304] 0 2024-08-31T05:21:08.461 INFO:tasks.workunit.client.1.smithi073.stdout:7/713: write d1/da/db2/fdb [155413,95702] 0 2024-08-31T05:21:08.461 INFO:tasks.workunit.client.1.smithi073.stdout:0/745: dwrite d0/d69/d8e/fc3 [0,4194304] 0 2024-08-31T05:21:08.463 INFO:tasks.workunit.client.1.smithi073.stdout:4/663: mkdir d7/d1a/d5c/d6d/dc9 0 2024-08-31T05:21:08.466 INFO:tasks.workunit.client.1.smithi073.stdout:1/714: rename d5/d17 to d5/d26/d54/db2/dd5 0 2024-08-31T05:21:08.467 INFO:tasks.workunit.client.1.smithi073.stdout:0/746: truncate d0/d69/d7f/d62/dbf/ff2 110663 0 2024-08-31T05:21:08.467 INFO:tasks.workunit.client.1.smithi073.stdout:6/740: dwrite d15/d1a/d51/d6e/fd4 [0,4194304] 0 2024-08-31T05:21:08.469 INFO:tasks.workunit.client.1.smithi073.stdout:7/714: dread d1/da/d15/d33/d44/f66 [0,4194304] 0 2024-08-31T05:21:08.476 INFO:tasks.workunit.client.1.smithi073.stdout:0/747: creat d0/d15/d2c/d4d/d3c/d9c/de4/ff4 x:0 0 0 2024-08-31T05:21:08.477 INFO:tasks.workunit.client.1.smithi073.stdout:9/832: link dc/d27/l46 dc/d37/d42/d5a/dda/l10e 0 2024-08-31T05:21:08.479 INFO:tasks.workunit.client.1.smithi073.stdout:4/664: mknod d7/df/cca 0 2024-08-31T05:21:08.481 INFO:tasks.workunit.client.1.smithi073.stdout:6/741: mkdir d15/d75/dc8/dea 0 2024-08-31T05:21:08.481 INFO:tasks.workunit.client.1.smithi073.stdout:8/746: getdents d0/db/d44/d72/d75/d7e 0 2024-08-31T05:21:08.482 INFO:tasks.workunit.client.1.smithi073.stdout:4/665: dread d7/db/f77 [0,4194304] 0 2024-08-31T05:21:08.483 INFO:tasks.workunit.client.1.smithi073.stdout:9/833: mknod dc/d82/c10f 0 2024-08-31T05:21:08.484 INFO:tasks.workunit.client.1.smithi073.stdout:4/666: write d7/df/f56 [3300498,57598] 0 2024-08-31T05:21:08.485 INFO:tasks.workunit.client.1.smithi073.stdout:7/715: rename d1/da/d15/d33/d44/d74/cd9 to d1/d11/ce4 0 2024-08-31T05:21:08.487 INFO:tasks.workunit.client.1.smithi073.stdout:9/834: unlink dc/c95 0 2024-08-31T05:21:08.495 INFO:tasks.workunit.client.1.smithi073.stdout:0/748: rename d0/d15/d2c/d4d to d0/d69/d7f/d68/d91/df5 0 2024-08-31T05:21:08.495 INFO:tasks.workunit.client.1.smithi073.stdout:9/835: fsync dc/d27/f38 0 2024-08-31T05:21:08.496 INFO:tasks.workunit.client.1.smithi073.stdout:2/731: truncate d2/d9/d66/d70/f74 55032 0 2024-08-31T05:21:08.497 INFO:tasks.workunit.client.1.smithi073.stdout:1/715: truncate d5/d26/d54/db2/dd5/d32/d37/d6f/fab 1543112 0 2024-08-31T05:21:08.497 INFO:tasks.workunit.client.1.smithi073.stdout:0/749: truncate d0/d15/d9b/fe5 82686 0 2024-08-31T05:21:08.498 INFO:tasks.workunit.client.1.smithi073.stdout:7/716: rename d1/da/d15/c1c to d1/da/d15/d33/d44/d74/ce5 0 2024-08-31T05:21:08.499 INFO:tasks.workunit.client.1.smithi073.stdout:4/667: dread d7/df/d13/d2e/f31 [0,4194304] 0 2024-08-31T05:21:08.500 INFO:tasks.workunit.client.1.smithi073.stdout:0/750: mknod d0/d15/d9b/cf6 0 2024-08-31T05:21:08.500 INFO:tasks.workunit.client.1.smithi073.stdout:1/716: symlink d5/d26/d54/db2/dd5/d3f/ld6 0 2024-08-31T05:21:08.503 INFO:tasks.workunit.client.1.smithi073.stdout:2/732: rename d2/d9/d7f/dab/d5d/d82/fcd to d2/d9/d27/d76/ddf/fe9 0 2024-08-31T05:21:08.503 INFO:tasks.workunit.client.1.smithi073.stdout:8/747: write d0/db/d1c/d34/d80/f9f [817394,41708] 0 2024-08-31T05:21:08.504 INFO:tasks.workunit.client.1.smithi073.stdout:2/733: stat d2/d9/df/lc3 0 2024-08-31T05:21:08.506 INFO:tasks.workunit.client.1.smithi073.stdout:6/742: truncate d15/d1a/d2b/d2f/fc5 214565 0 2024-08-31T05:21:08.506 INFO:tasks.workunit.client.1.smithi073.stdout:6/743: readlink l12 0 2024-08-31T05:21:08.507 INFO:tasks.workunit.client.1.smithi073.stdout:6/744: dread d15/d17/da1/dae/db0/fc7 [0,4194304] 0 2024-08-31T05:21:08.509 INFO:tasks.workunit.client.1.smithi073.stdout:7/717: rename d1/da/d65/da9 to d1/da/d15/d33/d44/d74/dd6/de6 0 2024-08-31T05:21:08.511 INFO:tasks.workunit.client.1.smithi073.stdout:9/836: dread dc/d27/f2e [0,4194304] 0 2024-08-31T05:21:08.513 INFO:tasks.workunit.client.1.smithi073.stdout:4/668: mkdir d7/df/d13/d53/d88/dc7/dcb 0 2024-08-31T05:21:08.515 INFO:tasks.workunit.client.1.smithi073.stdout:1/717: creat d5/d26/d54/db2/dd5/d32/daf/db1/fd7 x:0 0 0 2024-08-31T05:21:08.517 INFO:tasks.workunit.client.1.smithi073.stdout:9/837: dwrite dc/f30 [0,4194304] 0 2024-08-31T05:21:08.518 INFO:tasks.workunit.client.1.smithi073.stdout:6/745: creat d15/d1a/d2b/d6a/feb x:0 0 0 2024-08-31T05:21:08.518 INFO:tasks.workunit.client.1.smithi073.stdout:1/718: write d5/d26/da5/dba/d1c/f83 [893866,59153] 0 2024-08-31T05:21:08.522 INFO:tasks.workunit.client.1.smithi073.stdout:7/718: write d1/da/d3e/d22/d35/f9c [2442236,7396] 0 2024-08-31T05:21:08.523 INFO:tasks.workunit.client.1.smithi073.stdout:4/669: mknod d7/db/ccc 0 2024-08-31T05:21:08.524 INFO:tasks.workunit.client.1.smithi073.stdout:2/734: dwrite d2/d9/fa0 [0,4194304] 0 2024-08-31T05:21:08.525 INFO:tasks.workunit.client.1.smithi073.stdout:2/735: chown d2/l20 31100 1 2024-08-31T05:21:08.525 INFO:tasks.workunit.client.1.smithi073.stdout:1/719: readlink d5/d26/d54/db2/dd5/d32/d37/d6f/dc7/ld2 0 2024-08-31T05:21:08.528 INFO:tasks.workunit.client.0.smithi067.stdout:0/69: sync 2024-08-31T05:21:08.529 INFO:tasks.workunit.client.1.smithi073.stdout:0/751: link d0/d28/c34 d0/d58/d63/cf7 0 2024-08-31T05:21:08.530 INFO:tasks.workunit.client.1.smithi073.stdout:0/752: fdatasync d0/d69/d7f/d62/dbf/fe3 0 2024-08-31T05:21:08.532 INFO:tasks.workunit.client.0.smithi067.stdout:0/70: creat d1/df/d17/f1c x:0 0 0 2024-08-31T05:21:08.533 INFO:tasks.workunit.client.1.smithi073.stdout:4/670: creat d7/df/d79/fcd x:0 0 0 2024-08-31T05:21:08.534 INFO:tasks.workunit.client.0.smithi067.stdout:0/71: rmdir d1/dd 39 2024-08-31T05:21:08.536 INFO:tasks.workunit.client.0.smithi067.stdout:0/72: unlink d1/df/c9 0 2024-08-31T05:21:08.537 INFO:tasks.workunit.client.1.smithi073.stdout:1/720: rmdir d5/d26/d54/db2/dd5/d32/d37/d6f/dc7 39 2024-08-31T05:21:08.538 INFO:tasks.workunit.client.1.smithi073.stdout:0/753: symlink d0/d15/d2c/d40/d4a/d6b/lf8 0 2024-08-31T05:21:08.538 INFO:tasks.workunit.client.1.smithi073.stdout:1/721: write d5/d26/d54/db2/dd5/d3f/f96 [1018622,12930] 0 2024-08-31T05:21:08.542 INFO:tasks.workunit.client.1.smithi073.stdout:6/746: creat d15/d1a/d2b/d2f/d4b/fec x:0 0 0 2024-08-31T05:21:08.542 INFO:tasks.workunit.client.1.smithi073.stdout:5/932: sync 2024-08-31T05:21:08.543 INFO:tasks.workunit.client.1.smithi073.stdout:4/671: rmdir d7/d1a/d5c/d6d/d2c 39 2024-08-31T05:21:08.545 INFO:tasks.workunit.client.0.smithi067.stdout:0/73: dwrite d1/dd/f15 [0,4194304] 0 2024-08-31T05:21:08.545 INFO:tasks.workunit.client.1.smithi073.stdout:1/722: dwrite d5/d26/d54/db2/dd5/d32/f3d [0,4194304] 0 2024-08-31T05:21:08.547 INFO:tasks.workunit.client.1.smithi073.stdout:2/736: write d2/d9/df/d43/f7a [1319484,72487] 0 2024-08-31T05:21:08.548 INFO:tasks.workunit.client.1.smithi073.stdout:1/723: read - d5/d26/d54/db2/dd5/d2a/f9c zero size 2024-08-31T05:21:08.552 INFO:tasks.workunit.client.1.smithi073.stdout:7/719: creat d1/da/d15/fe7 x:0 0 0 2024-08-31T05:21:08.552 INFO:tasks.workunit.client.0.smithi067.stdout:0/74: dread d1/f6 [0,4194304] 0 2024-08-31T05:21:08.553 INFO:tasks.workunit.client.1.smithi073.stdout:6/747: dwrite d15/d17/da1/dae/db0/f34 [4194304,4194304] 0 2024-08-31T05:21:08.554 INFO:tasks.workunit.client.1.smithi073.stdout:5/933: truncate dc/d3d/d55/f101 661067 0 2024-08-31T05:21:08.554 INFO:tasks.workunit.client.1.smithi073.stdout:7/720: chown d1/ld 12628 1 2024-08-31T05:21:08.555 INFO:tasks.workunit.client.1.smithi073.stdout:9/838: truncate dc/d37/d42/d5a/f9f 2371326 0 2024-08-31T05:21:08.557 INFO:tasks.workunit.client.1.smithi073.stdout:0/754: symlink d0/d28/lf9 0 2024-08-31T05:21:08.557 INFO:tasks.workunit.client.1.smithi073.stdout:7/721: write d1/da/d15/fe7 [117396,3184] 0 2024-08-31T05:21:08.557 INFO:tasks.workunit.client.0.smithi067.stdout:0/75: rmdir d1/df/d17 39 2024-08-31T05:21:08.558 INFO:tasks.workunit.client.1.smithi073.stdout:5/934: chown dc/d3d/dab/dff/d49/f81 25 1 2024-08-31T05:21:08.558 INFO:tasks.workunit.client.1.smithi073.stdout:9/839: read - dc/d37/d42/d8d/d52/f104 zero size 2024-08-31T05:21:08.558 INFO:tasks.workunit.client.1.smithi073.stdout:1/724: mkdir d5/d26/da5/dba/d1b/dd8 0 2024-08-31T05:21:08.561 INFO:tasks.workunit.client.0.smithi067.stdout:0/76: chown d1/df/f13 1817617066 1 2024-08-31T05:21:08.561 INFO:tasks.workunit.client.1.smithi073.stdout:1/725: dread - d5/d26/d54/db2/dd5/d3f/d9f/fce zero size 2024-08-31T05:21:08.561 INFO:tasks.workunit.client.1.smithi073.stdout:2/737: rename d2/d9/d27/d76/db5/fce to d2/d9/d27/d9b/da6/fea 0 2024-08-31T05:21:08.562 INFO:tasks.workunit.client.1.smithi073.stdout:0/755: creat d0/d58/ffa x:0 0 0 2024-08-31T05:21:08.563 INFO:tasks.workunit.client.1.smithi073.stdout:1/726: dread - d5/d26/d54/db2/dd5/d2a/f9c zero size 2024-08-31T05:21:08.564 INFO:tasks.workunit.client.1.smithi073.stdout:2/738: write d2/d9/d27/d9b/da6/f75 [101744,49066] 0 2024-08-31T05:21:08.564 INFO:tasks.workunit.client.1.smithi073.stdout:7/722: unlink d1/da/d3e/c54 0 2024-08-31T05:21:08.565 INFO:tasks.workunit.client.1.smithi073.stdout:5/935: symlink dc/d16/d1a/d87/d94/l133 0 2024-08-31T05:21:08.566 INFO:tasks.workunit.client.1.smithi073.stdout:1/727: read d5/d26/d54/db2/dd5/d32/f3d [2113484,38227] 0 2024-08-31T05:21:08.566 INFO:tasks.workunit.client.1.smithi073.stdout:4/672: link l4 d7/df/d13/d53/d88/lce 0 2024-08-31T05:21:08.566 INFO:tasks.workunit.client.1.smithi073.stdout:9/840: symlink dc/dc4/l110 0 2024-08-31T05:21:08.567 INFO:tasks.workunit.client.1.smithi073.stdout:5/936: write dc/d16/d3b/dc6/f10c [725258,117646] 0 2024-08-31T05:21:08.569 INFO:tasks.workunit.client.0.smithi067.stdout:0/77: rename d1/df/d17/f1c to d1/df/f1d 0 2024-08-31T05:21:08.569 INFO:tasks.workunit.client.0.smithi067.stdout:0/78: dread - d1/df/f1d zero size 2024-08-31T05:21:08.571 INFO:tasks.workunit.client.1.smithi073.stdout:2/739: mkdir d2/d25/d92/deb 0 2024-08-31T05:21:08.572 INFO:tasks.workunit.client.1.smithi073.stdout:7/723: chown d1/da/d3e/d22/d35/d83/f9f 774713527 1 2024-08-31T05:21:08.573 INFO:tasks.workunit.client.0.smithi067.stdout:0/79: mknod d1/d8/c1e 0 2024-08-31T05:21:08.573 INFO:tasks.workunit.client.0.smithi067.stdout:0/80: dread - d1/df/f1d zero size 2024-08-31T05:21:08.574 INFO:tasks.workunit.client.0.smithi067.stdout:0/81: truncate d1/dd/f15 4411936 0 2024-08-31T05:21:08.575 INFO:tasks.workunit.client.0.smithi067.stdout:0/82: rename d1/dd/d18 to d1/dd/d18/d1f 22 2024-08-31T05:21:08.577 INFO:tasks.workunit.client.1.smithi073.stdout:6/748: creat d15/d41/fed x:0 0 0 2024-08-31T05:21:08.577 INFO:tasks.workunit.client.1.smithi073.stdout:2/740: dwrite d2/d9/d3c/fd3 [0,4194304] 0 2024-08-31T05:21:08.578 INFO:tasks.workunit.client.1.smithi073.stdout:0/756: symlink d0/d15/d2c/lfb 0 2024-08-31T05:21:08.579 INFO:tasks.workunit.client.0.smithi067.stdout:0/83: creat d1/df/d17/f20 x:0 0 0 2024-08-31T05:21:08.583 INFO:tasks.workunit.client.1.smithi073.stdout:0/757: dwrite d0/d69/d7f/d68/f81 [0,4194304] 0 2024-08-31T05:21:08.585 INFO:tasks.workunit.client.0.smithi067.stdout:0/84: rename d1/df/f13 to d1/dd/f21 0 2024-08-31T05:21:08.587 INFO:tasks.workunit.client.1.smithi073.stdout:9/841: dwrite dc/d37/d42/d8d/f4b [0,4194304] 0 2024-08-31T05:21:08.592 INFO:tasks.workunit.client.0.smithi067.stdout:0/85: mknod d1/dd/d18/c22 0 2024-08-31T05:21:08.593 INFO:tasks.workunit.client.0.smithi067.stdout:0/86: readlink d1/d8/l14 0 2024-08-31T05:21:08.598 INFO:tasks.workunit.client.0.smithi067.stdout:0/87: creat d1/d8/f23 x:0 0 0 2024-08-31T05:21:08.598 INFO:tasks.workunit.client.1.smithi073.stdout:3/808: sync 2024-08-31T05:21:08.599 INFO:tasks.workunit.client.1.smithi073.stdout:1/728: mknod d5/d26/d54/db2/dd5/d32/d37/d6f/cd9 0 2024-08-31T05:21:08.600 INFO:tasks.workunit.client.1.smithi073.stdout:0/758: dread d0/d58/d63/f7d [0,4194304] 0 2024-08-31T05:21:08.601 INFO:tasks.workunit.client.1.smithi073.stdout:1/729: chown d5/d26/d54/db2/dd5/d32/d37/d6f/f97 116710920 1 2024-08-31T05:21:08.602 INFO:tasks.workunit.client.0.smithi067.stdout:0/88: rename d1/df/d17/cc to d1/df/d17/c24 0 2024-08-31T05:21:08.602 INFO:tasks.workunit.client.1.smithi073.stdout:0/759: stat d0/d69/d7f/d68/d91/df5/d3c/fb4 0 2024-08-31T05:21:08.602 INFO:tasks.workunit.client.1.smithi073.stdout:1/730: chown d5/d26/d54/db2/dd5/d5d/d61/c9d 4 1 2024-08-31T05:21:08.604 INFO:tasks.workunit.client.1.smithi073.stdout:4/673: creat d7/df/d13/fcf x:0 0 0 2024-08-31T05:21:08.607 INFO:tasks.workunit.client.1.smithi073.stdout:4/674: truncate d7/d1a/d5c/d6d/d59/d86/fb7 314 0 2024-08-31T05:21:08.607 INFO:tasks.workunit.client.1.smithi073.stdout:3/809: mkdir da/d3c/d65/d2c/d8e/dc2/d107 0 2024-08-31T05:21:08.608 INFO:tasks.workunit.client.1.smithi073.stdout:5/937: creat dc/d3d/f134 x:0 0 0 2024-08-31T05:21:08.609 INFO:tasks.workunit.client.1.smithi073.stdout:1/731: dwrite d5/d26/da5/dba/d33/d13/f84 [0,4194304] 0 2024-08-31T05:21:08.609 INFO:tasks.workunit.client.0.smithi067.stdout:0/89: link d1/d8/l14 d1/l25 0 2024-08-31T05:21:08.610 INFO:tasks.workunit.client.0.smithi067.stdout:0/90: write d1/dd/f15 [5200614,56041] 0 2024-08-31T05:21:08.613 INFO:tasks.workunit.client.1.smithi073.stdout:0/760: fsync d0/d69/d7f/f6a 0 2024-08-31T05:21:08.617 INFO:tasks.workunit.client.1.smithi073.stdout:6/749: creat d15/d17/da1/dae/db0/fee x:0 0 0 2024-08-31T05:21:08.618 INFO:tasks.workunit.client.1.smithi073.stdout:7/724: getdents d1/da/d15/d33/d44/d74/dd6 0 2024-08-31T05:21:08.621 INFO:tasks.workunit.client.1.smithi073.stdout:3/810: rename da/d18 to da/d3c/d65/d45/dcd/d108 0 2024-08-31T05:21:08.622 INFO:tasks.workunit.client.0.smithi067.stdout:0/91: creat d1/df/f26 x:0 0 0 2024-08-31T05:21:08.625 INFO:tasks.workunit.client.0.smithi067.stdout:0/92: stat d1/dd/c10 0 2024-08-31T05:21:08.629 INFO:tasks.workunit.client.1.smithi073.stdout:2/741: truncate d2/d9/d3c/f57 832803 0 2024-08-31T05:21:08.629 INFO:tasks.workunit.client.1.smithi073.stdout:9/842: rmdir dc/d37/d42/d8d/d52/d5b/d108 0 2024-08-31T05:21:08.631 INFO:tasks.workunit.client.0.smithi067.stdout:0/93: rmdir d1/dd 39 2024-08-31T05:21:08.631 INFO:tasks.workunit.client.0.smithi067.stdout:0/94: dread - d1/d8/f16 zero size 2024-08-31T05:21:08.633 INFO:tasks.workunit.client.0.smithi067.stdout:0/95: truncate d1/df/f1d 1004948 0 2024-08-31T05:21:08.633 INFO:tasks.workunit.client.0.smithi067.stdout:6/69: sync 2024-08-31T05:21:08.633 INFO:tasks.workunit.client.0.smithi067.stdout:9/51: sync 2024-08-31T05:21:08.634 INFO:tasks.workunit.client.1.smithi073.stdout:0/761: creat d0/d69/d7f/ffc x:0 0 0 2024-08-31T05:21:08.636 INFO:tasks.workunit.client.1.smithi073.stdout:0/762: dread - d0/d69/d7f/d62/dbf/fe3 zero size 2024-08-31T05:21:08.638 INFO:tasks.workunit.client.0.smithi067.stdout:6/70: creat f18 x:0 0 0 2024-08-31T05:21:08.639 INFO:tasks.workunit.client.1.smithi073.stdout:5/938: symlink dc/d16/d1a/d87/l135 0 2024-08-31T05:21:08.640 INFO:tasks.workunit.client.1.smithi073.stdout:8/748: sync 2024-08-31T05:21:08.640 INFO:tasks.workunit.client.1.smithi073.stdout:3/811: rmdir da/d3c/d65/d40/d5d/dd2 39 2024-08-31T05:21:08.640 INFO:tasks.workunit.client.1.smithi073.stdout:5/939: dread - dc/d16/d1a/d87/f9b zero size 2024-08-31T05:21:08.640 INFO:tasks.workunit.client.1.smithi073.stdout:3/812: chown da/d3c 10180771 1 2024-08-31T05:21:08.641 INFO:tasks.workunit.client.0.smithi067.stdout:0/96: rename d1/d8/ce to d1/dd/d18/c27 0 2024-08-31T05:21:08.641 INFO:tasks.workunit.client.1.smithi073.stdout:2/742: dread d2/d9/d3c/fc5 [0,4194304] 0 2024-08-31T05:21:08.642 INFO:tasks.workunit.client.0.smithi067.stdout:6/71: chown ca 302 1 2024-08-31T05:21:08.643 INFO:tasks.workunit.client.1.smithi073.stdout:1/732: link d5/d26/da5/dba/d33/f36 d5/d26/da5/fda 0 2024-08-31T05:21:08.643 INFO:tasks.workunit.client.0.smithi067.stdout:9/52: symlink dd/le 0 2024-08-31T05:21:08.644 INFO:tasks.workunit.client.1.smithi073.stdout:1/733: chown d5/d26/d54/db2/dd5/d32/d37/d6f/cd9 0 1 2024-08-31T05:21:08.644 INFO:tasks.workunit.client.1.smithi073.stdout:9/843: mkdir dc/d37/d42/d8d/d52/d5f/d111 0 2024-08-31T05:21:08.644 INFO:tasks.workunit.client.1.smithi073.stdout:1/734: chown d5/d26/da5/dba/d33/d13/l2b 4222 1 2024-08-31T05:21:08.648 INFO:tasks.workunit.client.1.smithi073.stdout:6/750: mknod d15/d1a/d2b/cef 0 2024-08-31T05:21:08.648 INFO:tasks.workunit.client.1.smithi073.stdout:0/763: rmdir d0/d15 39 2024-08-31T05:21:08.649 INFO:tasks.workunit.client.0.smithi067.stdout:9/53: mkdir dd/df 0 2024-08-31T05:21:08.649 INFO:tasks.workunit.client.0.smithi067.stdout:9/54: stat cb 0 2024-08-31T05:21:08.649 INFO:tasks.workunit.client.1.smithi073.stdout:6/751: write d15/d1a/d1e/f24 [10295750,44976] 0 2024-08-31T05:21:08.649 INFO:tasks.workunit.client.1.smithi073.stdout:7/725: creat d1/da/d15/d33/d44/d60/de1/fe8 x:0 0 0 2024-08-31T05:21:08.651 INFO:tasks.workunit.client.0.smithi067.stdout:9/55: unlink dd/le 0 2024-08-31T05:21:08.653 INFO:tasks.workunit.client.0.smithi067.stdout:9/56: write f7 [1725622,84327] 0 2024-08-31T05:21:08.657 INFO:tasks.workunit.client.1.smithi073.stdout:1/735: mkdir d5/d26/d54/db2/ddb 0 2024-08-31T05:21:08.659 INFO:tasks.workunit.client.0.smithi067.stdout:9/57: dwrite f4 [0,4194304] 0 2024-08-31T05:21:08.660 INFO:tasks.workunit.client.1.smithi073.stdout:0/764: mkdir d0/d69/d7f/d68/d91/df5/d3c/d9c/db6/dfd 0 2024-08-31T05:21:08.668 INFO:tasks.workunit.client.0.smithi067.stdout:9/58: dwrite f7 [0,4194304] 0 2024-08-31T05:21:08.669 INFO:tasks.workunit.client.1.smithi073.stdout:4/675: getdents d7/df/d13/d2e/d70/d6b 0 2024-08-31T05:21:08.671 INFO:tasks.workunit.client.1.smithi073.stdout:3/813: truncate da/fb 2416700 0 2024-08-31T05:21:08.672 INFO:tasks.workunit.client.1.smithi073.stdout:3/814: readlink da/d3c/d5a/lf9 0 2024-08-31T05:21:08.673 INFO:tasks.workunit.client.0.smithi067.stdout:9/59: dread f3 [4194304,4194304] 0 2024-08-31T05:21:08.673 INFO:tasks.workunit.client.1.smithi073.stdout:3/815: chown da/d3c/d65/d45/dcd/d108/f2a 955 1 2024-08-31T05:21:08.673 INFO:tasks.workunit.client.0.smithi067.stdout:9/60: stat cb 0 2024-08-31T05:21:08.674 INFO:tasks.workunit.client.0.smithi067.stdout:9/61: truncate fa 587436 0 2024-08-31T05:21:08.679 INFO:tasks.workunit.client.1.smithi073.stdout:1/736: creat d5/d26/d54/d5f/fdc x:0 0 0 2024-08-31T05:21:08.681 INFO:tasks.workunit.client.0.smithi067.stdout:9/62: link f7 dd/f10 0 2024-08-31T05:21:08.683 INFO:tasks.workunit.client.1.smithi073.stdout:6/752: creat d15/d75/dc8/dea/ff0 x:0 0 0 2024-08-31T05:21:08.685 INFO:tasks.workunit.client.0.smithi067.stdout:6/72: dwrite f1 [0,4194304] 0 2024-08-31T05:21:08.687 INFO:tasks.workunit.client.1.smithi073.stdout:7/726: link d1/da/db2/fdb d1/da/d65/fe9 0 2024-08-31T05:21:08.689 INFO:tasks.workunit.client.0.smithi067.stdout:9/63: creat dd/df/f11 x:0 0 0 2024-08-31T05:21:08.689 INFO:tasks.workunit.client.1.smithi073.stdout:7/727: stat d1/da/d15/d33/d44/d74/c93 0 2024-08-31T05:21:08.690 INFO:tasks.workunit.client.1.smithi073.stdout:4/676: stat d7/d1a/d5c/d6d/d2c/d2d 0 2024-08-31T05:21:08.691 INFO:tasks.workunit.client.1.smithi073.stdout:9/844: dwrite dc/de/f1e [0,4194304] 0 2024-08-31T05:21:08.692 INFO:tasks.workunit.client.1.smithi073.stdout:3/816: mknod da/d3c/d65/d45/dcd/d108/c109 0 2024-08-31T05:21:08.693 INFO:tasks.workunit.client.1.smithi073.stdout:9/845: stat dc/de/d66/d84/ffd 0 2024-08-31T05:21:08.693 INFO:tasks.workunit.client.1.smithi073.stdout:1/737: creat d5/d26/fdd x:0 0 0 2024-08-31T05:21:08.697 INFO:tasks.workunit.client.1.smithi073.stdout:5/940: write dc/d53/f79 [941500,97053] 0 2024-08-31T05:21:08.699 INFO:tasks.workunit.client.1.smithi073.stdout:0/765: fdatasync d0/d15/d2c/fd1 0 2024-08-31T05:21:08.699 INFO:tasks.workunit.client.1.smithi073.stdout:5/941: write dc/d3d/f134 [894366,100309] 0 2024-08-31T05:21:08.702 INFO:tasks.workunit.client.1.smithi073.stdout:1/738: dwrite d5/d26/d54/db2/dd5/d2a/d80/f44 [0,4194304] 0 2024-08-31T05:21:08.702 INFO:tasks.workunit.client.1.smithi073.stdout:7/728: rmdir d1/da/d65 39 2024-08-31T05:21:08.703 INFO:tasks.workunit.client.1.smithi073.stdout:8/749: truncate d0/db/d1c/d34/d38/f43 1138843 0 2024-08-31T05:21:08.703 INFO:tasks.workunit.client.1.smithi073.stdout:7/729: readlink d1/da/d15/l45 0 2024-08-31T05:21:08.704 INFO:tasks.workunit.client.1.smithi073.stdout:1/739: truncate d5/d26/da5/dba/d33/d13/d7e/f98 476105 0 2024-08-31T05:21:08.704 INFO:tasks.workunit.client.1.smithi073.stdout:2/743: truncate d2/d9/df/f1f 330590 0 2024-08-31T05:21:08.706 INFO:tasks.workunit.client.1.smithi073.stdout:3/817: mkdir da/d3c/d65/d45/dcd/d108/d10a 0 2024-08-31T05:21:08.708 INFO:tasks.workunit.client.1.smithi073.stdout:9/846: mknod dc/d37/db5/dc1/c112 0 2024-08-31T05:21:08.710 INFO:tasks.workunit.client.1.smithi073.stdout:2/744: dread d2/d25/fac [0,4194304] 0 2024-08-31T05:21:08.710 INFO:tasks.workunit.client.1.smithi073.stdout:5/942: rmdir dc/d3d/dab/dff/dbd 39 2024-08-31T05:21:08.712 INFO:tasks.workunit.client.1.smithi073.stdout:1/740: dwrite d5/d26/da5/dba/d1b/f63 [0,4194304] 0 2024-08-31T05:21:08.712 INFO:tasks.workunit.client.1.smithi073.stdout:0/766: symlink d0/d58/lfe 0 2024-08-31T05:21:08.712 INFO:tasks.workunit.client.1.smithi073.stdout:2/745: truncate d2/d9/f81 2055273 0 2024-08-31T05:21:08.714 INFO:tasks.workunit.client.1.smithi073.stdout:0/767: readlink d0/d69/d7f/d68/d91/df5/l39 0 2024-08-31T05:21:08.714 INFO:tasks.workunit.client.1.smithi073.stdout:7/730: rmdir d1/da/d3e/d22/d6b 39 2024-08-31T05:21:08.714 INFO:tasks.workunit.client.1.smithi073.stdout:8/750: mkdir d0/db/d1c/d34/d68/de4 0 2024-08-31T05:21:08.716 INFO:tasks.workunit.client.1.smithi073.stdout:4/677: mkdir d7/df/da9/dd0 0 2024-08-31T05:21:08.720 INFO:tasks.workunit.client.1.smithi073.stdout:9/847: unlink dc/f30 0 2024-08-31T05:21:08.722 INFO:tasks.workunit.client.1.smithi073.stdout:5/943: unlink dc/d16/d1a/db7/dc1/cd3 0 2024-08-31T05:21:08.723 INFO:tasks.workunit.client.1.smithi073.stdout:2/746: dwrite d2/d9/d27/d76/db5/dc6/dd1/fd9 [0,4194304] 0 2024-08-31T05:21:08.729 INFO:tasks.workunit.client.1.smithi073.stdout:7/731: truncate d1/da/f99 190746 0 2024-08-31T05:21:08.731 INFO:tasks.workunit.client.1.smithi073.stdout:0/768: creat d0/d69/d7f/d68/d91/df5/d3c/d9c/dc8/fff x:0 0 0 2024-08-31T05:21:08.732 INFO:tasks.workunit.client.1.smithi073.stdout:2/747: dread d2/d9/df/d43/d88/f8f [0,4194304] 0 2024-08-31T05:21:08.732 INFO:tasks.workunit.client.1.smithi073.stdout:9/848: dwrite dc/d37/d42/d8d/d52/d5f/fe6 [0,4194304] 0 2024-08-31T05:21:08.732 INFO:tasks.workunit.client.1.smithi073.stdout:7/732: chown d1/lb 0 1 2024-08-31T05:21:08.734 INFO:tasks.workunit.client.1.smithi073.stdout:3/818: dread da/d3c/d65/d45/f55 [0,4194304] 0 2024-08-31T05:21:08.734 INFO:tasks.workunit.client.1.smithi073.stdout:0/769: dread - d0/d69/d7f/d62/fa6 zero size 2024-08-31T05:21:08.734 INFO:tasks.workunit.client.0.smithi067.stdout:6/73: dwrite ff [0,4194304] 0 2024-08-31T05:21:08.735 INFO:tasks.workunit.client.0.smithi067.stdout:6/74: chown c5 138 1 2024-08-31T05:21:08.735 INFO:tasks.workunit.client.1.smithi073.stdout:9/849: chown dc/d37/d42/d8d/d52/fa4 1 1 2024-08-31T05:21:08.737 INFO:tasks.workunit.client.1.smithi073.stdout:4/678: dread d7/df/f25 [0,4194304] 0 2024-08-31T05:21:08.738 INFO:tasks.workunit.client.1.smithi073.stdout:8/751: dwrite d0/db/d1c/f1f [0,4194304] 0 2024-08-31T05:21:08.738 INFO:tasks.workunit.client.1.smithi073.stdout:3/819: chown da/d3c/d65/d2c/d8e/dc2/d107 955429 1 2024-08-31T05:21:08.741 INFO:tasks.workunit.client.0.smithi067.stdout:6/75: creat f19 x:0 0 0 2024-08-31T05:21:08.742 INFO:tasks.workunit.client.0.smithi067.stdout:6/76: write f14 [492372,75008] 0 2024-08-31T05:21:08.743 INFO:tasks.workunit.client.0.smithi067.stdout:6/77: chown lb 126 1 2024-08-31T05:21:08.743 INFO:tasks.workunit.client.0.smithi067.stdout:6/78: read - f19 zero size 2024-08-31T05:21:08.745 INFO:tasks.workunit.client.1.smithi073.stdout:2/748: symlink d2/d9/lec 0 2024-08-31T05:21:08.747 INFO:tasks.workunit.client.1.smithi073.stdout:8/752: dwrite d0/da8/fc6 [0,4194304] 0 2024-08-31T05:21:08.748 INFO:tasks.workunit.client.1.smithi073.stdout:7/733: rename d1/d11/d14 to d1/da/d15/d33/d44/d74/dd6/dea 0 2024-08-31T05:21:08.750 INFO:tasks.workunit.client.0.smithi067.stdout:6/79: creat f1a x:0 0 0 2024-08-31T05:21:08.750 INFO:tasks.workunit.client.1.smithi073.stdout:7/734: readlink d1/da/d3e/d22/d35/l49 0 2024-08-31T05:21:08.751 INFO:tasks.workunit.client.1.smithi073.stdout:6/753: write d15/d17/da1/dae/db0/f45 [321393,49676] 0 2024-08-31T05:21:08.753 INFO:tasks.workunit.client.1.smithi073.stdout:3/820: symlink da/d3c/d65/d2c/d8e/dc2/l10b 0 2024-08-31T05:21:08.755 INFO:tasks.workunit.client.1.smithi073.stdout:3/821: write da/d3c/d67/fb6 [350819,52001] 0 2024-08-31T05:21:08.756 INFO:tasks.workunit.client.0.smithi067.stdout:6/80: mkdir d1b 0 2024-08-31T05:21:08.757 INFO:tasks.workunit.client.1.smithi073.stdout:0/770: mknod d0/d69/d7f/d68/c100 0 2024-08-31T05:21:08.759 INFO:tasks.workunit.client.1.smithi073.stdout:2/749: rmdir d2/d9/d84 39 2024-08-31T05:21:08.760 INFO:tasks.workunit.client.1.smithi073.stdout:2/750: chown d2/d9/df/d43/lc8 100256477 1 2024-08-31T05:21:08.761 INFO:tasks.workunit.client.1.smithi073.stdout:8/753: mkdir d0/db/d1c/d34/d80/d9a/de5 0 2024-08-31T05:21:08.761 INFO:tasks.workunit.client.1.smithi073.stdout:2/751: write d2/d9/f24 [2874683,105016] 0 2024-08-31T05:21:08.763 INFO:tasks.workunit.client.1.smithi073.stdout:1/741: dread d5/d26/da5/fda [0,4194304] 0 2024-08-31T05:21:08.768 INFO:tasks.workunit.client.1.smithi073.stdout:7/735: creat d1/da/d3e/d22/d47/da8/feb x:0 0 0 2024-08-31T05:21:08.769 INFO:tasks.workunit.client.1.smithi073.stdout:6/754: creat d15/d17/da1/dae/db0/d38/ff1 x:0 0 0 2024-08-31T05:21:08.771 INFO:tasks.workunit.client.1.smithi073.stdout:3/822: chown da/d3c/d65/l31 115225285 1 2024-08-31T05:21:08.773 INFO:tasks.workunit.client.1.smithi073.stdout:3/823: stat da/d3c/d65/d40/f57 0 2024-08-31T05:21:08.773 INFO:tasks.workunit.client.1.smithi073.stdout:5/944: dread fb [0,4194304] 0 2024-08-31T05:21:08.774 INFO:tasks.workunit.client.1.smithi073.stdout:3/824: chown da/d3c/d67/l6c 12933 1 2024-08-31T05:21:08.774 INFO:tasks.workunit.client.1.smithi073.stdout:8/754: symlink d0/db/d44/d72/d75/d7e/d91/dac/le6 0 2024-08-31T05:21:08.775 INFO:tasks.workunit.client.1.smithi073.stdout:3/825: stat da/d3c/d65/d40/d5d/f8b 0 2024-08-31T05:21:08.776 INFO:tasks.workunit.client.1.smithi073.stdout:3/826: chown da/d3c/d65/d45/dcd/d108/da2/daf/dbc 31 1 2024-08-31T05:21:08.777 INFO:tasks.workunit.client.1.smithi073.stdout:6/755: mknod d15/d17/da1/cf2 0 2024-08-31T05:21:08.778 INFO:tasks.workunit.client.1.smithi073.stdout:4/679: link d7/df/d13/d2e/f3a d7/df/d13/d2e/d70/fd1 0 2024-08-31T05:21:08.778 INFO:tasks.workunit.client.1.smithi073.stdout:6/756: write d15/d17/da1/dae/db0/d38/f5f [1974735,69515] 0 2024-08-31T05:21:08.780 INFO:tasks.workunit.client.1.smithi073.stdout:2/752: truncate d2/d9/d7f/dab/f42 2090178 0 2024-08-31T05:21:08.782 INFO:tasks.workunit.client.1.smithi073.stdout:5/945: readlink dc/d3d/dab/dff/d49/dd2/lc9 0 2024-08-31T05:21:08.784 INFO:tasks.workunit.client.1.smithi073.stdout:5/946: read - dc/d3d/dab/dd5/f108 zero size 2024-08-31T05:21:08.785 INFO:tasks.workunit.client.1.smithi073.stdout:9/850: truncate dc/d82/fbe 242308 0 2024-08-31T05:21:08.786 INFO:tasks.workunit.client.0.smithi067.stdout:6/81: truncate ff 391226 0 2024-08-31T05:21:08.786 INFO:tasks.workunit.client.1.smithi073.stdout:2/753: dread d2/d9/d7f/dab/d5d/d82/f8a [0,4194304] 0 2024-08-31T05:21:08.787 INFO:tasks.workunit.client.0.smithi067.stdout:6/82: write f10 [234146,101103] 0 2024-08-31T05:21:08.788 INFO:tasks.workunit.client.0.smithi067.stdout:6/83: write f18 [949239,6562] 0 2024-08-31T05:21:08.788 INFO:tasks.workunit.client.1.smithi073.stdout:2/754: dread - d2/d9/d27/d76/d97/faf zero size 2024-08-31T05:21:08.789 INFO:tasks.workunit.client.1.smithi073.stdout:1/742: dread d5/d26/d54/d5f/f7c [0,4194304] 0 2024-08-31T05:21:08.791 INFO:tasks.workunit.client.1.smithi073.stdout:2/755: dread d2/d9/d7f/dab/d5d/f71 [0,4194304] 0 2024-08-31T05:21:08.792 INFO:tasks.workunit.client.1.smithi073.stdout:7/736: dread d1/da/d15/f4b [0,4194304] 0 2024-08-31T05:21:08.794 INFO:tasks.workunit.client.0.smithi067.stdout:6/84: mknod d1b/c1c 0 2024-08-31T05:21:08.796 INFO:tasks.workunit.client.0.smithi067.stdout:6/85: rmdir d1b 39 2024-08-31T05:21:08.797 INFO:tasks.workunit.client.1.smithi073.stdout:2/756: dwrite d2/d9/d7f/fd2 [0,4194304] 0 2024-08-31T05:21:08.798 INFO:tasks.workunit.client.1.smithi073.stdout:0/771: getdents d0/d15/d2c/d40/d4a/d6b 0 2024-08-31T05:21:08.798 INFO:tasks.workunit.client.1.smithi073.stdout:0/772: readlink d0/d28/lf9 0 2024-08-31T05:21:08.803 INFO:tasks.workunit.client.1.smithi073.stdout:0/773: dwrite d0/d15/d2c/d40/f9a [0,4194304] 0 2024-08-31T05:21:08.806 INFO:tasks.workunit.client.0.smithi067.stdout:6/86: rename f1 to d1b/f1d 0 2024-08-31T05:21:08.806 INFO:tasks.workunit.client.1.smithi073.stdout:4/680: write d7/df/d13/d2e/f31 [1407257,29010] 0 2024-08-31T05:21:08.807 INFO:tasks.workunit.client.1.smithi073.stdout:7/737: mknod d1/da/d15/d33/cec 0 2024-08-31T05:21:08.807 INFO:tasks.workunit.client.1.smithi073.stdout:4/681: dread - d7/df/d1b/d34/fc8 zero size 2024-08-31T05:21:08.808 INFO:tasks.workunit.client.1.smithi073.stdout:7/738: chown d1/da/f7b 396899 1 2024-08-31T05:21:08.810 INFO:tasks.workunit.client.1.smithi073.stdout:8/755: mkdir d0/d62/db4/de7 0 2024-08-31T05:21:08.812 INFO:tasks.workunit.client.1.smithi073.stdout:8/756: write d0/db/d1c/d23/f26 [4421780,120120] 0 2024-08-31T05:21:08.813 INFO:tasks.workunit.client.1.smithi073.stdout:8/757: write d0/fbc [765087,111993] 0 2024-08-31T05:21:08.814 INFO:tasks.workunit.client.1.smithi073.stdout:8/758: read d0/f17 [2101040,4979] 0 2024-08-31T05:21:08.815 INFO:tasks.workunit.client.1.smithi073.stdout:8/759: fsync d0/db/d1c/d2a/f89 0 2024-08-31T05:21:08.818 INFO:tasks.workunit.client.1.smithi073.stdout:6/757: rename d15/d1a/d2b/d2f/d4b/d97/ld7 to d15/d1a/d2b/lf3 0 2024-08-31T05:21:08.821 INFO:tasks.workunit.client.1.smithi073.stdout:7/739: fdatasync d1/fdd 0 2024-08-31T05:21:08.823 INFO:tasks.workunit.client.1.smithi073.stdout:3/827: getdents da/d3c/d5a 0 2024-08-31T05:21:08.827 INFO:tasks.workunit.client.1.smithi073.stdout:6/758: unlink d15/d75/dc8/dea/ff0 0 2024-08-31T05:21:08.827 INFO:tasks.workunit.client.0.smithi067.stdout:6/87: getdents d1b 0 2024-08-31T05:21:08.831 INFO:tasks.workunit.client.1.smithi073.stdout:3/828: creat da/d3c/d82/d95/db9/f10c x:0 0 0 2024-08-31T05:21:08.832 INFO:tasks.workunit.client.0.smithi067.stdout:6/88: getdents d1b 0 2024-08-31T05:21:08.834 INFO:tasks.workunit.client.1.smithi073.stdout:5/947: rename dc/d53/l117 to dc/d3d/dab/dd5/l136 0 2024-08-31T05:21:08.835 INFO:tasks.workunit.client.1.smithi073.stdout:5/948: fsync dc/d16/d1a/f125 0 2024-08-31T05:21:08.835 INFO:tasks.workunit.client.1.smithi073.stdout:2/757: write f1 [1199091,59072] 0 2024-08-31T05:21:08.836 INFO:tasks.workunit.client.0.smithi067.stdout:6/89: rmdir d1b 39 2024-08-31T05:21:08.841 INFO:tasks.workunit.client.1.smithi073.stdout:4/682: creat d7/df/d13/d2e/fd2 x:0 0 0 2024-08-31T05:21:08.841 INFO:tasks.workunit.client.1.smithi073.stdout:1/743: truncate d5/d26/da5/fda 2199747 0 2024-08-31T05:21:08.841 INFO:tasks.workunit.client.1.smithi073.stdout:6/759: dwrite d15/d1a/d2b/d2f/f64 [4194304,4194304] 0 2024-08-31T05:21:08.842 INFO:tasks.workunit.client.0.smithi067.stdout:6/90: rename d1b/c1c to d1b/c1e 0 2024-08-31T05:21:08.845 INFO:tasks.workunit.client.1.smithi073.stdout:0/774: rename d0/d15/d2c/d41/d52/fa2 to d0/d69/d8e/d99/f101 0 2024-08-31T05:21:08.858 INFO:tasks.workunit.client.0.smithi067.stdout:6/91: getdents d1b 0 2024-08-31T05:21:08.861 INFO:tasks.workunit.client.0.smithi067.stdout:6/92: mknod d1b/c1f 0 2024-08-31T05:21:08.869 INFO:tasks.workunit.client.0.smithi067.stdout:6/93: getdents d1b 0 2024-08-31T05:21:08.870 INFO:tasks.workunit.client.0.smithi067.stdout:6/94: truncate f7 751616 0 2024-08-31T05:21:08.872 INFO:tasks.workunit.client.0.smithi067.stdout:6/95: fdatasync f7 0 2024-08-31T05:21:08.873 INFO:tasks.workunit.client.0.smithi067.stdout:6/96: rmdir d1b 39 2024-08-31T05:21:08.874 INFO:tasks.workunit.client.0.smithi067.stdout:6/97: write f19 [205414,99443] 0 2024-08-31T05:21:08.875 INFO:tasks.workunit.client.0.smithi067.stdout:6/98: fsync f10 0 2024-08-31T05:21:08.878 INFO:tasks.workunit.client.0.smithi067.stdout:6/99: dread f14 [0,4194304] 0 2024-08-31T05:21:08.884 INFO:tasks.workunit.client.0.smithi067.stdout:6/100: dwrite f1a [0,4194304] 0 2024-08-31T05:21:08.889 INFO:tasks.workunit.client.0.smithi067.stdout:6/101: dread f19 [0,4194304] 0 2024-08-31T05:21:08.890 INFO:tasks.workunit.client.0.smithi067.stdout:6/102: write f14 [985236,50413] 0 2024-08-31T05:21:08.890 INFO:tasks.workunit.client.0.smithi067.stdout:6/103: readlink l15 0 2024-08-31T05:21:08.893 INFO:tasks.workunit.client.0.smithi067.stdout:6/104: creat d1b/f20 x:0 0 0 2024-08-31T05:21:08.895 INFO:tasks.workunit.client.0.smithi067.stdout:6/105: creat d1b/f21 x:0 0 0 2024-08-31T05:21:08.895 INFO:tasks.workunit.client.0.smithi067.stdout:6/106: dread - d1b/f21 zero size 2024-08-31T05:21:08.896 INFO:tasks.workunit.client.0.smithi067.stdout:6/107: chown d1b/c1e 824347 1 2024-08-31T05:21:08.897 INFO:tasks.workunit.client.0.smithi067.stdout:6/108: write d1b/f21 [55541,123480] 0 2024-08-31T05:21:08.898 INFO:tasks.workunit.client.0.smithi067.stdout:6/109: symlink d1b/l22 0 2024-08-31T05:21:08.900 INFO:tasks.workunit.client.0.smithi067.stdout:6/110: mkdir d1b/d23 0 2024-08-31T05:21:08.902 INFO:tasks.workunit.client.0.smithi067.stdout:6/111: unlink d1b/c1e 0 2024-08-31T05:21:08.904 INFO:tasks.workunit.client.0.smithi067.stdout:6/112: creat d1b/d23/f24 x:0 0 0 2024-08-31T05:21:08.906 INFO:tasks.workunit.client.0.smithi067.stdout:6/113: dread f19 [0,4194304] 0 2024-08-31T05:21:08.907 INFO:tasks.workunit.client.0.smithi067.stdout:6/114: mknod d1b/d23/c25 0 2024-08-31T05:21:08.908 INFO:tasks.workunit.client.0.smithi067.stdout:6/115: rmdir d1b/d23 39 2024-08-31T05:21:08.915 INFO:tasks.workunit.client.0.smithi067.stdout:6/116: link ca d1b/d23/c26 0 2024-08-31T05:21:08.916 INFO:tasks.workunit.client.1.smithi073.stdout:6/760: creat d15/d1a/d51/d61/ff4 x:0 0 0 2024-08-31T05:21:08.916 INFO:tasks.workunit.client.0.smithi067.stdout:6/117: rmdir d1b 39 2024-08-31T05:21:08.917 INFO:tasks.workunit.client.1.smithi073.stdout:7/740: truncate d1/da/d3e/d22/d5c/f8b 216101 0 2024-08-31T05:21:08.917 INFO:tasks.workunit.client.1.smithi073.stdout:8/760: rename d0/db/d1c/d34/d68/de4 to d0/db/d1c/d24/d73/ddc/de8 0 2024-08-31T05:21:08.919 INFO:tasks.workunit.client.1.smithi073.stdout:0/775: truncate d0/d69/d7f/d68/d91/fb3 350351 0 2024-08-31T05:21:08.919 INFO:tasks.workunit.client.0.smithi067.stdout:6/118: mknod d1b/c27 0 2024-08-31T05:21:08.920 INFO:tasks.workunit.client.1.smithi073.stdout:4/683: mknod d7/df/cd3 0 2024-08-31T05:21:08.921 INFO:tasks.workunit.client.1.smithi073.stdout:5/949: creat dc/d16/d3b/f137 x:0 0 0 2024-08-31T05:21:08.922 INFO:tasks.workunit.client.1.smithi073.stdout:7/741: dread - d1/da/d15/d33/d44/d60/de1/fe8 zero size 2024-08-31T05:21:08.922 INFO:tasks.workunit.client.0.smithi067.stdout:6/119: mkdir d1b/d23/d28 0 2024-08-31T05:21:08.922 INFO:tasks.workunit.client.0.smithi067.stdout:6/120: truncate f18 1590780 0 2024-08-31T05:21:08.923 INFO:tasks.workunit.client.0.smithi067.stdout:6/121: read - d1b/d23/f24 zero size 2024-08-31T05:21:08.923 INFO:tasks.workunit.client.1.smithi073.stdout:6/761: fdatasync d15/d1a/d1e/d69/d7e/f8e 0 2024-08-31T05:21:08.925 INFO:tasks.workunit.client.1.smithi073.stdout:1/744: dwrite d5/d26/d54/db2/dd5/f38 [0,4194304] 0 2024-08-31T05:21:08.927 INFO:tasks.workunit.client.1.smithi073.stdout:6/762: write d15/d1a/d51/d61/f80 [1134883,42016] 0 2024-08-31T05:21:08.927 INFO:tasks.workunit.client.1.smithi073.stdout:3/829: dwrite da/d3c/d67/db7/fdc [0,4194304] 0 2024-08-31T05:21:08.927 INFO:tasks.workunit.client.1.smithi073.stdout:5/950: read dc/d16/d3b/d3f/fec [2477638,78310] 0 2024-08-31T05:21:08.927 INFO:tasks.workunit.client.1.smithi073.stdout:0/776: rename d0/d15/d2c/d40/f47 to d0/d69/f102 0 2024-08-31T05:21:08.930 INFO:tasks.workunit.client.1.smithi073.stdout:3/830: write da/d3c/d82/d95/db9/f10c [805375,58750] 0 2024-08-31T05:21:08.931 INFO:tasks.workunit.client.1.smithi073.stdout:8/761: creat d0/db/d44/d72/d75/fe9 x:0 0 0 2024-08-31T05:21:08.932 INFO:tasks.workunit.client.0.smithi067.stdout:6/122: symlink d1b/d23/d28/l29 0 2024-08-31T05:21:08.932 INFO:tasks.workunit.client.0.smithi067.stdout:6/123: readlink d1b/d23/d28/l29 0 2024-08-31T05:21:08.939 INFO:tasks.workunit.client.0.smithi067.stdout:3/89: sync 2024-08-31T05:21:08.939 INFO:tasks.workunit.client.0.smithi067.stdout:4/64: sync 2024-08-31T05:21:08.939 INFO:tasks.workunit.client.0.smithi067.stdout:8/149: sync 2024-08-31T05:21:08.939 INFO:tasks.workunit.client.0.smithi067.stdout:1/63: sync 2024-08-31T05:21:08.939 INFO:tasks.workunit.client.0.smithi067.stdout:5/49: sync 2024-08-31T05:21:08.940 INFO:tasks.workunit.client.0.smithi067.stdout:2/64: sync 2024-08-31T05:21:08.940 INFO:tasks.workunit.client.0.smithi067.stdout:7/69: sync 2024-08-31T05:21:08.941 INFO:tasks.workunit.client.1.smithi073.stdout:5/951: dread dc/d16/d3b/fb4 [0,4194304] 0 2024-08-31T05:21:08.941 INFO:tasks.workunit.client.1.smithi073.stdout:6/763: mknod d15/d1a/d2b/d2f/d4b/d97/cf5 0 2024-08-31T05:21:08.941 INFO:tasks.workunit.client.0.smithi067.stdout:6/124: dwrite f14 [0,4194304] 0 2024-08-31T05:21:08.942 INFO:tasks.workunit.client.0.smithi067.stdout:6/125: chown d1b/d23 1278956739 1 2024-08-31T05:21:08.944 INFO:tasks.workunit.client.1.smithi073.stdout:0/777: rename d0/d69/d8e/f3f to d0/d15/d2c/d40/d4a/d6b/f103 0 2024-08-31T05:21:08.945 INFO:tasks.workunit.client.0.smithi067.stdout:5/50: fdatasync f9 0 2024-08-31T05:21:08.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:08 smithi073 ceph-mon[24726]: pgmap v25: 65 pgs: 65 active+clean; 1.4 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 54 MiB/s rd, 177 MiB/s wr, 344 op/s 2024-08-31T05:21:08.946 INFO:tasks.workunit.client.0.smithi067.stdout:4/65: rmdir d4 39 2024-08-31T05:21:08.946 INFO:tasks.workunit.client.1.smithi073.stdout:4/684: symlink d7/d1a/d5c/d62/d9f/ld4 0 2024-08-31T05:21:08.947 INFO:tasks.workunit.client.1.smithi073.stdout:3/831: dread da/d3c/f5e [0,4194304] 0 2024-08-31T05:21:08.948 INFO:tasks.workunit.client.1.smithi073.stdout:9/851: sync 2024-08-31T05:21:08.949 INFO:tasks.workunit.client.0.smithi067.stdout:5/51: fdatasync f2 0 2024-08-31T05:21:08.950 INFO:tasks.workunit.client.1.smithi073.stdout:9/852: write dc/de/d66/d84/ffd [589151,122712] 0 2024-08-31T05:21:08.954 INFO:tasks.workunit.client.0.smithi067.stdout:5/52: truncate f2 1295608 0 2024-08-31T05:21:08.955 INFO:tasks.workunit.client.1.smithi073.stdout:6/764: mkdir d15/d1a/d51/d61/d7c/da6/df6 0 2024-08-31T05:21:08.956 INFO:tasks.workunit.client.0.smithi067.stdout:1/64: creat d3/f14 x:0 0 0 2024-08-31T05:21:08.959 INFO:tasks.workunit.client.1.smithi073.stdout:5/952: creat dc/d16/d3b/d3f/d4f/d98/f138 x:0 0 0 2024-08-31T05:21:08.960 INFO:tasks.workunit.client.0.smithi067.stdout:6/126: rename d1b/f1d to d1b/d23/f2a 0 2024-08-31T05:21:08.962 INFO:tasks.workunit.client.0.smithi067.stdout:4/66: chown d4/d14/c19 6613 1 2024-08-31T05:21:08.963 INFO:tasks.workunit.client.0.smithi067.stdout:8/150: dwrite d0/d2/f24 [0,4194304] 0 2024-08-31T05:21:08.965 INFO:tasks.workunit.client.0.smithi067.stdout:6/127: dread f19 [0,4194304] 0 2024-08-31T05:21:08.965 INFO:tasks.workunit.client.0.smithi067.stdout:4/67: read d4/d9/fa [354978,124290] 0 2024-08-31T05:21:08.966 INFO:tasks.workunit.client.1.smithi073.stdout:0/778: symlink d0/d69/d7f/d68/d91/df5/l104 0 2024-08-31T05:21:08.967 INFO:tasks.workunit.client.0.smithi067.stdout:6/128: stat d1b/l22 0 2024-08-31T05:21:08.967 INFO:tasks.workunit.client.0.smithi067.stdout:4/68: fdatasync d4/d9/fa 0 2024-08-31T05:21:08.967 INFO:tasks.workunit.client.1.smithi073.stdout:4/685: creat d7/d1a/d5c/d6d/d59/d86/fd5 x:0 0 0 2024-08-31T05:21:08.968 INFO:tasks.workunit.client.0.smithi067.stdout:3/90: dwrite f4 [4194304,4194304] 0 2024-08-31T05:21:08.971 INFO:tasks.workunit.client.0.smithi067.stdout:1/65: creat d3/f15 x:0 0 0 2024-08-31T05:21:08.972 INFO:tasks.workunit.client.1.smithi073.stdout:7/742: creat d1/d11/fed x:0 0 0 2024-08-31T05:21:08.977 INFO:tasks.workunit.client.0.smithi067.stdout:8/151: symlink d0/d2/da/dd/d1f/l2e 0 2024-08-31T05:21:08.979 INFO:tasks.workunit.client.0.smithi067.stdout:6/129: dread f14 [0,4194304] 0 2024-08-31T05:21:08.981 INFO:tasks.workunit.client.0.smithi067.stdout:3/91: mknod db/c23 0 2024-08-31T05:21:08.982 INFO:tasks.workunit.client.1.smithi073.stdout:0/779: rename d0/d69/d7f/ffc to d0/d69/d8e/d99/f105 0 2024-08-31T05:21:08.983 INFO:tasks.workunit.client.1.smithi073.stdout:2/758: sync 2024-08-31T05:21:08.984 INFO:tasks.workunit.client.1.smithi073.stdout:1/745: dread d5/d26/f64 [0,4194304] 0 2024-08-31T05:21:08.985 INFO:tasks.workunit.client.0.smithi067.stdout:5/53: dwrite f7 [0,4194304] 0 2024-08-31T05:21:08.985 INFO:tasks.workunit.client.0.smithi067.stdout:3/92: write db/fd [3914688,15560] 0 2024-08-31T05:21:08.986 INFO:tasks.workunit.client.1.smithi073.stdout:4/686: mkdir d7/d1a/d5c/d6d/d59/d65/db9/dd6 0 2024-08-31T05:21:08.988 INFO:tasks.workunit.client.0.smithi067.stdout:3/93: chown db 6603 1 2024-08-31T05:21:08.988 INFO:tasks.workunit.client.0.smithi067.stdout:7/70: link c4 c13 0 2024-08-31T05:21:08.989 INFO:tasks.workunit.client.1.smithi073.stdout:0/780: dread d0/d69/d7f/d68/d91/df5/d3c/fd5 [0,4194304] 0 2024-08-31T05:21:08.995 INFO:tasks.workunit.client.0.smithi067.stdout:1/66: rename d3/lf to d3/dd/l16 0 2024-08-31T05:21:08.996 INFO:tasks.workunit.client.0.smithi067.stdout:4/69: dwrite d4/d13/f1a [0,4194304] 0 2024-08-31T05:21:08.998 INFO:tasks.workunit.client.1.smithi073.stdout:6/765: symlink d15/d1a/d2b/d2f/lf7 0 2024-08-31T05:21:09.000 INFO:tasks.workunit.client.1.smithi073.stdout:5/953: mkdir dc/d16/d1a/d139 0 2024-08-31T05:21:09.000 INFO:tasks.workunit.client.1.smithi073.stdout:9/853: dread dc/d37/d42/d8d/d52/faf [0,4194304] 0 2024-08-31T05:21:09.001 INFO:tasks.workunit.client.1.smithi073.stdout:8/762: link d0/db/d1c/d23/c47 d0/db/d1c/d24/cea 0 2024-08-31T05:21:09.002 INFO:tasks.workunit.client.0.smithi067.stdout:8/152: dread d0/f9 [0,4194304] 0 2024-08-31T05:21:09.002 INFO:tasks.workunit.client.0.smithi067.stdout:5/54: dwrite f4 [0,4194304] 0 2024-08-31T05:21:09.007 INFO:tasks.workunit.client.0.smithi067.stdout:7/71: mkdir d14 0 2024-08-31T05:21:09.011 INFO:tasks.workunit.client.1.smithi073.stdout:4/687: dread d7/d1a/d5c/d6d/d59/f74 [0,4194304] 0 2024-08-31T05:21:09.012 INFO:tasks.workunit.client.0.smithi067.stdout:3/94: creat db/d17/f24 x:0 0 0 2024-08-31T05:21:09.013 INFO:tasks.workunit.client.0.smithi067.stdout:2/65: truncate f1 1929780 0 2024-08-31T05:21:09.014 INFO:tasks.workunit.client.1.smithi073.stdout:1/746: creat d5/d26/d54/db2/dd5/d32/d37/fde x:0 0 0 2024-08-31T05:21:09.014 INFO:tasks.workunit.client.0.smithi067.stdout:1/67: dwrite d3/f15 [0,4194304] 0 2024-08-31T05:21:09.016 INFO:tasks.workunit.client.0.smithi067.stdout:3/95: readlink db/d17/l1c 0 2024-08-31T05:21:09.017 INFO:tasks.workunit.client.0.smithi067.stdout:4/70: dwrite d4/d13/f1a [4194304,4194304] 0 2024-08-31T05:21:09.017 INFO:tasks.workunit.client.0.smithi067.stdout:6/130: dread f4 [0,4194304] 0 2024-08-31T05:21:09.019 INFO:tasks.workunit.client.1.smithi073.stdout:1/747: dwrite d5/d26/da5/dba/d33/d13/d7e/fbf [0,4194304] 0 2024-08-31T05:21:09.021 INFO:tasks.workunit.client.0.smithi067.stdout:5/55: dread f6 [0,4194304] 0 2024-08-31T05:21:09.022 INFO:tasks.workunit.client.0.smithi067.stdout:8/153: unlink d0/d2/f1e 0 2024-08-31T05:21:09.029 INFO:tasks.workunit.client.1.smithi073.stdout:7/743: mknod d1/da/d3e/db1/dbb/cee 0 2024-08-31T05:21:09.031 INFO:tasks.workunit.client.1.smithi073.stdout:0/781: dwrite d0/d69/d7f/f97 [0,4194304] 0 2024-08-31T05:21:09.032 INFO:tasks.workunit.client.1.smithi073.stdout:5/954: readlink dc/l88 0 2024-08-31T05:21:09.032 INFO:tasks.workunit.client.0.smithi067.stdout:2/66: creat db/ff x:0 0 0 2024-08-31T05:21:09.032 INFO:tasks.workunit.client.0.smithi067.stdout:2/67: rename db to db/d10 22 2024-08-31T05:21:09.033 INFO:tasks.workunit.client.0.smithi067.stdout:2/68: dread - db/ff zero size 2024-08-31T05:21:09.033 INFO:tasks.workunit.client.1.smithi073.stdout:9/854: write dc/d82/de4/ffa [132326,127183] 0 2024-08-31T05:21:09.033 INFO:tasks.workunit.client.0.smithi067.stdout:1/68: mknod d3/c17 0 2024-08-31T05:21:09.036 INFO:tasks.workunit.client.0.smithi067.stdout:6/131: unlink f1a 0 2024-08-31T05:21:09.037 INFO:tasks.workunit.client.1.smithi073.stdout:9/855: write dc/de/d11/d85/fe7 [368351,118197] 0 2024-08-31T05:21:09.038 INFO:tasks.workunit.client.1.smithi073.stdout:2/759: mknod d2/d9/ced 0 2024-08-31T05:21:09.041 INFO:tasks.workunit.client.1.smithi073.stdout:3/832: getdents da/d3c/d82/d97 0 2024-08-31T05:21:09.044 INFO:tasks.workunit.client.0.smithi067.stdout:5/56: mkdir db/d11 0 2024-08-31T05:21:09.050 INFO:tasks.workunit.client.0.smithi067.stdout:5/57: dwrite f4 [0,4194304] 0 2024-08-31T05:21:09.051 INFO:tasks.workunit.client.0.smithi067.stdout:7/72: creat d14/f15 x:0 0 0 2024-08-31T05:21:09.056 INFO:tasks.workunit.client.1.smithi073.stdout:5/955: mkdir dc/d3d/dab/d13a 0 2024-08-31T05:21:09.057 INFO:tasks.workunit.client.1.smithi073.stdout:5/956: chown dc/d16/d3b/d3f/d4f/l60 11719062 1 2024-08-31T05:21:09.058 INFO:tasks.workunit.client.0.smithi067.stdout:1/69: symlink d3/l18 0 2024-08-31T05:21:09.059 INFO:tasks.workunit.client.1.smithi073.stdout:0/782: mknod d0/d69/d7f/d68/d91/df5/d3c/d9c/db6/de6/c106 0 2024-08-31T05:21:09.060 INFO:tasks.workunit.client.1.smithi073.stdout:0/783: read d0/d69/d7f/f65 [2102450,92145] 0 2024-08-31T05:21:09.061 INFO:tasks.workunit.client.1.smithi073.stdout:0/784: fsync d0/d15/d2c/d41/d52/fde 0 2024-08-31T05:21:09.062 INFO:tasks.workunit.client.1.smithi073.stdout:0/785: fsync d0/d69/d7f/d68/d91/df5/d3c/d9c/dc8/fff 0 2024-08-31T05:21:09.063 INFO:tasks.workunit.client.1.smithi073.stdout:0/786: write d0/d69/d7f/d68/d91/df5/d3c/fa [8983175,98204] 0 2024-08-31T05:21:09.065 INFO:tasks.workunit.client.1.smithi073.stdout:9/856: creat dc/d37/d42/d8d/d52/d5f/f113 x:0 0 0 2024-08-31T05:21:09.067 INFO:tasks.workunit.client.0.smithi067.stdout:4/71: link d4/d9/fa d4/d14/f1b 0 2024-08-31T05:21:09.068 INFO:tasks.workunit.client.1.smithi073.stdout:4/688: creat d7/d1a/d5c/d6d/d59/d65/db9/dd6/fd7 x:0 0 0 2024-08-31T05:21:09.071 INFO:tasks.workunit.client.1.smithi073.stdout:8/763: dwrite d0/db/d1c/d34/d68/f8a [0,4194304] 0 2024-08-31T05:21:09.071 INFO:tasks.workunit.client.0.smithi067.stdout:8/154: write d0/f9 [203317,71368] 0 2024-08-31T05:21:09.073 INFO:tasks.workunit.client.0.smithi067.stdout:7/73: truncate f7 216939 0 2024-08-31T05:21:09.073 INFO:tasks.workunit.client.0.smithi067.stdout:7/74: readlink lf 0 2024-08-31T05:21:09.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:08 smithi067 ceph-mon[17432]: pgmap v25: 65 pgs: 65 active+clean; 1.4 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 54 MiB/s rd, 177 MiB/s wr, 344 op/s 2024-08-31T05:21:09.074 INFO:tasks.workunit.client.0.smithi067.stdout:8/155: read d0/d2/dc/f16 [1067048,111673] 0 2024-08-31T05:21:09.076 INFO:tasks.workunit.client.1.smithi073.stdout:6/766: link d15/d17/da1/dae/db0/d38/f5f d15/d1a/d1e/d69/ff8 0 2024-08-31T05:21:09.079 INFO:tasks.workunit.client.1.smithi073.stdout:5/957: readlink dc/l15 0 2024-08-31T05:21:09.080 INFO:tasks.workunit.client.1.smithi073.stdout:5/958: chown dc/d3d/d3e/l11d 236520 1 2024-08-31T05:21:09.082 INFO:tasks.workunit.client.0.smithi067.stdout:9/64: sync 2024-08-31T05:21:09.082 INFO:tasks.workunit.client.0.smithi067.stdout:0/97: sync 2024-08-31T05:21:09.084 INFO:tasks.workunit.client.0.smithi067.stdout:4/72: creat d4/d13/f1c x:0 0 0 2024-08-31T05:21:09.085 INFO:tasks.workunit.client.0.smithi067.stdout:9/65: write dd/df/f11 [645949,37868] 0 2024-08-31T05:21:09.087 INFO:tasks.workunit.client.0.smithi067.stdout:5/58: link f7 db/d11/f12 0 2024-08-31T05:21:09.088 INFO:tasks.workunit.client.0.smithi067.stdout:1/70: dwrite d3/f10 [0,4194304] 0 2024-08-31T05:21:09.088 INFO:tasks.workunit.client.0.smithi067.stdout:4/73: chown d4/d9/c11 0 1 2024-08-31T05:21:09.091 INFO:tasks.workunit.client.1.smithi073.stdout:2/760: creat d2/d9/d27/d9b/da6/ddd/fee x:0 0 0 2024-08-31T05:21:09.091 INFO:tasks.workunit.client.0.smithi067.stdout:4/74: chown d4/d9/c15 12103311 1 2024-08-31T05:21:09.092 INFO:tasks.workunit.client.0.smithi067.stdout:6/132: dwrite f4 [4194304,4194304] 0 2024-08-31T05:21:09.093 INFO:tasks.workunit.client.0.smithi067.stdout:7/75: mkdir d14/d16 0 2024-08-31T05:21:09.093 INFO:tasks.workunit.client.0.smithi067.stdout:4/75: write d4/f10 [959797,8089] 0 2024-08-31T05:21:09.093 INFO:tasks.workunit.client.1.smithi073.stdout:1/748: truncate d5/d26/d54/d5f/f7c 2764270 0 2024-08-31T05:21:09.095 INFO:tasks.workunit.client.1.smithi073.stdout:1/749: chown d5/d26/d54/db2/dd5/d3f/dc2 8138 1 2024-08-31T05:21:09.096 INFO:tasks.workunit.client.0.smithi067.stdout:4/76: write d4/d13/f1a [8170366,94900] 0 2024-08-31T05:21:09.096 INFO:tasks.workunit.client.1.smithi073.stdout:1/750: fdatasync d5/d26/da5/dba/d1c/d27/f9a 0 2024-08-31T05:21:09.097 INFO:tasks.workunit.client.1.smithi073.stdout:1/751: chown d5/d26/d54/db2/dd5/d5d/d61 6883711 1 2024-08-31T05:21:09.098 INFO:tasks.workunit.client.1.smithi073.stdout:1/752: truncate d5/d26/d54/d55/f8d 465495 0 2024-08-31T05:21:09.099 INFO:tasks.workunit.client.1.smithi073.stdout:7/744: creat d1/d11/fef x:0 0 0 2024-08-31T05:21:09.099 INFO:tasks.workunit.client.0.smithi067.stdout:1/71: dread d3/f6 [4194304,4194304] 0 2024-08-31T05:21:09.099 INFO:tasks.workunit.client.0.smithi067.stdout:8/156: mknod d0/d2/da/c2f 0 2024-08-31T05:21:09.100 INFO:tasks.workunit.client.0.smithi067.stdout:3/96: getdents db/d17 0 2024-08-31T05:21:09.100 INFO:tasks.workunit.client.1.smithi073.stdout:6/767: rmdir d15/d1a/d51/d61/d7c/da6 39 2024-08-31T05:21:09.101 INFO:tasks.workunit.client.0.smithi067.stdout:2/69: write f1 [1396588,90584] 0 2024-08-31T05:21:09.105 INFO:tasks.workunit.client.0.smithi067.stdout:9/66: creat dd/df/f12 x:0 0 0 2024-08-31T05:21:09.106 INFO:tasks.workunit.client.1.smithi073.stdout:3/833: creat da/d3c/f10d x:0 0 0 2024-08-31T05:21:09.110 INFO:tasks.workunit.client.0.smithi067.stdout:3/97: dwrite db/f14 [0,4194304] 0 2024-08-31T05:21:09.112 INFO:tasks.workunit.client.0.smithi067.stdout:9/67: dread f3 [0,4194304] 0 2024-08-31T05:21:09.114 INFO:tasks.workunit.client.1.smithi073.stdout:7/745: dwrite d1/d11/f8d [0,4194304] 0 2024-08-31T05:21:09.115 INFO:tasks.workunit.client.1.smithi073.stdout:7/746: readlink d1/da/d3e/d22/lc2 0 2024-08-31T05:21:09.116 INFO:tasks.workunit.client.1.smithi073.stdout:1/753: mkdir d5/d26/d54/d5f/ddf 0 2024-08-31T05:21:09.118 INFO:tasks.workunit.client.1.smithi073.stdout:1/754: dread - d5/d26/d54/db2/dd5/d32/fc8 zero size 2024-08-31T05:21:09.122 INFO:tasks.workunit.client.1.smithi073.stdout:9/857: creat dc/d37/d42/d8d/f114 x:0 0 0 2024-08-31T05:21:09.124 INFO:tasks.workunit.client.1.smithi073.stdout:6/768: dread fd [4194304,4194304] 0 2024-08-31T05:21:09.124 INFO:tasks.workunit.client.1.smithi073.stdout:0/787: dwrite d0/d58/d63/f7d [0,4194304] 0 2024-08-31T05:21:09.126 INFO:tasks.workunit.client.1.smithi073.stdout:3/834: creat da/d3c/d67/dd9/f10e x:0 0 0 2024-08-31T05:21:09.133 INFO:tasks.workunit.client.1.smithi073.stdout:3/835: dwrite da/d3c/d67/db7/fdc [0,4194304] 0 2024-08-31T05:21:09.134 INFO:tasks.workunit.client.1.smithi073.stdout:3/836: truncate da/d3c/d65/d45/fe5 468173 0 2024-08-31T05:21:09.138 INFO:tasks.workunit.client.1.smithi073.stdout:1/755: creat d5/d26/da5/dba/d1c/d27/fe0 x:0 0 0 2024-08-31T05:21:09.139 INFO:tasks.workunit.client.1.smithi073.stdout:8/764: truncate d0/db/d1c/f20 2669864 0 2024-08-31T05:21:09.139 INFO:tasks.workunit.client.1.smithi073.stdout:8/765: fdatasync d0/da8/fc6 0 2024-08-31T05:21:09.141 INFO:tasks.workunit.client.1.smithi073.stdout:1/756: truncate d5/d26/da5/dba/d1c/d27/d51/faa 579905 0 2024-08-31T05:21:09.141 INFO:tasks.workunit.client.1.smithi073.stdout:8/766: write d0/db/d44/d72/d79/f7f [450028,72254] 0 2024-08-31T05:21:09.142 INFO:tasks.workunit.client.1.smithi073.stdout:1/757: chown d5/d26/d54/db2/dd5/d32/d37/d6f/cd9 33424330 1 2024-08-31T05:21:09.145 INFO:tasks.workunit.client.1.smithi073.stdout:6/769: unlink d15/d17/da1/dae/fb7 0 2024-08-31T05:21:09.147 INFO:tasks.workunit.client.1.smithi073.stdout:0/788: unlink d0/d69/d7f/d68/c100 0 2024-08-31T05:21:09.150 INFO:tasks.workunit.client.1.smithi073.stdout:4/689: sync 2024-08-31T05:21:09.150 INFO:tasks.workunit.client.1.smithi073.stdout:3/837: creat da/d3c/d65/d2c/d8e/dc2/f10f x:0 0 0 2024-08-31T05:21:09.153 INFO:tasks.workunit.client.1.smithi073.stdout:5/959: rename dc/d16/d3b/d3f/d4f/c7c to dc/d16/d1a/c13b 0 2024-08-31T05:21:09.154 INFO:tasks.workunit.client.1.smithi073.stdout:5/960: write dc/d16/f2e [1023678,48327] 0 2024-08-31T05:21:09.155 INFO:tasks.workunit.client.1.smithi073.stdout:8/767: creat d0/db/d44/d9e/feb x:0 0 0 2024-08-31T05:21:09.156 INFO:tasks.workunit.client.1.smithi073.stdout:7/747: write d1/da/d3e/d22/d35/d83/f9f [2626720,62024] 0 2024-08-31T05:21:09.157 INFO:tasks.workunit.client.1.smithi073.stdout:7/748: readlink d1/da/d15/lb9 0 2024-08-31T05:21:09.157 INFO:tasks.workunit.client.1.smithi073.stdout:7/749: chown d1/c3a 440 1 2024-08-31T05:21:09.158 INFO:tasks.workunit.client.0.smithi067.stdout:7/76: fdatasync f5 0 2024-08-31T05:21:09.158 INFO:tasks.workunit.client.1.smithi073.stdout:1/758: symlink d5/d26/d54/db2/dd5/d32/d37/le1 0 2024-08-31T05:21:09.158 INFO:tasks.workunit.client.0.smithi067.stdout:6/133: unlink d1b/l22 0 2024-08-31T05:21:09.159 INFO:tasks.workunit.client.1.smithi073.stdout:4/690: creat d7/df/d79/d7a/fd8 x:0 0 0 2024-08-31T05:21:09.160 INFO:tasks.workunit.client.0.smithi067.stdout:1/72: creat d3/f19 x:0 0 0 2024-08-31T05:21:09.161 INFO:tasks.workunit.client.0.smithi067.stdout:8/157: symlink d0/d4/de/l30 0 2024-08-31T05:21:09.162 INFO:tasks.workunit.client.0.smithi067.stdout:8/158: fdatasync d0/f9 0 2024-08-31T05:21:09.165 INFO:tasks.workunit.client.0.smithi067.stdout:7/77: creat d14/f17 x:0 0 0 2024-08-31T05:21:09.165 INFO:tasks.workunit.client.0.smithi067.stdout:5/59: truncate f2 1019571 0 2024-08-31T05:21:09.166 INFO:tasks.workunit.client.1.smithi073.stdout:2/761: rename d2/d9/ced to d2/d9/d7f/de5/cef 0 2024-08-31T05:21:09.167 INFO:tasks.workunit.client.1.smithi073.stdout:2/762: truncate d2/d9/df/d43/fb7 2644715 0 2024-08-31T05:21:09.169 INFO:tasks.workunit.client.0.smithi067.stdout:9/68: dwrite dd/df/f11 [0,4194304] 0 2024-08-31T05:21:09.170 INFO:tasks.workunit.client.0.smithi067.stdout:4/77: dwrite d4/d14/f1b [0,4194304] 0 2024-08-31T05:21:09.172 INFO:tasks.workunit.client.0.smithi067.stdout:4/78: write d4/d14/f1b [4921196,98823] 0 2024-08-31T05:21:09.172 INFO:tasks.workunit.client.1.smithi073.stdout:5/961: symlink dc/d3d/dab/dd5/l13c 0 2024-08-31T05:21:09.174 INFO:tasks.workunit.client.1.smithi073.stdout:9/858: creat dc/d37/db5/f115 x:0 0 0 2024-08-31T05:21:09.177 INFO:tasks.workunit.client.0.smithi067.stdout:4/79: dread d4/d9/fa [0,4194304] 0 2024-08-31T05:21:09.182 INFO:tasks.workunit.client.0.smithi067.stdout:1/73: creat d3/dd/f1a x:0 0 0 2024-08-31T05:21:09.184 INFO:tasks.workunit.client.0.smithi067.stdout:4/80: dwrite d4/d13/f1a [4194304,4194304] 0 2024-08-31T05:21:09.185 INFO:tasks.workunit.client.1.smithi073.stdout:7/750: unlink d1/da/d3e/d22/d35/d83/fc5 0 2024-08-31T05:21:09.186 INFO:tasks.workunit.client.1.smithi073.stdout:7/751: dread - d1/da/d15/d33/d44/d74/dd6/de6/d84/fd7 zero size 2024-08-31T05:21:09.188 INFO:tasks.workunit.client.0.smithi067.stdout:8/159: rmdir d0/d4 39 2024-08-31T05:21:09.189 INFO:tasks.workunit.client.0.smithi067.stdout:8/160: chown d0/d2/f15 0 1 2024-08-31T05:21:09.189 INFO:tasks.workunit.client.0.smithi067.stdout:4/81: dread d4/d13/f1a [0,4194304] 0 2024-08-31T05:21:09.190 INFO:tasks.workunit.client.0.smithi067.stdout:4/82: write d4/d13/f1c [793189,70222] 0 2024-08-31T05:21:09.190 INFO:tasks.workunit.client.1.smithi073.stdout:4/691: unlink d7/lb8 0 2024-08-31T05:21:09.194 INFO:tasks.workunit.client.1.smithi073.stdout:6/770: rename d15/d1a/d1e/c82 to d15/d1a/d51/d6e/ddb/cf9 0 2024-08-31T05:21:09.199 INFO:tasks.workunit.client.0.smithi067.stdout:3/98: link db/d12/f18 db/d12/d21/f25 0 2024-08-31T05:21:09.200 INFO:tasks.workunit.client.1.smithi073.stdout:5/962: mkdir dc/d3d/d3e/d13d 0 2024-08-31T05:21:09.201 INFO:tasks.workunit.client.0.smithi067.stdout:9/69: rmdir dd 39 2024-08-31T05:21:09.202 INFO:tasks.workunit.client.1.smithi073.stdout:9/859: rmdir dc/de/dd8 39 2024-08-31T05:21:09.202 INFO:tasks.workunit.client.1.smithi073.stdout:9/860: readlink dc/de/d11/lfc 0 2024-08-31T05:21:09.203 INFO:tasks.workunit.client.1.smithi073.stdout:9/861: truncate dc/de/d56/f100 110264 0 2024-08-31T05:21:09.205 INFO:tasks.workunit.client.1.smithi073.stdout:0/789: truncate d0/f26 7945322 0 2024-08-31T05:21:09.208 INFO:tasks.workunit.client.0.smithi067.stdout:6/134: link d1b/d23/f24 d1b/d23/d28/f2b 0 2024-08-31T05:21:09.211 INFO:tasks.workunit.client.0.smithi067.stdout:0/98: link d1/d8/l14 d1/d8/l28 0 2024-08-31T05:21:09.215 INFO:tasks.workunit.client.1.smithi073.stdout:4/692: write d7/df/d13/f2b [3424750,34983] 0 2024-08-31T05:21:09.216 INFO:tasks.workunit.client.0.smithi067.stdout:8/161: chown d0/d4/de 0 1 2024-08-31T05:21:09.217 INFO:tasks.workunit.client.1.smithi073.stdout:4/693: fsync d7/df/d13/f2b 0 2024-08-31T05:21:09.218 INFO:tasks.workunit.client.0.smithi067.stdout:4/83: unlink d4/d14/c19 0 2024-08-31T05:21:09.218 INFO:tasks.workunit.client.0.smithi067.stdout:8/162: write d0/d2/da/f22 [360127,117656] 0 2024-08-31T05:21:09.218 INFO:tasks.workunit.client.1.smithi073.stdout:6/771: symlink d15/d75/dc8/dea/lfa 0 2024-08-31T05:21:09.219 INFO:tasks.workunit.client.1.smithi073.stdout:6/772: stat d15/f22 0 2024-08-31T05:21:09.220 INFO:tasks.workunit.client.0.smithi067.stdout:8/163: dread - d0/d4/f20 zero size 2024-08-31T05:21:09.221 INFO:tasks.workunit.client.0.smithi067.stdout:5/60: dwrite db/d11/f12 [0,4194304] 0 2024-08-31T05:21:09.221 INFO:tasks.workunit.client.0.smithi067.stdout:7/78: rename f3 to d14/f18 0 2024-08-31T05:21:09.222 INFO:tasks.workunit.client.1.smithi073.stdout:5/963: write dc/d3d/dab/dff/d49/f127 [1630305,39545] 0 2024-08-31T05:21:09.222 INFO:tasks.workunit.client.0.smithi067.stdout:8/164: write d0/d4/f20 [753436,125837] 0 2024-08-31T05:21:09.223 INFO:tasks.workunit.client.1.smithi073.stdout:4/694: dwrite d7/df/d13/f9e [0,4194304] 0 2024-08-31T05:21:09.224 INFO:tasks.workunit.client.0.smithi067.stdout:8/165: chown d0/d2/da 979829109 1 2024-08-31T05:21:09.225 INFO:tasks.workunit.client.1.smithi073.stdout:0/790: mknod d0/d15/d2c/d40/d86/c107 0 2024-08-31T05:21:09.226 INFO:tasks.workunit.client.1.smithi073.stdout:7/752: rename d1/da/d65/f86 to d1/da/d65/ff0 0 2024-08-31T05:21:09.227 INFO:tasks.workunit.client.1.smithi073.stdout:1/759: link d5/d26/da5/dba/d33/d13/lcb d5/d26/d54/d5f/le2 0 2024-08-31T05:21:09.229 INFO:tasks.workunit.client.1.smithi073.stdout:1/760: readlink d5/d26/da5/dba/ld3 0 2024-08-31T05:21:09.230 INFO:tasks.workunit.client.1.smithi073.stdout:5/964: dwrite dc/d16/d1a/f103 [0,4194304] 0 2024-08-31T05:21:09.232 INFO:tasks.workunit.client.1.smithi073.stdout:1/761: write d5/d26/da5/dba/d1b/f63 [2399799,50384] 0 2024-08-31T05:21:09.232 INFO:tasks.workunit.client.1.smithi073.stdout:5/965: write dc/d16/d1a/d87/d94/fbf [882007,15839] 0 2024-08-31T05:21:09.233 INFO:tasks.workunit.client.0.smithi067.stdout:4/84: mknod d4/c1d 0 2024-08-31T05:21:09.235 INFO:tasks.workunit.client.0.smithi067.stdout:7/79: dwrite d14/f17 [0,4194304] 0 2024-08-31T05:21:09.235 INFO:tasks.workunit.client.0.smithi067.stdout:7/80: stat fd 0 2024-08-31T05:21:09.237 INFO:tasks.workunit.client.0.smithi067.stdout:9/70: mknod dd/c13 0 2024-08-31T05:21:09.237 INFO:tasks.workunit.client.0.smithi067.stdout:7/81: write d14/f15 [327517,12546] 0 2024-08-31T05:21:09.239 INFO:tasks.workunit.client.0.smithi067.stdout:8/166: symlink d0/d2/da/dd/d1f/l31 0 2024-08-31T05:21:09.241 INFO:tasks.workunit.client.0.smithi067.stdout:6/135: symlink d1b/l2c 0 2024-08-31T05:21:09.242 INFO:tasks.workunit.client.1.smithi073.stdout:0/791: symlink d0/d69/d7f/d68/d91/df5/d3c/d9c/dc8/l108 0 2024-08-31T05:21:09.243 INFO:tasks.workunit.client.0.smithi067.stdout:6/136: write f18 [1368919,73232] 0 2024-08-31T05:21:09.248 INFO:tasks.workunit.client.0.smithi067.stdout:0/99: unlink d1/dd/d18/c27 0 2024-08-31T05:21:09.248 INFO:tasks.workunit.client.0.smithi067.stdout:7/82: dwrite d14/f17 [0,4194304] 0 2024-08-31T05:21:09.251 INFO:tasks.workunit.client.0.smithi067.stdout:9/71: unlink cc 0 2024-08-31T05:21:09.251 INFO:tasks.workunit.client.0.smithi067.stdout:9/72: read dd/df/f11 [3532993,120979] 0 2024-08-31T05:21:09.253 INFO:tasks.workunit.client.0.smithi067.stdout:8/167: unlink d0/d2/c21 0 2024-08-31T05:21:09.257 INFO:tasks.workunit.client.1.smithi073.stdout:2/763: link d2/d9/df/l8b d2/d25/d92/de7/lf0 0 2024-08-31T05:21:09.258 INFO:tasks.workunit.client.0.smithi067.stdout:6/137: rename c16 to d1b/d23/c2d 0 2024-08-31T05:21:09.259 INFO:tasks.workunit.client.0.smithi067.stdout:6/138: read f7 [205010,126511] 0 2024-08-31T05:21:09.261 INFO:tasks.workunit.client.1.smithi073.stdout:3/838: sync 2024-08-31T05:21:09.263 INFO:tasks.workunit.client.1.smithi073.stdout:0/792: creat d0/d69/f109 x:0 0 0 2024-08-31T05:21:09.263 INFO:tasks.workunit.client.1.smithi073.stdout:7/753: symlink d1/da/d15/d33/d44/d74/dd6/de3/lf1 0 2024-08-31T05:21:09.265 INFO:tasks.workunit.client.1.smithi073.stdout:8/768: rename d0/db/d44/d4e/c40 to d0/db/d1c/d24/cec 0 2024-08-31T05:21:09.268 INFO:tasks.workunit.client.1.smithi073.stdout:1/762: truncate d5/d26/da5/dba/d33/f36 2654202 0 2024-08-31T05:21:09.269 INFO:tasks.workunit.client.1.smithi073.stdout:3/839: dwrite da/ff5 [0,4194304] 0 2024-08-31T05:21:09.269 INFO:tasks.workunit.client.0.smithi067.stdout:9/73: rmdir dd/df 39 2024-08-31T05:21:09.271 INFO:tasks.workunit.client.0.smithi067.stdout:8/168: unlink d0/d2/da/dd/d1f/c29 0 2024-08-31T05:21:09.271 INFO:tasks.workunit.client.1.smithi073.stdout:1/763: readlink d5/d26/d54/db2/dd5/d32/d37/le1 0 2024-08-31T05:21:09.272 INFO:tasks.workunit.client.1.smithi073.stdout:1/764: chown d5/d26/d54/d5f/fa0 1456 1 2024-08-31T05:21:09.272 INFO:tasks.workunit.client.1.smithi073.stdout:7/754: dwrite d1/da/d96/fd8 [0,4194304] 0 2024-08-31T05:21:09.273 INFO:tasks.workunit.client.1.smithi073.stdout:1/765: dread - d5/d26/da5/dba/d1c/d27/f9a zero size 2024-08-31T05:21:09.277 INFO:tasks.workunit.client.0.smithi067.stdout:0/100: mkdir d1/df/d29 0 2024-08-31T05:21:09.279 INFO:tasks.workunit.client.1.smithi073.stdout:0/793: mkdir d0/d69/d10a 0 2024-08-31T05:21:09.279 INFO:tasks.workunit.client.1.smithi073.stdout:7/755: dwrite d1/fda [0,4194304] 0 2024-08-31T05:21:09.282 INFO:tasks.workunit.client.1.smithi073.stdout:7/756: truncate d1/da/fd5 4884616 0 2024-08-31T05:21:09.282 INFO:tasks.workunit.client.0.smithi067.stdout:7/83: symlink d14/d16/l19 0 2024-08-31T05:21:09.284 INFO:tasks.workunit.client.1.smithi073.stdout:9/862: rename dc/d10/c92 to dc/d37/d42/d5a/d89/db8/c116 0 2024-08-31T05:21:09.286 INFO:tasks.workunit.client.1.smithi073.stdout:8/769: creat d0/db/d1c/d34/fed x:0 0 0 2024-08-31T05:21:09.289 INFO:tasks.workunit.client.0.smithi067.stdout:8/169: mknod d0/d2/da/dd/d1f/c32 0 2024-08-31T05:21:09.293 INFO:tasks.workunit.client.1.smithi073.stdout:3/840: mkdir da/d3c/d65/d2c/d8e/dc2/d110 0 2024-08-31T05:21:09.293 INFO:tasks.workunit.client.1.smithi073.stdout:3/841: chown da/d3c/d5a/ffd 0 1 2024-08-31T05:21:09.298 INFO:tasks.workunit.client.0.smithi067.stdout:4/85: getdents d4 0 2024-08-31T05:21:09.299 INFO:tasks.workunit.client.0.smithi067.stdout:4/86: fsync d4/f10 0 2024-08-31T05:21:09.301 INFO:tasks.workunit.client.0.smithi067.stdout:7/84: creat d14/f1a x:0 0 0 2024-08-31T05:21:09.302 INFO:tasks.workunit.client.1.smithi073.stdout:7/757: truncate d1/da/d15/d33/d44/f66 842596 0 2024-08-31T05:21:09.303 INFO:tasks.workunit.client.1.smithi073.stdout:7/758: truncate d1/da/d96/fd8 4439722 0 2024-08-31T05:21:09.303 INFO:tasks.workunit.client.0.smithi067.stdout:9/74: symlink dd/df/l14 0 2024-08-31T05:21:09.306 INFO:tasks.workunit.client.1.smithi073.stdout:9/863: fsync dc/d37/d42/d8d/d52/d5f/f71 0 2024-08-31T05:21:09.306 INFO:tasks.workunit.client.1.smithi073.stdout:7/759: dread d1/da/d15/f4b [0,4194304] 0 2024-08-31T05:21:09.306 INFO:tasks.workunit.client.1.smithi073.stdout:4/695: truncate d7/db/f4f 7919021 0 2024-08-31T05:21:09.307 INFO:tasks.workunit.client.1.smithi073.stdout:9/864: chown dc/d37/d42/l6f 140515233 1 2024-08-31T05:21:09.309 INFO:tasks.workunit.client.0.smithi067.stdout:0/101: symlink d1/df/l2a 0 2024-08-31T05:21:09.309 INFO:tasks.workunit.client.0.smithi067.stdout:0/102: chown d1/df 39143705 1 2024-08-31T05:21:09.312 INFO:tasks.workunit.client.0.smithi067.stdout:4/87: mkdir d4/d1e 0 2024-08-31T05:21:09.314 INFO:tasks.workunit.client.0.smithi067.stdout:6/139: dwrite d1b/d23/d28/f2b [0,4194304] 0 2024-08-31T05:21:09.314 INFO:tasks.workunit.client.0.smithi067.stdout:9/75: truncate dd/df/f11 3853651 0 2024-08-31T05:21:09.316 INFO:tasks.workunit.client.0.smithi067.stdout:8/170: mknod d0/d2/c33 0 2024-08-31T05:21:09.318 INFO:tasks.workunit.client.0.smithi067.stdout:0/103: mknod d1/df/d17/c2b 0 2024-08-31T05:21:09.318 INFO:tasks.workunit.client.0.smithi067.stdout:5/61: write f2 [2034665,41886] 0 2024-08-31T05:21:09.321 INFO:tasks.workunit.client.1.smithi073.stdout:6/773: rename d15/d41/d89/ca7 to d15/d75/cfb 0 2024-08-31T05:21:09.324 INFO:tasks.workunit.client.0.smithi067.stdout:4/88: mkdir d4/d1f 0 2024-08-31T05:21:09.326 INFO:tasks.workunit.client.0.smithi067.stdout:6/140: mkdir d1b/d23/d2e 0 2024-08-31T05:21:09.326 INFO:tasks.workunit.client.1.smithi073.stdout:1/766: dwrite d5/d26/d54/db2/dd5/d32/d37/f8a [0,4194304] 0 2024-08-31T05:21:09.327 INFO:tasks.workunit.client.0.smithi067.stdout:0/104: dwrite d1/d8/f23 [0,4194304] 0 2024-08-31T05:21:09.327 INFO:tasks.workunit.client.0.smithi067.stdout:6/141: truncate fd 1010643 0 2024-08-31T05:21:09.329 INFO:tasks.workunit.client.1.smithi073.stdout:1/767: write d5/d26/da5/dba/d1b/f63 [5214443,98243] 0 2024-08-31T05:21:09.330 INFO:tasks.workunit.client.1.smithi073.stdout:0/794: dwrite d0/d69/d7f/d68/d91/df5/f54 [0,4194304] 0 2024-08-31T05:21:09.332 INFO:tasks.workunit.client.1.smithi073.stdout:1/768: dread - d5/d26/d54/db2/dd5/d3f/d9f/fce zero size 2024-08-31T05:21:09.333 INFO:tasks.workunit.client.0.smithi067.stdout:9/76: creat dd/df/f15 x:0 0 0 2024-08-31T05:21:09.336 INFO:tasks.workunit.client.1.smithi073.stdout:8/770: write d0/db/d1c/d24/f78 [667258,45176] 0 2024-08-31T05:21:09.339 INFO:tasks.workunit.client.0.smithi067.stdout:6/142: dread f18 [0,4194304] 0 2024-08-31T05:21:09.340 INFO:tasks.workunit.client.0.smithi067.stdout:0/105: dwrite d1/d8/f16 [0,4194304] 0 2024-08-31T05:21:09.341 INFO:tasks.workunit.client.0.smithi067.stdout:5/62: creat db/f13 x:0 0 0 2024-08-31T05:21:09.342 INFO:tasks.workunit.client.1.smithi073.stdout:7/760: creat d1/da/d15/d33/d44/d74/dd6/dea/dac/ff2 x:0 0 0 2024-08-31T05:21:09.346 INFO:tasks.workunit.client.1.smithi073.stdout:2/764: getdents d2/d25/d92/de7 0 2024-08-31T05:21:09.349 INFO:tasks.workunit.client.0.smithi067.stdout:8/171: dread d0/d2/dc/f16 [0,4194304] 0 2024-08-31T05:21:09.350 INFO:tasks.workunit.client.0.smithi067.stdout:4/89: fdatasync d4/d9/fa 0 2024-08-31T05:21:09.356 INFO:tasks.workunit.client.0.smithi067.stdout:5/63: dwrite db/f13 [0,4194304] 0 2024-08-31T05:21:09.360 INFO:tasks.workunit.client.1.smithi073.stdout:5/966: rename dc/d16/d3b/dc6/fce to dc/d16/d4e/f13e 0 2024-08-31T05:21:09.360 INFO:tasks.workunit.client.1.smithi073.stdout:6/774: symlink d15/d1a/d2b/d2f/d99/d9e/lfc 0 2024-08-31T05:21:09.361 INFO:tasks.workunit.client.1.smithi073.stdout:5/967: chown dc/d3d/d55/fed 917418 1 2024-08-31T05:21:09.365 INFO:tasks.workunit.client.1.smithi073.stdout:0/795: unlink d0/d69/d7f/d62/dbf/cdd 0 2024-08-31T05:21:09.367 INFO:tasks.workunit.client.1.smithi073.stdout:4/696: creat d7/d1a/d5c/d6d/d59/d65/db9/fd9 x:0 0 0 2024-08-31T05:21:09.368 INFO:tasks.workunit.client.1.smithi073.stdout:9/865: dwrite dc/d10/f26 [0,4194304] 0 2024-08-31T05:21:09.369 INFO:tasks.workunit.client.1.smithi073.stdout:4/697: fdatasync d7/df/d13/d2e/d70/d6b/f8f 0 2024-08-31T05:21:09.369 INFO:tasks.workunit.client.0.smithi067.stdout:8/172: creat d0/d4/de/f34 x:0 0 0 2024-08-31T05:21:09.371 INFO:tasks.workunit.client.0.smithi067.stdout:8/173: fdatasync d0/d4/f20 0 2024-08-31T05:21:09.371 INFO:tasks.workunit.client.1.smithi073.stdout:4/698: write d7/d1a/d5c/d6d/d59/d65/db9/dd6/fd7 [531081,69761] 0 2024-08-31T05:21:09.371 INFO:tasks.workunit.client.0.smithi067.stdout:6/143: dwrite f3 [0,4194304] 0 2024-08-31T05:21:09.372 INFO:tasks.workunit.client.1.smithi073.stdout:1/769: symlink d5/d26/da5/dba/d1b/le3 0 2024-08-31T05:21:09.374 INFO:tasks.workunit.client.0.smithi067.stdout:6/144: truncate d1b/f21 739788 0 2024-08-31T05:21:09.375 INFO:tasks.workunit.client.1.smithi073.stdout:8/771: mkdir d0/d62/db4/dee 0 2024-08-31T05:21:09.377 INFO:tasks.workunit.client.1.smithi073.stdout:8/772: read d0/db/d1c/d23/f2f [1395563,87916] 0 2024-08-31T05:21:09.377 INFO:tasks.workunit.client.0.smithi067.stdout:8/174: dread d0/d2/dc/f16 [0,4194304] 0 2024-08-31T05:21:09.378 INFO:tasks.workunit.client.1.smithi073.stdout:8/773: write d0/db/f5a [4157957,113209] 0 2024-08-31T05:21:09.382 INFO:tasks.workunit.client.0.smithi067.stdout:6/145: dread f3 [0,4194304] 0 2024-08-31T05:21:09.383 INFO:tasks.workunit.client.1.smithi073.stdout:2/765: dread d2/d9/df/f3e [0,4194304] 0 2024-08-31T05:21:09.385 INFO:tasks.workunit.client.0.smithi067.stdout:6/146: write fd [1916060,3833] 0 2024-08-31T05:21:09.385 INFO:tasks.workunit.client.0.smithi067.stdout:9/77: write f3 [3302676,108167] 0 2024-08-31T05:21:09.387 INFO:tasks.workunit.client.0.smithi067.stdout:9/78: stat dd/df/f12 0 2024-08-31T05:21:09.389 INFO:tasks.workunit.client.0.smithi067.stdout:4/90: symlink d4/d1f/l20 0 2024-08-31T05:21:09.391 INFO:tasks.workunit.client.0.smithi067.stdout:9/79: dread f6 [0,4194304] 0 2024-08-31T05:21:09.394 INFO:tasks.workunit.client.1.smithi073.stdout:8/774: dread d0/f39 [4194304,4194304] 0 2024-08-31T05:21:09.394 INFO:tasks.workunit.client.0.smithi067.stdout:5/64: symlink db/d11/l14 0 2024-08-31T05:21:09.394 INFO:tasks.workunit.client.0.smithi067.stdout:5/65: chown f4 186584 1 2024-08-31T05:21:09.394 INFO:tasks.workunit.client.0.smithi067.stdout:5/66: chown db 38523 1 2024-08-31T05:21:09.397 INFO:tasks.workunit.client.0.smithi067.stdout:8/175: creat d0/d2/da/dd/f35 x:0 0 0 2024-08-31T05:21:09.398 INFO:tasks.workunit.client.0.smithi067.stdout:8/176: write d0/d4/f20 [1135587,106337] 0 2024-08-31T05:21:09.401 INFO:tasks.workunit.client.0.smithi067.stdout:0/106: creat d1/f2c x:0 0 0 2024-08-31T05:21:09.403 INFO:tasks.workunit.client.0.smithi067.stdout:6/147: mkdir d1b/d23/d2f 0 2024-08-31T05:21:09.404 INFO:tasks.workunit.client.0.smithi067.stdout:8/177: dread d0/d2/f24 [0,4194304] 0 2024-08-31T05:21:09.405 INFO:tasks.workunit.client.0.smithi067.stdout:6/148: chown f4 100545236 1 2024-08-31T05:21:09.407 INFO:tasks.workunit.client.1.smithi073.stdout:7/761: dwrite d1/da/d15/f4b [0,4194304] 0 2024-08-31T05:21:09.408 INFO:tasks.workunit.client.0.smithi067.stdout:9/80: write f7 [2386995,45900] 0 2024-08-31T05:21:09.409 INFO:tasks.workunit.client.1.smithi073.stdout:2/766: dread d2/d9/d27/d76/d97/fa4 [0,4194304] 0 2024-08-31T05:21:09.410 INFO:tasks.workunit.client.0.smithi067.stdout:5/67: readlink db/lf 0 2024-08-31T05:21:09.410 INFO:tasks.workunit.client.0.smithi067.stdout:9/81: write dd/f10 [4178820,93868] 0 2024-08-31T05:21:09.411 INFO:tasks.workunit.client.0.smithi067.stdout:0/107: dwrite d1/d8/f16 [0,4194304] 0 2024-08-31T05:21:09.413 INFO:tasks.workunit.client.0.smithi067.stdout:0/108: truncate d1/d8/f16 5134812 0 2024-08-31T05:21:09.414 INFO:tasks.workunit.client.0.smithi067.stdout:0/109: chown d1/df/l2a 101785 1 2024-08-31T05:21:09.415 INFO:tasks.workunit.client.0.smithi067.stdout:4/91: mkdir d4/d1e/d21 0 2024-08-31T05:21:09.416 INFO:tasks.workunit.client.0.smithi067.stdout:0/110: chown d1/df/f26 45996 1 2024-08-31T05:21:09.417 INFO:tasks.workunit.client.0.smithi067.stdout:8/178: unlink d0/d2/da/c1a 0 2024-08-31T05:21:09.427 INFO:tasks.workunit.client.0.smithi067.stdout:6/149: mkdir d1b/d30 0 2024-08-31T05:21:09.428 INFO:tasks.workunit.client.0.smithi067.stdout:4/92: dwrite d4/f10 [0,4194304] 0 2024-08-31T05:21:09.430 INFO:tasks.workunit.client.0.smithi067.stdout:6/150: chown f3 1215180 1 2024-08-31T05:21:09.431 INFO:tasks.workunit.client.0.smithi067.stdout:9/82: mknod dd/c16 0 2024-08-31T05:21:09.432 INFO:tasks.workunit.client.0.smithi067.stdout:8/179: dwrite d0/d2/da/dd/f35 [0,4194304] 0 2024-08-31T05:21:09.434 INFO:tasks.workunit.client.0.smithi067.stdout:4/93: dread d4/d9/fa [4194304,4194304] 0 2024-08-31T05:21:09.435 INFO:tasks.workunit.client.0.smithi067.stdout:5/68: rename db/d11 to db/d15 0 2024-08-31T05:21:09.437 INFO:tasks.workunit.client.0.smithi067.stdout:5/69: truncate f4 4826444 0 2024-08-31T05:21:09.441 INFO:tasks.workunit.client.0.smithi067.stdout:4/94: dread d4/d9/fa [0,4194304] 0 2024-08-31T05:21:09.443 INFO:tasks.workunit.client.0.smithi067.stdout:6/151: dread fd [0,4194304] 0 2024-08-31T05:21:09.443 INFO:tasks.workunit.client.0.smithi067.stdout:9/83: rmdir dd 39 2024-08-31T05:21:09.447 INFO:tasks.workunit.client.0.smithi067.stdout:8/180: mknod d0/d4/de/c36 0 2024-08-31T05:21:09.453 INFO:tasks.workunit.client.0.smithi067.stdout:9/84: dwrite f6 [0,4194304] 0 2024-08-31T05:21:09.453 INFO:tasks.workunit.client.0.smithi067.stdout:0/111: rename d1/d8/l14 to d1/df/l2d 0 2024-08-31T05:21:09.454 INFO:tasks.workunit.client.0.smithi067.stdout:4/95: rmdir d4 39 2024-08-31T05:21:09.463 INFO:tasks.workunit.client.0.smithi067.stdout:8/181: truncate d0/d2/f24 1815719 0 2024-08-31T05:21:09.467 INFO:tasks.workunit.client.0.smithi067.stdout:8/182: dread d0/d2/da/f22 [0,4194304] 0 2024-08-31T05:21:09.468 INFO:tasks.workunit.client.0.smithi067.stdout:6/152: rename f4 to d1b/d23/d28/f31 0 2024-08-31T05:21:09.471 INFO:tasks.workunit.client.1.smithi073.stdout:0/796: symlink d0/d15/d2c/d40/l10b 0 2024-08-31T05:21:09.471 INFO:tasks.workunit.client.1.smithi073.stdout:0/797: chown d0/d58/ffa 21 1 2024-08-31T05:21:09.472 INFO:tasks.workunit.client.1.smithi073.stdout:9/866: mknod dc/de/d66/c117 0 2024-08-31T05:21:09.473 INFO:tasks.workunit.client.0.smithi067.stdout:4/96: dread d4/d9/fa [0,4194304] 0 2024-08-31T05:21:09.475 INFO:tasks.workunit.client.0.smithi067.stdout:9/85: creat dd/df/f17 x:0 0 0 2024-08-31T05:21:09.478 INFO:tasks.workunit.client.0.smithi067.stdout:6/153: rename c11 to d1b/d23/d2f/c32 0 2024-08-31T05:21:09.481 INFO:tasks.workunit.client.1.smithi073.stdout:3/842: getdents da/d3c/d82/d95/db9 0 2024-08-31T05:21:09.483 INFO:tasks.workunit.client.0.smithi067.stdout:5/70: truncate f2 1781919 0 2024-08-31T05:21:09.486 INFO:tasks.workunit.client.1.smithi073.stdout:4/699: sync 2024-08-31T05:21:09.486 INFO:tasks.workunit.client.1.smithi073.stdout:8/775: creat d0/db/d44/d9e/fef x:0 0 0 2024-08-31T05:21:09.486 INFO:tasks.workunit.client.1.smithi073.stdout:3/843: dwrite da/d68/f99 [0,4194304] 0 2024-08-31T05:21:09.486 INFO:tasks.workunit.client.0.smithi067.stdout:9/86: symlink dd/df/l18 0 2024-08-31T05:21:09.487 INFO:tasks.workunit.client.0.smithi067.stdout:9/87: dread - dd/df/f15 zero size 2024-08-31T05:21:09.487 INFO:tasks.workunit.client.0.smithi067.stdout:9/88: write f4 [2743777,18993] 0 2024-08-31T05:21:09.488 INFO:tasks.workunit.client.1.smithi073.stdout:7/762: unlink d1/da/d15/d33/f50 0 2024-08-31T05:21:09.490 INFO:tasks.workunit.client.1.smithi073.stdout:7/763: dread - d1/da/d15/d33/d44/d74/dd6/de6/fdc zero size 2024-08-31T05:21:09.491 INFO:tasks.workunit.client.0.smithi067.stdout:8/183: symlink d0/d2/dc/d28/l37 0 2024-08-31T05:21:09.496 INFO:tasks.workunit.client.0.smithi067.stdout:6/154: creat d1b/d23/d28/f33 x:0 0 0 2024-08-31T05:21:09.497 INFO:tasks.workunit.client.1.smithi073.stdout:5/968: symlink dc/d3d/d3e/d13d/l13f 0 2024-08-31T05:21:09.498 INFO:tasks.workunit.client.0.smithi067.stdout:6/155: write d1b/d23/f24 [2557760,28515] 0 2024-08-31T05:21:09.499 INFO:tasks.workunit.client.1.smithi073.stdout:2/767: dread d2/d9/d7f/dab/f42 [0,4194304] 0 2024-08-31T05:21:09.499 INFO:tasks.workunit.client.0.smithi067.stdout:5/71: fdatasync f6 0 2024-08-31T05:21:09.506 INFO:tasks.workunit.client.0.smithi067.stdout:0/112: truncate d1/d8/f16 2033254 0 2024-08-31T05:21:09.507 INFO:tasks.workunit.client.0.smithi067.stdout:0/113: dread - d1/df/d17/f20 zero size 2024-08-31T05:21:09.508 INFO:tasks.workunit.client.0.smithi067.stdout:6/156: rename d1b/d23/f24 to d1b/d23/f34 0 2024-08-31T05:21:09.509 INFO:tasks.workunit.client.0.smithi067.stdout:6/157: fdatasync f7 0 2024-08-31T05:21:09.516 INFO:tasks.workunit.client.1.smithi073.stdout:4/700: mkdir d7/d1a/d5c/d62/dda 0 2024-08-31T05:21:09.519 INFO:tasks.workunit.client.1.smithi073.stdout:8/776: fsync d0/db/d1c/d2a/d58/f7a 0 2024-08-31T05:21:09.520 INFO:tasks.workunit.client.0.smithi067.stdout:0/114: symlink d1/dd/l2e 0 2024-08-31T05:21:09.521 INFO:tasks.workunit.client.0.smithi067.stdout:0/115: read d1/f6 [604980,58690] 0 2024-08-31T05:21:09.521 INFO:tasks.workunit.client.0.smithi067.stdout:0/116: fsync d1/df/d17/f20 0 2024-08-31T05:21:09.523 INFO:tasks.workunit.client.1.smithi073.stdout:7/764: creat d1/da/d15/d33/d44/d74/dd6/de6/d84/ff3 x:0 0 0 2024-08-31T05:21:09.524 INFO:tasks.workunit.client.1.smithi073.stdout:1/770: truncate d5/d26/d54/db2/dd5/f38 1300394 0 2024-08-31T05:21:09.525 INFO:tasks.workunit.client.0.smithi067.stdout:6/158: dread f14 [0,4194304] 0 2024-08-31T05:21:09.528 INFO:tasks.workunit.client.0.smithi067.stdout:8/184: fsync d0/d2/f24 0 2024-08-31T05:21:09.533 INFO:tasks.workunit.client.1.smithi073.stdout:2/768: mknod d2/d9/d27/d76/db5/dc6/dd1/cf1 0 2024-08-31T05:21:09.534 INFO:tasks.workunit.client.0.smithi067.stdout:6/159: dwrite d1b/d23/d28/f33 [0,4194304] 0 2024-08-31T05:21:09.535 INFO:tasks.workunit.client.0.smithi067.stdout:6/160: truncate f19 768576 0 2024-08-31T05:21:09.544 INFO:tasks.workunit.client.1.smithi073.stdout:0/798: truncate d0/d15/d2c/d40/d4a/f87 1067051 0 2024-08-31T05:21:09.545 INFO:tasks.workunit.client.0.smithi067.stdout:0/117: symlink d1/df/d29/l2f 0 2024-08-31T05:21:09.546 INFO:tasks.workunit.client.1.smithi073.stdout:6/775: dwrite d15/d1a/d1e/d69/d7e/fb1 [0,4194304] 0 2024-08-31T05:21:09.546 INFO:tasks.workunit.client.0.smithi067.stdout:0/118: chown d1/dd/f15 3605 1 2024-08-31T05:21:09.547 INFO:tasks.workunit.client.0.smithi067.stdout:6/161: rename l12 to d1b/d30/l35 0 2024-08-31T05:21:09.548 INFO:tasks.workunit.client.1.smithi073.stdout:7/765: symlink d1/da/d3e/db1/lf4 0 2024-08-31T05:21:09.550 INFO:tasks.workunit.client.1.smithi073.stdout:1/771: creat d5/d26/d54/db2/dd5/d2a/d80/fe4 x:0 0 0 2024-08-31T05:21:09.551 INFO:tasks.workunit.client.1.smithi073.stdout:3/844: truncate da/d3c/d67/db7/fdc 774739 0 2024-08-31T05:21:09.557 INFO:tasks.workunit.client.0.smithi067.stdout:5/72: write f2 [2534146,48684] 0 2024-08-31T05:21:09.557 INFO:tasks.workunit.client.0.smithi067.stdout:5/73: fdatasync db/f13 0 2024-08-31T05:21:09.558 INFO:tasks.workunit.client.0.smithi067.stdout:5/74: stat f6 0 2024-08-31T05:21:09.558 INFO:tasks.workunit.client.1.smithi073.stdout:2/769: rename d2/d25/d92/lae to d2/d9/d27/d76/db5/lf2 0 2024-08-31T05:21:09.559 INFO:tasks.workunit.client.1.smithi073.stdout:2/770: stat d2/d9/df/d36/f5e 0 2024-08-31T05:21:09.560 INFO:tasks.workunit.client.0.smithi067.stdout:6/162: fsync f9 0 2024-08-31T05:21:09.561 INFO:tasks.workunit.client.0.smithi067.stdout:6/163: stat d1b/d23/d28/f31 0 2024-08-31T05:21:09.561 INFO:tasks.workunit.client.1.smithi073.stdout:9/867: creat dc/d37/d42/d8d/d52/f118 x:0 0 0 2024-08-31T05:21:09.562 INFO:tasks.workunit.client.1.smithi073.stdout:9/868: stat dc/de/d66/d84/f90 0 2024-08-31T05:21:09.562 INFO:tasks.workunit.client.0.smithi067.stdout:6/164: dread f7 [0,4194304] 0 2024-08-31T05:21:09.563 INFO:tasks.workunit.client.1.smithi073.stdout:9/869: fdatasync dc/d37/d42/d8d/d52/d5f/f113 0 2024-08-31T05:21:09.564 INFO:tasks.workunit.client.0.smithi067.stdout:8/185: creat d0/d2/f38 x:0 0 0 2024-08-31T05:21:09.565 INFO:tasks.workunit.client.1.smithi073.stdout:5/969: truncate dc/d16/d3b/d3f/d4f/f7b 1134705 0 2024-08-31T05:21:09.567 INFO:tasks.workunit.client.0.smithi067.stdout:0/119: mknod d1/c30 0 2024-08-31T05:21:09.569 INFO:tasks.workunit.client.1.smithi073.stdout:8/777: mknod d0/db/d1c/dda/cf0 0 2024-08-31T05:21:09.570 INFO:tasks.workunit.client.0.smithi067.stdout:6/165: dwrite f10 [0,4194304] 0 2024-08-31T05:21:09.573 INFO:tasks.workunit.client.0.smithi067.stdout:5/75: symlink db/l16 0 2024-08-31T05:21:09.574 INFO:tasks.workunit.client.1.smithi073.stdout:0/799: mkdir d0/d69/d7f/d62/d10c 0 2024-08-31T05:21:09.576 INFO:tasks.workunit.client.0.smithi067.stdout:8/186: fdatasync d0/d2/dc/f16 0 2024-08-31T05:21:09.578 INFO:tasks.workunit.client.1.smithi073.stdout:7/766: mknod d1/da/d3e/d22/d5c/cf5 0 2024-08-31T05:21:09.582 INFO:tasks.workunit.client.1.smithi073.stdout:1/772: mknod d5/d26/d54/db2/dd5/d32/daf/ce5 0 2024-08-31T05:21:09.584 INFO:tasks.workunit.client.0.smithi067.stdout:6/166: rename d1b/d23/c25 to d1b/d23/d2f/c36 0 2024-08-31T05:21:09.584 INFO:tasks.workunit.client.1.smithi073.stdout:3/845: readlink da/d3c/d65/d2c/l5f 0 2024-08-31T05:21:09.586 INFO:tasks.workunit.client.1.smithi073.stdout:2/771: write d2/d9/d7f/dab/d5d/fb3 [1604396,117669] 0 2024-08-31T05:21:09.588 INFO:tasks.workunit.client.1.smithi073.stdout:9/870: truncate f9 1166362 0 2024-08-31T05:21:09.591 INFO:tasks.workunit.client.0.smithi067.stdout:8/187: fdatasync d0/d2/da/f22 0 2024-08-31T05:21:09.593 INFO:tasks.workunit.client.1.smithi073.stdout:4/701: link d7/d1a/d5c/d6d/d59/d86/fbc d7/d1a/d5c/fdb 0 2024-08-31T05:21:09.593 INFO:tasks.workunit.client.1.smithi073.stdout:2/772: dread d2/d9/d7f/dab/d5d/fb3 [0,4194304] 0 2024-08-31T05:21:09.593 INFO:tasks.workunit.client.0.smithi067.stdout:8/188: dread d0/d2/dc/f16 [0,4194304] 0 2024-08-31T05:21:09.594 INFO:tasks.workunit.client.0.smithi067.stdout:0/120: symlink d1/l31 0 2024-08-31T05:21:09.596 INFO:tasks.workunit.client.1.smithi073.stdout:7/767: dread d1/d11/f97 [0,4194304] 0 2024-08-31T05:21:09.597 INFO:tasks.workunit.client.0.smithi067.stdout:6/167: creat d1b/d23/d28/f37 x:0 0 0 2024-08-31T05:21:09.597 INFO:tasks.workunit.client.1.smithi073.stdout:7/768: dread - d1/d11/dcc/fc8 zero size 2024-08-31T05:21:09.598 INFO:tasks.workunit.client.0.smithi067.stdout:8/189: dread d0/d2/d6/f1b [0,4194304] 0 2024-08-31T05:21:09.599 INFO:tasks.workunit.client.1.smithi073.stdout:8/778: rename d0/da8/fc6 to d0/db/d44/d72/d75/d7e/d91/ff1 0 2024-08-31T05:21:09.599 INFO:tasks.workunit.client.1.smithi073.stdout:5/970: dread dc/d3d/dab/dff/d49/f9e [0,4194304] 0 2024-08-31T05:21:09.601 INFO:tasks.workunit.client.0.smithi067.stdout:6/168: dread d1b/d23/d28/f2b [0,4194304] 0 2024-08-31T05:21:09.604 INFO:tasks.workunit.client.1.smithi073.stdout:0/800: creat d0/d69/d7f/d68/d91/df5/d3c/f10d x:0 0 0 2024-08-31T05:21:09.604 INFO:tasks.workunit.client.1.smithi073.stdout:0/801: fdatasync d0/d15/d2c/d40/f6d 0 2024-08-31T05:21:09.608 INFO:tasks.workunit.client.1.smithi073.stdout:1/773: readlink d5/d26/da5/dba/d33/d13/lcb 0 2024-08-31T05:21:09.615 INFO:tasks.workunit.client.0.smithi067.stdout:8/190: unlink d0/d4/de/c26 0 2024-08-31T05:21:09.616 INFO:tasks.workunit.client.0.smithi067.stdout:5/76: truncate db/d15/f12 1792935 0 2024-08-31T05:21:09.617 INFO:tasks.workunit.client.0.smithi067.stdout:6/169: write f19 [556529,50674] 0 2024-08-31T05:21:09.618 INFO:tasks.workunit.client.1.smithi073.stdout:4/702: symlink d7/df/da9/ldc 0 2024-08-31T05:21:09.619 INFO:tasks.workunit.client.1.smithi073.stdout:4/703: write d7/df/d13/d2e/f31 [2734275,39992] 0 2024-08-31T05:21:09.619 INFO:tasks.workunit.client.1.smithi073.stdout:2/773: symlink d2/d9/d27/d76/d7e/lf3 0 2024-08-31T05:21:09.627 INFO:tasks.workunit.client.1.smithi073.stdout:8/779: mknod d0/d62/cf2 0 2024-08-31T05:21:09.628 INFO:tasks.workunit.client.1.smithi073.stdout:5/971: fdatasync dc/d16/d3b/f77 0 2024-08-31T05:21:09.628 INFO:tasks.workunit.client.1.smithi073.stdout:3/846: dwrite da/f52 [0,4194304] 0 2024-08-31T05:21:09.631 INFO:tasks.workunit.client.1.smithi073.stdout:0/802: creat d0/d69/d7f/d68/d91/f10e x:0 0 0 2024-08-31T05:21:09.632 INFO:tasks.workunit.client.1.smithi073.stdout:6/776: link d15/d17/da1/dae/db0/f67 d15/d1a/d51/d61/d7c/da6/ffd 0 2024-08-31T05:21:09.632 INFO:tasks.workunit.client.0.smithi067.stdout:6/170: creat d1b/d23/d2e/f38 x:0 0 0 2024-08-31T05:21:09.634 INFO:tasks.workunit.client.1.smithi073.stdout:1/774: fsync d5/d26/d54/db2/dd5/f57 0 2024-08-31T05:21:09.634 INFO:tasks.workunit.client.1.smithi073.stdout:6/777: write d15/d17/da1/dae/db0/f34 [5928132,4987] 0 2024-08-31T05:21:09.635 INFO:tasks.workunit.client.0.smithi067.stdout:0/121: getdents d1/df/d17 0 2024-08-31T05:21:09.636 INFO:tasks.workunit.client.1.smithi073.stdout:9/871: dwrite dc/d37/d42/d8d/d52/fa4 [0,4194304] 0 2024-08-31T05:21:09.636 INFO:tasks.workunit.client.0.smithi067.stdout:0/122: write d1/dd/f15 [5330203,52234] 0 2024-08-31T05:21:09.637 INFO:tasks.workunit.client.1.smithi073.stdout:9/872: fdatasync dc/d82/de4/ffa 0 2024-08-31T05:21:09.637 INFO:tasks.workunit.client.0.smithi067.stdout:0/123: dread - d1/f2c zero size 2024-08-31T05:21:09.640 INFO:tasks.workunit.client.0.smithi067.stdout:6/171: creat d1b/d23/d28/f39 x:0 0 0 2024-08-31T05:21:09.644 INFO:tasks.workunit.client.0.smithi067.stdout:0/124: symlink d1/dd/d18/l32 0 2024-08-31T05:21:09.644 INFO:tasks.workunit.client.0.smithi067.stdout:0/125: chown d1/df/d17 12019565 1 2024-08-31T05:21:09.645 INFO:tasks.workunit.client.1.smithi073.stdout:4/704: mknod d7/d1a/cdd 0 2024-08-31T05:21:09.645 INFO:tasks.workunit.client.0.smithi067.stdout:6/172: dread d1b/d23/f2a [0,4194304] 0 2024-08-31T05:21:09.646 INFO:tasks.workunit.client.0.smithi067.stdout:8/191: getdents d0/d4 0 2024-08-31T05:21:09.646 INFO:tasks.workunit.client.0.smithi067.stdout:8/192: stat d0/d2/d6/lb 0 2024-08-31T05:21:09.648 INFO:tasks.workunit.client.0.smithi067.stdout:5/77: getdents db/d15 0 2024-08-31T05:21:09.649 INFO:tasks.workunit.client.0.smithi067.stdout:0/126: rmdir d1/df 39 2024-08-31T05:21:09.652 INFO:tasks.workunit.client.0.smithi067.stdout:6/173: unlink d1b/d23/d28/l29 0 2024-08-31T05:21:09.652 INFO:tasks.workunit.client.0.smithi067.stdout:6/174: dread - d1b/d23/d28/f37 zero size 2024-08-31T05:21:09.656 INFO:tasks.workunit.client.0.smithi067.stdout:8/193: creat d0/d4/de/d1d/f39 x:0 0 0 2024-08-31T05:21:09.661 INFO:tasks.workunit.client.0.smithi067.stdout:6/175: mknod d1b/d23/d2e/c3a 0 2024-08-31T05:21:09.662 INFO:tasks.workunit.client.1.smithi073.stdout:7/769: write d1/da/db2/fdb [443587,119918] 0 2024-08-31T05:21:09.662 INFO:tasks.workunit.client.1.smithi073.stdout:8/780: mkdir d0/db/d44/d4e/df3 0 2024-08-31T05:21:09.663 INFO:tasks.workunit.client.1.smithi073.stdout:3/847: unlink da/d3c/d67/dd9/f10e 0 2024-08-31T05:21:09.663 INFO:tasks.workunit.client.1.smithi073.stdout:5/972: rmdir dc/d16/d3b/d3f/d4f/d98/df6 39 2024-08-31T05:21:09.663 INFO:tasks.workunit.client.0.smithi067.stdout:8/194: creat d0/d4/de/d1d/f3a x:0 0 0 2024-08-31T05:21:09.666 INFO:tasks.workunit.client.1.smithi073.stdout:6/778: fdatasync d15/d17/f5e 0 2024-08-31T05:21:09.667 INFO:tasks.workunit.client.0.smithi067.stdout:5/78: truncate db/f13 2516818 0 2024-08-31T05:21:09.668 INFO:tasks.workunit.client.0.smithi067.stdout:5/79: chown db/l10 1264585886 1 2024-08-31T05:21:09.671 INFO:tasks.workunit.client.0.smithi067.stdout:8/195: dwrite d0/d4/de/d1d/f3a [0,4194304] 0 2024-08-31T05:21:09.671 INFO:tasks.workunit.client.0.smithi067.stdout:8/196: readlink d0/d2/d6/l2d 0 2024-08-31T05:21:09.673 INFO:tasks.workunit.client.1.smithi073.stdout:9/873: creat dc/d37/d42/d8d/d52/d5f/f119 x:0 0 0 2024-08-31T05:21:09.674 INFO:tasks.workunit.client.1.smithi073.stdout:2/774: dwrite d2/d9/d3c/f5c [4194304,4194304] 0 2024-08-31T05:21:09.674 INFO:tasks.workunit.client.1.smithi073.stdout:4/705: dread d7/d1a/d5c/f66 [0,4194304] 0 2024-08-31T05:21:09.674 INFO:tasks.workunit.client.0.smithi067.stdout:6/176: unlink d1b/d23/d28/f33 0 2024-08-31T05:21:09.679 INFO:tasks.workunit.client.0.smithi067.stdout:5/80: symlink db/l17 0 2024-08-31T05:21:09.680 INFO:tasks.workunit.client.0.smithi067.stdout:8/197: mknod d0/d4/c3b 0 2024-08-31T05:21:09.682 INFO:tasks.workunit.client.0.smithi067.stdout:8/198: readlink d0/d2/l12 0 2024-08-31T05:21:09.685 INFO:tasks.workunit.client.1.smithi073.stdout:7/770: symlink d1/da/d3e/d22/d47/da8/lf6 0 2024-08-31T05:21:09.686 INFO:tasks.workunit.client.0.smithi067.stdout:0/127: dwrite d1/f6 [0,4194304] 0 2024-08-31T05:21:09.687 INFO:tasks.workunit.client.1.smithi073.stdout:7/771: truncate d1/da/f7b 4630177 0 2024-08-31T05:21:09.687 INFO:tasks.workunit.client.1.smithi073.stdout:7/772: chown d1/da/d3e/d22/d5c/c78 16250306 1 2024-08-31T05:21:09.689 INFO:tasks.workunit.client.0.smithi067.stdout:6/177: write d1b/d23/f34 [4157599,4978] 0 2024-08-31T05:21:09.690 INFO:tasks.workunit.client.0.smithi067.stdout:5/81: creat db/d15/f18 x:0 0 0 2024-08-31T05:21:09.693 INFO:tasks.workunit.client.1.smithi073.stdout:8/781: rename d0/db/d44/d72/d75/d7e/d91/dac/le6 to d0/db/d44/d4e/df3/lf4 0 2024-08-31T05:21:09.695 INFO:tasks.workunit.client.0.smithi067.stdout:8/199: write d0/d2/d6/f27 [2427462,127232] 0 2024-08-31T05:21:09.697 INFO:tasks.workunit.client.1.smithi073.stdout:6/779: rmdir d15/d75/dc8 39 2024-08-31T05:21:09.698 INFO:tasks.workunit.client.0.smithi067.stdout:0/128: creat d1/d8/f33 x:0 0 0 2024-08-31T05:21:09.699 INFO:tasks.workunit.client.0.smithi067.stdout:0/129: write d1/d8/f33 [376422,58837] 0 2024-08-31T05:21:09.700 INFO:tasks.workunit.client.0.smithi067.stdout:5/82: creat db/f19 x:0 0 0 2024-08-31T05:21:09.704 INFO:tasks.workunit.client.0.smithi067.stdout:5/83: symlink db/l1a 0 2024-08-31T05:21:09.705 INFO:tasks.workunit.client.0.smithi067.stdout:8/200: mkdir d0/d4/de/d1d/d2c/d3c 0 2024-08-31T05:21:09.707 INFO:tasks.workunit.client.0.smithi067.stdout:0/130: creat d1/df/d29/f34 x:0 0 0 2024-08-31T05:21:09.710 INFO:tasks.workunit.client.1.smithi073.stdout:7/773: mknod d1/da/d3e/d22/d5c/dc6/cf7 0 2024-08-31T05:21:09.710 INFO:tasks.workunit.client.0.smithi067.stdout:0/131: fsync d1/df/f26 0 2024-08-31T05:21:09.711 INFO:tasks.workunit.client.1.smithi073.stdout:7/774: read d1/da/d3e/db1/fd4 [2953860,66214] 0 2024-08-31T05:21:09.712 INFO:tasks.workunit.client.0.smithi067.stdout:5/84: unlink db/f13 0 2024-08-31T05:21:09.714 INFO:tasks.workunit.client.0.smithi067.stdout:5/85: chown db/d15/l14 23 1 2024-08-31T05:21:09.714 INFO:tasks.workunit.client.1.smithi073.stdout:1/775: getdents d5/d26/da5/dba/d1c/d27 0 2024-08-31T05:21:09.714 INFO:tasks.workunit.client.0.smithi067.stdout:8/201: dwrite d0/d4/de/f34 [0,4194304] 0 2024-08-31T05:21:09.715 INFO:tasks.workunit.client.1.smithi073.stdout:1/776: dread - d5/d26/d54/db2/dd5/d32/d37/d6f/fb8 zero size 2024-08-31T05:21:09.716 INFO:tasks.workunit.client.1.smithi073.stdout:2/775: creat d2/d9/df/ff4 x:0 0 0 2024-08-31T05:21:09.719 INFO:tasks.workunit.client.1.smithi073.stdout:9/874: rename dc/de/ld5 to dc/l11a 0 2024-08-31T05:21:09.720 INFO:tasks.workunit.client.1.smithi073.stdout:3/848: write da/d3c/d65/d40/f9f [219194,120399] 0 2024-08-31T05:21:09.722 INFO:tasks.workunit.client.1.smithi073.stdout:1/777: dwrite d5/d26/d54/d9e/fb6 [0,4194304] 0 2024-08-31T05:21:09.723 INFO:tasks.workunit.client.1.smithi073.stdout:3/849: chown da/d3c/d65/d40/f57 302360 1 2024-08-31T05:21:09.725 INFO:tasks.workunit.client.0.smithi067.stdout:8/202: mkdir d0/d2/dc/d3d 0 2024-08-31T05:21:09.725 INFO:tasks.workunit.client.1.smithi073.stdout:2/776: fsync d2/d9/d27/d9b/da6/fea 0 2024-08-31T05:21:09.726 INFO:tasks.workunit.client.0.smithi067.stdout:8/203: fdatasync d0/d4/de/d1d/f39 0 2024-08-31T05:21:09.730 INFO:tasks.workunit.client.1.smithi073.stdout:4/706: rename d7/d1a/d5c/d62/d9f to d7/d1a/d5c/d6d/d2c/d2d/da6/dde 0 2024-08-31T05:21:09.730 INFO:tasks.workunit.client.0.smithi067.stdout:6/178: truncate f19 694655 0 2024-08-31T05:21:09.732 INFO:tasks.workunit.client.1.smithi073.stdout:8/782: write d0/db/d1c/d23/f2f [234291,38109] 0 2024-08-31T05:21:09.733 INFO:tasks.workunit.client.0.smithi067.stdout:6/179: write d1b/d23/d2e/f38 [62642,100159] 0 2024-08-31T05:21:09.734 INFO:tasks.workunit.client.0.smithi067.stdout:8/204: dwrite d0/d2/da/dd/f35 [0,4194304] 0 2024-08-31T05:21:09.735 INFO:tasks.workunit.client.1.smithi073.stdout:3/850: symlink da/d3c/dda/l111 0 2024-08-31T05:21:09.736 INFO:tasks.workunit.client.1.smithi073.stdout:3/851: chown da/d3c/d82/d97/fa7 259999814 1 2024-08-31T05:21:09.736 INFO:tasks.workunit.client.1.smithi073.stdout:2/777: mkdir d2/d9/d7f/dab/daa/df5 0 2024-08-31T05:21:09.737 INFO:tasks.workunit.client.1.smithi073.stdout:3/852: fsync da/d3c/d65/d45/fa1 0 2024-08-31T05:21:09.737 INFO:tasks.workunit.client.1.smithi073.stdout:5/973: truncate dc/d16/d1a/d87/d94/fb3 2620515 0 2024-08-31T05:21:09.739 INFO:tasks.workunit.client.0.smithi067.stdout:6/180: truncate f9 717640 0 2024-08-31T05:21:09.742 INFO:tasks.workunit.client.0.smithi067.stdout:8/205: dwrite d0/d2/f38 [0,4194304] 0 2024-08-31T05:21:09.745 INFO:tasks.workunit.client.1.smithi073.stdout:3/853: dwrite da/d3c/d65/d40/d5d/fe4 [0,4194304] 0 2024-08-31T05:21:09.746 INFO:tasks.workunit.client.0.smithi067.stdout:0/132: write d1/d8/f16 [3000447,8144] 0 2024-08-31T05:21:09.747 INFO:tasks.workunit.client.0.smithi067.stdout:8/206: mknod d0/d2/da/dd/d1f/c3e 0 2024-08-31T05:21:09.748 INFO:tasks.workunit.client.1.smithi073.stdout:8/783: symlink d0/db/d1c/d2a/lf5 0 2024-08-31T05:21:09.750 INFO:tasks.workunit.client.1.smithi073.stdout:8/784: readlink d0/db/d44/d72/d75/d7e/la7 0 2024-08-31T05:21:09.751 INFO:tasks.workunit.client.1.smithi073.stdout:3/854: dread da/f52 [0,4194304] 0 2024-08-31T05:21:09.752 INFO:tasks.workunit.client.1.smithi073.stdout:3/855: chown da/d3c/d82/d97/fd4 15 1 2024-08-31T05:21:09.753 INFO:tasks.workunit.client.0.smithi067.stdout:6/181: dwrite d1b/d23/d28/f31 [0,4194304] 0 2024-08-31T05:21:09.755 INFO:tasks.workunit.client.1.smithi073.stdout:5/974: write dc/d3d/dab/dff/d49/dd2/fd4 [2229565,63267] 0 2024-08-31T05:21:09.762 INFO:tasks.workunit.client.0.smithi067.stdout:0/133: dwrite d1/df/f1d [0,4194304] 0 2024-08-31T05:21:09.762 INFO:tasks.workunit.client.0.smithi067.stdout:6/182: chown d1b/d23/c26 9 1 2024-08-31T05:21:09.762 INFO:tasks.workunit.client.1.smithi073.stdout:2/778: getdents d2/d25/d92/de7 0 2024-08-31T05:21:09.765 INFO:tasks.workunit.client.0.smithi067.stdout:8/207: link d0/d4/de/d1d/f39 d0/d2/dc/d28/f3f 0 2024-08-31T05:21:09.765 INFO:tasks.workunit.client.1.smithi073.stdout:9/875: truncate dc/d37/d42/d8d/d52/fa4 1868872 0 2024-08-31T05:21:09.766 INFO:tasks.workunit.client.1.smithi073.stdout:8/785: symlink d0/db/d44/d4e/df3/lf6 0 2024-08-31T05:21:09.767 INFO:tasks.workunit.client.1.smithi073.stdout:8/786: chown d0/c1e 16673426 1 2024-08-31T05:21:09.768 INFO:tasks.workunit.client.1.smithi073.stdout:8/787: write d0/db/d44/d72/d79/f83 [872964,93350] 0 2024-08-31T05:21:09.772 INFO:tasks.workunit.client.1.smithi073.stdout:3/856: creat da/d3c/d65/d2c/d8e/dc2/f112 x:0 0 0 2024-08-31T05:21:09.773 INFO:tasks.workunit.client.0.smithi067.stdout:0/134: dwrite d1/df/f1d [0,4194304] 0 2024-08-31T05:21:09.774 INFO:tasks.workunit.client.0.smithi067.stdout:6/183: mkdir d1b/d23/d2e/d3b 0 2024-08-31T05:21:09.777 INFO:tasks.workunit.client.1.smithi073.stdout:5/975: symlink dc/d16/d1a/db7/deb/d115/l140 0 2024-08-31T05:21:09.779 INFO:tasks.workunit.client.1.smithi073.stdout:3/857: dwrite da/f2f [0,4194304] 0 2024-08-31T05:21:09.781 INFO:tasks.workunit.client.0.smithi067.stdout:6/184: mknod d1b/d23/c3c 0 2024-08-31T05:21:09.783 INFO:tasks.workunit.client.1.smithi073.stdout:4/707: getdents d7/d1a/d5c/d6d/d59/d86 0 2024-08-31T05:21:09.783 INFO:tasks.workunit.client.1.smithi073.stdout:8/788: dread d0/db/d1c/d24/faa [0,4194304] 0 2024-08-31T05:21:09.784 INFO:tasks.workunit.client.1.smithi073.stdout:5/976: creat dc/d16/d3b/d119/f141 x:0 0 0 2024-08-31T05:21:09.787 INFO:tasks.workunit.client.0.smithi067.stdout:8/208: link d0/d2/f15 d0/f40 0 2024-08-31T05:21:09.788 INFO:tasks.workunit.client.1.smithi073.stdout:0/803: sync 2024-08-31T05:21:09.883 INFO:tasks.workunit.client.0.smithi067.stdout:8/209: mknod d0/d2/da/c41 0 2024-08-31T05:21:09.885 INFO:tasks.workunit.client.1.smithi073.stdout:6/780: sync 2024-08-31T05:21:09.886 INFO:tasks.workunit.client.1.smithi073.stdout:6/781: write d15/d1a/d2b/d2f/d4b/d88/fbb [2359135,60254] 0 2024-08-31T05:21:09.886 INFO:tasks.workunit.client.1.smithi073.stdout:6/782: stat d15/d1a/d2b/d2f/d4b/fd9 0 2024-08-31T05:21:09.888 INFO:tasks.workunit.client.1.smithi073.stdout:6/783: write d15/d17/da1/dae/db0/d38/f3d [760431,93281] 0 2024-08-31T05:21:09.894 INFO:tasks.workunit.client.0.smithi067.stdout:0/135: getdents d1 0 2024-08-31T05:21:09.898 INFO:tasks.workunit.client.1.smithi073.stdout:2/779: rename d2/d9/d27/f33 to d2/d9/ff6 0 2024-08-31T05:21:09.902 INFO:tasks.workunit.client.0.smithi067.stdout:6/185: getdents d1b/d23 0 2024-08-31T05:21:09.903 INFO:tasks.workunit.client.1.smithi073.stdout:2/780: dwrite d2/d9/f24 [0,4194304] 0 2024-08-31T05:21:09.903 INFO:tasks.workunit.client.0.smithi067.stdout:0/136: dwrite d1/f2c [0,4194304] 0 2024-08-31T05:21:09.903 INFO:tasks.workunit.client.1.smithi073.stdout:0/804: symlink d0/d69/d7f/d68/d91/df5/d3c/d9c/de4/l10f 0 2024-08-31T05:21:09.904 INFO:tasks.workunit.client.0.smithi067.stdout:6/186: dread f7 [0,4194304] 0 2024-08-31T05:21:09.906 INFO:tasks.workunit.client.1.smithi073.stdout:4/708: mkdir d7/d1a/d5c/ddf 0 2024-08-31T05:21:09.913 INFO:tasks.workunit.client.1.smithi073.stdout:6/784: readlink d15/d1a/d2b/l39 0 2024-08-31T05:21:09.914 INFO:tasks.workunit.client.1.smithi073.stdout:6/785: read - d15/d1a/d51/fe8 zero size 2024-08-31T05:21:09.915 INFO:tasks.workunit.client.1.smithi073.stdout:8/789: dread d0/db/d1c/d24/d73/fcc [0,4194304] 0 2024-08-31T05:21:09.916 INFO:tasks.workunit.client.0.smithi067.stdout:0/137: dwrite d1/df/f1d [4194304,4194304] 0 2024-08-31T05:21:09.918 INFO:tasks.workunit.client.1.smithi073.stdout:5/977: mkdir dc/d16/d1a/d87/d142 0 2024-08-31T05:21:09.919 INFO:tasks.workunit.client.1.smithi073.stdout:5/978: read dc/d3d/f4c [1748936,1658] 0 2024-08-31T05:21:09.920 INFO:tasks.workunit.client.0.smithi067.stdout:6/187: dwrite d1b/d23/d2e/f38 [0,4194304] 0 2024-08-31T05:21:09.920 INFO:tasks.workunit.client.1.smithi073.stdout:4/709: creat d7/df/d13/d53/d88/fe0 x:0 0 0 2024-08-31T05:21:09.921 INFO:tasks.workunit.client.1.smithi073.stdout:4/710: write d7/df/d13/d2e/f31 [307106,124485] 0 2024-08-31T05:21:09.923 INFO:tasks.workunit.client.1.smithi073.stdout:4/711: readlink d7/d1a/d5c/d6d/d2c/d2d/da6/dde/ld4 0 2024-08-31T05:21:09.924 INFO:tasks.workunit.client.0.smithi067.stdout:0/138: creat d1/d8/f35 x:0 0 0 2024-08-31T05:21:09.925 INFO:tasks.workunit.client.0.smithi067.stdout:0/139: stat d1/c5 0 2024-08-31T05:21:09.925 INFO:tasks.workunit.client.0.smithi067.stdout:8/210: dwrite d0/d2/dc/f16 [0,4194304] 0 2024-08-31T05:21:09.927 INFO:tasks.workunit.client.0.smithi067.stdout:0/140: read d1/d8/f16 [141757,56835] 0 2024-08-31T05:21:09.927 INFO:tasks.workunit.client.0.smithi067.stdout:6/188: creat d1b/d23/d2e/f3d x:0 0 0 2024-08-31T05:21:09.931 INFO:tasks.workunit.client.0.smithi067.stdout:8/211: unlink d0/d2/d6/f1b 0 2024-08-31T05:21:09.932 INFO:tasks.workunit.client.1.smithi073.stdout:1/778: sync 2024-08-31T05:21:09.932 INFO:tasks.workunit.client.1.smithi073.stdout:7/775: sync 2024-08-31T05:21:09.933 INFO:tasks.workunit.client.1.smithi073.stdout:0/805: symlink d0/d89/l110 0 2024-08-31T05:21:09.933 INFO:tasks.workunit.client.1.smithi073.stdout:7/776: chown d1/da 4508 1 2024-08-31T05:21:09.935 INFO:tasks.workunit.client.1.smithi073.stdout:4/712: write d7/df/d79/faf [715299,56774] 0 2024-08-31T05:21:09.936 INFO:tasks.workunit.client.0.smithi067.stdout:0/141: dwrite d1/d8/f33 [0,4194304] 0 2024-08-31T05:21:09.937 INFO:tasks.workunit.client.1.smithi073.stdout:8/790: mkdir d0/db/d1c/df7 0 2024-08-31T05:21:09.938 INFO:tasks.workunit.client.0.smithi067.stdout:6/189: creat d1b/f3e x:0 0 0 2024-08-31T05:21:09.939 INFO:tasks.workunit.client.0.smithi067.stdout:6/190: write d1b/d23/d28/f37 [84830,117273] 0 2024-08-31T05:21:09.940 INFO:tasks.workunit.client.1.smithi073.stdout:9/876: rename dc/d37/d42/d5a/d89/cee to dc/d37/db5/c11b 0 2024-08-31T05:21:09.943 INFO:tasks.workunit.client.1.smithi073.stdout:5/979: symlink dc/d16/l143 0 2024-08-31T05:21:09.944 INFO:tasks.workunit.client.0.smithi067.stdout:8/212: link d0/d2/f15 d0/d2/da/f42 0 2024-08-31T05:21:09.945 INFO:tasks.workunit.client.1.smithi073.stdout:5/980: fdatasync dc/d16/d3b/d3f/f9a 0 2024-08-31T05:21:09.948 INFO:tasks.workunit.client.0.smithi067.stdout:0/142: fdatasync d1/f2c 0 2024-08-31T05:21:09.950 INFO:tasks.workunit.client.1.smithi073.stdout:6/786: creat d15/d17/da1/dae/ffe x:0 0 0 2024-08-31T05:21:09.952 INFO:tasks.workunit.client.0.smithi067.stdout:6/191: creat d1b/d23/d2e/d3b/f3f x:0 0 0 2024-08-31T05:21:09.952 INFO:tasks.workunit.client.1.smithi073.stdout:4/713: creat d7/d1a/d5c/d6d/d59/d65/db9/dd6/fe1 x:0 0 0 2024-08-31T05:21:09.953 INFO:tasks.workunit.client.0.smithi067.stdout:8/213: dwrite d0/d2/f38 [0,4194304] 0 2024-08-31T05:21:09.954 INFO:tasks.workunit.client.0.smithi067.stdout:0/143: creat d1/d8/f36 x:0 0 0 2024-08-31T05:21:09.954 INFO:tasks.workunit.client.0.smithi067.stdout:6/192: write d1b/d23/f34 [3229249,78413] 0 2024-08-31T05:21:09.956 INFO:tasks.workunit.client.0.smithi067.stdout:6/193: write d1b/f3e [845982,96464] 0 2024-08-31T05:21:09.958 INFO:tasks.workunit.client.1.smithi073.stdout:2/781: rename d2/f19 to d2/d9/d7f/dab/daa/df5/ff7 0 2024-08-31T05:21:09.960 INFO:tasks.workunit.client.0.smithi067.stdout:6/194: dread d1b/f21 [0,4194304] 0 2024-08-31T05:21:09.963 INFO:tasks.workunit.client.0.smithi067.stdout:8/214: mknod d0/d2/da/dd/c43 0 2024-08-31T05:21:09.964 INFO:tasks.workunit.client.0.smithi067.stdout:8/215: chown d0/d2/da/f22 1107137 1 2024-08-31T05:21:09.965 INFO:tasks.workunit.client.1.smithi073.stdout:8/791: dread d0/db/d1c/d2a/d58/faf [0,4194304] 0 2024-08-31T05:21:09.966 INFO:tasks.workunit.client.1.smithi073.stdout:1/779: mknod d5/d26/d54/db2/ddb/ce6 0 2024-08-31T05:21:09.968 INFO:tasks.workunit.client.1.smithi073.stdout:3/858: sync 2024-08-31T05:21:09.972 INFO:tasks.workunit.client.1.smithi073.stdout:8/792: dwrite d0/d62/f8d [0,4194304] 0 2024-08-31T05:21:09.973 INFO:tasks.workunit.client.1.smithi073.stdout:0/806: rename d0/d89/c8c to d0/d69/d7f/d68/d91/df5/d3c/d9c/dc8/c111 0 2024-08-31T05:21:09.974 INFO:tasks.workunit.client.1.smithi073.stdout:2/782: rmdir d2/d9/d27/d9b/da6/ddd 39 2024-08-31T05:21:09.976 INFO:tasks.workunit.client.0.smithi067.stdout:6/195: truncate f7 365813 0 2024-08-31T05:21:09.982 INFO:tasks.workunit.client.0.smithi067.stdout:0/144: getdents d1/dd 0 2024-08-31T05:21:09.983 INFO:tasks.workunit.client.1.smithi073.stdout:1/780: chown d5/d26/da5/fda 76 1 2024-08-31T05:21:09.984 INFO:tasks.workunit.client.1.smithi073.stdout:9/877: write dc/de/d56/fbb [135340,18180] 0 2024-08-31T05:21:09.985 INFO:tasks.workunit.client.1.smithi073.stdout:5/981: symlink dc/d16/d3b/d3f/d4f/d98/df6/l144 0 2024-08-31T05:21:09.986 INFO:tasks.workunit.client.1.smithi073.stdout:3/859: mknod da/d3c/d65/d45/dcd/d108/c113 0 2024-08-31T05:21:09.987 INFO:tasks.workunit.client.0.smithi067.stdout:8/216: link d0/d2/dc/l13 d0/d4/de/l44 0 2024-08-31T05:21:09.989 INFO:tasks.workunit.client.0.smithi067.stdout:0/145: read d1/d8/f16 [2763296,31471] 0 2024-08-31T05:21:09.989 INFO:tasks.workunit.client.1.smithi073.stdout:1/781: dwrite d5/d26/da5/dba/d1c/d27/d51/faa [0,4194304] 0 2024-08-31T05:21:09.990 INFO:tasks.workunit.client.1.smithi073.stdout:7/777: rename d1/da/db2/lb8 to d1/da/d3e/d22/d6b/ddf/de2/lf8 0 2024-08-31T05:21:09.991 INFO:tasks.workunit.client.0.smithi067.stdout:6/196: mkdir d1b/d40 0 2024-08-31T05:21:09.993 INFO:tasks.workunit.client.1.smithi073.stdout:7/778: truncate d1/d11/fed 1034364 0 2024-08-31T05:21:09.993 INFO:tasks.workunit.client.1.smithi073.stdout:8/793: symlink d0/db/d1c/d34/d68/lf8 0 2024-08-31T05:21:09.994 INFO:tasks.workunit.client.1.smithi073.stdout:6/787: dwrite d15/d1a/d1e/d69/ff8 [0,4194304] 0 2024-08-31T05:21:09.994 INFO:tasks.workunit.client.0.smithi067.stdout:6/197: chown d1b/d23/d28/f31 845 1 2024-08-31T05:21:09.994 INFO:tasks.workunit.client.1.smithi073.stdout:8/794: fdatasync d0/da8/fde 0 2024-08-31T05:21:09.997 INFO:tasks.workunit.client.0.smithi067.stdout:8/217: rename d0/d2/da/dd/cf to d0/d2/da/dd/c45 0 2024-08-31T05:21:10.000 INFO:tasks.workunit.client.1.smithi073.stdout:2/783: creat d2/d25/d92/de7/ff8 x:0 0 0 2024-08-31T05:21:10.001 INFO:tasks.workunit.client.1.smithi073.stdout:7/779: dwrite d1/da/d15/d33/d44/d60/f7d [0,4194304] 0 2024-08-31T05:21:10.001 INFO:tasks.workunit.client.0.smithi067.stdout:0/146: dwrite d1/f6 [4194304,4194304] 0 2024-08-31T05:21:10.001 INFO:tasks.workunit.client.1.smithi073.stdout:9/878: stat dc/de/dd8/dd9 0 2024-08-31T05:21:10.004 INFO:tasks.workunit.client.0.smithi067.stdout:0/147: fsync d1/f2c 0 2024-08-31T05:21:10.006 INFO:tasks.workunit.client.1.smithi073.stdout:2/784: read d2/d9/df/f64 [6412487,64762] 0 2024-08-31T05:21:10.007 INFO:tasks.workunit.client.0.smithi067.stdout:6/198: dwrite d1b/f20 [0,4194304] 0 2024-08-31T05:21:10.008 INFO:tasks.workunit.client.1.smithi073.stdout:4/714: rename d7/df/d1b/d34/l4d to d7/d1a/d5c/d62/dda/le2 0 2024-08-31T05:21:10.009 INFO:tasks.workunit.client.1.smithi073.stdout:8/795: creat d0/db/d44/d72/d79/ff9 x:0 0 0 2024-08-31T05:21:10.015 INFO:tasks.workunit.client.0.smithi067.stdout:6/199: mknod d1b/d23/c41 0 2024-08-31T05:21:10.020 INFO:tasks.workunit.client.1.smithi073.stdout:9/879: unlink dc/d37/d42/d5a/fbc 0 2024-08-31T05:21:10.025 INFO:tasks.workunit.client.0.smithi067.stdout:6/200: dwrite d1b/d23/d28/f39 [0,4194304] 0 2024-08-31T05:21:10.029 INFO:tasks.workunit.client.0.smithi067.stdout:6/201: dread f10 [0,4194304] 0 2024-08-31T05:21:10.029 INFO:tasks.workunit.client.1.smithi073.stdout:2/785: dread d2/d9/fa0 [0,4194304] 0 2024-08-31T05:21:10.030 INFO:tasks.workunit.client.1.smithi073.stdout:2/786: read d2/d9/df/f3e [3598948,33519] 0 2024-08-31T05:21:10.033 INFO:tasks.workunit.client.1.smithi073.stdout:5/982: dread dc/d3d/dab/dff/f25 [0,4194304] 0 2024-08-31T05:21:10.034 INFO:tasks.workunit.client.1.smithi073.stdout:5/983: chown dc/d16/d3b/d7f/d99/lf9 185156 1 2024-08-31T05:21:10.071 INFO:tasks.workunit.client.1.smithi073.stdout:3/860: sync 2024-08-31T05:21:10.074 INFO:tasks.workunit.client.0.smithi067.stdout:8/218: link d0/d2/da/dd/d1f/c3e d0/d2/dc/c46 0 2024-08-31T05:21:10.081 INFO:tasks.workunit.client.1.smithi073.stdout:6/788: mkdir d15/d1a/d2b/d2f/d4b/dff 0 2024-08-31T05:21:10.087 INFO:tasks.workunit.client.1.smithi073.stdout:4/715: rename d7/df/da9 to d7/d1a/d5c/d6d/d2c/d2d/da6/dde/de3 0 2024-08-31T05:21:10.087 INFO:tasks.workunit.client.1.smithi073.stdout:1/782: write d5/d26/d54/db2/dd5/fca [327575,49753] 0 2024-08-31T05:21:10.088 INFO:tasks.workunit.client.0.smithi067.stdout:8/219: symlink d0/d2/da/dd/d1f/l47 0 2024-08-31T05:21:10.090 INFO:tasks.workunit.client.1.smithi073.stdout:8/796: creat d0/db/d44/d72/d75/d7e/d91/dac/ffa x:0 0 0 2024-08-31T05:21:10.092 INFO:tasks.workunit.client.0.smithi067.stdout:0/148: write d1/dd/f21 [61290,128688] 0 2024-08-31T05:21:10.093 INFO:tasks.workunit.client.0.smithi067.stdout:0/149: dread - d1/df/d17/f20 zero size 2024-08-31T05:21:10.094 INFO:tasks.workunit.client.1.smithi073.stdout:9/880: mkdir dc/dc4/d11c 0 2024-08-31T05:21:10.094 INFO:tasks.workunit.client.1.smithi073.stdout:7/780: write d1/da/d3e/d22/f27 [1220137,118693] 0 2024-08-31T05:21:10.094 INFO:tasks.workunit.client.1.smithi073.stdout:9/881: stat dc/d10 0 2024-08-31T05:21:10.096 INFO:tasks.workunit.client.0.smithi067.stdout:8/220: creat d0/d2/dc/f48 x:0 0 0 2024-08-31T05:21:10.097 INFO:tasks.workunit.client.1.smithi073.stdout:7/781: fsync d1/da/d3e/d22/f27 0 2024-08-31T05:21:10.099 INFO:tasks.workunit.client.0.smithi067.stdout:0/150: dread d1/d8/f33 [0,4194304] 0 2024-08-31T05:21:10.101 INFO:tasks.workunit.client.0.smithi067.stdout:8/221: dread d0/d4/de/d1d/f3a [0,4194304] 0 2024-08-31T05:21:10.103 INFO:tasks.workunit.client.1.smithi073.stdout:5/984: mknod dc/d16/d1a/db7/dc1/c145 0 2024-08-31T05:21:10.104 INFO:tasks.workunit.client.1.smithi073.stdout:3/861: rmdir da 39 2024-08-31T05:21:10.105 INFO:tasks.workunit.client.0.smithi067.stdout:6/202: write f14 [966474,25776] 0 2024-08-31T05:21:10.105 INFO:tasks.workunit.client.0.smithi067.stdout:0/151: mkdir d1/df/d29/d37 0 2024-08-31T05:21:10.111 INFO:tasks.workunit.client.0.smithi067.stdout:8/222: creat d0/d2/dc/f49 x:0 0 0 2024-08-31T05:21:10.112 INFO:tasks.workunit.client.1.smithi073.stdout:0/807: link d0/d15/d9b/cf6 d0/d15/d2c/c112 0 2024-08-31T05:21:10.113 INFO:tasks.workunit.client.0.smithi067.stdout:0/152: rmdir d1/dd 39 2024-08-31T05:21:10.115 INFO:tasks.workunit.client.1.smithi073.stdout:4/716: write d7/df/d13/db2/fbd [579780,3245] 0 2024-08-31T05:21:10.117 INFO:tasks.workunit.client.0.smithi067.stdout:6/203: rename d1b/d23/d28/f31 to d1b/d23/d2f/f42 0 2024-08-31T05:21:10.118 INFO:tasks.workunit.client.1.smithi073.stdout:2/787: write d2/d9/df/f62 [4865392,21207] 0 2024-08-31T05:21:10.118 INFO:tasks.workunit.client.1.smithi073.stdout:4/717: dread d7/df/d79/fac [0,4194304] 0 2024-08-31T05:21:10.119 INFO:tasks.workunit.client.1.smithi073.stdout:1/783: creat d5/d26/d54/db2/fe7 x:0 0 0 2024-08-31T05:21:10.124 INFO:tasks.workunit.client.0.smithi067.stdout:8/223: mkdir d0/d4a 0 2024-08-31T05:21:10.125 INFO:tasks.workunit.client.1.smithi073.stdout:9/882: dread dc/d82/fbe [0,4194304] 0 2024-08-31T05:21:10.125 INFO:tasks.workunit.client.1.smithi073.stdout:5/985: write dc/d16/d1a/d87/d94/ff0 [88992,102780] 0 2024-08-31T05:21:10.125 INFO:tasks.workunit.client.1.smithi073.stdout:1/784: dwrite d5/d26/d54/db2/dd5/d2a/d80/fd0 [0,4194304] 0 2024-08-31T05:21:10.126 INFO:tasks.workunit.client.0.smithi067.stdout:0/153: mknod d1/dd/d18/c38 0 2024-08-31T05:21:10.126 INFO:tasks.workunit.client.0.smithi067.stdout:0/154: write d1/dd/f21 [857500,71130] 0 2024-08-31T05:21:10.128 INFO:tasks.workunit.client.1.smithi073.stdout:9/883: chown dc/de/d66/d84/lfe 3 1 2024-08-31T05:21:10.128 INFO:tasks.workunit.client.1.smithi073.stdout:9/884: truncate dc/de/d56/f106 604190 0 2024-08-31T05:21:10.129 INFO:tasks.workunit.client.1.smithi073.stdout:6/789: link d15/d1a/d51/d61/fbf d15/d1a/d51/d6e/ddb/f100 0 2024-08-31T05:21:10.131 INFO:tasks.workunit.client.0.smithi067.stdout:0/155: dread d1/dd/f15 [0,4194304] 0 2024-08-31T05:21:10.132 INFO:tasks.workunit.client.0.smithi067.stdout:0/156: chown d1/l31 764364 1 2024-08-31T05:21:10.136 INFO:tasks.workunit.client.1.smithi073.stdout:0/808: dread d0/d69/d8e/d99/f101 [0,4194304] 0 2024-08-31T05:21:10.136 INFO:tasks.workunit.client.0.smithi067.stdout:6/204: creat d1b/f43 x:0 0 0 2024-08-31T05:21:10.136 INFO:tasks.workunit.client.1.smithi073.stdout:0/809: fsync d0/d69/d7f/d62/fa6 0 2024-08-31T05:21:10.137 INFO:tasks.workunit.client.0.smithi067.stdout:6/205: stat d1b/d23/d2e 0 2024-08-31T05:21:10.138 INFO:tasks.workunit.client.1.smithi073.stdout:2/788: creat d2/d9/d27/d76/ff9 x:0 0 0 2024-08-31T05:21:10.139 INFO:tasks.workunit.client.1.smithi073.stdout:2/789: chown d2/d9/lec 664478168 1 2024-08-31T05:21:10.140 INFO:tasks.workunit.client.0.smithi067.stdout:8/224: mknod d0/d2/dc/d3d/c4b 0 2024-08-31T05:21:10.141 INFO:tasks.workunit.client.1.smithi073.stdout:8/797: mknod d0/d62/db4/dee/cfb 0 2024-08-31T05:21:10.141 INFO:tasks.workunit.client.0.smithi067.stdout:0/157: dwrite d1/df/f1d [0,4194304] 0 2024-08-31T05:21:10.142 INFO:tasks.workunit.client.1.smithi073.stdout:7/782: dwrite d1/da/d3e/db1/fd4 [4194304,4194304] 0 2024-08-31T05:21:10.143 INFO:tasks.workunit.client.0.smithi067.stdout:0/158: truncate d1/d8/f35 577652 0 2024-08-31T05:21:10.144 INFO:tasks.workunit.client.0.smithi067.stdout:8/225: read d0/d2/d6/f27 [218064,63782] 0 2024-08-31T05:21:10.146 INFO:tasks.workunit.client.1.smithi073.stdout:5/986: rmdir dc/d16/d3b/d119 39 2024-08-31T05:21:10.147 INFO:tasks.workunit.client.1.smithi073.stdout:5/987: fdatasync dc/d3d/dab/dff/fa7 0 2024-08-31T05:21:10.154 INFO:tasks.workunit.client.0.smithi067.stdout:0/159: dwrite d1/d8/f36 [0,4194304] 0 2024-08-31T05:21:10.154 INFO:tasks.workunit.client.0.smithi067.stdout:6/206: link d1b/d23/c2d d1b/d23/c44 0 2024-08-31T05:21:10.154 INFO:tasks.workunit.client.1.smithi073.stdout:5/988: dwrite dc/d16/f2e [0,4194304] 0 2024-08-31T05:21:10.155 INFO:tasks.workunit.client.0.smithi067.stdout:0/160: write d1/d8/f36 [2177535,77221] 0 2024-08-31T05:21:10.156 INFO:tasks.workunit.client.1.smithi073.stdout:0/810: creat d0/d15/d2c/d40/d86/f113 x:0 0 0 2024-08-31T05:21:10.161 INFO:tasks.workunit.client.0.smithi067.stdout:6/207: chown f7 565 1 2024-08-31T05:21:10.163 INFO:tasks.workunit.client.1.smithi073.stdout:4/718: write d7/df/d13/d2e/d47/d4c/d73/f87 [610612,17223] 0 2024-08-31T05:21:10.169 INFO:tasks.workunit.client.0.smithi067.stdout:6/208: dwrite d1b/d23/d28/f2b [0,4194304] 0 2024-08-31T05:21:10.170 INFO:tasks.workunit.client.1.smithi073.stdout:8/798: dread d0/f1a [0,4194304] 0 2024-08-31T05:21:10.172 INFO:tasks.workunit.client.0.smithi067.stdout:0/161: getdents d1/df/d29/d37 0 2024-08-31T05:21:10.173 INFO:tasks.workunit.client.0.smithi067.stdout:0/162: readlink d1/dd/l2e 0 2024-08-31T05:21:10.174 INFO:tasks.workunit.client.0.smithi067.stdout:8/226: getdents d0/d4/de/d1d/d2c 0 2024-08-31T05:21:10.174 INFO:tasks.workunit.client.0.smithi067.stdout:8/227: readlink d0/d4/de/l18 0 2024-08-31T05:21:10.176 INFO:tasks.workunit.client.0.smithi067.stdout:6/209: fdatasync ff 0 2024-08-31T05:21:10.176 INFO:tasks.workunit.client.1.smithi073.stdout:6/790: creat d15/d1a/d51/d61/d7c/da6/df6/f101 x:0 0 0 2024-08-31T05:21:10.176 INFO:tasks.workunit.client.0.smithi067.stdout:6/210: stat c17 0 2024-08-31T05:21:10.178 INFO:tasks.workunit.client.1.smithi073.stdout:5/989: rmdir dc/d16/d1a/db7/dc1 39 2024-08-31T05:21:10.180 INFO:tasks.workunit.client.0.smithi067.stdout:8/228: chown d0/d2/da/f42 1301151535 1 2024-08-31T05:21:10.180 INFO:tasks.workunit.client.1.smithi073.stdout:2/790: write d2/d9/d7f/dab/f42 [1449398,3079] 0 2024-08-31T05:21:10.182 INFO:tasks.workunit.client.1.smithi073.stdout:3/862: write da/d3c/d65/fb2 [590855,108470] 0 2024-08-31T05:21:10.182 INFO:tasks.workunit.client.1.smithi073.stdout:9/885: dwrite dc/d82/fbe [0,4194304] 0 2024-08-31T05:21:10.184 INFO:tasks.workunit.client.0.smithi067.stdout:0/163: rename d1/df/f26 to d1/f39 0 2024-08-31T05:21:10.184 INFO:tasks.workunit.client.0.smithi067.stdout:6/211: dwrite d1b/d23/d2e/f38 [0,4194304] 0 2024-08-31T05:21:10.186 INFO:tasks.workunit.client.0.smithi067.stdout:8/229: creat d0/d2/da/dd/f4c x:0 0 0 2024-08-31T05:21:10.187 INFO:tasks.workunit.client.0.smithi067.stdout:8/230: write d0/d2/f24 [31824,53922] 0 2024-08-31T05:21:10.189 INFO:tasks.workunit.client.1.smithi073.stdout:1/785: creat d5/d26/d54/db2/dd5/d2a/fe8 x:0 0 0 2024-08-31T05:21:10.190 INFO:tasks.workunit.client.1.smithi073.stdout:1/786: readlink d5/d26/d54/db2/dd5/d32/d37/le1 0 2024-08-31T05:21:10.191 INFO:tasks.workunit.client.0.smithi067.stdout:8/231: symlink d0/d4/de/l4d 0 2024-08-31T05:21:10.192 INFO:tasks.workunit.client.1.smithi073.stdout:0/811: dread d0/d69/d7f/d68/d91/df5/d3c/f6 [0,4194304] 0 2024-08-31T05:21:10.194 INFO:tasks.workunit.client.1.smithi073.stdout:2/791: mkdir d2/d9/d27/d76/db5/dfa 0 2024-08-31T05:21:10.196 INFO:tasks.workunit.client.0.smithi067.stdout:6/212: truncate ff 1872658 0 2024-08-31T05:21:10.197 INFO:tasks.workunit.client.0.smithi067.stdout:0/164: creat d1/f3a x:0 0 0 2024-08-31T05:21:10.198 INFO:tasks.workunit.client.1.smithi073.stdout:9/886: chown dc/d37/d42/d8d/f39 55287 1 2024-08-31T05:21:10.198 INFO:tasks.workunit.client.0.smithi067.stdout:0/165: read - d1/df/d29/f34 zero size 2024-08-31T05:21:10.199 INFO:tasks.workunit.client.1.smithi073.stdout:7/783: creat d1/d11/ff9 x:0 0 0 2024-08-31T05:21:10.199 INFO:tasks.workunit.client.0.smithi067.stdout:6/213: rmdir d1b/d30 39 2024-08-31T05:21:10.201 INFO:tasks.workunit.client.1.smithi073.stdout:3/863: symlink da/d3c/d65/d45/dcd/d108/da2/daf/dbc/l114 0 2024-08-31T05:21:10.201 INFO:tasks.workunit.client.1.smithi073.stdout:3/864: dread - da/d3c/d82/d97/fce zero size 2024-08-31T05:21:10.202 INFO:tasks.workunit.client.1.smithi073.stdout:3/865: write da/d3c/d65/d40/fa4 [215104,80351] 0 2024-08-31T05:21:10.203 INFO:tasks.workunit.client.1.smithi073.stdout:7/784: dread d1/da/d15/fe7 [0,4194304] 0 2024-08-31T05:21:10.204 INFO:tasks.workunit.client.1.smithi073.stdout:3/866: stat da/d3c/d65/d45/dcd/d108/fae 0 2024-08-31T05:21:10.205 INFO:tasks.workunit.client.1.smithi073.stdout:1/787: unlink d5/d26/da5/fda 0 2024-08-31T05:21:10.205 INFO:tasks.workunit.client.1.smithi073.stdout:3/867: write da/d3c/d65/d45/dcd/d108/da2/ff8 [696031,38181] 0 2024-08-31T05:21:10.206 INFO:tasks.workunit.client.1.smithi073.stdout:5/990: mknod dc/d3d/dab/dff/dbd/c146 0 2024-08-31T05:21:10.208 INFO:tasks.workunit.client.0.smithi067.stdout:8/232: getdents d0/d2/da 0 2024-08-31T05:21:10.209 INFO:tasks.workunit.client.0.smithi067.stdout:6/214: dwrite d1b/d23/d2f/f42 [0,4194304] 0 2024-08-31T05:21:10.209 INFO:tasks.workunit.client.0.smithi067.stdout:8/233: readlink d0/d4/de/l30 0 2024-08-31T05:21:10.210 INFO:tasks.workunit.client.1.smithi073.stdout:9/887: rmdir dc/d37/d42/d5a/d89 39 2024-08-31T05:21:10.213 INFO:tasks.workunit.client.0.smithi067.stdout:8/234: mknod d0/c4e 0 2024-08-31T05:21:10.214 INFO:tasks.workunit.client.1.smithi073.stdout:6/791: link d15/d17/da1/dae/db0/d38/d9b/f73 d15/f102 0 2024-08-31T05:21:10.217 INFO:tasks.workunit.client.0.smithi067.stdout:8/235: symlink d0/d2/da/l4f 0 2024-08-31T05:21:10.218 INFO:tasks.workunit.client.0.smithi067.stdout:8/236: dread - d0/d2/dc/f48 zero size 2024-08-31T05:21:10.218 INFO:tasks.workunit.client.1.smithi073.stdout:3/868: creat da/d3c/d65/d45/dcd/f115 x:0 0 0 2024-08-31T05:21:10.221 INFO:tasks.workunit.client.0.smithi067.stdout:8/237: dread d0/d4/de/f34 [0,4194304] 0 2024-08-31T05:21:10.221 INFO:tasks.workunit.client.1.smithi073.stdout:2/792: dread d2/d9/df/f64 [4194304,4194304] 0 2024-08-31T05:21:10.221 INFO:tasks.workunit.client.1.smithi073.stdout:4/719: link d7/df/d13/d53/f80 d7/df/d79/d7a/fe4 0 2024-08-31T05:21:10.223 INFO:tasks.workunit.client.1.smithi073.stdout:9/888: creat dc/d37/d42/d5a/da0/f11d x:0 0 0 2024-08-31T05:21:10.225 INFO:tasks.workunit.client.0.smithi067.stdout:8/238: rename d0/d2/dc/l17 to d0/d4a/l50 0 2024-08-31T05:21:10.226 INFO:tasks.workunit.client.0.smithi067.stdout:2/70: sync 2024-08-31T05:21:10.227 INFO:tasks.workunit.client.0.smithi067.stdout:2/71: read f1 [1760274,111167] 0 2024-08-31T05:21:10.228 INFO:tasks.workunit.client.0.smithi067.stdout:2/72: chown c6 207986288 1 2024-08-31T05:21:10.229 INFO:tasks.workunit.client.1.smithi073.stdout:3/869: creat da/d3c/d65/d40/f116 x:0 0 0 2024-08-31T05:21:10.230 INFO:tasks.workunit.client.0.smithi067.stdout:8/239: mknod d0/d4/de/d1d/d2c/c51 0 2024-08-31T05:21:10.234 INFO:tasks.workunit.client.1.smithi073.stdout:2/793: creat d2/d9/d3c/ffb x:0 0 0 2024-08-31T05:21:10.235 INFO:tasks.workunit.client.0.smithi067.stdout:8/240: mkdir d0/d2/dc/d3d/d52 0 2024-08-31T05:21:10.236 INFO:tasks.workunit.client.1.smithi073.stdout:4/720: creat d7/d1a/d5c/d6d/d59/d65/fe5 x:0 0 0 2024-08-31T05:21:10.239 INFO:tasks.workunit.client.0.smithi067.stdout:2/73: creat db/dd/f11 x:0 0 0 2024-08-31T05:21:10.240 INFO:tasks.workunit.client.0.smithi067.stdout:2/74: chown db/dd/f11 12 1 2024-08-31T05:21:10.240 INFO:tasks.workunit.client.0.smithi067.stdout:8/241: truncate d0/d2/d6/f27 427623 0 2024-08-31T05:21:10.240 INFO:tasks.workunit.client.0.smithi067.stdout:2/75: read f4 [2130109,83338] 0 2024-08-31T05:21:10.241 INFO:tasks.workunit.client.1.smithi073.stdout:4/721: dwrite d7/df/d1b/d34/fc8 [0,4194304] 0 2024-08-31T05:21:10.243 INFO:tasks.workunit.client.1.smithi073.stdout:4/722: truncate d7/df/d13/d2e/d70/d6b/f8f 584151 0 2024-08-31T05:21:10.244 INFO:tasks.workunit.client.0.smithi067.stdout:2/76: dread f4 [0,4194304] 0 2024-08-31T05:21:10.245 INFO:tasks.workunit.client.0.smithi067.stdout:8/242: rmdir d0/d4a 39 2024-08-31T05:21:10.246 INFO:tasks.workunit.client.1.smithi073.stdout:4/723: truncate d7/df/d79/d7a/f92 4519792 0 2024-08-31T05:21:10.246 INFO:tasks.workunit.client.0.smithi067.stdout:2/77: chown f4 14998 1 2024-08-31T05:21:10.246 INFO:tasks.workunit.client.0.smithi067.stdout:2/78: readlink l8 0 2024-08-31T05:21:10.249 INFO:tasks.workunit.client.1.smithi073.stdout:2/794: mknod d2/d9/df/d43/d88/cfc 0 2024-08-31T05:21:10.250 INFO:tasks.workunit.client.1.smithi073.stdout:8/799: dwrite d0/db/d1c/d24/d73/fcc [0,4194304] 0 2024-08-31T05:21:10.250 INFO:tasks.workunit.client.1.smithi073.stdout:4/724: dread d7/df/d13/db2/fbd [0,4194304] 0 2024-08-31T05:21:10.252 INFO:tasks.workunit.client.1.smithi073.stdout:8/800: write d0/db/d1c/d34/d38/f42 [4407159,25474] 0 2024-08-31T05:21:10.254 INFO:tasks.workunit.client.0.smithi067.stdout:2/79: mkdir db/d12 0 2024-08-31T05:21:10.257 INFO:tasks.workunit.client.1.smithi073.stdout:2/795: dwrite d2/d9/d27/d9b/da6/f63 [0,4194304] 0 2024-08-31T05:21:10.257 INFO:tasks.workunit.client.0.smithi067.stdout:8/243: mknod d0/d4a/c53 0 2024-08-31T05:21:10.259 INFO:tasks.workunit.client.0.smithi067.stdout:8/244: fdatasync d0/d2/da/dd/f4c 0 2024-08-31T05:21:10.260 INFO:tasks.workunit.client.0.smithi067.stdout:0/166: write d1/dd/f15 [4801131,10445] 0 2024-08-31T05:21:10.262 INFO:tasks.workunit.client.1.smithi073.stdout:1/788: getdents d5/d26/d54/db2/dd5/d32/daf 0 2024-08-31T05:21:10.265 INFO:tasks.workunit.client.0.smithi067.stdout:2/80: write f4 [755290,71955] 0 2024-08-31T05:21:10.266 INFO:tasks.workunit.client.0.smithi067.stdout:2/81: chown l5 3814065 1 2024-08-31T05:21:10.268 INFO:tasks.workunit.client.1.smithi073.stdout:4/725: dread d7/df/d13/f16 [0,4194304] 0 2024-08-31T05:21:10.268 INFO:tasks.workunit.client.0.smithi067.stdout:2/82: dread - db/ff zero size 2024-08-31T05:21:10.269 INFO:tasks.workunit.client.0.smithi067.stdout:0/167: rename d1/df/d17/c24 to d1/df/d29/d37/c3b 0 2024-08-31T05:21:10.270 INFO:tasks.workunit.client.1.smithi073.stdout:5/991: link dc/d3d/d55/f101 dc/d16/d4e/f147 0 2024-08-31T05:21:10.271 INFO:tasks.workunit.client.0.smithi067.stdout:6/215: truncate d1b/f3e 826396 0 2024-08-31T05:21:10.272 INFO:tasks.workunit.client.0.smithi067.stdout:2/83: mkdir db/dd/d13 0 2024-08-31T05:21:10.277 INFO:tasks.workunit.client.0.smithi067.stdout:0/168: dwrite d1/dd/f15 [4194304,4194304] 0 2024-08-31T05:21:10.278 INFO:tasks.workunit.client.1.smithi073.stdout:0/812: dwrite d0/d69/d8e/f38 [0,4194304] 0 2024-08-31T05:21:10.279 INFO:tasks.workunit.client.0.smithi067.stdout:6/216: fdatasync fd 0 2024-08-31T05:21:10.279 INFO:tasks.workunit.client.0.smithi067.stdout:6/217: readlink le 0 2024-08-31T05:21:10.282 INFO:tasks.workunit.client.0.smithi067.stdout:0/169: symlink d1/dd/l3c 0 2024-08-31T05:21:10.285 INFO:tasks.workunit.client.1.smithi073.stdout:7/785: dwrite d1/da/f99 [0,4194304] 0 2024-08-31T05:21:10.287 INFO:tasks.workunit.client.1.smithi073.stdout:7/786: chown d1/d11/d91/l95 283155 1 2024-08-31T05:21:10.289 INFO:tasks.workunit.client.1.smithi073.stdout:6/792: rename d15/d1a/d51/d61/d7c/da6/df6/f101 to d15/d41/f103 0 2024-08-31T05:21:10.291 INFO:tasks.workunit.client.0.smithi067.stdout:2/84: creat db/dd/d13/f14 x:0 0 0 2024-08-31T05:21:10.291 INFO:tasks.workunit.client.1.smithi073.stdout:2/796: rmdir d2/d9/d7f/dab 39 2024-08-31T05:21:10.292 INFO:tasks.workunit.client.1.smithi073.stdout:2/797: write d2/d25/f93 [4254405,58625] 0 2024-08-31T05:21:10.293 INFO:tasks.workunit.client.0.smithi067.stdout:0/170: creat d1/dd/f3d x:0 0 0 2024-08-31T05:21:10.294 INFO:tasks.workunit.client.1.smithi073.stdout:7/787: dwrite d1/da/d3e/d22/d47/fa1 [0,4194304] 0 2024-08-31T05:21:10.294 INFO:tasks.workunit.client.1.smithi073.stdout:1/789: fsync d5/d26/d54/d5f/fa8 0 2024-08-31T05:21:10.294 INFO:tasks.workunit.client.1.smithi073.stdout:2/798: fsync d2/d9/d27/d76/d97/faf 0 2024-08-31T05:21:10.295 INFO:tasks.workunit.client.0.smithi067.stdout:6/218: readlink d1b/d30/l35 0 2024-08-31T05:21:10.296 INFO:tasks.workunit.client.1.smithi073.stdout:7/788: stat d1/da/d3e/d22/c56 0 2024-08-31T05:21:10.298 INFO:tasks.workunit.client.0.smithi067.stdout:2/85: truncate f1 2458703 0 2024-08-31T05:21:10.298 INFO:tasks.workunit.client.1.smithi073.stdout:7/789: chown d1/da/la2 3186012 1 2024-08-31T05:21:10.299 INFO:tasks.workunit.client.0.smithi067.stdout:2/86: write db/ff [737053,24352] 0 2024-08-31T05:21:10.302 INFO:tasks.workunit.client.0.smithi067.stdout:0/171: creat d1/dd/d18/f3e x:0 0 0 2024-08-31T05:21:10.302 INFO:tasks.workunit.client.0.smithi067.stdout:0/172: write d1/f3a [258699,8375] 0 2024-08-31T05:21:10.303 INFO:tasks.workunit.client.1.smithi073.stdout:5/992: symlink dc/d16/d3b/d3f/d4f/d98/df6/l148 0 2024-08-31T05:21:10.304 INFO:tasks.workunit.client.0.smithi067.stdout:6/219: rmdir d1b/d23/d2e 39 2024-08-31T05:21:10.305 INFO:tasks.workunit.client.1.smithi073.stdout:3/870: truncate da/d68/f6b 222572 0 2024-08-31T05:21:10.305 INFO:tasks.workunit.client.1.smithi073.stdout:7/790: dwrite d1/da/d3e/d22/d35/f9c [4194304,4194304] 0 2024-08-31T05:21:10.306 INFO:tasks.workunit.client.1.smithi073.stdout:9/889: link dc/de/d66/fbd dc/f11e 0 2024-08-31T05:21:10.306 INFO:tasks.workunit.client.1.smithi073.stdout:2/799: dwrite d2/d9/df/d43/fb7 [0,4194304] 0 2024-08-31T05:21:10.307 INFO:tasks.workunit.client.0.smithi067.stdout:6/220: truncate f7 1164610 0 2024-08-31T05:21:10.308 INFO:tasks.workunit.client.1.smithi073.stdout:7/791: fdatasync d1/da/d15/d33/d44/d60/f9b 0 2024-08-31T05:21:10.308 INFO:tasks.workunit.client.0.smithi067.stdout:2/87: chown f1 837103 1 2024-08-31T05:21:10.308 INFO:tasks.workunit.client.1.smithi073.stdout:0/813: creat d0/d15/d2c/d40/d4a/f114 x:0 0 0 2024-08-31T05:21:10.309 INFO:tasks.workunit.client.1.smithi073.stdout:2/800: write d2/d9/d66/d70/fbb [1191571,81434] 0 2024-08-31T05:21:10.309 INFO:tasks.workunit.client.0.smithi067.stdout:2/88: fdatasync db/dd/d13/f14 0 2024-08-31T05:21:10.309 INFO:tasks.workunit.client.0.smithi067.stdout:6/221: read - d1b/d23/d2e/f3d zero size 2024-08-31T05:21:10.313 INFO:tasks.workunit.client.1.smithi073.stdout:6/793: creat d15/d1a/d2b/d2f/d99/d9e/f104 x:0 0 0 2024-08-31T05:21:10.315 INFO:tasks.workunit.client.0.smithi067.stdout:2/89: read db/ff [703742,93225] 0 2024-08-31T05:21:10.316 INFO:tasks.workunit.client.1.smithi073.stdout:1/790: creat d5/d26/d54/db2/dd5/d32/daf/db1/fe9 x:0 0 0 2024-08-31T05:21:10.317 INFO:tasks.workunit.client.1.smithi073.stdout:3/871: dwrite da/d3c/d65/d87/fd5 [0,4194304] 0 2024-08-31T05:21:10.318 INFO:tasks.workunit.client.1.smithi073.stdout:1/791: write d5/d26/d54/db2/dd5/d3f/f7d [828914,48370] 0 2024-08-31T05:21:10.319 INFO:tasks.workunit.client.1.smithi073.stdout:3/872: readlink da/d3c/d67/lef 0 2024-08-31T05:21:10.319 INFO:tasks.workunit.client.1.smithi073.stdout:3/873: chown da/f29 7 1 2024-08-31T05:21:10.321 INFO:tasks.workunit.client.1.smithi073.stdout:3/874: write da/d3c/d65/d45/fa1 [2194040,57013] 0 2024-08-31T05:21:10.322 INFO:tasks.workunit.client.1.smithi073.stdout:4/726: link d7/db/f90 d7/df/d13/d53/fe6 0 2024-08-31T05:21:10.323 INFO:tasks.workunit.client.1.smithi073.stdout:4/727: write d7/df/fc2 [802946,36863] 0 2024-08-31T05:21:10.324 INFO:tasks.workunit.client.1.smithi073.stdout:4/728: chown d7/df/d13/d2e/d47/d4c/d73/f84 41587755 1 2024-08-31T05:21:10.325 INFO:tasks.workunit.client.1.smithi073.stdout:3/875: read da/d3c/d65/d45/dcd/d108/f4d [2991780,9646] 0 2024-08-31T05:21:10.326 INFO:tasks.workunit.client.1.smithi073.stdout:3/876: fsync da/f17 0 2024-08-31T05:21:10.328 INFO:tasks.workunit.client.1.smithi073.stdout:8/801: write d0/db/d1c/d2a/d58/f7a [719710,50126] 0 2024-08-31T05:21:10.329 INFO:tasks.workunit.client.1.smithi073.stdout:5/993: dread dc/f67 [0,4194304] 0 2024-08-31T05:21:10.332 INFO:tasks.workunit.client.0.smithi067.stdout:2/90: getdents db/dd 0 2024-08-31T05:21:10.332 INFO:tasks.workunit.client.1.smithi073.stdout:5/994: truncate dc/d16/d4e/fae 1020773 0 2024-08-31T05:21:10.333 INFO:tasks.workunit.client.1.smithi073.stdout:7/792: mkdir d1/da/d15/d33/d44/d60/de1/dfa 0 2024-08-31T05:21:10.333 INFO:tasks.workunit.client.1.smithi073.stdout:5/995: chown dc/d16/d3b/d7f/d99 12788960 1 2024-08-31T05:21:10.334 INFO:tasks.workunit.client.1.smithi073.stdout:2/801: symlink d2/d9/d27/d76/db5/lfd 0 2024-08-31T05:21:10.334 INFO:tasks.workunit.client.1.smithi073.stdout:9/890: dread dc/d27/fbf [0,4194304] 0 2024-08-31T05:21:10.335 INFO:tasks.workunit.client.0.smithi067.stdout:2/91: creat db/dd/f15 x:0 0 0 2024-08-31T05:21:10.336 INFO:tasks.workunit.client.0.smithi067.stdout:2/92: dread - db/dd/d13/f14 zero size 2024-08-31T05:21:10.337 INFO:tasks.workunit.client.1.smithi073.stdout:6/794: creat d15/d1a/d2b/d2f/d99/d9e/f105 x:0 0 0 2024-08-31T05:21:10.341 INFO:tasks.workunit.client.1.smithi073.stdout:7/793: dread d1/da/d15/d33/d44/d74/dd6/dea/f5b [0,4194304] 0 2024-08-31T05:21:10.341 INFO:tasks.workunit.client.1.smithi073.stdout:4/729: symlink d7/df/d13/d2e/d70/le7 0 2024-08-31T05:21:10.341 INFO:tasks.workunit.client.1.smithi073.stdout:9/891: dwrite dc/d37/d42/d8d/d52/d5f/f71 [0,4194304] 0 2024-08-31T05:21:10.342 INFO:tasks.workunit.client.1.smithi073.stdout:4/730: stat f5 0 2024-08-31T05:21:10.343 INFO:tasks.workunit.client.0.smithi067.stdout:2/93: getdents db/d12 0 2024-08-31T05:21:10.344 INFO:tasks.workunit.client.1.smithi073.stdout:9/892: write dc/d37/d42/d8d/d52/fe5 [734228,66237] 0 2024-08-31T05:21:10.346 INFO:tasks.workunit.client.1.smithi073.stdout:8/802: mknod d0/db/d44/d72/d75/d7e/d91/dac/cfc 0 2024-08-31T05:21:10.352 INFO:tasks.workunit.client.1.smithi073.stdout:9/893: dwrite dc/de/d66/d84/f90 [0,4194304] 0 2024-08-31T05:21:10.352 INFO:tasks.workunit.client.1.smithi073.stdout:8/803: dread d0/d62/f8d [0,4194304] 0 2024-08-31T05:21:10.353 INFO:tasks.workunit.client.0.smithi067.stdout:6/222: truncate d1b/d23/f2a 367996 0 2024-08-31T05:21:10.354 INFO:tasks.workunit.client.1.smithi073.stdout:2/802: readlink d2/d9/df/l8b 0 2024-08-31T05:21:10.356 INFO:tasks.workunit.client.1.smithi073.stdout:6/795: creat d15/d1a/d1e/d69/d7e/f106 x:0 0 0 2024-08-31T05:21:10.357 INFO:tasks.workunit.client.1.smithi073.stdout:0/814: dread d0/d28/f80 [0,4194304] 0 2024-08-31T05:21:10.358 INFO:tasks.workunit.client.0.smithi067.stdout:6/223: mkdir d1b/d23/d28/d45 0 2024-08-31T05:21:10.359 INFO:tasks.workunit.client.0.smithi067.stdout:6/224: stat d1b/d23/d2e/d3b/f3f 0 2024-08-31T05:21:10.363 INFO:tasks.workunit.client.0.smithi067.stdout:6/225: chown f19 15 1 2024-08-31T05:21:10.364 INFO:tasks.workunit.client.1.smithi073.stdout:7/794: chown d1/d11/c3f 0 1 2024-08-31T05:21:10.365 INFO:tasks.workunit.client.1.smithi073.stdout:4/731: unlink d7/d1a/d5c/d6d/d59/d86/fb7 0 2024-08-31T05:21:10.366 INFO:tasks.workunit.client.1.smithi073.stdout:7/795: fsync d1/d11/faf 0 2024-08-31T05:21:10.367 INFO:tasks.workunit.client.0.smithi067.stdout:6/226: creat d1b/d23/d28/f46 x:0 0 0 2024-08-31T05:21:10.367 INFO:tasks.workunit.client.1.smithi073.stdout:7/796: readlink d1/ld 0 2024-08-31T05:21:10.368 INFO:tasks.workunit.client.0.smithi067.stdout:6/227: chown d1b/l2c 4844 1 2024-08-31T05:21:10.368 INFO:tasks.workunit.client.1.smithi073.stdout:8/804: symlink d0/db/d44/d72/d79/lfd 0 2024-08-31T05:21:10.370 INFO:tasks.workunit.client.1.smithi073.stdout:0/815: dwrite d0/d15/f37 [0,4194304] 0 2024-08-31T05:21:10.371 INFO:tasks.workunit.client.0.smithi067.stdout:6/228: symlink d1b/l47 0 2024-08-31T05:21:10.371 INFO:tasks.workunit.client.1.smithi073.stdout:7/797: write d1/da/d3e/d22/d5c/fcd [1378607,123232] 0 2024-08-31T05:21:10.377 INFO:tasks.workunit.client.0.smithi067.stdout:2/94: dwrite f1 [0,4194304] 0 2024-08-31T05:21:10.377 INFO:tasks.workunit.client.0.smithi067.stdout:6/229: creat d1b/d23/d2e/d3b/f48 x:0 0 0 2024-08-31T05:21:10.379 INFO:tasks.workunit.client.0.smithi067.stdout:6/230: chown f18 86681699 1 2024-08-31T05:21:10.379 INFO:tasks.workunit.client.0.smithi067.stdout:6/231: chown c17 22 1 2024-08-31T05:21:10.381 INFO:tasks.workunit.client.0.smithi067.stdout:6/232: write d1b/d23/d2e/f3d [361294,107960] 0 2024-08-31T05:21:10.385 INFO:tasks.workunit.client.0.smithi067.stdout:6/233: rename c17 to d1b/d23/d2f/c49 0 2024-08-31T05:21:10.388 INFO:tasks.workunit.client.0.smithi067.stdout:2/95: creat db/d12/f16 x:0 0 0 2024-08-31T05:21:10.389 INFO:tasks.workunit.client.0.smithi067.stdout:2/96: chown db/dd/f11 3699 1 2024-08-31T05:21:10.389 INFO:tasks.workunit.client.0.smithi067.stdout:6/234: rmdir d1b 39 2024-08-31T05:21:10.393 INFO:tasks.workunit.client.0.smithi067.stdout:2/97: dread f1 [0,4194304] 0 2024-08-31T05:21:10.393 INFO:tasks.workunit.client.0.smithi067.stdout:2/98: read f4 [3625345,2025] 0 2024-08-31T05:21:10.400 INFO:tasks.workunit.client.0.smithi067.stdout:2/99: dwrite db/dd/d13/f14 [0,4194304] 0 2024-08-31T05:21:10.408 INFO:tasks.workunit.client.0.smithi067.stdout:2/100: dwrite db/dd/f11 [0,4194304] 0 2024-08-31T05:21:10.413 INFO:tasks.workunit.client.0.smithi067.stdout:2/101: creat db/dd/f17 x:0 0 0 2024-08-31T05:21:10.413 INFO:tasks.workunit.client.0.smithi067.stdout:2/102: stat db/ff 0 2024-08-31T05:21:10.415 INFO:tasks.workunit.client.0.smithi067.stdout:6/235: write f19 [1047836,63603] 0 2024-08-31T05:21:10.417 INFO:tasks.workunit.client.0.smithi067.stdout:2/103: creat db/dd/f18 x:0 0 0 2024-08-31T05:21:10.419 INFO:tasks.workunit.client.0.smithi067.stdout:6/236: dread - d1b/f43 zero size 2024-08-31T05:21:10.421 INFO:tasks.workunit.client.0.smithi067.stdout:2/104: dread db/dd/f11 [0,4194304] 0 2024-08-31T05:21:10.422 INFO:tasks.workunit.client.0.smithi067.stdout:6/237: mkdir d1b/d30/d4a 0 2024-08-31T05:21:10.425 INFO:tasks.workunit.client.1.smithi073.stdout:5/996: dread dc/d53/f68 [0,4194304] 0 2024-08-31T05:21:10.426 INFO:tasks.workunit.client.1.smithi073.stdout:3/877: dwrite da/d3c/d67/f6f [0,4194304] 0 2024-08-31T05:21:10.429 INFO:tasks.workunit.client.1.smithi073.stdout:5/997: truncate dc/d16/d3b/d3f/d4f/d98/f138 410100 0 2024-08-31T05:21:10.431 INFO:tasks.workunit.client.0.smithi067.stdout:1/74: sync 2024-08-31T05:21:10.432 INFO:tasks.workunit.client.0.smithi067.stdout:3/99: sync 2024-08-31T05:21:10.433 INFO:tasks.workunit.client.0.smithi067.stdout:1/75: write f2 [1301044,65520] 0 2024-08-31T05:21:10.433 INFO:tasks.workunit.client.0.smithi067.stdout:1/76: chown d3/f15 14513 1 2024-08-31T05:21:10.434 INFO:tasks.workunit.client.0.smithi067.stdout:1/77: chown d3/la 47745 1 2024-08-31T05:21:10.438 INFO:tasks.workunit.client.1.smithi073.stdout:9/894: dread dc/d37/d42/d8d/f4b [0,4194304] 0 2024-08-31T05:21:10.442 INFO:tasks.workunit.client.1.smithi073.stdout:2/803: dread d2/d9/d66/d70/f72 [0,4194304] 0 2024-08-31T05:21:10.447 INFO:tasks.workunit.client.0.smithi067.stdout:3/100: creat db/d12/d21/f26 x:0 0 0 2024-08-31T05:21:10.450 INFO:tasks.workunit.client.0.smithi067.stdout:1/78: unlink d3/f11 0 2024-08-31T05:21:10.451 INFO:tasks.workunit.client.0.smithi067.stdout:2/105: getdents db/dd 0 2024-08-31T05:21:10.456 INFO:tasks.workunit.client.0.smithi067.stdout:1/79: creat d3/dd/f1b x:0 0 0 2024-08-31T05:21:10.459 INFO:tasks.workunit.client.0.smithi067.stdout:2/106: dwrite db/dd/f15 [0,4194304] 0 2024-08-31T05:21:10.463 INFO:tasks.workunit.client.0.smithi067.stdout:1/80: creat d3/dd/f1c x:0 0 0 2024-08-31T05:21:10.465 INFO:tasks.workunit.client.1.smithi073.stdout:1/792: sync 2024-08-31T05:21:10.469 INFO:tasks.workunit.client.1.smithi073.stdout:4/732: mknod d7/df/d13/d53/ce8 0 2024-08-31T05:21:10.472 INFO:tasks.workunit.client.0.smithi067.stdout:6/238: dwrite f7 [0,4194304] 0 2024-08-31T05:21:10.477 INFO:tasks.workunit.client.1.smithi073.stdout:0/816: write d0/d69/d7f/d68/d91/df5/d3c/fd5 [1225574,19162] 0 2024-08-31T05:21:10.478 INFO:tasks.workunit.client.0.smithi067.stdout:2/107: fsync db/dd/f15 0 2024-08-31T05:21:10.479 INFO:tasks.workunit.client.0.smithi067.stdout:6/239: dwrite d1b/d23/d28/f39 [0,4194304] 0 2024-08-31T05:21:10.479 INFO:tasks.workunit.client.1.smithi073.stdout:7/798: rename d1/da/f72 to d1/da/d3e/d22/d6b/ddf/de2/ffb 0 2024-08-31T05:21:10.481 INFO:tasks.workunit.client.1.smithi073.stdout:3/878: mkdir da/d3c/d65/d45/dcd/d108/da2/daf/dbc/d117 0 2024-08-31T05:21:10.481 INFO:tasks.workunit.client.1.smithi073.stdout:7/799: fsync d1/da/d3e/d22/d47/f79 0 2024-08-31T05:21:10.483 INFO:tasks.workunit.client.1.smithi073.stdout:7/800: read d1/fdd [286567,37623] 0 2024-08-31T05:21:10.483 INFO:tasks.workunit.client.0.smithi067.stdout:2/108: symlink db/l19 0 2024-08-31T05:21:10.485 INFO:tasks.workunit.client.1.smithi073.stdout:0/817: dwrite d0/d69/d7f/d62/fa6 [0,4194304] 0 2024-08-31T05:21:10.485 INFO:tasks.workunit.client.0.smithi067.stdout:2/109: truncate db/dd/f17 115431 0 2024-08-31T05:21:10.487 INFO:tasks.workunit.client.1.smithi073.stdout:0/818: chown d0/d69/d7f/d68/d91/df5/d3c/d9c/de4/fc9 3078 1 2024-08-31T05:21:10.487 INFO:tasks.workunit.client.1.smithi073.stdout:0/819: stat d0/d15/d2c/d40/f5a 0 2024-08-31T05:21:10.488 INFO:tasks.workunit.client.0.smithi067.stdout:6/240: mknod d1b/d23/c4b 0 2024-08-31T05:21:10.489 INFO:tasks.workunit.client.0.smithi067.stdout:3/101: dwrite db/f10 [0,4194304] 0 2024-08-31T05:21:10.489 INFO:tasks.workunit.client.1.smithi073.stdout:1/793: stat d5/f9 0 2024-08-31T05:21:10.491 INFO:tasks.workunit.client.0.smithi067.stdout:2/110: unlink db/cc 0 2024-08-31T05:21:10.492 INFO:tasks.workunit.client.1.smithi073.stdout:6/796: creat d15/d41/f107 x:0 0 0 2024-08-31T05:21:10.496 INFO:tasks.workunit.client.0.smithi067.stdout:2/111: unlink db/dd/f18 0 2024-08-31T05:21:10.497 INFO:tasks.workunit.client.0.smithi067.stdout:2/112: fsync db/d12/f16 0 2024-08-31T05:21:10.498 INFO:tasks.workunit.client.0.smithi067.stdout:2/113: read db/dd/f15 [2416663,72253] 0 2024-08-31T05:21:10.498 INFO:tasks.workunit.client.0.smithi067.stdout:6/241: symlink d1b/l4c 0 2024-08-31T05:21:10.500 INFO:tasks.workunit.client.0.smithi067.stdout:3/102: unlink db/l13 0 2024-08-31T05:21:10.503 INFO:tasks.workunit.client.1.smithi073.stdout:3/879: fdatasync da/d3c/d65/d2c/d8e/f93 0 2024-08-31T05:21:10.504 INFO:tasks.workunit.client.0.smithi067.stdout:2/114: mkdir db/d12/d1a 0 2024-08-31T05:21:10.505 INFO:tasks.workunit.client.1.smithi073.stdout:7/801: write d1/da/d65/ff0 [2005151,123323] 0 2024-08-31T05:21:10.505 INFO:tasks.workunit.client.0.smithi067.stdout:2/115: fdatasync db/d12/f16 0 2024-08-31T05:21:10.505 INFO:tasks.workunit.client.1.smithi073.stdout:7/802: readlink d1/d11/d91/laa 0 2024-08-31T05:21:10.506 INFO:tasks.workunit.client.0.smithi067.stdout:2/116: read db/dd/f17 [24508,53078] 0 2024-08-31T05:21:10.506 INFO:tasks.workunit.client.1.smithi073.stdout:7/803: fsync d1/da/f98 0 2024-08-31T05:21:10.506 INFO:tasks.workunit.client.1.smithi073.stdout:7/804: write d1/d11/f8d [411952,107151] 0 2024-08-31T05:21:10.507 INFO:tasks.workunit.client.1.smithi073.stdout:2/804: rmdir d2/d9/d7f/dab/d5d/d82 39 2024-08-31T05:21:10.508 INFO:tasks.workunit.client.1.smithi073.stdout:7/805: write d1/da/d3e/d22/d35/d83/fc1 [869169,34419] 0 2024-08-31T05:21:10.509 INFO:tasks.workunit.client.0.smithi067.stdout:6/242: fsync f3 0 2024-08-31T05:21:10.513 INFO:tasks.workunit.client.0.smithi067.stdout:3/103: write db/d12/d21/f25 [1574849,95582] 0 2024-08-31T05:21:10.515 INFO:tasks.workunit.client.0.smithi067.stdout:2/117: symlink db/l1b 0 2024-08-31T05:21:10.516 INFO:tasks.workunit.client.0.smithi067.stdout:2/118: stat l8 0 2024-08-31T05:21:10.516 INFO:tasks.workunit.client.1.smithi073.stdout:5/998: creat dc/d16/d1a/db7/f149 x:0 0 0 2024-08-31T05:21:10.517 INFO:tasks.workunit.client.0.smithi067.stdout:6/243: dwrite d1b/f43 [0,4194304] 0 2024-08-31T05:21:10.518 INFO:tasks.workunit.client.1.smithi073.stdout:5/999: dread - dc/d16/d3b/dc6/f126 zero size 2024-08-31T05:21:10.519 INFO:tasks.workunit.client.0.smithi067.stdout:3/104: mkdir db/d27 0 2024-08-31T05:21:10.520 INFO:tasks.workunit.client.1.smithi073.stdout:1/794: dwrite d5/d26/da5/dba/d33/d13/d7e/fae [0,4194304] 0 2024-08-31T05:21:10.520 INFO:tasks.workunit.client.1.smithi073.stdout:3/880: truncate da/d3c/d65/d40/d5d/dd2/f101 4411829 0 2024-08-31T05:21:10.521 INFO:tasks.workunit.client.1.smithi073.stdout:3/881: readlink da/d3c/d65/d45/ld8 0 2024-08-31T05:21:10.523 INFO:tasks.workunit.client.1.smithi073.stdout:3/882: readlink da/d3c/d5a/db8/le8 0 2024-08-31T05:21:10.525 INFO:tasks.workunit.client.0.smithi067.stdout:2/119: creat db/d12/f1c x:0 0 0 2024-08-31T05:21:10.529 INFO:tasks.workunit.client.0.smithi067.stdout:6/244: creat d1b/d23/d28/f4d x:0 0 0 2024-08-31T05:21:10.529 INFO:tasks.workunit.client.1.smithi073.stdout:2/805: dwrite d2/f4f [0,4194304] 0 2024-08-31T05:21:10.530 INFO:tasks.workunit.client.0.smithi067.stdout:3/105: rename db/fc to db/d27/f28 0 2024-08-31T05:21:10.531 INFO:tasks.workunit.client.1.smithi073.stdout:8/805: sync 2024-08-31T05:21:10.533 INFO:tasks.workunit.client.1.smithi073.stdout:6/797: getdents d15/d1a/d2b/d2f/d4b/d97/de3 0 2024-08-31T05:21:10.535 INFO:tasks.workunit.client.1.smithi073.stdout:2/806: read d2/d25/fac [1107555,129179] 0 2024-08-31T05:21:10.535 INFO:tasks.workunit.client.1.smithi073.stdout:9/895: getdents dc/d37/d42 0 2024-08-31T05:21:10.537 INFO:tasks.workunit.client.1.smithi073.stdout:2/807: chown d2/d9/d7f/dab/f42 26091704 1 2024-08-31T05:21:10.539 INFO:tasks.workunit.client.1.smithi073.stdout:1/795: creat d5/d26/da5/dba/d1c/d27/fea x:0 0 0 2024-08-31T05:21:10.540 INFO:tasks.workunit.client.1.smithi073.stdout:1/796: fsync d5/d26/d54/db2/dd5/d32/daf/db1/fd7 0 2024-08-31T05:21:10.540 INFO:tasks.workunit.client.1.smithi073.stdout:3/883: unlink da/d3c/d65/d40/fa4 0 2024-08-31T05:21:10.541 INFO:tasks.workunit.client.1.smithi073.stdout:3/884: chown da/d3c/d5a/la9 15305 1 2024-08-31T05:21:10.541 INFO:tasks.workunit.client.0.smithi067.stdout:2/120: dwrite db/dd/f17 [0,4194304] 0 2024-08-31T05:21:10.541 INFO:tasks.workunit.client.0.smithi067.stdout:6/245: creat d1b/d30/d4a/f4e x:0 0 0 2024-08-31T05:21:10.542 INFO:tasks.workunit.client.1.smithi073.stdout:3/885: write da/d3c/f10d [503266,80077] 0 2024-08-31T05:21:10.543 INFO:tasks.workunit.client.1.smithi073.stdout:3/886: stat da/d3c/d65/d40/c4b 0 2024-08-31T05:21:10.546 INFO:tasks.workunit.client.1.smithi073.stdout:0/820: creat d0/d15/d2c/f115 x:0 0 0 2024-08-31T05:21:10.548 INFO:tasks.workunit.client.0.smithi067.stdout:2/121: truncate f4 640271 0 2024-08-31T05:21:10.549 INFO:tasks.workunit.client.1.smithi073.stdout:6/798: creat d15/d1a/d2b/d2f/d99/f108 x:0 0 0 2024-08-31T05:21:10.554 INFO:tasks.workunit.client.1.smithi073.stdout:0/821: creat d0/d15/d9b/f116 x:0 0 0 2024-08-31T05:21:10.554 INFO:tasks.workunit.client.1.smithi073.stdout:4/733: sync 2024-08-31T05:21:10.555 INFO:tasks.workunit.client.0.smithi067.stdout:2/122: getdents db/dd 0 2024-08-31T05:21:10.561 INFO:tasks.workunit.client.1.smithi073.stdout:0/822: write d0/d28/f2d [3048049,82219] 0 2024-08-31T05:21:10.562 INFO:tasks.workunit.client.1.smithi073.stdout:6/799: symlink d15/d17/da1/dae/db0/l109 0 2024-08-31T05:21:10.565 INFO:tasks.workunit.client.1.smithi073.stdout:2/808: creat d2/d9/d7f/ffe x:0 0 0 2024-08-31T05:21:10.567 INFO:tasks.workunit.client.1.smithi073.stdout:0/823: dwrite d0/d15/d2c/d40/d4a/f4b [4194304,4194304] 0 2024-08-31T05:21:10.567 INFO:tasks.workunit.client.1.smithi073.stdout:4/734: rename d7/l61 to d7/d1a/d5c/d6d/d2c/d2d/da6/le9 0 2024-08-31T05:21:10.572 INFO:tasks.workunit.client.1.smithi073.stdout:7/806: dwrite d1/da/d15/d33/d44/f66 [0,4194304] 0 2024-08-31T05:21:10.572 INFO:tasks.workunit.client.1.smithi073.stdout:9/896: link dc/de/d56/lca dc/de/d11/l11f 0 2024-08-31T05:21:10.574 INFO:tasks.workunit.client.0.smithi067.stdout:6/246: dwrite d1b/f21 [0,4194304] 0 2024-08-31T05:21:10.574 INFO:tasks.workunit.client.1.smithi073.stdout:1/797: getdents d5/d26/da5/dba/d1b 0 2024-08-31T05:21:10.575 INFO:tasks.workunit.client.1.smithi073.stdout:3/887: write da/f10 [2807169,94774] 0 2024-08-31T05:21:10.575 INFO:tasks.workunit.client.1.smithi073.stdout:2/809: rename d2/d9 to d2/d9/d27/d9b/da6/ddd/dff 22 2024-08-31T05:21:10.575 INFO:tasks.workunit.client.1.smithi073.stdout:9/897: chown dc/d37/d42/d8d/d52/d5f/la3 83645 1 2024-08-31T05:21:10.579 INFO:tasks.workunit.client.1.smithi073.stdout:8/806: write d0/db/d1c/d2a/f30 [876702,104165] 0 2024-08-31T05:21:10.581 INFO:tasks.workunit.client.1.smithi073.stdout:8/807: write d0/f27 [2068275,62987] 0 2024-08-31T05:21:10.582 INFO:tasks.workunit.client.1.smithi073.stdout:7/807: dwrite d1/da/d65/f7e [0,4194304] 0 2024-08-31T05:21:10.584 INFO:tasks.workunit.client.1.smithi073.stdout:7/808: chown d1/d11/fef 1912743 1 2024-08-31T05:21:10.586 INFO:tasks.workunit.client.1.smithi073.stdout:1/798: symlink d5/d26/d54/db2/dd5/d2a/d80/d93/leb 0 2024-08-31T05:21:10.586 INFO:tasks.workunit.client.1.smithi073.stdout:9/898: dread dc/d37/d42/d8d/d52/d5f/f71 [0,4194304] 0 2024-08-31T05:21:10.588 INFO:tasks.workunit.client.1.smithi073.stdout:2/810: creat d2/d9/df/d43/d88/f100 x:0 0 0 2024-08-31T05:21:10.593 INFO:tasks.workunit.client.1.smithi073.stdout:9/899: fdatasync dc/de/d56/f7d 0 2024-08-31T05:21:10.593 INFO:tasks.workunit.client.1.smithi073.stdout:2/811: chown d2/d9/ff6 63941 1 2024-08-31T05:21:10.594 INFO:tasks.workunit.client.1.smithi073.stdout:0/824: mknod d0/c117 0 2024-08-31T05:21:10.594 INFO:tasks.workunit.client.1.smithi073.stdout:0/825: readlink d0/d15/d2c/lfb 0 2024-08-31T05:21:10.595 INFO:tasks.workunit.client.1.smithi073.stdout:0/826: fdatasync d0/d15/d2c/f115 0 2024-08-31T05:21:10.596 INFO:tasks.workunit.client.1.smithi073.stdout:7/809: creat d1/da/db2/ffc x:0 0 0 2024-08-31T05:21:10.597 INFO:tasks.workunit.client.1.smithi073.stdout:7/810: chown d1/d11/f64 40931367 1 2024-08-31T05:21:10.598 INFO:tasks.workunit.client.1.smithi073.stdout:8/808: rename d0/db/d1c/d34/l5d to d0/db/d1c/d34/d68/d9d/lfe 0 2024-08-31T05:21:10.599 INFO:tasks.workunit.client.1.smithi073.stdout:8/809: chown d0/db/d1c/d34/d68 504697 1 2024-08-31T05:21:10.599 INFO:tasks.workunit.client.0.smithi067.stdout:2/123: dwrite f4 [0,4194304] 0 2024-08-31T05:21:10.599 INFO:tasks.workunit.client.1.smithi073.stdout:3/888: mkdir da/d3c/d65/d2c/d8e/dc2/d110/d118 0 2024-08-31T05:21:10.600 INFO:tasks.workunit.client.0.smithi067.stdout:6/247: truncate d1b/f21 2554238 0 2024-08-31T05:21:10.600 INFO:tasks.workunit.client.0.smithi067.stdout:2/124: read db/dd/f17 [1615980,103] 0 2024-08-31T05:21:10.604 INFO:tasks.workunit.client.0.smithi067.stdout:6/248: dread f7 [0,4194304] 0 2024-08-31T05:21:10.606 INFO:tasks.workunit.client.0.smithi067.stdout:6/249: write d1b/f20 [4395943,128263] 0 2024-08-31T05:21:10.606 INFO:tasks.workunit.client.1.smithi073.stdout:3/889: dwrite da/f2f [0,4194304] 0 2024-08-31T05:21:10.609 INFO:tasks.workunit.client.0.smithi067.stdout:2/125: unlink c6 0 2024-08-31T05:21:10.611 INFO:tasks.workunit.client.1.smithi073.stdout:4/735: truncate d7/df/f56 780855 0 2024-08-31T05:21:10.614 INFO:tasks.workunit.client.1.smithi073.stdout:2/812: dread d2/d9/d3c/fc5 [0,4194304] 0 2024-08-31T05:21:10.614 INFO:tasks.workunit.client.1.smithi073.stdout:6/800: getdents d15/d1a/d1e 0 2024-08-31T05:21:10.619 INFO:tasks.workunit.client.1.smithi073.stdout:7/811: truncate d1/da/d15/fe7 734706 0 2024-08-31T05:21:10.620 INFO:tasks.workunit.client.1.smithi073.stdout:7/812: chown d1/da/d15/d33/d44/d74/dd6/de6/l40 1910 1 2024-08-31T05:21:10.621 INFO:tasks.workunit.client.1.smithi073.stdout:8/810: mkdir d0/da8/dff 0 2024-08-31T05:21:10.622 INFO:tasks.workunit.client.0.smithi067.stdout:2/126: fdatasync f1 0 2024-08-31T05:21:10.622 INFO:tasks.workunit.client.0.smithi067.stdout:2/127: fdatasync db/dd/f15 0 2024-08-31T05:21:10.625 INFO:tasks.workunit.client.1.smithi073.stdout:9/900: dread dc/d37/db5/dc1/fed [0,4194304] 0 2024-08-31T05:21:10.627 INFO:tasks.workunit.client.1.smithi073.stdout:1/799: rename d5/d26/d54/db2/dd5/d32/d37/d6f/dc7/ld2 to d5/d26/d54/db2/dd5/d32/daf/lec 0 2024-08-31T05:21:10.630 INFO:tasks.workunit.client.0.smithi067.stdout:2/128: creat db/dd/f1d x:0 0 0 2024-08-31T05:21:10.631 INFO:tasks.workunit.client.1.smithi073.stdout:3/890: dread da/d3c/d65/d45/dcd/d108/da2/fc4 [0,4194304] 0 2024-08-31T05:21:10.631 INFO:tasks.workunit.client.0.smithi067.stdout:6/250: creat d1b/d23/f4f x:0 0 0 2024-08-31T05:21:10.634 INFO:tasks.workunit.client.0.smithi067.stdout:2/129: unlink l8 0 2024-08-31T05:21:10.635 INFO:tasks.workunit.client.1.smithi073.stdout:6/801: creat d15/d1a/d51/d6e/ddb/f10a x:0 0 0 2024-08-31T05:21:10.637 INFO:tasks.workunit.client.1.smithi073.stdout:0/827: mknod d0/d69/d7f/d68/d91/df5/d3c/d9c/db6/dc6/c118 0 2024-08-31T05:21:10.639 INFO:tasks.workunit.client.0.smithi067.stdout:2/130: dwrite f1 [0,4194304] 0 2024-08-31T05:21:10.641 INFO:tasks.workunit.client.0.smithi067.stdout:6/251: link d1b/d23/c26 d1b/d40/c50 0 2024-08-31T05:21:10.641 INFO:tasks.workunit.client.0.smithi067.stdout:2/131: write db/d12/f1c [689963,93752] 0 2024-08-31T05:21:10.641 INFO:tasks.workunit.client.0.smithi067.stdout:2/132: stat f4 0 2024-08-31T05:21:10.642 INFO:tasks.workunit.client.0.smithi067.stdout:2/133: write db/dd/f15 [1043118,95131] 0 2024-08-31T05:21:10.643 INFO:tasks.workunit.client.0.smithi067.stdout:2/134: readlink db/l1b 0 2024-08-31T05:21:10.646 INFO:tasks.workunit.client.0.smithi067.stdout:6/252: rename d1b/d23/d2e/d3b/f3f to d1b/d23/d2e/f51 0 2024-08-31T05:21:10.649 INFO:tasks.workunit.client.1.smithi073.stdout:2/813: link d2/d9/d7f/ffe d2/d9/d7f/dab/dc4/f101 0 2024-08-31T05:21:10.652 INFO:tasks.workunit.client.1.smithi073.stdout:8/811: fsync d0/db/d1c/f20 0 2024-08-31T05:21:10.653 INFO:tasks.workunit.client.1.smithi073.stdout:8/812: fsync d0/db/d44/d72/d75/d7e/d91/f97 0 2024-08-31T05:21:10.654 INFO:tasks.workunit.client.1.smithi073.stdout:9/901: mknod dc/de/c120 0 2024-08-31T05:21:10.657 INFO:tasks.workunit.client.1.smithi073.stdout:4/736: fdatasync d7/df/f56 0 2024-08-31T05:21:10.660 INFO:tasks.workunit.client.1.smithi073.stdout:7/813: dread d1/da/d15/d33/d44/d74/dd6/de6/f4c [0,4194304] 0 2024-08-31T05:21:10.662 INFO:tasks.workunit.client.1.smithi073.stdout:7/814: chown d1/da/d3e/d22/d35/d83/l89 0 1 2024-08-31T05:21:10.662 INFO:tasks.workunit.client.1.smithi073.stdout:3/891: dwrite da/ff [0,4194304] 0 2024-08-31T05:21:10.664 INFO:tasks.workunit.client.1.smithi073.stdout:7/815: fsync d1/d11/f64 0 2024-08-31T05:21:10.664 INFO:tasks.workunit.client.1.smithi073.stdout:9/902: creat dc/de/d66/f121 x:0 0 0 2024-08-31T05:21:10.664 INFO:tasks.workunit.client.1.smithi073.stdout:7/816: chown d1/da/f26 274454 1 2024-08-31T05:21:10.668 INFO:tasks.workunit.client.1.smithi073.stdout:3/892: truncate da/f14 8787302 0 2024-08-31T05:21:10.668 INFO:tasks.workunit.client.1.smithi073.stdout:6/802: write d15/d17/da1/dae/db0/d38/f62 [4230547,102509] 0 2024-08-31T05:21:10.669 INFO:tasks.workunit.client.1.smithi073.stdout:1/800: getdents d5/d26/d54 0 2024-08-31T05:21:10.670 INFO:tasks.workunit.client.1.smithi073.stdout:9/903: creat dc/d37/d42/d5a/da0/f122 x:0 0 0 2024-08-31T05:21:10.672 INFO:tasks.workunit.client.1.smithi073.stdout:0/828: dwrite d0/f1a [0,4194304] 0 2024-08-31T05:21:10.672 INFO:tasks.workunit.client.1.smithi073.stdout:8/813: creat d0/db/d1c/f100 x:0 0 0 2024-08-31T05:21:10.673 INFO:tasks.workunit.client.1.smithi073.stdout:7/817: mknod d1/da/d96/cfd 0 2024-08-31T05:21:10.678 INFO:tasks.workunit.client.1.smithi073.stdout:7/818: write d1/da/d65/f7e [3656239,42842] 0 2024-08-31T05:21:10.678 INFO:tasks.workunit.client.1.smithi073.stdout:3/893: write da/d3c/d65/d45/dcd/d108/f4d [3525418,33865] 0 2024-08-31T05:21:10.678 INFO:tasks.workunit.client.1.smithi073.stdout:8/814: symlink d0/d62/l101 0 2024-08-31T05:21:10.680 INFO:tasks.workunit.client.1.smithi073.stdout:1/801: rename d5/d26/da5/dba/d1c/d27/d51 to d5/d26/da5/dba/d1c/d27/ded 0 2024-08-31T05:21:10.681 INFO:tasks.workunit.client.1.smithi073.stdout:8/815: rmdir d0/db/d44/d4e/df3 39 2024-08-31T05:21:10.684 INFO:tasks.workunit.client.1.smithi073.stdout:0/829: dwrite d0/d69/d7f/d62/dbf/fe3 [0,4194304] 0 2024-08-31T05:21:10.684 INFO:tasks.workunit.client.1.smithi073.stdout:3/894: mknod da/d3c/d65/d45/dcd/d108/d10a/c119 0 2024-08-31T05:21:10.685 INFO:tasks.workunit.client.1.smithi073.stdout:7/819: dread d1/d11/fde [0,4194304] 0 2024-08-31T05:21:10.687 INFO:tasks.workunit.client.1.smithi073.stdout:8/816: chown d0/db/d1c/c25 9437 1 2024-08-31T05:21:10.688 INFO:tasks.workunit.client.1.smithi073.stdout:7/820: mknod d1/da/d3e/cfe 0 2024-08-31T05:21:10.689 INFO:tasks.workunit.client.1.smithi073.stdout:0/830: mknod d0/d28/c119 0 2024-08-31T05:21:10.690 INFO:tasks.workunit.client.1.smithi073.stdout:8/817: dread - d0/db/d44/d9e/fef zero size 2024-08-31T05:21:10.691 INFO:tasks.workunit.client.1.smithi073.stdout:3/895: fdatasync da/f61 0 2024-08-31T05:21:10.692 INFO:tasks.workunit.client.1.smithi073.stdout:1/802: dwrite d5/d26/da5/dba/d1c/d27/f9a [0,4194304] 0 2024-08-31T05:21:10.693 INFO:tasks.workunit.client.1.smithi073.stdout:3/896: read - da/d3c/d82/d95/ff4 zero size 2024-08-31T05:21:10.695 INFO:tasks.workunit.client.1.smithi073.stdout:8/818: mknod d0/db/c102 0 2024-08-31T05:21:10.696 INFO:tasks.workunit.client.1.smithi073.stdout:1/803: mknod d5/d26/d54/d55/cee 0 2024-08-31T05:21:10.698 INFO:tasks.workunit.client.1.smithi073.stdout:0/831: symlink d0/d69/d10a/l11a 0 2024-08-31T05:21:10.699 INFO:tasks.workunit.client.1.smithi073.stdout:3/897: fsync da/d3c/d65/ffa 0 2024-08-31T05:21:10.700 INFO:tasks.workunit.client.1.smithi073.stdout:7/821: getdents d1/da/d3e/d22/d6b/ddf 0 2024-08-31T05:21:10.701 INFO:tasks.workunit.client.1.smithi073.stdout:0/832: readlink d0/d69/d7f/l75 0 2024-08-31T05:21:10.701 INFO:tasks.workunit.client.1.smithi073.stdout:1/804: unlink d5/d26/d54/db2/dd5/d5d/ccf 0 2024-08-31T05:21:10.703 INFO:tasks.workunit.client.1.smithi073.stdout:0/833: chown d0/d69/fa8 3 1 2024-08-31T05:21:10.703 INFO:tasks.workunit.client.1.smithi073.stdout:3/898: write da/d3c/d65/d2c/f48 [4580987,115899] 0 2024-08-31T05:21:10.704 INFO:tasks.workunit.client.1.smithi073.stdout:8/819: dwrite d0/db/fc5 [0,4194304] 0 2024-08-31T05:21:10.707 INFO:tasks.workunit.client.1.smithi073.stdout:8/820: write d0/f27 [2423010,67164] 0 2024-08-31T05:21:10.707 INFO:tasks.workunit.client.1.smithi073.stdout:0/834: symlink d0/d28/l11b 0 2024-08-31T05:21:10.708 INFO:tasks.workunit.client.1.smithi073.stdout:8/821: dread - d0/db/d44/d9e/fef zero size 2024-08-31T05:21:10.713 INFO:tasks.workunit.client.1.smithi073.stdout:3/899: truncate da/d3c/d65/d40/f44 121237 0 2024-08-31T05:21:10.715 INFO:tasks.workunit.client.1.smithi073.stdout:0/835: mkdir d0/d69/d11c 0 2024-08-31T05:21:10.716 INFO:tasks.workunit.client.1.smithi073.stdout:1/805: getdents d5/d26/d54/db2/dd5/d32 0 2024-08-31T05:21:10.717 INFO:tasks.workunit.client.1.smithi073.stdout:7/822: link d1/da/d3e/d22/d5c/c5d d1/da/d3e/d22/d6b/ddf/de2/cff 0 2024-08-31T05:21:10.718 INFO:tasks.workunit.client.1.smithi073.stdout:8/822: symlink d0/db/d44/d72/l103 0 2024-08-31T05:21:10.718 INFO:tasks.workunit.client.1.smithi073.stdout:0/836: symlink d0/d69/d7f/l11d 0 2024-08-31T05:21:10.720 INFO:tasks.workunit.client.1.smithi073.stdout:0/837: chown d0/d15/d2c/d40/d4a/f114 250673 1 2024-08-31T05:21:10.721 INFO:tasks.workunit.client.1.smithi073.stdout:1/806: creat d5/d26/d54/d9e/fef x:0 0 0 2024-08-31T05:21:10.724 INFO:tasks.workunit.client.1.smithi073.stdout:0/838: truncate d0/d15/d2c/fd1 616094 0 2024-08-31T05:21:10.725 INFO:tasks.workunit.client.1.smithi073.stdout:0/839: chown d0/d69/d10a 338619 1 2024-08-31T05:21:10.725 INFO:tasks.workunit.client.1.smithi073.stdout:1/807: stat d5/d26/d54/d55/cc9 0 2024-08-31T05:21:10.726 INFO:tasks.workunit.client.1.smithi073.stdout:8/823: mknod d0/db/d44/d4e/c104 0 2024-08-31T05:21:10.727 INFO:tasks.workunit.client.1.smithi073.stdout:7/823: write d1/da/d15/d33/f42 [2811046,11346] 0 2024-08-31T05:21:10.728 INFO:tasks.workunit.client.1.smithi073.stdout:0/840: write d0/d69/d8e/d99/fa9 [2610686,74985] 0 2024-08-31T05:21:10.728 INFO:tasks.workunit.client.1.smithi073.stdout:3/900: dwrite da/d3c/d82/d97/fd0 [0,4194304] 0 2024-08-31T05:21:10.731 INFO:tasks.workunit.client.1.smithi073.stdout:1/808: chown d5/d26/d54/db2/dd5/d2a/d80/d93/fcd 201 1 2024-08-31T05:21:10.731 INFO:tasks.workunit.client.1.smithi073.stdout:3/901: write da/f10 [8337153,45023] 0 2024-08-31T05:21:10.733 INFO:tasks.workunit.client.1.smithi073.stdout:7/824: dread d1/d11/f64 [0,4194304] 0 2024-08-31T05:21:10.737 INFO:tasks.workunit.client.1.smithi073.stdout:1/809: creat d5/d26/d54/db2/dd5/d32/d37/d6f/dc7/ff0 x:0 0 0 2024-08-31T05:21:10.739 INFO:tasks.workunit.client.1.smithi073.stdout:3/902: rename da/d3c/d5a/ce7 to da/d3c/d65/d45/dcd/d108/ded/c11a 0 2024-08-31T05:21:10.740 INFO:tasks.workunit.client.1.smithi073.stdout:8/824: link d0/db/d1c/d2a/lf5 d0/db/d44/d9e/l105 0 2024-08-31T05:21:10.740 INFO:tasks.workunit.client.1.smithi073.stdout:0/841: write d0/d69/fa8 [605291,15832] 0 2024-08-31T05:21:10.741 INFO:tasks.workunit.client.1.smithi073.stdout:7/825: read d1/da/d15/d33/d44/d60/f9b [1645994,92305] 0 2024-08-31T05:21:10.741 INFO:tasks.workunit.client.1.smithi073.stdout:1/810: mkdir d5/d26/d54/db2/dd5/d32/d37/d6f/dc7/df1 0 2024-08-31T05:21:10.742 INFO:tasks.workunit.client.1.smithi073.stdout:3/903: rmdir da/d3c/d5a/d8a 39 2024-08-31T05:21:10.743 INFO:tasks.workunit.client.1.smithi073.stdout:8/825: mkdir d0/db/d1c/d34/d38/d106 0 2024-08-31T05:21:10.743 INFO:tasks.workunit.client.1.smithi073.stdout:0/842: symlink d0/d69/d7f/d68/d91/df5/d3c/d9c/dc8/l11e 0 2024-08-31T05:21:10.743 INFO:tasks.workunit.client.1.smithi073.stdout:8/826: truncate d0/da8/fde 325913 0 2024-08-31T05:21:10.744 INFO:tasks.workunit.client.1.smithi073.stdout:3/904: symlink da/d3c/d65/d2c/l11b 0 2024-08-31T05:21:10.745 INFO:tasks.workunit.client.1.smithi073.stdout:0/843: chown d0/d15/d2c/l59 2017 1 2024-08-31T05:21:10.754 INFO:tasks.workunit.client.0.smithi067.stdout:6/253: symlink d1b/d30/l52 0 2024-08-31T05:21:10.758 INFO:tasks.workunit.client.0.smithi067.stdout:2/135: dwrite db/dd/f17 [0,4194304] 0 2024-08-31T05:21:10.758 INFO:tasks.workunit.client.0.smithi067.stdout:2/136: chown db 1430601 1 2024-08-31T05:21:10.760 INFO:tasks.workunit.client.0.smithi067.stdout:6/254: dwrite d1b/d23/d2f/f42 [4194304,4194304] 0 2024-08-31T05:21:10.761 INFO:tasks.workunit.client.0.smithi067.stdout:6/255: fsync d1b/d23/d28/f39 0 2024-08-31T05:21:10.762 INFO:tasks.workunit.client.0.smithi067.stdout:2/137: mkdir db/d12/d1a/d1e 0 2024-08-31T05:21:10.764 INFO:tasks.workunit.client.0.smithi067.stdout:6/256: mknod d1b/d40/c53 0 2024-08-31T05:21:10.765 INFO:tasks.workunit.client.0.smithi067.stdout:6/257: readlink d1b/l47 0 2024-08-31T05:21:10.768 INFO:tasks.workunit.client.0.smithi067.stdout:2/138: link db/dd/f15 db/d12/d1a/f1f 0 2024-08-31T05:21:10.769 INFO:tasks.workunit.client.0.smithi067.stdout:6/258: rmdir d1b/d23/d2f 39 2024-08-31T05:21:10.770 INFO:tasks.workunit.client.0.smithi067.stdout:6/259: write d1b/d23/d2e/f38 [2523718,121192] 0 2024-08-31T05:21:10.773 INFO:tasks.workunit.client.0.smithi067.stdout:6/260: rename ff to d1b/d23/d2e/f54 0 2024-08-31T05:21:10.775 INFO:tasks.workunit.client.0.smithi067.stdout:2/139: dwrite db/dd/d13/f14 [0,4194304] 0 2024-08-31T05:21:10.776 INFO:tasks.workunit.client.0.smithi067.stdout:2/140: chown db/le 3483191 1 2024-08-31T05:21:10.779 INFO:tasks.workunit.client.0.smithi067.stdout:2/141: creat db/d12/d1a/f20 x:0 0 0 2024-08-31T05:21:10.779 INFO:tasks.workunit.client.0.smithi067.stdout:6/261: dread d1b/f43 [0,4194304] 0 2024-08-31T05:21:10.786 INFO:tasks.workunit.client.1.smithi073.stdout:3/905: chown da/d3c/d65/d2c/d8e/dc2/d110 345380 1 2024-08-31T05:21:10.787 INFO:tasks.workunit.client.1.smithi073.stdout:0/844: write d0/d69/d7f/d62/dbf/fe3 [841208,3451] 0 2024-08-31T05:21:10.787 INFO:tasks.workunit.client.1.smithi073.stdout:1/811: getdents d5/d26/da5/dba/d1c/d27 0 2024-08-31T05:21:10.788 INFO:tasks.workunit.client.0.smithi067.stdout:2/142: dwrite f4 [0,4194304] 0 2024-08-31T05:21:10.788 INFO:tasks.workunit.client.1.smithi073.stdout:1/812: chown d5/d26/da5/dba/d33/d13/lcb 252113841 1 2024-08-31T05:21:10.789 INFO:tasks.workunit.client.0.smithi067.stdout:6/262: dwrite d1b/d23/d28/f4d [0,4194304] 0 2024-08-31T05:21:10.789 INFO:tasks.workunit.client.1.smithi073.stdout:8/827: creat d0/db/d1c/d34/d80/d9a/de5/f107 x:0 0 0 2024-08-31T05:21:10.790 INFO:tasks.workunit.client.0.smithi067.stdout:6/263: read d1b/f20 [459683,103814] 0 2024-08-31T05:21:10.791 INFO:tasks.workunit.client.1.smithi073.stdout:1/813: write d5/d26/d54/db2/dd5/d3f/f96 [1573906,36090] 0 2024-08-31T05:21:10.791 INFO:tasks.workunit.client.1.smithi073.stdout:8/828: dread - d0/db/d44/d9e/fef zero size 2024-08-31T05:21:10.799 INFO:tasks.workunit.client.1.smithi073.stdout:1/814: creat d5/d26/d54/db2/dd5/d5d/d61/ff2 x:0 0 0 2024-08-31T05:21:10.800 INFO:tasks.workunit.client.0.smithi067.stdout:2/143: creat db/d12/d1a/d1e/f21 x:0 0 0 2024-08-31T05:21:10.801 INFO:tasks.workunit.client.1.smithi073.stdout:1/815: chown d5/d26/d54/db2/dd5/d2a/d80/fd0 776540 1 2024-08-31T05:21:10.801 INFO:tasks.workunit.client.1.smithi073.stdout:8/829: creat d0/db/d1c/d34/d38/f108 x:0 0 0 2024-08-31T05:21:10.806 INFO:tasks.workunit.client.0.smithi067.stdout:2/144: mknod db/d12/d1a/d1e/c22 0 2024-08-31T05:21:10.807 INFO:tasks.workunit.client.1.smithi073.stdout:3/906: creat da/d3c/d65/f11c x:0 0 0 2024-08-31T05:21:10.808 INFO:tasks.workunit.client.1.smithi073.stdout:8/830: rmdir d0/db/d44/d72/d75/d7e/d91 39 2024-08-31T05:21:10.810 INFO:tasks.workunit.client.1.smithi073.stdout:1/816: rename d5/d26/d54/db2/dd5/d32/d37/f8e to d5/d26/d54/db2/dd5/d32/d37/ff3 0 2024-08-31T05:21:10.810 INFO:tasks.workunit.client.1.smithi073.stdout:0/845: link d0/d15/d2c/lfb d0/d69/d7f/d68/d91/l11f 0 2024-08-31T05:21:10.811 INFO:tasks.workunit.client.1.smithi073.stdout:3/907: symlink da/d3c/d65/d45/dcd/d108/l11d 0 2024-08-31T05:21:10.812 INFO:tasks.workunit.client.0.smithi067.stdout:2/145: dwrite f4 [0,4194304] 0 2024-08-31T05:21:10.813 INFO:tasks.workunit.client.1.smithi073.stdout:1/817: write d5/d26/d54/f9b [538817,79913] 0 2024-08-31T05:21:10.813 INFO:tasks.workunit.client.1.smithi073.stdout:0/846: fsync d0/d15/d2c/d40/d4a/f87 0 2024-08-31T05:21:10.816 INFO:tasks.workunit.client.1.smithi073.stdout:1/818: chown d5/d26/d54/ccc 53 1 2024-08-31T05:21:10.818 INFO:tasks.workunit.client.1.smithi073.stdout:0/847: creat d0/d69/d8e/f120 x:0 0 0 2024-08-31T05:21:10.818 INFO:tasks.workunit.client.0.smithi067.stdout:7/85: sync 2024-08-31T05:21:10.821 INFO:tasks.workunit.client.0.smithi067.stdout:2/146: dwrite db/ff [0,4194304] 0 2024-08-31T05:21:10.821 INFO:tasks.workunit.client.1.smithi073.stdout:3/908: dwrite da/d3c/d5a/ffd [0,4194304] 0 2024-08-31T05:21:10.823 INFO:tasks.workunit.client.0.smithi067.stdout:7/86: dread d14/f15 [0,4194304] 0 2024-08-31T05:21:10.824 INFO:tasks.workunit.client.0.smithi067.stdout:6/264: write d1b/d23/d2e/f54 [1018034,126989] 0 2024-08-31T05:21:10.826 INFO:tasks.workunit.client.1.smithi073.stdout:1/819: rename d5/d26/da5/dba/d33/d13/l2b to d5/d26/da5/dba/d1c/d27/ded/lf4 0 2024-08-31T05:21:10.831 INFO:tasks.workunit.client.1.smithi073.stdout:3/909: truncate da/d3c/d65/f91 668213 0 2024-08-31T05:21:10.834 INFO:tasks.workunit.client.0.smithi067.stdout:6/265: write d1b/f43 [2363958,82103] 0 2024-08-31T05:21:10.835 INFO:tasks.workunit.client.1.smithi073.stdout:1/820: symlink d5/d26/d54/lf5 0 2024-08-31T05:21:10.836 INFO:tasks.workunit.client.0.smithi067.stdout:2/147: dwrite db/dd/f11 [0,4194304] 0 2024-08-31T05:21:10.838 INFO:tasks.workunit.client.0.smithi067.stdout:7/87: creat d14/d16/f1b x:0 0 0 2024-08-31T05:21:10.840 INFO:tasks.workunit.client.0.smithi067.stdout:7/88: read fd [591189,8483] 0 2024-08-31T05:21:10.840 INFO:tasks.workunit.client.0.smithi067.stdout:7/89: readlink la 0 2024-08-31T05:21:10.841 INFO:tasks.workunit.client.1.smithi073.stdout:3/910: creat da/d3c/d65/d2c/d8e/dc2/d107/f11e x:0 0 0 2024-08-31T05:21:10.843 INFO:tasks.workunit.client.1.smithi073.stdout:8/831: dread d0/db/d1c/d24/f74 [0,4194304] 0 2024-08-31T05:21:10.844 INFO:tasks.workunit.client.0.smithi067.stdout:7/90: mknod d14/d16/c1c 0 2024-08-31T05:21:10.844 INFO:tasks.workunit.client.0.smithi067.stdout:6/266: getdents d1b/d23/d28 0 2024-08-31T05:21:10.845 INFO:tasks.workunit.client.0.smithi067.stdout:6/267: chown d1b/l47 0 1 2024-08-31T05:21:10.847 INFO:tasks.workunit.client.1.smithi073.stdout:3/911: creat da/d3c/d65/d45/dcd/d108/ded/f11f x:0 0 0 2024-08-31T05:21:10.847 INFO:tasks.workunit.client.0.smithi067.stdout:7/91: creat d14/d16/f1d x:0 0 0 2024-08-31T05:21:10.848 INFO:tasks.workunit.client.1.smithi073.stdout:2/814: sync 2024-08-31T05:21:10.849 INFO:tasks.workunit.client.1.smithi073.stdout:0/848: dread d0/d69/f8a [0,4194304] 0 2024-08-31T05:21:10.850 INFO:tasks.workunit.client.1.smithi073.stdout:3/912: chown da/d3c/d5a/d8a/fb3 63 1 2024-08-31T05:21:10.851 INFO:tasks.workunit.client.1.smithi073.stdout:0/849: stat d0/d15/d2c/d40/d86 0 2024-08-31T05:21:10.852 INFO:tasks.workunit.client.1.smithi073.stdout:2/815: creat d2/d9/d27/d76/db5/dc6/f102 x:0 0 0 2024-08-31T05:21:10.853 INFO:tasks.workunit.client.1.smithi073.stdout:2/816: read - d2/d9/d7f/ffe zero size 2024-08-31T05:21:10.856 INFO:tasks.workunit.client.1.smithi073.stdout:2/817: rmdir d2/d9/d7f/dab/d5d/da1 39 2024-08-31T05:21:10.858 INFO:tasks.workunit.client.1.smithi073.stdout:0/850: dwrite d0/d28/fce [0,4194304] 0 2024-08-31T05:21:10.858 INFO:tasks.workunit.client.1.smithi073.stdout:1/821: dread d5/d26/f64 [0,4194304] 0 2024-08-31T05:21:10.862 INFO:tasks.workunit.client.1.smithi073.stdout:0/851: creat d0/d58/d63/f121 x:0 0 0 2024-08-31T05:21:10.862 INFO:tasks.workunit.client.1.smithi073.stdout:2/818: read d2/d9/d27/d9b/da6/fcf [4010864,48662] 0 2024-08-31T05:21:10.863 INFO:tasks.workunit.client.1.smithi073.stdout:1/822: mkdir d5/d26/d54/db2/ddb/df6 0 2024-08-31T05:21:10.864 INFO:tasks.workunit.client.1.smithi073.stdout:0/852: symlink d0/d15/d2c/d40/l122 0 2024-08-31T05:21:10.868 INFO:tasks.workunit.client.1.smithi073.stdout:1/823: rename d5/d26/da5/dba/d33/f90 to d5/d26/d54/db2/dd5/d2a/d80/d93/ff7 0 2024-08-31T05:21:10.870 INFO:tasks.workunit.client.1.smithi073.stdout:2/819: dread d2/d9/df/d36/f5e [0,4194304] 0 2024-08-31T05:21:10.872 INFO:tasks.workunit.client.1.smithi073.stdout:1/824: unlink d5/d26/d54/db2/dd5/d2a/d80/c40 0 2024-08-31T05:21:10.873 INFO:tasks.workunit.client.1.smithi073.stdout:1/825: fsync d5/d26/d54/db2/dd5/d32/d37/d6f/f97 0 2024-08-31T05:21:10.874 INFO:tasks.workunit.client.1.smithi073.stdout:0/853: unlink d0/d69/d7f/d68/d91/l11f 0 2024-08-31T05:21:10.875 INFO:tasks.workunit.client.1.smithi073.stdout:3/913: dread da/d3c/f8f [0,4194304] 0 2024-08-31T05:21:10.875 INFO:tasks.workunit.client.1.smithi073.stdout:0/854: chown d0/d69/d8e 18115 1 2024-08-31T05:21:10.875 INFO:tasks.workunit.client.1.smithi073.stdout:2/820: readlink d2/d9/d27/d76/ldb 0 2024-08-31T05:21:10.876 INFO:tasks.workunit.client.0.smithi067.stdout:2/148: truncate f1 1645547 0 2024-08-31T05:21:10.877 INFO:tasks.workunit.client.1.smithi073.stdout:1/826: mknod d5/d26/d54/db2/dd5/d32/d37/cf8 0 2024-08-31T05:21:10.878 INFO:tasks.workunit.client.0.smithi067.stdout:9/89: sync 2024-08-31T05:21:10.878 INFO:tasks.workunit.client.0.smithi067.stdout:4/97: sync 2024-08-31T05:21:10.879 INFO:tasks.workunit.client.0.smithi067.stdout:4/98: fsync d4/f10 0 2024-08-31T05:21:10.879 INFO:tasks.workunit.client.0.smithi067.stdout:4/99: chown d4/d13/f1c 2115643 1 2024-08-31T05:21:10.880 INFO:tasks.workunit.client.1.smithi073.stdout:9/904: sync 2024-08-31T05:21:10.880 INFO:tasks.workunit.client.1.smithi073.stdout:4/737: sync 2024-08-31T05:21:10.880 INFO:tasks.workunit.client.1.smithi073.stdout:6/803: sync 2024-08-31T05:21:10.881 INFO:tasks.workunit.client.0.smithi067.stdout:2/149: unlink db/d12/d1a/d1e/c22 0 2024-08-31T05:21:10.881 INFO:tasks.workunit.client.0.smithi067.stdout:4/100: truncate d4/f10 4389730 0 2024-08-31T05:21:10.881 INFO:tasks.workunit.client.0.smithi067.stdout:2/150: dread - db/d12/d1a/f20 zero size 2024-08-31T05:21:10.882 INFO:tasks.workunit.client.0.smithi067.stdout:4/101: write d4/d13/f1c [1268631,72391] 0 2024-08-31T05:21:10.882 INFO:tasks.workunit.client.1.smithi073.stdout:6/804: write d15/d17/f3a [4738058,38714] 0 2024-08-31T05:21:10.882 INFO:tasks.workunit.client.1.smithi073.stdout:8/832: truncate d0/db/d1c/d23/f2f 70088 0 2024-08-31T05:21:10.884 INFO:tasks.workunit.client.0.smithi067.stdout:7/92: truncate f9 1359093 0 2024-08-31T05:21:10.885 INFO:tasks.workunit.client.0.smithi067.stdout:6/268: dwrite f10 [0,4194304] 0 2024-08-31T05:21:10.886 INFO:tasks.workunit.client.1.smithi073.stdout:1/827: mknod d5/d26/d54/db2/dd5/d5d/cf9 0 2024-08-31T05:21:10.886 INFO:tasks.workunit.client.0.smithi067.stdout:6/269: readlink d1b/l47 0 2024-08-31T05:21:10.887 INFO:tasks.workunit.client.1.smithi073.stdout:3/914: dread da/f52 [0,4194304] 0 2024-08-31T05:21:10.888 INFO:tasks.workunit.client.1.smithi073.stdout:8/833: dwrite d0/db/d44/d72/d79/f83 [0,4194304] 0 2024-08-31T05:21:10.889 INFO:tasks.workunit.client.1.smithi073.stdout:8/834: fdatasync d0/db/d1c/d34/d38/fdd 0 2024-08-31T05:21:10.889 INFO:tasks.workunit.client.0.smithi067.stdout:2/151: creat db/d12/f23 x:0 0 0 2024-08-31T05:21:10.891 INFO:tasks.workunit.client.0.smithi067.stdout:4/102: symlink d4/d1f/l22 0 2024-08-31T05:21:10.892 INFO:tasks.workunit.client.0.smithi067.stdout:6/270: dread f14 [0,4194304] 0 2024-08-31T05:21:10.893 INFO:tasks.workunit.client.1.smithi073.stdout:4/738: symlink d7/df/d13/d2e/d47/d4c/lea 0 2024-08-31T05:21:10.897 INFO:tasks.workunit.client.1.smithi073.stdout:9/905: rename dc/de/d66/d84/l88 to dc/d37/l123 0 2024-08-31T05:21:10.900 INFO:tasks.workunit.client.0.smithi067.stdout:6/271: dwrite d1b/d23/d2e/f3d [0,4194304] 0 2024-08-31T05:21:10.903 INFO:tasks.workunit.client.0.smithi067.stdout:2/152: mkdir db/d12/d24 0 2024-08-31T05:21:10.905 INFO:tasks.workunit.client.0.smithi067.stdout:4/103: mknod d4/d1e/c23 0 2024-08-31T05:21:10.910 INFO:tasks.workunit.client.0.smithi067.stdout:7/93: unlink c13 0 2024-08-31T05:21:10.910 INFO:tasks.workunit.client.0.smithi067.stdout:7/94: truncate f11 90280 0 2024-08-31T05:21:10.911 INFO:tasks.workunit.client.1.smithi073.stdout:7/826: sync 2024-08-31T05:21:10.916 INFO:tasks.workunit.client.1.smithi073.stdout:3/915: dread da/d3c/d65/d2c/f2e [0,4194304] 0 2024-08-31T05:21:10.917 INFO:tasks.workunit.client.0.smithi067.stdout:6/272: creat d1b/d23/d28/f55 x:0 0 0 2024-08-31T05:21:10.921 INFO:tasks.workunit.client.0.smithi067.stdout:4/104: creat d4/d13/f24 x:0 0 0 2024-08-31T05:21:10.922 INFO:tasks.workunit.client.1.smithi073.stdout:0/855: getdents d0/d69/d7f/d62/dbf 0 2024-08-31T05:21:10.923 INFO:tasks.workunit.client.1.smithi073.stdout:4/739: dread d7/db/f69 [0,4194304] 0 2024-08-31T05:21:10.924 INFO:tasks.workunit.client.0.smithi067.stdout:9/90: link dd/df/l14 dd/l19 0 2024-08-31T05:21:10.925 INFO:tasks.workunit.client.1.smithi073.stdout:2/821: getdents d2/d9/d27/d76/d7e 0 2024-08-31T05:21:10.929 INFO:tasks.workunit.client.1.smithi073.stdout:8/835: mknod d0/db/d44/c109 0 2024-08-31T05:21:10.930 INFO:tasks.workunit.client.1.smithi073.stdout:0/856: dwrite d0/d69/d7f/d62/dbf/fe3 [4194304,4194304] 0 2024-08-31T05:21:10.930 INFO:tasks.workunit.client.0.smithi067.stdout:2/153: link db/ff db/f25 0 2024-08-31T05:21:10.931 INFO:tasks.workunit.client.0.smithi067.stdout:2/154: write db/dd/d13/f14 [1290142,80077] 0 2024-08-31T05:21:10.932 INFO:tasks.workunit.client.1.smithi073.stdout:0/857: read - d0/d58/d63/f121 zero size 2024-08-31T05:21:10.933 INFO:tasks.workunit.client.0.smithi067.stdout:4/105: creat d4/f25 x:0 0 0 2024-08-31T05:21:10.934 INFO:tasks.workunit.client.1.smithi073.stdout:9/906: symlink dc/d37/d42/d8d/de8/l124 0 2024-08-31T05:21:10.935 INFO:tasks.workunit.client.1.smithi073.stdout:0/858: fdatasync d0/d15/d9b/f116 0 2024-08-31T05:21:10.935 INFO:tasks.workunit.client.0.smithi067.stdout:6/273: write f7 [1130953,28230] 0 2024-08-31T05:21:10.936 INFO:tasks.workunit.client.0.smithi067.stdout:6/274: stat f18 0 2024-08-31T05:21:10.936 INFO:tasks.workunit.client.1.smithi073.stdout:2/822: dwrite d2/d9/df/d43/d88/f100 [0,4194304] 0 2024-08-31T05:21:10.937 INFO:tasks.workunit.client.1.smithi073.stdout:3/916: dread da/f43 [0,4194304] 0 2024-08-31T05:21:10.938 INFO:tasks.workunit.client.1.smithi073.stdout:1/828: creat d5/d26/d54/db2/dd5/ffa x:0 0 0 2024-08-31T05:21:10.941 INFO:tasks.workunit.client.0.smithi067.stdout:4/106: creat d4/d1e/f26 x:0 0 0 2024-08-31T05:21:10.941 INFO:tasks.workunit.client.1.smithi073.stdout:4/740: mkdir d7/d1a/d5c/d6d/d2c/deb 0 2024-08-31T05:21:10.942 INFO:tasks.workunit.client.1.smithi073.stdout:8/836: dwrite d0/db/d1c/d2a/d58/f7a [0,4194304] 0 2024-08-31T05:21:10.943 INFO:tasks.workunit.client.1.smithi073.stdout:7/827: symlink d1/da/d15/d33/d44/d60/de1/dfa/l100 0 2024-08-31T05:21:10.944 INFO:tasks.workunit.client.0.smithi067.stdout:7/95: rename f9 to d14/f1e 0 2024-08-31T05:21:10.945 INFO:tasks.workunit.client.1.smithi073.stdout:7/828: chown d1/da/d3e/d22/d6b 1249495 1 2024-08-31T05:21:10.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:10 smithi073 ceph-mon[24726]: pgmap v26: 65 pgs: 65 active+clean; 1.6 GiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 76 MiB/s rd, 223 MiB/s wr, 451 op/s 2024-08-31T05:21:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:10 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:21:10.946 INFO:tasks.workunit.client.1.smithi073.stdout:4/741: dread - d7/df/d13/d2e/fa3 zero size 2024-08-31T05:21:10.946 INFO:tasks.workunit.client.1.smithi073.stdout:6/805: getdents d15/d17/da1/dae/db0 0 2024-08-31T05:21:10.948 INFO:tasks.workunit.client.0.smithi067.stdout:6/275: chown d1b/d23/c2d 551 1 2024-08-31T05:21:10.949 INFO:tasks.workunit.client.0.smithi067.stdout:6/276: write d1b/d23/d2e/f54 [162622,122438] 0 2024-08-31T05:21:10.949 INFO:tasks.workunit.client.0.smithi067.stdout:4/107: mknod d4/d1e/c27 0 2024-08-31T05:21:10.949 INFO:tasks.workunit.client.0.smithi067.stdout:4/108: chown d4/c1d 92 1 2024-08-31T05:21:10.949 INFO:tasks.workunit.client.1.smithi073.stdout:0/859: stat d0/d15/c23 0 2024-08-31T05:21:10.949 INFO:tasks.workunit.client.1.smithi073.stdout:2/823: fsync d2/d9/fa0 0 2024-08-31T05:21:10.950 INFO:tasks.workunit.client.1.smithi073.stdout:7/829: stat d1/da/d3e/d22/d47/cb5 0 2024-08-31T05:21:10.950 INFO:tasks.workunit.client.1.smithi073.stdout:4/742: chown d7/df/d1b/fa2 1052 1 2024-08-31T05:21:10.951 INFO:tasks.workunit.client.1.smithi073.stdout:9/907: mkdir dc/d37/d42/d5a/dda/d125 0 2024-08-31T05:21:10.951 INFO:tasks.workunit.client.1.smithi073.stdout:1/829: mknod d5/d26/d54/db2/dd5/d5d/d61/cfb 0 2024-08-31T05:21:10.951 INFO:tasks.workunit.client.1.smithi073.stdout:4/743: write d7/d1a/fa0 [570776,33255] 0 2024-08-31T05:21:10.952 INFO:tasks.workunit.client.1.smithi073.stdout:3/917: creat da/d3c/d65/d40/d5d/dd2/f120 x:0 0 0 2024-08-31T05:21:10.952 INFO:tasks.workunit.client.1.smithi073.stdout:2/824: truncate d2/d9/d7f/fb0 1055227 0 2024-08-31T05:21:10.953 INFO:tasks.workunit.client.0.smithi067.stdout:6/277: symlink d1b/d23/d28/l56 0 2024-08-31T05:21:10.954 INFO:tasks.workunit.client.0.smithi067.stdout:4/109: mknod d4/d13/c28 0 2024-08-31T05:21:10.954 INFO:tasks.workunit.client.0.smithi067.stdout:4/110: stat d4/d14 0 2024-08-31T05:21:10.956 INFO:tasks.workunit.client.0.smithi067.stdout:9/91: getdents dd 0 2024-08-31T05:21:10.958 INFO:tasks.workunit.client.0.smithi067.stdout:6/278: write d1b/d23/d2f/f42 [8850453,49920] 0 2024-08-31T05:21:10.959 INFO:tasks.workunit.client.0.smithi067.stdout:0/173: sync 2024-08-31T05:21:10.959 INFO:tasks.workunit.client.0.smithi067.stdout:8/245: sync 2024-08-31T05:21:10.959 INFO:tasks.workunit.client.0.smithi067.stdout:5/86: sync 2024-08-31T05:21:10.959 INFO:tasks.workunit.client.0.smithi067.stdout:1/81: sync 2024-08-31T05:21:10.959 INFO:tasks.workunit.client.0.smithi067.stdout:3/106: sync 2024-08-31T05:21:10.960 INFO:tasks.workunit.client.1.smithi073.stdout:7/830: rename d1/da/d3e/d22/d5c/cf5 to d1/c101 0 2024-08-31T05:21:10.961 INFO:tasks.workunit.client.1.smithi073.stdout:4/744: creat d7/df/d79/fec x:0 0 0 2024-08-31T05:21:10.961 INFO:tasks.workunit.client.0.smithi067.stdout:0/174: dread - d1/df/d29/f34 zero size 2024-08-31T05:21:10.962 INFO:tasks.workunit.client.0.smithi067.stdout:8/246: write d0/d2/dc/f49 [953201,77560] 0 2024-08-31T05:21:10.962 INFO:tasks.workunit.client.0.smithi067.stdout:9/92: creat dd/f1a x:0 0 0 2024-08-31T05:21:10.963 INFO:tasks.workunit.client.1.smithi073.stdout:2/825: symlink d2/d9/d7f/dab/daa/l103 0 2024-08-31T05:21:10.964 INFO:tasks.workunit.client.1.smithi073.stdout:3/918: rmdir da/d3c/d65/d2c/d8e/dc2/d110 39 2024-08-31T05:21:10.965 INFO:tasks.workunit.client.0.smithi067.stdout:6/279: symlink d1b/d23/d2e/l57 0 2024-08-31T05:21:10.966 INFO:tasks.workunit.client.1.smithi073.stdout:7/831: dwrite d1/da/d3e/d22/d47/fa1 [0,4194304] 0 2024-08-31T05:21:10.967 INFO:tasks.workunit.client.1.smithi073.stdout:7/832: chown d1/da/d3e/d22/d47 402 1 2024-08-31T05:21:10.968 INFO:tasks.workunit.client.0.smithi067.stdout:8/247: write d0/d2/da/dd/f35 [3007486,26558] 0 2024-08-31T05:21:10.969 INFO:tasks.workunit.client.0.smithi067.stdout:3/107: rename l9 to db/l29 0 2024-08-31T05:21:10.969 INFO:tasks.workunit.client.0.smithi067.stdout:4/111: dread d4/d13/f1a [0,4194304] 0 2024-08-31T05:21:10.972 INFO:tasks.workunit.client.1.smithi073.stdout:0/860: truncate d0/d69/d7f/d68/d91/df5/d3c/d9c/dc8/fe9 1207862 0 2024-08-31T05:21:10.974 INFO:tasks.workunit.client.0.smithi067.stdout:1/82: dwrite d3/dd/f1a [0,4194304] 0 2024-08-31T05:21:10.975 INFO:tasks.workunit.client.1.smithi073.stdout:7/833: dwrite d1/d11/fed [0,4194304] 0 2024-08-31T05:21:10.975 INFO:tasks.workunit.client.1.smithi073.stdout:1/830: fdatasync f0 0 2024-08-31T05:21:10.975 INFO:tasks.workunit.client.1.smithi073.stdout:0/861: read d0/d15/fb1 [201491,113044] 0 2024-08-31T05:21:10.976 INFO:tasks.workunit.client.1.smithi073.stdout:0/862: write d0/d15/d9b/fe5 [227177,1433] 0 2024-08-31T05:21:10.977 INFO:tasks.workunit.client.0.smithi067.stdout:0/175: dwrite d1/df/d17/f20 [0,4194304] 0 2024-08-31T05:21:10.978 INFO:tasks.workunit.client.1.smithi073.stdout:0/863: dread d0/d69/d7f/d68/d91/df5/d3c/d9c/db6/ff3 [0,4194304] 0 2024-08-31T05:21:10.982 INFO:tasks.workunit.client.0.smithi067.stdout:6/280: symlink d1b/d40/l58 0 2024-08-31T05:21:10.982 INFO:tasks.workunit.client.0.smithi067.stdout:2/155: write db/dd/f15 [197107,26776] 0 2024-08-31T05:21:10.984 INFO:tasks.workunit.client.1.smithi073.stdout:4/745: creat d7/d1a/d5c/d6d/d2c/d2d/da6/dde/fed x:0 0 0 2024-08-31T05:21:10.989 INFO:tasks.workunit.client.1.smithi073.stdout:3/919: symlink da/d3c/d65/d45/dcd/d108/ded/l121 0 2024-08-31T05:21:10.991 INFO:tasks.workunit.client.1.smithi073.stdout:4/746: dwrite d7/df/d1b/fa2 [0,4194304] 0 2024-08-31T05:21:10.994 INFO:tasks.workunit.client.0.smithi067.stdout:8/248: symlink d0/d2/da/dd/d1f/l54 0 2024-08-31T05:21:11.002 INFO:tasks.workunit.client.0.smithi067.stdout:7/96: write d14/f18 [445971,129286] 0 2024-08-31T05:21:11.002 INFO:tasks.workunit.client.1.smithi073.stdout:7/834: rmdir d1/d11/dcc 39 2024-08-31T05:21:11.002 INFO:tasks.workunit.client.0.smithi067.stdout:7/97: chown d14/f1a 101690 1 2024-08-31T05:21:11.003 INFO:tasks.workunit.client.1.smithi073.stdout:8/837: dwrite d0/db/d1c/d34/d38/f94 [0,4194304] 0 2024-08-31T05:21:11.003 INFO:tasks.workunit.client.0.smithi067.stdout:7/98: truncate d14/f1a 466456 0 2024-08-31T05:21:11.005 INFO:tasks.workunit.client.0.smithi067.stdout:7/99: write d14/d16/f1b [978877,128446] 0 2024-08-31T05:21:11.011 INFO:tasks.workunit.client.0.smithi067.stdout:8/249: fdatasync d0/f40 0 2024-08-31T05:21:11.014 INFO:tasks.workunit.client.0.smithi067.stdout:9/93: dwrite dd/f1a [0,4194304] 0 2024-08-31T05:21:11.015 INFO:tasks.workunit.client.1.smithi073.stdout:6/806: getdents d15/d1a/d2b/d2f/d99/d9e 0 2024-08-31T05:21:11.015 INFO:tasks.workunit.client.1.smithi073.stdout:9/908: dwrite dc/dc4/fcf [0,4194304] 0 2024-08-31T05:21:11.018 INFO:tasks.workunit.client.0.smithi067.stdout:5/87: write f7 [1779983,30687] 0 2024-08-31T05:21:11.018 INFO:tasks.workunit.client.1.smithi073.stdout:4/747: creat d7/df/d13/d2e/d70/d6b/fee x:0 0 0 2024-08-31T05:21:11.019 INFO:tasks.workunit.client.0.smithi067.stdout:8/250: dwrite d0/f9 [0,4194304] 0 2024-08-31T05:21:11.020 INFO:tasks.workunit.client.0.smithi067.stdout:5/88: write f2 [1500568,86915] 0 2024-08-31T05:21:11.026 INFO:tasks.workunit.client.1.smithi073.stdout:7/835: creat d1/f102 x:0 0 0 2024-08-31T05:21:11.028 INFO:tasks.workunit.client.0.smithi067.stdout:2/156: creat db/d12/d24/f26 x:0 0 0 2024-08-31T05:21:11.028 INFO:tasks.workunit.client.0.smithi067.stdout:4/112: write d4/d13/f1a [344700,24425] 0 2024-08-31T05:21:11.031 INFO:tasks.workunit.client.1.smithi073.stdout:7/836: write d1/da/d15/d33/d44/d74/dd6/de6/d84/ff3 [577741,48749] 0 2024-08-31T05:21:11.031 INFO:tasks.workunit.client.0.smithi067.stdout:7/100: creat d14/f1f x:0 0 0 2024-08-31T05:21:11.032 INFO:tasks.workunit.client.0.smithi067.stdout:7/101: fdatasync d14/d16/f1b 0 2024-08-31T05:21:11.032 INFO:tasks.workunit.client.1.smithi073.stdout:2/826: dwrite d2/d9/df/f64 [0,4194304] 0 2024-08-31T05:21:11.033 INFO:tasks.workunit.client.1.smithi073.stdout:7/837: stat d1/da/d15/d33/d44/d74/dd6 0 2024-08-31T05:21:11.034 INFO:tasks.workunit.client.1.smithi073.stdout:9/909: write dc/d37/d42/f94 [4673760,114139] 0 2024-08-31T05:21:11.034 INFO:tasks.workunit.client.0.smithi067.stdout:6/281: write d1b/f20 [3596116,98587] 0 2024-08-31T05:21:11.034 INFO:tasks.workunit.client.1.smithi073.stdout:7/838: truncate d1/f102 531085 0 2024-08-31T05:21:11.035 INFO:tasks.workunit.client.1.smithi073.stdout:4/748: readlink d7/d1a/d5c/d6d/d2c/d2d/da6/le9 0 2024-08-31T05:21:11.036 INFO:tasks.workunit.client.0.smithi067.stdout:6/282: fdatasync d1b/d23/f4f 0 2024-08-31T05:21:11.036 INFO:tasks.workunit.client.0.smithi067.stdout:5/89: read f2 [1505708,114370] 0 2024-08-31T05:21:11.037 INFO:tasks.workunit.client.1.smithi073.stdout:4/749: write d7/df/d79/faf [4780291,112960] 0 2024-08-31T05:21:11.038 INFO:tasks.workunit.client.1.smithi073.stdout:1/831: rename d5/d26/fdd to d5/ffc 0 2024-08-31T05:21:11.041 INFO:tasks.workunit.client.1.smithi073.stdout:6/807: symlink d15/d41/l10b 0 2024-08-31T05:21:11.042 INFO:tasks.workunit.client.0.smithi067.stdout:1/83: truncate d3/f10 2125504 0 2024-08-31T05:21:11.043 INFO:tasks.workunit.client.0.smithi067.stdout:7/102: dread fd [0,4194304] 0 2024-08-31T05:21:11.043 INFO:tasks.workunit.client.1.smithi073.stdout:4/750: dwrite d7/df/d79/fec [0,4194304] 0 2024-08-31T05:21:11.047 INFO:tasks.workunit.client.0.smithi067.stdout:2/157: chown f1 27265 1 2024-08-31T05:21:11.048 INFO:tasks.workunit.client.1.smithi073.stdout:7/839: write d1/da/d3e/d22/d6b/f70 [4170782,71064] 0 2024-08-31T05:21:11.049 INFO:tasks.workunit.client.0.smithi067.stdout:3/108: getdents db 0 2024-08-31T05:21:11.051 INFO:tasks.workunit.client.0.smithi067.stdout:4/113: symlink d4/d9/l29 0 2024-08-31T05:21:11.056 INFO:tasks.workunit.client.0.smithi067.stdout:5/90: creat db/f1b x:0 0 0 2024-08-31T05:21:11.057 INFO:tasks.workunit.client.1.smithi073.stdout:2/827: mknod d2/d9/d7f/dab/dc4/c104 0 2024-08-31T05:21:11.058 INFO:tasks.workunit.client.0.smithi067.stdout:4/114: dwrite d4/d13/f1c [0,4194304] 0 2024-08-31T05:21:11.059 INFO:tasks.workunit.client.1.smithi073.stdout:4/751: creat d7/d1a/d5c/d6d/d2c/fef x:0 0 0 2024-08-31T05:21:11.059 INFO:tasks.workunit.client.0.smithi067.stdout:4/115: fdatasync d4/f25 0 2024-08-31T05:21:11.060 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:10 smithi067 ceph-mon[17432]: pgmap v26: 65 pgs: 65 active+clean; 1.6 GiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 76 MiB/s rd, 223 MiB/s wr, 451 op/s 2024-08-31T05:21:11.060 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:10 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:21:11.060 INFO:tasks.workunit.client.1.smithi073.stdout:4/752: write d7/d1a/d5c/d6d/f6e [4051936,16131] 0 2024-08-31T05:21:11.061 INFO:tasks.workunit.client.1.smithi073.stdout:7/840: mkdir d1/da/d15/d33/d44/d74/dd6/dea/dac/d103 0 2024-08-31T05:21:11.062 INFO:tasks.workunit.client.0.smithi067.stdout:0/176: getdents d1/d8 0 2024-08-31T05:21:11.062 INFO:tasks.workunit.client.1.smithi073.stdout:4/753: write d7/d1a/d5c/d6d/d59/d65/fe5 [499847,86799] 0 2024-08-31T05:21:11.064 INFO:tasks.workunit.client.0.smithi067.stdout:0/177: write d1/dd/f21 [765602,28708] 0 2024-08-31T05:21:11.064 INFO:tasks.workunit.client.0.smithi067.stdout:7/103: rmdir d14/d16 39 2024-08-31T05:21:11.066 INFO:tasks.workunit.client.0.smithi067.stdout:7/104: readlink lf 0 2024-08-31T05:21:11.067 INFO:tasks.workunit.client.0.smithi067.stdout:4/116: dread d4/d13/f1a [0,4194304] 0 2024-08-31T05:21:11.068 INFO:tasks.workunit.client.0.smithi067.stdout:3/109: mknod db/d17/c2a 0 2024-08-31T05:21:11.068 INFO:tasks.workunit.client.0.smithi067.stdout:4/117: readlink d4/d9/le 0 2024-08-31T05:21:11.069 INFO:tasks.workunit.client.1.smithi073.stdout:1/832: dwrite d5/d26/da5/dba/d33/d13/d7e/f98 [0,4194304] 0 2024-08-31T05:21:11.069 INFO:tasks.workunit.client.0.smithi067.stdout:4/118: chown d4/d13/f1c 4652 1 2024-08-31T05:21:11.070 INFO:tasks.workunit.client.0.smithi067.stdout:9/94: creat dd/f1b x:0 0 0 2024-08-31T05:21:11.071 INFO:tasks.workunit.client.1.smithi073.stdout:1/833: write d5/d26/d54/db2/dd5/f57 [3606645,29655] 0 2024-08-31T05:21:11.072 INFO:tasks.workunit.client.1.smithi073.stdout:1/834: readlink d5/d26/d54/db2/dd5/d3f/lb7 0 2024-08-31T05:21:11.075 INFO:tasks.workunit.client.1.smithi073.stdout:0/864: rename d0/d15/c8d to d0/d15/d2c/c123 0 2024-08-31T05:21:11.076 INFO:tasks.workunit.client.0.smithi067.stdout:5/91: rmdir db/d15 39 2024-08-31T05:21:11.078 INFO:tasks.workunit.client.0.smithi067.stdout:5/92: dread - db/f19 zero size 2024-08-31T05:21:11.080 INFO:tasks.workunit.client.0.smithi067.stdout:8/251: write d0/d2/dc/d28/f3f [330968,29233] 0 2024-08-31T05:21:11.086 INFO:tasks.workunit.client.1.smithi073.stdout:7/841: symlink d1/da/db2/dba/l104 0 2024-08-31T05:21:11.088 INFO:tasks.workunit.client.1.smithi073.stdout:4/754: getdents d7/d1a/d5c/d6d/d2c/d2d/da6/dde/de3/dd0 0 2024-08-31T05:21:11.089 INFO:tasks.workunit.client.0.smithi067.stdout:3/110: rmdir db/d12/d21 39 2024-08-31T05:21:11.091 INFO:tasks.workunit.client.0.smithi067.stdout:3/111: write db/d12/f18 [3613768,10412] 0 2024-08-31T05:21:11.095 INFO:tasks.workunit.client.1.smithi073.stdout:9/910: rename dc/d37/db5/dc1 to dc/de/dd8/d126 0 2024-08-31T05:21:11.097 INFO:tasks.workunit.client.1.smithi073.stdout:9/911: read dc/d37/d42/d8d/d52/d5f/f91 [2833906,79071] 0 2024-08-31T05:21:11.098 INFO:tasks.workunit.client.1.smithi073.stdout:0/865: creat d0/d58/d63/f124 x:0 0 0 2024-08-31T05:21:11.098 INFO:tasks.workunit.client.1.smithi073.stdout:2/828: truncate d2/d9/d7f/fd2 4008479 0 2024-08-31T05:21:11.099 INFO:tasks.workunit.client.1.smithi073.stdout:0/866: chown d0/d69/d7f/d68/d91/df5/d3c/d9c/dc8/fd8 1 1 2024-08-31T05:21:11.099 INFO:tasks.workunit.client.1.smithi073.stdout:6/808: link d15/d1a/d2b/d2f/d4b/l93 d15/d1a/d2b/d6a/l10c 0 2024-08-31T05:21:11.100 INFO:tasks.workunit.client.1.smithi073.stdout:6/809: readlink d15/d41/le7 0 2024-08-31T05:21:11.101 INFO:tasks.workunit.client.1.smithi073.stdout:4/755: mknod d7/d1a/d5c/d6d/d59/d86/cf0 0 2024-08-31T05:21:11.101 INFO:tasks.workunit.client.0.smithi067.stdout:5/93: rmdir db 39 2024-08-31T05:21:11.102 INFO:tasks.workunit.client.0.smithi067.stdout:2/158: truncate db/dd/f17 3889883 0 2024-08-31T05:21:11.103 INFO:tasks.workunit.client.0.smithi067.stdout:2/159: dread - db/d12/d24/f26 zero size 2024-08-31T05:21:11.104 INFO:tasks.workunit.client.0.smithi067.stdout:2/160: chown db/d12/d1a/d1e 821919 1 2024-08-31T05:21:11.105 INFO:tasks.workunit.client.0.smithi067.stdout:2/161: fdatasync db/dd/f1d 0 2024-08-31T05:21:11.105 INFO:tasks.workunit.client.1.smithi073.stdout:7/842: rename d1/da/d15/d33/d44/d60/de1/dfa/l100 to d1/da/d15/d33/d44/d74/dd6/de3/l105 0 2024-08-31T05:21:11.105 INFO:tasks.workunit.client.1.smithi073.stdout:1/835: write d5/d26/d54/db2/dd5/d2a/d80/d93/fcd [705520,55918] 0 2024-08-31T05:21:11.105 INFO:tasks.workunit.client.0.smithi067.stdout:2/162: read db/dd/d13/f14 [308574,75772] 0 2024-08-31T05:21:11.107 INFO:tasks.workunit.client.1.smithi073.stdout:2/829: truncate d2/d9/d7f/ffe 1039747 0 2024-08-31T05:21:11.107 INFO:tasks.workunit.client.0.smithi067.stdout:2/163: write db/d12/d1a/d1e/f21 [360825,20186] 0 2024-08-31T05:21:11.108 INFO:tasks.workunit.client.1.smithi073.stdout:0/867: mknod d0/d69/d7f/d68/d91/df5/d3c/d9c/db6/dc6/c125 0 2024-08-31T05:21:11.109 INFO:tasks.workunit.client.1.smithi073.stdout:0/868: write d0/d28/f2d [1212888,117114] 0 2024-08-31T05:21:11.109 INFO:tasks.workunit.client.1.smithi073.stdout:6/810: mknod d15/d1a/d2b/d2f/d4b/d97/c10d 0 2024-08-31T05:21:11.109 INFO:tasks.workunit.client.1.smithi073.stdout:1/836: dread d5/d26/d54/db2/dd5/f57 [0,4194304] 0 2024-08-31T05:21:11.114 INFO:tasks.workunit.client.1.smithi073.stdout:9/912: write dc/d82/d97/f9e [383991,52814] 0 2024-08-31T05:21:11.115 INFO:tasks.workunit.client.0.smithi067.stdout:2/164: dwrite db/d12/f23 [0,4194304] 0 2024-08-31T05:21:11.116 INFO:tasks.workunit.client.0.smithi067.stdout:9/95: symlink dd/df/l1c 0 2024-08-31T05:21:11.117 INFO:tasks.workunit.client.0.smithi067.stdout:9/96: read fa [470904,16724] 0 2024-08-31T05:21:11.119 INFO:tasks.workunit.client.1.smithi073.stdout:9/913: dread - dc/de/dd8/ff8 zero size 2024-08-31T05:21:11.120 INFO:tasks.workunit.client.0.smithi067.stdout:6/283: getdents d1b/d30/d4a 0 2024-08-31T05:21:11.121 INFO:tasks.workunit.client.1.smithi073.stdout:2/830: creat d2/f105 x:0 0 0 2024-08-31T05:21:11.123 INFO:tasks.workunit.client.1.smithi073.stdout:6/811: dwrite d15/d1a/fac [0,4194304] 0 2024-08-31T05:21:11.123 INFO:tasks.workunit.client.1.smithi073.stdout:0/869: dwrite d0/d28/f30 [0,4194304] 0 2024-08-31T05:21:11.125 INFO:tasks.workunit.client.1.smithi073.stdout:3/920: sync 2024-08-31T05:21:11.125 INFO:tasks.workunit.client.1.smithi073.stdout:2/831: write d2/d9/f81 [2100371,95526] 0 2024-08-31T05:21:11.126 INFO:tasks.workunit.client.0.smithi067.stdout:1/84: getdents d3 0 2024-08-31T05:21:11.126 INFO:tasks.workunit.client.1.smithi073.stdout:1/837: dwrite d5/d26/d54/d55/f8d [0,4194304] 0 2024-08-31T05:21:11.127 INFO:tasks.workunit.client.0.smithi067.stdout:1/85: fsync d3/f13 0 2024-08-31T05:21:11.130 INFO:tasks.workunit.client.1.smithi073.stdout:1/838: chown d5/d26/d54/d55 2618695 1 2024-08-31T05:21:11.131 INFO:tasks.workunit.client.0.smithi067.stdout:7/105: creat d14/f20 x:0 0 0 2024-08-31T05:21:11.131 INFO:tasks.workunit.client.0.smithi067.stdout:0/178: truncate d1/d8/f35 108738 0 2024-08-31T05:21:11.133 INFO:tasks.workunit.client.1.smithi073.stdout:2/832: truncate d2/d9/d7f/dab/f47 4926165 0 2024-08-31T05:21:11.134 INFO:tasks.workunit.client.1.smithi073.stdout:3/921: dread - da/d3c/d82/d97/fce zero size 2024-08-31T05:21:11.134 INFO:tasks.workunit.client.1.smithi073.stdout:4/756: write d7/df/d13/d2e/d70/f9b [62830,69386] 0 2024-08-31T05:21:11.136 INFO:tasks.workunit.client.1.smithi073.stdout:4/757: write d7/d1a/d5c/d6d/d59/d86/fd5 [720345,23607] 0 2024-08-31T05:21:11.138 INFO:tasks.workunit.client.1.smithi073.stdout:6/812: dwrite d15/d17/da1/fbc [0,4194304] 0 2024-08-31T05:21:11.138 INFO:tasks.workunit.client.1.smithi073.stdout:7/843: rename d1/da/d3e/d22/d47/cb0 to d1/da/d3e/d22/d35/c106 0 2024-08-31T05:21:11.141 INFO:tasks.workunit.client.0.smithi067.stdout:0/179: dwrite d1/dd/f15 [0,4194304] 0 2024-08-31T05:21:11.142 INFO:tasks.workunit.client.0.smithi067.stdout:0/180: rename d1/df/d17 to d1/df/d17/d3f 22 2024-08-31T05:21:11.159 INFO:tasks.workunit.client.0.smithi067.stdout:1/86: dwrite d3/f5 [0,4194304] 0 2024-08-31T05:21:11.161 INFO:tasks.workunit.client.1.smithi073.stdout:3/922: creat da/d3c/d65/d40/f122 x:0 0 0 2024-08-31T05:21:11.168 INFO:tasks.workunit.client.1.smithi073.stdout:6/813: mknod d15/d1a/d51/d61/c10e 0 2024-08-31T05:21:11.170 INFO:tasks.workunit.client.1.smithi073.stdout:7/844: creat d1/da/d3e/f107 x:0 0 0 2024-08-31T05:21:11.170 INFO:tasks.workunit.client.1.smithi073.stdout:8/838: sync 2024-08-31T05:21:11.172 INFO:tasks.workunit.client.1.smithi073.stdout:4/758: rename d7/d1a/d5c/d6d/d59/fb1 to d7/df/d13/d53/d88/dc7/ff1 0 2024-08-31T05:21:11.172 INFO:tasks.workunit.client.1.smithi073.stdout:4/759: chown d7/db/f4e 6502 1 2024-08-31T05:21:11.177 INFO:tasks.workunit.client.1.smithi073.stdout:9/914: mkdir dc/de/d127 0 2024-08-31T05:21:11.177 INFO:tasks.workunit.client.1.smithi073.stdout:9/915: chown dc/de/f4f 0 1 2024-08-31T05:21:11.179 INFO:tasks.workunit.client.0.smithi067.stdout:4/119: getdents d4 0 2024-08-31T05:21:11.180 INFO:tasks.workunit.client.0.smithi067.stdout:4/120: fsync d4/d1e/f26 0 2024-08-31T05:21:11.180 INFO:tasks.workunit.client.1.smithi073.stdout:0/870: creat d0/d69/d7f/d62/d10c/f126 x:0 0 0 2024-08-31T05:21:11.181 INFO:tasks.workunit.client.0.smithi067.stdout:4/121: chown d4/d9/cb 873681010 1 2024-08-31T05:21:11.183 INFO:tasks.workunit.client.1.smithi073.stdout:1/839: unlink d5/d26/da5/cb5 0 2024-08-31T05:21:11.187 INFO:tasks.workunit.client.1.smithi073.stdout:4/760: dread d7/d1a/d5c/d6d/d2c/d2d/f57 [0,4194304] 0 2024-08-31T05:21:11.187 INFO:tasks.workunit.client.0.smithi067.stdout:0/181: write d1/d8/f16 [1127702,129304] 0 2024-08-31T05:21:11.188 INFO:tasks.workunit.client.0.smithi067.stdout:9/97: symlink dd/l1d 0 2024-08-31T05:21:11.189 INFO:tasks.workunit.client.0.smithi067.stdout:9/98: fsync f3 0 2024-08-31T05:21:11.196 INFO:tasks.workunit.client.0.smithi067.stdout:6/284: truncate fd 1102076 0 2024-08-31T05:21:11.197 INFO:tasks.workunit.client.1.smithi073.stdout:2/833: write d2/d9/d7f/ffe [773814,127397] 0 2024-08-31T05:21:11.198 INFO:tasks.workunit.client.0.smithi067.stdout:5/94: creat db/d15/f1c x:0 0 0 2024-08-31T05:21:11.200 INFO:tasks.workunit.client.1.smithi073.stdout:7/845: mkdir d1/da/d15/d33/d44/d74/dd6/de3/d108 0 2024-08-31T05:21:11.202 INFO:tasks.workunit.client.1.smithi073.stdout:7/846: fsync d1/da/db2/fdb 0 2024-08-31T05:21:11.203 INFO:tasks.workunit.client.1.smithi073.stdout:6/814: write d15/d1a/d51/d61/fbf [264467,88562] 0 2024-08-31T05:21:11.204 INFO:tasks.workunit.client.1.smithi073.stdout:2/834: dwrite d2/d9/df/d43/fb7 [0,4194304] 0 2024-08-31T05:21:11.205 INFO:tasks.workunit.client.0.smithi067.stdout:3/112: link db/d17/c1b db/d12/c2b 0 2024-08-31T05:21:11.205 INFO:tasks.workunit.client.0.smithi067.stdout:3/113: chown db/c23 466355174 1 2024-08-31T05:21:11.206 INFO:tasks.workunit.client.1.smithi073.stdout:2/835: readlink d2/d9/l7b 0 2024-08-31T05:21:11.206 INFO:tasks.workunit.client.1.smithi073.stdout:1/840: mkdir d5/d26/d54/d5f/dfd 0 2024-08-31T05:21:11.207 INFO:tasks.workunit.client.0.smithi067.stdout:5/95: dwrite db/f1b [0,4194304] 0 2024-08-31T05:21:11.207 INFO:tasks.workunit.client.1.smithi073.stdout:3/923: dwrite da/d3c/d65/d45/dcd/d108/f1f [0,4194304] 0 2024-08-31T05:21:11.209 INFO:tasks.workunit.client.1.smithi073.stdout:6/815: write d15/d1a/d51/d61/f80 [928963,45562] 0 2024-08-31T05:21:11.209 INFO:tasks.workunit.client.1.smithi073.stdout:2/836: read d2/d9/d3c/fc5 [1900005,13597] 0 2024-08-31T05:21:11.213 INFO:tasks.workunit.client.1.smithi073.stdout:9/916: write dc/d37/d42/fa1 [783276,89674] 0 2024-08-31T05:21:11.217 INFO:tasks.workunit.client.0.smithi067.stdout:0/182: creat d1/dd/f40 x:0 0 0 2024-08-31T05:21:11.218 INFO:tasks.workunit.client.1.smithi073.stdout:7/847: dwrite d1/da/d15/d33/d44/d74/dd6/de6/fdc [0,4194304] 0 2024-08-31T05:21:11.220 INFO:tasks.workunit.client.1.smithi073.stdout:1/841: dwrite d5/d26/d54/db2/dd5/fca [0,4194304] 0 2024-08-31T05:21:11.223 INFO:tasks.workunit.client.0.smithi067.stdout:6/285: rename le to d1b/d23/d2f/l59 0 2024-08-31T05:21:11.232 INFO:tasks.workunit.client.0.smithi067.stdout:6/286: dwrite d1b/f43 [4194304,4194304] 0 2024-08-31T05:21:11.235 INFO:tasks.workunit.client.0.smithi067.stdout:6/287: dread f3 [0,4194304] 0 2024-08-31T05:21:11.237 INFO:tasks.workunit.client.0.smithi067.stdout:1/87: unlink d3/l8 0 2024-08-31T05:21:11.239 INFO:tasks.workunit.client.1.smithi073.stdout:6/816: symlink d15/d1a/d51/d61/d7c/da6/l10f 0 2024-08-31T05:21:11.242 INFO:tasks.workunit.client.0.smithi067.stdout:2/165: getdents db/dd/d13 0 2024-08-31T05:21:11.243 INFO:tasks.workunit.client.1.smithi073.stdout:2/837: dwrite d2/f35 [0,4194304] 0 2024-08-31T05:21:11.243 INFO:tasks.workunit.client.1.smithi073.stdout:9/917: rmdir dc/de/d66/d84/da2 39 2024-08-31T05:21:11.245 INFO:tasks.workunit.client.1.smithi073.stdout:1/842: rmdir d5/d26/da5/dba/d1c 39 2024-08-31T05:21:11.247 INFO:tasks.workunit.client.1.smithi073.stdout:0/871: creat d0/d15/d2c/f127 x:0 0 0 2024-08-31T05:21:11.250 INFO:tasks.workunit.client.1.smithi073.stdout:2/838: dwrite d2/d9/d27/d9b/da7/fa8 [4194304,4194304] 0 2024-08-31T05:21:11.254 INFO:tasks.workunit.client.0.smithi067.stdout:6/288: dwrite d1b/d23/d28/f46 [0,4194304] 0 2024-08-31T05:21:11.260 INFO:tasks.workunit.client.0.smithi067.stdout:1/88: dwrite d3/f13 [0,4194304] 0 2024-08-31T05:21:11.261 INFO:tasks.workunit.client.1.smithi073.stdout:7/848: mkdir d1/da/d15/d33/d44/d74/dd6/dea/dac/d103/d109 0 2024-08-31T05:21:11.266 INFO:tasks.workunit.client.0.smithi067.stdout:3/114: dwrite db/d27/f28 [0,4194304] 0 2024-08-31T05:21:11.267 INFO:tasks.workunit.client.1.smithi073.stdout:9/918: fdatasync dc/d27/f38 0 2024-08-31T05:21:11.267 INFO:tasks.workunit.client.0.smithi067.stdout:5/96: mkdir db/d1d 0 2024-08-31T05:21:11.268 INFO:tasks.workunit.client.0.smithi067.stdout:1/89: dread - d3/dd/fe zero size 2024-08-31T05:21:11.269 INFO:tasks.workunit.client.0.smithi067.stdout:4/122: write d4/d13/f1a [2865794,118029] 0 2024-08-31T05:21:11.269 INFO:tasks.workunit.client.1.smithi073.stdout:7/849: dwrite d1/da/d15/d33/d44/d74/dd6/dea/dac/ff2 [0,4194304] 0 2024-08-31T05:21:11.269 INFO:tasks.workunit.client.1.smithi073.stdout:9/919: write dc/de/d56/fbb [162819,86584] 0 2024-08-31T05:21:11.270 INFO:tasks.workunit.client.1.smithi073.stdout:9/920: chown dc/d27/f38 41 1 2024-08-31T05:21:11.272 INFO:tasks.workunit.client.0.smithi067.stdout:9/99: creat dd/f1e x:0 0 0 2024-08-31T05:21:11.272 INFO:tasks.workunit.client.1.smithi073.stdout:7/850: fsync d1/da/d15/d33/d44/d60/de1/fe8 0 2024-08-31T05:21:11.274 INFO:tasks.workunit.client.0.smithi067.stdout:9/100: write dd/df/f15 [920031,4721] 0 2024-08-31T05:21:11.276 INFO:tasks.workunit.client.1.smithi073.stdout:1/843: creat d5/d26/da5/ffe x:0 0 0 2024-08-31T05:21:11.278 INFO:tasks.workunit.client.0.smithi067.stdout:7/106: getdents d14/d16 0 2024-08-31T05:21:11.280 INFO:tasks.workunit.client.1.smithi073.stdout:1/844: write d5/d26/d54/f6c [920117,45577] 0 2024-08-31T05:21:11.282 INFO:tasks.workunit.client.1.smithi073.stdout:4/761: dwrite d7/db/f4f [0,4194304] 0 2024-08-31T05:21:11.285 INFO:tasks.workunit.client.1.smithi073.stdout:4/762: chown d7/df/d13/d2e 61135 1 2024-08-31T05:21:11.285 INFO:tasks.workunit.client.0.smithi067.stdout:6/289: mknod d1b/d23/d2f/c5a 0 2024-08-31T05:21:11.285 INFO:tasks.workunit.client.0.smithi067.stdout:3/115: dread f6 [0,4194304] 0 2024-08-31T05:21:11.287 INFO:tasks.workunit.client.0.smithi067.stdout:3/116: write db/f10 [3860901,130293] 0 2024-08-31T05:21:11.288 INFO:tasks.workunit.client.1.smithi073.stdout:3/924: dwrite da/d3c/d82/d97/fd4 [0,4194304] 0 2024-08-31T05:21:11.289 INFO:tasks.workunit.client.0.smithi067.stdout:3/117: chown db/lf 38 1 2024-08-31T05:21:11.290 INFO:tasks.workunit.client.0.smithi067.stdout:4/123: symlink d4/l2a 0 2024-08-31T05:21:11.291 INFO:tasks.workunit.client.0.smithi067.stdout:3/118: fsync db/d12/f18 0 2024-08-31T05:21:11.292 INFO:tasks.workunit.client.1.smithi073.stdout:7/851: mkdir d1/da/d3e/d22/d5c/dc6/d10a 0 2024-08-31T05:21:11.292 INFO:tasks.workunit.client.1.smithi073.stdout:6/817: dwrite d15/d17/f91 [0,4194304] 0 2024-08-31T05:21:11.293 INFO:tasks.workunit.client.0.smithi067.stdout:3/119: chown db/c23 10 1 2024-08-31T05:21:11.297 INFO:tasks.workunit.client.1.smithi073.stdout:0/872: mknod d0/d69/d7f/d68/d91/df5/d3c/d9c/db6/de0/c128 0 2024-08-31T05:21:11.297 INFO:tasks.workunit.client.0.smithi067.stdout:5/97: truncate f2 3101575 0 2024-08-31T05:21:11.297 INFO:tasks.workunit.client.0.smithi067.stdout:3/120: dread - db/d17/f24 zero size 2024-08-31T05:21:11.297 INFO:tasks.workunit.client.0.smithi067.stdout:6/290: dwrite d1b/d23/d2e/d3b/f48 [0,4194304] 0 2024-08-31T05:21:11.297 INFO:tasks.workunit.client.1.smithi073.stdout:3/925: read da/d3c/d67/fb6 [125599,50633] 0 2024-08-31T05:21:11.299 INFO:tasks.workunit.client.0.smithi067.stdout:9/101: rename f4 to dd/df/f1f 0 2024-08-31T05:21:11.300 INFO:tasks.workunit.client.1.smithi073.stdout:3/926: write da/d3c/d65/d40/d5d/fe4 [4392001,6439] 0 2024-08-31T05:21:11.303 INFO:tasks.workunit.client.0.smithi067.stdout:1/90: unlink d3/l18 0 2024-08-31T05:21:11.305 INFO:tasks.workunit.client.1.smithi073.stdout:8/839: sync 2024-08-31T05:21:11.307 INFO:tasks.workunit.client.0.smithi067.stdout:5/98: dwrite db/d15/f1c [0,4194304] 0 2024-08-31T05:21:11.308 INFO:tasks.workunit.client.1.smithi073.stdout:7/852: creat d1/da/d3e/d22/d6b/ddf/f10b x:0 0 0 2024-08-31T05:21:11.310 INFO:tasks.workunit.client.0.smithi067.stdout:4/124: rmdir d4/d13 39 2024-08-31T05:21:11.310 INFO:tasks.workunit.client.1.smithi073.stdout:3/927: dwrite da/d3c/d82/d95/ff4 [0,4194304] 0 2024-08-31T05:21:11.317 INFO:tasks.workunit.client.0.smithi067.stdout:6/291: rename d1b/d23/d28/f4d to d1b/d23/d28/d45/f5b 0 2024-08-31T05:21:11.318 INFO:tasks.workunit.client.1.smithi073.stdout:4/763: dread d7/df/f21 [0,4194304] 0 2024-08-31T05:21:11.319 INFO:tasks.workunit.client.0.smithi067.stdout:7/107: symlink d14/l21 0 2024-08-31T05:21:11.320 INFO:tasks.workunit.client.0.smithi067.stdout:7/108: dread - d14/d16/f1d zero size 2024-08-31T05:21:11.321 INFO:tasks.workunit.client.1.smithi073.stdout:9/921: dread dc/d10/f26 [0,4194304] 0 2024-08-31T05:21:11.321 INFO:tasks.workunit.client.0.smithi067.stdout:7/109: chown d14/d16/l19 514802 1 2024-08-31T05:21:11.322 INFO:tasks.workunit.client.0.smithi067.stdout:7/110: write d14/d16/f1b [1774750,100665] 0 2024-08-31T05:21:11.324 INFO:tasks.workunit.client.1.smithi073.stdout:2/839: dwrite d2/d9/d3c/fc5 [0,4194304] 0 2024-08-31T05:21:11.324 INFO:tasks.workunit.client.1.smithi073.stdout:8/840: symlink d0/db/d44/d72/d79/l10a 0 2024-08-31T05:21:11.324 INFO:tasks.workunit.client.0.smithi067.stdout:7/111: truncate f7 1167095 0 2024-08-31T05:21:11.325 INFO:tasks.workunit.client.0.smithi067.stdout:7/112: chown d14/d16/l19 1984763 1 2024-08-31T05:21:11.325 INFO:tasks.workunit.client.1.smithi073.stdout:8/841: fsync d0/db/d1c/d34/d38/f108 0 2024-08-31T05:21:11.326 INFO:tasks.workunit.client.1.smithi073.stdout:8/842: readlink d0/db/d1c/d24/d73/db0/lc7 0 2024-08-31T05:21:11.327 INFO:tasks.workunit.client.0.smithi067.stdout:4/125: write d4/d13/f24 [1028523,119883] 0 2024-08-31T05:21:11.328 INFO:tasks.workunit.client.1.smithi073.stdout:7/853: rename d1/da/d65/cae to d1/da/d15/d33/d44/d60/de1/c10c 0 2024-08-31T05:21:11.329 INFO:tasks.workunit.client.0.smithi067.stdout:9/102: mkdir dd/d20 0 2024-08-31T05:21:11.330 INFO:tasks.workunit.client.1.smithi073.stdout:4/764: fsync d7/df/f21 0 2024-08-31T05:21:11.332 INFO:tasks.workunit.client.1.smithi073.stdout:4/765: dread d7/db/f77 [0,4194304] 0 2024-08-31T05:21:11.334 INFO:tasks.workunit.client.0.smithi067.stdout:6/292: mkdir d1b/d23/d28/d45/d5c 0 2024-08-31T05:21:11.335 INFO:tasks.workunit.client.1.smithi073.stdout:0/873: link d0/d69/d7f/d68/d91/df5/d3c/c66 d0/d69/d7f/d62/c129 0 2024-08-31T05:21:11.335 INFO:tasks.workunit.client.1.smithi073.stdout:6/818: dread d15/d1a/d51/d6e/fd4 [0,4194304] 0 2024-08-31T05:21:11.335 INFO:tasks.workunit.client.0.smithi067.stdout:0/183: write d1/d8/f35 [1115101,37690] 0 2024-08-31T05:21:11.337 INFO:tasks.workunit.client.1.smithi073.stdout:0/874: write d0/d69/d7f/d68/d91/df5/d3c/d9c/de4/fc9 [875752,96660] 0 2024-08-31T05:21:11.337 INFO:tasks.workunit.client.1.smithi073.stdout:3/928: rename da/f62 to da/d3c/d65/d45/dcd/f123 0 2024-08-31T05:21:11.339 INFO:tasks.workunit.client.1.smithi073.stdout:8/843: dread d0/db/d44/d4e/f63 [0,4194304] 0 2024-08-31T05:21:11.340 INFO:tasks.workunit.client.0.smithi067.stdout:6/293: mknod d1b/d23/d28/d45/c5d 0 2024-08-31T05:21:11.341 INFO:tasks.workunit.client.1.smithi073.stdout:9/922: creat dc/d37/d42/d5a/da0/dcd/d105/f128 x:0 0 0 2024-08-31T05:21:11.342 INFO:tasks.workunit.client.0.smithi067.stdout:5/99: creat db/f1e x:0 0 0 2024-08-31T05:21:11.344 INFO:tasks.workunit.client.0.smithi067.stdout:4/126: mknod d4/d1e/d21/c2b 0 2024-08-31T05:21:11.345 INFO:tasks.workunit.client.0.smithi067.stdout:4/127: truncate d4/f25 906875 0 2024-08-31T05:21:11.346 INFO:tasks.workunit.client.0.smithi067.stdout:6/294: mkdir d1b/d23/d28/d45/d5e 0 2024-08-31T05:21:11.348 INFO:tasks.workunit.client.1.smithi073.stdout:6/819: mknod d15/d1a/d51/d61/d7c/da6/c110 0 2024-08-31T05:21:11.350 INFO:tasks.workunit.client.1.smithi073.stdout:3/929: mknod da/d3c/d65/d45/dcd/c124 0 2024-08-31T05:21:11.351 INFO:tasks.workunit.client.1.smithi073.stdout:0/875: rmdir d0/d69/d7f/d68/d91/df5/d3c/d9c/db6/de6 39 2024-08-31T05:21:11.355 INFO:tasks.workunit.client.1.smithi073.stdout:7/854: dread d1/da/f32 [0,4194304] 0 2024-08-31T05:21:11.355 INFO:tasks.workunit.client.1.smithi073.stdout:8/844: rename d0/db/d1c/d34/d80/d9a/lc4 to d0/db/d1c/d34/d38/d106/l10b 0 2024-08-31T05:21:11.356 INFO:tasks.workunit.client.1.smithi073.stdout:7/855: write d1/da/d15/d33/d44/d74/fb4 [2237865,82439] 0 2024-08-31T05:21:11.357 INFO:tasks.workunit.client.1.smithi073.stdout:7/856: chown d1/d11/d91/laa 5396 1 2024-08-31T05:21:11.360 INFO:tasks.workunit.client.0.smithi067.stdout:6/295: creat d1b/d23/d28/d45/d5e/f5f x:0 0 0 2024-08-31T05:21:11.362 INFO:tasks.workunit.client.1.smithi073.stdout:8/845: dread d0/db/d1c/d24/d73/f9b [0,4194304] 0 2024-08-31T05:21:11.363 INFO:tasks.workunit.client.0.smithi067.stdout:9/103: dread f6 [0,4194304] 0 2024-08-31T05:21:11.364 INFO:tasks.workunit.client.0.smithi067.stdout:1/91: dread - d3/dd/f1c zero size 2024-08-31T05:21:11.365 INFO:tasks.workunit.client.0.smithi067.stdout:3/121: write db/d12/f16 [407139,31570] 0 2024-08-31T05:21:11.366 INFO:tasks.workunit.client.0.smithi067.stdout:4/128: rename d4/d9/l12 to d4/l2c 0 2024-08-31T05:21:11.367 INFO:tasks.workunit.client.0.smithi067.stdout:6/296: rename d1b/d40 to d1b/d40/d60 22 2024-08-31T05:21:11.367 INFO:tasks.workunit.client.0.smithi067.stdout:4/129: stat d4/d1f 0 2024-08-31T05:21:11.370 INFO:tasks.workunit.client.1.smithi073.stdout:1/845: truncate d5/d26/da5/dba/d1b/f63 4776006 0 2024-08-31T05:21:11.371 INFO:tasks.workunit.client.0.smithi067.stdout:1/92: readlink d3/l9 0 2024-08-31T05:21:11.372 INFO:tasks.workunit.client.1.smithi073.stdout:0/876: dread d0/fd9 [0,4194304] 0 2024-08-31T05:21:11.374 INFO:tasks.workunit.client.1.smithi073.stdout:8/846: dwrite d0/db/d1c/d34/d38/f60 [0,4194304] 0 2024-08-31T05:21:11.374 INFO:tasks.workunit.client.1.smithi073.stdout:9/923: mknod dc/c129 0 2024-08-31T05:21:11.375 INFO:tasks.workunit.client.0.smithi067.stdout:4/130: mknod d4/d1e/d21/c2d 0 2024-08-31T05:21:11.384 INFO:tasks.workunit.client.0.smithi067.stdout:1/93: creat d3/dd/f1d x:0 0 0 2024-08-31T05:21:11.390 INFO:tasks.workunit.client.0.smithi067.stdout:6/297: rename d1b/d30/d4a to d1b/d23/d61 0 2024-08-31T05:21:11.390 INFO:tasks.workunit.client.1.smithi073.stdout:2/840: dwrite d2/d9/d66/d70/f74 [0,4194304] 0 2024-08-31T05:21:11.391 INFO:tasks.workunit.client.1.smithi073.stdout:2/841: write d2/d25/f93 [5321725,57733] 0 2024-08-31T05:21:11.393 INFO:tasks.workunit.client.0.smithi067.stdout:5/100: truncate f7 472228 0 2024-08-31T05:21:11.398 INFO:tasks.workunit.client.0.smithi067.stdout:6/298: dwrite d1b/d23/f4f [0,4194304] 0 2024-08-31T05:21:11.401 INFO:tasks.workunit.client.0.smithi067.stdout:6/299: write d1b/d23/d28/d45/d5e/f5f [381900,21880] 0 2024-08-31T05:21:11.402 INFO:tasks.workunit.client.0.smithi067.stdout:6/300: stat d1b/c1f 0 2024-08-31T05:21:11.402 INFO:tasks.workunit.client.0.smithi067.stdout:6/301: readlink d1b/l4c 0 2024-08-31T05:21:11.405 INFO:tasks.workunit.client.0.smithi067.stdout:1/94: link d3/f14 d3/f1e 0 2024-08-31T05:21:11.406 INFO:tasks.workunit.client.0.smithi067.stdout:3/122: write f6 [1199807,114773] 0 2024-08-31T05:21:11.408 INFO:tasks.workunit.client.1.smithi073.stdout:7/857: write d1/da/d15/d33/d44/d74/dd6/dea/f5b [1616754,57034] 0 2024-08-31T05:21:11.409 INFO:tasks.workunit.client.0.smithi067.stdout:6/302: mkdir d1b/d23/d2f/d62 0 2024-08-31T05:21:11.410 INFO:tasks.workunit.client.0.smithi067.stdout:9/104: truncate dd/f1a 2703842 0 2024-08-31T05:21:11.411 INFO:tasks.workunit.client.0.smithi067.stdout:9/105: truncate dd/f1e 510303 0 2024-08-31T05:21:11.413 INFO:tasks.workunit.client.1.smithi073.stdout:7/858: dwrite d1/da/d3e/d22/d47/f51 [0,4194304] 0 2024-08-31T05:21:11.414 INFO:tasks.workunit.client.0.smithi067.stdout:3/123: stat db/le 0 2024-08-31T05:21:11.415 INFO:tasks.workunit.client.1.smithi073.stdout:6/820: dwrite d15/d17/f5c [0,4194304] 0 2024-08-31T05:21:11.417 INFO:tasks.workunit.client.0.smithi067.stdout:9/106: chown dd/c16 77577213 1 2024-08-31T05:21:11.422 INFO:tasks.workunit.client.0.smithi067.stdout:3/124: dwrite db/f10 [4194304,4194304] 0 2024-08-31T05:21:11.427 INFO:tasks.workunit.client.0.smithi067.stdout:5/101: dread f4 [0,4194304] 0 2024-08-31T05:21:11.429 INFO:tasks.workunit.client.0.smithi067.stdout:9/107: symlink dd/df/l21 0 2024-08-31T05:21:11.433 INFO:tasks.workunit.client.0.smithi067.stdout:3/125: dwrite db/f14 [0,4194304] 0 2024-08-31T05:21:11.434 INFO:tasks.workunit.client.0.smithi067.stdout:3/126: readlink db/d17/l22 0 2024-08-31T05:21:11.438 INFO:tasks.workunit.client.0.smithi067.stdout:3/127: rmdir db/d12 39 2024-08-31T05:21:11.439 INFO:tasks.workunit.client.0.smithi067.stdout:5/102: mknod db/c1f 0 2024-08-31T05:21:11.441 INFO:tasks.workunit.client.0.smithi067.stdout:5/103: write db/f1e [871245,74638] 0 2024-08-31T05:21:11.442 INFO:tasks.workunit.client.0.smithi067.stdout:5/104: write db/d15/f1c [1652337,54900] 0 2024-08-31T05:21:11.443 INFO:tasks.workunit.client.0.smithi067.stdout:5/105: chown l3 9855778 1 2024-08-31T05:21:11.448 INFO:tasks.workunit.client.0.smithi067.stdout:3/128: chown db/d12/d21/f19 1011 1 2024-08-31T05:21:11.451 INFO:tasks.workunit.client.0.smithi067.stdout:5/106: dwrite db/f19 [0,4194304] 0 2024-08-31T05:21:11.453 INFO:tasks.workunit.client.0.smithi067.stdout:1/95: dread d3/f15 [0,4194304] 0 2024-08-31T05:21:11.460 INFO:tasks.workunit.client.0.smithi067.stdout:3/129: mkdir db/d2c 0 2024-08-31T05:21:11.463 INFO:tasks.workunit.client.0.smithi067.stdout:3/130: read db/fd [622119,68373] 0 2024-08-31T05:21:11.463 INFO:tasks.workunit.client.0.smithi067.stdout:3/131: fdatasync db/f14 0 2024-08-31T05:21:11.465 INFO:tasks.workunit.client.0.smithi067.stdout:6/303: truncate d1b/d23/d28/d45/f5b 1410149 0 2024-08-31T05:21:11.466 INFO:tasks.workunit.client.0.smithi067.stdout:5/107: dread f2 [0,4194304] 0 2024-08-31T05:21:11.469 INFO:tasks.workunit.client.0.smithi067.stdout:3/132: dread db/d27/f28 [0,4194304] 0 2024-08-31T05:21:11.469 INFO:tasks.workunit.client.0.smithi067.stdout:3/133: chown db/d17 0 1 2024-08-31T05:21:11.469 INFO:tasks.workunit.client.0.smithi067.stdout:3/134: stat db/d2c 0 2024-08-31T05:21:11.470 INFO:tasks.workunit.client.0.smithi067.stdout:3/135: truncate db/d17/f24 52135 0 2024-08-31T05:21:11.471 INFO:tasks.workunit.client.0.smithi067.stdout:3/136: dread - db/d12/f1f zero size 2024-08-31T05:21:11.472 INFO:tasks.workunit.client.1.smithi073.stdout:8/847: sync 2024-08-31T05:21:11.473 INFO:tasks.workunit.client.1.smithi073.stdout:8/848: fsync d0/db/d44/d4e/f63 0 2024-08-31T05:21:11.473 INFO:tasks.workunit.client.0.smithi067.stdout:6/304: unlink d1b/d23/c2d 0 2024-08-31T05:21:11.481 INFO:tasks.workunit.client.0.smithi067.stdout:1/96: rename d3/c17 to d3/c1f 0 2024-08-31T05:21:11.487 INFO:tasks.workunit.client.0.smithi067.stdout:3/137: mknod db/d2c/c2d 0 2024-08-31T05:21:11.490 INFO:tasks.workunit.client.0.smithi067.stdout:1/97: truncate d3/dd/f12 753844 0 2024-08-31T05:21:11.491 INFO:tasks.workunit.client.0.smithi067.stdout:1/98: fsync d3/dd/f1a 0 2024-08-31T05:21:11.493 INFO:tasks.workunit.client.1.smithi073.stdout:1/846: symlink d5/d26/d54/db2/dd5/d2a/d80/lff 0 2024-08-31T05:21:11.494 INFO:tasks.workunit.client.1.smithi073.stdout:1/847: readlink d5/d26/da5/dba/d33/la3 0 2024-08-31T05:21:11.495 INFO:tasks.workunit.client.1.smithi073.stdout:1/848: write d5/d26/da5/dba/d33/d13/d7e/fbf [1385461,103481] 0 2024-08-31T05:21:11.496 INFO:tasks.workunit.client.0.smithi067.stdout:3/138: mkdir db/d2e 0 2024-08-31T05:21:11.496 INFO:tasks.workunit.client.0.smithi067.stdout:3/139: chown db/d12/d21/f19 2032687533 1 2024-08-31T05:21:11.497 INFO:tasks.workunit.client.1.smithi073.stdout:1/849: write d5/d26/d54/db2/dd5/d32/d37/d6f/dc7/ff0 [196506,61579] 0 2024-08-31T05:21:11.498 INFO:tasks.workunit.client.1.smithi073.stdout:1/850: dread - d5/d26/d54/db2/fe7 zero size 2024-08-31T05:21:11.500 INFO:tasks.workunit.client.1.smithi073.stdout:1/851: chown d5/d26/d54/db2/dd5/d32/daf/db1/fd7 8124 1 2024-08-31T05:21:11.502 INFO:tasks.workunit.client.1.smithi073.stdout:4/766: getdents d7/df/d13/d2e/d47/d4c 0 2024-08-31T05:21:11.503 INFO:tasks.workunit.client.0.smithi067.stdout:5/108: truncate db/f19 3934436 0 2024-08-31T05:21:11.504 INFO:tasks.workunit.client.1.smithi073.stdout:3/930: rmdir da/d3c/dda/df7 0 2024-08-31T05:21:11.505 INFO:tasks.workunit.client.0.smithi067.stdout:6/305: chown d1b/d23/d28/d45/f5b 12 1 2024-08-31T05:21:11.510 INFO:tasks.workunit.client.1.smithi073.stdout:3/931: fsync da/d3c/d65/d45/dcd/d108/da2/f104 0 2024-08-31T05:21:11.511 INFO:tasks.workunit.client.0.smithi067.stdout:5/109: unlink db/cc 0 2024-08-31T05:21:11.511 INFO:tasks.workunit.client.0.smithi067.stdout:5/110: rename db to db/d1d/d20 22 2024-08-31T05:21:11.512 INFO:tasks.workunit.client.1.smithi073.stdout:9/924: write dc/de/f4f [1281627,39315] 0 2024-08-31T05:21:11.515 INFO:tasks.workunit.client.0.smithi067.stdout:3/140: creat db/d12/f2f x:0 0 0 2024-08-31T05:21:11.515 INFO:tasks.workunit.client.0.smithi067.stdout:1/99: write d3/f1e [116082,14093] 0 2024-08-31T05:21:11.525 INFO:tasks.workunit.client.0.smithi067.stdout:1/100: creat d3/dd/f20 x:0 0 0 2024-08-31T05:21:11.526 INFO:tasks.workunit.client.0.smithi067.stdout:6/306: write f14 [1522947,22173] 0 2024-08-31T05:21:11.527 INFO:tasks.workunit.client.1.smithi073.stdout:7/859: write d1/da/f32 [3133432,57756] 0 2024-08-31T05:21:11.529 INFO:tasks.workunit.client.0.smithi067.stdout:5/111: creat db/f21 x:0 0 0 2024-08-31T05:21:11.530 INFO:tasks.workunit.client.0.smithi067.stdout:5/112: stat db 0 2024-08-31T05:21:11.530 INFO:tasks.workunit.client.0.smithi067.stdout:5/113: fdatasync f9 0 2024-08-31T05:21:11.530 INFO:tasks.workunit.client.1.smithi073.stdout:0/877: truncate d0/d15/d2c/d41/faf 2552792 0 2024-08-31T05:21:11.531 INFO:tasks.workunit.client.0.smithi067.stdout:3/141: symlink db/d12/l30 0 2024-08-31T05:21:11.532 INFO:tasks.workunit.client.1.smithi073.stdout:1/852: mknod d5/d26/d54/db2/dd5/d3f/c100 0 2024-08-31T05:21:11.533 INFO:tasks.workunit.client.1.smithi073.stdout:1/853: readlink d5/d26/d54/db2/dd5/d3f/d9f/lbe 0 2024-08-31T05:21:11.533 INFO:tasks.workunit.client.0.smithi067.stdout:3/142: dread f6 [0,4194304] 0 2024-08-31T05:21:11.534 INFO:tasks.workunit.client.0.smithi067.stdout:3/143: stat db/c1d 0 2024-08-31T05:21:11.534 INFO:tasks.workunit.client.1.smithi073.stdout:1/854: write d5/d26/d54/db2/dd5/d2a/d80/d93/fbb [7113534,5695] 0 2024-08-31T05:21:11.534 INFO:tasks.workunit.client.1.smithi073.stdout:4/767: mknod d7/d1a/d5c/d6d/d59/cf2 0 2024-08-31T05:21:11.535 INFO:tasks.workunit.client.0.smithi067.stdout:1/101: creat d3/dd/f21 x:0 0 0 2024-08-31T05:21:11.536 INFO:tasks.workunit.client.0.smithi067.stdout:5/114: creat db/d15/f22 x:0 0 0 2024-08-31T05:21:11.538 INFO:tasks.workunit.client.0.smithi067.stdout:6/307: fsync d1b/d23/d28/f2b 0 2024-08-31T05:21:11.539 INFO:tasks.workunit.client.1.smithi073.stdout:9/925: creat dc/d37/d42/d5a/da0/dcd/d105/f12a x:0 0 0 2024-08-31T05:21:11.539 INFO:tasks.workunit.client.0.smithi067.stdout:3/144: creat db/d2c/f31 x:0 0 0 2024-08-31T05:21:11.540 INFO:tasks.workunit.client.1.smithi073.stdout:6/821: symlink d15/d1a/d2b/d2f/l111 0 2024-08-31T05:21:11.541 INFO:tasks.workunit.client.1.smithi073.stdout:6/822: dread - d15/d17/da1/dae/db0/d38/ff1 zero size 2024-08-31T05:21:11.541 INFO:tasks.workunit.client.0.smithi067.stdout:1/102: mknod d3/dd/c22 0 2024-08-31T05:21:11.541 INFO:tasks.workunit.client.1.smithi073.stdout:6/823: stat d15/d1a/d2b/cef 0 2024-08-31T05:21:11.542 INFO:tasks.workunit.client.1.smithi073.stdout:8/849: creat d0/d62/db4/de7/f10c x:0 0 0 2024-08-31T05:21:11.542 INFO:tasks.workunit.client.1.smithi073.stdout:8/850: stat d0/db/d1c/d34/d38/f8b 0 2024-08-31T05:21:11.543 INFO:tasks.workunit.client.0.smithi067.stdout:5/115: unlink la 0 2024-08-31T05:21:11.543 INFO:tasks.workunit.client.0.smithi067.stdout:3/145: dread db/f10 [0,4194304] 0 2024-08-31T05:21:11.545 INFO:tasks.workunit.client.1.smithi073.stdout:7/860: creat d1/da/d15/d33/d44/d74/dd6/de3/f10d x:0 0 0 2024-08-31T05:21:11.546 INFO:tasks.workunit.client.1.smithi073.stdout:7/861: write d1/da/d15/d33/d44/d60/f9b [646430,18854] 0 2024-08-31T05:21:11.547 INFO:tasks.workunit.client.0.smithi067.stdout:6/308: chown d1b/d23/d2f/c5a 757 1 2024-08-31T05:21:11.548 INFO:tasks.workunit.client.1.smithi073.stdout:0/878: dread d0/d15/d2c/d40/f56 [0,4194304] 0 2024-08-31T05:21:11.548 INFO:tasks.workunit.client.1.smithi073.stdout:0/879: chown d0/f29 1 1 2024-08-31T05:21:11.549 INFO:tasks.workunit.client.1.smithi073.stdout:3/932: symlink da/d3c/d67/l125 0 2024-08-31T05:21:11.551 INFO:tasks.workunit.client.1.smithi073.stdout:4/768: rename d7/d1a/d5c/d6d/d59/d65/db9/dd6/fd7 to d7/d1a/d5c/d6d/d2c/d2d/ff3 0 2024-08-31T05:21:11.551 INFO:tasks.workunit.client.1.smithi073.stdout:4/769: chown d7/df/d79 1423686354 1 2024-08-31T05:21:11.553 INFO:tasks.workunit.client.1.smithi073.stdout:8/851: dread d0/db/d1c/f20 [0,4194304] 0 2024-08-31T05:21:11.553 INFO:tasks.workunit.client.1.smithi073.stdout:2/842: creat d2/d9/d7f/dab/d5d/f106 x:0 0 0 2024-08-31T05:21:11.555 INFO:tasks.workunit.client.1.smithi073.stdout:6/824: readlink d15/d1a/d1e/d69/d7e/lde 0 2024-08-31T05:21:11.557 INFO:tasks.workunit.client.0.smithi067.stdout:3/146: dread db/d27/f28 [0,4194304] 0 2024-08-31T05:21:11.557 INFO:tasks.workunit.client.1.smithi073.stdout:7/862: creat d1/da/d15/d33/d44/d74/dd6/de6/d84/f10e x:0 0 0 2024-08-31T05:21:11.558 INFO:tasks.workunit.client.0.smithi067.stdout:3/147: chown db/d12/f18 7 1 2024-08-31T05:21:11.559 INFO:tasks.workunit.client.1.smithi073.stdout:1/855: mknod d5/d26/da5/dba/d1c/d27/ded/c101 0 2024-08-31T05:21:11.561 INFO:tasks.workunit.client.0.smithi067.stdout:1/103: mkdir d3/d23 0 2024-08-31T05:21:11.562 INFO:tasks.workunit.client.0.smithi067.stdout:5/116: getdents db/d1d 0 2024-08-31T05:21:11.564 INFO:tasks.workunit.client.1.smithi073.stdout:0/880: rmdir d0/d28 39 2024-08-31T05:21:11.564 INFO:tasks.workunit.client.0.smithi067.stdout:5/117: truncate db/d15/f22 979588 0 2024-08-31T05:21:11.564 INFO:tasks.workunit.client.0.smithi067.stdout:5/118: chown db/d15 33 1 2024-08-31T05:21:11.567 INFO:tasks.workunit.client.1.smithi073.stdout:3/933: symlink da/d3c/d65/d40/l126 0 2024-08-31T05:21:11.572 INFO:tasks.workunit.client.1.smithi073.stdout:8/852: mkdir d0/da8/d10d 0 2024-08-31T05:21:11.576 INFO:tasks.workunit.client.0.smithi067.stdout:5/119: truncate f7 1310866 0 2024-08-31T05:21:11.577 INFO:tasks.workunit.client.1.smithi073.stdout:1/856: rmdir d5/d26/d54 39 2024-08-31T05:21:11.578 INFO:tasks.workunit.client.0.smithi067.stdout:6/309: getdents d1b/d30 0 2024-08-31T05:21:11.579 INFO:tasks.workunit.client.0.smithi067.stdout:3/148: dwrite f6 [0,4194304] 0 2024-08-31T05:21:11.581 INFO:tasks.workunit.client.1.smithi073.stdout:3/934: unlink da/d68/f7e 0 2024-08-31T05:21:11.584 INFO:tasks.workunit.client.0.smithi067.stdout:6/310: fdatasync f18 0 2024-08-31T05:21:11.586 INFO:tasks.workunit.client.0.smithi067.stdout:1/104: getdents d3 0 2024-08-31T05:21:11.588 INFO:tasks.workunit.client.1.smithi073.stdout:8/853: chown d0/db/d44/d72/d75/d7e/d91/dac/cfc 15204 1 2024-08-31T05:21:11.591 INFO:tasks.workunit.client.0.smithi067.stdout:5/120: symlink db/l23 0 2024-08-31T05:21:11.591 INFO:tasks.workunit.client.0.smithi067.stdout:6/311: write f18 [971366,8077] 0 2024-08-31T05:21:11.593 INFO:tasks.workunit.client.1.smithi073.stdout:4/770: truncate d7/df/d79/fec 619896 0 2024-08-31T05:21:11.596 INFO:tasks.workunit.client.1.smithi073.stdout:2/843: creat d2/d9/f107 x:0 0 0 2024-08-31T05:21:11.596 INFO:tasks.workunit.client.1.smithi073.stdout:2/844: fdatasync d2/d9/d3c/f5c 0 2024-08-31T05:21:11.599 INFO:tasks.workunit.client.0.smithi067.stdout:3/149: dread db/d12/d21/f25 [0,4194304] 0 2024-08-31T05:21:11.599 INFO:tasks.workunit.client.1.smithi073.stdout:8/854: mknod d0/db/d44/d72/d79/c10e 0 2024-08-31T05:21:11.599 INFO:tasks.workunit.client.1.smithi073.stdout:8/855: readlink d0/d62/l101 0 2024-08-31T05:21:11.601 INFO:tasks.workunit.client.0.smithi067.stdout:6/312: fdatasync d1b/d23/d2e/d3b/f48 0 2024-08-31T05:21:11.601 INFO:tasks.workunit.client.1.smithi073.stdout:6/825: creat d15/d75/f112 x:0 0 0 2024-08-31T05:21:11.604 INFO:tasks.workunit.client.1.smithi073.stdout:6/826: dread - d15/d17/da1/dae/db0/fee zero size 2024-08-31T05:21:11.606 INFO:tasks.workunit.client.1.smithi073.stdout:7/863: dwrite d1/da/d96/fa4 [0,4194304] 0 2024-08-31T05:21:11.607 INFO:tasks.workunit.client.1.smithi073.stdout:0/881: dread d0/f21 [0,4194304] 0 2024-08-31T05:21:11.607 INFO:tasks.workunit.client.0.smithi067.stdout:5/121: write db/d15/f18 [834302,54964] 0 2024-08-31T05:21:11.608 INFO:tasks.workunit.client.1.smithi073.stdout:1/857: mkdir d5/d26/d54/db2/ddb/d102 0 2024-08-31T05:21:11.609 INFO:tasks.workunit.client.0.smithi067.stdout:1/105: dwrite d3/f6 [8388608,4194304] 0 2024-08-31T05:21:11.610 INFO:tasks.workunit.client.1.smithi073.stdout:0/882: readlink d0/d69/d7f/d68/d91/df5/d3c/d9c/dc8/l11e 0 2024-08-31T05:21:11.611 INFO:tasks.workunit.client.0.smithi067.stdout:1/106: fdatasync f2 0 2024-08-31T05:21:11.612 INFO:tasks.workunit.client.1.smithi073.stdout:0/883: truncate d0/d69/d7f/d62/dbf/ff2 568515 0 2024-08-31T05:21:11.612 INFO:tasks.workunit.client.0.smithi067.stdout:3/150: write db/d27/f28 [2381041,7507] 0 2024-08-31T05:21:11.612 INFO:tasks.workunit.client.0.smithi067.stdout:6/313: symlink d1b/d23/d2e/l63 0 2024-08-31T05:21:11.613 INFO:tasks.workunit.client.1.smithi073.stdout:0/884: write d0/d69/d8e/d99/fa9 [581371,83031] 0 2024-08-31T05:21:11.618 INFO:tasks.workunit.client.1.smithi073.stdout:8/856: rmdir d0/db/d1c/d34/d38/d106 39 2024-08-31T05:21:11.622 INFO:tasks.workunit.client.0.smithi067.stdout:1/107: creat d3/f24 x:0 0 0 2024-08-31T05:21:11.622 INFO:tasks.workunit.client.0.smithi067.stdout:6/314: dwrite d1b/f43 [4194304,4194304] 0 2024-08-31T05:21:11.625 INFO:tasks.workunit.client.0.smithi067.stdout:3/151: dwrite db/d12/f1f [0,4194304] 0 2024-08-31T05:21:11.625 INFO:tasks.workunit.client.0.smithi067.stdout:6/315: chown d1b/d23/d28/f2b 3770631 1 2024-08-31T05:21:11.634 INFO:tasks.workunit.client.0.smithi067.stdout:3/152: dwrite db/f14 [0,4194304] 0 2024-08-31T05:21:11.641 INFO:tasks.workunit.client.1.smithi073.stdout:9/926: sync 2024-08-31T05:21:11.644 INFO:tasks.workunit.client.1.smithi073.stdout:0/885: rmdir d0/d69/d7f/d62/dbf 39 2024-08-31T05:21:11.644 INFO:tasks.workunit.client.1.smithi073.stdout:4/771: write d7/df/d13/d53/f80 [757583,39488] 0 2024-08-31T05:21:11.645 INFO:tasks.workunit.client.1.smithi073.stdout:2/845: unlink d2/d9/d27/d76/db5/lf2 0 2024-08-31T05:21:11.645 INFO:tasks.workunit.client.0.smithi067.stdout:6/316: getdents d1b/d30 0 2024-08-31T05:21:11.645 INFO:tasks.workunit.client.1.smithi073.stdout:0/886: read - d0/d58/d63/f121 zero size 2024-08-31T05:21:11.647 INFO:tasks.workunit.client.1.smithi073.stdout:8/857: rename d0/db/d1c/d2a/lb1 to d0/db/d1c/d34/d80/l10f 0 2024-08-31T05:21:11.647 INFO:tasks.workunit.client.1.smithi073.stdout:2/846: write d2/d9/d27/d9b/da6/f75 [955624,28573] 0 2024-08-31T05:21:11.648 INFO:tasks.workunit.client.0.smithi067.stdout:1/108: write d3/dd/f21 [262493,126774] 0 2024-08-31T05:21:11.649 INFO:tasks.workunit.client.0.smithi067.stdout:1/109: write d3/dd/f1d [596960,129551] 0 2024-08-31T05:21:11.649 INFO:tasks.workunit.client.1.smithi073.stdout:7/864: unlink d1/da/d15/fe7 0 2024-08-31T05:21:11.650 INFO:tasks.workunit.client.1.smithi073.stdout:0/887: dread d0/f21 [0,4194304] 0 2024-08-31T05:21:11.650 INFO:tasks.workunit.client.0.smithi067.stdout:6/317: mknod d1b/d23/d2f/c64 0 2024-08-31T05:21:11.651 INFO:tasks.workunit.client.0.smithi067.stdout:6/318: truncate f19 2024127 0 2024-08-31T05:21:11.651 INFO:tasks.workunit.client.1.smithi073.stdout:0/888: fsync d0/d15/d2c/d41/de8/fee 0 2024-08-31T05:21:11.652 INFO:tasks.workunit.client.1.smithi073.stdout:6/827: link d15/d17/da1/dae/db0/d38/d9b/fad d15/d1a/d2b/d2f/d99/db3/f113 0 2024-08-31T05:21:11.653 INFO:tasks.workunit.client.0.smithi067.stdout:3/153: link db/lf db/d2c/l32 0 2024-08-31T05:21:11.657 INFO:tasks.workunit.client.0.smithi067.stdout:6/319: creat d1b/d23/d28/d45/f65 x:0 0 0 2024-08-31T05:21:11.657 INFO:tasks.workunit.client.0.smithi067.stdout:6/320: stat d1b/d23/d28/f39 0 2024-08-31T05:21:11.658 INFO:tasks.workunit.client.1.smithi073.stdout:9/927: chown dc/d37/d42/d5a/dda/l10e 1 1 2024-08-31T05:21:11.658 INFO:tasks.workunit.client.0.smithi067.stdout:3/154: truncate db/f10 1035986 0 2024-08-31T05:21:11.661 INFO:tasks.workunit.client.1.smithi073.stdout:8/858: rmdir d0/db/d1c/d34/d80/d9a 39 2024-08-31T05:21:11.662 INFO:tasks.workunit.client.0.smithi067.stdout:5/122: truncate db/f1b 675098 0 2024-08-31T05:21:11.662 INFO:tasks.workunit.client.0.smithi067.stdout:5/123: chown f9 0 1 2024-08-31T05:21:11.663 INFO:tasks.workunit.client.1.smithi073.stdout:2/847: mknod d2/d9/df/d36/c108 0 2024-08-31T05:21:11.663 INFO:tasks.workunit.client.0.smithi067.stdout:1/110: symlink d3/d23/l25 0 2024-08-31T05:21:11.666 INFO:tasks.workunit.client.0.smithi067.stdout:6/321: truncate d1b/d23/d28/f2b 2652053 0 2024-08-31T05:21:11.668 INFO:tasks.workunit.client.0.smithi067.stdout:6/322: fdatasync d1b/d23/d28/d45/d5e/f5f 0 2024-08-31T05:21:11.668 INFO:tasks.workunit.client.1.smithi073.stdout:0/889: rename d0/d15/d2c/d41/d52/c95 to d0/d69/d7f/d68/d91/df5/c12a 0 2024-08-31T05:21:11.670 INFO:tasks.workunit.client.1.smithi073.stdout:1/858: creat d5/d26/d54/db2/dd5/d2a/f103 x:0 0 0 2024-08-31T05:21:11.671 INFO:tasks.workunit.client.0.smithi067.stdout:1/111: dwrite d3/dd/fe [0,4194304] 0 2024-08-31T05:21:11.673 INFO:tasks.workunit.client.1.smithi073.stdout:3/935: link da/d3c/d65/d40/f44 da/f127 0 2024-08-31T05:21:11.675 INFO:tasks.workunit.client.0.smithi067.stdout:6/323: dwrite f18 [0,4194304] 0 2024-08-31T05:21:11.686 INFO:tasks.workunit.client.0.smithi067.stdout:3/155: getdents db/d17 0 2024-08-31T05:21:11.689 INFO:tasks.workunit.client.0.smithi067.stdout:1/112: symlink d3/d23/l26 0 2024-08-31T05:21:11.689 INFO:tasks.workunit.client.0.smithi067.stdout:1/113: dread - d3/dd/f20 zero size 2024-08-31T05:21:11.690 INFO:tasks.workunit.client.0.smithi067.stdout:1/114: chown d3/dd/f1a 20 1 2024-08-31T05:21:11.691 INFO:tasks.workunit.client.1.smithi073.stdout:6/828: creat d15/d75/dc8/dea/f114 x:0 0 0 2024-08-31T05:21:11.693 INFO:tasks.workunit.client.1.smithi073.stdout:0/890: creat d0/d15/d2c/d40/f12b x:0 0 0 2024-08-31T05:21:11.694 INFO:tasks.workunit.client.0.smithi067.stdout:6/324: dread d1b/d23/f4f [0,4194304] 0 2024-08-31T05:21:11.695 INFO:tasks.workunit.client.0.smithi067.stdout:3/156: creat db/d12/d21/f33 x:0 0 0 2024-08-31T05:21:11.696 INFO:tasks.workunit.client.0.smithi067.stdout:3/157: chown db/d17/l22 330449 1 2024-08-31T05:21:11.696 INFO:tasks.workunit.client.0.smithi067.stdout:3/158: write db/d12/f1f [714857,89531] 0 2024-08-31T05:21:11.698 INFO:tasks.workunit.client.1.smithi073.stdout:3/936: creat da/d3c/d65/d45/dcd/d108/ded/f128 x:0 0 0 2024-08-31T05:21:11.699 INFO:tasks.workunit.client.0.smithi067.stdout:5/124: write f7 [103748,118333] 0 2024-08-31T05:21:11.700 INFO:tasks.workunit.client.1.smithi073.stdout:9/928: creat dc/de/d127/f12b x:0 0 0 2024-08-31T05:21:11.704 INFO:tasks.workunit.client.1.smithi073.stdout:4/772: rmdir d7/df/d13/d2e/d47/dc6 0 2024-08-31T05:21:11.704 INFO:tasks.workunit.client.1.smithi073.stdout:8/859: write d0/f45 [420650,107409] 0 2024-08-31T05:21:11.705 INFO:tasks.workunit.client.1.smithi073.stdout:8/860: read d0/db/d1c/d2a/f30 [1641693,77010] 0 2024-08-31T05:21:11.707 INFO:tasks.workunit.client.1.smithi073.stdout:2/848: creat d2/d9/d27/d76/d7e/db4/f109 x:0 0 0 2024-08-31T05:21:11.708 INFO:tasks.workunit.client.0.smithi067.stdout:3/159: mknod db/d27/c34 0 2024-08-31T05:21:11.711 INFO:tasks.workunit.client.1.smithi073.stdout:1/859: fdatasync d5/d26/d54/d5f/f7c 0 2024-08-31T05:21:11.715 INFO:tasks.workunit.client.0.smithi067.stdout:6/325: fdatasync d1b/d23/f34 0 2024-08-31T05:21:11.717 INFO:tasks.workunit.client.1.smithi073.stdout:4/773: mkdir d7/d1a/d5c/d62/df4 0 2024-08-31T05:21:11.717 INFO:tasks.workunit.client.1.smithi073.stdout:4/774: dread - d7/d1a/d5c/fdb zero size 2024-08-31T05:21:11.718 INFO:tasks.workunit.client.0.smithi067.stdout:1/115: creat d3/f27 x:0 0 0 2024-08-31T05:21:11.719 INFO:tasks.workunit.client.0.smithi067.stdout:3/160: mknod db/d2c/c35 0 2024-08-31T05:21:11.721 INFO:tasks.workunit.client.1.smithi073.stdout:7/865: getdents d1/da/d3e/d22/d47 0 2024-08-31T05:21:11.722 INFO:tasks.workunit.client.1.smithi073.stdout:8/861: chown d0/db/d1c/d34/d68/d9d/lfe 74123619 1 2024-08-31T05:21:11.723 INFO:tasks.workunit.client.0.smithi067.stdout:6/326: mknod d1b/d23/d28/d45/c66 0 2024-08-31T05:21:11.724 INFO:tasks.workunit.client.0.smithi067.stdout:1/116: rmdir d3 39 2024-08-31T05:21:11.724 INFO:tasks.workunit.client.0.smithi067.stdout:6/327: fsync d1b/d23/d28/d45/d5e/f5f 0 2024-08-31T05:21:11.725 INFO:tasks.workunit.client.0.smithi067.stdout:3/161: dwrite db/d12/f1f [0,4194304] 0 2024-08-31T05:21:11.726 INFO:tasks.workunit.client.1.smithi073.stdout:6/829: symlink d15/d41/l115 0 2024-08-31T05:21:11.726 INFO:tasks.workunit.client.1.smithi073.stdout:7/866: dwrite d1/da/d3e/d22/d35/d83/fc1 [0,4194304] 0 2024-08-31T05:21:11.726 INFO:tasks.workunit.client.0.smithi067.stdout:3/162: readlink db/d17/l1c 0 2024-08-31T05:21:11.730 INFO:tasks.workunit.client.1.smithi073.stdout:1/860: rmdir d5/d26/da5/dba 39 2024-08-31T05:21:11.731 INFO:tasks.workunit.client.1.smithi073.stdout:1/861: fdatasync d5/d26/d54/db2/dd5/d32/d37/f8a 0 2024-08-31T05:21:11.732 INFO:tasks.workunit.client.1.smithi073.stdout:7/867: dwrite d1/da/d15/fe0 [0,4194304] 0 2024-08-31T05:21:11.732 INFO:tasks.workunit.client.0.smithi067.stdout:6/328: rename d1b/l4c to d1b/d23/d2e/l67 0 2024-08-31T05:21:11.734 INFO:tasks.workunit.client.1.smithi073.stdout:3/937: mkdir da/d3c/d67/d129 0 2024-08-31T05:21:11.735 INFO:tasks.workunit.client.1.smithi073.stdout:9/929: creat dc/d37/d42/d5a/db4/f12c x:0 0 0 2024-08-31T05:21:11.736 INFO:tasks.workunit.client.0.smithi067.stdout:6/329: fdatasync d1b/d23/f4f 0 2024-08-31T05:21:11.740 INFO:tasks.workunit.client.1.smithi073.stdout:4/775: mknod d7/df/d13/d2e/d70/cf5 0 2024-08-31T05:21:11.740 INFO:tasks.workunit.client.0.smithi067.stdout:3/163: creat db/d12/f36 x:0 0 0 2024-08-31T05:21:11.744 INFO:tasks.workunit.client.0.smithi067.stdout:1/117: creat d3/f28 x:0 0 0 2024-08-31T05:21:11.745 INFO:tasks.workunit.client.0.smithi067.stdout:3/164: mknod db/d17/c37 0 2024-08-31T05:21:11.746 INFO:tasks.workunit.client.0.smithi067.stdout:3/165: dread - db/d12/d21/f26 zero size 2024-08-31T05:21:11.747 INFO:tasks.workunit.client.0.smithi067.stdout:3/166: read db/d12/f1f [2355436,127603] 0 2024-08-31T05:21:11.747 INFO:tasks.workunit.client.0.smithi067.stdout:6/330: mknod d1b/d23/d2f/d62/c68 0 2024-08-31T05:21:11.748 INFO:tasks.workunit.client.0.smithi067.stdout:3/167: readlink db/le 0 2024-08-31T05:21:11.749 INFO:tasks.workunit.client.1.smithi073.stdout:0/891: link d0/d69/d7f/f65 d0/d58/dc7/f12c 0 2024-08-31T05:21:11.749 INFO:tasks.workunit.client.0.smithi067.stdout:3/168: stat db/d17/c37 0 2024-08-31T05:21:11.749 INFO:tasks.workunit.client.0.smithi067.stdout:6/331: chown d1b/d23/d2e/f3d 110880387 1 2024-08-31T05:21:11.750 INFO:tasks.workunit.client.0.smithi067.stdout:6/332: write d1b/d23/d28/f37 [510011,124123] 0 2024-08-31T05:21:11.755 INFO:tasks.workunit.client.0.smithi067.stdout:3/169: dwrite f6 [4194304,4194304] 0 2024-08-31T05:21:11.757 INFO:tasks.workunit.client.1.smithi073.stdout:7/868: dread d1/da/d3e/d22/d47/da8/fbf [0,4194304] 0 2024-08-31T05:21:11.757 INFO:tasks.workunit.client.0.smithi067.stdout:3/170: chown db/d17/c2a 61 1 2024-08-31T05:21:11.758 INFO:tasks.workunit.client.1.smithi073.stdout:7/869: write d1/da/d3e/d22/d35/f9c [710432,111230] 0 2024-08-31T05:21:11.758 INFO:tasks.workunit.client.1.smithi073.stdout:4/776: unlink d7/df/f25 0 2024-08-31T05:21:11.774 INFO:tasks.workunit.client.1.smithi073.stdout:2/849: dread d2/d9/d7f/dab/d5d/d82/f8a [0,4194304] 0 2024-08-31T05:21:11.866 INFO:tasks.workunit.client.1.smithi073.stdout:3/938: rename da/d3c/d65/d2c/d8e/dc2/c103 to da/d3c/d65/d45/dcd/d108/da2/daf/c12a 0 2024-08-31T05:21:11.867 INFO:tasks.workunit.client.1.smithi073.stdout:8/862: mknod d0/db/d1c/d34/d80/d9a/c110 0 2024-08-31T05:21:11.870 INFO:tasks.workunit.client.1.smithi073.stdout:8/863: dread d0/db/d44/d72/d79/f7f [0,4194304] 0 2024-08-31T05:21:11.943 INFO:tasks.workunit.client.0.smithi067.stdout:1/118: rename d3/dd/l16 to d3/l29 0 2024-08-31T05:21:11.943 INFO:tasks.workunit.client.1.smithi073.stdout:6/830: mknod d15/d1a/d2b/d2f/c116 0 2024-08-31T05:21:11.944 INFO:tasks.workunit.client.0.smithi067.stdout:3/171: creat db/d2e/f38 x:0 0 0 2024-08-31T05:21:11.944 INFO:tasks.workunit.client.0.smithi067.stdout:3/172: dread - db/d12/f36 zero size 2024-08-31T05:21:11.947 INFO:tasks.workunit.client.1.smithi073.stdout:6/831: read d15/d1a/d1e/f3e [902789,101148] 0 2024-08-31T05:21:11.950 INFO:tasks.workunit.client.1.smithi073.stdout:0/892: dwrite d0/d69/d7f/d62/dbf/fdf [0,4194304] 0 2024-08-31T05:21:11.950 INFO:tasks.workunit.client.1.smithi073.stdout:1/862: dread d5/d26/da5/dba/d33/d13/d7e/fae [0,4194304] 0 2024-08-31T05:21:11.950 INFO:tasks.workunit.client.0.smithi067.stdout:1/119: mknod d3/c2a 0 2024-08-31T05:21:11.952 INFO:tasks.workunit.client.0.smithi067.stdout:3/173: dwrite db/d2c/f31 [0,4194304] 0 2024-08-31T05:21:11.952 INFO:tasks.workunit.client.1.smithi073.stdout:9/930: symlink dc/d37/d42/d5a/d89/db8/dd3/l12d 0 2024-08-31T05:21:11.955 INFO:tasks.workunit.client.0.smithi067.stdout:6/333: rename d1b/d23/d2e/f38 to d1b/d23/f69 0 2024-08-31T05:21:11.955 INFO:tasks.workunit.client.0.smithi067.stdout:6/334: read f18 [2009945,28462] 0 2024-08-31T05:21:11.956 INFO:tasks.workunit.client.0.smithi067.stdout:6/335: stat d1b/d23/d2e/d3b 0 2024-08-31T05:21:11.962 INFO:tasks.workunit.client.1.smithi073.stdout:4/777: unlink d7/db/c22 0 2024-08-31T05:21:11.963 INFO:tasks.workunit.client.0.smithi067.stdout:1/120: readlink d3/d23/l26 0 2024-08-31T05:21:11.964 INFO:tasks.workunit.client.1.smithi073.stdout:2/850: truncate d2/d9/d27/d76/d97/fbf 701006 0 2024-08-31T05:21:11.964 INFO:tasks.workunit.client.0.smithi067.stdout:1/121: chown d3/f24 1000760 1 2024-08-31T05:21:11.965 INFO:tasks.workunit.client.0.smithi067.stdout:1/122: fdatasync d3/dd/f12 0 2024-08-31T05:21:11.966 INFO:tasks.workunit.client.1.smithi073.stdout:3/939: creat da/d3c/d5a/db8/f12b x:0 0 0 2024-08-31T05:21:11.970 INFO:tasks.workunit.client.1.smithi073.stdout:8/864: dread d0/db/d1c/d23/f2f [0,4194304] 0 2024-08-31T05:21:11.971 INFO:tasks.workunit.client.0.smithi067.stdout:3/174: mkdir db/d12/d39 0 2024-08-31T05:21:11.973 INFO:tasks.workunit.client.1.smithi073.stdout:1/863: rmdir d5/d26/da5/dba/d1c/d27 39 2024-08-31T05:21:11.975 INFO:tasks.workunit.client.1.smithi073.stdout:0/893: mkdir d0/d15/d2c/d40/d4a/d6b/d12d 0 2024-08-31T05:21:11.975 INFO:tasks.workunit.client.1.smithi073.stdout:9/931: dread dc/d37/d42/d8d/d52/d5b/f80 [0,4194304] 0 2024-08-31T05:21:11.976 INFO:tasks.workunit.client.0.smithi067.stdout:6/336: mknod d1b/d23/d28/d45/d5c/c6a 0 2024-08-31T05:21:11.979 INFO:tasks.workunit.client.0.smithi067.stdout:1/123: dwrite d3/f5 [0,4194304] 0 2024-08-31T05:21:11.980 INFO:tasks.workunit.client.1.smithi073.stdout:0/894: dwrite d0/d69/d8e/fc3 [0,4194304] 0 2024-08-31T05:21:11.983 INFO:tasks.workunit.client.1.smithi073.stdout:2/851: dread - d2/d9/d27/d9b/da7/fad zero size 2024-08-31T05:21:11.983 INFO:tasks.workunit.client.1.smithi073.stdout:2/852: fdatasync d2/d9/f77 0 2024-08-31T05:21:11.985 INFO:tasks.workunit.client.1.smithi073.stdout:3/940: mknod da/d3c/d65/d45/dcd/d108/d10a/c12c 0 2024-08-31T05:21:11.988 INFO:tasks.workunit.client.0.smithi067.stdout:1/124: dwrite d3/f27 [0,4194304] 0 2024-08-31T05:21:11.992 INFO:tasks.workunit.client.0.smithi067.stdout:6/337: mknod d1b/d23/c6b 0 2024-08-31T05:21:11.996 INFO:tasks.workunit.client.1.smithi073.stdout:8/865: mkdir d0/d62/db4/d111 0 2024-08-31T05:21:11.996 INFO:tasks.workunit.client.1.smithi073.stdout:8/866: chown d0/l21 15 1 2024-08-31T05:21:11.997 INFO:tasks.workunit.client.1.smithi073.stdout:7/870: write d1/f43 [6969396,37316] 0 2024-08-31T05:21:11.998 INFO:tasks.workunit.client.1.smithi073.stdout:7/871: read d1/d11/f53 [4005122,107382] 0 2024-08-31T05:21:11.999 INFO:tasks.workunit.client.1.smithi073.stdout:6/832: link d15/d17/da1/dae/db0/d38/d9b/fc4 d15/d1a/d2b/d2f/d99/d9e/f117 0 2024-08-31T05:21:12.000 INFO:tasks.workunit.client.0.smithi067.stdout:6/338: dwrite f10 [0,4194304] 0 2024-08-31T05:21:12.001 INFO:tasks.workunit.client.1.smithi073.stdout:6/833: write d15/d17/da1/dae/db0/d38/ff1 [885876,40233] 0 2024-08-31T05:21:12.001 INFO:tasks.workunit.client.1.smithi073.stdout:1/864: rmdir d5/d26/d54/db2/dd5/d3f 39 2024-08-31T05:21:12.005 INFO:tasks.workunit.client.1.smithi073.stdout:7/872: dwrite d1/da/d15/d33/d44/d74/dd6/de6/d84/f10e [0,4194304] 0 2024-08-31T05:21:12.006 INFO:tasks.workunit.client.0.smithi067.stdout:1/125: dwrite d3/f14 [0,4194304] 0 2024-08-31T05:21:12.009 INFO:tasks.workunit.client.1.smithi073.stdout:0/895: rename d0/d69/d7f/d68/d91/df5/d3c/d9c/de4/ff4 to d0/d69/d10a/f12e 0 2024-08-31T05:21:12.010 INFO:tasks.workunit.client.1.smithi073.stdout:3/941: creat da/d3c/d65/d40/d5d/dd2/f12d x:0 0 0 2024-08-31T05:21:12.011 INFO:tasks.workunit.client.0.smithi067.stdout:6/339: dwrite d1b/f20 [4194304,4194304] 0 2024-08-31T05:21:12.012 INFO:tasks.workunit.client.0.smithi067.stdout:1/126: symlink d3/dd/l2b 0 2024-08-31T05:21:12.012 INFO:tasks.workunit.client.1.smithi073.stdout:8/867: rmdir d0 39 2024-08-31T05:21:12.015 INFO:tasks.workunit.client.1.smithi073.stdout:6/834: mknod d15/d75/dc8/dea/c118 0 2024-08-31T05:21:12.016 INFO:tasks.workunit.client.1.smithi073.stdout:6/835: write d15/d75/f85 [1655892,61954] 0 2024-08-31T05:21:12.018 INFO:tasks.workunit.client.1.smithi073.stdout:1/865: mknod d5/d26/d54/db2/dd5/d5d/c104 0 2024-08-31T05:21:12.019 INFO:tasks.workunit.client.0.smithi067.stdout:1/127: creat d3/dd/f2c x:0 0 0 2024-08-31T05:21:12.020 INFO:tasks.workunit.client.0.smithi067.stdout:6/340: dread d1b/d23/d2e/f3d [0,4194304] 0 2024-08-31T05:21:12.021 INFO:tasks.workunit.client.0.smithi067.stdout:3/175: dwrite db/f10 [0,4194304] 0 2024-08-31T05:21:12.022 INFO:tasks.workunit.client.0.smithi067.stdout:3/176: read f6 [7111100,53124] 0 2024-08-31T05:21:12.023 INFO:tasks.workunit.client.0.smithi067.stdout:6/341: truncate d1b/d23/d28/f55 895987 0 2024-08-31T05:21:12.025 INFO:tasks.workunit.client.1.smithi073.stdout:7/873: rename d1/da/d3e/d22/d47/c69 to d1/da/d15/d33/d44/d74/dd6/de3/d108/c10f 0 2024-08-31T05:21:12.026 INFO:tasks.workunit.client.0.smithi067.stdout:1/128: mkdir d3/d23/d2d 0 2024-08-31T05:21:12.027 INFO:tasks.workunit.client.0.smithi067.stdout:1/129: write d3/dd/fe [2051692,10522] 0 2024-08-31T05:21:12.028 INFO:tasks.workunit.client.0.smithi067.stdout:1/130: write d3/f28 [212073,126780] 0 2024-08-31T05:21:12.032 INFO:tasks.workunit.client.1.smithi073.stdout:6/836: mknod d15/d1a/d2b/d2f/d99/c119 0 2024-08-31T05:21:12.033 INFO:tasks.workunit.client.1.smithi073.stdout:6/837: stat d15/d1a/d1e/d69/d7e/f106 0 2024-08-31T05:21:12.034 INFO:tasks.workunit.client.0.smithi067.stdout:6/342: symlink d1b/l6c 0 2024-08-31T05:21:12.035 INFO:tasks.workunit.client.1.smithi073.stdout:0/896: chown d0/d28/l5f 25 1 2024-08-31T05:21:12.035 INFO:tasks.workunit.client.1.smithi073.stdout:0/897: chown d0/d28/lf9 888 1 2024-08-31T05:21:12.036 INFO:tasks.workunit.client.0.smithi067.stdout:1/131: read d3/f6 [3047512,54262] 0 2024-08-31T05:21:12.037 INFO:tasks.workunit.client.0.smithi067.stdout:1/132: truncate d3/f28 403288 0 2024-08-31T05:21:12.040 INFO:tasks.workunit.client.1.smithi073.stdout:2/853: getdents d2/d9/d27 0 2024-08-31T05:21:12.040 INFO:tasks.workunit.client.0.smithi067.stdout:3/177: link db/d12/d21/c15 db/c3a 0 2024-08-31T05:21:12.040 INFO:tasks.workunit.client.1.smithi073.stdout:6/838: rmdir d15/d17/da1/dae/db0 39 2024-08-31T05:21:12.042 INFO:tasks.workunit.client.0.smithi067.stdout:1/133: unlink d3/f10 0 2024-08-31T05:21:12.046 INFO:tasks.workunit.client.1.smithi073.stdout:2/854: symlink d2/d9/d27/d76/l10a 0 2024-08-31T05:21:12.046 INFO:tasks.workunit.client.0.smithi067.stdout:3/178: rename db/d27 to db/d3b 0 2024-08-31T05:21:12.047 INFO:tasks.workunit.client.1.smithi073.stdout:1/866: dread d5/d26/da5/dba/d33/f36 [0,4194304] 0 2024-08-31T05:21:12.048 INFO:tasks.workunit.client.1.smithi073.stdout:6/839: rename d15/d1a/d2b/d2f/d4b/d88/d9f/ldf to d15/d1a/d51/d6e/l11a 0 2024-08-31T05:21:12.048 INFO:tasks.workunit.client.1.smithi073.stdout:2/855: truncate d2/d9/d27/d9b/da6/fcf 4660910 0 2024-08-31T05:21:12.050 INFO:tasks.workunit.client.1.smithi073.stdout:6/840: write d15/d1a/d1e/f24 [10307377,85696] 0 2024-08-31T05:21:12.050 INFO:tasks.workunit.client.0.smithi067.stdout:3/179: rename c8 to db/d2c/c3c 0 2024-08-31T05:21:12.051 INFO:tasks.workunit.client.1.smithi073.stdout:3/942: getdents da/d3c/d65/d40/d5d 0 2024-08-31T05:21:12.052 INFO:tasks.workunit.client.1.smithi073.stdout:3/943: truncate da/d3c/d65/d87/fa8 2034188 0 2024-08-31T05:21:12.053 INFO:tasks.workunit.client.1.smithi073.stdout:1/867: creat d5/d26/d54/d9e/f105 x:0 0 0 2024-08-31T05:21:12.053 INFO:tasks.workunit.client.1.smithi073.stdout:3/944: write da/ff5 [200031,124681] 0 2024-08-31T05:21:12.057 INFO:tasks.workunit.client.1.smithi073.stdout:4/778: sync 2024-08-31T05:21:12.058 INFO:tasks.workunit.client.0.smithi067.stdout:1/134: dread d3/f28 [0,4194304] 0 2024-08-31T05:21:12.059 INFO:tasks.workunit.client.0.smithi067.stdout:3/180: creat db/f3d x:0 0 0 2024-08-31T05:21:12.059 INFO:tasks.workunit.client.1.smithi073.stdout:3/945: rmdir da/d3c/dda 39 2024-08-31T05:21:12.060 INFO:tasks.workunit.client.0.smithi067.stdout:3/181: rename db/d2c to db/d2c/d3e 22 2024-08-31T05:21:12.060 INFO:tasks.workunit.client.1.smithi073.stdout:9/932: dwrite dc/d37/d42/f59 [0,4194304] 0 2024-08-31T05:21:12.060 INFO:tasks.workunit.client.0.smithi067.stdout:3/182: stat db/d12/d21/f25 0 2024-08-31T05:21:12.061 INFO:tasks.workunit.client.1.smithi073.stdout:2/856: fsync d2/d9/d7f/dab/daa/df5/ff7 0 2024-08-31T05:21:12.063 INFO:tasks.workunit.client.1.smithi073.stdout:4/779: read d7/d1a/d5c/d6d/d59/d86/fd5 [108941,17777] 0 2024-08-31T05:21:12.064 INFO:tasks.workunit.client.1.smithi073.stdout:7/874: dread d1/da/d96/fd8 [0,4194304] 0 2024-08-31T05:21:12.064 INFO:tasks.workunit.client.0.smithi067.stdout:3/183: mkdir db/d17/d3f 0 2024-08-31T05:21:12.065 INFO:tasks.workunit.client.1.smithi073.stdout:1/868: dwrite d5/d26/d54/db2/dd5/d32/d37/d6f/dc7/ff0 [0,4194304] 0 2024-08-31T05:21:12.066 INFO:tasks.workunit.client.1.smithi073.stdout:4/780: write d7/df/d13/fcf [94209,73661] 0 2024-08-31T05:21:12.067 INFO:tasks.workunit.client.1.smithi073.stdout:4/781: fsync d7/df/d79/faf 0 2024-08-31T05:21:12.068 INFO:tasks.workunit.client.1.smithi073.stdout:4/782: chown d7/d1a/d5c/d6d/f8d 1247627712 1 2024-08-31T05:21:12.073 INFO:tasks.workunit.client.0.smithi067.stdout:3/184: dwrite db/f14 [4194304,4194304] 0 2024-08-31T05:21:12.074 INFO:tasks.workunit.client.0.smithi067.stdout:3/185: dread - db/d12/f2f zero size 2024-08-31T05:21:12.075 INFO:tasks.workunit.client.1.smithi073.stdout:3/946: creat da/d3c/d65/d40/f12e x:0 0 0 2024-08-31T05:21:12.076 INFO:tasks.workunit.client.1.smithi073.stdout:9/933: creat dc/d37/d42/d8d/d52/d5f/f12e x:0 0 0 2024-08-31T05:21:12.076 INFO:tasks.workunit.client.1.smithi073.stdout:9/934: chown dc/de/dd8 1 1 2024-08-31T05:21:12.078 INFO:tasks.workunit.client.1.smithi073.stdout:9/935: write dc/d37/d42/d5a/fdf [318120,63964] 0 2024-08-31T05:21:12.078 INFO:tasks.workunit.client.1.smithi073.stdout:6/841: rmdir d15/d17/db6 0 2024-08-31T05:21:12.081 INFO:tasks.workunit.client.1.smithi073.stdout:2/857: creat d2/d9/d27/d76/db5/dc6/dd1/f10b x:0 0 0 2024-08-31T05:21:12.082 INFO:tasks.workunit.client.1.smithi073.stdout:8/868: write d0/db/d44/d4e/fbf [256388,34775] 0 2024-08-31T05:21:12.082 INFO:tasks.workunit.client.0.smithi067.stdout:3/186: mknod db/d12/d39/c40 0 2024-08-31T05:21:12.085 INFO:tasks.workunit.client.0.smithi067.stdout:3/187: rename db/d12 to db/d12/d41 22 2024-08-31T05:21:12.085 INFO:tasks.workunit.client.0.smithi067.stdout:3/188: chown db/d2e 211117 1 2024-08-31T05:21:12.086 INFO:tasks.workunit.client.1.smithi073.stdout:3/947: unlink da/d3c/d65/d45/dcd/d108/l58 0 2024-08-31T05:21:12.087 INFO:tasks.workunit.client.1.smithi073.stdout:2/858: dwrite d2/d9/d7f/fb0 [0,4194304] 0 2024-08-31T05:21:12.090 INFO:tasks.workunit.client.1.smithi073.stdout:3/948: read da/d3c/d65/d2c/d8e/f9c [38994,53695] 0 2024-08-31T05:21:12.092 INFO:tasks.workunit.client.1.smithi073.stdout:0/898: dwrite d0/d15/d2c/d40/d4a/f87 [0,4194304] 0 2024-08-31T05:21:12.092 INFO:tasks.workunit.client.0.smithi067.stdout:3/189: dwrite db/d12/d21/f33 [0,4194304] 0 2024-08-31T05:21:12.093 INFO:tasks.workunit.client.0.smithi067.stdout:3/190: rename db/d17 to db/d17/d42 22 2024-08-31T05:21:12.094 INFO:tasks.workunit.client.1.smithi073.stdout:0/899: truncate d0/d58/d63/f121 260803 0 2024-08-31T05:21:12.096 INFO:tasks.workunit.client.1.smithi073.stdout:8/869: truncate d0/db/d44/f84 91486 0 2024-08-31T05:21:12.102 INFO:tasks.workunit.client.1.smithi073.stdout:4/783: dwrite d7/df/d13/d2e/fd2 [0,4194304] 0 2024-08-31T05:21:12.103 INFO:tasks.workunit.client.0.smithi067.stdout:3/191: dwrite f4 [4194304,4194304] 0 2024-08-31T05:21:12.106 INFO:tasks.workunit.client.0.smithi067.stdout:3/192: chown db/d12/d39 17706645 1 2024-08-31T05:21:12.109 INFO:tasks.workunit.client.1.smithi073.stdout:2/859: fdatasync d2/d9/d7f/dab/d5d/da1/de0/fe4 0 2024-08-31T05:21:12.110 INFO:tasks.workunit.client.0.smithi067.stdout:3/193: rename db/d3b to db/d2e/d43 0 2024-08-31T05:21:12.112 INFO:tasks.workunit.client.0.smithi067.stdout:1/135: truncate d3/dd/f1d 581526 0 2024-08-31T05:21:12.115 INFO:tasks.workunit.client.0.smithi067.stdout:3/194: unlink db/d17/c1e 0 2024-08-31T05:21:12.121 INFO:tasks.workunit.client.0.smithi067.stdout:3/195: mknod db/d12/d21/c44 0 2024-08-31T05:21:12.125 INFO:tasks.workunit.client.1.smithi073.stdout:9/936: rename dc/d37/d42/d8d/d52/d5b/d73 to dc/d37/d42/d5a/d12f 0 2024-08-31T05:21:12.126 INFO:tasks.workunit.client.1.smithi073.stdout:0/900: getdents d0/d69/d7f/d68/d91/df5/d3c/d9c/db6/dfd 0 2024-08-31T05:21:12.128 INFO:tasks.workunit.client.1.smithi073.stdout:4/784: mknod d7/df/d13/d2e/cf6 0 2024-08-31T05:21:12.130 INFO:tasks.workunit.client.1.smithi073.stdout:4/785: symlink d7/df/d1b/d34/lf7 0 2024-08-31T05:21:12.131 INFO:tasks.workunit.client.1.smithi073.stdout:2/860: rename d2/d9/d7f/de5/cef to d2/d9/d7f/dab/d5d/d82/c10c 0 2024-08-31T05:21:12.132 INFO:tasks.workunit.client.1.smithi073.stdout:0/901: getdents d0/d15/d2c/d40/d4a/ddb 0 2024-08-31T05:21:12.133 INFO:tasks.workunit.client.1.smithi073.stdout:9/937: link dc/d37/d42/d8d/d52/d5b/l10a dc/d37/l130 0 2024-08-31T05:21:12.134 INFO:tasks.workunit.client.1.smithi073.stdout:6/842: dwrite d15/d75/f78 [4194304,4194304] 0 2024-08-31T05:21:12.134 INFO:tasks.workunit.client.1.smithi073.stdout:2/861: dread - d2/d9/d27/d9b/da7/fad zero size 2024-08-31T05:21:12.136 INFO:tasks.workunit.client.1.smithi073.stdout:4/786: rename d7/db/l95 to d7/d1a/d5c/d6d/d2c/d2d/lf8 0 2024-08-31T05:21:12.139 INFO:tasks.workunit.client.1.smithi073.stdout:0/902: creat d0/d69/d8e/d99/f12f x:0 0 0 2024-08-31T05:21:12.142 INFO:tasks.workunit.client.1.smithi073.stdout:3/949: dread da/d3c/d65/d45/dcd/d108/f5b [0,4194304] 0 2024-08-31T05:21:12.143 INFO:tasks.workunit.client.1.smithi073.stdout:9/938: rename dc/d37/d42/d5a/d89/db8 to dc/dc4/d131 0 2024-08-31T05:21:12.145 INFO:tasks.workunit.client.0.smithi067.stdout:1/136: dread d3/f6 [4194304,4194304] 0 2024-08-31T05:21:12.146 INFO:tasks.workunit.client.1.smithi073.stdout:9/939: chown dc/d37/d42/d5a/dda/l10e 450165 1 2024-08-31T05:21:12.147 INFO:tasks.workunit.client.1.smithi073.stdout:2/862: dwrite d2/d25/fac [4194304,4194304] 0 2024-08-31T05:21:12.148 INFO:tasks.workunit.client.1.smithi073.stdout:6/843: symlink d15/d1a/d2b/d2f/l11b 0 2024-08-31T05:21:12.150 INFO:tasks.workunit.client.1.smithi073.stdout:0/903: creat d0/d15/d2c/d40/d86/f130 x:0 0 0 2024-08-31T05:21:12.151 INFO:tasks.workunit.client.0.smithi067.stdout:1/137: dread d3/f1e [0,4194304] 0 2024-08-31T05:21:12.152 INFO:tasks.workunit.client.1.smithi073.stdout:4/787: creat d7/d1a/d5c/d6d/d2c/d2d/da6/dde/de3/dd0/ff9 x:0 0 0 2024-08-31T05:21:12.153 INFO:tasks.workunit.client.0.smithi067.stdout:1/138: write d3/dd/f21 [1413388,114341] 0 2024-08-31T05:21:12.159 INFO:tasks.workunit.client.1.smithi073.stdout:9/940: symlink dc/d37/d42/d5a/da0/l132 0 2024-08-31T05:21:12.161 INFO:tasks.workunit.client.1.smithi073.stdout:9/941: chown dc/d37/d42/d8d/d52/d5b/lde 891446 1 2024-08-31T05:21:12.161 INFO:tasks.workunit.client.1.smithi073.stdout:8/870: write d0/db/d44/f84 [5928,48636] 0 2024-08-31T05:21:12.162 INFO:tasks.workunit.client.1.smithi073.stdout:8/871: fdatasync d0/fbc 0 2024-08-31T05:21:12.162 INFO:tasks.workunit.client.1.smithi073.stdout:0/904: mknod d0/d15/d9b/c131 0 2024-08-31T05:21:12.162 INFO:tasks.workunit.client.1.smithi073.stdout:8/872: chown d0/db/d44/d72/d75 349 1 2024-08-31T05:21:12.163 INFO:tasks.workunit.client.1.smithi073.stdout:4/788: mkdir d7/d1a/d5c/d6d/d59/d65/db9/dd6/dfa 0 2024-08-31T05:21:12.163 INFO:tasks.workunit.client.1.smithi073.stdout:8/873: fsync d0/db/d1c/d34/d38/f108 0 2024-08-31T05:21:12.165 INFO:tasks.workunit.client.1.smithi073.stdout:7/875: sync 2024-08-31T05:21:12.166 INFO:tasks.workunit.client.1.smithi073.stdout:7/876: readlink d1/da/d3e/d22/d5c/l76 0 2024-08-31T05:21:12.166 INFO:tasks.workunit.client.1.smithi073.stdout:3/950: truncate da/d3c/d65/d45/dcd/d108/f2a 3568491 0 2024-08-31T05:21:12.167 INFO:tasks.workunit.client.1.smithi073.stdout:2/863: unlink d2/d9/d27/d76/d97/fbf 0 2024-08-31T05:21:12.171 INFO:tasks.workunit.client.1.smithi073.stdout:9/942: rename dc/de/d11/l11f to dc/d37/l133 0 2024-08-31T05:21:12.173 INFO:tasks.workunit.client.1.smithi073.stdout:0/905: mkdir d0/d15/d2c/d40/d132 0 2024-08-31T05:21:12.174 INFO:tasks.workunit.client.1.smithi073.stdout:4/789: symlink d7/d1a/d5c/d6d/d2c/d2d/lfb 0 2024-08-31T05:21:12.175 INFO:tasks.workunit.client.1.smithi073.stdout:4/790: stat d7/df/d1b/f51 0 2024-08-31T05:21:12.177 INFO:tasks.workunit.client.1.smithi073.stdout:7/877: readlink d1/da/d3e/d22/d47/lcb 0 2024-08-31T05:21:12.177 INFO:tasks.workunit.client.1.smithi073.stdout:9/943: dwrite dc/de/dd8/ff8 [0,4194304] 0 2024-08-31T05:21:12.177 INFO:tasks.workunit.client.1.smithi073.stdout:2/864: mknod d2/d9/d27/d76/db5/dc6/dd1/c10d 0 2024-08-31T05:21:12.178 INFO:tasks.workunit.client.1.smithi073.stdout:7/878: stat d1/da/d15 0 2024-08-31T05:21:12.180 INFO:tasks.workunit.client.1.smithi073.stdout:3/951: dread da/f12 [0,4194304] 0 2024-08-31T05:21:12.180 INFO:tasks.workunit.client.1.smithi073.stdout:8/874: symlink d0/db/d1c/d34/d38/d106/l112 0 2024-08-31T05:21:12.181 INFO:tasks.workunit.client.1.smithi073.stdout:2/865: dread - d2/d9/d27/d76/db5/dc6/dd1/f10b zero size 2024-08-31T05:21:12.183 INFO:tasks.workunit.client.1.smithi073.stdout:9/944: write dc/d27/f2e [4265106,98470] 0 2024-08-31T05:21:12.185 INFO:tasks.workunit.client.1.smithi073.stdout:9/945: write dc/d37/db5/f115 [796081,63756] 0 2024-08-31T05:21:12.187 INFO:tasks.workunit.client.1.smithi073.stdout:4/791: rename d7/d1a/d5c/d6d/d59/d86/fd5 to d7/d1a/d5c/d6d/d2c/ffc 0 2024-08-31T05:21:12.189 INFO:tasks.workunit.client.1.smithi073.stdout:7/879: creat d1/da/d15/d33/d44/d74/f110 x:0 0 0 2024-08-31T05:21:12.190 INFO:tasks.workunit.client.1.smithi073.stdout:3/952: dwrite da/d3c/d65/d45/dcd/d108/ded/f11f [0,4194304] 0 2024-08-31T05:21:12.191 INFO:tasks.workunit.client.1.smithi073.stdout:2/866: dread d2/d9/d66/d70/fbb [0,4194304] 0 2024-08-31T05:21:12.192 INFO:tasks.workunit.client.1.smithi073.stdout:7/880: read d1/da/d15/d33/d44/d74/dd6/de6/d84/f10e [3348363,69000] 0 2024-08-31T05:21:12.192 INFO:tasks.workunit.client.1.smithi073.stdout:0/906: creat d0/d28/f133 x:0 0 0 2024-08-31T05:21:12.194 INFO:tasks.workunit.client.1.smithi073.stdout:2/867: dread - d2/d9/df/ff4 zero size 2024-08-31T05:21:12.197 INFO:tasks.workunit.client.1.smithi073.stdout:4/792: creat d7/d1a/d5c/d6d/d2c/ffd x:0 0 0 2024-08-31T05:21:12.197 INFO:tasks.workunit.client.1.smithi073.stdout:8/875: mkdir d0/db/d1c/d34/d38/d113 0 2024-08-31T05:21:12.199 INFO:tasks.workunit.client.1.smithi073.stdout:0/907: write d0/d69/d7f/d68/d91/df5/d3c/d9c/dc8/fff [330341,56982] 0 2024-08-31T05:21:12.201 INFO:tasks.workunit.client.1.smithi073.stdout:6/844: dwrite d15/d17/da1/dae/db0/d38/d9b/f9d [0,4194304] 0 2024-08-31T05:21:12.204 INFO:tasks.workunit.client.1.smithi073.stdout:7/881: mkdir d1/da/d15/d33/d44/d74/dd6/dea/d111 0 2024-08-31T05:21:12.207 INFO:tasks.workunit.client.1.smithi073.stdout:0/908: truncate d0/d69/d7f/d68/d91/df5/d3c/f10d 18395 0 2024-08-31T05:21:12.208 INFO:tasks.workunit.client.1.smithi073.stdout:7/882: truncate d1/da/d3e/f107 234288 0 2024-08-31T05:21:12.208 INFO:tasks.workunit.client.1.smithi073.stdout:4/793: dwrite d7/d1a/d5c/d6d/d2c/fef [0,4194304] 0 2024-08-31T05:21:12.211 INFO:tasks.workunit.client.1.smithi073.stdout:2/868: dread d2/d9/d3c/f57 [0,4194304] 0 2024-08-31T05:21:12.213 INFO:tasks.workunit.client.1.smithi073.stdout:9/946: creat dc/d37/d42/d8d/f134 x:0 0 0 2024-08-31T05:21:12.213 INFO:tasks.workunit.client.1.smithi073.stdout:6/845: mknod d15/d1a/d2b/d2f/d4b/d88/c11c 0 2024-08-31T05:21:12.214 INFO:tasks.workunit.client.1.smithi073.stdout:1/869: sync 2024-08-31T05:21:12.215 INFO:tasks.workunit.client.1.smithi073.stdout:7/883: chown d1/da/d15/d33/d44/d74/c93 217265334 1 2024-08-31T05:21:12.215 INFO:tasks.workunit.client.1.smithi073.stdout:6/846: dread - d15/d1a/d51/d61/ff4 zero size 2024-08-31T05:21:12.217 INFO:tasks.workunit.client.1.smithi073.stdout:4/794: readlink d7/df/d13/d53/d88/lce 0 2024-08-31T05:21:12.217 INFO:tasks.workunit.client.1.smithi073.stdout:2/869: dread - d2/d9/d3c/f40 zero size 2024-08-31T05:21:12.218 INFO:tasks.workunit.client.1.smithi073.stdout:9/947: fsync dc/de/dd8/d126/fff 0 2024-08-31T05:21:12.219 INFO:tasks.workunit.client.1.smithi073.stdout:3/953: dread da/d3c/d5a/db8/fc5 [0,4194304] 0 2024-08-31T05:21:12.221 INFO:tasks.workunit.client.1.smithi073.stdout:4/795: unlink d7/df/d13/c55 0 2024-08-31T05:21:12.222 INFO:tasks.workunit.client.1.smithi073.stdout:3/954: chown da/d3c/d65/c3b 0 1 2024-08-31T05:21:12.222 INFO:tasks.workunit.client.1.smithi073.stdout:1/870: symlink d5/d26/da5/dba/d1c/d27/l106 0 2024-08-31T05:21:12.223 INFO:tasks.workunit.client.1.smithi073.stdout:7/884: rename d1/d11/c3f to d1/da/d15/d33/d44/d74/dd6/dea/c112 0 2024-08-31T05:21:12.225 INFO:tasks.workunit.client.1.smithi073.stdout:4/796: chown d7/d1a/d5c/d6d/d2c/d2d/f57 438 1 2024-08-31T05:21:12.225 INFO:tasks.workunit.client.1.smithi073.stdout:9/948: creat dc/d37/d42/d5a/f135 x:0 0 0 2024-08-31T05:21:12.226 INFO:tasks.workunit.client.1.smithi073.stdout:8/876: dwrite d0/db/d1c/d34/d80/d9a/fa1 [0,4194304] 0 2024-08-31T05:21:12.229 INFO:tasks.workunit.client.1.smithi073.stdout:1/871: symlink d5/d26/d54/db2/ddb/d102/l107 0 2024-08-31T05:21:12.229 INFO:tasks.workunit.client.1.smithi073.stdout:4/797: chown d7/df/d13/d53/d88/d9d/fb0 1022 1 2024-08-31T05:21:12.232 INFO:tasks.workunit.client.1.smithi073.stdout:3/955: rename da/d3c/d65/d40/d5d/dd2 to da/d3c/d65/d45/dcd/d108/da2/d12f 0 2024-08-31T05:21:12.235 INFO:tasks.workunit.client.1.smithi073.stdout:6/847: dread d15/f29 [0,4194304] 0 2024-08-31T05:21:12.236 INFO:tasks.workunit.client.1.smithi073.stdout:1/872: symlink d5/d26/d54/db2/ddb/d102/l108 0 2024-08-31T05:21:12.236 INFO:tasks.workunit.client.1.smithi073.stdout:3/956: readlink da/d3c/d65/d45/dcd/d108/da2/daf/dbc/l114 0 2024-08-31T05:21:12.237 INFO:tasks.workunit.client.1.smithi073.stdout:9/949: link dc/de/d66/d84/lfe dc/de/d11/d85/l136 0 2024-08-31T05:21:12.238 INFO:tasks.workunit.client.1.smithi073.stdout:7/885: getdents d1/da/d15/d33/d44/d60/de1 0 2024-08-31T05:21:12.238 INFO:tasks.workunit.client.1.smithi073.stdout:9/950: dread - dc/d37/d42/d5a/f135 zero size 2024-08-31T05:21:12.239 INFO:tasks.workunit.client.1.smithi073.stdout:7/886: readlink d1/da/d15/lb9 0 2024-08-31T05:21:12.239 INFO:tasks.workunit.client.1.smithi073.stdout:1/873: mknod d5/d26/d54/db2/ddb/c109 0 2024-08-31T05:21:12.240 INFO:tasks.workunit.client.1.smithi073.stdout:3/957: chown da/d3c/d65/d2c/d8e/dc2/d110 120 1 2024-08-31T05:21:12.240 INFO:tasks.workunit.client.1.smithi073.stdout:6/848: mknod d15/d1a/d1e/d69/c11d 0 2024-08-31T05:21:12.242 INFO:tasks.workunit.client.1.smithi073.stdout:1/874: chown d5/d26/d54/db2/dd5/d32/d37 2 1 2024-08-31T05:21:12.243 INFO:tasks.workunit.client.1.smithi073.stdout:3/958: mknod da/d68/c130 0 2024-08-31T05:21:12.244 INFO:tasks.workunit.client.1.smithi073.stdout:0/909: dread d0/d15/d2c/fb9 [0,4194304] 0 2024-08-31T05:21:12.245 INFO:tasks.workunit.client.1.smithi073.stdout:6/849: mknod d15/d1a/d51/d61/d7c/da6/c11e 0 2024-08-31T05:21:12.245 INFO:tasks.workunit.client.1.smithi073.stdout:8/877: write d0/db/d44/d72/d75/d7e/f99 [3741271,114185] 0 2024-08-31T05:21:12.247 INFO:tasks.workunit.client.1.smithi073.stdout:3/959: fsync da/d3c/f42 0 2024-08-31T05:21:12.248 INFO:tasks.workunit.client.1.smithi073.stdout:7/887: symlink d1/da/d15/d33/d44/d74/dd6/dea/d111/l113 0 2024-08-31T05:21:12.250 INFO:tasks.workunit.client.1.smithi073.stdout:9/951: dwrite dc/d37/d42/d5a/da0/dcd/d105/f128 [0,4194304] 0 2024-08-31T05:21:12.250 INFO:tasks.workunit.client.1.smithi073.stdout:0/910: symlink d0/d28/l134 0 2024-08-31T05:21:12.250 INFO:tasks.workunit.client.1.smithi073.stdout:6/850: chown d15/d41/d89/cca 4177298 1 2024-08-31T05:21:12.251 INFO:tasks.workunit.client.1.smithi073.stdout:1/875: write d5/f9 [912322,43177] 0 2024-08-31T05:21:12.253 INFO:tasks.workunit.client.1.smithi073.stdout:3/960: read - da/d3c/d82/d97/fce zero size 2024-08-31T05:21:12.254 INFO:tasks.workunit.client.1.smithi073.stdout:2/870: dread d2/d9/df/f29 [0,4194304] 0 2024-08-31T05:21:12.254 INFO:tasks.workunit.client.1.smithi073.stdout:8/878: write d0/db/d44/d72/d75/d7e/d91/f97 [2576695,102997] 0 2024-08-31T05:21:12.258 INFO:tasks.workunit.client.1.smithi073.stdout:2/871: write d2/d9/d27/d76/d97/faf [58903,109974] 0 2024-08-31T05:21:12.259 INFO:tasks.workunit.client.1.smithi073.stdout:0/911: dread d0/d69/d8e/fc3 [0,4194304] 0 2024-08-31T05:21:12.261 INFO:tasks.workunit.client.1.smithi073.stdout:7/888: creat d1/da/d3e/d22/d6b/ddf/de2/f114 x:0 0 0 2024-08-31T05:21:12.262 INFO:tasks.workunit.client.1.smithi073.stdout:6/851: mknod d15/c11f 0 2024-08-31T05:21:12.265 INFO:tasks.workunit.client.0.smithi067.stdout:8/252: sync 2024-08-31T05:21:12.265 INFO:tasks.workunit.client.0.smithi067.stdout:7/113: sync 2024-08-31T05:21:12.265 INFO:tasks.workunit.client.0.smithi067.stdout:2/166: sync 2024-08-31T05:21:12.265 INFO:tasks.workunit.client.0.smithi067.stdout:0/184: sync 2024-08-31T05:21:12.265 INFO:tasks.workunit.client.0.smithi067.stdout:9/108: sync 2024-08-31T05:21:12.265 INFO:tasks.workunit.client.0.smithi067.stdout:5/125: sync 2024-08-31T05:21:12.265 INFO:tasks.workunit.client.0.smithi067.stdout:4/131: sync 2024-08-31T05:21:12.266 INFO:tasks.workunit.client.0.smithi067.stdout:0/185: dread - d1/f39 zero size 2024-08-31T05:21:12.266 INFO:tasks.workunit.client.1.smithi073.stdout:9/952: truncate dc/d27/ddc/ff7 1799974 0 2024-08-31T05:21:12.267 INFO:tasks.workunit.client.0.smithi067.stdout:2/167: chown db/d12/d24 756828 1 2024-08-31T05:21:12.270 INFO:tasks.workunit.client.1.smithi073.stdout:1/876: write d5/d26/f46 [158217,31478] 0 2024-08-31T05:21:12.272 INFO:tasks.workunit.client.1.smithi073.stdout:2/872: creat d2/d9/d7f/dab/daa/f10e x:0 0 0 2024-08-31T05:21:12.273 INFO:tasks.workunit.client.1.smithi073.stdout:0/912: mkdir d0/d69/d7f/d68/d91/df5/d3c/d9c/db6/dc6/d135 0 2024-08-31T05:21:12.273 INFO:tasks.workunit.client.1.smithi073.stdout:2/873: chown d2/d9/d7f/dab/dc4 99829 1 2024-08-31T05:21:12.273 INFO:tasks.workunit.client.0.smithi067.stdout:9/109: write dd/df/f1f [1017825,112519] 0 2024-08-31T05:21:12.274 INFO:tasks.workunit.client.1.smithi073.stdout:8/879: mknod d0/c114 0 2024-08-31T05:21:12.274 INFO:tasks.workunit.client.1.smithi073.stdout:3/961: dwrite da/fb [0,4194304] 0 2024-08-31T05:21:12.275 INFO:tasks.workunit.client.0.smithi067.stdout:8/253: fsync d0/d4/de/d1d/f3a 0 2024-08-31T05:21:12.275 INFO:tasks.workunit.client.1.smithi073.stdout:0/913: dread d0/d15/d2c/d40/f56 [0,4194304] 0 2024-08-31T05:21:12.277 INFO:tasks.workunit.client.0.smithi067.stdout:2/168: symlink db/d12/l27 0 2024-08-31T05:21:12.279 INFO:tasks.workunit.client.1.smithi073.stdout:2/874: dwrite d2/f105 [0,4194304] 0 2024-08-31T05:21:12.282 INFO:tasks.workunit.client.0.smithi067.stdout:5/126: dread db/f19 [0,4194304] 0 2024-08-31T05:21:12.284 INFO:tasks.workunit.client.0.smithi067.stdout:4/132: symlink d4/l2e 0 2024-08-31T05:21:12.285 INFO:tasks.workunit.client.0.smithi067.stdout:9/110: dwrite dd/df/f1f [0,4194304] 0 2024-08-31T05:21:12.289 INFO:tasks.workunit.client.1.smithi073.stdout:7/889: link d1/da/d3e/d22/d47/f79 d1/da/db2/f115 0 2024-08-31T05:21:12.290 INFO:tasks.workunit.client.0.smithi067.stdout:4/133: dread d4/d13/f1a [0,4194304] 0 2024-08-31T05:21:12.292 INFO:tasks.workunit.client.0.smithi067.stdout:2/169: rename db/dd/f1d to db/dd/d13/f28 0 2024-08-31T05:21:12.294 INFO:tasks.workunit.client.0.smithi067.stdout:2/170: chown db/dd/f15 358100 1 2024-08-31T05:21:12.294 INFO:tasks.workunit.client.1.smithi073.stdout:3/962: symlink da/d3c/d67/db7/l131 0 2024-08-31T05:21:12.296 INFO:tasks.workunit.client.0.smithi067.stdout:0/186: link d1/df/d17/f20 d1/dd/d18/f41 0 2024-08-31T05:21:12.301 INFO:tasks.workunit.client.1.smithi073.stdout:6/852: mkdir d15/d1a/d2b/d120 0 2024-08-31T05:21:12.303 INFO:tasks.workunit.client.0.smithi067.stdout:0/187: dwrite d1/d8/f23 [0,4194304] 0 2024-08-31T05:21:12.305 INFO:tasks.workunit.client.1.smithi073.stdout:9/953: write dc/d10/f18 [232442,37803] 0 2024-08-31T05:21:12.305 INFO:tasks.workunit.client.0.smithi067.stdout:7/114: write f6 [2314190,79282] 0 2024-08-31T05:21:12.306 INFO:tasks.workunit.client.1.smithi073.stdout:1/877: mknod d5/d26/d54/d5f/dfd/c10a 0 2024-08-31T05:21:12.307 INFO:tasks.workunit.client.0.smithi067.stdout:7/115: write f7 [1360111,31294] 0 2024-08-31T05:21:12.307 INFO:tasks.workunit.client.1.smithi073.stdout:7/890: write d1/d11/fde [384558,18157] 0 2024-08-31T05:21:12.315 INFO:tasks.workunit.client.1.smithi073.stdout:1/878: creat d5/d26/d54/db2/ddb/d102/f10b x:0 0 0 2024-08-31T05:21:12.316 INFO:tasks.workunit.client.1.smithi073.stdout:1/879: truncate d5/d26/da5/ffe 332487 0 2024-08-31T05:21:12.319 INFO:tasks.workunit.client.0.smithi067.stdout:8/254: dwrite d0/d2/f15 [0,4194304] 0 2024-08-31T05:21:12.323 INFO:tasks.workunit.client.0.smithi067.stdout:0/188: fsync d1/df/d17/f20 0 2024-08-31T05:21:12.325 INFO:tasks.workunit.client.0.smithi067.stdout:0/189: dread - d1/dd/d18/f3e zero size 2024-08-31T05:21:12.326 INFO:tasks.workunit.client.0.smithi067.stdout:0/190: fdatasync d1/dd/d18/f3e 0 2024-08-31T05:21:12.327 INFO:tasks.workunit.client.0.smithi067.stdout:7/116: creat d14/d16/f22 x:0 0 0 2024-08-31T05:21:12.328 INFO:tasks.workunit.client.0.smithi067.stdout:7/117: write d14/f1e [1944523,51989] 0 2024-08-31T05:21:12.328 INFO:tasks.workunit.client.1.smithi073.stdout:2/875: write d2/d9/d3c/f40 [232055,51844] 0 2024-08-31T05:21:12.330 INFO:tasks.workunit.client.0.smithi067.stdout:5/127: getdents db 0 2024-08-31T05:21:12.330 INFO:tasks.workunit.client.0.smithi067.stdout:7/118: dread d14/f1a [0,4194304] 0 2024-08-31T05:21:12.330 INFO:tasks.workunit.client.1.smithi073.stdout:1/880: unlink d5/d26/d54/db2/dd5/fca 0 2024-08-31T05:21:12.331 INFO:tasks.workunit.client.0.smithi067.stdout:2/171: truncate db/ff 771797 0 2024-08-31T05:21:12.336 INFO:tasks.workunit.client.1.smithi073.stdout:6/853: rmdir d15/d1a/d2b/d2f/d4b/d97/de3 0 2024-08-31T05:21:12.336 INFO:tasks.workunit.client.1.smithi073.stdout:0/914: dwrite d0/d69/d7f/d68/d91/df5/d3c/d9c/dc8/fe9 [0,4194304] 0 2024-08-31T05:21:12.337 INFO:tasks.workunit.client.0.smithi067.stdout:8/255: creat d0/d4/de/d1d/d2c/f55 x:0 0 0 2024-08-31T05:21:12.337 INFO:tasks.workunit.client.0.smithi067.stdout:0/191: dwrite d1/dd/f15 [0,4194304] 0 2024-08-31T05:21:12.337 INFO:tasks.workunit.client.0.smithi067.stdout:4/134: dwrite d4/d9/fa [4194304,4194304] 0 2024-08-31T05:21:12.338 INFO:tasks.workunit.client.1.smithi073.stdout:6/854: stat d15/d17/da1/dae/db0/f2c 0 2024-08-31T05:21:12.338 INFO:tasks.workunit.client.1.smithi073.stdout:9/954: creat dc/d37/db5/f137 x:0 0 0 2024-08-31T05:21:12.340 INFO:tasks.workunit.client.0.smithi067.stdout:9/111: creat dd/f22 x:0 0 0 2024-08-31T05:21:12.342 INFO:tasks.workunit.client.1.smithi073.stdout:7/891: dwrite d1/da/d15/d33/d44/d74/dd6/dea/f3c [0,4194304] 0 2024-08-31T05:21:12.346 INFO:tasks.workunit.client.0.smithi067.stdout:4/135: read d4/d13/f24 [209442,723] 0 2024-08-31T05:21:12.346 INFO:tasks.workunit.client.0.smithi067.stdout:5/128: rename db/c1f to db/c24 0 2024-08-31T05:21:12.348 INFO:tasks.workunit.client.0.smithi067.stdout:8/256: dread d0/d2/dc/f49 [0,4194304] 0 2024-08-31T05:21:12.355 INFO:tasks.workunit.client.1.smithi073.stdout:2/876: symlink d2/d9/l10f 0 2024-08-31T05:21:12.361 INFO:tasks.workunit.client.0.smithi067.stdout:0/192: mkdir d1/d8/d42 0 2024-08-31T05:21:12.362 INFO:tasks.workunit.client.0.smithi067.stdout:0/193: truncate d1/f39 82387 0 2024-08-31T05:21:12.362 INFO:tasks.workunit.client.0.smithi067.stdout:0/194: fsync d1/f6 0 2024-08-31T05:21:12.365 INFO:tasks.workunit.client.1.smithi073.stdout:9/955: dread dc/de/d66/d84/da2/fa5 [0,4194304] 0 2024-08-31T05:21:12.365 INFO:tasks.workunit.client.0.smithi067.stdout:9/112: rename dd/df/f15 to dd/df/f23 0 2024-08-31T05:21:12.366 INFO:tasks.workunit.client.1.smithi073.stdout:2/877: chown d2/d9/df/d43/l90 1865 1 2024-08-31T05:21:12.366 INFO:tasks.workunit.client.1.smithi073.stdout:0/915: link d0/d58/cb7 d0/d89/c136 0 2024-08-31T05:21:12.367 INFO:tasks.workunit.client.1.smithi073.stdout:0/916: truncate d0/d15/d9b/f116 143855 0 2024-08-31T05:21:12.368 INFO:tasks.workunit.client.0.smithi067.stdout:8/257: chown d0/d2/d6/f27 3 1 2024-08-31T05:21:12.369 INFO:tasks.workunit.client.1.smithi073.stdout:0/917: fsync d0/d69/d7f/d68/d91/df5/d3c/d9c/ff1 0 2024-08-31T05:21:12.369 INFO:tasks.workunit.client.1.smithi073.stdout:6/855: link l12 d15/d75/dc8/dea/l121 0 2024-08-31T05:21:12.370 INFO:tasks.workunit.client.1.smithi073.stdout:0/918: readlink d0/d69/d7f/d68/d91/df5/l104 0 2024-08-31T05:21:12.370 INFO:tasks.workunit.client.1.smithi073.stdout:9/956: symlink dc/dc4/d131/l138 0 2024-08-31T05:21:12.374 INFO:tasks.workunit.client.0.smithi067.stdout:8/258: dwrite d0/d4/de/f11 [0,4194304] 0 2024-08-31T05:21:12.375 INFO:tasks.workunit.client.1.smithi073.stdout:2/878: creat d2/d9/d7f/dab/d5d/da1/f110 x:0 0 0 2024-08-31T05:21:12.376 INFO:tasks.workunit.client.1.smithi073.stdout:6/856: read d15/d17/da1/dae/db0/d38/f98 [263657,61001] 0 2024-08-31T05:21:12.376 INFO:tasks.workunit.client.0.smithi067.stdout:0/195: write d1/d8/f33 [781858,46577] 0 2024-08-31T05:21:12.377 INFO:tasks.workunit.client.0.smithi067.stdout:0/196: readlink d1/dd/l3c 0 2024-08-31T05:21:12.377 INFO:tasks.workunit.client.1.smithi073.stdout:6/857: chown d15/d17/da1/dae/cd2 204986726 1 2024-08-31T05:21:12.378 INFO:tasks.workunit.client.1.smithi073.stdout:4/798: sync 2024-08-31T05:21:12.379 INFO:tasks.workunit.client.1.smithi073.stdout:2/879: dread d2/d9/d7f/dab/d5d/d82/f8a [0,4194304] 0 2024-08-31T05:21:12.380 INFO:tasks.workunit.client.1.smithi073.stdout:2/880: write d2/d9/d27/d9b/da6/f75 [2024574,108308] 0 2024-08-31T05:21:12.382 INFO:tasks.workunit.client.1.smithi073.stdout:2/881: write d2/d9/df/f3b [2101552,76389] 0 2024-08-31T05:21:12.383 INFO:tasks.workunit.client.0.smithi067.stdout:9/113: rename dd/df/f17 to dd/df/f24 0 2024-08-31T05:21:12.383 INFO:tasks.workunit.client.1.smithi073.stdout:2/882: write d2/d9/d7f/fb0 [3539765,13882] 0 2024-08-31T05:21:12.385 INFO:tasks.workunit.client.1.smithi073.stdout:2/883: write d2/d9/d27/d76/db5/dc6/dd1/f10b [973103,81502] 0 2024-08-31T05:21:12.386 INFO:tasks.workunit.client.1.smithi073.stdout:2/884: dread - d2/d9/d27/d9b/da6/ddd/fee zero size 2024-08-31T05:21:12.387 INFO:tasks.workunit.client.0.smithi067.stdout:4/136: rename d4/ld to d4/d14/l2f 0 2024-08-31T05:21:12.388 INFO:tasks.workunit.client.1.smithi073.stdout:2/885: dread d2/d9/d7f/dab/f47 [4194304,4194304] 0 2024-08-31T05:21:12.392 INFO:tasks.workunit.client.0.smithi067.stdout:5/129: fsync db/f19 0 2024-08-31T05:21:12.395 INFO:tasks.workunit.client.0.smithi067.stdout:8/259: mknod d0/d4/c56 0 2024-08-31T05:21:12.396 INFO:tasks.workunit.client.0.smithi067.stdout:8/260: readlink d0/d2/d6/l7 0 2024-08-31T05:21:12.397 INFO:tasks.workunit.client.0.smithi067.stdout:0/197: mkdir d1/df/d17/d43 0 2024-08-31T05:21:12.398 INFO:tasks.workunit.client.0.smithi067.stdout:2/172: dwrite db/dd/f17 [0,4194304] 0 2024-08-31T05:21:12.399 INFO:tasks.workunit.client.0.smithi067.stdout:0/198: write d1/f2c [3969605,25526] 0 2024-08-31T05:21:12.399 INFO:tasks.workunit.client.0.smithi067.stdout:2/173: chown l9 5 1 2024-08-31T05:21:12.403 INFO:tasks.workunit.client.0.smithi067.stdout:9/114: mkdir dd/df/d25 0 2024-08-31T05:21:12.410 INFO:tasks.workunit.client.0.smithi067.stdout:8/261: creat d0/d2/da/f57 x:0 0 0 2024-08-31T05:21:12.411 INFO:tasks.workunit.client.0.smithi067.stdout:0/199: mkdir d1/df/d29/d44 0 2024-08-31T05:21:12.411 INFO:tasks.workunit.client.1.smithi073.stdout:2/886: dread d2/d9/df/d43/fb7 [0,4194304] 0 2024-08-31T05:21:12.411 INFO:tasks.workunit.client.1.smithi073.stdout:2/887: chown d2/d9/lc 104 1 2024-08-31T05:21:12.412 INFO:tasks.workunit.client.0.smithi067.stdout:2/174: rmdir db/d12/d24 39 2024-08-31T05:21:12.413 INFO:tasks.workunit.client.1.smithi073.stdout:2/888: chown d2/d9/d7f/dab/d5d/f71 30 1 2024-08-31T05:21:12.414 INFO:tasks.workunit.client.0.smithi067.stdout:9/115: rename dd/f1b to dd/df/d25/f26 0 2024-08-31T05:21:12.414 INFO:tasks.workunit.client.0.smithi067.stdout:7/119: link c10 d14/c23 0 2024-08-31T05:21:12.415 INFO:tasks.workunit.client.0.smithi067.stdout:9/116: chown dd/df/l21 6 1 2024-08-31T05:21:12.416 INFO:tasks.workunit.client.0.smithi067.stdout:0/200: dwrite d1/d8/f33 [0,4194304] 0 2024-08-31T05:21:12.417 INFO:tasks.workunit.client.0.smithi067.stdout:4/137: link d4/f25 d4/d1f/f30 0 2024-08-31T05:21:12.423 INFO:tasks.workunit.client.0.smithi067.stdout:9/117: creat dd/df/f27 x:0 0 0 2024-08-31T05:21:12.424 INFO:tasks.workunit.client.0.smithi067.stdout:4/138: fsync d4/d13/f1a 0 2024-08-31T05:21:12.426 INFO:tasks.workunit.client.0.smithi067.stdout:8/262: mknod d0/c58 0 2024-08-31T05:21:12.427 INFO:tasks.workunit.client.1.smithi073.stdout:7/892: getdents d1/da/d3e/d22/d35/d83 0 2024-08-31T05:21:12.429 INFO:tasks.workunit.client.0.smithi067.stdout:7/120: link f7 d14/d16/f24 0 2024-08-31T05:21:12.430 INFO:tasks.workunit.client.1.smithi073.stdout:6/858: creat d15/d17/da1/f122 x:0 0 0 2024-08-31T05:21:12.431 INFO:tasks.workunit.client.1.smithi073.stdout:4/799: fsync d7/df/d13/d2e/f36 0 2024-08-31T05:21:12.432 INFO:tasks.workunit.client.1.smithi073.stdout:6/859: dread d15/f29 [0,4194304] 0 2024-08-31T05:21:12.432 INFO:tasks.workunit.client.1.smithi073.stdout:4/800: chown d7/db/c7c 855467644 1 2024-08-31T05:21:12.433 INFO:tasks.workunit.client.1.smithi073.stdout:4/801: write d7/d1a/d5c/d6d/d59/d65/db9/dd6/fe1 [24476,120341] 0 2024-08-31T05:21:12.434 INFO:tasks.workunit.client.0.smithi067.stdout:5/130: getdents db 0 2024-08-31T05:21:12.434 INFO:tasks.workunit.client.0.smithi067.stdout:8/263: symlink d0/d2/d6/l59 0 2024-08-31T05:21:12.436 INFO:tasks.workunit.client.0.smithi067.stdout:5/131: write f9 [840679,113551] 0 2024-08-31T05:21:12.439 INFO:tasks.workunit.client.0.smithi067.stdout:8/264: dread - d0/d2/da/f57 zero size 2024-08-31T05:21:12.439 INFO:tasks.workunit.client.0.smithi067.stdout:9/118: dwrite dd/df/f23 [0,4194304] 0 2024-08-31T05:21:12.440 INFO:tasks.workunit.client.0.smithi067.stdout:7/121: write d14/d16/f24 [912290,101038] 0 2024-08-31T05:21:12.441 INFO:tasks.workunit.client.1.smithi073.stdout:7/893: mknod d1/da/d3e/d22/d47/da8/c116 0 2024-08-31T05:21:12.442 INFO:tasks.workunit.client.0.smithi067.stdout:2/175: getdents db/dd 0 2024-08-31T05:21:12.442 INFO:tasks.workunit.client.0.smithi067.stdout:5/132: write db/f1e [1679966,23823] 0 2024-08-31T05:21:12.444 INFO:tasks.workunit.client.0.smithi067.stdout:9/119: write dd/f22 [402732,82148] 0 2024-08-31T05:21:12.446 INFO:tasks.workunit.client.0.smithi067.stdout:2/176: write db/d12/d1a/f20 [857383,14160] 0 2024-08-31T05:21:12.447 INFO:tasks.workunit.client.0.smithi067.stdout:4/139: dwrite d4/d1f/f30 [0,4194304] 0 2024-08-31T05:21:12.448 INFO:tasks.workunit.client.0.smithi067.stdout:5/133: dread db/d15/f22 [0,4194304] 0 2024-08-31T05:21:12.449 INFO:tasks.workunit.client.0.smithi067.stdout:7/122: mknod d14/c25 0 2024-08-31T05:21:12.451 INFO:tasks.workunit.client.1.smithi073.stdout:4/802: dwrite d7/df/d13/d2e/d47/d4c/d73/f87 [0,4194304] 0 2024-08-31T05:21:12.453 INFO:tasks.workunit.client.0.smithi067.stdout:7/123: truncate fd 1774919 0 2024-08-31T05:21:12.453 INFO:tasks.workunit.client.0.smithi067.stdout:4/140: unlink d4/d9/l29 0 2024-08-31T05:21:12.455 INFO:tasks.workunit.client.1.smithi073.stdout:4/803: mkdir d7/d1a/d5c/d62/df4/dfe 0 2024-08-31T05:21:12.457 INFO:tasks.workunit.client.0.smithi067.stdout:8/265: dwrite d0/d4/f20 [0,4194304] 0 2024-08-31T05:21:12.457 INFO:tasks.workunit.client.0.smithi067.stdout:9/120: dwrite dd/f1e [0,4194304] 0 2024-08-31T05:21:12.458 INFO:tasks.workunit.client.1.smithi073.stdout:2/889: dread d2/d9/d7f/dab/f39 [0,4194304] 0 2024-08-31T05:21:12.459 INFO:tasks.workunit.client.0.smithi067.stdout:8/266: stat d0/d2/da 0 2024-08-31T05:21:12.459 INFO:tasks.workunit.client.1.smithi073.stdout:2/890: write d2/d9/d27/d76/fde [77454,40238] 0 2024-08-31T05:21:12.460 INFO:tasks.workunit.client.0.smithi067.stdout:7/124: creat d14/f26 x:0 0 0 2024-08-31T05:21:12.460 INFO:tasks.workunit.client.1.smithi073.stdout:2/891: chown d2/d9/df/f1a 11 1 2024-08-31T05:21:12.460 INFO:tasks.workunit.client.0.smithi067.stdout:8/267: fdatasync d0/d2/f24 0 2024-08-31T05:21:12.461 INFO:tasks.workunit.client.0.smithi067.stdout:8/268: dread - d0/d2/dc/f48 zero size 2024-08-31T05:21:12.462 INFO:tasks.workunit.client.0.smithi067.stdout:8/269: chown d0/d2/f24 6355 1 2024-08-31T05:21:12.464 INFO:tasks.workunit.client.0.smithi067.stdout:4/141: rename d4/d14/f1b to d4/d1f/f31 0 2024-08-31T05:21:12.465 INFO:tasks.workunit.client.1.smithi073.stdout:2/892: mknod d2/d9/d7f/dab/dc4/c111 0 2024-08-31T05:21:12.468 INFO:tasks.workunit.client.1.smithi073.stdout:8/880: sync 2024-08-31T05:21:12.468 INFO:tasks.workunit.client.1.smithi073.stdout:2/893: fsync d2/f2c 0 2024-08-31T05:21:12.469 INFO:tasks.workunit.client.0.smithi067.stdout:4/142: mkdir d4/d32 0 2024-08-31T05:21:12.470 INFO:tasks.workunit.client.1.smithi073.stdout:2/894: dread - d2/d9/d27/d9b/da7/fad zero size 2024-08-31T05:21:12.472 INFO:tasks.workunit.client.1.smithi073.stdout:2/895: chown d2/d9/d66/d70/dc9/lcc 200331241 1 2024-08-31T05:21:12.475 INFO:tasks.workunit.client.1.smithi073.stdout:2/896: mkdir d2/d9/d112 0 2024-08-31T05:21:12.475 INFO:tasks.workunit.client.0.smithi067.stdout:4/143: dwrite d4/f10 [0,4194304] 0 2024-08-31T05:21:12.476 INFO:tasks.workunit.client.1.smithi073.stdout:2/897: dread - d2/d25/d92/de7/ff8 zero size 2024-08-31T05:21:12.476 INFO:tasks.workunit.client.0.smithi067.stdout:4/144: write d4/f10 [2147768,76863] 0 2024-08-31T05:21:12.479 INFO:tasks.workunit.client.0.smithi067.stdout:4/145: rename d4/l2c to d4/d13/l33 0 2024-08-31T05:21:12.480 INFO:tasks.workunit.client.0.smithi067.stdout:4/146: read d4/d1f/f30 [130010,112943] 0 2024-08-31T05:21:12.483 INFO:tasks.workunit.client.0.smithi067.stdout:4/147: mkdir d4/d1f/d34 0 2024-08-31T05:21:12.483 INFO:tasks.workunit.client.1.smithi073.stdout:2/898: link d2/d9/d66/d70/dc9/lcc d2/d9/d7f/dab/d5d/l113 0 2024-08-31T05:21:12.484 INFO:tasks.workunit.client.0.smithi067.stdout:4/148: symlink d4/d9/l35 0 2024-08-31T05:21:12.485 INFO:tasks.workunit.client.1.smithi073.stdout:4/804: dread d7/df/d13/f9e [0,4194304] 0 2024-08-31T05:21:12.485 INFO:tasks.workunit.client.1.smithi073.stdout:2/899: symlink d2/d9/d27/d76/d7e/l114 0 2024-08-31T05:21:12.486 INFO:tasks.workunit.client.0.smithi067.stdout:4/149: write d4/d9/fa [7436915,82990] 0 2024-08-31T05:21:12.486 INFO:tasks.workunit.client.1.smithi073.stdout:2/900: chown d2/d9/df/l6a 396 1 2024-08-31T05:21:12.487 INFO:tasks.workunit.client.1.smithi073.stdout:2/901: chown d2/d9/d7f/dab/lbc 247063031 1 2024-08-31T05:21:12.489 INFO:tasks.workunit.client.0.smithi067.stdout:4/150: rename d4/d13/c28 to d4/d14/c36 0 2024-08-31T05:21:12.490 INFO:tasks.workunit.client.0.smithi067.stdout:4/151: symlink d4/d1f/l37 0 2024-08-31T05:21:12.491 INFO:tasks.workunit.client.1.smithi073.stdout:3/963: sync 2024-08-31T05:21:12.492 INFO:tasks.workunit.client.0.smithi067.stdout:4/152: symlink d4/d9/l38 0 2024-08-31T05:21:12.492 INFO:tasks.workunit.client.1.smithi073.stdout:3/964: write da/d3c/d82/d97/fd4 [3406152,46051] 0 2024-08-31T05:21:12.493 INFO:tasks.workunit.client.0.smithi067.stdout:4/153: truncate d4/f10 5330710 0 2024-08-31T05:21:12.495 INFO:tasks.workunit.client.1.smithi073.stdout:3/965: creat da/d3c/d5a/db8/f132 x:0 0 0 2024-08-31T05:21:12.496 INFO:tasks.workunit.client.0.smithi067.stdout:6/343: sync 2024-08-31T05:21:12.497 INFO:tasks.workunit.client.1.smithi073.stdout:4/805: dread d7/df/d13/f16 [0,4194304] 0 2024-08-31T05:21:12.499 INFO:tasks.workunit.client.0.smithi067.stdout:4/154: dread d4/d13/f1c [0,4194304] 0 2024-08-31T05:21:12.499 INFO:tasks.workunit.client.0.smithi067.stdout:6/344: symlink d1b/d40/l6d 0 2024-08-31T05:21:12.504 INFO:tasks.workunit.client.1.smithi073.stdout:4/806: rename d7/d1a/fb5 to d7/df/d13/d53/d88/d9d/dc3/fff 0 2024-08-31T05:21:12.508 INFO:tasks.workunit.client.1.smithi073.stdout:3/966: creat da/d3c/d65/d2c/d8e/dc2/d110/d118/f133 x:0 0 0 2024-08-31T05:21:12.508 INFO:tasks.workunit.client.0.smithi067.stdout:4/155: dwrite d4/d1e/f26 [0,4194304] 0 2024-08-31T05:21:12.510 INFO:tasks.workunit.client.1.smithi073.stdout:4/807: symlink d7/df/d1b/l100 0 2024-08-31T05:21:12.512 INFO:tasks.workunit.client.1.smithi073.stdout:3/967: chown da/d3c/f71 126 1 2024-08-31T05:21:12.515 INFO:tasks.workunit.client.1.smithi073.stdout:4/808: symlink d7/df/d13/d53/d88/d9d/dc3/l101 0 2024-08-31T05:21:12.516 INFO:tasks.workunit.client.0.smithi067.stdout:4/156: truncate d4/d13/f24 1371078 0 2024-08-31T05:21:12.516 INFO:tasks.workunit.client.1.smithi073.stdout:4/809: fsync d7/d1a/d5c/d6d/d2c/ffd 0 2024-08-31T05:21:12.517 INFO:tasks.workunit.client.0.smithi067.stdout:4/157: readlink d4/d1f/l22 0 2024-08-31T05:21:12.517 INFO:tasks.workunit.client.1.smithi073.stdout:3/968: fdatasync da/d3c/d65/d40/fec 0 2024-08-31T05:21:12.517 INFO:tasks.workunit.client.1.smithi073.stdout:4/810: write d7/df/d13/f2b [6035998,39468] 0 2024-08-31T05:21:12.520 INFO:tasks.workunit.client.0.smithi067.stdout:4/158: fdatasync d4/d13/f1c 0 2024-08-31T05:21:12.522 INFO:tasks.workunit.client.1.smithi073.stdout:3/969: dwrite da/f17 [0,4194304] 0 2024-08-31T05:21:12.524 INFO:tasks.workunit.client.1.smithi073.stdout:4/811: dread d7/df/d13/d53/d88/d9d/dc3/fff [4194304,4194304] 0 2024-08-31T05:21:12.526 INFO:tasks.workunit.client.0.smithi067.stdout:2/177: dread db/f25 [0,4194304] 0 2024-08-31T05:21:12.526 INFO:tasks.workunit.client.1.smithi073.stdout:3/970: creat da/d3c/d65/d2c/d8e/dc2/d110/d118/f134 x:0 0 0 2024-08-31T05:21:12.528 INFO:tasks.workunit.client.1.smithi073.stdout:4/812: creat d7/df/d13/d2e/d47/d4c/d73/f102 x:0 0 0 2024-08-31T05:21:12.531 INFO:tasks.workunit.client.1.smithi073.stdout:3/971: creat da/d3c/d65/d2c/f135 x:0 0 0 2024-08-31T05:21:12.531 INFO:tasks.workunit.client.1.smithi073.stdout:1/881: sync 2024-08-31T05:21:12.531 INFO:tasks.workunit.client.1.smithi073.stdout:0/919: sync 2024-08-31T05:21:12.533 INFO:tasks.workunit.client.1.smithi073.stdout:0/920: truncate d0/d69/d8e/d99/f105 512836 0 2024-08-31T05:21:12.535 INFO:tasks.workunit.client.0.smithi067.stdout:2/178: link db/d12/f23 db/dd/d13/f29 0 2024-08-31T05:21:12.536 INFO:tasks.workunit.client.0.smithi067.stdout:2/179: chown db/d12/f16 10225 1 2024-08-31T05:21:12.537 INFO:tasks.workunit.client.1.smithi073.stdout:1/882: rmdir d5/d26/d54/db2/dd5/d3f 39 2024-08-31T05:21:12.541 INFO:tasks.workunit.client.1.smithi073.stdout:4/813: creat d7/df/f103 x:0 0 0 2024-08-31T05:21:12.542 INFO:tasks.workunit.client.1.smithi073.stdout:0/921: symlink d0/d15/d2c/d40/d4a/d6b/d12d/l137 0 2024-08-31T05:21:12.543 INFO:tasks.workunit.client.1.smithi073.stdout:1/883: rmdir d5/d26/da5 39 2024-08-31T05:21:12.544 INFO:tasks.workunit.client.0.smithi067.stdout:2/180: dwrite db/d12/d1a/d1e/f21 [0,4194304] 0 2024-08-31T05:21:12.544 INFO:tasks.workunit.client.1.smithi073.stdout:4/814: mknod d7/df/d13/d2e/d47/c104 0 2024-08-31T05:21:12.546 INFO:tasks.workunit.client.1.smithi073.stdout:9/957: write dc/de/d11/fc8 [433891,101045] 0 2024-08-31T05:21:12.547 INFO:tasks.workunit.client.1.smithi073.stdout:1/884: chown d5/d26/d54/db2/dd5/d3f/ca2 65399770 1 2024-08-31T05:21:12.548 INFO:tasks.workunit.client.1.smithi073.stdout:4/815: dread - d7/d1a/d5c/d6d/d2c/fbb zero size 2024-08-31T05:21:12.549 INFO:tasks.workunit.client.0.smithi067.stdout:4/159: dwrite d4/d13/f1a [0,4194304] 0 2024-08-31T05:21:12.549 INFO:tasks.workunit.client.0.smithi067.stdout:5/134: dread f6 [0,4194304] 0 2024-08-31T05:21:12.550 INFO:tasks.workunit.client.0.smithi067.stdout:4/160: chown d4/d9/fa 3568975 1 2024-08-31T05:21:12.550 INFO:tasks.workunit.client.0.smithi067.stdout:2/181: fsync db/ff 0 2024-08-31T05:21:12.553 INFO:tasks.workunit.client.1.smithi073.stdout:9/958: mknod dc/de/d11/d85/c139 0 2024-08-31T05:21:12.557 INFO:tasks.workunit.client.0.smithi067.stdout:5/135: dwrite db/d15/f18 [0,4194304] 0 2024-08-31T05:21:12.558 INFO:tasks.workunit.client.1.smithi073.stdout:4/816: rename d7/df/d1b/d34/l42 to d7/df/d13/d53/d88/dc7/l105 0 2024-08-31T05:21:12.559 INFO:tasks.workunit.client.1.smithi073.stdout:4/817: chown d7/df/d13/d53/fe6 885612692 1 2024-08-31T05:21:12.561 INFO:tasks.workunit.client.1.smithi073.stdout:9/959: unlink dc/c79 0 2024-08-31T05:21:12.562 INFO:tasks.workunit.client.1.smithi073.stdout:1/885: getdents d5/d26/d54/db2/dd5/d32/d37/d6f/dc7/df1 0 2024-08-31T05:21:12.563 INFO:tasks.workunit.client.0.smithi067.stdout:5/136: creat db/f25 x:0 0 0 2024-08-31T05:21:12.568 INFO:tasks.workunit.client.1.smithi073.stdout:7/894: write d1/da/f94 [2851657,43083] 0 2024-08-31T05:21:12.570 INFO:tasks.workunit.client.1.smithi073.stdout:6/860: dwrite d15/d1a/d51/f70 [4194304,4194304] 0 2024-08-31T05:21:12.572 INFO:tasks.workunit.client.1.smithi073.stdout:9/960: link dc/de/d11/fc8 dc/dc4/d131/f13a 0 2024-08-31T05:21:12.573 INFO:tasks.workunit.client.1.smithi073.stdout:9/961: chown dc/d37/d42/d5a/dd0 729458926 1 2024-08-31T05:21:12.573 INFO:tasks.workunit.client.0.smithi067.stdout:4/161: link d4/d9/l38 d4/d1e/l39 0 2024-08-31T05:21:12.574 INFO:tasks.workunit.client.1.smithi073.stdout:1/886: symlink d5/d26/l10c 0 2024-08-31T05:21:12.576 INFO:tasks.workunit.client.0.smithi067.stdout:5/137: dwrite f4 [0,4194304] 0 2024-08-31T05:21:12.578 INFO:tasks.workunit.client.1.smithi073.stdout:4/818: creat d7/d1a/d5c/d6d/f106 x:0 0 0 2024-08-31T05:21:12.580 INFO:tasks.workunit.client.0.smithi067.stdout:4/162: dread d4/d13/f1c [0,4194304] 0 2024-08-31T05:21:12.582 INFO:tasks.workunit.client.0.smithi067.stdout:4/163: write d4/f10 [6275057,56512] 0 2024-08-31T05:21:12.583 INFO:tasks.workunit.client.0.smithi067.stdout:4/164: chown d4/c17 2 1 2024-08-31T05:21:12.583 INFO:tasks.workunit.client.1.smithi073.stdout:7/895: rename d1/da/d15/d33/d44/d60/c77 to d1/da/d3e/db1/c117 0 2024-08-31T05:21:12.587 INFO:tasks.workunit.client.1.smithi073.stdout:9/962: creat dc/d82/de4/f13b x:0 0 0 2024-08-31T05:21:12.591 INFO:tasks.workunit.client.0.smithi067.stdout:9/121: dwrite dd/df/f11 [0,4194304] 0 2024-08-31T05:21:12.616 INFO:tasks.workunit.client.1.smithi073.stdout:7/896: readlink d1/d11/l73 0 2024-08-31T05:21:12.617 INFO:tasks.workunit.client.1.smithi073.stdout:7/897: readlink d1/da/d15/d33/d44/d74/dd6/de3/lf1 0 2024-08-31T05:21:12.618 INFO:tasks.workunit.client.0.smithi067.stdout:9/122: creat dd/df/f28 x:0 0 0 2024-08-31T05:21:12.618 INFO:tasks.workunit.client.1.smithi073.stdout:8/881: truncate d0/db/d1c/d34/d38/f94 2298063 0 2024-08-31T05:21:12.620 INFO:tasks.workunit.client.1.smithi073.stdout:9/963: chown dc/d37/db5/c11b 44481456 1 2024-08-31T05:21:12.622 INFO:tasks.workunit.client.1.smithi073.stdout:1/887: symlink d5/l10d 0 2024-08-31T05:21:12.624 INFO:tasks.workunit.client.1.smithi073.stdout:4/819: symlink d7/df/l107 0 2024-08-31T05:21:12.626 INFO:tasks.workunit.client.0.smithi067.stdout:9/123: symlink dd/d20/l29 0 2024-08-31T05:21:12.627 INFO:tasks.workunit.client.1.smithi073.stdout:7/898: mknod d1/da/d15/d33/d44/d60/c118 0 2024-08-31T05:21:12.628 INFO:tasks.workunit.client.0.smithi067.stdout:4/165: getdents d4/d14 0 2024-08-31T05:21:12.629 INFO:tasks.workunit.client.1.smithi073.stdout:2/902: write d2/f87 [894842,18455] 0 2024-08-31T05:21:12.632 INFO:tasks.workunit.client.0.smithi067.stdout:4/166: fdatasync d4/d1f/f30 0 2024-08-31T05:21:12.639 INFO:tasks.workunit.client.0.smithi067.stdout:4/167: creat d4/d1e/d21/f3a x:0 0 0 2024-08-31T05:21:12.639 INFO:tasks.workunit.client.1.smithi073.stdout:9/964: mkdir dc/dc4/d11c/d13c 0 2024-08-31T05:21:12.640 INFO:tasks.workunit.client.1.smithi073.stdout:1/888: mkdir d5/d26/d54/db2/dd5/d2a/d10e 0 2024-08-31T05:21:12.642 INFO:tasks.workunit.client.1.smithi073.stdout:2/903: rename d2/d9/d27/d76/db5/dc6/dd1/f10b to d2/d9/d27/d76/d97/f115 0 2024-08-31T05:21:12.643 INFO:tasks.workunit.client.0.smithi067.stdout:4/168: symlink d4/d13/l3b 0 2024-08-31T05:21:12.644 INFO:tasks.workunit.client.1.smithi073.stdout:4/820: rmdir d7/df/d13/d2e/d70/d6b 39 2024-08-31T05:21:12.648 INFO:tasks.workunit.client.1.smithi073.stdout:2/904: dwrite d2/d9/d27/d9b/da6/f75 [0,4194304] 0 2024-08-31T05:21:12.649 INFO:tasks.workunit.client.0.smithi067.stdout:6/345: dwrite fd [0,4194304] 0 2024-08-31T05:21:12.650 INFO:tasks.workunit.client.1.smithi073.stdout:4/821: rmdir d7/d1a/d5c 39 2024-08-31T05:21:12.652 INFO:tasks.workunit.client.0.smithi067.stdout:4/169: dwrite d4/f25 [4194304,4194304] 0 2024-08-31T05:21:12.655 INFO:tasks.workunit.client.1.smithi073.stdout:9/965: mkdir dc/d37/d42/d5a/d13d 0 2024-08-31T05:21:12.655 INFO:tasks.workunit.client.1.smithi073.stdout:1/889: dread d5/d26/d54/db2/dd5/d32/d37/f8a [0,4194304] 0 2024-08-31T05:21:12.658 INFO:tasks.workunit.client.1.smithi073.stdout:2/905: creat d2/d9/df/d43/d88/f116 x:0 0 0 2024-08-31T05:21:12.659 INFO:tasks.workunit.client.1.smithi073.stdout:2/906: chown d2/d9/df/d36/l60 200994413 1 2024-08-31T05:21:12.661 INFO:tasks.workunit.client.1.smithi073.stdout:3/972: truncate da/d3c/d5a/db8/fc5 259443 0 2024-08-31T05:21:12.662 INFO:tasks.workunit.client.1.smithi073.stdout:4/822: stat d7/d1a/d5c/fdb 0 2024-08-31T05:21:12.663 INFO:tasks.workunit.client.0.smithi067.stdout:6/346: mknod d1b/d23/c6e 0 2024-08-31T05:21:12.664 INFO:tasks.workunit.client.0.smithi067.stdout:6/347: fdatasync d1b/d23/d28/f55 0 2024-08-31T05:21:12.668 INFO:tasks.workunit.client.0.smithi067.stdout:4/170: creat d4/d1f/d34/f3c x:0 0 0 2024-08-31T05:21:12.670 INFO:tasks.workunit.client.0.smithi067.stdout:6/348: rmdir d1b/d30 39 2024-08-31T05:21:12.671 INFO:tasks.workunit.client.1.smithi073.stdout:0/922: dwrite d0/d58/fbd [0,4194304] 0 2024-08-31T05:21:12.673 INFO:tasks.workunit.client.0.smithi067.stdout:4/171: creat d4/d1f/f3d x:0 0 0 2024-08-31T05:21:12.677 INFO:tasks.workunit.client.0.smithi067.stdout:6/349: unlink d1b/l6c 0 2024-08-31T05:21:12.679 INFO:tasks.workunit.client.1.smithi073.stdout:3/973: mkdir da/d3c/dda/d136 0 2024-08-31T05:21:12.679 INFO:tasks.workunit.client.0.smithi067.stdout:2/182: truncate db/d12/d1a/f20 67847 0 2024-08-31T05:21:12.681 INFO:tasks.workunit.client.0.smithi067.stdout:4/172: mknod d4/d1f/c3e 0 2024-08-31T05:21:12.684 INFO:tasks.workunit.client.1.smithi073.stdout:4/823: rename d7/df/d13/d2e/f3a to d7/df/d13/d53/f108 0 2024-08-31T05:21:12.685 INFO:tasks.workunit.client.0.smithi067.stdout:6/350: mknod d1b/d23/d28/c6f 0 2024-08-31T05:21:12.686 INFO:tasks.workunit.client.1.smithi073.stdout:9/966: creat dc/d37/d42/d8d/f13e x:0 0 0 2024-08-31T05:21:12.687 INFO:tasks.workunit.client.1.smithi073.stdout:9/967: write dc/d37/d42/f94 [1040352,130661] 0 2024-08-31T05:21:12.689 INFO:tasks.workunit.client.1.smithi073.stdout:0/923: mknod d0/d15/d2c/d40/d4a/d6b/d12d/c138 0 2024-08-31T05:21:12.689 INFO:tasks.workunit.client.1.smithi073.stdout:6/861: write d15/d17/da1/dae/db0/d38/d9b/d87/fb5 [144039,34447] 0 2024-08-31T05:21:12.689 INFO:tasks.workunit.client.1.smithi073.stdout:0/924: chown d0/d15/d9b/cf6 84 1 2024-08-31T05:21:12.691 INFO:tasks.workunit.client.1.smithi073.stdout:1/890: link d5/d26/d54/db2/dd5/d32/d37/ff3 d5/d26/da5/dba/d1b/dc3/f10f 0 2024-08-31T05:21:12.692 INFO:tasks.workunit.client.1.smithi073.stdout:1/891: read - d5/d26/d54/d5f/fdc zero size 2024-08-31T05:21:12.694 INFO:tasks.workunit.client.1.smithi073.stdout:3/974: write da/d3c/f8f [622297,75751] 0 2024-08-31T05:21:12.697 INFO:tasks.workunit.client.0.smithi067.stdout:2/183: rename db/d12/l27 to db/d12/d24/l2a 0 2024-08-31T05:21:12.698 INFO:tasks.workunit.client.1.smithi073.stdout:4/824: creat d7/df/d79/d7a/f109 x:0 0 0 2024-08-31T05:21:12.699 INFO:tasks.workunit.client.1.smithi073.stdout:1/892: dwrite d5/d26/d54/db2/dd5/d32/fc8 [0,4194304] 0 2024-08-31T05:21:12.699 INFO:tasks.workunit.client.1.smithi073.stdout:4/825: chown d7/d1a/d5c/d6d/d59/d65/db9 45131946 1 2024-08-31T05:21:12.700 INFO:tasks.workunit.client.1.smithi073.stdout:4/826: chown d7/db/f4f 4446 1 2024-08-31T05:21:12.700 INFO:tasks.workunit.client.1.smithi073.stdout:9/968: unlink dc/d82/de4/ffa 0 2024-08-31T05:21:12.703 INFO:tasks.workunit.client.1.smithi073.stdout:6/862: dread d15/d1a/d2b/f63 [0,4194304] 0 2024-08-31T05:21:12.703 INFO:tasks.workunit.client.1.smithi073.stdout:0/925: creat d0/d69/d7f/d68/d91/df5/f139 x:0 0 0 2024-08-31T05:21:12.704 INFO:tasks.workunit.client.1.smithi073.stdout:3/975: rmdir da/d3c/d82/d86 39 2024-08-31T05:21:12.709 INFO:tasks.workunit.client.1.smithi073.stdout:4/827: mkdir d7/d1a/d5c/d6d/d59/d10a 0 2024-08-31T05:21:12.710 INFO:tasks.workunit.client.1.smithi073.stdout:6/863: creat d15/d1a/d1e/f123 x:0 0 0 2024-08-31T05:21:12.710 INFO:tasks.workunit.client.1.smithi073.stdout:8/882: dwrite d0/db/d1c/fba [0,4194304] 0 2024-08-31T05:21:12.711 INFO:tasks.workunit.client.0.smithi067.stdout:9/124: truncate dd/f1e 3543892 0 2024-08-31T05:21:12.712 INFO:tasks.workunit.client.1.smithi073.stdout:0/926: unlink d0/c1c 0 2024-08-31T05:21:12.713 INFO:tasks.workunit.client.0.smithi067.stdout:1/139: sync 2024-08-31T05:21:12.714 INFO:tasks.workunit.client.1.smithi073.stdout:4/828: write d7/d1a/d5c/d6d/d2c/fef [268562,60658] 0 2024-08-31T05:21:12.714 INFO:tasks.workunit.client.0.smithi067.stdout:3/196: sync 2024-08-31T05:21:12.714 INFO:tasks.workunit.client.1.smithi073.stdout:3/976: dwrite da/d3c/d65/d87/fcc [0,4194304] 0 2024-08-31T05:21:12.715 INFO:tasks.workunit.client.0.smithi067.stdout:9/125: unlink dd/df/l1c 0 2024-08-31T05:21:12.716 INFO:tasks.workunit.client.1.smithi073.stdout:4/829: write d7/df/d79/fcd [739424,27722] 0 2024-08-31T05:21:12.718 INFO:tasks.workunit.client.1.smithi073.stdout:4/830: fsync d7/d1a/d5c/d6d/d59/d65/db9/fd9 0 2024-08-31T05:21:12.720 INFO:tasks.workunit.client.0.smithi067.stdout:3/197: mknod db/d12/d39/c45 0 2024-08-31T05:21:12.725 INFO:tasks.workunit.client.0.smithi067.stdout:3/198: dread db/d2e/d43/f28 [0,4194304] 0 2024-08-31T05:21:12.734 INFO:tasks.workunit.client.1.smithi073.stdout:3/977: creat da/d3c/d65/d45/dcd/f137 x:0 0 0 2024-08-31T05:21:12.735 INFO:tasks.workunit.client.1.smithi073.stdout:7/899: sync 2024-08-31T05:21:12.735 INFO:tasks.workunit.client.0.smithi067.stdout:3/199: rename db/fd to db/d2e/f46 0 2024-08-31T05:21:12.736 INFO:tasks.workunit.client.1.smithi073.stdout:1/893: creat d5/d26/da5/dba/d1c/f110 x:0 0 0 2024-08-31T05:21:12.738 INFO:tasks.workunit.client.1.smithi073.stdout:4/831: chown d7/f12 1 1 2024-08-31T05:21:12.739 INFO:tasks.workunit.client.0.smithi067.stdout:1/140: getdents d3/d23 0 2024-08-31T05:21:12.741 INFO:tasks.workunit.client.1.smithi073.stdout:0/927: truncate d0/d69/fab 1329825 0 2024-08-31T05:21:12.742 INFO:tasks.workunit.client.0.smithi067.stdout:9/126: getdents dd/d20 0 2024-08-31T05:21:12.744 INFO:tasks.workunit.client.0.smithi067.stdout:1/141: chown d3/f13 902985 1 2024-08-31T05:21:12.744 INFO:tasks.workunit.client.0.smithi067.stdout:5/138: write db/d15/f22 [1870803,21999] 0 2024-08-31T05:21:12.745 INFO:tasks.workunit.client.1.smithi073.stdout:3/978: fdatasync da/d3c/d67/db7/fc6 0 2024-08-31T05:21:12.748 INFO:tasks.workunit.client.0.smithi067.stdout:6/351: write f18 [2391547,6938] 0 2024-08-31T05:21:12.753 INFO:tasks.workunit.client.1.smithi073.stdout:8/883: creat d0/db/d44/f115 x:0 0 0 2024-08-31T05:21:12.754 INFO:tasks.workunit.client.1.smithi073.stdout:8/884: chown d0/db/d44/f115 1 1 2024-08-31T05:21:12.755 INFO:tasks.workunit.client.0.smithi067.stdout:1/142: mkdir d3/d23/d2d/d2e 0 2024-08-31T05:21:12.757 INFO:tasks.workunit.client.0.smithi067.stdout:6/352: chown f9 0 1 2024-08-31T05:21:12.758 INFO:tasks.workunit.client.0.smithi067.stdout:6/353: chown f14 3884 1 2024-08-31T05:21:12.759 INFO:tasks.workunit.client.0.smithi067.stdout:2/184: dwrite db/ff [0,4194304] 0 2024-08-31T05:21:12.760 INFO:tasks.workunit.client.0.smithi067.stdout:6/354: read d1b/d23/d28/f37 [597675,90645] 0 2024-08-31T05:21:12.761 INFO:tasks.workunit.client.1.smithi073.stdout:3/979: mkdir da/d3c/d65/d45/dcd/d108/d10a/d138 0 2024-08-31T05:21:12.762 INFO:tasks.workunit.client.1.smithi073.stdout:9/969: dwrite dc/de/d66/f67 [4194304,4194304] 0 2024-08-31T05:21:12.763 INFO:tasks.workunit.client.1.smithi073.stdout:7/900: creat d1/dc0/f119 x:0 0 0 2024-08-31T05:21:12.763 INFO:tasks.workunit.client.1.smithi073.stdout:3/980: chown da/d3c/d82/d95/db9/lc0 302647 1 2024-08-31T05:21:12.764 INFO:tasks.workunit.client.1.smithi073.stdout:9/970: write dc/d82/fbe [190795,107978] 0 2024-08-31T05:21:12.765 INFO:tasks.workunit.client.1.smithi073.stdout:3/981: chown da/d3c/d65/d2c/d8e/f93 2499144 1 2024-08-31T05:21:12.766 INFO:tasks.workunit.client.0.smithi067.stdout:9/127: creat dd/f2a x:0 0 0 2024-08-31T05:21:12.766 INFO:tasks.workunit.client.0.smithi067.stdout:2/185: dread db/dd/f17 [0,4194304] 0 2024-08-31T05:21:12.768 INFO:tasks.workunit.client.1.smithi073.stdout:2/907: sync 2024-08-31T05:21:12.768 INFO:tasks.workunit.client.0.smithi067.stdout:1/143: mknod d3/d23/d2d/c2f 0 2024-08-31T05:21:12.769 INFO:tasks.workunit.client.0.smithi067.stdout:6/355: dwrite fd [0,4194304] 0 2024-08-31T05:21:12.769 INFO:tasks.workunit.client.1.smithi073.stdout:1/894: mknod d5/d26/da5/c111 0 2024-08-31T05:21:12.778 INFO:tasks.workunit.client.1.smithi073.stdout:8/885: rename d0/db/d1c/d34/fed to d0/db/d1c/d2a/d58/f116 0 2024-08-31T05:21:12.779 INFO:tasks.workunit.client.1.smithi073.stdout:8/886: write d0/db/d1c/fb9 [2208068,34173] 0 2024-08-31T05:21:12.779 INFO:tasks.workunit.client.1.smithi073.stdout:0/928: mkdir d0/d15/d2c/d40/d132/d13a 0 2024-08-31T05:21:12.782 INFO:tasks.workunit.client.0.smithi067.stdout:9/128: creat dd/d20/f2b x:0 0 0 2024-08-31T05:21:12.785 INFO:tasks.workunit.client.1.smithi073.stdout:6/864: dwrite d15/d17/da1/dae/db0/d38/f4a [0,4194304] 0 2024-08-31T05:21:12.787 INFO:tasks.workunit.client.1.smithi073.stdout:7/901: fsync d1/da/d15/d33/d44/d74/dd6/dea/f29 0 2024-08-31T05:21:12.789 INFO:tasks.workunit.client.1.smithi073.stdout:7/902: write d1/da/d15/d33/d44/d74/fb4 [4085571,106825] 0 2024-08-31T05:21:12.789 INFO:tasks.workunit.client.1.smithi073.stdout:9/971: chown dc/dc4/ce3 0 1 2024-08-31T05:21:12.790 INFO:tasks.workunit.client.0.smithi067.stdout:6/356: mkdir d1b/d40/d70 0 2024-08-31T05:21:12.791 INFO:tasks.workunit.client.1.smithi073.stdout:9/972: chown dc/de/c16 50834 1 2024-08-31T05:21:12.791 INFO:tasks.workunit.client.1.smithi073.stdout:3/982: fsync da/d3c/f71 0 2024-08-31T05:21:12.794 INFO:tasks.workunit.client.1.smithi073.stdout:2/908: unlink d2/cc2 0 2024-08-31T05:21:12.796 INFO:tasks.workunit.client.1.smithi073.stdout:1/895: creat d5/d26/d54/db2/ddb/d102/f112 x:0 0 0 2024-08-31T05:21:12.796 INFO:tasks.workunit.client.0.smithi067.stdout:5/139: truncate db/d15/f22 1159724 0 2024-08-31T05:21:12.797 INFO:tasks.workunit.client.1.smithi073.stdout:9/973: dwrite dc/d37/d42/d5a/fdf [0,4194304] 0 2024-08-31T05:21:12.798 INFO:tasks.workunit.client.0.smithi067.stdout:9/129: creat dd/df/d25/f2c x:0 0 0 2024-08-31T05:21:12.799 INFO:tasks.workunit.client.1.smithi073.stdout:9/974: fdatasync dc/d37/d42/d8d/d52/d5f/f91 0 2024-08-31T05:21:12.800 INFO:tasks.workunit.client.1.smithi073.stdout:9/975: chown dc/de/dd8/d126/fed 176 1 2024-08-31T05:21:12.801 INFO:tasks.workunit.client.1.smithi073.stdout:4/832: link d7/df/d1b/l100 d7/d1a/d5c/d6d/d59/d65/db9/l10b 0 2024-08-31T05:21:12.803 INFO:tasks.workunit.client.1.smithi073.stdout:4/833: read d7/df/d13/d2e/f36 [738784,123185] 0 2024-08-31T05:21:12.805 INFO:tasks.workunit.client.0.smithi067.stdout:1/144: mknod d3/c30 0 2024-08-31T05:21:12.812 INFO:tasks.workunit.client.1.smithi073.stdout:8/887: truncate d0/db/d1c/d2a/d58/f66 211821 0 2024-08-31T05:21:12.813 INFO:tasks.workunit.client.0.smithi067.stdout:1/145: dwrite d3/dd/fe [4194304,4194304] 0 2024-08-31T05:21:12.814 INFO:tasks.workunit.client.1.smithi073.stdout:6/865: creat d15/d17/f124 x:0 0 0 2024-08-31T05:21:12.820 INFO:tasks.workunit.client.0.smithi067.stdout:1/146: dwrite d3/dd/f1a [0,4194304] 0 2024-08-31T05:21:12.821 INFO:tasks.workunit.client.0.smithi067.stdout:5/140: mkdir db/d26 0 2024-08-31T05:21:12.823 INFO:tasks.workunit.client.0.smithi067.stdout:2/186: getdents db/d12 0 2024-08-31T05:21:12.829 INFO:tasks.workunit.client.0.smithi067.stdout:5/141: dread f4 [0,4194304] 0 2024-08-31T05:21:12.831 INFO:tasks.workunit.client.0.smithi067.stdout:1/147: dwrite f1 [0,4194304] 0 2024-08-31T05:21:12.832 INFO:tasks.workunit.client.1.smithi073.stdout:2/909: rename d2/d9/d27/d76/db5 to d2/d9/d27/d117 0 2024-08-31T05:21:12.833 INFO:tasks.workunit.client.1.smithi073.stdout:1/896: rmdir d5/d26/d54 39 2024-08-31T05:21:12.835 INFO:tasks.workunit.client.0.smithi067.stdout:6/357: dread f3 [0,4194304] 0 2024-08-31T05:21:12.839 INFO:tasks.workunit.client.0.smithi067.stdout:3/200: dwrite db/d2e/f46 [0,4194304] 0 2024-08-31T05:21:12.843 INFO:tasks.workunit.client.1.smithi073.stdout:0/929: dwrite d0/d69/d7f/f6a [0,4194304] 0 2024-08-31T05:21:12.869 INFO:tasks.workunit.client.1.smithi073.stdout:4/834: dread d7/df/d1b/f51 [0,4194304] 0 2024-08-31T05:21:12.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:12 smithi073 ceph-mon[24726]: pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 88 MiB/s rd, 245 MiB/s wr, 504 op/s 2024-08-31T05:21:12.959 INFO:tasks.workunit.client.1.smithi073.stdout:4/835: sync 2024-08-31T05:21:12.988 INFO:tasks.workunit.client.0.smithi067.stdout:2/187: truncate db/d12/d1a/f20 110613 0 2024-08-31T05:21:12.991 INFO:tasks.workunit.client.0.smithi067.stdout:5/142: symlink db/d15/l27 0 2024-08-31T05:21:12.992 INFO:tasks.workunit.client.0.smithi067.stdout:5/143: chown db/d15/l14 1 1 2024-08-31T05:21:12.993 INFO:tasks.workunit.client.0.smithi067.stdout:2/188: dread db/d12/f1c [0,4194304] 0 2024-08-31T05:21:12.994 INFO:tasks.workunit.client.0.smithi067.stdout:3/201: mknod db/d2e/c47 0 2024-08-31T05:21:12.994 INFO:tasks.workunit.client.0.smithi067.stdout:2/189: fsync db/d12/d24/f26 0 2024-08-31T05:21:12.997 INFO:tasks.workunit.client.1.smithi073.stdout:3/983: creat da/d3c/d67/d129/f139 x:0 0 0 2024-08-31T05:21:12.997 INFO:tasks.workunit.client.0.smithi067.stdout:3/202: write db/d12/f2f [698357,38529] 0 2024-08-31T05:21:12.997 INFO:tasks.workunit.client.0.smithi067.stdout:2/190: chown db/dd/f11 4157 1 2024-08-31T05:21:13.001 INFO:tasks.workunit.client.0.smithi067.stdout:5/144: dwrite db/d15/f12 [0,4194304] 0 2024-08-31T05:21:13.002 INFO:tasks.workunit.client.1.smithi073.stdout:2/910: rename f1 to d2/d9/d27/d117/dfa/f118 0 2024-08-31T05:21:13.005 INFO:tasks.workunit.client.1.smithi073.stdout:1/897: readlink d5/d26/d54/db2/dd5/d2a/d80/d93/leb 0 2024-08-31T05:21:13.020 INFO:tasks.workunit.client.1.smithi073.stdout:8/888: fdatasync d0/db/d1c/d34/d38/f43 0 2024-08-31T05:21:13.022 INFO:tasks.workunit.client.0.smithi067.stdout:2/191: mkdir db/d12/d1a/d2b 0 2024-08-31T05:21:13.025 INFO:tasks.workunit.client.0.smithi067.stdout:3/203: creat db/d2c/f48 x:0 0 0 2024-08-31T05:21:13.027 INFO:tasks.workunit.client.0.smithi067.stdout:2/192: dread db/d12/d1a/d1e/f21 [0,4194304] 0 2024-08-31T05:21:13.034 INFO:tasks.workunit.client.0.smithi067.stdout:5/145: dwrite f4 [0,4194304] 0 2024-08-31T05:21:13.041 INFO:tasks.workunit.client.1.smithi073.stdout:2/911: creat d2/d9/d7f/dab/daa/f119 x:0 0 0 2024-08-31T05:21:13.043 INFO:tasks.workunit.client.0.smithi067.stdout:2/193: mknod db/d12/d1a/d1e/c2c 0 2024-08-31T05:21:13.049 INFO:tasks.workunit.client.0.smithi067.stdout:5/146: creat db/d15/f28 x:0 0 0 2024-08-31T05:21:13.051 INFO:tasks.workunit.client.0.smithi067.stdout:3/204: symlink db/d17/d3f/l49 0 2024-08-31T05:21:13.052 INFO:tasks.workunit.client.0.smithi067.stdout:3/205: chown db/f10 14468 1 2024-08-31T05:21:13.053 INFO:tasks.workunit.client.0.smithi067.stdout:3/206: fsync db/d2c/f31 0 2024-08-31T05:21:13.055 INFO:tasks.workunit.client.0.smithi067.stdout:2/194: truncate db/dd/f17 3680463 0 2024-08-31T05:21:13.060 INFO:tasks.workunit.client.1.smithi073.stdout:7/903: getdents d1/da/d3e/d22/d6b 0 2024-08-31T05:21:13.065 INFO:tasks.workunit.client.1.smithi073.stdout:3/984: link da/d3c/d82/d95/ff4 da/d3c/d65/d45/dcd/d108/d10a/d138/f13a 0 2024-08-31T05:21:13.066 INFO:tasks.workunit.client.0.smithi067.stdout:5/147: mkdir db/d26/d29 0 2024-08-31T05:21:13.068 INFO:tasks.workunit.client.1.smithi073.stdout:1/898: mknod d5/d26/d54/db2/dd5/d3f/dc2/c113 0 2024-08-31T05:21:13.070 INFO:tasks.workunit.client.0.smithi067.stdout:2/195: dwrite db/d12/f1c [0,4194304] 0 2024-08-31T05:21:13.072 INFO:tasks.workunit.client.1.smithi073.stdout:9/976: mknod dc/d37/db5/c13f 0 2024-08-31T05:21:13.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:12 smithi067 ceph-mon[17432]: pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 88 MiB/s rd, 245 MiB/s wr, 504 op/s 2024-08-31T05:21:13.075 INFO:tasks.workunit.client.1.smithi073.stdout:7/904: readlink d1/da/d15/d33/d44/d74/dd6/de3/l105 0 2024-08-31T05:21:13.077 INFO:tasks.workunit.client.0.smithi067.stdout:2/196: mkdir db/dd/d2d 0 2024-08-31T05:21:13.079 INFO:tasks.workunit.client.1.smithi073.stdout:9/977: dread dc/de/d11/d85/fe7 [0,4194304] 0 2024-08-31T05:21:13.083 INFO:tasks.workunit.client.1.smithi073.stdout:4/836: link d7/df/l64 d7/df/d79/d7a/l10c 0 2024-08-31T05:21:13.085 INFO:tasks.workunit.client.0.smithi067.stdout:2/197: chown db/d12/d1a/f20 177261845 1 2024-08-31T05:21:13.089 INFO:tasks.workunit.client.0.smithi067.stdout:2/198: rmdir db/d12/d1a/d1e 39 2024-08-31T05:21:13.092 INFO:tasks.workunit.client.0.smithi067.stdout:2/199: symlink db/l2e 0 2024-08-31T05:21:13.094 INFO:tasks.workunit.client.1.smithi073.stdout:4/837: write d7/df/d13/f9e [817054,109574] 0 2024-08-31T05:21:13.096 INFO:tasks.workunit.client.1.smithi073.stdout:7/905: rename d1/da/d15/d33/d44/d74/dd6/dea/dac/cb7 to d1/da/d15/d33/d44/d74/dd6/dea/dac/c11a 0 2024-08-31T05:21:13.097 INFO:tasks.workunit.client.1.smithi073.stdout:7/906: write d1/da/d15/d33/d44/d74/dd6/de6/d84/fd7 [757207,46438] 0 2024-08-31T05:21:13.098 INFO:tasks.workunit.client.1.smithi073.stdout:9/978: truncate dc/f11e 129964 0 2024-08-31T05:21:13.099 INFO:tasks.workunit.client.1.smithi073.stdout:9/979: dread - dc/d37/db5/f137 zero size 2024-08-31T05:21:13.102 INFO:tasks.workunit.client.1.smithi073.stdout:7/907: symlink d1/da/d3e/d22/d47/da8/l11b 0 2024-08-31T05:21:13.103 INFO:tasks.workunit.client.1.smithi073.stdout:4/838: unlink d7/df/d13/d2e/f48 0 2024-08-31T05:21:13.106 INFO:tasks.workunit.client.1.smithi073.stdout:7/908: dread d1/da/d3e/d22/d35/d83/f9f [0,4194304] 0 2024-08-31T05:21:13.107 INFO:tasks.workunit.client.1.smithi073.stdout:7/909: dread - d1/da/d3e/d22/d47/da8/feb zero size 2024-08-31T05:21:13.108 INFO:tasks.workunit.client.1.smithi073.stdout:4/839: link d7/db/f77 d7/d1a/d5c/d6d/d2c/deb/f10d 0 2024-08-31T05:21:13.113 INFO:tasks.workunit.client.1.smithi073.stdout:9/980: dread dc/de/dd8/d126/fed [0,4194304] 0 2024-08-31T05:21:13.113 INFO:tasks.workunit.client.1.smithi073.stdout:7/910: dread d1/da/d96/fd8 [0,4194304] 0 2024-08-31T05:21:13.114 INFO:tasks.workunit.client.1.smithi073.stdout:4/840: dwrite d7/df/d13/d2e/fd2 [0,4194304] 0 2024-08-31T05:21:13.119 INFO:tasks.workunit.client.1.smithi073.stdout:4/841: symlink d7/df/d13/d53/d88/d9d/dc3/l10e 0 2024-08-31T05:21:13.119 INFO:tasks.workunit.client.1.smithi073.stdout:4/842: dread - d7/d1a/d5c/d6d/f106 zero size 2024-08-31T05:21:13.120 INFO:tasks.workunit.client.1.smithi073.stdout:4/843: write d7/df/d13/d2e/f36 [590306,16262] 0 2024-08-31T05:21:13.121 INFO:tasks.workunit.client.1.smithi073.stdout:4/844: chown d7/df/d13 82167634 1 2024-08-31T05:21:13.123 INFO:tasks.workunit.client.1.smithi073.stdout:4/845: truncate d7/db/f2a 590707 0 2024-08-31T05:21:13.125 INFO:tasks.workunit.client.1.smithi073.stdout:6/866: write d15/d1a/d2b/d2f/f64 [9256114,35315] 0 2024-08-31T05:21:13.127 INFO:tasks.workunit.client.0.smithi067.stdout:1/148: mknod d3/c31 0 2024-08-31T05:21:13.127 INFO:tasks.workunit.client.1.smithi073.stdout:4/846: truncate d7/d1a/d5c/d6d/d59/d65/db9/dd6/fe1 279915 0 2024-08-31T05:21:13.128 INFO:tasks.workunit.client.1.smithi073.stdout:6/867: symlink d15/d1a/d51/d61/d7c/da6/l125 0 2024-08-31T05:21:13.130 INFO:tasks.workunit.client.0.smithi067.stdout:1/149: truncate d3/f14 2475514 0 2024-08-31T05:21:13.131 INFO:tasks.workunit.client.1.smithi073.stdout:6/868: creat d15/d17/da1/dae/db0/d38/d9b/f126 x:0 0 0 2024-08-31T05:21:13.132 INFO:tasks.workunit.client.1.smithi073.stdout:6/869: write d15/d1a/d2b/d6a/feb [508698,92534] 0 2024-08-31T05:21:13.133 INFO:tasks.workunit.client.0.smithi067.stdout:1/150: symlink d3/d23/l32 0 2024-08-31T05:21:13.136 INFO:tasks.workunit.client.0.smithi067.stdout:1/151: rename d3/f6 to d3/d23/f33 0 2024-08-31T05:21:13.140 INFO:tasks.workunit.client.1.smithi073.stdout:6/870: unlink d15/d1a/d1e/lb2 0 2024-08-31T05:21:13.140 INFO:tasks.workunit.client.1.smithi073.stdout:6/871: fsync d15/d1a/fac 0 2024-08-31T05:21:13.141 INFO:tasks.workunit.client.0.smithi067.stdout:6/358: truncate f14 3302196 0 2024-08-31T05:21:13.141 INFO:tasks.workunit.client.1.smithi073.stdout:6/872: write d15/d1a/d2b/d6a/f94 [430163,17326] 0 2024-08-31T05:21:13.151 INFO:tasks.workunit.client.0.smithi067.stdout:1/152: dread d3/d23/f33 [0,4194304] 0 2024-08-31T05:21:13.153 INFO:tasks.workunit.client.1.smithi073.stdout:2/912: unlink d2/f87 0 2024-08-31T05:21:13.156 INFO:tasks.workunit.client.1.smithi073.stdout:2/913: creat d2/d9/d66/d70/f11a x:0 0 0 2024-08-31T05:21:13.157 INFO:tasks.workunit.client.1.smithi073.stdout:2/914: stat d2/d9/df/lc3 0 2024-08-31T05:21:13.157 INFO:tasks.workunit.client.1.smithi073.stdout:2/915: stat d2/d9/df/d43/fb7 0 2024-08-31T05:21:13.160 INFO:tasks.workunit.client.1.smithi073.stdout:2/916: creat d2/d25/d92/de7/f11b x:0 0 0 2024-08-31T05:21:13.161 INFO:tasks.workunit.client.1.smithi073.stdout:0/930: truncate d0/d28/fce 2724076 0 2024-08-31T05:21:13.161 INFO:tasks.workunit.client.1.smithi073.stdout:2/917: chown d2/d9/d7f/dab/d5d/da1/de0/fe4 4496642 1 2024-08-31T05:21:13.163 INFO:tasks.workunit.client.1.smithi073.stdout:2/918: symlink d2/d9/d27/d117/dc6/l11c 0 2024-08-31T05:21:13.168 INFO:tasks.workunit.client.1.smithi073.stdout:0/931: getdents d0/d69/d7f/d68/d91/df5/d3c/d9c/db6/dc6/d135 0 2024-08-31T05:21:13.170 INFO:tasks.workunit.client.1.smithi073.stdout:2/919: rename d2/d9/df/d36 to d2/d9/d7f/d11d 0 2024-08-31T05:21:13.173 INFO:tasks.workunit.client.1.smithi073.stdout:0/932: rename d0/d69/d7f/f97 to d0/d69/d7f/d68/d91/df5/d3c/d9c/f13b 0 2024-08-31T05:21:13.175 INFO:tasks.workunit.client.1.smithi073.stdout:2/920: dwrite d2/d9/d7f/fb0 [4194304,4194304] 0 2024-08-31T05:21:13.175 INFO:tasks.workunit.client.1.smithi073.stdout:0/933: readlink d0/d69/d7f/d68/d91/df5/d3c/d9c/de4/l10f 0 2024-08-31T05:21:13.178 INFO:tasks.workunit.client.1.smithi073.stdout:0/934: creat d0/d69/f13c x:0 0 0 2024-08-31T05:21:13.179 INFO:tasks.workunit.client.1.smithi073.stdout:8/889: truncate d0/d62/f8d 3048428 0 2024-08-31T05:21:13.181 INFO:tasks.workunit.client.1.smithi073.stdout:0/935: creat d0/d15/d2c/d41/d52/f13d x:0 0 0 2024-08-31T05:21:13.184 INFO:tasks.workunit.client.1.smithi073.stdout:1/899: unlink d5/d26/da5/dba/d33/ca9 0 2024-08-31T05:21:13.185 INFO:tasks.workunit.client.1.smithi073.stdout:8/890: write d0/db/d1c/d24/f74 [4788929,64244] 0 2024-08-31T05:21:13.185 INFO:tasks.workunit.client.1.smithi073.stdout:1/900: readlink d5/d26/d54/db2/dd5/d3f/ld6 0 2024-08-31T05:21:13.186 INFO:tasks.workunit.client.1.smithi073.stdout:0/936: symlink d0/d15/d2c/d41/de8/l13e 0 2024-08-31T05:21:13.186 INFO:tasks.workunit.client.1.smithi073.stdout:8/891: dread - d0/db/d44/d72/d79/ff9 zero size 2024-08-31T05:21:13.187 INFO:tasks.workunit.client.1.smithi073.stdout:3/985: write da/d3c/dda/fe3 [896230,88591] 0 2024-08-31T05:21:13.187 INFO:tasks.workunit.client.0.smithi067.stdout:5/148: dwrite db/f19 [0,4194304] 0 2024-08-31T05:21:13.187 INFO:tasks.workunit.client.1.smithi073.stdout:2/921: getdents d2/d9/d27/d117/dfa 0 2024-08-31T05:21:13.191 INFO:tasks.workunit.client.1.smithi073.stdout:1/901: mkdir d5/d26/d54/db2/dd5/d32/d37/d6f/dc7/df1/d114 0 2024-08-31T05:21:13.193 INFO:tasks.workunit.client.1.smithi073.stdout:1/902: write d5/d26/d54/db2/fe7 [190818,117968] 0 2024-08-31T05:21:13.193 INFO:tasks.workunit.client.1.smithi073.stdout:8/892: mkdir d0/db/d1c/dda/d117 0 2024-08-31T05:21:13.195 INFO:tasks.workunit.client.0.smithi067.stdout:5/149: dwrite db/f25 [0,4194304] 0 2024-08-31T05:21:13.195 INFO:tasks.workunit.client.1.smithi073.stdout:2/922: unlink d2/d9/d66/c6b 0 2024-08-31T05:21:13.196 INFO:tasks.workunit.client.1.smithi073.stdout:0/937: dwrite d0/d15/d2c/d40/d86/f130 [0,4194304] 0 2024-08-31T05:21:13.196 INFO:tasks.workunit.client.0.smithi067.stdout:5/150: fsync db/d15/f1c 0 2024-08-31T05:21:13.201 INFO:tasks.workunit.client.1.smithi073.stdout:3/986: symlink da/d3c/dda/d136/l13b 0 2024-08-31T05:21:13.204 INFO:tasks.workunit.client.1.smithi073.stdout:8/893: mkdir d0/db/d1c/d23/d118 0 2024-08-31T05:21:13.204 INFO:tasks.workunit.client.1.smithi073.stdout:1/903: dread d5/d26/da5/dba/d33/fe [4194304,4194304] 0 2024-08-31T05:21:13.204 INFO:tasks.workunit.client.1.smithi073.stdout:8/894: dread - d0/db/d1c/d34/fd7 zero size 2024-08-31T05:21:13.205 INFO:tasks.workunit.client.0.smithi067.stdout:5/151: creat db/d15/f2a x:0 0 0 2024-08-31T05:21:13.208 INFO:tasks.workunit.client.1.smithi073.stdout:0/938: rmdir d0/d15/d2c/d40 39 2024-08-31T05:21:13.209 INFO:tasks.workunit.client.1.smithi073.stdout:2/923: dread - d2/d9/d27/d76/d7e/fd6 zero size 2024-08-31T05:21:13.210 INFO:tasks.workunit.client.1.smithi073.stdout:9/981: dread dc/de/d66/fbd [0,4194304] 0 2024-08-31T05:21:13.211 INFO:tasks.workunit.client.0.smithi067.stdout:2/200: truncate db/f25 3748139 0 2024-08-31T05:21:13.211 INFO:tasks.workunit.client.1.smithi073.stdout:2/924: stat d2/d25/d92/l96 0 2024-08-31T05:21:13.212 INFO:tasks.workunit.client.1.smithi073.stdout:3/987: symlink da/d3c/d65/d2c/d8e/dc2/d107/l13c 0 2024-08-31T05:21:13.214 INFO:tasks.workunit.client.1.smithi073.stdout:1/904: rename d5/d26/d54/db2/dd5/d2a/d80/fe4 to d5/d26/d54/db2/dd5/d32/f115 0 2024-08-31T05:21:13.217 INFO:tasks.workunit.client.1.smithi073.stdout:2/925: dwrite d2/d9/d7f/dab/f42 [0,4194304] 0 2024-08-31T05:21:13.217 INFO:tasks.workunit.client.1.smithi073.stdout:2/926: fdatasync d2/d9/d7f/dab/d5d/f106 0 2024-08-31T05:21:13.218 INFO:tasks.workunit.client.0.smithi067.stdout:2/201: read db/dd/d13/f14 [1348187,86896] 0 2024-08-31T05:21:13.219 INFO:tasks.workunit.client.1.smithi073.stdout:9/982: fsync dc/de/d66/d84/da2/fa5 0 2024-08-31T05:21:13.224 INFO:tasks.workunit.client.0.smithi067.stdout:2/202: creat db/d12/d1a/d1e/f2f x:0 0 0 2024-08-31T05:21:13.231 INFO:tasks.workunit.client.1.smithi073.stdout:0/939: link d0/d15/d9b/f116 d0/d69/d7f/d68/d91/df5/d3c/d9c/db6/de6/f13f 0 2024-08-31T05:21:13.232 INFO:tasks.workunit.client.1.smithi073.stdout:7/911: creat d1/da/d15/d33/d44/d74/dd6/dea/f11c x:0 0 0 2024-08-31T05:21:13.232 INFO:tasks.workunit.client.1.smithi073.stdout:7/912: readlink d1/da/d15/lb9 0 2024-08-31T05:21:13.232 INFO:tasks.workunit.client.1.smithi073.stdout:0/940: chown d0/d69/d7f/d68/d91/df5/d3c/d9c/dc8/fd8 928049462 1 2024-08-31T05:21:13.233 INFO:tasks.workunit.client.1.smithi073.stdout:2/927: rename d2/d9/d7f/d11d/l60 to d2/d9/d7f/l11e 0 2024-08-31T05:21:13.234 INFO:tasks.workunit.client.1.smithi073.stdout:0/941: dread - d0/d69/d7f/d68/d91/df5/d3c/d9c/ff1 zero size 2024-08-31T05:21:13.234 INFO:tasks.workunit.client.1.smithi073.stdout:2/928: read - d2/d9/f107 zero size 2024-08-31T05:21:13.235 INFO:tasks.workunit.client.0.smithi067.stdout:5/152: rename l3 to db/d1d/l2b 0 2024-08-31T05:21:13.235 INFO:tasks.workunit.client.0.smithi067.stdout:5/153: stat f2 0 2024-08-31T05:21:13.239 INFO:tasks.workunit.client.1.smithi073.stdout:3/988: dread da/d68/f99 [0,4194304] 0 2024-08-31T05:21:13.239 INFO:tasks.workunit.client.1.smithi073.stdout:2/929: rmdir d2/d9/d27/d9b/da6/ddd 39 2024-08-31T05:21:13.240 INFO:tasks.workunit.client.1.smithi073.stdout:4/847: dwrite d7/df/d13/f16 [4194304,4194304] 0 2024-08-31T05:21:13.242 INFO:tasks.workunit.client.1.smithi073.stdout:7/913: truncate d1/da/d15/d33/d44/d74/dd6/de6/d84/f10e 1741266 0 2024-08-31T05:21:13.246 INFO:tasks.workunit.client.1.smithi073.stdout:2/930: symlink d2/d9/d27/d117/dfa/l11f 0 2024-08-31T05:21:13.248 INFO:tasks.workunit.client.1.smithi073.stdout:4/848: unlink d7/df/d13/d2e/d70/c8a 0 2024-08-31T05:21:13.248 INFO:tasks.workunit.client.0.smithi067.stdout:6/359: write d1b/d23/d2e/f54 [734092,88316] 0 2024-08-31T05:21:13.250 INFO:tasks.workunit.client.1.smithi073.stdout:7/914: creat d1/da/d3e/d22/d5c/f11d x:0 0 0 2024-08-31T05:21:13.252 INFO:tasks.workunit.client.1.smithi073.stdout:3/989: symlink da/d3c/d82/l13d 0 2024-08-31T05:21:13.253 INFO:tasks.workunit.client.1.smithi073.stdout:2/931: creat d2/d9/d7f/dab/daa/f120 x:0 0 0 2024-08-31T05:21:13.254 INFO:tasks.workunit.client.1.smithi073.stdout:3/990: write da/d3c/d67/f6f [5036307,8441] 0 2024-08-31T05:21:13.255 INFO:tasks.workunit.client.0.smithi067.stdout:6/360: dwrite d1b/d23/d2e/f54 [0,4194304] 0 2024-08-31T05:21:13.256 INFO:tasks.workunit.client.1.smithi073.stdout:1/905: symlink d5/d26/da5/l116 0 2024-08-31T05:21:13.256 INFO:tasks.workunit.client.1.smithi073.stdout:6/873: dwrite d15/d1a/d2b/d2f/d99/fda [0,4194304] 0 2024-08-31T05:21:13.257 INFO:tasks.workunit.client.1.smithi073.stdout:4/849: symlink d7/d1a/d5c/d6d/d2c/d2d/l10f 0 2024-08-31T05:21:13.259 INFO:tasks.workunit.client.1.smithi073.stdout:0/942: getdents d0/d15 0 2024-08-31T05:21:13.261 INFO:tasks.workunit.client.0.smithi067.stdout:6/361: fsync d1b/d23/d2e/f3d 0 2024-08-31T05:21:13.263 INFO:tasks.workunit.client.0.smithi067.stdout:6/362: dread f9 [0,4194304] 0 2024-08-31T05:21:13.268 INFO:tasks.workunit.client.1.smithi073.stdout:2/932: chown d2/d9/d27/d9b/da6/ddd 665 1 2024-08-31T05:21:13.268 INFO:tasks.workunit.client.1.smithi073.stdout:7/915: dread d1/da/d15/fe0 [0,4194304] 0 2024-08-31T05:21:13.269 INFO:tasks.workunit.client.1.smithi073.stdout:7/916: write d1/da/d3e/d22/d6b/f70 [1797439,74198] 0 2024-08-31T05:21:13.270 INFO:tasks.workunit.client.1.smithi073.stdout:3/991: chown da/d3c/d65/d45/dcd/d108/ded/c11a 0 1 2024-08-31T05:21:13.274 INFO:tasks.workunit.client.0.smithi067.stdout:6/363: mkdir d1b/d40/d70/d71 0 2024-08-31T05:21:13.275 INFO:tasks.workunit.client.1.smithi073.stdout:1/906: chown d5/d26/d54/db2/dd5/d2a/c6b 26336 1 2024-08-31T05:21:13.275 INFO:tasks.workunit.client.0.smithi067.stdout:6/364: chown d1b/d23/d28/d45/d5c 1965984 1 2024-08-31T05:21:13.276 INFO:tasks.workunit.client.1.smithi073.stdout:1/907: write d5/d26/d54/db2/dd5/d5d/d61/ff2 [970496,114628] 0 2024-08-31T05:21:13.277 INFO:tasks.workunit.client.0.smithi067.stdout:2/203: write db/dd/f17 [4149668,79824] 0 2024-08-31T05:21:13.283 INFO:tasks.workunit.client.0.smithi067.stdout:2/204: symlink db/d12/d24/l30 0 2024-08-31T05:21:13.283 INFO:tasks.workunit.client.0.smithi067.stdout:2/205: readlink db/d12/d24/l30 0 2024-08-31T05:21:13.284 INFO:tasks.workunit.client.0.smithi067.stdout:2/206: write db/d12/f16 [394907,97445] 0 2024-08-31T05:21:13.287 INFO:tasks.workunit.client.1.smithi073.stdout:6/874: mkdir d15/d75/d127 0 2024-08-31T05:21:13.289 INFO:tasks.workunit.client.1.smithi073.stdout:6/875: read d15/d1a/d51/f70 [2896707,115536] 0 2024-08-31T05:21:13.289 INFO:tasks.workunit.client.1.smithi073.stdout:4/850: unlink d7/c96 0 2024-08-31T05:21:13.290 INFO:tasks.workunit.client.1.smithi073.stdout:1/908: creat d5/d26/d54/f117 x:0 0 0 2024-08-31T05:21:13.290 INFO:tasks.workunit.client.1.smithi073.stdout:3/992: dread da/d3c/d67/db7/fdc [0,4194304] 0 2024-08-31T05:21:13.296 INFO:tasks.workunit.client.1.smithi073.stdout:3/993: dwrite da/d3c/d65/d45/dcd/d108/f1f [0,4194304] 0 2024-08-31T05:21:13.297 INFO:tasks.workunit.client.1.smithi073.stdout:6/876: creat d15/d41/d89/f128 x:0 0 0 2024-08-31T05:21:13.297 INFO:tasks.workunit.client.1.smithi073.stdout:3/994: chown f9 23 1 2024-08-31T05:21:13.298 INFO:tasks.workunit.client.1.smithi073.stdout:4/851: rename d7/df/d13/d53/fe6 to d7/d1a/d5c/d6d/d59/f110 0 2024-08-31T05:21:13.298 INFO:tasks.workunit.client.1.smithi073.stdout:0/943: link d0/d69/d8e/d99/ca1 d0/d69/d7f/d62/d10c/c140 0 2024-08-31T05:21:13.302 INFO:tasks.workunit.client.1.smithi073.stdout:8/895: sync 2024-08-31T05:21:13.303 INFO:tasks.workunit.client.1.smithi073.stdout:8/896: chown d0/db/d44/f84 302591783 1 2024-08-31T05:21:13.306 INFO:tasks.workunit.client.1.smithi073.stdout:3/995: mknod da/d3c/d65/d45/c13e 0 2024-08-31T05:21:13.307 INFO:tasks.workunit.client.1.smithi073.stdout:0/944: creat d0/d69/d7f/d62/dbf/f141 x:0 0 0 2024-08-31T05:21:13.307 INFO:tasks.workunit.client.1.smithi073.stdout:0/945: readlink d0/d89/l110 0 2024-08-31T05:21:13.308 INFO:tasks.workunit.client.1.smithi073.stdout:1/909: stat d5/d26/d54/db2/dd5/d32/daf/lbd 0 2024-08-31T05:21:13.311 INFO:tasks.workunit.client.1.smithi073.stdout:1/910: stat d5/d26/da5/dba/d1c/f4b 0 2024-08-31T05:21:13.313 INFO:tasks.workunit.client.1.smithi073.stdout:4/852: truncate d7/df/d1b/d34/f49 2206675 0 2024-08-31T05:21:13.314 INFO:tasks.workunit.client.1.smithi073.stdout:9/983: dwrite dc/de/d66/fbd [0,4194304] 0 2024-08-31T05:21:13.315 INFO:tasks.workunit.client.1.smithi073.stdout:0/946: mkdir d0/d58/d142 0 2024-08-31T05:21:13.316 INFO:tasks.workunit.client.0.smithi067.stdout:1/153: write d3/f14 [2002026,37796] 0 2024-08-31T05:21:13.316 INFO:tasks.workunit.client.1.smithi073.stdout:8/897: mknod d0/db/d1c/d34/d38/d113/c119 0 2024-08-31T05:21:13.316 INFO:tasks.workunit.client.0.smithi067.stdout:5/154: write f6 [196592,91184] 0 2024-08-31T05:21:13.317 INFO:tasks.workunit.client.0.smithi067.stdout:1/154: write d3/dd/f1c [268908,129389] 0 2024-08-31T05:21:13.320 INFO:tasks.workunit.client.1.smithi073.stdout:3/996: symlink da/d3c/l13f 0 2024-08-31T05:21:13.330 INFO:tasks.workunit.client.0.smithi067.stdout:5/155: dwrite db/f1e [0,4194304] 0 2024-08-31T05:21:13.331 INFO:tasks.workunit.client.1.smithi073.stdout:4/853: rmdir d7/df/d13/d2e/d47/d4c/d73 39 2024-08-31T05:21:13.333 INFO:tasks.workunit.client.0.smithi067.stdout:1/155: mkdir d3/d23/d2d/d2e/d34 0 2024-08-31T05:21:13.334 INFO:tasks.workunit.client.1.smithi073.stdout:9/984: read - dc/d37/d42/d5a/dd0/ff0 zero size 2024-08-31T05:21:13.337 INFO:tasks.workunit.client.0.smithi067.stdout:1/156: dread d3/f14 [0,4194304] 0 2024-08-31T05:21:13.339 INFO:tasks.workunit.client.1.smithi073.stdout:0/947: mkdir d0/d69/d7f/d68/d91/df5/d3c/d9c/de4/d143 0 2024-08-31T05:21:13.340 INFO:tasks.workunit.client.1.smithi073.stdout:9/985: dwrite dc/d37/d42/d8d/f134 [0,4194304] 0 2024-08-31T05:21:13.344 INFO:tasks.workunit.client.0.smithi067.stdout:1/157: dwrite d3/f13 [0,4194304] 0 2024-08-31T05:21:13.346 INFO:tasks.workunit.client.1.smithi073.stdout:1/911: mknod d5/d26/da5/dba/d1b/dc3/c118 0 2024-08-31T05:21:13.355 INFO:tasks.workunit.client.0.smithi067.stdout:1/158: rmdir d3/dd 39 2024-08-31T05:21:13.356 INFO:tasks.workunit.client.1.smithi073.stdout:2/933: fsync d2/d9/d27/d9b/da6/fcf 0 2024-08-31T05:21:13.357 INFO:tasks.workunit.client.1.smithi073.stdout:8/898: mknod d0/db/d1c/d24/c11a 0 2024-08-31T05:21:13.357 INFO:tasks.workunit.client.1.smithi073.stdout:7/917: truncate d1/da/d15/d33/d44/d74/dd6/de6/d84/ff3 10939 0 2024-08-31T05:21:13.357 INFO:tasks.workunit.client.1.smithi073.stdout:8/899: fdatasync d0/db/d1c/d34/fd7 0 2024-08-31T05:21:13.359 INFO:tasks.workunit.client.0.smithi067.stdout:1/159: stat d3/dd/f21 0 2024-08-31T05:21:13.359 INFO:tasks.workunit.client.1.smithi073.stdout:8/900: truncate d0/db/d44/f84 714601 0 2024-08-31T05:21:13.360 INFO:tasks.workunit.client.1.smithi073.stdout:8/901: chown d0/db/d1c/d23/c54 714770 1 2024-08-31T05:21:13.360 INFO:tasks.workunit.client.1.smithi073.stdout:8/902: read d0/f45 [328636,18640] 0 2024-08-31T05:21:13.362 INFO:tasks.workunit.client.1.smithi073.stdout:8/903: write d0/db/d44/f115 [390372,112559] 0 2024-08-31T05:21:13.363 INFO:tasks.workunit.client.1.smithi073.stdout:3/997: mkdir da/d3c/d5a/d140 0 2024-08-31T05:21:13.366 INFO:tasks.workunit.client.0.smithi067.stdout:1/160: rename d3/la to d3/dd/l35 0 2024-08-31T05:21:13.367 INFO:tasks.workunit.client.0.smithi067.stdout:1/161: stat d3/f24 0 2024-08-31T05:21:13.371 INFO:tasks.workunit.client.1.smithi073.stdout:6/877: dwrite d15/d1a/d1e/f3e [0,4194304] 0 2024-08-31T05:21:13.371 INFO:tasks.workunit.client.0.smithi067.stdout:1/162: readlink d3/l29 0 2024-08-31T05:21:13.372 INFO:tasks.workunit.client.1.smithi073.stdout:7/918: rmdir d1/da/d15/d33/d44/d74 39 2024-08-31T05:21:13.379 INFO:tasks.workunit.client.0.smithi067.stdout:1/163: mkdir d3/d36 0 2024-08-31T05:21:13.382 INFO:tasks.workunit.client.1.smithi073.stdout:1/912: mkdir d5/d26/d54/db2/dd5/d32/d119 0 2024-08-31T05:21:13.386 INFO:tasks.workunit.client.1.smithi073.stdout:6/878: symlink d15/d1a/d2b/d2f/d4b/d88/d9f/l129 0 2024-08-31T05:21:13.389 INFO:tasks.workunit.client.0.smithi067.stdout:1/164: dwrite d3/d23/f33 [0,4194304] 0 2024-08-31T05:21:13.393 INFO:tasks.workunit.client.0.smithi067.stdout:5/156: dwrite db/d15/f22 [0,4194304] 0 2024-08-31T05:21:13.398 INFO:tasks.workunit.client.0.smithi067.stdout:1/165: unlink f2 0 2024-08-31T05:21:13.401 INFO:tasks.workunit.client.0.smithi067.stdout:5/157: dwrite db/d15/f18 [0,4194304] 0 2024-08-31T05:21:13.402 INFO:tasks.workunit.client.0.smithi067.stdout:5/158: fdatasync f6 0 2024-08-31T05:21:13.403 INFO:tasks.workunit.client.0.smithi067.stdout:5/159: fsync db/d15/f28 0 2024-08-31T05:21:13.405 INFO:tasks.workunit.client.1.smithi073.stdout:9/986: write f9 [2110022,25237] 0 2024-08-31T05:21:13.411 INFO:tasks.workunit.client.1.smithi073.stdout:4/854: dwrite d7/df/d13/d53/f80 [0,4194304] 0 2024-08-31T05:21:13.412 INFO:tasks.workunit.client.0.smithi067.stdout:5/160: mkdir db/d26/d29/d2c 0 2024-08-31T05:21:13.415 INFO:tasks.workunit.client.0.smithi067.stdout:1/166: link d3/f1e d3/d23/d2d/d2e/f37 0 2024-08-31T05:21:13.417 INFO:tasks.workunit.client.0.smithi067.stdout:5/161: dread db/d15/f22 [0,4194304] 0 2024-08-31T05:21:13.425 INFO:tasks.workunit.client.0.smithi067.stdout:1/167: symlink d3/d23/l38 0 2024-08-31T05:21:13.432 INFO:tasks.workunit.client.0.smithi067.stdout:1/168: creat d3/d23/d2d/d2e/f39 x:0 0 0 2024-08-31T05:21:13.436 INFO:tasks.workunit.client.0.smithi067.stdout:0/201: sync 2024-08-31T05:21:13.439 INFO:tasks.workunit.client.0.smithi067.stdout:0/202: read d1/d8/f35 [253075,75648] 0 2024-08-31T05:21:13.440 INFO:tasks.workunit.client.0.smithi067.stdout:1/169: dwrite d3/dd/f20 [0,4194304] 0 2024-08-31T05:21:13.441 INFO:tasks.workunit.client.0.smithi067.stdout:0/203: dread - d1/dd/f40 zero size 2024-08-31T05:21:13.448 INFO:tasks.workunit.client.0.smithi067.stdout:0/204: dwrite d1/df/f1d [4194304,4194304] 0 2024-08-31T05:21:13.449 INFO:tasks.workunit.client.0.smithi067.stdout:0/205: chown d1/dd/l2e 196 1 2024-08-31T05:21:13.451 INFO:tasks.workunit.client.0.smithi067.stdout:0/206: write d1/df/f1d [5417160,35900] 0 2024-08-31T05:21:13.451 INFO:tasks.workunit.client.0.smithi067.stdout:5/162: write f2 [2252259,57392] 0 2024-08-31T05:21:13.461 INFO:tasks.workunit.client.0.smithi067.stdout:5/163: unlink db/c24 0 2024-08-31T05:21:13.462 INFO:tasks.workunit.client.0.smithi067.stdout:0/207: mknod d1/df/c45 0 2024-08-31T05:21:13.465 INFO:tasks.workunit.client.0.smithi067.stdout:5/164: rename f2 to db/d1d/f2d 0 2024-08-31T05:21:13.469 INFO:tasks.workunit.client.0.smithi067.stdout:5/165: rmdir db/d1d 39 2024-08-31T05:21:13.471 INFO:tasks.workunit.client.0.smithi067.stdout:0/208: dwrite d1/dd/d18/f3e [0,4194304] 0 2024-08-31T05:21:13.472 INFO:tasks.workunit.client.0.smithi067.stdout:5/166: write f7 [201555,54171] 0 2024-08-31T05:21:13.474 INFO:tasks.workunit.client.0.smithi067.stdout:1/170: dwrite d3/f28 [0,4194304] 0 2024-08-31T05:21:13.475 INFO:tasks.workunit.client.0.smithi067.stdout:0/209: truncate d1/dd/f40 946998 0 2024-08-31T05:21:13.475 INFO:tasks.workunit.client.0.smithi067.stdout:1/171: chown d3/dd/f12 241 1 2024-08-31T05:21:13.478 INFO:tasks.workunit.client.0.smithi067.stdout:0/210: mknod d1/d8/c46 0 2024-08-31T05:21:13.479 INFO:tasks.workunit.client.0.smithi067.stdout:0/211: dread d1/f39 [0,4194304] 0 2024-08-31T05:21:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:1/172: mkdir d3/d23/d2d/d2e/d3a 0 2024-08-31T05:21:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:0/212: chown d1/f3a 19123 1 2024-08-31T05:21:13.481 INFO:tasks.workunit.client.0.smithi067.stdout:1/173: write d3/dd/fe [4216127,109686] 0 2024-08-31T05:21:13.491 INFO:tasks.workunit.client.0.smithi067.stdout:1/174: dwrite d3/dd/f21 [0,4194304] 0 2024-08-31T05:21:13.491 INFO:tasks.workunit.client.0.smithi067.stdout:5/167: creat db/f2e x:0 0 0 2024-08-31T05:21:13.497 INFO:tasks.workunit.client.0.smithi067.stdout:0/213: rename d1/l25 to d1/d8/l47 0 2024-08-31T05:21:13.498 INFO:tasks.workunit.client.0.smithi067.stdout:0/214: write d1/dd/d18/f3e [1525633,55666] 0 2024-08-31T05:21:13.499 INFO:tasks.workunit.client.0.smithi067.stdout:5/168: rmdir db/d26 39 2024-08-31T05:21:13.507 INFO:tasks.workunit.client.0.smithi067.stdout:5/169: chown db/d26/d29 3975 1 2024-08-31T05:21:13.511 INFO:tasks.workunit.client.1.smithi073.stdout:8/904: unlink d0/db/d1c/d34/d68/d9d/ccb 0 2024-08-31T05:21:13.512 INFO:tasks.workunit.client.0.smithi067.stdout:0/215: mkdir d1/df/d17/d43/d48 0 2024-08-31T05:21:13.513 INFO:tasks.workunit.client.0.smithi067.stdout:7/125: sync 2024-08-31T05:21:13.513 INFO:tasks.workunit.client.0.smithi067.stdout:7/126: readlink l12 0 2024-08-31T05:21:13.513 INFO:tasks.workunit.client.1.smithi073.stdout:3/998: chown da/d3c/d65/d40/d5d/f8b 127 1 2024-08-31T05:21:13.514 INFO:tasks.workunit.client.0.smithi067.stdout:0/216: dread d1/f39 [0,4194304] 0 2024-08-31T05:21:13.514 INFO:tasks.workunit.client.0.smithi067.stdout:7/127: dread - d14/f26 zero size 2024-08-31T05:21:13.515 INFO:tasks.workunit.client.0.smithi067.stdout:7/128: dread - d14/f1f zero size 2024-08-31T05:21:13.515 INFO:tasks.workunit.client.0.smithi067.stdout:5/170: creat db/d26/d29/f2f x:0 0 0 2024-08-31T05:21:13.515 INFO:tasks.workunit.client.0.smithi067.stdout:0/217: write d1/d8/f36 [629302,16554] 0 2024-08-31T05:21:13.516 INFO:tasks.workunit.client.0.smithi067.stdout:7/129: chown d14/f15 467823394 1 2024-08-31T05:21:13.517 INFO:tasks.workunit.client.1.smithi073.stdout:1/913: rename d5/d26/da5/ffe to d5/d26/d54/db2/dd5/d3f/dc2/f11a 0 2024-08-31T05:21:13.519 INFO:tasks.workunit.client.1.smithi073.stdout:1/914: write d5/d26/d54/db2/dd5/d2a/d80/d93/fbb [4423054,99892] 0 2024-08-31T05:21:13.521 INFO:tasks.workunit.client.1.smithi073.stdout:1/915: truncate d5/d26/d54/db2/dd5/d3f/d9f/fce 62643 0 2024-08-31T05:21:13.522 INFO:tasks.workunit.client.1.smithi073.stdout:1/916: truncate d5/d26/da5/dba/d1c/d27/fe0 958075 0 2024-08-31T05:21:13.523 INFO:tasks.workunit.client.0.smithi067.stdout:0/218: dwrite d1/dd/f40 [0,4194304] 0 2024-08-31T05:21:13.523 INFO:tasks.workunit.client.1.smithi073.stdout:1/917: write d5/d26/d54/f117 [14210,36078] 0 2024-08-31T05:21:13.524 INFO:tasks.workunit.client.1.smithi073.stdout:1/918: write d5/d26/d54/d5f/fdc [270862,24173] 0 2024-08-31T05:21:13.528 INFO:tasks.workunit.client.1.smithi073.stdout:9/987: creat dc/dc4/d11c/f140 x:0 0 0 2024-08-31T05:21:13.532 INFO:tasks.workunit.client.0.smithi067.stdout:7/130: symlink d14/l27 0 2024-08-31T05:21:13.534 INFO:tasks.workunit.client.0.smithi067.stdout:5/171: dread db/d1d/f2d [0,4194304] 0 2024-08-31T05:21:13.535 INFO:tasks.workunit.client.0.smithi067.stdout:5/172: dread - db/d15/f2a zero size 2024-08-31T05:21:13.535 INFO:tasks.workunit.client.0.smithi067.stdout:1/175: truncate d3/f27 766899 0 2024-08-31T05:21:13.536 INFO:tasks.workunit.client.1.smithi073.stdout:0/948: link d0/d69/d8e/d99/lcc d0/d69/d7f/d68/d91/df5/d3c/l144 0 2024-08-31T05:21:13.538 INFO:tasks.workunit.client.1.smithi073.stdout:4/855: dwrite d7/d1a/d5c/f66 [0,4194304] 0 2024-08-31T05:21:13.538 INFO:tasks.workunit.client.0.smithi067.stdout:7/131: dread fd [0,4194304] 0 2024-08-31T05:21:13.544 INFO:tasks.workunit.client.1.smithi073.stdout:0/949: dwrite d0/d69/d7f/d62/d10c/f126 [0,4194304] 0 2024-08-31T05:21:13.547 INFO:tasks.workunit.client.1.smithi073.stdout:2/934: getdents d2/d9/d27/d117 0 2024-08-31T05:21:13.551 INFO:tasks.workunit.client.1.smithi073.stdout:6/879: dwrite d15/f29 [0,4194304] 0 2024-08-31T05:21:13.555 INFO:tasks.workunit.client.0.smithi067.stdout:1/176: link d3/dd/l35 d3/l3b 0 2024-08-31T05:21:13.558 INFO:tasks.workunit.client.1.smithi073.stdout:3/999: rename da/f14 to da/d3c/d65/d2c/f141 0 2024-08-31T05:21:13.560 INFO:tasks.workunit.client.0.smithi067.stdout:1/177: creat d3/d23/f3c x:0 0 0 2024-08-31T05:21:13.561 INFO:tasks.workunit.client.1.smithi073.stdout:7/919: link d1/d11/ce4 d1/da/d15/d33/d44/d60/de1/c11e 0 2024-08-31T05:21:13.562 INFO:tasks.workunit.client.1.smithi073.stdout:7/920: read d1/d11/f53 [4193667,46553] 0 2024-08-31T05:21:13.562 INFO:tasks.workunit.client.1.smithi073.stdout:9/988: mknod dc/de/d66/d84/c141 0 2024-08-31T05:21:13.564 INFO:tasks.workunit.client.0.smithi067.stdout:7/132: dread f6 [0,4194304] 0 2024-08-31T05:21:13.565 INFO:tasks.workunit.client.0.smithi067.stdout:1/178: creat d3/dd/f3d x:0 0 0 2024-08-31T05:21:13.566 INFO:tasks.workunit.client.0.smithi067.stdout:7/133: chown d14/f1e 96027 1 2024-08-31T05:21:13.568 INFO:tasks.workunit.client.1.smithi073.stdout:0/950: creat d0/d69/d7f/d68/d91/df5/d3c/d9c/db6/dc6/d135/f145 x:0 0 0 2024-08-31T05:21:13.569 INFO:tasks.workunit.client.0.smithi067.stdout:1/179: symlink d3/d23/d2d/l3e 0 2024-08-31T05:21:13.570 INFO:tasks.workunit.client.1.smithi073.stdout:1/919: rename d5/d26/d54/d5f/le2 to d5/d26/da5/dba/d33/d13/d7e/l11b 0 2024-08-31T05:21:13.573 INFO:tasks.workunit.client.0.smithi067.stdout:5/173: truncate db/d15/f22 1781439 0 2024-08-31T05:21:13.575 INFO:tasks.workunit.client.0.smithi067.stdout:1/180: mknod d3/d23/c3f 0 2024-08-31T05:21:13.577 INFO:tasks.workunit.client.1.smithi073.stdout:7/921: mkdir d1/da/d3e/d22/d35/d11f 0 2024-08-31T05:21:13.578 INFO:tasks.workunit.client.0.smithi067.stdout:7/134: unlink d14/c23 0 2024-08-31T05:21:13.579 INFO:tasks.workunit.client.0.smithi067.stdout:7/135: dread - d14/d16/f1d zero size 2024-08-31T05:21:13.579 INFO:tasks.workunit.client.1.smithi073.stdout:8/905: truncate d0/db/d1c/d24/f74 3468964 0 2024-08-31T05:21:13.579 INFO:tasks.workunit.client.0.smithi067.stdout:7/136: dread - d14/f26 zero size 2024-08-31T05:21:13.580 INFO:tasks.workunit.client.1.smithi073.stdout:9/989: rmdir dc/d37/d42/d5a/dda 39 2024-08-31T05:21:13.580 INFO:tasks.workunit.client.0.smithi067.stdout:7/137: read fd [1728471,66500] 0 2024-08-31T05:21:13.581 INFO:tasks.workunit.client.0.smithi067.stdout:5/174: creat db/d1d/f30 x:0 0 0 2024-08-31T05:21:13.584 INFO:tasks.workunit.client.1.smithi073.stdout:0/951: unlink d0/d28/l5f 0 2024-08-31T05:21:13.586 INFO:tasks.workunit.client.1.smithi073.stdout:6/880: rename d15/d1a/d1e to d15/d1a/d51/d61/ddc/d12a 0 2024-08-31T05:21:13.590 INFO:tasks.workunit.client.0.smithi067.stdout:7/138: dwrite d14/f1e [0,4194304] 0 2024-08-31T05:21:13.591 INFO:tasks.workunit.client.0.smithi067.stdout:7/139: chown d14/d16/l19 25097 1 2024-08-31T05:21:13.593 INFO:tasks.workunit.client.1.smithi073.stdout:2/935: write d2/d9/d7f/fd2 [4502358,1316] 0 2024-08-31T05:21:13.595 INFO:tasks.workunit.client.1.smithi073.stdout:7/922: mkdir d1/da/d15/d33/d44/d60/d120 0 2024-08-31T05:21:13.597 INFO:tasks.workunit.client.1.smithi073.stdout:8/906: chown d0/c2 161443 1 2024-08-31T05:21:13.597 INFO:tasks.workunit.client.0.smithi067.stdout:1/181: link d3/d23/c3f d3/d23/d2d/d2e/d34/c40 0 2024-08-31T05:21:13.599 INFO:tasks.workunit.client.0.smithi067.stdout:7/140: dwrite d14/f20 [0,4194304] 0 2024-08-31T05:21:13.601 INFO:tasks.workunit.client.1.smithi073.stdout:4/856: getdents d7/df/d13/d2e/d47 0 2024-08-31T05:21:13.601 INFO:tasks.workunit.client.0.smithi067.stdout:7/141: truncate d14/d16/f1d 161793 0 2024-08-31T05:21:13.601 INFO:tasks.workunit.client.1.smithi073.stdout:4/857: stat d7/d1a/d5c/d6d/d59 0 2024-08-31T05:21:13.602 INFO:tasks.workunit.client.0.smithi067.stdout:7/142: fsync d14/d16/f24 0 2024-08-31T05:21:13.605 INFO:tasks.workunit.client.0.smithi067.stdout:7/143: dread fd [0,4194304] 0 2024-08-31T05:21:13.614 INFO:tasks.workunit.client.1.smithi073.stdout:7/923: mknod d1/da/d96/c121 0 2024-08-31T05:21:13.614 INFO:tasks.workunit.client.1.smithi073.stdout:7/924: readlink d1/da/la2 0 2024-08-31T05:21:13.615 INFO:tasks.workunit.client.1.smithi073.stdout:7/925: fdatasync d1/da/d15/d33/d44/f66 0 2024-08-31T05:21:13.616 INFO:tasks.workunit.client.0.smithi067.stdout:5/175: dwrite db/f1b [0,4194304] 0 2024-08-31T05:21:13.617 INFO:tasks.workunit.client.0.smithi067.stdout:5/176: chown db/d15/l27 29 1 2024-08-31T05:21:13.619 INFO:tasks.workunit.client.1.smithi073.stdout:8/907: read d0/db/d1c/d34/d38/f94 [1031406,58219] 0 2024-08-31T05:21:13.621 INFO:tasks.workunit.client.1.smithi073.stdout:9/990: mkdir dc/d82/df9/d142 0 2024-08-31T05:21:13.621 INFO:tasks.workunit.client.0.smithi067.stdout:5/177: mkdir db/d26/d29/d31 0 2024-08-31T05:21:13.623 INFO:tasks.workunit.client.1.smithi073.stdout:1/920: truncate d5/d26/d54/d9e/fb6 85193 0 2024-08-31T05:21:13.626 INFO:tasks.workunit.client.1.smithi073.stdout:2/936: mkdir d2/d9/d27/d9b/da6/d121 0 2024-08-31T05:21:13.626 INFO:tasks.workunit.client.0.smithi067.stdout:1/182: write d3/f1e [312540,105973] 0 2024-08-31T05:21:13.626 INFO:tasks.workunit.client.1.smithi073.stdout:4/858: dread d7/df/d13/db2/fbd [0,4194304] 0 2024-08-31T05:21:13.629 INFO:tasks.workunit.client.0.smithi067.stdout:5/178: dwrite f9 [0,4194304] 0 2024-08-31T05:21:13.631 INFO:tasks.workunit.client.1.smithi073.stdout:1/921: dwrite d5/d26/da5/dba/d1c/d27/fe0 [0,4194304] 0 2024-08-31T05:21:13.633 INFO:tasks.workunit.client.1.smithi073.stdout:9/991: chown dc/d37/d42/d8d/l99 51075 1 2024-08-31T05:21:13.635 INFO:tasks.workunit.client.1.smithi073.stdout:9/992: truncate dc/de/d127/f12b 474830 0 2024-08-31T05:21:13.641 INFO:tasks.workunit.client.1.smithi073.stdout:2/937: rmdir d2/d9/d66/d70/dc9 39 2024-08-31T05:21:13.646 INFO:tasks.workunit.client.0.smithi067.stdout:5/179: rename f9 to db/f32 0 2024-08-31T05:21:13.648 INFO:tasks.workunit.client.0.smithi067.stdout:5/180: mknod db/d1d/c33 0 2024-08-31T05:21:13.648 INFO:tasks.workunit.client.1.smithi073.stdout:7/926: write d1/da/d15/f24 [549698,68257] 0 2024-08-31T05:21:13.649 INFO:tasks.workunit.client.1.smithi073.stdout:9/993: symlink dc/de/dd8/l143 0 2024-08-31T05:21:13.650 INFO:tasks.workunit.client.1.smithi073.stdout:9/994: chown dc/d10 54 1 2024-08-31T05:21:13.650 INFO:tasks.workunit.client.1.smithi073.stdout:2/938: mkdir d2/d9/d3c/d122 0 2024-08-31T05:21:13.651 INFO:tasks.workunit.client.1.smithi073.stdout:9/995: stat dc/d37/d42/d8d/de8/l124 0 2024-08-31T05:21:13.652 INFO:tasks.workunit.client.0.smithi067.stdout:5/181: rename db/d1d/c33 to db/c34 0 2024-08-31T05:21:13.653 INFO:tasks.workunit.client.1.smithi073.stdout:2/939: chown d2/d9/d84 722 1 2024-08-31T05:21:13.654 INFO:tasks.workunit.client.1.smithi073.stdout:1/922: rename d5/d26/da5/dba/d1c/f4b to d5/d26/da5/dba/d1c/f11c 0 2024-08-31T05:21:13.655 INFO:tasks.workunit.client.0.smithi067.stdout:5/182: rmdir db/d26 39 2024-08-31T05:21:13.656 INFO:tasks.workunit.client.0.smithi067.stdout:5/183: readlink db/d15/l14 0 2024-08-31T05:21:13.656 INFO:tasks.workunit.client.1.smithi073.stdout:4/859: getdents d7/d1a/d5c/d62/df4 0 2024-08-31T05:21:13.657 INFO:tasks.workunit.client.1.smithi073.stdout:8/908: write d0/db/d1c/d34/d68/fd9 [37574,67106] 0 2024-08-31T05:21:13.657 INFO:tasks.workunit.client.0.smithi067.stdout:5/184: write f4 [438395,79902] 0 2024-08-31T05:21:13.658 INFO:tasks.workunit.client.1.smithi073.stdout:4/860: stat d7/d1a/d5c/d6d/d59/d65/db9 0 2024-08-31T05:21:13.658 INFO:tasks.workunit.client.0.smithi067.stdout:5/185: fdatasync db/f2e 0 2024-08-31T05:21:13.658 INFO:tasks.workunit.client.1.smithi073.stdout:2/940: dread d2/d9/d7f/dab/d5d/d82/f8a [0,4194304] 0 2024-08-31T05:21:13.659 INFO:tasks.workunit.client.1.smithi073.stdout:2/941: stat d2/d9/d7f/dab/d5d/fb3 0 2024-08-31T05:21:13.661 INFO:tasks.workunit.client.0.smithi067.stdout:5/186: write db/d26/d29/f2f [500798,120257] 0 2024-08-31T05:21:13.662 INFO:tasks.workunit.client.1.smithi073.stdout:7/927: getdents d1/da/d96 0 2024-08-31T05:21:13.663 INFO:tasks.workunit.client.0.smithi067.stdout:1/183: truncate d3/dd/f21 1354752 0 2024-08-31T05:21:13.665 INFO:tasks.workunit.client.1.smithi073.stdout:8/909: creat d0/d62/db4/de7/f11b x:0 0 0 2024-08-31T05:21:13.665 INFO:tasks.workunit.client.1.smithi073.stdout:4/861: chown d7/df/d13/d2e/d47/d4c/d73 1009 1 2024-08-31T05:21:13.667 INFO:tasks.workunit.client.0.smithi067.stdout:5/187: rename db/l23 to db/d26/d29/d31/l35 0 2024-08-31T05:21:13.668 INFO:tasks.workunit.client.0.smithi067.stdout:1/184: mknod d3/d23/c41 0 2024-08-31T05:21:13.669 INFO:tasks.workunit.client.1.smithi073.stdout:2/942: creat d2/d9/d3c/f123 x:0 0 0 2024-08-31T05:21:13.671 INFO:tasks.workunit.client.1.smithi073.stdout:9/996: rmdir dc/d82/df9/d142 0 2024-08-31T05:21:13.674 INFO:tasks.workunit.client.0.smithi067.stdout:5/188: readlink db/lf 0 2024-08-31T05:21:13.674 INFO:tasks.workunit.client.0.smithi067.stdout:1/185: dwrite d3/dd/f3d [0,4194304] 0 2024-08-31T05:21:13.675 INFO:tasks.workunit.client.1.smithi073.stdout:7/928: readlink d1/da/d15/d33/d44/d74/dd6/de6/l40 0 2024-08-31T05:21:13.679 INFO:tasks.workunit.client.0.smithi067.stdout:5/189: dread db/d15/f18 [0,4194304] 0 2024-08-31T05:21:13.680 INFO:tasks.workunit.client.1.smithi073.stdout:1/923: write d5/d26/da5/dba/d1c/fbc [816647,72639] 0 2024-08-31T05:21:13.682 INFO:tasks.workunit.client.1.smithi073.stdout:8/910: truncate d0/f5 1671627 0 2024-08-31T05:21:13.683 INFO:tasks.workunit.client.1.smithi073.stdout:2/943: truncate d2/d9/d66/d70/fbb 167513 0 2024-08-31T05:21:13.686 INFO:tasks.workunit.client.0.smithi067.stdout:5/190: dread db/d26/d29/f2f [0,4194304] 0 2024-08-31T05:21:13.686 INFO:tasks.workunit.client.0.smithi067.stdout:5/191: fdatasync db/d1d/f30 0 2024-08-31T05:21:13.686 INFO:tasks.workunit.client.1.smithi073.stdout:1/924: truncate d5/d26/d54/db2/dd5/d32/f115 767489 0 2024-08-31T05:21:13.687 INFO:tasks.workunit.client.1.smithi073.stdout:7/929: creat d1/da/d15/d33/d44/d60/d120/f122 x:0 0 0 2024-08-31T05:21:13.688 INFO:tasks.workunit.client.1.smithi073.stdout:8/911: mkdir d0/db/d1c/d34/d80/d9a/de5/d11c 0 2024-08-31T05:21:13.691 INFO:tasks.workunit.client.1.smithi073.stdout:7/930: mknod d1/da/d15/d33/d44/d60/d120/c123 0 2024-08-31T05:21:13.692 INFO:tasks.workunit.client.0.smithi067.stdout:5/192: mkdir db/d26/d29/d2c/d36 0 2024-08-31T05:21:13.694 INFO:tasks.workunit.client.1.smithi073.stdout:8/912: creat d0/db/d44/d72/d75/d7e/d91/f11d x:0 0 0 2024-08-31T05:21:13.695 INFO:tasks.workunit.client.1.smithi073.stdout:9/997: dread dc/dc4/fcf [0,4194304] 0 2024-08-31T05:21:13.695 INFO:tasks.workunit.client.1.smithi073.stdout:7/931: symlink d1/da/d15/d33/l124 0 2024-08-31T05:21:13.695 INFO:tasks.workunit.client.0.smithi067.stdout:5/193: dread db/d1d/f2d [0,4194304] 0 2024-08-31T05:21:13.696 INFO:tasks.workunit.client.0.smithi067.stdout:5/194: chown db/lf 141 1 2024-08-31T05:21:13.696 INFO:tasks.workunit.client.1.smithi073.stdout:0/952: sync 2024-08-31T05:21:13.697 INFO:tasks.workunit.client.1.smithi073.stdout:2/944: dwrite d2/d9/df/d43/d88/f8f [0,4194304] 0 2024-08-31T05:21:13.697 INFO:tasks.workunit.client.1.smithi073.stdout:8/913: creat d0/db/d44/d72/d79/f11e x:0 0 0 2024-08-31T05:21:13.698 INFO:tasks.workunit.client.1.smithi073.stdout:9/998: write dc/d37/d42/fa1 [2249270,53655] 0 2024-08-31T05:21:13.699 INFO:tasks.workunit.client.1.smithi073.stdout:8/914: write d0/fbc [119608,102885] 0 2024-08-31T05:21:13.703 INFO:tasks.workunit.client.1.smithi073.stdout:2/945: mkdir d2/d25/d92/d124 0 2024-08-31T05:21:13.709 INFO:tasks.workunit.client.1.smithi073.stdout:4/862: dwrite d7/df/d13/d2e/d70/f6c [0,4194304] 0 2024-08-31T05:21:13.716 INFO:tasks.workunit.client.1.smithi073.stdout:2/946: rmdir d2/d9/d7f/db6 0 2024-08-31T05:21:13.717 INFO:tasks.workunit.client.1.smithi073.stdout:0/953: link d0/d69/d7f/d62/f8f d0/d28/f146 0 2024-08-31T05:21:13.718 INFO:tasks.workunit.client.1.smithi073.stdout:8/915: getdents d0/d62/db4 0 2024-08-31T05:21:13.718 INFO:tasks.workunit.client.0.smithi067.stdout:5/195: write db/d15/f22 [437321,110995] 0 2024-08-31T05:21:13.719 INFO:tasks.workunit.client.1.smithi073.stdout:8/916: dread - d0/db/d1c/d2a/d58/f116 zero size 2024-08-31T05:21:13.725 INFO:tasks.workunit.client.0.smithi067.stdout:5/196: dwrite db/d15/f12 [0,4194304] 0 2024-08-31T05:21:13.726 INFO:tasks.workunit.client.1.smithi073.stdout:7/932: dwrite d1/da/d15/d33/d44/d74/dd6/de6/f85 [0,4194304] 0 2024-08-31T05:21:13.726 INFO:tasks.workunit.client.1.smithi073.stdout:0/954: getdents d0/d15/d2c/d41/d52 0 2024-08-31T05:21:13.729 INFO:tasks.workunit.client.1.smithi073.stdout:7/933: chown d1/da/d15/d33/d44 71 1 2024-08-31T05:21:13.732 INFO:tasks.workunit.client.1.smithi073.stdout:8/917: truncate d0/db/d1c/d34/d80/d9a/fa1 1755387 0 2024-08-31T05:21:13.734 INFO:tasks.workunit.client.1.smithi073.stdout:0/955: truncate d0/d58/f6e 3403410 0 2024-08-31T05:21:13.736 INFO:tasks.workunit.client.1.smithi073.stdout:9/999: dread f5 [0,4194304] 0 2024-08-31T05:21:13.737 INFO:tasks.workunit.client.1.smithi073.stdout:7/934: creat d1/da/d3e/d22/d47/f125 x:0 0 0 2024-08-31T05:21:13.738 INFO:tasks.workunit.client.1.smithi073.stdout:0/956: symlink d0/d69/d7f/d68/d91/l147 0 2024-08-31T05:21:13.739 INFO:tasks.workunit.client.1.smithi073.stdout:4/863: dwrite d7/df/f21 [0,4194304] 0 2024-08-31T05:21:13.739 INFO:tasks.workunit.client.1.smithi073.stdout:8/918: write d0/db/d44/d72/d75/d7e/d91/f11d [65617,118575] 0 2024-08-31T05:21:13.741 INFO:tasks.workunit.client.1.smithi073.stdout:2/947: dwrite d2/d9/d3c/f73 [0,4194304] 0 2024-08-31T05:21:13.743 INFO:tasks.workunit.client.1.smithi073.stdout:7/935: creat d1/da/d96/f126 x:0 0 0 2024-08-31T05:21:13.744 INFO:tasks.workunit.client.0.smithi067.stdout:3/207: sync 2024-08-31T05:21:13.744 INFO:tasks.workunit.client.0.smithi067.stdout:9/130: sync 2024-08-31T05:21:13.744 INFO:tasks.workunit.client.0.smithi067.stdout:6/365: sync 2024-08-31T05:21:13.744 INFO:tasks.workunit.client.0.smithi067.stdout:8/270: sync 2024-08-31T05:21:13.744 INFO:tasks.workunit.client.0.smithi067.stdout:4/173: sync 2024-08-31T05:21:13.745 INFO:tasks.workunit.client.0.smithi067.stdout:2/207: sync 2024-08-31T05:21:13.746 INFO:tasks.workunit.client.0.smithi067.stdout:9/131: stat dd/df/f12 0 2024-08-31T05:21:13.746 INFO:tasks.workunit.client.0.smithi067.stdout:8/271: readlink d0/d4/de/l19 0 2024-08-31T05:21:13.747 INFO:tasks.workunit.client.0.smithi067.stdout:6/366: write f7 [3968331,109260] 0 2024-08-31T05:21:13.747 INFO:tasks.workunit.client.0.smithi067.stdout:3/208: readlink db/lf 0 2024-08-31T05:21:13.750 INFO:tasks.workunit.client.0.smithi067.stdout:2/208: mkdir db/d12/d1a/d31 0 2024-08-31T05:21:13.753 INFO:tasks.workunit.client.1.smithi073.stdout:4/864: rename d7/d1a/d5c/d6d/d59/d86 to d7/d1a/d5c/d6d/d111 0 2024-08-31T05:21:13.760 INFO:tasks.workunit.client.0.smithi067.stdout:2/209: dwrite db/d12/d24/f26 [0,4194304] 0 2024-08-31T05:21:13.762 INFO:tasks.workunit.client.0.smithi067.stdout:2/210: write db/dd/f17 [815800,50524] 0 2024-08-31T05:21:13.763 INFO:tasks.workunit.client.0.smithi067.stdout:8/272: mknod d0/d2/d6/c5a 0 2024-08-31T05:21:13.765 INFO:tasks.workunit.client.0.smithi067.stdout:8/273: truncate d0/d2/dc/f48 584324 0 2024-08-31T05:21:13.766 INFO:tasks.workunit.client.1.smithi073.stdout:2/948: link d2/d9/d7f/l11e d2/d9/df/l125 0 2024-08-31T05:21:13.767 INFO:tasks.workunit.client.1.smithi073.stdout:8/919: write d0/d62/fab [932639,116762] 0 2024-08-31T05:21:13.769 INFO:tasks.workunit.client.1.smithi073.stdout:2/949: truncate d2/d9/d3c/ffb 92796 0 2024-08-31T05:21:13.772 INFO:tasks.workunit.client.1.smithi073.stdout:4/865: creat d7/df/d13/d2e/d70/f112 x:0 0 0 2024-08-31T05:21:13.772 INFO:tasks.workunit.client.1.smithi073.stdout:7/936: dread d1/da/d15/d33/d44/f66 [0,4194304] 0 2024-08-31T05:21:13.774 INFO:tasks.workunit.client.1.smithi073.stdout:4/866: write d7/d1a/d5c/d6d/d59/d65/db9/dd6/fe1 [1120680,109934] 0 2024-08-31T05:21:13.774 INFO:tasks.workunit.client.0.smithi067.stdout:3/209: dread db/f10 [0,4194304] 0 2024-08-31T05:21:13.776 INFO:tasks.workunit.client.0.smithi067.stdout:9/132: creat dd/f2d x:0 0 0 2024-08-31T05:21:13.780 INFO:tasks.workunit.client.0.smithi067.stdout:9/133: creat dd/df/f2e x:0 0 0 2024-08-31T05:21:13.781 INFO:tasks.workunit.client.1.smithi073.stdout:8/920: rename d0/d62/l101 to d0/db/d1c/d24/l11f 0 2024-08-31T05:21:13.783 INFO:tasks.workunit.client.1.smithi073.stdout:7/937: dwrite d1/da/d3e/d22/d35/d83/f9f [4194304,4194304] 0 2024-08-31T05:21:13.783 INFO:tasks.workunit.client.0.smithi067.stdout:3/210: dwrite db/d12/d21/f25 [4194304,4194304] 0 2024-08-31T05:21:13.784 INFO:tasks.workunit.client.0.smithi067.stdout:9/134: write dd/f2a [775654,91909] 0 2024-08-31T05:21:13.785 INFO:tasks.workunit.client.1.smithi073.stdout:4/867: creat d7/d1a/d5c/d6d/f113 x:0 0 0 2024-08-31T05:21:13.785 INFO:tasks.workunit.client.0.smithi067.stdout:6/367: dread d1b/d23/d28/d45/f5b [0,4194304] 0 2024-08-31T05:21:13.786 INFO:tasks.workunit.client.1.smithi073.stdout:7/938: truncate d1/d11/fed 4506801 0 2024-08-31T05:21:13.787 INFO:tasks.workunit.client.0.smithi067.stdout:9/135: readlink dd/df/l14 0 2024-08-31T05:21:13.787 INFO:tasks.workunit.client.1.smithi073.stdout:4/868: dread - d7/d1a/d5c/d6d/d2c/ffd zero size 2024-08-31T05:21:13.788 INFO:tasks.workunit.client.0.smithi067.stdout:9/136: read - dd/df/f12 zero size 2024-08-31T05:21:13.789 INFO:tasks.workunit.client.0.smithi067.stdout:9/137: fdatasync dd/d20/f2b 0 2024-08-31T05:21:13.790 INFO:tasks.workunit.client.0.smithi067.stdout:3/211: mkdir db/d12/d39/d4a 0 2024-08-31T05:21:13.790 INFO:tasks.workunit.client.1.smithi073.stdout:8/921: dwrite d0/f39 [4194304,4194304] 0 2024-08-31T05:21:13.790 INFO:tasks.workunit.client.1.smithi073.stdout:4/869: write d7/df/d79/faf [3604537,10537] 0 2024-08-31T05:21:13.792 INFO:tasks.workunit.client.0.smithi067.stdout:6/368: chown ca 1 1 2024-08-31T05:21:13.793 INFO:tasks.workunit.client.1.smithi073.stdout:7/939: symlink d1/da/d65/d9e/l127 0 2024-08-31T05:21:13.795 INFO:tasks.workunit.client.1.smithi073.stdout:7/940: stat d1/da/d15/d33/d44/d74/dd6/dea/f5b 0 2024-08-31T05:21:13.796 INFO:tasks.workunit.client.0.smithi067.stdout:9/138: creat dd/d20/f2f x:0 0 0 2024-08-31T05:21:13.796 INFO:tasks.workunit.client.0.smithi067.stdout:8/274: dread d0/f9 [0,4194304] 0 2024-08-31T05:21:13.798 INFO:tasks.workunit.client.0.smithi067.stdout:3/212: creat db/d17/d3f/f4b x:0 0 0 2024-08-31T05:21:13.799 INFO:tasks.workunit.client.1.smithi073.stdout:8/922: symlink d0/da8/l120 0 2024-08-31T05:21:13.801 INFO:tasks.workunit.client.0.smithi067.stdout:6/369: rename f3 to d1b/d23/d2e/d3b/f72 0 2024-08-31T05:21:13.802 INFO:tasks.workunit.client.1.smithi073.stdout:4/870: symlink d7/d1a/d5c/l114 0 2024-08-31T05:21:13.807 INFO:tasks.workunit.client.1.smithi073.stdout:7/941: rename d1/da/d3e/d22/d6b/f70 to d1/da/d15/d33/d44/d74/dd6/dea/dac/d103/d109/f128 0 2024-08-31T05:21:13.807 INFO:tasks.workunit.client.1.smithi073.stdout:2/950: write d2/d9/df/d43/f7a [3781857,46726] 0 2024-08-31T05:21:13.808 INFO:tasks.workunit.client.0.smithi067.stdout:8/275: mknod d0/d2/da/dd/c5b 0 2024-08-31T05:21:13.810 INFO:tasks.workunit.client.1.smithi073.stdout:8/923: creat d0/db/d1c/d34/d80/d9a/de5/f121 x:0 0 0 2024-08-31T05:21:13.812 INFO:tasks.workunit.client.1.smithi073.stdout:6/881: sync 2024-08-31T05:21:13.815 INFO:tasks.workunit.client.0.smithi067.stdout:2/211: dwrite db/f25 [0,4194304] 0 2024-08-31T05:21:13.816 INFO:tasks.workunit.client.0.smithi067.stdout:3/213: dread db/d2e/d43/f28 [0,4194304] 0 2024-08-31T05:21:13.817 INFO:tasks.workunit.client.0.smithi067.stdout:3/214: dread - db/d17/d3f/f4b zero size 2024-08-31T05:21:13.820 INFO:tasks.workunit.client.1.smithi073.stdout:2/951: dread d2/d9/d3c/fc5 [0,4194304] 0 2024-08-31T05:21:13.822 INFO:tasks.workunit.client.0.smithi067.stdout:8/276: mknod d0/d2/dc/d28/c5c 0 2024-08-31T05:21:13.823 INFO:tasks.workunit.client.0.smithi067.stdout:2/212: symlink db/l32 0 2024-08-31T05:21:13.826 INFO:tasks.workunit.client.1.smithi073.stdout:8/924: symlink d0/db/d1c/d24/d73/ddc/l122 0 2024-08-31T05:21:13.826 INFO:tasks.workunit.client.0.smithi067.stdout:6/370: creat d1b/d30/f73 x:0 0 0 2024-08-31T05:21:13.827 INFO:tasks.workunit.client.1.smithi073.stdout:8/925: dread - d0/db/d1c/d34/d80/d9a/de5/f107 zero size 2024-08-31T05:21:13.828 INFO:tasks.workunit.client.0.smithi067.stdout:3/215: symlink db/d2c/l4c 0 2024-08-31T05:21:13.828 INFO:tasks.workunit.client.0.smithi067.stdout:3/216: chown db/c20 6829 1 2024-08-31T05:21:13.831 INFO:tasks.workunit.client.0.smithi067.stdout:8/277: rmdir d0/d4/de 39 2024-08-31T05:21:13.834 INFO:tasks.workunit.client.0.smithi067.stdout:2/213: creat db/dd/f33 x:0 0 0 2024-08-31T05:21:13.835 INFO:tasks.workunit.client.1.smithi073.stdout:8/926: symlink d0/db/d1c/dda/l123 0 2024-08-31T05:21:13.836 INFO:tasks.workunit.client.0.smithi067.stdout:6/371: chown d1b/d23/c26 63098606 1 2024-08-31T05:21:13.836 INFO:tasks.workunit.client.0.smithi067.stdout:6/372: chown d1b/c1f 2970204 1 2024-08-31T05:21:13.837 INFO:tasks.workunit.client.0.smithi067.stdout:9/139: write dd/f1a [1048373,49907] 0 2024-08-31T05:21:13.846 INFO:tasks.workunit.client.1.smithi073.stdout:2/952: mknod d2/d9/c126 0 2024-08-31T05:21:13.848 INFO:tasks.workunit.client.1.smithi073.stdout:4/871: dwrite d7/df/d13/f44 [0,4194304] 0 2024-08-31T05:21:13.848 INFO:tasks.workunit.client.1.smithi073.stdout:7/942: dread d1/da/fd5 [0,4194304] 0 2024-08-31T05:21:13.849 INFO:tasks.workunit.client.0.smithi067.stdout:2/214: dread db/dd/f15 [0,4194304] 0 2024-08-31T05:21:13.857 INFO:tasks.workunit.client.1.smithi073.stdout:4/872: truncate d7/df/d13/d2e/fa3 303188 0 2024-08-31T05:21:13.876 INFO:tasks.workunit.client.1.smithi073.stdout:0/957: sync 2024-08-31T05:21:13.877 INFO:tasks.workunit.client.1.smithi073.stdout:1/925: sync 2024-08-31T05:21:13.881 INFO:tasks.workunit.client.1.smithi073.stdout:0/958: dwrite d0/d69/d7f/d62/fa6 [4194304,4194304] 0 2024-08-31T05:21:13.886 INFO:tasks.workunit.client.1.smithi073.stdout:7/943: creat d1/da/d15/d33/d44/d74/dd6/dea/dac/f129 x:0 0 0 2024-08-31T05:21:13.886 INFO:tasks.workunit.client.0.smithi067.stdout:9/140: fdatasync dd/df/f24 0 2024-08-31T05:21:13.888 INFO:tasks.workunit.client.1.smithi073.stdout:2/953: mkdir d2/d9/d3c/d122/d127 0 2024-08-31T05:21:13.891 INFO:tasks.workunit.client.1.smithi073.stdout:1/926: chown d5/d26/d54/db2/dd5/d32/d37/d6f/dc7/df1/d114 8556389 1 2024-08-31T05:21:13.891 INFO:tasks.workunit.client.0.smithi067.stdout:3/217: link db/d2e/c47 db/d17/c4d 0 2024-08-31T05:21:13.892 INFO:tasks.workunit.client.0.smithi067.stdout:9/141: dwrite dd/df/f28 [0,4194304] 0 2024-08-31T05:21:13.892 INFO:tasks.workunit.client.0.smithi067.stdout:3/218: fsync db/d12/f16 0 2024-08-31T05:21:13.893 INFO:tasks.workunit.client.0.smithi067.stdout:9/142: readlink dd/df/l21 0 2024-08-31T05:21:13.896 INFO:tasks.workunit.client.1.smithi073.stdout:7/944: rename d1/d11/fed to d1/da/d15/d33/d44/d60/d120/f12a 0 2024-08-31T05:21:13.897 INFO:tasks.workunit.client.0.smithi067.stdout:6/373: getdents d1b/d23/d61 0 2024-08-31T05:21:13.901 INFO:tasks.workunit.client.1.smithi073.stdout:0/959: symlink d0/d69/d7f/d68/d91/df5/d3c/l148 0 2024-08-31T05:21:13.903 INFO:tasks.workunit.client.1.smithi073.stdout:1/927: creat d5/d26/d54/db2/dd5/d2a/d80/f11d x:0 0 0 2024-08-31T05:21:13.904 INFO:tasks.workunit.client.1.smithi073.stdout:8/927: link d0/c46 d0/db/d44/d72/d75/d7e/d91/c124 0 2024-08-31T05:21:13.905 INFO:tasks.workunit.client.0.smithi067.stdout:6/374: dwrite d1b/d30/f73 [0,4194304] 0 2024-08-31T05:21:13.907 INFO:tasks.workunit.client.0.smithi067.stdout:9/143: symlink dd/df/l30 0 2024-08-31T05:21:13.907 INFO:tasks.workunit.client.0.smithi067.stdout:9/144: read - dd/d20/f2f zero size 2024-08-31T05:21:13.908 INFO:tasks.workunit.client.1.smithi073.stdout:0/960: dwrite d0/d58/ffa [0,4194304] 0 2024-08-31T05:21:13.910 INFO:tasks.workunit.client.1.smithi073.stdout:2/954: symlink d2/d9/d7f/dab/l128 0 2024-08-31T05:21:13.911 INFO:tasks.workunit.client.0.smithi067.stdout:2/215: write db/d12/d1a/f20 [1031160,113254] 0 2024-08-31T05:21:13.913 INFO:tasks.workunit.client.0.smithi067.stdout:8/278: truncate d0/d4/de/f34 3197096 0 2024-08-31T05:21:13.916 INFO:tasks.workunit.client.0.smithi067.stdout:9/145: mkdir dd/df/d31 0 2024-08-31T05:21:13.918 INFO:tasks.workunit.client.1.smithi073.stdout:6/882: sync 2024-08-31T05:21:13.919 INFO:tasks.workunit.client.1.smithi073.stdout:1/928: symlink d5/d26/d54/d9e/l11e 0 2024-08-31T05:21:13.921 INFO:tasks.workunit.client.1.smithi073.stdout:0/961: creat d0/d69/d7f/d62/d10c/f149 x:0 0 0 2024-08-31T05:21:13.922 INFO:tasks.workunit.client.1.smithi073.stdout:0/962: dread - d0/d15/d2c/f115 zero size 2024-08-31T05:21:13.923 INFO:tasks.workunit.client.1.smithi073.stdout:2/955: mkdir d2/d9/d7f/dab/d5d/da1/d129 0 2024-08-31T05:21:13.925 INFO:tasks.workunit.client.0.smithi067.stdout:9/146: mknod dd/df/d25/c32 0 2024-08-31T05:21:13.926 INFO:tasks.workunit.client.1.smithi073.stdout:0/963: chown d0/d69/d7f/d68/d91/df5/d3c/l148 65862433 1 2024-08-31T05:21:13.926 INFO:tasks.workunit.client.1.smithi073.stdout:4/873: getdents d7/df/d13/d2e/d47/d4c 0 2024-08-31T05:21:13.927 INFO:tasks.workunit.client.0.smithi067.stdout:3/219: getdents db/d12 0 2024-08-31T05:21:13.928 INFO:tasks.workunit.client.1.smithi073.stdout:0/964: write d0/d58/d63/f7d [2628374,125738] 0 2024-08-31T05:21:13.929 INFO:tasks.workunit.client.0.smithi067.stdout:3/220: truncate db/d12/f36 751008 0 2024-08-31T05:21:13.929 INFO:tasks.workunit.client.0.smithi067.stdout:6/375: creat d1b/f74 x:0 0 0 2024-08-31T05:21:13.931 INFO:tasks.workunit.client.1.smithi073.stdout:7/945: dwrite d1/da/d15/d33/d44/d74/dd6/dea/f29 [4194304,4194304] 0 2024-08-31T05:21:13.931 INFO:tasks.workunit.client.1.smithi073.stdout:8/928: mkdir d0/da8/d10d/d125 0 2024-08-31T05:21:13.931 INFO:tasks.workunit.client.0.smithi067.stdout:2/216: symlink db/d12/d1a/d2b/l34 0 2024-08-31T05:21:13.933 INFO:tasks.workunit.client.1.smithi073.stdout:4/874: creat d7/df/d13/d53/d88/dc7/f115 x:0 0 0 2024-08-31T05:21:13.935 INFO:tasks.workunit.client.1.smithi073.stdout:4/875: stat d7/d1a/d5c/d6d/d2c/deb 0 2024-08-31T05:21:13.940 INFO:tasks.workunit.client.1.smithi073.stdout:2/956: dread d2/d9/df/f29 [0,4194304] 0 2024-08-31T05:21:13.943 INFO:tasks.workunit.client.1.smithi073.stdout:8/929: unlink d0/d62/fab 0 2024-08-31T05:21:13.945 INFO:tasks.workunit.client.1.smithi073.stdout:6/883: dwrite d15/d17/da1/dae/db0/f7a [0,4194304] 0 2024-08-31T05:21:13.947 INFO:tasks.workunit.client.0.smithi067.stdout:8/279: getdents d0/d2/da 0 2024-08-31T05:21:13.949 INFO:tasks.workunit.client.0.smithi067.stdout:2/217: creat db/dd/d2d/f35 x:0 0 0 2024-08-31T05:21:13.951 INFO:tasks.workunit.client.1.smithi073.stdout:0/965: dread d0/d28/f30 [0,4194304] 0 2024-08-31T05:21:13.953 INFO:tasks.workunit.client.1.smithi073.stdout:0/966: write d0/d15/d2c/f127 [261602,117135] 0 2024-08-31T05:21:13.957 INFO:tasks.workunit.client.1.smithi073.stdout:0/967: truncate d0/d69/f109 207911 0 2024-08-31T05:21:13.957 INFO:tasks.workunit.client.1.smithi073.stdout:7/946: write d1/da/db2/f115 [54085,15115] 0 2024-08-31T05:21:13.957 INFO:tasks.workunit.client.1.smithi073.stdout:6/884: truncate d15/d75/f76 355404 0 2024-08-31T05:21:13.957 INFO:tasks.workunit.client.0.smithi067.stdout:3/221: truncate db/f14 2920645 0 2024-08-31T05:21:13.958 INFO:tasks.workunit.client.1.smithi073.stdout:6/885: write d15/d1a/d51/d61/fbf [69093,82119] 0 2024-08-31T05:21:13.960 INFO:tasks.workunit.client.1.smithi073.stdout:8/930: mknod d0/db/d44/c126 0 2024-08-31T05:21:13.961 INFO:tasks.workunit.client.0.smithi067.stdout:6/376: dread d1b/d23/d28/f46 [0,4194304] 0 2024-08-31T05:21:13.964 INFO:tasks.workunit.client.0.smithi067.stdout:9/147: dread dd/f1e [0,4194304] 0 2024-08-31T05:21:13.965 INFO:tasks.workunit.client.0.smithi067.stdout:3/222: mkdir db/d4e 0 2024-08-31T05:21:13.965 INFO:tasks.workunit.client.1.smithi073.stdout:2/957: dwrite d2/d9/d27/d9b/da7/fad [0,4194304] 0 2024-08-31T05:21:13.966 INFO:tasks.workunit.client.0.smithi067.stdout:8/280: truncate d0/f40 3367788 0 2024-08-31T05:21:13.966 INFO:tasks.workunit.client.1.smithi073.stdout:2/958: dread - d2/d9/d7f/dab/d5d/f106 zero size 2024-08-31T05:21:13.967 INFO:tasks.workunit.client.1.smithi073.stdout:7/947: write d1/da/d15/d33/d44/d60/d120/f12a [2662608,7362] 0 2024-08-31T05:21:13.967 INFO:tasks.workunit.client.0.smithi067.stdout:2/218: dwrite f1 [0,4194304] 0 2024-08-31T05:21:13.968 INFO:tasks.workunit.client.0.smithi067.stdout:2/219: chown db/d12/d1a/f1f 21997 1 2024-08-31T05:21:13.969 INFO:tasks.workunit.client.0.smithi067.stdout:6/377: unlink d1b/d23/d28/f46 0 2024-08-31T05:21:13.970 INFO:tasks.workunit.client.1.smithi073.stdout:8/931: unlink d0/db/d1c/d24/lbe 0 2024-08-31T05:21:13.973 INFO:tasks.workunit.client.1.smithi073.stdout:4/876: dread d7/df/d13/d2e/f31 [0,4194304] 0 2024-08-31T05:21:13.973 INFO:tasks.workunit.client.1.smithi073.stdout:4/877: stat d7/df/d13/d2e/d47 0 2024-08-31T05:21:13.974 INFO:tasks.workunit.client.0.smithi067.stdout:3/223: creat db/d12/f4f x:0 0 0 2024-08-31T05:21:13.974 INFO:tasks.workunit.client.1.smithi073.stdout:8/932: fdatasync d0/db/d1c/fba 0 2024-08-31T05:21:13.974 INFO:tasks.workunit.client.1.smithi073.stdout:0/968: rmdir d0/d15/d2c/d40/d4a/d6b/d12d 39 2024-08-31T05:21:13.976 INFO:tasks.workunit.client.0.smithi067.stdout:8/281: dwrite d0/d2/dc/f48 [0,4194304] 0 2024-08-31T05:21:13.977 INFO:tasks.workunit.client.1.smithi073.stdout:7/948: unlink d1/da/d65/c6c 0 2024-08-31T05:21:13.980 INFO:tasks.workunit.client.0.smithi067.stdout:2/220: dread db/d12/d1a/d1e/f21 [0,4194304] 0 2024-08-31T05:21:13.982 INFO:tasks.workunit.client.0.smithi067.stdout:9/148: mkdir dd/df/d31/d33 0 2024-08-31T05:21:13.984 INFO:tasks.workunit.client.0.smithi067.stdout:9/149: write dd/d20/f2f [136733,79032] 0 2024-08-31T05:21:13.985 INFO:tasks.workunit.client.0.smithi067.stdout:9/150: read - dd/d20/f2b zero size 2024-08-31T05:21:13.986 INFO:tasks.workunit.client.0.smithi067.stdout:9/151: read - dd/d20/f2b zero size 2024-08-31T05:21:13.986 INFO:tasks.workunit.client.0.smithi067.stdout:6/378: rename d1b/d23/d2e/d3b/f72 to d1b/d23/d28/d45/d5c/f75 0 2024-08-31T05:21:13.987 INFO:tasks.workunit.client.0.smithi067.stdout:9/152: write dd/df/f11 [3224719,68846] 0 2024-08-31T05:21:13.988 INFO:tasks.workunit.client.1.smithi073.stdout:4/878: mknod d7/df/d13/d53/d88/c116 0 2024-08-31T05:21:13.988 INFO:tasks.workunit.client.0.smithi067.stdout:9/153: dread - dd/df/f27 zero size 2024-08-31T05:21:13.991 INFO:tasks.workunit.client.1.smithi073.stdout:7/949: symlink d1/da/d15/d33/d44/d74/dd6/dea/d111/l12b 0 2024-08-31T05:21:13.992 INFO:tasks.workunit.client.1.smithi073.stdout:6/886: dread d15/f102 [0,4194304] 0 2024-08-31T05:21:13.995 INFO:tasks.workunit.client.0.smithi067.stdout:9/154: unlink cb 0 2024-08-31T05:21:13.995 INFO:tasks.workunit.client.1.smithi073.stdout:1/929: sync 2024-08-31T05:21:13.996 INFO:tasks.workunit.client.1.smithi073.stdout:8/933: mknod d0/db/d1c/dda/d117/c127 0 2024-08-31T05:21:13.997 INFO:tasks.workunit.client.1.smithi073.stdout:8/934: readlink d0/db/d44/d72/d79/l10a 0 2024-08-31T05:21:14.000 INFO:tasks.workunit.client.1.smithi073.stdout:2/959: write d2/d9/d27/d76/d7e/fd6 [466784,18414] 0 2024-08-31T05:21:14.002 INFO:tasks.workunit.client.1.smithi073.stdout:1/930: symlink d5/d26/d54/db2/dd5/d3f/l11f 0 2024-08-31T05:21:14.002 INFO:tasks.workunit.client.1.smithi073.stdout:2/960: read d2/d9/df/d43/d88/f100 [545101,55245] 0 2024-08-31T05:21:14.003 INFO:tasks.workunit.client.1.smithi073.stdout:2/961: readlink d2/d9/d7f/dab/l128 0 2024-08-31T05:21:14.003 INFO:tasks.workunit.client.0.smithi067.stdout:2/221: creat db/d12/d1a/f36 x:0 0 0 2024-08-31T05:21:14.003 INFO:tasks.workunit.client.1.smithi073.stdout:2/962: chown d2/d9/d7f/dab/daa/f119 247655 1 2024-08-31T05:21:14.005 INFO:tasks.workunit.client.1.smithi073.stdout:8/935: mkdir d0/db/d1c/d34/d38/d106/d128 0 2024-08-31T05:21:14.007 INFO:tasks.workunit.client.0.smithi067.stdout:2/222: symlink db/dd/d13/l37 0 2024-08-31T05:21:14.008 INFO:tasks.workunit.client.1.smithi073.stdout:0/969: write d0/d28/fc1 [4800231,30363] 0 2024-08-31T05:21:14.008 INFO:tasks.workunit.client.0.smithi067.stdout:6/379: write d1b/d23/d28/f37 [1337588,6778] 0 2024-08-31T05:21:14.010 INFO:tasks.workunit.client.1.smithi073.stdout:0/970: write d0/d69/d7f/d62/dbf/f141 [406370,59360] 0 2024-08-31T05:21:14.011 INFO:tasks.workunit.client.1.smithi073.stdout:6/887: creat d15/d1a/d51/d61/ddc/d12a/f12b x:0 0 0 2024-08-31T05:21:14.012 INFO:tasks.workunit.client.0.smithi067.stdout:3/224: truncate f4 4992288 0 2024-08-31T05:21:14.013 INFO:tasks.workunit.client.1.smithi073.stdout:2/963: symlink d2/d9/d7f/dab/daa/df5/l12a 0 2024-08-31T05:21:14.013 INFO:tasks.workunit.client.0.smithi067.stdout:6/380: rmdir d1b/d23/d61 39 2024-08-31T05:21:14.014 INFO:tasks.workunit.client.1.smithi073.stdout:4/879: dwrite d7/df/d13/d2e/d47/d4c/d73/f84 [0,4194304] 0 2024-08-31T05:21:14.015 INFO:tasks.workunit.client.1.smithi073.stdout:8/936: symlink d0/db/d1c/d2a/l129 0 2024-08-31T05:21:14.015 INFO:tasks.workunit.client.0.smithi067.stdout:9/155: getdents dd/df/d31 0 2024-08-31T05:21:14.020 INFO:tasks.workunit.client.1.smithi073.stdout:1/931: link d5/d26/d54/db2/fe7 d5/d26/d54/d5f/f120 0 2024-08-31T05:21:14.020 INFO:tasks.workunit.client.1.smithi073.stdout:4/880: dwrite d7/df/d13/fcf [0,4194304] 0 2024-08-31T05:21:14.020 INFO:tasks.workunit.client.0.smithi067.stdout:6/381: truncate f9 404224 0 2024-08-31T05:21:14.022 INFO:tasks.workunit.client.1.smithi073.stdout:6/888: symlink d15/d17/da1/l12c 0 2024-08-31T05:21:14.025 INFO:tasks.workunit.client.1.smithi073.stdout:2/964: rename d2/d9/d7f/d11d to d2/d9/d27/d76/ddf/d12b 0 2024-08-31T05:21:14.028 INFO:tasks.workunit.client.1.smithi073.stdout:7/950: getdents d1/da/d15/d33/d44/d74/dd6/de3/d108 0 2024-08-31T05:21:14.029 INFO:tasks.workunit.client.1.smithi073.stdout:7/951: chown d1/da/d15/d33/d44/d74/dd6/dea/dac/d103 1043 1 2024-08-31T05:21:14.030 INFO:tasks.workunit.client.0.smithi067.stdout:9/156: dwrite dd/f10 [0,4194304] 0 2024-08-31T05:21:14.030 INFO:tasks.workunit.client.1.smithi073.stdout:7/952: dread - d1/da/d15/d33/d44/d74/dd6/dea/f11c zero size 2024-08-31T05:21:14.031 INFO:tasks.workunit.client.0.smithi067.stdout:2/223: getdents db/d12/d1a/d2b 0 2024-08-31T05:21:14.031 INFO:tasks.workunit.client.0.smithi067.stdout:9/157: write dd/f2d [850281,111408] 0 2024-08-31T05:21:14.034 INFO:tasks.workunit.client.1.smithi073.stdout:4/881: read - d7/df/d13/d2e/d47/d4c/d73/f76 zero size 2024-08-31T05:21:14.035 INFO:tasks.workunit.client.0.smithi067.stdout:2/224: rmdir db/dd 39 2024-08-31T05:21:14.036 INFO:tasks.workunit.client.0.smithi067.stdout:2/225: write db/d12/d1a/d1e/f2f [146546,62395] 0 2024-08-31T05:21:14.039 INFO:tasks.workunit.client.1.smithi073.stdout:2/965: fsync d2/d9/d7f/f83 0 2024-08-31T05:21:14.041 INFO:tasks.workunit.client.1.smithi073.stdout:8/937: symlink d0/d62/db4/d111/l12a 0 2024-08-31T05:21:14.042 INFO:tasks.workunit.client.0.smithi067.stdout:2/226: mknod db/d12/d1a/d2b/c38 0 2024-08-31T05:21:14.043 INFO:tasks.workunit.client.1.smithi073.stdout:8/938: write d0/db/d1c/d34/d38/f108 [712156,82503] 0 2024-08-31T05:21:14.043 INFO:tasks.workunit.client.0.smithi067.stdout:2/227: chown db/l1b 197353 1 2024-08-31T05:21:14.046 INFO:tasks.workunit.client.1.smithi073.stdout:1/932: creat d5/d26/da5/dba/d1b/d88/f121 x:0 0 0 2024-08-31T05:21:14.048 INFO:tasks.workunit.client.1.smithi073.stdout:8/939: dread d0/db/d44/d4e/f63 [0,4194304] 0 2024-08-31T05:21:14.048 INFO:tasks.workunit.client.0.smithi067.stdout:2/228: creat db/d12/f39 x:0 0 0 2024-08-31T05:21:14.048 INFO:tasks.workunit.client.1.smithi073.stdout:8/940: stat d0/db/d1c/d24/f78 0 2024-08-31T05:21:14.049 INFO:tasks.workunit.client.0.smithi067.stdout:9/158: rmdir dd/df/d31/d33 0 2024-08-31T05:21:14.050 INFO:tasks.workunit.client.1.smithi073.stdout:4/882: mkdir d7/d1a/d5c/d6d/d59/d65/d117 0 2024-08-31T05:21:14.051 INFO:tasks.workunit.client.0.smithi067.stdout:9/159: dread dd/d20/f2f [0,4194304] 0 2024-08-31T05:21:14.051 INFO:tasks.workunit.client.1.smithi073.stdout:0/971: dwrite d0/d15/d2c/d41/faf [0,4194304] 0 2024-08-31T05:21:14.051 INFO:tasks.workunit.client.1.smithi073.stdout:6/889: getdents d15/d1a/d2b/d2f/d4b/d97/de6 0 2024-08-31T05:21:14.052 INFO:tasks.workunit.client.0.smithi067.stdout:9/160: stat dd/f2d 0 2024-08-31T05:21:14.052 INFO:tasks.workunit.client.0.smithi067.stdout:9/161: chown l8 649813650 1 2024-08-31T05:21:14.053 INFO:tasks.workunit.client.1.smithi073.stdout:4/883: write d7/d1a/fa0 [518217,19989] 0 2024-08-31T05:21:14.053 INFO:tasks.workunit.client.1.smithi073.stdout:2/966: rmdir d2/d9/d27/d76/d7e/db4 39 2024-08-31T05:21:14.058 INFO:tasks.workunit.client.1.smithi073.stdout:6/890: dread d15/d17/da1/dae/db0/d38/d9b/d87/fb5 [0,4194304] 0 2024-08-31T05:21:14.059 INFO:tasks.workunit.client.0.smithi067.stdout:9/162: creat dd/df/d25/f34 x:0 0 0 2024-08-31T05:21:14.062 INFO:tasks.workunit.client.0.smithi067.stdout:6/382: dread f14 [0,4194304] 0 2024-08-31T05:21:14.064 INFO:tasks.workunit.client.0.smithi067.stdout:3/225: dread f4 [0,4194304] 0 2024-08-31T05:21:14.064 INFO:tasks.workunit.client.1.smithi073.stdout:8/941: mkdir d0/db/d1c/d34/d68/d9d/d12b 0 2024-08-31T05:21:14.066 INFO:tasks.workunit.client.1.smithi073.stdout:7/953: truncate d1/da/f94 967394 0 2024-08-31T05:21:14.067 INFO:tasks.workunit.client.0.smithi067.stdout:2/229: fsync db/d12/f23 0 2024-08-31T05:21:14.069 INFO:tasks.workunit.client.0.smithi067.stdout:6/383: dwrite d1b/f43 [4194304,4194304] 0 2024-08-31T05:21:14.070 INFO:tasks.workunit.client.1.smithi073.stdout:8/942: dwrite d0/db/d44/d72/d75/fe9 [0,4194304] 0 2024-08-31T05:21:14.071 INFO:tasks.workunit.client.0.smithi067.stdout:9/163: mknod dd/c35 0 2024-08-31T05:21:14.072 INFO:tasks.workunit.client.1.smithi073.stdout:8/943: stat d0/db/d44/d72/d75/fd5 0 2024-08-31T05:21:14.074 INFO:tasks.workunit.client.1.smithi073.stdout:0/972: creat d0/d69/d7f/d68/d91/df5/d3c/d9c/db6/dc6/d135/f14a x:0 0 0 2024-08-31T05:21:14.075 INFO:tasks.workunit.client.0.smithi067.stdout:2/230: fdatasync db/dd/f33 0 2024-08-31T05:21:14.076 INFO:tasks.workunit.client.0.smithi067.stdout:2/231: truncate db/dd/f33 995795 0 2024-08-31T05:21:14.078 INFO:tasks.workunit.client.1.smithi073.stdout:8/944: dread d0/db/d1c/d34/d38/f108 [0,4194304] 0 2024-08-31T05:21:14.080 INFO:tasks.workunit.client.0.smithi067.stdout:6/384: creat d1b/d23/d28/d45/d5c/f76 x:0 0 0 2024-08-31T05:21:14.080 INFO:tasks.workunit.client.0.smithi067.stdout:6/385: read - d1b/f74 zero size 2024-08-31T05:21:14.081 INFO:tasks.workunit.client.1.smithi073.stdout:7/954: symlink d1/da/d3e/d22/d6b/l12c 0 2024-08-31T05:21:14.082 INFO:tasks.workunit.client.1.smithi073.stdout:0/973: dwrite d0/d28/f2d [4194304,4194304] 0 2024-08-31T05:21:14.083 INFO:tasks.workunit.client.0.smithi067.stdout:3/226: rename db/d12/d39 to db/d2e/d50 0 2024-08-31T05:21:14.084 INFO:tasks.workunit.client.1.smithi073.stdout:0/974: truncate d0/d15/d9b/fe5 249028 0 2024-08-31T05:21:14.084 INFO:tasks.workunit.client.1.smithi073.stdout:4/884: truncate d7/db/f77 838834 0 2024-08-31T05:21:14.085 INFO:tasks.workunit.client.1.smithi073.stdout:4/885: chown d7/d1a/d5c/d6d/d59/d65 2489987 1 2024-08-31T05:21:14.086 INFO:tasks.workunit.client.1.smithi073.stdout:2/967: rmdir d2/d9/d66/d70/dc9 39 2024-08-31T05:21:14.087 INFO:tasks.workunit.client.1.smithi073.stdout:2/968: fsync d2/f105 0 2024-08-31T05:21:14.090 INFO:tasks.workunit.client.0.smithi067.stdout:6/386: truncate d1b/d23/d28/f39 4040434 0 2024-08-31T05:21:14.090 INFO:tasks.workunit.client.0.smithi067.stdout:6/387: read fd [660256,126226] 0 2024-08-31T05:21:14.092 INFO:tasks.workunit.client.1.smithi073.stdout:8/945: creat d0/db/d1c/d34/d38/d106/f12c x:0 0 0 2024-08-31T05:21:14.093 INFO:tasks.workunit.client.0.smithi067.stdout:2/232: creat db/f3a x:0 0 0 2024-08-31T05:21:14.093 INFO:tasks.workunit.client.1.smithi073.stdout:7/955: creat d1/da/d96/f12d x:0 0 0 2024-08-31T05:21:14.095 INFO:tasks.workunit.client.1.smithi073.stdout:0/975: symlink d0/d15/d9b/l14b 0 2024-08-31T05:21:14.098 INFO:tasks.workunit.client.1.smithi073.stdout:2/969: mkdir d2/d9/d3c/d122/d12c 0 2024-08-31T05:21:14.099 INFO:tasks.workunit.client.1.smithi073.stdout:2/970: write d2/d9/d27/d76/ff9 [69615,30414] 0 2024-08-31T05:21:14.099 INFO:tasks.workunit.client.0.smithi067.stdout:6/388: mkdir d1b/d23/d61/d77 0 2024-08-31T05:21:14.101 INFO:tasks.workunit.client.1.smithi073.stdout:6/891: rename d15/d1a/d2b/d2f/d99/d9e to d15/d1a/d2b/d12d 0 2024-08-31T05:21:14.102 INFO:tasks.workunit.client.0.smithi067.stdout:2/233: mkdir db/d12/d24/d3b 0 2024-08-31T05:21:14.102 INFO:tasks.workunit.client.1.smithi073.stdout:1/933: getdents d5/d26/d54/db2/dd5/d2a/d80 0 2024-08-31T05:21:14.103 INFO:tasks.workunit.client.1.smithi073.stdout:8/946: fdatasync d0/db/d1c/d23/fc9 0 2024-08-31T05:21:14.104 INFO:tasks.workunit.client.0.smithi067.stdout:2/234: chown db/d12/d1a/f1f 2231 1 2024-08-31T05:21:14.104 INFO:tasks.workunit.client.1.smithi073.stdout:7/956: mkdir d1/da/d3e/db1/d12e 0 2024-08-31T05:21:14.105 INFO:tasks.workunit.client.1.smithi073.stdout:7/957: fdatasync d1/da/d3e/d22/d6b/ddf/de2/f114 0 2024-08-31T05:21:14.106 INFO:tasks.workunit.client.1.smithi073.stdout:7/958: write d1/da/d65/fe9 [1419372,740] 0 2024-08-31T05:21:14.106 INFO:tasks.workunit.client.0.smithi067.stdout:6/389: truncate d1b/d23/f4f 4075242 0 2024-08-31T05:21:14.107 INFO:tasks.workunit.client.1.smithi073.stdout:2/971: creat d2/d9/d3c/f12d x:0 0 0 2024-08-31T05:21:14.110 INFO:tasks.workunit.client.1.smithi073.stdout:4/886: rename d7/df/d13/f16 to d7/df/d13/d53/d88/dc7/f118 0 2024-08-31T05:21:14.111 INFO:tasks.workunit.client.1.smithi073.stdout:6/892: mkdir d15/d1a/d51/d6e/d12e 0 2024-08-31T05:21:14.111 INFO:tasks.workunit.client.1.smithi073.stdout:4/887: chown d7/d1a/l5a 2 1 2024-08-31T05:21:14.114 INFO:tasks.workunit.client.1.smithi073.stdout:2/972: dwrite d2/d9/d3c/ffb [0,4194304] 0 2024-08-31T05:21:14.114 INFO:tasks.workunit.client.1.smithi073.stdout:4/888: write d7/df/d13/d53/d88/fe0 [543657,119461] 0 2024-08-31T05:21:14.115 INFO:tasks.workunit.client.0.smithi067.stdout:6/390: mkdir d1b/d40/d70/d71/d78 0 2024-08-31T05:21:14.116 INFO:tasks.workunit.client.1.smithi073.stdout:0/976: getdents d0/d69/d11c 0 2024-08-31T05:21:14.117 INFO:tasks.workunit.client.1.smithi073.stdout:2/973: write d2/d9/f77 [680940,98215] 0 2024-08-31T05:21:14.123 INFO:tasks.workunit.client.0.smithi067.stdout:2/235: dread db/dd/f11 [0,4194304] 0 2024-08-31T05:21:14.124 INFO:tasks.workunit.client.1.smithi073.stdout:6/893: mknod d15/d17/c12f 0 2024-08-31T05:21:14.124 INFO:tasks.workunit.client.1.smithi073.stdout:6/894: chown d15/d1a/d2b/d2f/d4b/d88/d9f/l129 7 1 2024-08-31T05:21:14.126 INFO:tasks.workunit.client.0.smithi067.stdout:3/227: truncate db/f10 377887 0 2024-08-31T05:21:14.129 INFO:tasks.workunit.client.0.smithi067.stdout:2/236: mknod db/d12/d24/c3c 0 2024-08-31T05:21:14.130 INFO:tasks.workunit.client.1.smithi073.stdout:7/959: mkdir d1/da/d3e/db1/d12e/d12f 0 2024-08-31T05:21:14.131 INFO:tasks.workunit.client.1.smithi073.stdout:7/960: write d1/da/d3e/d22/d47/fa1 [2950855,16820] 0 2024-08-31T05:21:14.132 INFO:tasks.workunit.client.0.smithi067.stdout:6/391: getdents d1b/d23/d2e 0 2024-08-31T05:21:14.134 INFO:tasks.workunit.client.1.smithi073.stdout:1/934: dread d5/d26/da5/dba/f28 [0,4194304] 0 2024-08-31T05:21:14.136 INFO:tasks.workunit.client.0.smithi067.stdout:2/237: mkdir db/d12/d1a/d2b/d3d 0 2024-08-31T05:21:14.136 INFO:tasks.workunit.client.0.smithi067.stdout:2/238: chown db/d12/d1a/d1e 6334967 1 2024-08-31T05:21:14.138 INFO:tasks.workunit.client.1.smithi073.stdout:4/889: mkdir d7/d1a/d5c/d119 0 2024-08-31T05:21:14.143 INFO:tasks.workunit.client.1.smithi073.stdout:2/974: mknod d2/d9/d112/c12e 0 2024-08-31T05:21:14.145 INFO:tasks.workunit.client.1.smithi073.stdout:6/895: mkdir d15/d17/da1/dae/db0/de1/d130 0 2024-08-31T05:21:14.147 INFO:tasks.workunit.client.0.smithi067.stdout:2/239: mknod db/d12/d24/d3b/c3e 0 2024-08-31T05:21:14.148 INFO:tasks.workunit.client.0.smithi067.stdout:3/228: getdents db/d2e/d43 0 2024-08-31T05:21:14.148 INFO:tasks.workunit.client.1.smithi073.stdout:8/947: dwrite d0/db/d44/f70 [0,4194304] 0 2024-08-31T05:21:14.149 INFO:tasks.workunit.client.1.smithi073.stdout:1/935: mkdir d5/d26/da5/dba/d1b/dd8/d122 0 2024-08-31T05:21:14.152 INFO:tasks.workunit.client.0.smithi067.stdout:2/240: mknod db/dd/c3f 0 2024-08-31T05:21:14.160 INFO:tasks.workunit.client.1.smithi073.stdout:0/977: getdents d0/d15/d9b 0 2024-08-31T05:21:14.161 INFO:tasks.workunit.client.0.smithi067.stdout:6/392: truncate d1b/d30/f73 2670195 0 2024-08-31T05:21:14.161 INFO:tasks.workunit.client.1.smithi073.stdout:8/948: readlink d0/db/d1c/d23/l3a 0 2024-08-31T05:21:14.161 INFO:tasks.workunit.client.0.smithi067.stdout:2/241: dwrite db/dd/d2d/f35 [0,4194304] 0 2024-08-31T05:21:14.162 INFO:tasks.workunit.client.0.smithi067.stdout:3/229: dread db/d12/f18 [4194304,4194304] 0 2024-08-31T05:21:14.163 INFO:tasks.workunit.client.0.smithi067.stdout:2/242: write db/dd/f17 [2680755,20981] 0 2024-08-31T05:21:14.163 INFO:tasks.workunit.client.1.smithi073.stdout:4/890: write d7/d1a/d5c/d6d/d59/f110 [96517,62174] 0 2024-08-31T05:21:14.164 INFO:tasks.workunit.client.1.smithi073.stdout:0/978: dwrite d0/d15/d2c/f115 [0,4194304] 0 2024-08-31T05:21:14.168 INFO:tasks.workunit.client.0.smithi067.stdout:3/230: fsync f6 0 2024-08-31T05:21:14.171 INFO:tasks.workunit.client.0.smithi067.stdout:2/243: read db/dd/d13/f29 [2460210,86634] 0 2024-08-31T05:21:14.171 INFO:tasks.workunit.client.0.smithi067.stdout:3/231: write db/d12/f36 [412696,18126] 0 2024-08-31T05:21:14.171 INFO:tasks.workunit.client.1.smithi073.stdout:2/975: link d2/d9/l10f d2/d9/d112/l12f 0 2024-08-31T05:21:14.172 INFO:tasks.workunit.client.1.smithi073.stdout:4/891: read d7/df/fc2 [210093,44324] 0 2024-08-31T05:21:14.174 INFO:tasks.workunit.client.1.smithi073.stdout:0/979: fdatasync d0/d69/d7f/d68/d91/df5/d3c/d9c/dc8/fff 0 2024-08-31T05:21:14.175 INFO:tasks.workunit.client.1.smithi073.stdout:8/949: dread d0/db/d44/f84 [0,4194304] 0 2024-08-31T05:21:14.176 INFO:tasks.workunit.client.1.smithi073.stdout:6/896: getdents d15/d1a/d2b/d2f/d4b/d88 0 2024-08-31T05:21:14.177 INFO:tasks.workunit.client.1.smithi073.stdout:1/936: dwrite d5/d26/d54/db2/dd5/d32/d37/d6f/fab [0,4194304] 0 2024-08-31T05:21:14.178 INFO:tasks.workunit.client.0.smithi067.stdout:3/232: getdents db/d17/d3f 0 2024-08-31T05:21:14.180 INFO:tasks.workunit.client.0.smithi067.stdout:2/244: getdents db/d12/d1a/d1e 0 2024-08-31T05:21:14.180 INFO:tasks.workunit.client.1.smithi073.stdout:2/976: creat d2/d9/d7f/dab/daa/f130 x:0 0 0 2024-08-31T05:21:14.181 INFO:tasks.workunit.client.1.smithi073.stdout:2/977: read d2/d9/d7f/dab/d5d/f71 [128307,88378] 0 2024-08-31T05:21:14.182 INFO:tasks.workunit.client.1.smithi073.stdout:4/892: unlink d7/d1a/d5c/d6d/f106 0 2024-08-31T05:21:14.183 INFO:tasks.workunit.client.1.smithi073.stdout:6/897: creat d15/d41/d89/f131 x:0 0 0 2024-08-31T05:21:14.183 INFO:tasks.workunit.client.1.smithi073.stdout:2/978: write d2/d9/df/f62 [2763313,33769] 0 2024-08-31T05:21:14.184 INFO:tasks.workunit.client.1.smithi073.stdout:1/937: fsync d5/d26/da5/dba/d1b/f41 0 2024-08-31T05:21:14.186 INFO:tasks.workunit.client.0.smithi067.stdout:3/233: creat db/d4e/f51 x:0 0 0 2024-08-31T05:21:14.187 INFO:tasks.workunit.client.0.smithi067.stdout:2/245: dwrite f4 [0,4194304] 0 2024-08-31T05:21:14.188 INFO:tasks.workunit.client.0.smithi067.stdout:2/246: chown db 34 1 2024-08-31T05:21:14.190 INFO:tasks.workunit.client.1.smithi073.stdout:6/898: dwrite d15/d17/da1/dae/db0/d38/f62 [0,4194304] 0 2024-08-31T05:21:14.196 INFO:tasks.workunit.client.1.smithi073.stdout:8/950: creat d0/db/d1c/d34/d38/d106/d128/f12d x:0 0 0 2024-08-31T05:21:14.197 INFO:tasks.workunit.client.1.smithi073.stdout:1/938: creat d5/d26/da5/dba/d1b/d88/f123 x:0 0 0 2024-08-31T05:21:14.198 INFO:tasks.workunit.client.0.smithi067.stdout:3/234: write db/f10 [1261629,89918] 0 2024-08-31T05:21:14.198 INFO:tasks.workunit.client.1.smithi073.stdout:8/951: read d0/db/d44/d4e/f63 [202731,66783] 0 2024-08-31T05:21:14.199 INFO:tasks.workunit.client.0.smithi067.stdout:3/235: stat db/f3d 0 2024-08-31T05:21:14.200 INFO:tasks.workunit.client.1.smithi073.stdout:2/979: symlink d2/d25/d92/d124/l131 0 2024-08-31T05:21:14.200 INFO:tasks.workunit.client.1.smithi073.stdout:8/952: chown d0/db/d1c/d34/d38/d106/d128/f12d 598863 1 2024-08-31T05:21:14.201 INFO:tasks.workunit.client.0.smithi067.stdout:2/247: getdents db/d12/d24 0 2024-08-31T05:21:14.202 INFO:tasks.workunit.client.1.smithi073.stdout:8/953: fdatasync d0/db/d44/d72/d75/d7e/d91/f11d 0 2024-08-31T05:21:14.202 INFO:tasks.workunit.client.0.smithi067.stdout:2/248: stat db/dd/d13/f29 0 2024-08-31T05:21:14.202 INFO:tasks.workunit.client.1.smithi073.stdout:1/939: symlink d5/d26/d54/l124 0 2024-08-31T05:21:14.206 INFO:tasks.workunit.client.1.smithi073.stdout:6/899: creat d15/d1a/d2b/d2f/d4b/dff/f132 x:0 0 0 2024-08-31T05:21:14.208 INFO:tasks.workunit.client.0.smithi067.stdout:2/249: mkdir db/d12/d1a/d2b/d40 0 2024-08-31T05:21:14.209 INFO:tasks.workunit.client.0.smithi067.stdout:6/393: write f14 [2899121,19547] 0 2024-08-31T05:21:14.210 INFO:tasks.workunit.client.1.smithi073.stdout:2/980: creat d2/d9/d27/d117/dc6/dd1/f132 x:0 0 0 2024-08-31T05:21:14.211 INFO:tasks.workunit.client.0.smithi067.stdout:3/236: creat db/d12/d21/f52 x:0 0 0 2024-08-31T05:21:14.215 INFO:tasks.workunit.client.1.smithi073.stdout:8/954: creat d0/db/d1c/dda/f12e x:0 0 0 2024-08-31T05:21:14.218 INFO:tasks.workunit.client.0.smithi067.stdout:3/237: dwrite db/d12/d21/f52 [0,4194304] 0 2024-08-31T05:21:14.221 INFO:tasks.workunit.client.0.smithi067.stdout:2/250: getdents db/d12/d1a/d2b/d40 0 2024-08-31T05:21:14.222 INFO:tasks.workunit.client.1.smithi073.stdout:2/981: mkdir d2/d9/d3c/d122/d133 0 2024-08-31T05:21:14.224 INFO:tasks.workunit.client.1.smithi073.stdout:8/955: symlink d0/d62/db4/de7/l12f 0 2024-08-31T05:21:14.225 INFO:tasks.workunit.client.1.smithi073.stdout:8/956: write d0/db/d1c/d34/d68/fd9 [597219,23864] 0 2024-08-31T05:21:14.229 INFO:tasks.workunit.client.0.smithi067.stdout:2/251: rename db/d12/f16 to db/dd/d2d/f41 0 2024-08-31T05:21:14.231 INFO:tasks.workunit.client.0.smithi067.stdout:3/238: creat db/f53 x:0 0 0 2024-08-31T05:21:14.231 INFO:tasks.workunit.client.1.smithi073.stdout:6/900: link d15/d1a/d2b/d2f/d4b/d88/c11c d15/d1a/d2b/d2f/d99/db3/c133 0 2024-08-31T05:21:14.234 INFO:tasks.workunit.client.1.smithi073.stdout:0/980: truncate d0/d69/d7f/d68/d91/df5/d3c/d9c/db6/ff3 71379 0 2024-08-31T05:21:14.235 INFO:tasks.workunit.client.1.smithi073.stdout:0/981: readlink d0/d69/d7f/d68/d91/df5/l39 0 2024-08-31T05:21:14.235 INFO:tasks.workunit.client.1.smithi073.stdout:4/893: truncate d7/df/d13/f9e 3077476 0 2024-08-31T05:21:14.236 INFO:tasks.workunit.client.1.smithi073.stdout:6/901: creat d15/d1a/d51/d61/ddc/f134 x:0 0 0 2024-08-31T05:21:14.236 INFO:tasks.workunit.client.1.smithi073.stdout:4/894: dread - d7/d1a/d5c/fdb zero size 2024-08-31T05:21:14.237 INFO:tasks.workunit.client.0.smithi067.stdout:3/239: mkdir db/d17/d3f/d54 0 2024-08-31T05:21:14.237 INFO:tasks.workunit.client.0.smithi067.stdout:3/240: stat db/d17 0 2024-08-31T05:21:14.237 INFO:tasks.workunit.client.1.smithi073.stdout:4/895: chown d7/df/d13/d53/f80 2 1 2024-08-31T05:21:14.238 INFO:tasks.workunit.client.0.smithi067.stdout:3/241: truncate db/d2c/f48 330123 0 2024-08-31T05:21:14.238 INFO:tasks.workunit.client.1.smithi073.stdout:4/896: dread - d7/df/d13/d2e/d47/d4c/d73/f76 zero size 2024-08-31T05:21:14.241 INFO:tasks.workunit.client.1.smithi073.stdout:1/940: dread d5/d26/d54/d9e/fc0 [0,4194304] 0 2024-08-31T05:21:14.242 INFO:tasks.workunit.client.0.smithi067.stdout:6/394: write d1b/d23/f34 [3067040,94811] 0 2024-08-31T05:21:14.243 INFO:tasks.workunit.client.1.smithi073.stdout:0/982: symlink d0/d69/d7f/d62/l14c 0 2024-08-31T05:21:14.243 INFO:tasks.workunit.client.1.smithi073.stdout:4/897: truncate d7/df/d13/d2e/d70/d6b/fee 337335 0 2024-08-31T05:21:14.244 INFO:tasks.workunit.client.1.smithi073.stdout:4/898: stat d7/db/f69 0 2024-08-31T05:21:14.244 INFO:tasks.workunit.client.0.smithi067.stdout:3/242: mkdir db/d55 0 2024-08-31T05:21:14.245 INFO:tasks.workunit.client.1.smithi073.stdout:1/941: fdatasync d5/d26/da5/dba/d33/f36 0 2024-08-31T05:21:14.246 INFO:tasks.workunit.client.0.smithi067.stdout:6/395: creat d1b/d23/d2f/f79 x:0 0 0 2024-08-31T05:21:14.247 INFO:tasks.workunit.client.1.smithi073.stdout:2/982: dread d2/d9/d7f/dab/d5d/da1/fb2 [0,4194304] 0 2024-08-31T05:21:14.249 INFO:tasks.workunit.client.1.smithi073.stdout:1/942: fsync d5/d26/d54/db2/dd5/d3f/f96 0 2024-08-31T05:21:14.252 INFO:tasks.workunit.client.1.smithi073.stdout:0/983: dwrite d0/d15/d2c/d41/faf [0,4194304] 0 2024-08-31T05:21:14.252 INFO:tasks.workunit.client.0.smithi067.stdout:3/243: mkdir db/d17/d3f/d54/d56 0 2024-08-31T05:21:14.254 INFO:tasks.workunit.client.1.smithi073.stdout:7/961: sync 2024-08-31T05:21:14.254 INFO:tasks.workunit.client.1.smithi073.stdout:4/899: dread d7/df/fc2 [0,4194304] 0 2024-08-31T05:21:14.256 INFO:tasks.workunit.client.1.smithi073.stdout:4/900: stat d7/df/d1b/f1f 0 2024-08-31T05:21:14.257 INFO:tasks.workunit.client.0.smithi067.stdout:6/396: mkdir d1b/d7a 0 2024-08-31T05:21:14.258 INFO:tasks.workunit.client.1.smithi073.stdout:6/902: dread d15/f36 [0,4194304] 0 2024-08-31T05:21:14.258 INFO:tasks.workunit.client.1.smithi073.stdout:4/901: dread - d7/df/d13/d53/d88/dc7/f115 zero size 2024-08-31T05:21:14.261 INFO:tasks.workunit.client.1.smithi073.stdout:8/957: truncate d0/fe 1906284 0 2024-08-31T05:21:14.262 INFO:tasks.workunit.client.0.smithi067.stdout:2/252: mkdir db/d12/d1a/d2b/d42 0 2024-08-31T05:21:14.264 INFO:tasks.workunit.client.1.smithi073.stdout:2/983: dread d2/d9/d27/d9b/da6/fcf [0,4194304] 0 2024-08-31T05:21:14.265 INFO:tasks.workunit.client.1.smithi073.stdout:2/984: fdatasync d2/f35 0 2024-08-31T05:21:14.265 INFO:tasks.workunit.client.0.smithi067.stdout:2/253: symlink db/dd/d2d/l43 0 2024-08-31T05:21:14.266 INFO:tasks.workunit.client.1.smithi073.stdout:0/984: dread d0/d15/d2c/d41/de8/fee [0,4194304] 0 2024-08-31T05:21:14.266 INFO:tasks.workunit.client.1.smithi073.stdout:6/903: mknod d15/d1a/d51/d6e/ddb/c135 0 2024-08-31T05:21:14.267 INFO:tasks.workunit.client.0.smithi067.stdout:2/254: dread db/dd/f33 [0,4194304] 0 2024-08-31T05:21:14.267 INFO:tasks.workunit.client.0.smithi067.stdout:2/255: chown db 3070 1 2024-08-31T05:21:14.268 INFO:tasks.workunit.client.0.smithi067.stdout:3/244: creat db/f57 x:0 0 0 2024-08-31T05:21:14.269 INFO:tasks.workunit.client.0.smithi067.stdout:3/245: write db/d12/f36 [311533,84049] 0 2024-08-31T05:21:14.272 INFO:tasks.workunit.client.1.smithi073.stdout:1/943: write d5/d26/da5/dba/d1c/f50 [830650,116586] 0 2024-08-31T05:21:14.276 INFO:tasks.workunit.client.1.smithi073.stdout:0/985: creat d0/d58/d63/f14d x:0 0 0 2024-08-31T05:21:14.278 INFO:tasks.workunit.client.1.smithi073.stdout:6/904: creat d15/d1a/d2b/d12d/f136 x:0 0 0 2024-08-31T05:21:14.278 INFO:tasks.workunit.client.0.smithi067.stdout:0/219: sync 2024-08-31T05:21:14.279 INFO:tasks.workunit.client.1.smithi073.stdout:4/902: dread d7/df/d13/d2e/d47/d4c/d73/f87 [0,4194304] 0 2024-08-31T05:21:14.280 INFO:tasks.workunit.client.0.smithi067.stdout:0/220: write d1/dd/d18/f3e [2738937,124021] 0 2024-08-31T05:21:14.280 INFO:tasks.workunit.client.1.smithi073.stdout:8/958: mknod d0/db/d44/d4e/c130 0 2024-08-31T05:21:14.281 INFO:tasks.workunit.client.0.smithi067.stdout:2/256: creat db/d12/f44 x:0 0 0 2024-08-31T05:21:14.285 INFO:tasks.workunit.client.0.smithi067.stdout:3/246: rename db/d12/d21/f33 to db/d12/f58 0 2024-08-31T05:21:14.287 INFO:tasks.workunit.client.1.smithi073.stdout:7/962: dread d1/da/d3e/d22/d35/f9c [0,4194304] 0 2024-08-31T05:21:14.288 INFO:tasks.workunit.client.0.smithi067.stdout:2/257: dwrite f4 [4194304,4194304] 0 2024-08-31T05:21:14.289 INFO:tasks.workunit.client.1.smithi073.stdout:0/986: read - d0/d15/d2c/d40/d4a/f64 zero size 2024-08-31T05:21:14.289 INFO:tasks.workunit.client.1.smithi073.stdout:0/987: chown d0/d69/d7f/d62/dbf 15 1 2024-08-31T05:21:14.290 INFO:tasks.workunit.client.1.smithi073.stdout:0/988: readlink d0/d15/d2c/l4c 0 2024-08-31T05:21:14.294 INFO:tasks.workunit.client.0.smithi067.stdout:0/221: read d1/d8/f35 [1077893,99672] 0 2024-08-31T05:21:14.295 INFO:tasks.workunit.client.0.smithi067.stdout:0/222: chown d1/df/d17/d43/d48 11196 1 2024-08-31T05:21:14.295 INFO:tasks.workunit.client.1.smithi073.stdout:8/959: creat d0/d62/f131 x:0 0 0 2024-08-31T05:21:14.296 INFO:tasks.workunit.client.0.smithi067.stdout:2/258: write db/dd/d13/f28 [561997,980] 0 2024-08-31T05:21:14.296 INFO:tasks.workunit.client.0.smithi067.stdout:0/223: truncate d1/dd/f3d 245758 0 2024-08-31T05:21:14.298 INFO:tasks.workunit.client.0.smithi067.stdout:0/224: write d1/df/f1d [7314637,75123] 0 2024-08-31T05:21:14.298 INFO:tasks.workunit.client.0.smithi067.stdout:3/247: symlink db/d2e/d50/d4a/l59 0 2024-08-31T05:21:14.299 INFO:tasks.workunit.client.1.smithi073.stdout:1/944: write d5/d26/d54/db2/dd5/f57 [2469584,115605] 0 2024-08-31T05:21:14.302 INFO:tasks.workunit.client.0.smithi067.stdout:2/259: write db/d12/f1c [3424401,121960] 0 2024-08-31T05:21:14.306 INFO:tasks.workunit.client.1.smithi073.stdout:0/989: creat d0/d15/d2c/d40/d4a/f14e x:0 0 0 2024-08-31T05:21:14.307 INFO:tasks.workunit.client.1.smithi073.stdout:7/963: dread d1/da/d15/f21 [0,4194304] 0 2024-08-31T05:21:14.309 INFO:tasks.workunit.client.1.smithi073.stdout:8/960: rmdir d0/da8 39 2024-08-31T05:21:14.310 INFO:tasks.workunit.client.1.smithi073.stdout:4/903: dwrite d7/db/fc0 [0,4194304] 0 2024-08-31T05:21:14.310 INFO:tasks.workunit.client.1.smithi073.stdout:6/905: truncate d15/d75/f85 3680156 0 2024-08-31T05:21:14.312 INFO:tasks.workunit.client.0.smithi067.stdout:3/248: mkdir db/d5a 0 2024-08-31T05:21:14.313 INFO:tasks.workunit.client.0.smithi067.stdout:0/225: write d1/df/d17/f20 [3359519,16409] 0 2024-08-31T05:21:14.314 INFO:tasks.workunit.client.0.smithi067.stdout:3/249: read - db/d12/d21/f26 zero size 2024-08-31T05:21:14.315 INFO:tasks.workunit.client.0.smithi067.stdout:3/250: dread db/d17/f24 [0,4194304] 0 2024-08-31T05:21:14.317 INFO:tasks.workunit.client.0.smithi067.stdout:3/251: readlink db/l29 0 2024-08-31T05:21:14.317 INFO:tasks.workunit.client.0.smithi067.stdout:2/260: write db/dd/f15 [940624,69951] 0 2024-08-31T05:21:14.320 INFO:tasks.workunit.client.1.smithi073.stdout:8/961: mkdir d0/d62/d132 0 2024-08-31T05:21:14.321 INFO:tasks.workunit.client.1.smithi073.stdout:7/964: creat d1/da/d15/d33/d44/d74/dd6/dea/dac/d103/f130 x:0 0 0 2024-08-31T05:21:14.322 INFO:tasks.workunit.client.0.smithi067.stdout:3/252: mknod db/d4e/c5b 0 2024-08-31T05:21:14.323 INFO:tasks.workunit.client.0.smithi067.stdout:3/253: write db/f3d [734808,95580] 0 2024-08-31T05:21:14.324 INFO:tasks.workunit.client.1.smithi073.stdout:4/904: dread d7/f12 [0,4194304] 0 2024-08-31T05:21:14.324 INFO:tasks.workunit.client.1.smithi073.stdout:6/906: unlink d15/d1a/d2b/d2f/d4b/f6b 0 2024-08-31T05:21:14.326 INFO:tasks.workunit.client.0.smithi067.stdout:0/226: link d1/f39 d1/df/d29/f49 0 2024-08-31T05:21:14.326 INFO:tasks.workunit.client.1.smithi073.stdout:1/945: mknod d5/d26/da5/dba/c125 0 2024-08-31T05:21:14.328 INFO:tasks.workunit.client.1.smithi073.stdout:1/946: dread - d5/d26/da5/dba/d1b/d88/f123 zero size 2024-08-31T05:21:14.329 INFO:tasks.workunit.client.0.smithi067.stdout:3/254: creat db/d2e/d50/f5c x:0 0 0 2024-08-31T05:21:14.329 INFO:tasks.workunit.client.0.smithi067.stdout:3/255: stat db/d2e/d43/c34 0 2024-08-31T05:21:14.330 INFO:tasks.workunit.client.0.smithi067.stdout:0/227: creat d1/d8/f4a x:0 0 0 2024-08-31T05:21:14.331 INFO:tasks.workunit.client.1.smithi073.stdout:4/905: chown d7/df/d1b/l100 1109 1 2024-08-31T05:21:14.331 INFO:tasks.workunit.client.0.smithi067.stdout:2/261: rename db/d12/d1a to db/d12/d1a/d45 22 2024-08-31T05:21:14.332 INFO:tasks.workunit.client.0.smithi067.stdout:3/256: mknod db/d17/c5d 0 2024-08-31T05:21:14.334 INFO:tasks.workunit.client.0.smithi067.stdout:0/228: rename d1/d8/f4a to d1/d8/f4b 0 2024-08-31T05:21:14.335 INFO:tasks.workunit.client.0.smithi067.stdout:2/262: dread db/dd/f11 [0,4194304] 0 2024-08-31T05:21:14.335 INFO:tasks.workunit.client.0.smithi067.stdout:2/263: fsync db/f3a 0 2024-08-31T05:21:14.336 INFO:tasks.workunit.client.0.smithi067.stdout:0/229: write d1/dd/f40 [972323,65009] 0 2024-08-31T05:21:14.340 INFO:tasks.workunit.client.0.smithi067.stdout:0/230: rename d1/dd/f3d to d1/df/d17/f4c 0 2024-08-31T05:21:14.340 INFO:tasks.workunit.client.0.smithi067.stdout:0/231: readlink d1/dd/d18/l32 0 2024-08-31T05:21:14.344 INFO:tasks.workunit.client.0.smithi067.stdout:2/264: creat db/d12/d1a/d2b/d3d/f46 x:0 0 0 2024-08-31T05:21:14.345 INFO:tasks.workunit.client.0.smithi067.stdout:0/232: unlink d1/dd/f40 0 2024-08-31T05:21:14.346 INFO:tasks.workunit.client.1.smithi073.stdout:7/965: symlink d1/da/d3e/d22/d5c/dc6/d10a/l131 0 2024-08-31T05:21:14.346 INFO:tasks.workunit.client.1.smithi073.stdout:1/947: mkdir d5/d26/da5/dba/d1c/d27/ded/d126 0 2024-08-31T05:21:14.346 INFO:tasks.workunit.client.0.smithi067.stdout:0/233: fsync d1/dd/d18/f41 0 2024-08-31T05:21:14.346 INFO:tasks.workunit.client.1.smithi073.stdout:6/907: creat d15/d1a/d51/d6e/d12e/f137 x:0 0 0 2024-08-31T05:21:14.347 INFO:tasks.workunit.client.0.smithi067.stdout:0/234: fsync d1/f2c 0 2024-08-31T05:21:14.351 INFO:tasks.workunit.client.1.smithi073.stdout:4/906: creat d7/d1a/d5c/d6d/d2c/d2d/da6/dde/de3/dd0/f11a x:0 0 0 2024-08-31T05:21:14.352 INFO:tasks.workunit.client.1.smithi073.stdout:0/990: dread d0/d69/d7f/d68/d91/df5/d3c/d9c/dc8/fe9 [0,4194304] 0 2024-08-31T05:21:14.353 INFO:tasks.workunit.client.1.smithi073.stdout:0/991: readlink d0/d69/d7f/d68/d91/df5/l104 0 2024-08-31T05:21:14.353 INFO:tasks.workunit.client.0.smithi067.stdout:0/235: dwrite d1/dd/d18/f41 [0,4194304] 0 2024-08-31T05:21:14.354 INFO:tasks.workunit.client.1.smithi073.stdout:1/948: unlink d5/d26/d54/db2/dd5/d3f/f96 0 2024-08-31T05:21:14.354 INFO:tasks.workunit.client.0.smithi067.stdout:0/236: truncate d1/f39 531800 0 2024-08-31T05:21:14.355 INFO:tasks.workunit.client.0.smithi067.stdout:0/237: stat d1/df/d29/d44 0 2024-08-31T05:21:14.355 INFO:tasks.workunit.client.0.smithi067.stdout:2/265: mknod db/d12/d1a/c47 0 2024-08-31T05:21:14.356 INFO:tasks.workunit.client.0.smithi067.stdout:0/238: write d1/df/f1d [6085351,120754] 0 2024-08-31T05:21:14.356 INFO:tasks.workunit.client.0.smithi067.stdout:2/266: chown db/d12/d1a/d2b/l34 87138 1 2024-08-31T05:21:14.357 INFO:tasks.workunit.client.0.smithi067.stdout:2/267: chown db/le 4 1 2024-08-31T05:21:14.358 INFO:tasks.workunit.client.1.smithi073.stdout:7/966: truncate d1/da/f94 871835 0 2024-08-31T05:21:14.361 INFO:tasks.workunit.client.1.smithi073.stdout:1/949: dwrite d5/d26/d54/db2/dd5/d2a/d80/f11d [0,4194304] 0 2024-08-31T05:21:14.365 INFO:tasks.workunit.client.0.smithi067.stdout:0/239: dread d1/dd/d18/f3e [0,4194304] 0 2024-08-31T05:21:14.365 INFO:tasks.workunit.client.1.smithi073.stdout:4/907: mknod d7/d1a/d5c/d62/dda/c11b 0 2024-08-31T05:21:14.365 INFO:tasks.workunit.client.1.smithi073.stdout:4/908: chown d7/df/d13/d2e/fd2 10 1 2024-08-31T05:21:14.366 INFO:tasks.workunit.client.0.smithi067.stdout:2/268: dwrite db/dd/f15 [4194304,4194304] 0 2024-08-31T05:21:14.367 INFO:tasks.workunit.client.0.smithi067.stdout:3/257: truncate db/d12/f1f 239637 0 2024-08-31T05:21:14.371 INFO:tasks.workunit.client.1.smithi073.stdout:4/909: dwrite d7/d1a/d5c/d6d/d2c/d2d/da6/dde/de3/dd0/f11a [0,4194304] 0 2024-08-31T05:21:14.372 INFO:tasks.workunit.client.1.smithi073.stdout:4/910: stat d7/df/d13/d53/d88 0 2024-08-31T05:21:14.373 INFO:tasks.workunit.client.1.smithi073.stdout:6/908: truncate d15/d1a/d51/d61/ddc/d12a/f66 2873338 0 2024-08-31T05:21:14.373 INFO:tasks.workunit.client.1.smithi073.stdout:7/967: symlink d1/da/d15/d33/l132 0 2024-08-31T05:21:14.375 INFO:tasks.workunit.client.1.smithi073.stdout:0/992: mknod d0/c14f 0 2024-08-31T05:21:14.376 INFO:tasks.workunit.client.1.smithi073.stdout:0/993: fsync d0/d69/d7f/f6a 0 2024-08-31T05:21:14.378 INFO:tasks.workunit.client.0.smithi067.stdout:2/269: rename db/dd/c3f to db/c48 0 2024-08-31T05:21:14.379 INFO:tasks.workunit.client.1.smithi073.stdout:6/909: mkdir d15/d17/d138 0 2024-08-31T05:21:14.379 INFO:tasks.workunit.client.1.smithi073.stdout:7/968: chown d1/d11/dcc/fc8 65638 1 2024-08-31T05:21:14.380 INFO:tasks.workunit.client.1.smithi073.stdout:4/911: mknod d7/df/d13/d53/d88/dc7/c11c 0 2024-08-31T05:21:14.384 INFO:tasks.workunit.client.0.smithi067.stdout:3/258: rename db/c3a to db/d5a/c5e 0 2024-08-31T05:21:14.385 INFO:tasks.workunit.client.0.smithi067.stdout:2/270: dwrite db/d12/f1c [0,4194304] 0 2024-08-31T05:21:14.386 INFO:tasks.workunit.client.0.smithi067.stdout:3/259: dread db/d2c/f48 [0,4194304] 0 2024-08-31T05:21:14.387 INFO:tasks.workunit.client.1.smithi073.stdout:0/994: creat d0/d69/d8e/d99/f150 x:0 0 0 2024-08-31T05:21:14.387 INFO:tasks.workunit.client.1.smithi073.stdout:6/910: creat d15/d17/f139 x:0 0 0 2024-08-31T05:21:14.387 INFO:tasks.workunit.client.0.smithi067.stdout:2/271: chown db/l2e 66 1 2024-08-31T05:21:14.392 INFO:tasks.workunit.client.1.smithi073.stdout:2/985: sync 2024-08-31T05:21:14.392 INFO:tasks.workunit.client.1.smithi073.stdout:2/986: readlink d2/d9/d27/d76/d7e/l114 0 2024-08-31T05:21:14.393 INFO:tasks.workunit.client.1.smithi073.stdout:2/987: dread - d2/d9/d27/d117/dc6/f102 zero size 2024-08-31T05:21:14.394 INFO:tasks.workunit.client.0.smithi067.stdout:0/240: dread d1/d8/f33 [0,4194304] 0 2024-08-31T05:21:14.394 INFO:tasks.workunit.client.0.smithi067.stdout:0/241: chown d1/dd/c1b 208609357 1 2024-08-31T05:21:14.400 INFO:tasks.workunit.client.0.smithi067.stdout:2/272: mknod db/c49 0 2024-08-31T05:21:14.401 INFO:tasks.workunit.client.0.smithi067.stdout:2/273: write db/d12/d1a/f20 [878348,93228] 0 2024-08-31T05:21:14.403 INFO:tasks.workunit.client.0.smithi067.stdout:0/242: mkdir d1/dd/d4d 0 2024-08-31T05:21:14.407 INFO:tasks.workunit.client.1.smithi073.stdout:4/912: dread d7/db/f4e [0,4194304] 0 2024-08-31T05:21:14.411 INFO:tasks.workunit.client.0.smithi067.stdout:2/274: creat db/d12/d1a/d2b/d40/f4a x:0 0 0 2024-08-31T05:21:14.412 INFO:tasks.workunit.client.1.smithi073.stdout:8/962: sync 2024-08-31T05:21:14.414 INFO:tasks.workunit.client.1.smithi073.stdout:1/950: dwrite d5/fc [0,4194304] 0 2024-08-31T05:21:14.419 INFO:tasks.workunit.client.0.smithi067.stdout:0/243: link d1/l31 d1/l4e 0 2024-08-31T05:21:14.421 INFO:tasks.workunit.client.0.smithi067.stdout:2/275: creat db/f4b x:0 0 0 2024-08-31T05:21:14.422 INFO:tasks.workunit.client.0.smithi067.stdout:2/276: fdatasync db/d12/f39 0 2024-08-31T05:21:14.425 INFO:tasks.workunit.client.0.smithi067.stdout:2/277: creat db/dd/f4c x:0 0 0 2024-08-31T05:21:14.429 INFO:tasks.workunit.client.0.smithi067.stdout:2/278: mkdir db/d12/d1a/d1e/d4d 0 2024-08-31T05:21:14.429 INFO:tasks.workunit.client.0.smithi067.stdout:3/260: write db/d12/f1f [49789,22840] 0 2024-08-31T05:21:14.431 INFO:tasks.workunit.client.0.smithi067.stdout:2/279: read db/d12/d1a/d1e/f2f [60761,42634] 0 2024-08-31T05:21:14.435 INFO:tasks.workunit.client.0.smithi067.stdout:3/261: unlink db/d4e/c5b 0 2024-08-31T05:21:14.457 INFO:tasks.workunit.client.0.smithi067.stdout:3/262: getdents db/d4e 0 2024-08-31T05:21:14.463 INFO:tasks.workunit.client.0.smithi067.stdout:2/280: write db/d12/f23 [96804,37290] 0 2024-08-31T05:21:14.465 INFO:tasks.workunit.client.0.smithi067.stdout:2/281: stat db/dd/d2d/f35 0 2024-08-31T05:21:14.466 INFO:tasks.workunit.client.0.smithi067.stdout:3/263: dwrite f4 [4194304,4194304] 0 2024-08-31T05:21:14.467 INFO:tasks.workunit.client.0.smithi067.stdout:2/282: write db/f25 [1202507,122699] 0 2024-08-31T05:21:14.467 INFO:tasks.workunit.client.1.smithi073.stdout:7/969: symlink d1/da/d15/d33/d44/d74/dd6/dea/dac/d103/l133 0 2024-08-31T05:21:14.470 INFO:tasks.workunit.client.0.smithi067.stdout:3/264: fsync db/d12/f16 0 2024-08-31T05:21:14.473 INFO:tasks.workunit.client.1.smithi073.stdout:2/988: unlink d2/d9/d27/d9b/da6/f63 0 2024-08-31T05:21:14.474 INFO:tasks.workunit.client.1.smithi073.stdout:2/989: write d2/d9/d3c/f73 [471096,70543] 0 2024-08-31T05:21:14.474 INFO:tasks.workunit.client.0.smithi067.stdout:2/283: symlink db/d12/d1a/d2b/l4e 0 2024-08-31T05:21:14.475 INFO:tasks.workunit.client.1.smithi073.stdout:4/913: mkdir d7/df/d79/d11d 0 2024-08-31T05:21:14.479 INFO:tasks.workunit.client.0.smithi067.stdout:2/284: mkdir db/d12/d1a/d2b/d3d/d4f 0 2024-08-31T05:21:14.482 INFO:tasks.workunit.client.0.smithi067.stdout:3/265: link db/d12/f1f db/d5a/f5f 0 2024-08-31T05:21:14.483 INFO:tasks.workunit.client.0.smithi067.stdout:3/266: chown db/d2e/f38 4941703 1 2024-08-31T05:21:14.485 INFO:tasks.workunit.client.0.smithi067.stdout:3/267: chown db/d2c/l32 0 1 2024-08-31T05:21:14.486 INFO:tasks.workunit.client.0.smithi067.stdout:2/285: dwrite db/d12/d1a/f20 [0,4194304] 0 2024-08-31T05:21:14.491 INFO:tasks.workunit.client.0.smithi067.stdout:3/268: creat db/d2e/d50/d4a/f60 x:0 0 0 2024-08-31T05:21:14.493 INFO:tasks.workunit.client.1.smithi073.stdout:0/995: dread d0/d28/f146 [0,4194304] 0 2024-08-31T05:21:14.494 INFO:tasks.workunit.client.1.smithi073.stdout:0/996: stat d0/d69/d8e/d99/f105 0 2024-08-31T05:21:14.494 INFO:tasks.workunit.client.0.smithi067.stdout:3/269: unlink db/c20 0 2024-08-31T05:21:14.495 INFO:tasks.workunit.client.1.smithi073.stdout:1/951: symlink d5/d26/l127 0 2024-08-31T05:21:14.498 INFO:tasks.workunit.client.1.smithi073.stdout:6/911: creat d15/d1a/d2b/d2f/d4b/f13a x:0 0 0 2024-08-31T05:21:14.500 INFO:tasks.workunit.client.0.smithi067.stdout:3/270: fdatasync f6 0 2024-08-31T05:21:14.505 INFO:tasks.workunit.client.0.smithi067.stdout:3/271: creat db/d17/d3f/f61 x:0 0 0 2024-08-31T05:21:14.506 INFO:tasks.workunit.client.1.smithi073.stdout:8/963: creat d0/da8/d10d/d125/f133 x:0 0 0 2024-08-31T05:21:14.507 INFO:tasks.workunit.client.0.smithi067.stdout:2/286: getdents db/d12 0 2024-08-31T05:21:14.508 INFO:tasks.workunit.client.0.smithi067.stdout:3/272: write db/d12/f58 [3645697,5395] 0 2024-08-31T05:21:14.509 INFO:tasks.workunit.client.1.smithi073.stdout:1/952: symlink d5/d26/da5/dba/d1c/d27/l128 0 2024-08-31T05:21:14.512 INFO:tasks.workunit.client.1.smithi073.stdout:7/970: dwrite d1/da/d3e/d22/d47/f68 [0,4194304] 0 2024-08-31T05:21:14.514 INFO:tasks.workunit.client.0.smithi067.stdout:3/273: mkdir db/d2e/d50/d62 0 2024-08-31T05:21:14.514 INFO:tasks.workunit.client.1.smithi073.stdout:4/914: link d7/df/d13/db2/fbd d7/df/d13/d2e/d70/d6b/f11e 0 2024-08-31T05:21:14.515 INFO:tasks.workunit.client.1.smithi073.stdout:7/971: chown d1/da/d3e/d22/d47/l57 175 1 2024-08-31T05:21:14.516 INFO:tasks.workunit.client.1.smithi073.stdout:0/997: symlink d0/d58/d142/l151 0 2024-08-31T05:21:14.516 INFO:tasks.workunit.client.1.smithi073.stdout:2/990: dwrite d2/d9/d7f/f83 [0,4194304] 0 2024-08-31T05:21:14.517 INFO:tasks.workunit.client.1.smithi073.stdout:7/972: dread - d1/da/d96/f126 zero size 2024-08-31T05:21:14.520 INFO:tasks.workunit.client.1.smithi073.stdout:6/912: symlink d15/l13b 0 2024-08-31T05:21:14.521 INFO:tasks.workunit.client.1.smithi073.stdout:1/953: rename d5/d26/d54/d9e/fef to d5/d26/d54/d5f/ddf/f129 0 2024-08-31T05:21:14.521 INFO:tasks.workunit.client.1.smithi073.stdout:4/915: dread - d7/df/d79/d7a/fd8 zero size 2024-08-31T05:21:14.522 INFO:tasks.workunit.client.1.smithi073.stdout:6/913: dread - d15/d1a/d2b/d2f/d99/db3/f113 zero size 2024-08-31T05:21:14.524 INFO:tasks.workunit.client.1.smithi073.stdout:2/991: mknod d2/d9/d27/d117/dc6/dd1/c134 0 2024-08-31T05:21:14.526 INFO:tasks.workunit.client.1.smithi073.stdout:8/964: dread d0/db/fc5 [0,4194304] 0 2024-08-31T05:21:14.531 INFO:tasks.workunit.client.1.smithi073.stdout:0/998: mknod d0/d69/d11c/c152 0 2024-08-31T05:21:14.536 INFO:tasks.workunit.client.1.smithi073.stdout:8/965: rename d0/db/d1c/d34/d38/fdd to d0/d62/db4/de7/f134 0 2024-08-31T05:21:14.541 INFO:tasks.workunit.client.1.smithi073.stdout:1/954: write d5/d26/d54/db2/dd5/d32/d37/fde [221082,21193] 0 2024-08-31T05:21:14.543 INFO:tasks.workunit.client.1.smithi073.stdout:2/992: truncate d2/d25/f93 2997353 0 2024-08-31T05:21:14.545 INFO:tasks.workunit.client.1.smithi073.stdout:8/966: link d0/db/d1c/d24/cec d0/da8/d10d/d125/c135 0 2024-08-31T05:21:14.546 INFO:tasks.workunit.client.1.smithi073.stdout:2/993: dread - d2/d9/d66/d70/f11a zero size 2024-08-31T05:21:14.550 INFO:tasks.workunit.client.1.smithi073.stdout:7/973: dwrite d1/da/d15/d33/d44/d74/dd6/dea/f63 [0,4194304] 0 2024-08-31T05:21:14.552 INFO:tasks.workunit.client.1.smithi073.stdout:8/967: read d0/db/d44/d4e/f5c [3048978,65152] 0 2024-08-31T05:21:14.552 INFO:tasks.workunit.client.1.smithi073.stdout:4/916: dwrite d7/df/d13/db2/fbd [0,4194304] 0 2024-08-31T05:21:14.552 INFO:tasks.workunit.client.1.smithi073.stdout:1/955: link d5/d26/d54/db2/ddb/d102/f112 d5/d26/da5/dba/d1c/d27/f12a 0 2024-08-31T05:21:14.557 INFO:tasks.workunit.client.1.smithi073.stdout:4/917: write d7/df/d13/db2/fbd [3419817,3182] 0 2024-08-31T05:21:14.557 INFO:tasks.workunit.client.1.smithi073.stdout:6/914: dread d15/d1a/d51/f70 [4194304,4194304] 0 2024-08-31T05:21:14.558 INFO:tasks.workunit.client.1.smithi073.stdout:1/956: write d5/d26/f64 [3489029,57505] 0 2024-08-31T05:21:14.559 INFO:tasks.workunit.client.1.smithi073.stdout:8/968: mknod d0/db/d1c/d34/d80/d9a/c136 0 2024-08-31T05:21:14.561 INFO:tasks.workunit.client.1.smithi073.stdout:7/974: link d1/da/d15/d33/d44/d74/dd6/dea/f11c d1/da/d15/d33/d44/d74/f134 0 2024-08-31T05:21:14.562 INFO:tasks.workunit.client.1.smithi073.stdout:8/969: chown d0/d62/db4/dee 8210651 1 2024-08-31T05:21:14.563 INFO:tasks.workunit.client.1.smithi073.stdout:1/957: write d5/d26/d54/f117 [62368,59026] 0 2024-08-31T05:21:14.564 INFO:tasks.workunit.client.1.smithi073.stdout:7/975: stat d1/da/d15/d33/l132 0 2024-08-31T05:21:14.564 INFO:tasks.workunit.client.1.smithi073.stdout:8/970: chown d0/db/d44/f71 1 1 2024-08-31T05:21:14.568 INFO:tasks.workunit.client.1.smithi073.stdout:1/958: readlink d5/d26/d54/db2/dd5/d3f/d9f/lbe 0 2024-08-31T05:21:14.569 INFO:tasks.workunit.client.1.smithi073.stdout:4/918: dwrite d7/db/f4e [0,4194304] 0 2024-08-31T05:21:14.569 INFO:tasks.workunit.client.1.smithi073.stdout:4/919: readlink d7/df/d13/d2e/d70/le7 0 2024-08-31T05:21:14.570 INFO:tasks.workunit.client.1.smithi073.stdout:8/971: creat d0/db/d44/d4e/f137 x:0 0 0 2024-08-31T05:21:14.571 INFO:tasks.workunit.client.1.smithi073.stdout:7/976: symlink d1/da/d15/d33/d44/d74/dd6/de3/d108/l135 0 2024-08-31T05:21:14.572 INFO:tasks.workunit.client.1.smithi073.stdout:1/959: unlink d5/d26/da5/dba/d1c/c67 0 2024-08-31T05:21:14.574 INFO:tasks.workunit.client.1.smithi073.stdout:8/972: mknod d0/db/d1c/d34/d80/c138 0 2024-08-31T05:21:14.575 INFO:tasks.workunit.client.1.smithi073.stdout:7/977: symlink d1/da/d15/d33/d44/d74/dd6/dea/dac/d103/l136 0 2024-08-31T05:21:14.575 INFO:tasks.workunit.client.1.smithi073.stdout:8/973: write d0/da8/fde [33477,57162] 0 2024-08-31T05:21:14.575 INFO:tasks.workunit.client.1.smithi073.stdout:1/960: symlink d5/d26/d54/db2/ddb/d102/l12b 0 2024-08-31T05:21:14.576 INFO:tasks.workunit.client.1.smithi073.stdout:4/920: getdents d7/d1a/d5c/d6d 0 2024-08-31T05:21:14.577 INFO:tasks.workunit.client.1.smithi073.stdout:8/974: fsync d0/db/d1c/d34/d38/d106/d128/f12d 0 2024-08-31T05:21:14.578 INFO:tasks.workunit.client.1.smithi073.stdout:7/978: mknod d1/da/d15/d33/d44/d60/de1/dfa/c137 0 2024-08-31T05:21:14.578 INFO:tasks.workunit.client.1.smithi073.stdout:7/979: readlink d1/da/d65/d9e/l127 0 2024-08-31T05:21:14.579 INFO:tasks.workunit.client.1.smithi073.stdout:1/961: mkdir d5/d26/da5/dba/d33/d13/d12c 0 2024-08-31T05:21:14.579 INFO:tasks.workunit.client.1.smithi073.stdout:2/994: write d2/d9/d7f/dab/d5d/da1/fb2 [4318321,80686] 0 2024-08-31T05:21:14.580 INFO:tasks.workunit.client.1.smithi073.stdout:4/921: creat d7/df/d13/d53/d88/d9d/dc3/f11f x:0 0 0 2024-08-31T05:21:14.580 INFO:tasks.workunit.client.1.smithi073.stdout:2/995: stat d2/d9/d7f/dab/daa/cda 0 2024-08-31T05:21:14.581 INFO:tasks.workunit.client.1.smithi073.stdout:7/980: mknod d1/d11/c138 0 2024-08-31T05:21:14.583 INFO:tasks.workunit.client.1.smithi073.stdout:4/922: dread d7/db/f90 [0,4194304] 0 2024-08-31T05:21:14.584 INFO:tasks.workunit.client.1.smithi073.stdout:7/981: unlink d1/da/d65/d9e/la6 0 2024-08-31T05:21:14.584 INFO:tasks.workunit.client.1.smithi073.stdout:1/962: dread d5/d26/d54/d9e/fb6 [0,4194304] 0 2024-08-31T05:21:14.585 INFO:tasks.workunit.client.1.smithi073.stdout:7/982: chown d1/d11/dcc/cc4 3543473 1 2024-08-31T05:21:14.585 INFO:tasks.workunit.client.1.smithi073.stdout:4/923: unlink d7/db/c7c 0 2024-08-31T05:21:14.585 INFO:tasks.workunit.client.1.smithi073.stdout:1/963: rmdir d5 39 2024-08-31T05:21:14.586 INFO:tasks.workunit.client.1.smithi073.stdout:4/924: stat d7/d1a/d5c/d6d/d2c/d2d/da6 0 2024-08-31T05:21:14.589 INFO:tasks.workunit.client.1.smithi073.stdout:4/925: write d7/d1a/d5c/d6d/d2c/d2d/f57 [1124537,19437] 0 2024-08-31T05:21:14.589 INFO:tasks.workunit.client.1.smithi073.stdout:7/983: getdents d1/da/d3e/d22/d5c/dc6 0 2024-08-31T05:21:14.589 INFO:tasks.workunit.client.1.smithi073.stdout:1/964: mkdir d5/d26/da5/dba/d1b/dd8/d122/d12d 0 2024-08-31T05:21:14.590 INFO:tasks.workunit.client.1.smithi073.stdout:4/926: readlink d7/df/d13/d2e/d47/lb3 0 2024-08-31T05:21:14.591 INFO:tasks.workunit.client.1.smithi073.stdout:1/965: chown d5/d26/d54/db2 12 1 2024-08-31T05:21:14.591 INFO:tasks.workunit.client.1.smithi073.stdout:1/966: stat d5/d26/d54/d5f 0 2024-08-31T05:21:14.592 INFO:tasks.workunit.client.1.smithi073.stdout:7/984: symlink d1/da/d3e/db1/l139 0 2024-08-31T05:21:14.594 INFO:tasks.workunit.client.1.smithi073.stdout:1/967: chown d5/d26/da5/dba/d1c/d27/l74 3175738 1 2024-08-31T05:21:14.594 INFO:tasks.workunit.client.1.smithi073.stdout:6/915: truncate d15/d17/da1/fbc 1997234 0 2024-08-31T05:21:14.595 INFO:tasks.workunit.client.1.smithi073.stdout:6/916: read d15/d17/f5e [53953,56252] 0 2024-08-31T05:21:14.599 INFO:tasks.workunit.client.1.smithi073.stdout:7/985: getdents d1/da/d15/d33/d44/d74/dd6 0 2024-08-31T05:21:14.599 INFO:tasks.workunit.client.1.smithi073.stdout:1/968: truncate d5/d26/da5/dba/d1b/d88/f123 266919 0 2024-08-31T05:21:14.600 INFO:tasks.workunit.client.1.smithi073.stdout:4/927: dwrite d7/df/d13/d2e/d47/d4c/d73/f87 [0,4194304] 0 2024-08-31T05:21:14.602 INFO:tasks.workunit.client.1.smithi073.stdout:8/975: dread d0/db/d1c/d24/f74 [0,4194304] 0 2024-08-31T05:21:14.604 INFO:tasks.workunit.client.1.smithi073.stdout:4/928: symlink d7/df/d1b/l120 0 2024-08-31T05:21:14.604 INFO:tasks.workunit.client.1.smithi073.stdout:2/996: write d2/d9/d7f/dab/f39 [1407192,126452] 0 2024-08-31T05:21:14.608 INFO:tasks.workunit.client.1.smithi073.stdout:1/969: write d5/d26/d54/db2/dd5/d32/d37/d6f/fab [4451484,59562] 0 2024-08-31T05:21:14.610 INFO:tasks.workunit.client.1.smithi073.stdout:8/976: write d0/da8/d10d/d125/f133 [616824,78090] 0 2024-08-31T05:21:14.610 INFO:tasks.workunit.client.1.smithi073.stdout:4/929: write d7/df/f56 [990780,86589] 0 2024-08-31T05:21:14.610 INFO:tasks.workunit.client.1.smithi073.stdout:7/986: truncate d1/da/f94 1512939 0 2024-08-31T05:21:14.612 INFO:tasks.workunit.client.1.smithi073.stdout:2/997: chown d2/d9/d27/d76/d7e/db4/f109 7 1 2024-08-31T05:21:14.613 INFO:tasks.workunit.client.1.smithi073.stdout:1/970: chown d5/d26/d54/db2/dd5/d5d/d61/f8c 177533068 1 2024-08-31T05:21:14.613 INFO:tasks.workunit.client.1.smithi073.stdout:4/930: chown d7/df/d13/d2e/d70/d6b/f11e 0 1 2024-08-31T05:21:14.615 INFO:tasks.workunit.client.1.smithi073.stdout:2/998: getdents d2/d25 0 2024-08-31T05:21:14.615 INFO:tasks.workunit.client.1.smithi073.stdout:4/931: read - d7/d1a/d5c/d6d/d2c/ffd zero size 2024-08-31T05:21:14.617 INFO:tasks.workunit.client.1.smithi073.stdout:1/971: dread d5/d26/d54/db2/dd5/d32/d37/fde [0,4194304] 0 2024-08-31T05:21:14.619 INFO:tasks.workunit.client.1.smithi073.stdout:4/932: fsync d7/df/d13/d53/d88/d9d/dc3/fff 0 2024-08-31T05:21:14.620 INFO:tasks.workunit.client.1.smithi073.stdout:2/999: mknod d2/d9/d27/d117/dfa/c135 0 2024-08-31T05:21:14.626 INFO:tasks.workunit.client.1.smithi073.stdout:6/917: dread d15/d17/da1/dae/db0/d38/f5f [0,4194304] 0 2024-08-31T05:21:14.627 INFO:tasks.workunit.client.1.smithi073.stdout:7/987: dwrite d1/da/d15/d33/d44/d74/dd6/dea/dac/d103/f130 [0,4194304] 0 2024-08-31T05:21:14.627 INFO:tasks.workunit.client.1.smithi073.stdout:1/972: symlink d5/d26/d54/db2/dd5/d32/d37/d6f/dc7/l12e 0 2024-08-31T05:21:14.630 INFO:tasks.workunit.client.1.smithi073.stdout:1/973: truncate d5/fc 4623283 0 2024-08-31T05:21:14.630 INFO:tasks.workunit.client.1.smithi073.stdout:0/999: sync 2024-08-31T05:21:14.632 INFO:tasks.workunit.client.1.smithi073.stdout:6/918: getdents d15/d1a/d2b/d2f/d4b/dff 0 2024-08-31T05:21:14.633 INFO:tasks.workunit.client.1.smithi073.stdout:6/919: chown d15/d17/da1/dae/db0/f45 359363 1 2024-08-31T05:21:14.634 INFO:tasks.workunit.client.1.smithi073.stdout:1/974: unlink d5/d26/d54/db2/dd5/d32/d37/le1 0 2024-08-31T05:21:14.635 INFO:tasks.workunit.client.1.smithi073.stdout:1/975: readlink d5/d26/d54/db2/dd5/l78 0 2024-08-31T05:21:14.637 INFO:tasks.workunit.client.1.smithi073.stdout:6/920: rename d15/d17/da1/l12c to d15/d1a/d2b/d6a/l13c 0 2024-08-31T05:21:14.639 INFO:tasks.workunit.client.1.smithi073.stdout:1/976: rename d5/d26/d54/db2/dd5/d32/d37/d6f/fb8 to d5/d26/da5/dba/d1b/dd8/d122/f12f 0 2024-08-31T05:21:14.644 INFO:tasks.workunit.client.1.smithi073.stdout:8/977: dread d0/db/d44/d72/d79/f83 [0,4194304] 0 2024-08-31T05:21:14.644 INFO:tasks.workunit.client.1.smithi073.stdout:7/988: dwrite d1/d11/fef [0,4194304] 0 2024-08-31T05:21:14.647 INFO:tasks.workunit.client.1.smithi073.stdout:8/978: creat d0/db/d1c/d34/d38/d113/f139 x:0 0 0 2024-08-31T05:21:14.649 INFO:tasks.workunit.client.1.smithi073.stdout:6/921: dread d15/d17/da1/dae/db0/d38/f86 [0,4194304] 0 2024-08-31T05:21:14.650 INFO:tasks.workunit.client.1.smithi073.stdout:7/989: rename d1/da/d3e/d22/d47/fa1 to d1/da/d3e/db1/f13a 0 2024-08-31T05:21:14.654 INFO:tasks.workunit.client.1.smithi073.stdout:8/979: rmdir d0/db/d44/d4e 39 2024-08-31T05:21:14.657 INFO:tasks.workunit.client.1.smithi073.stdout:6/922: fdatasync d15/f102 0 2024-08-31T05:21:14.660 INFO:tasks.workunit.client.1.smithi073.stdout:7/990: getdents d1/da/d3e/d22/d47/da8 0 2024-08-31T05:21:14.660 INFO:tasks.workunit.client.1.smithi073.stdout:4/933: dread d7/df/d13/d53/d88/d9d/dc3/fff [0,4194304] 0 2024-08-31T05:21:14.662 INFO:tasks.workunit.client.1.smithi073.stdout:6/923: creat d15/d1a/d2b/d2f/d99/f13d x:0 0 0 2024-08-31T05:21:14.662 INFO:tasks.workunit.client.1.smithi073.stdout:1/977: dwrite d5/d26/d54/db2/dd5/d2a/f3b [0,4194304] 0 2024-08-31T05:21:14.663 INFO:tasks.workunit.client.1.smithi073.stdout:1/978: dread - d5/d26/d54/d9e/f105 zero size 2024-08-31T05:21:14.665 INFO:tasks.workunit.client.1.smithi073.stdout:6/924: mknod d15/d1a/d51/d6e/ddb/c13e 0 2024-08-31T05:21:14.673 INFO:tasks.workunit.client.1.smithi073.stdout:8/980: dwrite d0/f17 [0,4194304] 0 2024-08-31T05:21:14.673 INFO:tasks.workunit.client.1.smithi073.stdout:7/991: dwrite d1/da/d3e/d22/d5c/fcd [0,4194304] 0 2024-08-31T05:21:14.681 INFO:tasks.workunit.client.1.smithi073.stdout:7/992: mknod d1/da/d15/d33/d44/d60/de1/c13b 0 2024-08-31T05:21:14.684 INFO:tasks.workunit.client.1.smithi073.stdout:8/981: chown d0/db/d44/d72/d75/fd5 2321 1 2024-08-31T05:21:14.684 INFO:tasks.workunit.client.1.smithi073.stdout:1/979: dwrite d5/ffc [0,4194304] 0 2024-08-31T05:21:14.685 INFO:tasks.workunit.client.1.smithi073.stdout:4/934: dread d7/df/d79/d7a/f92 [0,4194304] 0 2024-08-31T05:21:14.686 INFO:tasks.workunit.client.1.smithi073.stdout:7/993: mknod d1/c13c 0 2024-08-31T05:21:14.686 INFO:tasks.workunit.client.1.smithi073.stdout:6/925: dwrite d15/d17/da1/dae/db0/fee [0,4194304] 0 2024-08-31T05:21:14.693 INFO:tasks.workunit.client.1.smithi073.stdout:6/926: creat d15/d1a/d2b/f13f x:0 0 0 2024-08-31T05:21:14.693 INFO:tasks.workunit.client.1.smithi073.stdout:4/935: rename d7/df/l107 to d7/l121 0 2024-08-31T05:21:14.696 INFO:tasks.workunit.client.1.smithi073.stdout:1/980: rename d5/d26/da5/dba/d33/d13/c59 to d5/d26/da5/dba/d33/d13/d12c/c130 0 2024-08-31T05:21:14.696 INFO:tasks.workunit.client.1.smithi073.stdout:4/936: mknod d7/d1a/d5c/d62/dda/c122 0 2024-08-31T05:21:14.698 INFO:tasks.workunit.client.1.smithi073.stdout:7/994: rename d1/da/d96/c121 to d1/da/db2/c13d 0 2024-08-31T05:21:14.700 INFO:tasks.workunit.client.1.smithi073.stdout:1/981: creat d5/f131 x:0 0 0 2024-08-31T05:21:14.701 INFO:tasks.workunit.client.1.smithi073.stdout:6/927: dwrite d15/d17/f124 [0,4194304] 0 2024-08-31T05:21:14.701 INFO:tasks.workunit.client.1.smithi073.stdout:7/995: dread - d1/da/d15/d33/d44/d74/f134 zero size 2024-08-31T05:21:14.703 INFO:tasks.workunit.client.1.smithi073.stdout:1/982: write d5/d26/d54/f6c [2232855,25380] 0 2024-08-31T05:21:14.708 INFO:tasks.workunit.client.1.smithi073.stdout:1/983: mknod d5/d26/da5/dba/d1b/dd8/c132 0 2024-08-31T05:21:14.708 INFO:tasks.workunit.client.1.smithi073.stdout:6/928: getdents d15/d17/da1/dae/db0/de1/d130 0 2024-08-31T05:21:14.714 INFO:tasks.workunit.client.1.smithi073.stdout:4/937: write d7/d1a/d5c/d6d/d59/f74 [1653239,55333] 0 2024-08-31T05:21:14.715 INFO:tasks.workunit.client.1.smithi073.stdout:1/984: dwrite d5/d26/d54/f117 [0,4194304] 0 2024-08-31T05:21:14.716 INFO:tasks.workunit.client.1.smithi073.stdout:4/938: readlink d7/df/d1b/d34/lf7 0 2024-08-31T05:21:14.716 INFO:tasks.workunit.client.1.smithi073.stdout:4/939: chown d7/df/d1b 0 1 2024-08-31T05:21:14.717 INFO:tasks.workunit.client.1.smithi073.stdout:8/982: dread d0/db/d1c/d34/d38/f43 [0,4194304] 0 2024-08-31T05:21:14.718 INFO:tasks.workunit.client.1.smithi073.stdout:7/996: write d1/da/d3e/d22/d6b/ddf/de2/ffb [3393713,93848] 0 2024-08-31T05:21:14.720 INFO:tasks.workunit.client.1.smithi073.stdout:8/983: creat d0/d62/db4/dee/f13a x:0 0 0 2024-08-31T05:21:14.722 INFO:tasks.workunit.client.1.smithi073.stdout:4/940: creat d7/df/f123 x:0 0 0 2024-08-31T05:21:14.722 INFO:tasks.workunit.client.1.smithi073.stdout:6/929: write d15/d41/f103 [219474,80297] 0 2024-08-31T05:21:14.723 INFO:tasks.workunit.client.1.smithi073.stdout:7/997: unlink d1/d11/dcc/cc4 0 2024-08-31T05:21:14.768 INFO:tasks.workunit.client.1.smithi073.stdout:6/930: truncate d15/d1a/d51/d6e/ddb/f10a 280613 0 2024-08-31T05:21:14.768 INFO:tasks.workunit.client.1.smithi073.stdout:7/998: stat d1/da/d15/d33/d44/d74/dd6/dea/d111 0 2024-08-31T05:21:14.769 INFO:tasks.workunit.client.1.smithi073.stdout:4/941: mknod d7/d1a/d5c/c124 0 2024-08-31T05:21:14.772 INFO:tasks.workunit.client.1.smithi073.stdout:7/999: fsync d1/da/d15/d33/d44/d74/dd6/dea/f29 0 2024-08-31T05:21:14.788 INFO:tasks.workunit.client.1.smithi073.stdout:4/942: rename d7/df/d13/d53/f108 to d7/df/d1b/d34/f125 0 2024-08-31T05:21:14.789 INFO:tasks.workunit.client.1.smithi073.stdout:8/984: write d0/db/d44/d4e/f5c [4971150,32628] 0 2024-08-31T05:21:14.790 INFO:tasks.workunit.client.1.smithi073.stdout:4/943: write d7/df/d13/d53/f80 [4558623,37714] 0 2024-08-31T05:21:14.793 INFO:tasks.workunit.client.1.smithi073.stdout:8/985: creat d0/db/d1c/d34/d68/f13b x:0 0 0 2024-08-31T05:21:14.794 INFO:tasks.workunit.client.1.smithi073.stdout:8/986: stat d0/db/d44/ld4 0 2024-08-31T05:21:14.794 INFO:tasks.workunit.client.1.smithi073.stdout:4/944: mknod d7/d1a/d5c/c126 0 2024-08-31T05:21:14.796 INFO:tasks.workunit.client.1.smithi073.stdout:6/931: dwrite d15/d17/da1/dae/fd6 [0,4194304] 0 2024-08-31T05:21:14.797 INFO:tasks.workunit.client.1.smithi073.stdout:8/987: unlink d0/d62/db4/de7/f10c 0 2024-08-31T05:21:14.798 INFO:tasks.workunit.client.1.smithi073.stdout:8/988: chown d0/db/d1c/d34/d38/f108 24502 1 2024-08-31T05:21:14.801 INFO:tasks.workunit.client.1.smithi073.stdout:8/989: creat d0/db/d1c/d34/d38/d113/f13c x:0 0 0 2024-08-31T05:21:14.803 INFO:tasks.workunit.client.1.smithi073.stdout:6/932: write d15/d1a/d2b/d2f/d4b/fd9 [493511,10218] 0 2024-08-31T05:21:14.804 INFO:tasks.workunit.client.1.smithi073.stdout:6/933: stat d15/d17 0 2024-08-31T05:21:14.805 INFO:tasks.workunit.client.1.smithi073.stdout:8/990: mkdir d0/db/d1c/d34/d68/d13d 0 2024-08-31T05:21:14.808 INFO:tasks.workunit.client.1.smithi073.stdout:8/991: unlink d0/d62/db4/dee/cfb 0 2024-08-31T05:21:14.811 INFO:tasks.workunit.client.1.smithi073.stdout:8/992: creat d0/db/d1c/dda/f13e x:0 0 0 2024-08-31T05:21:14.811 INFO:tasks.workunit.client.1.smithi073.stdout:6/934: write d15/d75/f85 [900954,43982] 0 2024-08-31T05:21:14.812 INFO:tasks.workunit.client.1.smithi073.stdout:4/945: dread d7/d1a/d5c/d6d/f6e [0,4194304] 0 2024-08-31T05:21:14.813 INFO:tasks.workunit.client.1.smithi073.stdout:4/946: unlink d7/d1a/d5c/fdb 0 2024-08-31T05:21:14.814 INFO:tasks.workunit.client.1.smithi073.stdout:4/947: read - d7/df/d13/d53/d88/d9d/fb0 zero size 2024-08-31T05:21:14.817 INFO:tasks.workunit.client.1.smithi073.stdout:4/948: truncate d7/d1a/d5c/d6d/d2c/f7b 1913018 0 2024-08-31T05:21:14.818 INFO:tasks.workunit.client.1.smithi073.stdout:4/949: mknod d7/d1a/d5c/d119/c127 0 2024-08-31T05:21:14.820 INFO:tasks.workunit.client.1.smithi073.stdout:4/950: creat d7/df/d13/d2e/d47/f128 x:0 0 0 2024-08-31T05:21:14.863 INFO:tasks.workunit.client.1.smithi073.stdout:4/951: creat d7/d1a/d5c/d6d/f129 x:0 0 0 2024-08-31T05:21:14.869 INFO:tasks.workunit.client.1.smithi073.stdout:4/952: dread - d7/d1a/d5c/d6d/f129 zero size 2024-08-31T05:21:14.873 INFO:tasks.workunit.client.1.smithi073.stdout:4/953: dread d7/df/d13/d2e/f31 [0,4194304] 0 2024-08-31T05:21:14.902 INFO:tasks.workunit.client.1.smithi073.stdout:1/985: sync 2024-08-31T05:21:14.903 INFO:tasks.workunit.client.1.smithi073.stdout:1/986: dread - d5/d26/d54/d9e/f105 zero size 2024-08-31T05:21:14.908 INFO:tasks.workunit.client.0.smithi067.stdout:7/144: sync 2024-08-31T05:21:14.909 INFO:tasks.workunit.client.1.smithi073.stdout:1/987: dwrite d5/d26/d54/d9e/fc0 [0,4194304] 0 2024-08-31T05:21:14.909 INFO:tasks.workunit.client.0.smithi067.stdout:7/145: mkdir d14/d16/d28 0 2024-08-31T05:21:14.910 INFO:tasks.workunit.client.0.smithi067.stdout:7/146: write f7 [1109801,96296] 0 2024-08-31T05:21:14.911 INFO:tasks.workunit.client.1.smithi073.stdout:1/988: symlink d5/d26/d54/db2/ddb/l133 0 2024-08-31T05:21:14.912 INFO:tasks.workunit.client.0.smithi067.stdout:7/147: write fd [92674,27056] 0 2024-08-31T05:21:14.913 INFO:tasks.workunit.client.1.smithi073.stdout:1/989: chown d5/d26/d54/f9b 6 1 2024-08-31T05:21:14.913 INFO:tasks.workunit.client.0.smithi067.stdout:7/148: chown d14/d16/f24 86505227 1 2024-08-31T05:21:14.914 INFO:tasks.workunit.client.1.smithi073.stdout:1/990: fsync d5/d26/d54/db2/dd5/d32/d37/d6f/fab 0 2024-08-31T05:21:14.915 INFO:tasks.workunit.client.1.smithi073.stdout:1/991: chown d5/d26/d54/db2/dd5/d32/d37/f8a 2005308475 1 2024-08-31T05:21:14.915 INFO:tasks.workunit.client.0.smithi067.stdout:7/149: write d14/f15 [1081595,128037] 0 2024-08-31T05:21:14.918 INFO:tasks.workunit.client.1.smithi073.stdout:1/992: creat d5/d26/d54/db2/ddb/d102/f134 x:0 0 0 2024-08-31T05:21:14.919 INFO:tasks.workunit.client.0.smithi067.stdout:7/150: dread - d14/f1f zero size 2024-08-31T05:21:14.923 INFO:tasks.workunit.client.0.smithi067.stdout:7/151: creat d14/d16/d28/f29 x:0 0 0 2024-08-31T05:21:14.924 INFO:tasks.workunit.client.0.smithi067.stdout:7/152: mknod d14/d16/c2a 0 2024-08-31T05:21:14.925 INFO:tasks.workunit.client.0.smithi067.stdout:7/153: dread f11 [0,4194304] 0 2024-08-31T05:21:14.926 INFO:tasks.workunit.client.0.smithi067.stdout:7/154: creat d14/d16/f2b x:0 0 0 2024-08-31T05:21:14.928 INFO:tasks.workunit.client.0.smithi067.stdout:7/155: dread fd [0,4194304] 0 2024-08-31T05:21:14.930 INFO:tasks.workunit.client.0.smithi067.stdout:7/156: unlink d14/f26 0 2024-08-31T05:21:14.930 INFO:tasks.workunit.client.0.smithi067.stdout:7/157: chown d14/d16/f24 170876 1 2024-08-31T05:21:14.932 INFO:tasks.workunit.client.0.smithi067.stdout:7/158: symlink d14/d16/d28/l2c 0 2024-08-31T05:21:14.933 INFO:tasks.workunit.client.0.smithi067.stdout:7/159: write d14/d16/f22 [991983,117006] 0 2024-08-31T05:21:14.935 INFO:tasks.workunit.client.0.smithi067.stdout:7/160: mknod d14/d16/d28/c2d 0 2024-08-31T05:21:14.935 INFO:tasks.workunit.client.0.smithi067.stdout:7/161: fsync d14/d16/f1d 0 2024-08-31T05:21:14.936 INFO:tasks.workunit.client.0.smithi067.stdout:7/162: write f6 [1469311,11537] 0 2024-08-31T05:21:14.938 INFO:tasks.workunit.client.0.smithi067.stdout:7/163: mkdir d14/d16/d28/d2e 0 2024-08-31T05:21:14.938 INFO:tasks.workunit.client.1.smithi073.stdout:1/993: dwrite d5/d26/d54/db2/dd5/f2f [0,4194304] 0 2024-08-31T05:21:14.939 INFO:tasks.workunit.client.0.smithi067.stdout:7/164: dread d14/d16/f1d [0,4194304] 0 2024-08-31T05:21:14.944 INFO:tasks.workunit.client.0.smithi067.stdout:7/165: mkdir d14/d16/d28/d2e/d2f 0 2024-08-31T05:21:14.945 INFO:tasks.workunit.client.0.smithi067.stdout:7/166: chown d14/d16/f22 10046 1 2024-08-31T05:21:14.947 INFO:tasks.workunit.client.1.smithi073.stdout:1/994: rename d5/d26/da5/dba/d1b to d5/d26/d54/db2/dd5/d2a/d80/d93/d135 0 2024-08-31T05:21:14.950 INFO:tasks.workunit.client.1.smithi073.stdout:1/995: symlink d5/l136 0 2024-08-31T05:21:14.952 INFO:tasks.workunit.client.0.smithi067.stdout:7/167: dwrite d14/f15 [0,4194304] 0 2024-08-31T05:21:14.952 INFO:tasks.workunit.client.1.smithi073.stdout:1/996: truncate d5/d26/d54/db2/dd5/d32/d37/fde 739829 0 2024-08-31T05:21:14.952 INFO:tasks.workunit.client.0.smithi067.stdout:7/168: fsync d14/f1e 0 2024-08-31T05:21:14.953 INFO:tasks.workunit.client.0.smithi067.stdout:7/169: write d14/f1f [356543,48149] 0 2024-08-31T05:21:14.956 INFO:tasks.workunit.client.0.smithi067.stdout:7/170: unlink f5 0 2024-08-31T05:21:14.957 INFO:tasks.workunit.client.1.smithi073.stdout:1/997: link d5/d26/d54/d5f/fdc d5/d26/da5/dba/d1c/d27/ded/f137 0 2024-08-31T05:21:14.959 INFO:tasks.workunit.client.0.smithi067.stdout:7/171: dread f6 [0,4194304] 0 2024-08-31T05:21:14.961 INFO:tasks.workunit.client.0.smithi067.stdout:7/172: mknod d14/d16/d28/d2e/c30 0 2024-08-31T05:21:14.962 INFO:tasks.workunit.client.1.smithi073.stdout:1/998: rename d5/d26/da5/dba/d1c/d27/ded/d126 to d5/d26/d54/db2/dd5/d2a/d80/d93/d135/dd8/d122/d12d/d138 0 2024-08-31T05:21:14.963 INFO:tasks.workunit.client.0.smithi067.stdout:7/173: rmdir d14/d16/d28/d2e 39 2024-08-31T05:21:14.964 INFO:tasks.workunit.client.1.smithi073.stdout:1/999: mkdir d5/d26/d54/d5f/ddf/d139 0 2024-08-31T05:21:14.965 INFO:tasks.workunit.client.0.smithi067.stdout:7/174: unlink d14/d16/l19 0 2024-08-31T05:21:14.966 INFO:tasks.workunit.client.0.smithi067.stdout:7/175: mknod d14/d16/d28/c31 0 2024-08-31T05:21:14.967 INFO:tasks.workunit.client.0.smithi067.stdout:7/176: write d14/d16/f1b [11064,5302] 0 2024-08-31T05:21:14.968 INFO:tasks.workunit.client.0.smithi067.stdout:7/177: chown d14/f1e 1993 1 2024-08-31T05:21:14.968 INFO:tasks.workunit.client.0.smithi067.stdout:7/178: truncate fd 2411281 0 2024-08-31T05:21:14.969 INFO:tasks.workunit.client.0.smithi067.stdout:7/179: write f7 [2349854,65080] 0 2024-08-31T05:21:14.970 INFO:tasks.workunit.client.0.smithi067.stdout:7/180: write d14/d16/f24 [697496,15581] 0 2024-08-31T05:21:14.976 INFO:tasks.workunit.client.0.smithi067.stdout:7/181: dwrite d14/d16/d28/f29 [0,4194304] 0 2024-08-31T05:21:14.983 INFO:tasks.workunit.client.0.smithi067.stdout:7/182: dwrite d14/d16/f22 [0,4194304] 0 2024-08-31T05:21:14.987 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:14 smithi067 ceph-mon[17432]: pgmap v28: 65 pgs: 65 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 80 MiB/s rd, 200 MiB/s wr, 404 op/s 2024-08-31T05:21:14.987 INFO:tasks.workunit.client.0.smithi067.stdout:1/186: sync 2024-08-31T05:21:14.987 INFO:tasks.workunit.client.0.smithi067.stdout:5/197: sync 2024-08-31T05:21:14.989 INFO:tasks.workunit.client.0.smithi067.stdout:7/183: write d14/f1a [409770,41187] 0 2024-08-31T05:21:14.989 INFO:tasks.workunit.client.1.smithi073.stdout:8/993: sync 2024-08-31T05:21:14.990 INFO:tasks.workunit.client.1.smithi073.stdout:8/994: write d0/db/d1c/fba [587490,117171] 0 2024-08-31T05:21:14.992 INFO:tasks.workunit.client.0.smithi067.stdout:7/184: write d14/d16/f22 [1370462,127754] 0 2024-08-31T05:21:14.996 INFO:tasks.workunit.client.0.smithi067.stdout:5/198: link c8 db/d26/d29/d2c/c37 0 2024-08-31T05:21:14.996 INFO:tasks.workunit.client.0.smithi067.stdout:1/187: dwrite d3/f14 [0,4194304] 0 2024-08-31T05:21:14.997 INFO:tasks.workunit.client.1.smithi073.stdout:8/995: dwrite d0/db/d1c/f100 [0,4194304] 0 2024-08-31T05:21:14.997 INFO:tasks.workunit.client.0.smithi067.stdout:1/188: fsync d3/dd/f1c 0 2024-08-31T05:21:14.999 INFO:tasks.workunit.client.1.smithi073.stdout:8/996: creat d0/d62/db4/d111/f13f x:0 0 0 2024-08-31T05:21:14.999 INFO:tasks.workunit.client.0.smithi067.stdout:1/189: write d3/d23/d2d/d2e/f37 [2065750,102914] 0 2024-08-31T05:21:15.000 INFO:tasks.workunit.client.0.smithi067.stdout:5/199: creat db/d26/d29/f38 x:0 0 0 2024-08-31T05:21:15.002 INFO:tasks.workunit.client.0.smithi067.stdout:5/200: readlink db/d1d/l2b 0 2024-08-31T05:21:15.003 INFO:tasks.workunit.client.0.smithi067.stdout:1/190: symlink d3/d36/l42 0 2024-08-31T05:21:15.004 INFO:tasks.workunit.client.0.smithi067.stdout:1/191: dread - d3/f24 zero size 2024-08-31T05:21:15.004 INFO:tasks.workunit.client.0.smithi067.stdout:7/185: dread d14/f1a [0,4194304] 0 2024-08-31T05:21:15.005 INFO:tasks.workunit.client.0.smithi067.stdout:5/201: creat db/d26/d29/d2c/f39 x:0 0 0 2024-08-31T05:21:15.006 INFO:tasks.workunit.client.0.smithi067.stdout:5/202: write f7 [3990421,75773] 0 2024-08-31T05:21:15.011 INFO:tasks.workunit.client.1.smithi073.stdout:8/997: link d0/db/d1c/d2a/d58/l8e d0/db/d1c/dda/l140 0 2024-08-31T05:21:15.012 INFO:tasks.workunit.client.0.smithi067.stdout:1/192: read f1 [1017351,61178] 0 2024-08-31T05:21:15.013 INFO:tasks.workunit.client.0.smithi067.stdout:5/203: mkdir db/d1d/d3a 0 2024-08-31T05:21:15.017 INFO:tasks.workunit.client.0.smithi067.stdout:5/204: creat db/d26/d29/d2c/d36/f3b x:0 0 0 2024-08-31T05:21:15.021 INFO:tasks.workunit.client.1.smithi073.stdout:4/954: sync 2024-08-31T05:21:15.021 INFO:tasks.workunit.client.1.smithi073.stdout:6/935: sync 2024-08-31T05:21:15.023 INFO:tasks.workunit.client.1.smithi073.stdout:4/955: symlink d7/df/d13/d53/l12a 0 2024-08-31T05:21:15.025 INFO:tasks.workunit.client.1.smithi073.stdout:4/956: stat l4 0 2024-08-31T05:21:15.025 INFO:tasks.workunit.client.0.smithi067.stdout:5/205: dwrite db/f32 [0,4194304] 0 2024-08-31T05:21:15.025 INFO:tasks.workunit.client.0.smithi067.stdout:7/186: dread d14/f18 [0,4194304] 0 2024-08-31T05:21:15.026 INFO:tasks.workunit.client.0.smithi067.stdout:5/206: stat f7 0 2024-08-31T05:21:15.026 INFO:tasks.workunit.client.1.smithi073.stdout:8/998: dwrite d0/f3c [0,4194304] 0 2024-08-31T05:21:15.027 INFO:tasks.workunit.client.1.smithi073.stdout:6/936: rename d15/d17/da1/dae/db0/d38/ld8 to d15/d1a/d2b/d2f/d99/l140 0 2024-08-31T05:21:15.028 INFO:tasks.workunit.client.0.smithi067.stdout:7/187: write fd [2576581,49889] 0 2024-08-31T05:21:15.029 INFO:tasks.workunit.client.0.smithi067.stdout:1/193: dwrite d3/dd/f21 [0,4194304] 0 2024-08-31T05:21:15.030 INFO:tasks.workunit.client.0.smithi067.stdout:5/207: unlink db/d15/l14 0 2024-08-31T05:21:15.033 INFO:tasks.workunit.client.0.smithi067.stdout:7/188: rename d14/f1f to d14/d16/f32 0 2024-08-31T05:21:15.034 INFO:tasks.workunit.client.1.smithi073.stdout:4/957: creat d7/d1a/d5c/d6d/d59/d65/db9/f12b x:0 0 0 2024-08-31T05:21:15.039 INFO:tasks.workunit.client.0.smithi067.stdout:5/208: symlink db/d26/d29/l3c 0 2024-08-31T05:21:15.040 INFO:tasks.workunit.client.0.smithi067.stdout:5/209: truncate db/d15/f28 73047 0 2024-08-31T05:21:15.042 INFO:tasks.workunit.client.0.smithi067.stdout:5/210: rmdir db/d26 39 2024-08-31T05:21:15.043 INFO:tasks.workunit.client.1.smithi073.stdout:4/958: mknod d7/d1a/d5c/d6d/d2c/d2d/da6/dde/de3/c12c 0 2024-08-31T05:21:15.044 INFO:tasks.workunit.client.0.smithi067.stdout:1/194: link d3/c31 d3/d23/d2d/c43 0 2024-08-31T05:21:15.044 INFO:tasks.workunit.client.0.smithi067.stdout:1/195: fsync d3/f1e 0 2024-08-31T05:21:15.046 INFO:tasks.workunit.client.0.smithi067.stdout:1/196: symlink d3/dd/l44 0 2024-08-31T05:21:15.047 INFO:tasks.workunit.client.1.smithi073.stdout:4/959: creat d7/f12d x:0 0 0 2024-08-31T05:21:15.048 INFO:tasks.workunit.client.0.smithi067.stdout:5/211: unlink db/d26/d29/d2c/d36/f3b 0 2024-08-31T05:21:15.049 INFO:tasks.workunit.client.1.smithi073.stdout:4/960: creat d7/db/f12e x:0 0 0 2024-08-31T05:21:15.052 INFO:tasks.workunit.client.0.smithi067.stdout:1/197: dwrite d3/dd/f21 [0,4194304] 0 2024-08-31T05:21:15.052 INFO:tasks.workunit.client.1.smithi073.stdout:4/961: rename d7/df/d13/d53/d88/dc7/dcb to d7/df/d1b/d12f 0 2024-08-31T05:21:15.055 INFO:tasks.workunit.client.0.smithi067.stdout:1/198: creat d3/d23/d2d/d2e/f45 x:0 0 0 2024-08-31T05:21:15.056 INFO:tasks.workunit.client.0.smithi067.stdout:3/274: sync 2024-08-31T05:21:15.056 INFO:tasks.workunit.client.0.smithi067.stdout:9/164: sync 2024-08-31T05:21:15.056 INFO:tasks.workunit.client.0.smithi067.stdout:2/287: sync 2024-08-31T05:21:15.056 INFO:tasks.workunit.client.0.smithi067.stdout:0/244: sync 2024-08-31T05:21:15.056 INFO:tasks.workunit.client.0.smithi067.stdout:6/397: sync 2024-08-31T05:21:15.056 INFO:tasks.workunit.client.0.smithi067.stdout:4/174: sync 2024-08-31T05:21:15.056 INFO:tasks.workunit.client.0.smithi067.stdout:8/282: sync 2024-08-31T05:21:15.057 INFO:tasks.workunit.client.1.smithi073.stdout:4/962: dread d7/df/d13/db2/fbd [0,4194304] 0 2024-08-31T05:21:15.058 INFO:tasks.workunit.client.0.smithi067.stdout:0/245: write d1/dd/f21 [186854,33459] 0 2024-08-31T05:21:15.058 INFO:tasks.workunit.client.0.smithi067.stdout:9/165: fdatasync fa 0 2024-08-31T05:21:15.058 INFO:tasks.workunit.client.1.smithi073.stdout:4/963: dread - d7/df/d13/d2e/d47/f128 zero size 2024-08-31T05:21:15.061 INFO:tasks.workunit.client.0.smithi067.stdout:4/175: creat d4/d1e/f3f x:0 0 0 2024-08-31T05:21:15.061 INFO:tasks.workunit.client.1.smithi073.stdout:4/964: write d7/df/d13/d53/d88/fe0 [1705322,35836] 0 2024-08-31T05:21:15.062 INFO:tasks.workunit.client.0.smithi067.stdout:3/275: symlink db/d17/l63 0 2024-08-31T05:21:15.066 INFO:tasks.workunit.client.1.smithi073.stdout:8/999: dwrite d0/f1b [0,4194304] 0 2024-08-31T05:21:15.067 INFO:tasks.workunit.client.1.smithi073.stdout:6/937: dwrite d15/d1a/d51/d61/ddc/d12a/f37 [0,4194304] 0 2024-08-31T05:21:15.071 INFO:tasks.workunit.client.1.smithi073.stdout:4/965: fsync d7/db/f12e 0 2024-08-31T05:21:15.073 INFO:tasks.workunit.client.1.smithi073.stdout:6/938: rename d15/d75 to d15/d1a/d51/d61/d141 0 2024-08-31T05:21:15.079 INFO:tasks.workunit.client.1.smithi073.stdout:6/939: mkdir d15/d1a/d51/d61/ddc/d142 0 2024-08-31T05:21:15.081 INFO:tasks.workunit.client.1.smithi073.stdout:6/940: creat d15/d17/f143 x:0 0 0 2024-08-31T05:21:15.082 INFO:tasks.workunit.client.1.smithi073.stdout:4/966: getdents d7/df/d13/d53/d88/d9d 0 2024-08-31T05:21:15.082 INFO:tasks.workunit.client.1.smithi073.stdout:6/941: write d15/d17/f124 [4348973,104197] 0 2024-08-31T05:21:15.085 INFO:tasks.workunit.client.1.smithi073.stdout:6/942: dread - d15/d1a/d2b/d12d/f105 zero size 2024-08-31T05:21:15.085 INFO:tasks.workunit.client.1.smithi073.stdout:4/967: fdatasync d7/d1a/d5c/d6d/d2c/d2d/da6/dde/de3/dd0/f11a 0 2024-08-31T05:21:15.086 INFO:tasks.workunit.client.1.smithi073.stdout:6/943: rmdir d15/d1a/d2b 39 2024-08-31T05:21:15.086 INFO:tasks.workunit.client.1.smithi073.stdout:4/968: readlink d7/d1a/d5c/d6d/d2c/d2d/da6/dde/ld4 0 2024-08-31T05:21:15.087 INFO:tasks.workunit.client.1.smithi073.stdout:4/969: chown d7/d1a/d5c/d6d/d2c/d2d/l5e 9861 1 2024-08-31T05:21:15.088 INFO:tasks.workunit.client.1.smithi073.stdout:6/944: mkdir d15/d1a/d2b/d2f/d4b/d88/d144 0 2024-08-31T05:21:15.089 INFO:tasks.workunit.client.1.smithi073.stdout:4/970: symlink d7/d1a/d5c/d6d/d59/d65/d117/l130 0 2024-08-31T05:21:15.089 INFO:tasks.workunit.client.1.smithi073.stdout:6/945: mknod d15/d17/da1/dae/db0/d38/c145 0 2024-08-31T05:21:15.091 INFO:tasks.workunit.client.1.smithi073.stdout:4/971: fsync d7/df/d13/f9e 0 2024-08-31T05:21:15.092 INFO:tasks.workunit.client.1.smithi073.stdout:4/972: readlink d7/df/d13/d2e/d47/d4c/lea 0 2024-08-31T05:21:15.096 INFO:tasks.workunit.client.1.smithi073.stdout:4/973: rename d7/d1a/d5c/d6d/d59/d65/db9/fd9 to d7/df/f131 0 2024-08-31T05:21:15.102 INFO:tasks.workunit.client.1.smithi073.stdout:4/974: dwrite d7/df/d13/d53/f80 [4194304,4194304] 0 2024-08-31T05:21:15.105 INFO:tasks.workunit.client.1.smithi073.stdout:6/946: dwrite d15/d17/da1/dae/db0/f67 [0,4194304] 0 2024-08-31T05:21:15.105 INFO:tasks.workunit.client.1.smithi073.stdout:4/975: creat d7/d1a/d5c/d6d/d2c/d2d/da6/dde/f132 x:0 0 0 2024-08-31T05:21:15.108 INFO:tasks.workunit.client.1.smithi073.stdout:6/947: creat d15/d1a/d2b/d12d/f146 x:0 0 0 2024-08-31T05:21:15.110 INFO:tasks.workunit.client.0.smithi067.stdout:6/398: mkdir d1b/d23/d28/d45/d5e/d7b 0 2024-08-31T05:21:15.110 INFO:tasks.workunit.client.0.smithi067.stdout:3/276: write db/d12/f58 [1309347,111670] 0 2024-08-31T05:21:15.111 INFO:tasks.workunit.client.0.smithi067.stdout:0/246: creat d1/df/d17/f4f x:0 0 0 2024-08-31T05:21:15.111 INFO:tasks.workunit.client.1.smithi073.stdout:6/948: read d15/d17/da1/fbc [881375,122641] 0 2024-08-31T05:21:15.112 INFO:tasks.workunit.client.0.smithi067.stdout:4/176: rmdir d4 39 2024-08-31T05:21:15.113 INFO:tasks.workunit.client.0.smithi067.stdout:5/212: truncate db/f25 3159105 0 2024-08-31T05:21:15.113 INFO:tasks.workunit.client.0.smithi067.stdout:6/399: chown d1b/f74 8073 1 2024-08-31T05:21:15.114 INFO:tasks.workunit.client.1.smithi073.stdout:4/976: rename d7/d1a/d5c/d6d/d2c/d2d/l10f to d7/d1a/d5c/d62/dda/l133 0 2024-08-31T05:21:15.115 INFO:tasks.workunit.client.1.smithi073.stdout:4/977: write d7/db/f4f [1500071,56625] 0 2024-08-31T05:21:15.115 INFO:tasks.workunit.client.0.smithi067.stdout:2/288: symlink db/d12/d1a/d2b/d42/l50 0 2024-08-31T05:21:15.118 INFO:tasks.workunit.client.0.smithi067.stdout:5/213: write db/d15/f22 [679637,17748] 0 2024-08-31T05:21:15.119 INFO:tasks.workunit.client.0.smithi067.stdout:2/289: stat db/d12/d24/d3b 0 2024-08-31T05:21:15.121 INFO:tasks.workunit.client.0.smithi067.stdout:9/166: rename dd/df/d25/f34 to dd/f36 0 2024-08-31T05:21:15.121 INFO:tasks.workunit.client.1.smithi073.stdout:4/978: rmdir d7/d1a/d5c/d6d/d2c/d2d/da6/dde/de3/dd0 39 2024-08-31T05:21:15.123 INFO:tasks.workunit.client.1.smithi073.stdout:6/949: rename d15/d1a/d51/d61/ddc/d12a/d69/c11d to d15/d1a/d2b/d120/c147 0 2024-08-31T05:21:15.124 INFO:tasks.workunit.client.0.smithi067.stdout:7/189: dwrite d14/f17 [0,4194304] 0 2024-08-31T05:21:15.125 INFO:tasks.workunit.client.0.smithi067.stdout:3/277: creat db/d17/d3f/d54/f64 x:0 0 0 2024-08-31T05:21:15.126 INFO:tasks.workunit.client.0.smithi067.stdout:3/278: chown db/d17 2844698 1 2024-08-31T05:21:15.126 INFO:tasks.workunit.client.0.smithi067.stdout:2/290: creat db/dd/d2d/f51 x:0 0 0 2024-08-31T05:21:15.127 INFO:tasks.workunit.client.0.smithi067.stdout:2/291: read db/dd/f15 [1431258,93123] 0 2024-08-31T05:21:15.130 INFO:tasks.workunit.client.0.smithi067.stdout:8/283: rename d0/d4/de/d1d/f3a to d0/d2/dc/d3d/f5d 0 2024-08-31T05:21:15.131 INFO:tasks.workunit.client.0.smithi067.stdout:9/167: symlink dd/df/d25/l37 0 2024-08-31T05:21:15.132 INFO:tasks.workunit.client.0.smithi067.stdout:7/190: mknod d14/d16/c33 0 2024-08-31T05:21:15.133 INFO:tasks.workunit.client.0.smithi067.stdout:8/284: read d0/d2/da/dd/f35 [1068974,3791] 0 2024-08-31T05:21:15.133 INFO:tasks.workunit.client.1.smithi073.stdout:4/979: creat d7/f134 x:0 0 0 2024-08-31T05:21:15.134 INFO:tasks.workunit.client.1.smithi073.stdout:4/980: fsync d7/df/d1b/d34/fc8 0 2024-08-31T05:21:15.135 INFO:tasks.workunit.client.0.smithi067.stdout:7/191: write d14/d16/f2b [682881,7050] 0 2024-08-31T05:21:15.135 INFO:tasks.workunit.client.1.smithi073.stdout:4/981: readlink d7/d1a/d5c/d6d/d59/d65/db9/lc5 0 2024-08-31T05:21:15.139 INFO:tasks.workunit.client.0.smithi067.stdout:3/279: creat db/d17/f65 x:0 0 0 2024-08-31T05:21:15.141 INFO:tasks.workunit.client.1.smithi073.stdout:4/982: mknod d7/d1a/d5c/d6d/d59/d65/db9/c135 0 2024-08-31T05:21:15.141 INFO:tasks.workunit.client.0.smithi067.stdout:9/168: dwrite f3 [4194304,4194304] 0 2024-08-31T05:21:15.143 INFO:tasks.workunit.client.0.smithi067.stdout:2/292: fdatasync db/dd/d13/f14 0 2024-08-31T05:21:15.144 INFO:tasks.workunit.client.0.smithi067.stdout:2/293: chown db/dd/d2d/f41 114 1 2024-08-31T05:21:15.145 INFO:tasks.workunit.client.0.smithi067.stdout:2/294: write db/d12/f1c [5070026,56869] 0 2024-08-31T05:21:15.145 INFO:tasks.workunit.client.0.smithi067.stdout:6/400: rename d1b/d23/d2f/c5a to d1b/d40/d70/d71/d78/c7c 0 2024-08-31T05:21:15.147 INFO:tasks.workunit.client.0.smithi067.stdout:2/295: chown db/d12/d24/c3c 10716831 1 2024-08-31T05:21:15.150 INFO:tasks.workunit.client.1.smithi073.stdout:4/983: rename d7/f81 to d7/d1a/d5c/d6d/d2c/d2d/f136 0 2024-08-31T05:21:15.150 INFO:tasks.workunit.client.1.smithi073.stdout:4/984: chown d7/df/d79/d7a/fd8 82698 1 2024-08-31T05:21:15.151 INFO:tasks.workunit.client.0.smithi067.stdout:7/192: write d14/d16/f32 [1318434,2137] 0 2024-08-31T05:21:15.152 INFO:tasks.workunit.client.1.smithi073.stdout:6/950: write d15/d41/fed [794677,4235] 0 2024-08-31T05:21:15.153 INFO:tasks.workunit.client.1.smithi073.stdout:6/951: fsync d15/d1a/fac 0 2024-08-31T05:21:15.153 INFO:tasks.workunit.client.1.smithi073.stdout:6/952: readlink d15/l28 0 2024-08-31T05:21:15.154 INFO:tasks.workunit.client.0.smithi067.stdout:3/280: unlink db/d12/f16 0 2024-08-31T05:21:15.155 INFO:tasks.workunit.client.1.smithi073.stdout:6/953: truncate d15/d1a/d2b/d2f/d4b/dff/f132 814959 0 2024-08-31T05:21:15.156 INFO:tasks.workunit.client.0.smithi067.stdout:7/193: dread fd [0,4194304] 0 2024-08-31T05:21:15.156 INFO:tasks.workunit.client.0.smithi067.stdout:9/169: symlink dd/df/d25/l38 0 2024-08-31T05:21:15.157 INFO:tasks.workunit.client.0.smithi067.stdout:7/194: write d14/f17 [3809559,88621] 0 2024-08-31T05:21:15.160 INFO:tasks.workunit.client.0.smithi067.stdout:0/247: truncate d1/dd/f21 100928 0 2024-08-31T05:21:15.162 INFO:tasks.workunit.client.0.smithi067.stdout:0/248: write d1/dd/d18/f41 [3805046,45541] 0 2024-08-31T05:21:15.162 INFO:tasks.workunit.client.1.smithi073.stdout:4/985: mkdir d7/d1a/d5c/d6d/d2c/d2d/da6/dde/de3/dd0/d137 0 2024-08-31T05:21:15.165 INFO:tasks.workunit.client.0.smithi067.stdout:5/214: rename db/d1d/f30 to db/d26/d29/d2c/d36/f3d 0 2024-08-31T05:21:15.166 INFO:tasks.workunit.client.1.smithi073.stdout:4/986: stat d7/df/l37 0 2024-08-31T05:21:15.167 INFO:tasks.workunit.client.0.smithi067.stdout:0/249: fdatasync d1/df/d17/f20 0 2024-08-31T05:21:15.168 INFO:tasks.workunit.client.0.smithi067.stdout:6/401: creat d1b/d23/d61/f7d x:0 0 0 2024-08-31T05:21:15.168 INFO:tasks.workunit.client.0.smithi067.stdout:6/402: fsync d1b/f74 0 2024-08-31T05:21:15.169 INFO:tasks.workunit.client.0.smithi067.stdout:0/250: dread d1/df/d17/f4c [0,4194304] 0 2024-08-31T05:21:15.171 INFO:tasks.workunit.client.1.smithi073.stdout:4/987: unlink d7/df/d13/d2e/d70/d6b/f7e 0 2024-08-31T05:21:15.171 INFO:tasks.workunit.client.1.smithi073.stdout:4/988: chown d7/d1a/d5c/d6d/d59/d65/c97 15428306 1 2024-08-31T05:21:15.174 INFO:tasks.workunit.client.1.smithi073.stdout:4/989: rmdir d7/df/d13/d2e/d70/d6b 39 2024-08-31T05:21:15.178 INFO:tasks.workunit.client.1.smithi073.stdout:6/954: dwrite d15/d17/da1/dae/db0/d38/d9b/fad [0,4194304] 0 2024-08-31T05:21:15.184 INFO:tasks.workunit.client.0.smithi067.stdout:8/285: rename d0/d2/da/f22 to d0/d2/dc/d3d/f5e 0 2024-08-31T05:21:15.184 INFO:tasks.workunit.client.0.smithi067.stdout:8/286: stat d0/d4/de/l18 0 2024-08-31T05:21:15.186 INFO:tasks.workunit.client.0.smithi067.stdout:6/403: symlink d1b/d23/d28/d45/d5e/l7e 0 2024-08-31T05:21:15.189 INFO:tasks.workunit.client.1.smithi073.stdout:6/955: rename d15/d1a/d51/d61/d141/d127 to d15/d1a/d51/d61/ddc/d12a/d69/d148 0 2024-08-31T05:21:15.191 INFO:tasks.workunit.client.0.smithi067.stdout:5/215: dwrite db/d1d/f2d [0,4194304] 0 2024-08-31T05:21:15.191 INFO:tasks.workunit.client.0.smithi067.stdout:3/281: creat db/d2e/d50/d62/f66 x:0 0 0 2024-08-31T05:21:15.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:14 smithi073 ceph-mon[24726]: pgmap v28: 65 pgs: 65 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 80 MiB/s rd, 200 MiB/s wr, 404 op/s 2024-08-31T05:21:15.196 INFO:tasks.workunit.client.0.smithi067.stdout:7/195: rename d14/f17 to d14/d16/d28/d2e/d2f/f34 0 2024-08-31T05:21:15.198 INFO:tasks.workunit.client.1.smithi073.stdout:6/956: symlink d15/d1a/d51/d61/ddc/d12a/d69/d148/l149 0 2024-08-31T05:21:15.200 INFO:tasks.workunit.client.0.smithi067.stdout:3/282: mkdir db/d4e/d67 0 2024-08-31T05:21:15.201 INFO:tasks.workunit.client.0.smithi067.stdout:5/216: mkdir db/d15/d3e 0 2024-08-31T05:21:15.202 INFO:tasks.workunit.client.0.smithi067.stdout:9/170: link dd/d20/f2f dd/d20/f39 0 2024-08-31T05:21:15.202 INFO:tasks.workunit.client.0.smithi067.stdout:3/283: dread - db/d17/f65 zero size 2024-08-31T05:21:15.202 INFO:tasks.workunit.client.0.smithi067.stdout:0/251: dwrite d1/dd/d18/f3e [0,4194304] 0 2024-08-31T05:21:15.202 INFO:tasks.workunit.client.0.smithi067.stdout:5/217: fdatasync f4 0 2024-08-31T05:21:15.203 INFO:tasks.workunit.client.1.smithi073.stdout:6/957: rename d15/d1a/d51/d61/d7c to d15/d1a/d2b/d2f/d4b/d88/d144/d14a 0 2024-08-31T05:21:15.205 INFO:tasks.workunit.client.0.smithi067.stdout:9/171: write dd/df/f23 [1156136,100972] 0 2024-08-31T05:21:15.205 INFO:tasks.workunit.client.0.smithi067.stdout:5/218: dread - db/d26/d29/d2c/d36/f3d zero size 2024-08-31T05:21:15.206 INFO:tasks.workunit.client.0.smithi067.stdout:8/287: rename d0/d2/d6/l2d to d0/d2/dc/d28/l5f 0 2024-08-31T05:21:15.206 INFO:tasks.workunit.client.0.smithi067.stdout:7/196: rmdir d14/d16/d28/d2e/d2f 39 2024-08-31T05:21:15.208 INFO:tasks.workunit.client.0.smithi067.stdout:2/296: getdents db/dd 0 2024-08-31T05:21:15.208 INFO:tasks.workunit.client.0.smithi067.stdout:7/197: chown d14/d16/c33 272701 1 2024-08-31T05:21:15.209 INFO:tasks.workunit.client.0.smithi067.stdout:3/284: creat db/d2e/d50/f68 x:0 0 0 2024-08-31T05:21:15.210 INFO:tasks.workunit.client.0.smithi067.stdout:0/252: chown d1/df/d29/d37/c3b 1 1 2024-08-31T05:21:15.210 INFO:tasks.workunit.client.0.smithi067.stdout:9/172: fsync dd/df/d25/f26 0 2024-08-31T05:21:15.212 INFO:tasks.workunit.client.0.smithi067.stdout:0/253: write d1/d8/f16 [3397482,118002] 0 2024-08-31T05:21:15.212 INFO:tasks.workunit.client.0.smithi067.stdout:8/288: creat d0/d4/de/d1d/f60 x:0 0 0 2024-08-31T05:21:15.213 INFO:tasks.workunit.client.0.smithi067.stdout:0/254: fsync d1/df/d17/f4f 0 2024-08-31T05:21:15.213 INFO:tasks.workunit.client.0.smithi067.stdout:6/404: link lb d1b/d23/d2e/l7f 0 2024-08-31T05:21:15.214 INFO:tasks.workunit.client.0.smithi067.stdout:8/289: fsync d0/d4/de/d1d/d2c/f55 0 2024-08-31T05:21:15.216 INFO:tasks.workunit.client.0.smithi067.stdout:8/290: write d0/d2/dc/f16 [829973,70434] 0 2024-08-31T05:21:15.216 INFO:tasks.workunit.client.0.smithi067.stdout:2/297: truncate db/d12/d1a/d1e/f2f 978411 0 2024-08-31T05:21:15.222 INFO:tasks.workunit.client.0.smithi067.stdout:6/405: dwrite d1b/f20 [0,4194304] 0 2024-08-31T05:21:15.226 INFO:tasks.workunit.client.0.smithi067.stdout:3/285: dwrite db/d12/f2f [0,4194304] 0 2024-08-31T05:21:15.228 INFO:tasks.workunit.client.1.smithi073.stdout:6/958: dread d15/d1a/d51/d6e/fd4 [0,4194304] 0 2024-08-31T05:21:15.229 INFO:tasks.workunit.client.1.smithi073.stdout:6/959: stat d15/d1a/d2b/d2f/d4b/d88/d144/d14a/da6/c110 0 2024-08-31T05:21:15.233 INFO:tasks.workunit.client.0.smithi067.stdout:9/173: symlink dd/l3a 0 2024-08-31T05:21:15.236 INFO:tasks.workunit.client.0.smithi067.stdout:3/286: dwrite db/d12/f36 [0,4194304] 0 2024-08-31T05:21:15.236 INFO:tasks.workunit.client.1.smithi073.stdout:6/960: dwrite d15/d1a/d51/d6e/ddb/f10a [0,4194304] 0 2024-08-31T05:21:15.238 INFO:tasks.workunit.client.1.smithi073.stdout:6/961: chown d15/d1a/d2b/d2f/d4b/dff/f132 1 1 2024-08-31T05:21:15.239 INFO:tasks.workunit.client.0.smithi067.stdout:0/255: mkdir d1/d50 0 2024-08-31T05:21:15.242 INFO:tasks.workunit.client.0.smithi067.stdout:6/406: mknod d1b/d40/d70/d71/d78/c80 0 2024-08-31T05:21:15.242 INFO:tasks.workunit.client.0.smithi067.stdout:2/298: dwrite db/dd/d2d/f41 [0,4194304] 0 2024-08-31T05:21:15.245 INFO:tasks.workunit.client.0.smithi067.stdout:8/291: truncate d0/f40 2236461 0 2024-08-31T05:21:15.248 INFO:tasks.workunit.client.0.smithi067.stdout:3/287: mkdir db/d2e/d50/d69 0 2024-08-31T05:21:15.249 INFO:tasks.workunit.client.0.smithi067.stdout:7/198: getdents d14 0 2024-08-31T05:21:15.252 INFO:tasks.workunit.client.0.smithi067.stdout:0/256: creat d1/dd/d4d/f51 x:0 0 0 2024-08-31T05:21:15.253 INFO:tasks.workunit.client.0.smithi067.stdout:9/174: dwrite dd/df/d25/f2c [0,4194304] 0 2024-08-31T05:21:15.255 INFO:tasks.workunit.client.0.smithi067.stdout:2/299: rename db/dd/d2d/l43 to db/d12/d24/d3b/l52 0 2024-08-31T05:21:15.256 INFO:tasks.workunit.client.0.smithi067.stdout:6/407: symlink d1b/d23/l81 0 2024-08-31T05:21:15.257 INFO:tasks.workunit.client.0.smithi067.stdout:8/292: mkdir d0/d2/d61 0 2024-08-31T05:21:15.259 INFO:tasks.workunit.client.0.smithi067.stdout:0/257: mkdir d1/dd/d18/d52 0 2024-08-31T05:21:15.261 INFO:tasks.workunit.client.0.smithi067.stdout:9/175: mkdir dd/df/d25/d3b 0 2024-08-31T05:21:15.262 INFO:tasks.workunit.client.0.smithi067.stdout:2/300: rmdir db/d12/d1a/d2b/d42 39 2024-08-31T05:21:15.264 INFO:tasks.workunit.client.0.smithi067.stdout:6/408: mknod d1b/d23/d2f/d62/c82 0 2024-08-31T05:21:15.264 INFO:tasks.workunit.client.0.smithi067.stdout:2/301: read db/dd/d2d/f41 [154272,1041] 0 2024-08-31T05:21:15.265 INFO:tasks.workunit.client.1.smithi073.stdout:6/962: write d15/f36 [4319642,69668] 0 2024-08-31T05:21:15.265 INFO:tasks.workunit.client.0.smithi067.stdout:2/302: dread - db/f3a zero size 2024-08-31T05:21:15.265 INFO:tasks.workunit.client.0.smithi067.stdout:6/409: chown d1b/d40/d70/d71/d78 4 1 2024-08-31T05:21:15.266 INFO:tasks.workunit.client.0.smithi067.stdout:7/199: creat d14/d16/d28/f35 x:0 0 0 2024-08-31T05:21:15.266 INFO:tasks.workunit.client.1.smithi073.stdout:6/963: write d15/d1a/d2b/d12d/f117 [1506001,7868] 0 2024-08-31T05:21:15.267 INFO:tasks.workunit.client.0.smithi067.stdout:8/293: mkdir d0/d2/dc/d62 0 2024-08-31T05:21:15.268 INFO:tasks.workunit.client.0.smithi067.stdout:7/200: write d14/d16/d28/f29 [4670000,2490] 0 2024-08-31T05:21:15.269 INFO:tasks.workunit.client.0.smithi067.stdout:0/258: write d1/df/d17/f4c [1010877,8656] 0 2024-08-31T05:21:15.271 INFO:tasks.workunit.client.0.smithi067.stdout:7/201: read d14/d16/f32 [1289046,12033] 0 2024-08-31T05:21:15.273 INFO:tasks.workunit.client.0.smithi067.stdout:6/410: rename d1b/d23/d2e/f54 to d1b/d40/f83 0 2024-08-31T05:21:15.275 INFO:tasks.workunit.client.0.smithi067.stdout:8/294: symlink d0/d4/de/l63 0 2024-08-31T05:21:15.276 INFO:tasks.workunit.client.1.smithi073.stdout:6/964: getdents d15/d1a/d51/d61/d141/dc8/dea 0 2024-08-31T05:21:15.276 INFO:tasks.workunit.client.0.smithi067.stdout:8/295: truncate d0/d2/da/f57 113397 0 2024-08-31T05:21:15.280 INFO:tasks.workunit.client.1.smithi073.stdout:4/990: sync 2024-08-31T05:21:15.286 INFO:tasks.workunit.client.0.smithi067.stdout:0/259: truncate d1/dd/f21 232571 0 2024-08-31T05:21:15.287 INFO:tasks.workunit.client.1.smithi073.stdout:6/965: getdents d15/d1a/d2b/d2f/d4b/d88/d144 0 2024-08-31T05:21:15.291 INFO:tasks.workunit.client.0.smithi067.stdout:2/303: link db/d12/d1a/f20 db/d12/d1a/d2b/d42/f53 0 2024-08-31T05:21:15.291 INFO:tasks.workunit.client.1.smithi073.stdout:6/966: dwrite d15/d17/f5e [0,4194304] 0 2024-08-31T05:21:15.292 INFO:tasks.workunit.client.0.smithi067.stdout:9/176: getdents dd/d20 0 2024-08-31T05:21:15.293 INFO:tasks.workunit.client.0.smithi067.stdout:6/411: dread d1b/d23/f4f [0,4194304] 0 2024-08-31T05:21:15.294 INFO:tasks.workunit.client.1.smithi073.stdout:4/991: link d7/df/d13/d2e/d70/d6b/f8f d7/df/d13/d53/d88/f138 0 2024-08-31T05:21:15.294 INFO:tasks.workunit.client.0.smithi067.stdout:8/296: mkdir d0/d4/d64 0 2024-08-31T05:21:15.295 INFO:tasks.workunit.client.1.smithi073.stdout:4/992: read - d7/df/d13/d53/d88/dc7/ff1 zero size 2024-08-31T05:21:15.296 INFO:tasks.workunit.client.1.smithi073.stdout:6/967: creat d15/d1a/d2b/d2f/d4b/d88/d144/d14a/da6/df6/f14b x:0 0 0 2024-08-31T05:21:15.298 INFO:tasks.workunit.client.0.smithi067.stdout:2/304: chown db/d12/d1a/d1e/f2f 5 1 2024-08-31T05:21:15.303 INFO:tasks.workunit.client.0.smithi067.stdout:7/202: getdents d14/d16/d28/d2e 0 2024-08-31T05:21:15.304 INFO:tasks.workunit.client.1.smithi073.stdout:4/993: rename d7/db/f2a to d7/d1a/d5c/d6d/d2c/d2d/da6/f139 0 2024-08-31T05:21:15.305 INFO:tasks.workunit.client.1.smithi073.stdout:4/994: dread - d7/df/d79/d7a/fd8 zero size 2024-08-31T05:21:15.306 INFO:tasks.workunit.client.0.smithi067.stdout:2/305: creat db/d12/d1a/d1e/f54 x:0 0 0 2024-08-31T05:21:15.306 INFO:tasks.workunit.client.1.smithi073.stdout:4/995: stat d7/df/d13/d2e/d70/le7 0 2024-08-31T05:21:15.307 INFO:tasks.workunit.client.1.smithi073.stdout:4/996: chown d7/d1a/d5c/d6d/f129 1 1 2024-08-31T05:21:15.308 INFO:tasks.workunit.client.1.smithi073.stdout:4/997: read - d7/df/f103 zero size 2024-08-31T05:21:15.308 INFO:tasks.workunit.client.1.smithi073.stdout:4/998: readlink d7/d1a/d5c/d62/l83 0 2024-08-31T05:21:15.309 INFO:tasks.workunit.client.0.smithi067.stdout:0/260: link d1/dd/c10 d1/dd/d4d/c53 0 2024-08-31T05:21:15.309 INFO:tasks.workunit.client.1.smithi073.stdout:4/999: chown d7/df/f131 1794 1 2024-08-31T05:21:15.310 INFO:tasks.workunit.client.0.smithi067.stdout:0/261: write d1/dd/d4d/f51 [397047,130317] 0 2024-08-31T05:21:15.311 INFO:tasks.workunit.client.0.smithi067.stdout:2/306: fdatasync db/d12/d1a/d1e/f2f 0 2024-08-31T05:21:15.311 INFO:tasks.workunit.client.0.smithi067.stdout:0/262: fsync d1/d8/f23 0 2024-08-31T05:21:15.313 INFO:tasks.workunit.client.0.smithi067.stdout:9/177: getdents dd/df/d25 0 2024-08-31T05:21:15.316 INFO:tasks.workunit.client.0.smithi067.stdout:2/307: symlink db/d12/d1a/d2b/l55 0 2024-08-31T05:21:15.321 INFO:tasks.workunit.client.0.smithi067.stdout:9/178: dwrite dd/df/f28 [0,4194304] 0 2024-08-31T05:21:15.323 INFO:tasks.workunit.client.1.smithi073.stdout:6/968: truncate d15/d1a/d2b/d12d/f117 356960 0 2024-08-31T05:21:15.325 INFO:tasks.workunit.client.0.smithi067.stdout:7/203: truncate d14/d16/d28/f29 877461 0 2024-08-31T05:21:15.325 INFO:tasks.workunit.client.0.smithi067.stdout:2/308: truncate db/d12/d1a/d2b/d42/f53 194695 0 2024-08-31T05:21:15.327 INFO:tasks.workunit.client.0.smithi067.stdout:2/309: write db/d12/d1a/f36 [256284,26689] 0 2024-08-31T05:21:15.328 INFO:tasks.workunit.client.1.smithi073.stdout:6/969: mkdir d15/d1a/d51/d6e/d14c 0 2024-08-31T05:21:15.332 INFO:tasks.workunit.client.0.smithi067.stdout:9/179: rmdir dd/df/d31 0 2024-08-31T05:21:15.334 INFO:tasks.workunit.client.0.smithi067.stdout:8/297: write d0/f40 [282642,48360] 0 2024-08-31T05:21:15.336 INFO:tasks.workunit.client.0.smithi067.stdout:7/204: link d14/d16/f32 d14/d16/d28/d2e/f36 0 2024-08-31T05:21:15.339 INFO:tasks.workunit.client.0.smithi067.stdout:0/263: dwrite d1/df/d29/f49 [0,4194304] 0 2024-08-31T05:21:15.339 INFO:tasks.workunit.client.0.smithi067.stdout:9/180: fsync dd/df/f28 0 2024-08-31T05:21:15.339 INFO:tasks.workunit.client.0.smithi067.stdout:2/310: dwrite db/dd/f4c [0,4194304] 0 2024-08-31T05:21:15.341 INFO:tasks.workunit.client.0.smithi067.stdout:0/264: fdatasync d1/dd/f15 0 2024-08-31T05:21:15.342 INFO:tasks.workunit.client.0.smithi067.stdout:7/205: dread d14/d16/f1d [0,4194304] 0 2024-08-31T05:21:15.343 INFO:tasks.workunit.client.0.smithi067.stdout:7/206: readlink la 0 2024-08-31T05:21:15.349 INFO:tasks.workunit.client.0.smithi067.stdout:9/181: mkdir dd/df/d3c 0 2024-08-31T05:21:15.350 INFO:tasks.workunit.client.0.smithi067.stdout:8/298: truncate d0/d2/dc/d3d/f5e 988403 0 2024-08-31T05:21:15.352 INFO:tasks.workunit.client.0.smithi067.stdout:8/299: dread d0/d2/da/f57 [0,4194304] 0 2024-08-31T05:21:15.364 INFO:tasks.workunit.client.1.smithi073.stdout:6/970: dread d15/f1f [0,4194304] 0 2024-08-31T05:21:15.370 INFO:tasks.workunit.client.0.smithi067.stdout:0/265: dread d1/f6 [0,4194304] 0 2024-08-31T05:21:15.373 INFO:tasks.workunit.client.0.smithi067.stdout:8/300: dread d0/d4/f20 [0,4194304] 0 2024-08-31T05:21:15.417 INFO:tasks.workunit.client.0.smithi067.stdout:2/311: creat db/d12/d1a/d1e/d4d/f56 x:0 0 0 2024-08-31T05:21:15.418 INFO:tasks.workunit.client.0.smithi067.stdout:2/312: fdatasync db/f25 0 2024-08-31T05:21:15.418 INFO:tasks.workunit.client.1.smithi073.stdout:6/971: mknod d15/d1a/d2b/d2f/d4b/d88/d144/d14a/da6/df6/c14d 0 2024-08-31T05:21:15.421 INFO:tasks.workunit.client.0.smithi067.stdout:0/266: mkdir d1/df/d29/d54 0 2024-08-31T05:21:15.423 INFO:tasks.workunit.client.0.smithi067.stdout:8/301: mknod d0/d2/da/dd/c65 0 2024-08-31T05:21:15.436 INFO:tasks.workunit.client.0.smithi067.stdout:2/313: write db/dd/d13/f14 [251229,38650] 0 2024-08-31T05:21:15.437 INFO:tasks.workunit.client.0.smithi067.stdout:2/314: chown db/dd/f11 159088334 1 2024-08-31T05:21:15.440 INFO:tasks.workunit.client.0.smithi067.stdout:0/267: getdents d1/df/d29/d44 0 2024-08-31T05:21:15.443 INFO:tasks.workunit.client.0.smithi067.stdout:7/207: creat d14/d16/d28/d2e/f37 x:0 0 0 2024-08-31T05:21:15.446 INFO:tasks.workunit.client.0.smithi067.stdout:2/315: getdents db/d12/d1a/d31 0 2024-08-31T05:21:15.447 INFO:tasks.workunit.client.0.smithi067.stdout:8/302: getdents d0/d2/d6 0 2024-08-31T05:21:15.448 INFO:tasks.workunit.client.0.smithi067.stdout:8/303: chown d0/d2/dc/d3d/d52 755557 1 2024-08-31T05:21:15.449 INFO:tasks.workunit.client.0.smithi067.stdout:7/208: fsync d14/d16/f32 0 2024-08-31T05:21:15.450 INFO:tasks.workunit.client.0.smithi067.stdout:2/316: symlink db/d12/d24/d3b/l57 0 2024-08-31T05:21:15.451 INFO:tasks.workunit.client.0.smithi067.stdout:2/317: chown f1 7921 1 2024-08-31T05:21:15.455 INFO:tasks.workunit.client.0.smithi067.stdout:7/209: rmdir d14 39 2024-08-31T05:21:15.455 INFO:tasks.workunit.client.0.smithi067.stdout:8/304: dread d0/d2/dc/f49 [0,4194304] 0 2024-08-31T05:21:15.457 INFO:tasks.workunit.client.0.smithi067.stdout:2/318: symlink db/dd/d13/l58 0 2024-08-31T05:21:15.462 INFO:tasks.workunit.client.0.smithi067.stdout:2/319: write db/dd/f11 [3313632,112415] 0 2024-08-31T05:21:15.468 INFO:tasks.workunit.client.0.smithi067.stdout:2/320: creat db/d12/d1a/d1e/d4d/f59 x:0 0 0 2024-08-31T05:21:15.476 INFO:tasks.workunit.client.0.smithi067.stdout:7/210: link d14/f15 d14/d16/d28/d2e/f38 0 2024-08-31T05:21:15.478 INFO:tasks.workunit.client.0.smithi067.stdout:2/321: creat db/d12/d1a/d2b/f5a x:0 0 0 2024-08-31T05:21:15.483 INFO:tasks.workunit.client.0.smithi067.stdout:2/322: creat db/f5b x:0 0 0 2024-08-31T05:21:15.486 INFO:tasks.workunit.client.0.smithi067.stdout:2/323: stat db/d12/d1a/d2b/d3d/d4f 0 2024-08-31T05:21:15.487 INFO:tasks.workunit.client.0.smithi067.stdout:8/305: dwrite d0/d2/dc/d3d/f5e [0,4194304] 0 2024-08-31T05:21:15.488 INFO:tasks.workunit.client.0.smithi067.stdout:8/306: chown d0/d2/da/dd/c43 22 1 2024-08-31T05:21:15.491 INFO:tasks.workunit.client.0.smithi067.stdout:2/324: mkdir db/d12/d1a/d5c 0 2024-08-31T05:21:15.492 INFO:tasks.workunit.client.0.smithi067.stdout:2/325: write db/dd/d13/f28 [1314291,115600] 0 2024-08-31T05:21:15.494 INFO:tasks.workunit.client.0.smithi067.stdout:8/307: rename d0/d2/d6/f27 to d0/d2/d61/f66 0 2024-08-31T05:21:15.494 INFO:tasks.workunit.client.0.smithi067.stdout:2/326: chown db/d12/d1a/d1e/d4d 26 1 2024-08-31T05:21:15.495 INFO:tasks.workunit.client.0.smithi067.stdout:2/327: truncate db/d12/d1a/d1e/d4d/f56 43598 0 2024-08-31T05:21:15.496 INFO:tasks.workunit.client.0.smithi067.stdout:2/328: dread - db/d12/f44 zero size 2024-08-31T05:21:15.497 INFO:tasks.workunit.client.0.smithi067.stdout:8/308: creat d0/d2/dc/d3d/f67 x:0 0 0 2024-08-31T05:21:15.498 INFO:tasks.workunit.client.0.smithi067.stdout:2/329: creat db/dd/d2d/f5d x:0 0 0 2024-08-31T05:21:15.499 INFO:tasks.workunit.client.0.smithi067.stdout:2/330: stat db/f3a 0 2024-08-31T05:21:15.499 INFO:tasks.workunit.client.0.smithi067.stdout:8/309: mkdir d0/d4/de/d1d/d2c/d68 0 2024-08-31T05:21:15.500 INFO:tasks.workunit.client.0.smithi067.stdout:8/310: write d0/d4/de/d1d/f39 [192443,94625] 0 2024-08-31T05:21:15.501 INFO:tasks.workunit.client.0.smithi067.stdout:2/331: symlink db/d12/d1a/d1e/d4d/l5e 0 2024-08-31T05:21:15.504 INFO:tasks.workunit.client.0.smithi067.stdout:2/332: mkdir db/d12/d1a/d1e/d5f 0 2024-08-31T05:21:15.505 INFO:tasks.workunit.client.0.smithi067.stdout:8/311: creat d0/d2/dc/d62/f69 x:0 0 0 2024-08-31T05:21:15.506 INFO:tasks.workunit.client.0.smithi067.stdout:8/312: dread - d0/d2/dc/d62/f69 zero size 2024-08-31T05:21:15.507 INFO:tasks.workunit.client.0.smithi067.stdout:2/333: unlink db/d12/d1a/f20 0 2024-08-31T05:21:15.508 INFO:tasks.workunit.client.0.smithi067.stdout:2/334: write db/dd/d2d/f51 [485558,62349] 0 2024-08-31T05:21:15.510 INFO:tasks.workunit.client.1.smithi073.stdout:6/972: write d15/f102 [5141224,80346] 0 2024-08-31T05:21:15.512 INFO:tasks.workunit.client.1.smithi073.stdout:6/973: rmdir d15/d17/da1/dae/db0/d38/d9b/d87 39 2024-08-31T05:21:15.514 INFO:tasks.workunit.client.0.smithi067.stdout:8/313: rename d0/d2/d61/f66 to d0/d2/da/dd/f6a 0 2024-08-31T05:21:15.516 INFO:tasks.workunit.client.1.smithi073.stdout:6/974: fdatasync d15/d1a/d51/d61/d141/f76 0 2024-08-31T05:21:15.517 INFO:tasks.workunit.client.1.smithi073.stdout:6/975: dread - d15/d1a/d51/d61/ddc/d12a/f123 zero size 2024-08-31T05:21:15.522 INFO:tasks.workunit.client.1.smithi073.stdout:6/976: creat d15/d1a/d2b/f14e x:0 0 0 2024-08-31T05:21:15.523 INFO:tasks.workunit.client.1.smithi073.stdout:6/977: fsync d15/d17/da1/fbc 0 2024-08-31T05:21:15.524 INFO:tasks.workunit.client.1.smithi073.stdout:6/978: write d15/d17/da1/f122 [16477,118691] 0 2024-08-31T05:21:15.527 INFO:tasks.workunit.client.1.smithi073.stdout:6/979: mkdir d15/d1a/d51/d61/d141/d14f 0 2024-08-31T05:21:15.529 INFO:tasks.workunit.client.1.smithi073.stdout:6/980: rmdir d15/d17/da1/dae/db0/de1 39 2024-08-31T05:21:15.532 INFO:tasks.workunit.client.1.smithi073.stdout:6/981: write d15/d1a/d51/f70 [5031694,129446] 0 2024-08-31T05:21:15.534 INFO:tasks.workunit.client.1.smithi073.stdout:6/982: symlink d15/d1a/d2b/d2f/d99/db3/l150 0 2024-08-31T05:21:15.538 INFO:tasks.workunit.client.1.smithi073.stdout:6/983: write d15/d1a/d2b/d2f/f30 [1496233,60469] 0 2024-08-31T05:21:15.539 INFO:tasks.workunit.client.1.smithi073.stdout:6/984: readlink d15/d1a/d2b/d2f/l84 0 2024-08-31T05:21:15.544 INFO:tasks.workunit.client.1.smithi073.stdout:6/985: rename d15/d17/d138 to d15/d17/da1/dae/db0/d38/d151 0 2024-08-31T05:21:15.548 INFO:tasks.workunit.client.1.smithi073.stdout:6/986: link d15/d1a/d51/d61/ddc/d12a/d69/d7e/ce9 d15/d1a/d2b/d2f/d4b/c152 0 2024-08-31T05:21:15.549 INFO:tasks.workunit.client.1.smithi073.stdout:6/987: write d15/d17/da1/dae/fd6 [1857130,25718] 0 2024-08-31T05:21:15.550 INFO:tasks.workunit.client.1.smithi073.stdout:6/988: fsync d15/f36 0 2024-08-31T05:21:15.550 INFO:tasks.workunit.client.1.smithi073.stdout:6/989: chown d15/f47 5 1 2024-08-31T05:21:15.551 INFO:tasks.workunit.client.1.smithi073.stdout:6/990: dread - d15/d1a/d51/d61/ddc/d12a/f123 zero size 2024-08-31T05:21:15.556 INFO:tasks.workunit.client.1.smithi073.stdout:6/991: dwrite d15/d1a/d2b/d12d/f136 [0,4194304] 0 2024-08-31T05:21:15.558 INFO:tasks.workunit.client.1.smithi073.stdout:6/992: write d15/d17/da1/dae/db0/d38/d9b/f73 [590174,50372] 0 2024-08-31T05:21:15.560 INFO:tasks.workunit.client.1.smithi073.stdout:6/993: read d15/d1a/d51/d61/fbf [11241,42885] 0 2024-08-31T05:21:15.563 INFO:tasks.workunit.client.1.smithi073.stdout:6/994: mkdir d15/d1a/d153 0 2024-08-31T05:21:15.564 INFO:tasks.workunit.client.1.smithi073.stdout:6/995: fdatasync d15/d17/da1/dae/db0/d38/d9b/f9d 0 2024-08-31T05:21:15.577 INFO:tasks.workunit.client.1.smithi073.stdout:6/996: dread d15/f29 [0,4194304] 0 2024-08-31T05:21:15.584 INFO:tasks.workunit.client.1.smithi073.stdout:6/997: rename d15/d1a/d51/d61/fbf to d15/d1a/d2b/f154 0 2024-08-31T05:21:15.585 INFO:tasks.workunit.client.1.smithi073.stdout:6/998: chown d15/d17/da1/dae/db0/d38/ff1 5468 1 2024-08-31T05:21:15.585 INFO:tasks.workunit.client.1.smithi073.stdout:6/999: symlink d15/d1a/d2b/d2f/d4b/d88/d144/d14a/da6/df6/l155 0 2024-08-31T05:21:15.588 INFO:tasks.workunit.client.1.smithi073.stderr:+ rm -rf -- ./tmp.XN6wATsPTV 2024-08-31T05:21:15.806 INFO:tasks.workunit.client.0.smithi067.stdout:1/199: sync 2024-08-31T05:21:15.809 INFO:tasks.workunit.client.0.smithi067.stdout:1/200: mknod d3/d23/d2d/d2e/d3a/c46 0 2024-08-31T05:21:15.812 INFO:tasks.workunit.client.0.smithi067.stdout:1/201: getdents d3/d23/d2d/d2e 0 2024-08-31T05:21:15.813 INFO:tasks.workunit.client.0.smithi067.stdout:1/202: dread - d3/d23/f3c zero size 2024-08-31T05:21:15.814 INFO:tasks.workunit.client.0.smithi067.stdout:1/203: write d3/dd/f1b [468171,129798] 0 2024-08-31T05:21:15.819 INFO:tasks.workunit.client.0.smithi067.stdout:1/204: dwrite d3/dd/f20 [0,4194304] 0 2024-08-31T05:21:15.822 INFO:tasks.workunit.client.0.smithi067.stdout:1/205: creat d3/d36/f47 x:0 0 0 2024-08-31T05:21:15.830 INFO:tasks.workunit.client.0.smithi067.stdout:1/206: link d3/f19 d3/d23/d2d/d2e/d3a/f48 0 2024-08-31T05:21:15.831 INFO:tasks.workunit.client.0.smithi067.stdout:1/207: write d3/f13 [4671623,99154] 0 2024-08-31T05:21:15.833 INFO:tasks.workunit.client.0.smithi067.stdout:1/208: symlink d3/d23/d2d/d2e/l49 0 2024-08-31T05:21:15.836 INFO:tasks.workunit.client.0.smithi067.stdout:1/209: mknod d3/d23/d2d/d2e/d34/c4a 0 2024-08-31T05:21:15.842 INFO:tasks.workunit.client.0.smithi067.stdout:1/210: dwrite d3/dd/f21 [0,4194304] 0 2024-08-31T05:21:15.843 INFO:tasks.workunit.client.0.smithi067.stdout:1/211: rmdir d3/d23/d2d/d2e 39 2024-08-31T05:21:15.844 INFO:tasks.workunit.client.0.smithi067.stdout:1/212: read - d3/f24 zero size 2024-08-31T05:21:15.844 INFO:tasks.workunit.client.0.smithi067.stdout:1/213: chown d3/f5 489 1 2024-08-31T05:21:15.846 INFO:tasks.workunit.client.0.smithi067.stdout:1/214: write d3/d23/d2d/d2e/f37 [4986790,67384] 0 2024-08-31T05:21:15.849 INFO:tasks.workunit.client.0.smithi067.stdout:1/215: truncate d3/dd/f1d 780836 0 2024-08-31T05:21:15.851 INFO:tasks.workunit.client.0.smithi067.stdout:1/216: chown d3/d23/d2d/d2e/d34/c40 47 1 2024-08-31T05:21:15.852 INFO:tasks.workunit.client.0.smithi067.stdout:1/217: creat d3/d23/d2d/d2e/f4b x:0 0 0 2024-08-31T05:21:15.854 INFO:tasks.workunit.client.0.smithi067.stdout:1/218: rename d3/c2a to d3/dd/c4c 0 2024-08-31T05:21:15.855 INFO:tasks.workunit.client.0.smithi067.stdout:1/219: write d3/dd/f1b [1104415,117267] 0 2024-08-31T05:21:15.856 INFO:tasks.workunit.client.0.smithi067.stdout:1/220: mknod d3/d23/d2d/d2e/d34/c4d 0 2024-08-31T05:21:15.857 INFO:tasks.workunit.client.0.smithi067.stdout:1/221: rmdir d3 39 2024-08-31T05:21:15.863 INFO:tasks.workunit.client.0.smithi067.stdout:1/222: unlink d3/dd/f1d 0 2024-08-31T05:21:15.865 INFO:tasks.workunit.client.0.smithi067.stdout:1/223: creat d3/dd/f4e x:0 0 0 2024-08-31T05:21:15.868 INFO:tasks.workunit.client.0.smithi067.stdout:1/224: rename d3/dd/f1b to d3/d23/d2d/d2e/d3a/f4f 0 2024-08-31T05:21:15.869 INFO:tasks.workunit.client.0.smithi067.stdout:1/225: mkdir d3/dd/d50 0 2024-08-31T05:21:15.893 INFO:tasks.workunit.client.0.smithi067.stdout:1/226: dread d3/d23/f33 [8388608,4194304] 0 2024-08-31T05:21:15.895 INFO:tasks.workunit.client.0.smithi067.stdout:1/227: rename d3/f1e to d3/dd/f51 0 2024-08-31T05:21:16.005 INFO:tasks.workunit.client.0.smithi067.stdout:5/219: sync 2024-08-31T05:21:16.005 INFO:tasks.workunit.client.0.smithi067.stdout:4/177: sync 2024-08-31T05:21:16.019 INFO:tasks.workunit.client.0.smithi067.stdout:5/220: dread db/f1b [0,4194304] 0 2024-08-31T05:21:16.032 INFO:tasks.workunit.client.0.smithi067.stdout:5/221: fsync db/d26/d29/f2f 0 2024-08-31T05:21:16.032 INFO:tasks.workunit.client.0.smithi067.stdout:4/178: truncate d4/d1e/d21/f3a 865847 0 2024-08-31T05:21:16.040 INFO:tasks.workunit.client.0.smithi067.stdout:5/222: rmdir db/d15/d3e 0 2024-08-31T05:21:16.043 INFO:tasks.workunit.client.0.smithi067.stdout:5/223: rename db/lf to db/d26/l3f 0 2024-08-31T05:21:16.043 INFO:tasks.workunit.client.0.smithi067.stdout:5/224: dread - db/f2e zero size 2024-08-31T05:21:16.049 INFO:tasks.workunit.client.0.smithi067.stdout:5/225: dwrite db/d15/f12 [0,4194304] 0 2024-08-31T05:21:16.050 INFO:tasks.workunit.client.0.smithi067.stdout:5/226: rename db/d26/d29/d2c to db/d26/d29/d2c/d40 22 2024-08-31T05:21:16.055 INFO:tasks.workunit.client.0.smithi067.stdout:5/227: link db/d26/d29/f38 db/d26/d29/d31/f41 0 2024-08-31T05:21:16.060 INFO:tasks.workunit.client.0.smithi067.stdout:5/228: truncate f4 2131660 0 2024-08-31T05:21:16.062 INFO:tasks.workunit.client.0.smithi067.stdout:5/229: rename db/d26/d29/d2c to db/d15/d42 0 2024-08-31T05:21:16.063 INFO:tasks.workunit.client.0.smithi067.stdout:5/230: fsync db/f1e 0 2024-08-31T05:21:16.066 INFO:tasks.workunit.client.0.smithi067.stdout:5/231: dread db/d15/f12 [0,4194304] 0 2024-08-31T05:21:16.072 INFO:tasks.workunit.client.0.smithi067.stdout:5/232: creat db/d1d/d3a/f43 x:0 0 0 2024-08-31T05:21:16.075 INFO:tasks.workunit.client.0.smithi067.stdout:5/233: fsync f7 0 2024-08-31T05:21:16.076 INFO:tasks.workunit.client.0.smithi067.stdout:5/234: read db/f1e [152724,97149] 0 2024-08-31T05:21:16.077 INFO:tasks.workunit.client.0.smithi067.stdout:5/235: chown c8 421849268 1 2024-08-31T05:21:16.264 INFO:tasks.workunit.client.0.smithi067.stdout:3/288: sync 2024-08-31T05:21:16.266 INFO:tasks.workunit.client.0.smithi067.stdout:3/289: mkdir db/d2e/d6a 0 2024-08-31T05:21:16.267 INFO:tasks.workunit.client.0.smithi067.stdout:3/290: mknod db/d17/c6b 0 2024-08-31T05:21:16.268 INFO:tasks.workunit.client.0.smithi067.stdout:3/291: truncate db/d12/d21/f52 5231549 0 2024-08-31T05:21:16.270 INFO:tasks.workunit.client.0.smithi067.stdout:3/292: creat db/d17/f6c x:0 0 0 2024-08-31T05:21:16.270 INFO:tasks.workunit.client.0.smithi067.stdout:3/293: chown db/d12/f1f 35 1 2024-08-31T05:21:16.272 INFO:tasks.workunit.client.0.smithi067.stdout:3/294: mknod db/d17/d3f/c6d 0 2024-08-31T05:21:16.275 INFO:tasks.workunit.client.0.smithi067.stdout:3/295: rename db/d4e/d67 to db/d17/d3f/d54/d56/d6e 0 2024-08-31T05:21:16.276 INFO:tasks.workunit.client.0.smithi067.stdout:3/296: dread - db/d17/d3f/d54/f64 zero size 2024-08-31T05:21:16.284 INFO:tasks.workunit.client.0.smithi067.stdout:3/297: creat db/f6f x:0 0 0 2024-08-31T05:21:16.287 INFO:tasks.workunit.client.0.smithi067.stdout:3/298: dread db/f3d [0,4194304] 0 2024-08-31T05:21:16.288 INFO:tasks.workunit.client.0.smithi067.stdout:3/299: dread - db/d17/d3f/d54/f64 zero size 2024-08-31T05:21:16.291 INFO:tasks.workunit.client.0.smithi067.stdout:3/300: symlink db/d55/l70 0 2024-08-31T05:21:16.292 INFO:tasks.workunit.client.0.smithi067.stdout:3/301: chown db/d2c/f31 3388486 1 2024-08-31T05:21:16.297 INFO:tasks.workunit.client.0.smithi067.stdout:3/302: dwrite db/d2c/f31 [0,4194304] 0 2024-08-31T05:21:16.301 INFO:tasks.workunit.client.0.smithi067.stdout:9/182: sync 2024-08-31T05:21:16.301 INFO:tasks.workunit.client.0.smithi067.stdout:6/412: sync 2024-08-31T05:21:16.301 INFO:tasks.workunit.client.0.smithi067.stdout:0/268: sync 2024-08-31T05:21:16.301 INFO:tasks.workunit.client.0.smithi067.stdout:3/303: rename db/d2c/l32 to db/d5a/l71 0 2024-08-31T05:21:16.304 INFO:tasks.workunit.client.0.smithi067.stdout:6/413: rmdir d1b/d40 39 2024-08-31T05:21:16.306 INFO:tasks.workunit.client.0.smithi067.stdout:3/304: write db/d12/d21/f25 [3158507,95571] 0 2024-08-31T05:21:16.308 INFO:tasks.workunit.client.0.smithi067.stdout:6/414: truncate fd 1576561 0 2024-08-31T05:21:16.309 INFO:tasks.workunit.client.0.smithi067.stdout:0/269: dwrite d1/dd/f15 [4194304,4194304] 0 2024-08-31T05:21:16.310 INFO:tasks.workunit.client.0.smithi067.stdout:0/270: readlink d1/df/l2a 0 2024-08-31T05:21:16.312 INFO:tasks.workunit.client.0.smithi067.stdout:9/183: rename dd/df/f28 to dd/f3d 0 2024-08-31T05:21:16.313 INFO:tasks.workunit.client.0.smithi067.stdout:3/305: mknod db/d17/d3f/d54/d56/d6e/c72 0 2024-08-31T05:21:16.314 INFO:tasks.workunit.client.0.smithi067.stdout:0/271: getdents d1/df/d29/d54 0 2024-08-31T05:21:16.315 INFO:tasks.workunit.client.0.smithi067.stdout:3/306: creat db/d5a/f73 x:0 0 0 2024-08-31T05:21:16.317 INFO:tasks.workunit.client.0.smithi067.stdout:3/307: mknod db/d2c/c74 0 2024-08-31T05:21:16.319 INFO:tasks.workunit.client.0.smithi067.stdout:0/272: mknod d1/d50/c55 0 2024-08-31T05:21:16.319 INFO:tasks.workunit.client.0.smithi067.stdout:3/308: stat db/d17/d3f/d54/d56/d6e/c72 0 2024-08-31T05:21:16.320 INFO:tasks.workunit.client.0.smithi067.stdout:6/415: dread f19 [0,4194304] 0 2024-08-31T05:21:16.321 INFO:tasks.workunit.client.0.smithi067.stdout:6/416: write f14 [231844,76023] 0 2024-08-31T05:21:16.323 INFO:tasks.workunit.client.0.smithi067.stdout:3/309: dread db/d17/f24 [0,4194304] 0 2024-08-31T05:21:16.326 INFO:tasks.workunit.client.0.smithi067.stdout:0/273: truncate d1/dd/f21 354801 0 2024-08-31T05:21:16.327 INFO:tasks.workunit.client.0.smithi067.stdout:0/274: write d1/df/d29/f49 [216105,101805] 0 2024-08-31T05:21:16.328 INFO:tasks.workunit.client.0.smithi067.stdout:6/417: symlink d1b/d40/d70/d71/d78/l84 0 2024-08-31T05:21:16.339 INFO:tasks.workunit.client.0.smithi067.stdout:0/275: rmdir d1/df/d29/d54 0 2024-08-31T05:21:16.342 INFO:tasks.workunit.client.0.smithi067.stdout:0/276: creat d1/df/d29/d37/f56 x:0 0 0 2024-08-31T05:21:16.346 INFO:tasks.workunit.client.0.smithi067.stdout:0/277: rename d1/d8/f36 to d1/d50/f57 0 2024-08-31T05:21:16.348 INFO:tasks.workunit.client.0.smithi067.stdout:3/310: truncate f4 1136700 0 2024-08-31T05:21:16.350 INFO:tasks.workunit.client.0.smithi067.stdout:0/278: creat d1/dd/f58 x:0 0 0 2024-08-31T05:21:16.352 INFO:tasks.workunit.client.0.smithi067.stdout:3/311: rename db/d12/d21/f25 to db/d17/d3f/d54/d56/d6e/f75 0 2024-08-31T05:21:16.355 INFO:tasks.workunit.client.0.smithi067.stdout:0/279: rename d1/df/c45 to d1/dd/d18/d52/c59 0 2024-08-31T05:21:16.358 INFO:tasks.workunit.client.0.smithi067.stdout:0/280: symlink d1/dd/d4d/l5a 0 2024-08-31T05:21:16.361 INFO:tasks.workunit.client.0.smithi067.stdout:0/281: dread d1/dd/f15 [4194304,4194304] 0 2024-08-31T05:21:16.372 INFO:tasks.workunit.client.0.smithi067.stdout:3/312: write db/d17/f24 [698862,122226] 0 2024-08-31T05:21:16.381 INFO:tasks.workunit.client.0.smithi067.stdout:0/282: dread d1/f2c [0,4194304] 0 2024-08-31T05:21:16.387 INFO:tasks.workunit.client.0.smithi067.stdout:0/283: link d1/d8/f23 d1/dd/d18/d52/f5b 0 2024-08-31T05:21:16.390 INFO:tasks.workunit.client.0.smithi067.stdout:0/284: write d1/dd/d18/d52/f5b [3650752,48240] 0 2024-08-31T05:21:16.395 INFO:tasks.workunit.client.0.smithi067.stdout:0/285: dread d1/f39 [0,4194304] 0 2024-08-31T05:21:16.395 INFO:tasks.workunit.client.0.smithi067.stdout:0/286: dread - d1/d8/f4b zero size 2024-08-31T05:21:16.398 INFO:tasks.workunit.client.0.smithi067.stdout:0/287: dread d1/f2c [0,4194304] 0 2024-08-31T05:21:16.402 INFO:tasks.workunit.client.0.smithi067.stdout:0/288: symlink d1/l5c 0 2024-08-31T05:21:16.409 INFO:tasks.workunit.client.0.smithi067.stdout:0/289: getdents d1/d8 0 2024-08-31T05:21:16.428 INFO:tasks.workunit.client.0.smithi067.stdout:0/290: truncate d1/df/f1d 4710688 0 2024-08-31T05:21:16.431 INFO:tasks.workunit.client.0.smithi067.stdout:0/291: unlink d1/l4e 0 2024-08-31T05:21:16.433 INFO:tasks.workunit.client.0.smithi067.stdout:0/292: truncate d1/dd/f15 5492183 0 2024-08-31T05:21:16.434 INFO:tasks.workunit.client.0.smithi067.stdout:0/293: write d1/df/d17/f4c [1651910,30259] 0 2024-08-31T05:21:16.437 INFO:tasks.workunit.client.0.smithi067.stdout:0/294: rename d1/df/d29/d44 to d1/df/d17/d5d 0 2024-08-31T05:21:16.442 INFO:tasks.workunit.client.0.smithi067.stdout:0/295: dwrite d1/f2c [0,4194304] 0 2024-08-31T05:21:16.444 INFO:tasks.workunit.client.0.smithi067.stdout:0/296: write d1/df/d17/f20 [3217461,106403] 0 2024-08-31T05:21:16.449 INFO:tasks.workunit.client.0.smithi067.stdout:0/297: getdents d1/dd/d4d 0 2024-08-31T05:21:16.451 INFO:tasks.workunit.client.0.smithi067.stdout:0/298: stat d1/dd/f21 0 2024-08-31T05:21:16.457 INFO:tasks.workunit.client.0.smithi067.stdout:0/299: dwrite d1/d50/f57 [4194304,4194304] 0 2024-08-31T05:21:16.462 INFO:tasks.workunit.client.0.smithi067.stdout:0/300: dread d1/f3a [0,4194304] 0 2024-08-31T05:21:16.465 INFO:tasks.workunit.client.0.smithi067.stdout:0/301: unlink d1/dd/d18/d52/f5b 0 2024-08-31T05:21:16.466 INFO:tasks.workunit.client.0.smithi067.stdout:0/302: chown d1/df/d17/d43 3 1 2024-08-31T05:21:16.467 INFO:tasks.workunit.client.0.smithi067.stdout:0/303: truncate d1/dd/d4d/f51 743434 0 2024-08-31T05:21:16.484 INFO:tasks.workunit.client.0.smithi067.stdout:0/304: dread d1/d8/f16 [0,4194304] 0 2024-08-31T05:21:16.486 INFO:tasks.workunit.client.0.smithi067.stdout:0/305: creat d1/df/d29/d37/f5e x:0 0 0 2024-08-31T05:21:16.487 INFO:tasks.workunit.client.0.smithi067.stdout:0/306: stat d1/dd/d18/c38 0 2024-08-31T05:21:16.487 INFO:tasks.workunit.client.0.smithi067.stdout:0/307: readlink d1/dd/d4d/l5a 0 2024-08-31T05:21:16.488 INFO:tasks.workunit.client.0.smithi067.stdout:0/308: stat d1/df/d29/d37/c3b 0 2024-08-31T05:21:16.489 INFO:tasks.workunit.client.0.smithi067.stdout:0/309: fsync d1/d8/f16 0 2024-08-31T05:21:16.495 INFO:tasks.workunit.client.0.smithi067.stdout:5/236: sync 2024-08-31T05:21:16.495 INFO:tasks.workunit.client.0.smithi067.stdout:2/335: sync 2024-08-31T05:21:16.495 INFO:tasks.workunit.client.0.smithi067.stdout:7/211: sync 2024-08-31T05:21:16.496 INFO:tasks.workunit.client.0.smithi067.stdout:4/179: sync 2024-08-31T05:21:16.496 INFO:tasks.workunit.client.0.smithi067.stdout:8/314: sync 2024-08-31T05:21:16.496 INFO:tasks.workunit.client.0.smithi067.stdout:1/228: sync 2024-08-31T05:21:16.496 INFO:tasks.workunit.client.0.smithi067.stdout:4/180: fdatasync d4/d1f/f3d 0 2024-08-31T05:21:16.497 INFO:tasks.workunit.client.0.smithi067.stdout:8/315: chown d0/d4/de/f11 77258 1 2024-08-31T05:21:16.498 INFO:tasks.workunit.client.0.smithi067.stdout:8/316: fsync d0/d2/dc/d3d/f67 0 2024-08-31T05:21:16.499 INFO:tasks.workunit.client.0.smithi067.stdout:1/229: chown d3/l3b 9434 1 2024-08-31T05:21:16.500 INFO:tasks.workunit.client.0.smithi067.stdout:1/230: fdatasync d3/dd/f1c 0 2024-08-31T05:21:16.503 INFO:tasks.workunit.client.0.smithi067.stdout:4/181: rename d4/d1e/d21/c2b to d4/d1f/d34/c40 0 2024-08-31T05:21:16.503 INFO:tasks.workunit.client.0.smithi067.stdout:0/310: dread d1/d8/f23 [0,4194304] 0 2024-08-31T05:21:16.503 INFO:tasks.workunit.client.0.smithi067.stdout:2/336: symlink db/d12/d1a/d1e/d5f/l60 0 2024-08-31T05:21:16.504 INFO:tasks.workunit.client.0.smithi067.stdout:0/311: write d1/dd/d4d/f51 [857049,8843] 0 2024-08-31T05:21:16.506 INFO:tasks.workunit.client.0.smithi067.stdout:5/237: link db/d1d/f2d db/d15/d42/f44 0 2024-08-31T05:21:16.508 INFO:tasks.workunit.client.0.smithi067.stdout:4/182: creat d4/d1e/f41 x:0 0 0 2024-08-31T05:21:16.512 INFO:tasks.workunit.client.0.smithi067.stdout:8/317: mkdir d0/d2/dc/d3d/d52/d6b 0 2024-08-31T05:21:16.513 INFO:tasks.workunit.client.0.smithi067.stdout:8/318: fdatasync d0/d4/de/f11 0 2024-08-31T05:21:16.514 INFO:tasks.workunit.client.0.smithi067.stdout:0/312: truncate d1/d8/f35 1048306 0 2024-08-31T05:21:16.516 INFO:tasks.workunit.client.0.smithi067.stdout:4/183: dwrite d4/d13/f1c [4194304,4194304] 0 2024-08-31T05:21:16.516 INFO:tasks.workunit.client.0.smithi067.stdout:8/319: write d0/d2/dc/f16 [4919675,50197] 0 2024-08-31T05:21:16.518 INFO:tasks.workunit.client.0.smithi067.stdout:2/337: mknod db/d12/d1a/d5c/c61 0 2024-08-31T05:21:16.520 INFO:tasks.workunit.client.0.smithi067.stdout:2/338: chown db/d12/d1a/d2b/l34 332254031 1 2024-08-31T05:21:16.521 INFO:tasks.workunit.client.0.smithi067.stdout:1/231: creat d3/f52 x:0 0 0 2024-08-31T05:21:16.522 INFO:tasks.workunit.client.0.smithi067.stdout:1/232: write d3/dd/f3d [4530543,78169] 0 2024-08-31T05:21:16.524 INFO:tasks.workunit.client.0.smithi067.stdout:0/313: unlink d1/f6 0 2024-08-31T05:21:16.525 INFO:tasks.workunit.client.0.smithi067.stdout:0/314: fsync d1/df/d17/f4f 0 2024-08-31T05:21:16.528 INFO:tasks.workunit.client.0.smithi067.stdout:8/320: readlink d0/d4a/l50 0 2024-08-31T05:21:16.530 INFO:tasks.workunit.client.0.smithi067.stdout:8/321: read d0/d4/f20 [3916322,56521] 0 2024-08-31T05:21:16.531 INFO:tasks.workunit.client.0.smithi067.stdout:5/238: dwrite db/d15/d42/f44 [0,4194304] 0 2024-08-31T05:21:16.532 INFO:tasks.workunit.client.0.smithi067.stdout:8/322: read - d0/d4/de/d1d/d2c/f55 zero size 2024-08-31T05:21:16.534 INFO:tasks.workunit.client.0.smithi067.stdout:5/239: write db/d1d/f2d [3986563,117086] 0 2024-08-31T05:21:16.535 INFO:tasks.workunit.client.0.smithi067.stdout:1/233: unlink d3/d23/l38 0 2024-08-31T05:21:16.539 INFO:tasks.workunit.client.0.smithi067.stdout:4/184: mkdir d4/d42 0 2024-08-31T05:21:16.546 INFO:tasks.workunit.client.0.smithi067.stdout:1/234: rename d3/dd/f1a to d3/d36/f53 0 2024-08-31T05:21:16.546 INFO:tasks.workunit.client.0.smithi067.stdout:0/315: truncate d1/dd/f15 2260492 0 2024-08-31T05:21:16.547 INFO:tasks.workunit.client.0.smithi067.stdout:1/235: truncate d3/dd/f3d 5518070 0 2024-08-31T05:21:16.548 INFO:tasks.workunit.client.0.smithi067.stdout:2/339: mkdir db/d12/d1a/d2b/d42/d62 0 2024-08-31T05:21:16.549 INFO:tasks.workunit.client.0.smithi067.stdout:5/240: fsync db/d15/d42/f44 0 2024-08-31T05:21:16.551 INFO:tasks.workunit.client.0.smithi067.stdout:0/316: symlink d1/df/d17/d43/l5f 0 2024-08-31T05:21:16.553 INFO:tasks.workunit.client.0.smithi067.stdout:1/236: creat d3/dd/f54 x:0 0 0 2024-08-31T05:21:16.554 INFO:tasks.workunit.client.0.smithi067.stdout:5/241: rmdir db 39 2024-08-31T05:21:16.555 INFO:tasks.workunit.client.0.smithi067.stdout:2/340: dwrite db/dd/f17 [0,4194304] 0 2024-08-31T05:21:16.556 INFO:tasks.workunit.client.0.smithi067.stdout:8/323: creat d0/d2/f6c x:0 0 0 2024-08-31T05:21:16.556 INFO:tasks.workunit.client.0.smithi067.stdout:1/237: read d3/dd/f3d [1493100,42344] 0 2024-08-31T05:21:16.557 INFO:tasks.workunit.client.0.smithi067.stdout:8/324: read - d0/d2/f6c zero size 2024-08-31T05:21:16.557 INFO:tasks.workunit.client.0.smithi067.stdout:2/341: write db/f5b [813872,111177] 0 2024-08-31T05:21:16.557 INFO:tasks.workunit.client.0.smithi067.stdout:0/317: creat d1/dd/d18/f60 x:0 0 0 2024-08-31T05:21:16.560 INFO:tasks.workunit.client.0.smithi067.stdout:8/325: write d0/d2/dc/d62/f69 [947392,77982] 0 2024-08-31T05:21:16.564 INFO:tasks.workunit.client.0.smithi067.stdout:4/185: getdents d4/d13 0 2024-08-31T05:21:16.571 INFO:tasks.workunit.client.0.smithi067.stdout:8/326: stat d0/d2/dc/c46 0 2024-08-31T05:21:16.572 INFO:tasks.workunit.client.0.smithi067.stdout:5/242: dread db/f1b [0,4194304] 0 2024-08-31T05:21:16.572 INFO:tasks.workunit.client.0.smithi067.stdout:5/243: read - db/d15/f2a zero size 2024-08-31T05:21:16.576 INFO:tasks.workunit.client.0.smithi067.stdout:2/342: mkdir db/d12/d1a/d2b/d3d/d4f/d63 0 2024-08-31T05:21:16.576 INFO:tasks.workunit.client.0.smithi067.stdout:4/186: rmdir d4/d9 39 2024-08-31T05:21:16.577 INFO:tasks.workunit.client.0.smithi067.stdout:2/343: write db/dd/d2d/f5d [649213,95640] 0 2024-08-31T05:21:16.581 INFO:tasks.workunit.client.0.smithi067.stdout:2/344: dread db/d12/d1a/f36 [0,4194304] 0 2024-08-31T05:21:16.582 INFO:tasks.workunit.client.0.smithi067.stdout:8/327: fdatasync d0/d4/f20 0 2024-08-31T05:21:16.584 INFO:tasks.workunit.client.0.smithi067.stdout:1/238: rename d3/d23/d2d/d2e/f45 to d3/f55 0 2024-08-31T05:21:16.584 INFO:tasks.workunit.client.0.smithi067.stdout:4/187: dwrite d4/d1f/f30 [4194304,4194304] 0 2024-08-31T05:21:16.594 INFO:tasks.workunit.client.0.smithi067.stdout:8/328: rmdir d0/d2/dc/d3d/d52 39 2024-08-31T05:21:16.596 INFO:tasks.workunit.client.0.smithi067.stdout:1/239: readlink d3/l9 0 2024-08-31T05:21:16.596 INFO:tasks.workunit.client.0.smithi067.stdout:1/240: dread - d3/dd/f54 zero size 2024-08-31T05:21:16.598 INFO:tasks.workunit.client.0.smithi067.stdout:5/244: rename db/d15/f28 to db/d26/f45 0 2024-08-31T05:21:16.601 INFO:tasks.workunit.client.0.smithi067.stdout:0/318: truncate d1/d8/f35 1318436 0 2024-08-31T05:21:16.602 INFO:tasks.workunit.client.0.smithi067.stdout:8/329: dwrite d0/d2/da/f42 [0,4194304] 0 2024-08-31T05:21:16.607 INFO:tasks.workunit.client.0.smithi067.stdout:4/188: readlink d4/d9/l38 0 2024-08-31T05:21:16.608 INFO:tasks.workunit.client.0.smithi067.stdout:4/189: dread - d4/d1e/f3f zero size 2024-08-31T05:21:16.609 INFO:tasks.workunit.client.0.smithi067.stdout:4/190: readlink d4/d1f/l20 0 2024-08-31T05:21:16.613 INFO:tasks.workunit.client.0.smithi067.stdout:4/191: fdatasync d4/d1f/f3d 0 2024-08-31T05:21:16.613 INFO:tasks.workunit.client.0.smithi067.stdout:2/345: rename l5 to db/d12/d1a/d5c/l64 0 2024-08-31T05:21:16.613 INFO:tasks.workunit.client.0.smithi067.stdout:5/245: write db/d26/f45 [1093154,42798] 0 2024-08-31T05:21:16.613 INFO:tasks.workunit.client.0.smithi067.stdout:8/330: dread - d0/d2/da/dd/f4c zero size 2024-08-31T05:21:16.615 INFO:tasks.workunit.client.0.smithi067.stdout:0/319: rename d1/df/d29/d37/f5e to d1/df/d17/f61 0 2024-08-31T05:21:16.616 INFO:tasks.workunit.client.0.smithi067.stdout:4/192: truncate d4/d13/f24 722554 0 2024-08-31T05:21:16.623 INFO:tasks.workunit.client.0.smithi067.stdout:0/320: dwrite d1/f2c [0,4194304] 0 2024-08-31T05:21:16.625 INFO:tasks.workunit.client.0.smithi067.stdout:2/346: rename db/d12/d1a/d1e/d5f/l60 to db/d12/d1a/d2b/d3d/l65 0 2024-08-31T05:21:16.632 INFO:tasks.workunit.client.0.smithi067.stdout:0/321: rmdir d1/d50 39 2024-08-31T05:21:16.634 INFO:tasks.workunit.client.0.smithi067.stdout:5/246: creat db/f46 x:0 0 0 2024-08-31T05:21:16.637 INFO:tasks.workunit.client.0.smithi067.stdout:1/241: truncate d3/f14 2853195 0 2024-08-31T05:21:16.638 INFO:tasks.workunit.client.0.smithi067.stdout:0/322: symlink d1/df/d29/d37/l62 0 2024-08-31T05:21:16.639 INFO:tasks.workunit.client.0.smithi067.stdout:0/323: dread - d1/dd/d18/f60 zero size 2024-08-31T05:21:16.649 INFO:tasks.workunit.client.0.smithi067.stdout:5/247: link db/d26/d29/d31/l35 db/d26/d29/l47 0 2024-08-31T05:21:16.650 INFO:tasks.workunit.client.0.smithi067.stdout:8/331: write d0/d2/da/dd/f6a [556087,125470] 0 2024-08-31T05:21:16.652 INFO:tasks.workunit.client.0.smithi067.stdout:5/248: creat db/d26/d29/d31/f48 x:0 0 0 2024-08-31T05:21:16.653 INFO:tasks.workunit.client.0.smithi067.stdout:8/332: rename d0/d2/d6/l7 to d0/d2/dc/d62/l6d 0 2024-08-31T05:21:16.655 INFO:tasks.workunit.client.0.smithi067.stdout:8/333: read d0/d4/de/f11 [2666870,61721] 0 2024-08-31T05:21:16.660 INFO:tasks.workunit.client.0.smithi067.stdout:5/249: dwrite db/f21 [0,4194304] 0 2024-08-31T05:21:16.664 INFO:tasks.workunit.client.0.smithi067.stdout:8/334: mknod d0/d2/dc/d3d/d52/c6e 0 2024-08-31T05:21:16.668 INFO:tasks.workunit.client.0.smithi067.stdout:5/250: link db/d15/f22 db/f49 0 2024-08-31T05:21:16.671 INFO:tasks.workunit.client.0.smithi067.stdout:5/251: stat db/d26/d29/d31/f48 0 2024-08-31T05:21:16.675 INFO:tasks.workunit.client.0.smithi067.stdout:0/324: dwrite d1/f3a [0,4194304] 0 2024-08-31T05:21:16.677 INFO:tasks.workunit.client.0.smithi067.stdout:0/325: read - d1/df/d17/f4f zero size 2024-08-31T05:21:16.679 INFO:tasks.workunit.client.0.smithi067.stdout:8/335: getdents d0/d2/dc/d62 0 2024-08-31T05:21:16.681 INFO:tasks.workunit.client.0.smithi067.stdout:5/252: dwrite db/d1d/d3a/f43 [0,4194304] 0 2024-08-31T05:21:16.682 INFO:tasks.workunit.client.0.smithi067.stdout:8/336: write d0/d2/da/dd/f6a [622758,86462] 0 2024-08-31T05:21:16.683 INFO:tasks.workunit.client.0.smithi067.stdout:5/253: stat db/d26/d29 0 2024-08-31T05:21:16.683 INFO:tasks.workunit.client.0.smithi067.stdout:5/254: chown db/d15/f18 70203 1 2024-08-31T05:21:16.689 INFO:tasks.workunit.client.0.smithi067.stdout:5/255: creat db/d1d/d3a/f4a x:0 0 0 2024-08-31T05:21:16.692 INFO:tasks.workunit.client.0.smithi067.stdout:8/337: unlink d0/d2/d6/lb 0 2024-08-31T05:21:16.692 INFO:tasks.workunit.client.0.smithi067.stdout:0/326: getdents d1/df/d17/d43 0 2024-08-31T05:21:16.695 INFO:tasks.workunit.client.0.smithi067.stdout:0/327: symlink d1/dd/d4d/l63 0 2024-08-31T05:21:16.705 INFO:tasks.workunit.client.0.smithi067.stdout:0/328: dwrite d1/d8/f4b [0,4194304] 0 2024-08-31T05:21:16.710 INFO:tasks.workunit.client.0.smithi067.stdout:5/256: dread f6 [0,4194304] 0 2024-08-31T05:21:16.711 INFO:tasks.workunit.client.0.smithi067.stdout:0/329: creat d1/df/d17/d43/f64 x:0 0 0 2024-08-31T05:21:16.711 INFO:tasks.workunit.client.0.smithi067.stdout:8/338: truncate d0/f40 12652 0 2024-08-31T05:21:16.712 INFO:tasks.workunit.client.0.smithi067.stdout:5/257: write db/d26/f45 [556642,65041] 0 2024-08-31T05:21:16.712 INFO:tasks.workunit.client.0.smithi067.stdout:8/339: readlink d0/d2/l12 0 2024-08-31T05:21:16.715 INFO:tasks.workunit.client.0.smithi067.stdout:9/184: sync 2024-08-31T05:21:16.760 INFO:tasks.workunit.client.0.smithi067.stdout:9/185: creat dd/df/d25/d3b/f3e x:0 0 0 2024-08-31T05:21:16.761 INFO:tasks.workunit.client.0.smithi067.stdout:0/330: rmdir d1/df/d17/d5d 0 2024-08-31T05:21:16.768 INFO:tasks.workunit.client.0.smithi067.stdout:5/258: getdents db/d26/d29 0 2024-08-31T05:21:16.772 INFO:tasks.workunit.client.0.smithi067.stdout:0/331: mkdir d1/d50/d65 0 2024-08-31T05:21:16.775 INFO:tasks.workunit.client.0.smithi067.stdout:9/186: creat dd/f3f x:0 0 0 2024-08-31T05:21:16.777 INFO:tasks.workunit.client.0.smithi067.stdout:5/259: dwrite db/d15/f2a [0,4194304] 0 2024-08-31T05:21:16.777 INFO:tasks.workunit.client.0.smithi067.stdout:9/187: rename dd/d20 to dd/d20/d40 22 2024-08-31T05:21:16.778 INFO:tasks.workunit.client.0.smithi067.stdout:5/260: dread - db/f2e zero size 2024-08-31T05:21:16.779 INFO:tasks.workunit.client.0.smithi067.stdout:8/340: dwrite d0/d2/dc/f48 [0,4194304] 0 2024-08-31T05:21:16.781 INFO:tasks.workunit.client.0.smithi067.stdout:0/332: mkdir d1/d8/d66 0 2024-08-31T05:21:16.785 INFO:tasks.workunit.client.0.smithi067.stdout:0/333: dread d1/d8/f16 [0,4194304] 0 2024-08-31T05:21:16.786 INFO:tasks.workunit.client.0.smithi067.stdout:9/188: unlink dd/df/d25/l38 0 2024-08-31T05:21:16.788 INFO:tasks.workunit.client.0.smithi067.stdout:9/189: dread fa [0,4194304] 0 2024-08-31T05:21:16.798 INFO:tasks.workunit.client.0.smithi067.stdout:0/334: creat d1/f67 x:0 0 0 2024-08-31T05:21:16.799 INFO:tasks.workunit.client.0.smithi067.stdout:0/335: read d1/d8/f23 [753481,75587] 0 2024-08-31T05:21:16.800 INFO:tasks.workunit.client.0.smithi067.stdout:5/261: link db/d26/d29/l47 db/d1d/l4b 0 2024-08-31T05:21:16.801 INFO:tasks.workunit.client.0.smithi067.stdout:5/262: write db/f32 [126101,91123] 0 2024-08-31T05:21:16.807 INFO:tasks.workunit.client.0.smithi067.stdout:9/190: write fa [792910,41321] 0 2024-08-31T05:21:16.808 INFO:tasks.workunit.client.0.smithi067.stdout:9/191: dread - dd/df/f24 zero size 2024-08-31T05:21:16.809 INFO:tasks.workunit.client.0.smithi067.stdout:9/192: write dd/d20/f2b [143344,46967] 0 2024-08-31T05:21:16.810 INFO:tasks.workunit.client.0.smithi067.stdout:9/193: chown dd/df/d25/c32 36 1 2024-08-31T05:21:16.812 INFO:tasks.workunit.client.0.smithi067.stdout:0/336: truncate d1/dd/d18/f3e 1279313 0 2024-08-31T05:21:16.816 INFO:tasks.workunit.client.0.smithi067.stdout:9/194: unlink dd/df/l21 0 2024-08-31T05:21:16.817 INFO:tasks.workunit.client.0.smithi067.stdout:9/195: stat dd/d20/f39 0 2024-08-31T05:21:16.818 INFO:tasks.workunit.client.0.smithi067.stdout:0/337: dread d1/d8/f23 [0,4194304] 0 2024-08-31T05:21:16.819 INFO:tasks.workunit.client.0.smithi067.stdout:5/263: dwrite f4 [0,4194304] 0 2024-08-31T05:21:16.819 INFO:tasks.workunit.client.0.smithi067.stdout:9/196: read dd/d20/f2b [141763,2086] 0 2024-08-31T05:21:16.823 INFO:tasks.workunit.client.0.smithi067.stdout:9/197: creat dd/df/d25/d3b/f41 x:0 0 0 2024-08-31T05:21:16.824 INFO:tasks.workunit.client.0.smithi067.stdout:5/264: truncate db/d15/f18 1929268 0 2024-08-31T05:21:16.826 INFO:tasks.workunit.client.0.smithi067.stdout:0/338: fdatasync d1/dd/d18/f3e 0 2024-08-31T05:21:16.827 INFO:tasks.workunit.client.0.smithi067.stdout:0/339: read - d1/df/d29/f34 zero size 2024-08-31T05:21:16.830 INFO:tasks.workunit.client.0.smithi067.stdout:9/198: creat dd/f42 x:0 0 0 2024-08-31T05:21:16.831 INFO:tasks.workunit.client.0.smithi067.stdout:9/199: truncate dd/f3f 5898 0 2024-08-31T05:21:16.832 INFO:tasks.workunit.client.0.smithi067.stdout:0/340: symlink d1/d50/d65/l68 0 2024-08-31T05:21:16.833 INFO:tasks.workunit.client.0.smithi067.stdout:9/200: truncate dd/f1e 2755287 0 2024-08-31T05:21:16.833 INFO:tasks.workunit.client.0.smithi067.stdout:0/341: chown d1/d8/f16 21095850 1 2024-08-31T05:21:16.834 INFO:tasks.workunit.client.0.smithi067.stdout:9/201: chown dd/df/d25 964 1 2024-08-31T05:21:16.839 INFO:tasks.workunit.client.0.smithi067.stdout:0/342: rename d1/dd/d18/f41 to d1/dd/d4d/f69 0 2024-08-31T05:21:16.840 INFO:tasks.workunit.client.0.smithi067.stdout:5/265: dread db/f49 [0,4194304] 0 2024-08-31T05:21:16.840 INFO:tasks.workunit.client.0.smithi067.stdout:0/343: readlink d1/dd/d4d/l63 0 2024-08-31T05:21:16.846 INFO:tasks.workunit.client.0.smithi067.stdout:5/266: dwrite db/f32 [0,4194304] 0 2024-08-31T05:21:16.853 INFO:tasks.workunit.client.0.smithi067.stdout:0/344: rename d1/d50/d65 to d1/df/d17/d43/d48/d6a 0 2024-08-31T05:21:16.856 INFO:tasks.workunit.client.0.smithi067.stdout:0/345: truncate d1/dd/d4d/f51 1266128 0 2024-08-31T05:21:16.856 INFO:tasks.workunit.client.0.smithi067.stdout:5/267: dwrite db/d15/d42/f39 [0,4194304] 0 2024-08-31T05:21:16.858 INFO:tasks.workunit.client.0.smithi067.stdout:5/268: write db/d26/d29/d31/f48 [391687,93978] 0 2024-08-31T05:21:16.860 INFO:tasks.workunit.client.0.smithi067.stdout:5/269: truncate db/d15/f12 4311680 0 2024-08-31T05:21:16.861 INFO:tasks.workunit.client.0.smithi067.stdout:0/346: readlink d1/df/l2d 0 2024-08-31T05:21:16.864 INFO:tasks.workunit.client.0.smithi067.stdout:0/347: stat d1/dd/f15 0 2024-08-31T05:21:16.868 INFO:tasks.workunit.client.0.smithi067.stdout:0/348: write d1/df/d29/f49 [4881867,48480] 0 2024-08-31T05:21:16.874 INFO:tasks.workunit.client.0.smithi067.stdout:0/349: rename d1/dd/d18/f3e to d1/df/f6b 0 2024-08-31T05:21:16.876 INFO:tasks.workunit.client.0.smithi067.stdout:0/350: creat d1/d50/f6c x:0 0 0 2024-08-31T05:21:16.878 INFO:tasks.workunit.client.0.smithi067.stdout:5/270: dread db/f25 [0,4194304] 0 2024-08-31T05:21:16.879 INFO:tasks.workunit.client.0.smithi067.stdout:5/271: fdatasync db/f1b 0 2024-08-31T05:21:16.881 INFO:tasks.workunit.client.0.smithi067.stdout:5/272: write f4 [4746603,69677] 0 2024-08-31T05:21:16.885 INFO:tasks.workunit.client.0.smithi067.stdout:5/273: mkdir db/d26/d4c 0 2024-08-31T05:21:16.885 INFO:tasks.workunit.client.0.smithi067.stdout:0/351: dwrite d1/df/f6b [0,4194304] 0 2024-08-31T05:21:16.886 INFO:tasks.workunit.client.0.smithi067.stdout:0/352: chown d1/d50/f6c 47 1 2024-08-31T05:21:16.886 INFO:tasks.workunit.client.0.smithi067.stdout:5/274: read db/d15/d42/f44 [1141847,54407] 0 2024-08-31T05:21:16.888 INFO:tasks.workunit.client.0.smithi067.stdout:5/275: chown db/d26/d29/d31/f48 11456 1 2024-08-31T05:21:16.892 INFO:tasks.workunit.client.0.smithi067.stdout:5/276: readlink db/d26/d29/l47 0 2024-08-31T05:21:16.893 INFO:tasks.workunit.client.0.smithi067.stdout:5/277: stat db/d26/d29/d31 0 2024-08-31T05:21:16.894 INFO:tasks.workunit.client.0.smithi067.stdout:0/353: dwrite d1/d50/f57 [0,4194304] 0 2024-08-31T05:21:16.900 INFO:tasks.workunit.client.0.smithi067.stdout:5/278: mknod db/d26/d4c/c4d 0 2024-08-31T05:21:16.905 INFO:tasks.workunit.client.0.smithi067.stdout:0/354: creat d1/df/f6d x:0 0 0 2024-08-31T05:21:16.908 INFO:tasks.workunit.client.0.smithi067.stdout:0/355: symlink d1/df/d17/d43/d48/d6a/l6e 0 2024-08-31T05:21:16.909 INFO:tasks.workunit.client.0.smithi067.stdout:5/279: dwrite db/f32 [4194304,4194304] 0 2024-08-31T05:21:16.911 INFO:tasks.workunit.client.0.smithi067.stdout:0/356: mkdir d1/df/d29/d37/d6f 0 2024-08-31T05:21:16.914 INFO:tasks.workunit.client.0.smithi067.stdout:0/357: mknod d1/df/d29/c70 0 2024-08-31T05:21:16.916 INFO:tasks.workunit.client.0.smithi067.stdout:5/280: dwrite f6 [0,4194304] 0 2024-08-31T05:21:16.917 INFO:tasks.workunit.client.0.smithi067.stdout:0/358: stat d1/dd/d18/d52/c59 0 2024-08-31T05:21:16.917 INFO:tasks.workunit.client.0.smithi067.stdout:5/281: chown db/d15/d42/d36/f3d 1112437 1 2024-08-31T05:21:16.918 INFO:tasks.workunit.client.0.smithi067.stdout:0/359: truncate d1/d50/f6c 462773 0 2024-08-31T05:21:16.926 INFO:tasks.workunit.client.0.smithi067.stdout:0/360: dread d1/d8/f23 [0,4194304] 0 2024-08-31T05:21:16.929 INFO:tasks.workunit.client.0.smithi067.stdout:0/361: truncate d1/dd/f21 435286 0 2024-08-31T05:21:16.930 INFO:tasks.workunit.client.0.smithi067.stdout:0/362: mkdir d1/dd/d71 0 2024-08-31T05:21:16.934 INFO:tasks.workunit.client.0.smithi067.stdout:0/363: mknod d1/c72 0 2024-08-31T05:21:16.935 INFO:tasks.workunit.client.0.smithi067.stdout:0/364: write d1/d50/f57 [1830412,69455] 0 2024-08-31T05:21:16.939 INFO:tasks.workunit.client.0.smithi067.stdout:0/365: rename d1/d8/c46 to d1/d50/c73 0 2024-08-31T05:21:16.942 INFO:tasks.workunit.client.0.smithi067.stdout:0/366: creat d1/df/d29/f74 x:0 0 0 2024-08-31T05:21:16.944 INFO:tasks.workunit.client.0.smithi067.stdout:0/367: symlink d1/df/d17/l75 0 2024-08-31T05:21:16.952 INFO:tasks.workunit.client.0.smithi067.stdout:5/282: dwrite db/d26/d29/f38 [0,4194304] 0 2024-08-31T05:21:16.958 INFO:tasks.workunit.client.0.smithi067.stdout:5/283: truncate db/d15/f18 1684138 0 2024-08-31T05:21:16.961 INFO:tasks.workunit.client.0.smithi067.stdout:5/284: symlink db/d26/d29/l4e 0 2024-08-31T05:21:16.962 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:16 smithi067 ceph-mon[17432]: pgmap v29: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 114 MiB/s rd, 305 MiB/s wr, 611 op/s 2024-08-31T05:21:16.964 INFO:tasks.workunit.client.0.smithi067.stdout:5/285: mkdir db/d1d/d4f 0 2024-08-31T05:21:16.966 INFO:tasks.workunit.client.0.smithi067.stdout:0/368: getdents d1/d8 0 2024-08-31T05:21:16.967 INFO:tasks.workunit.client.0.smithi067.stdout:5/286: mknod db/d1d/d3a/c50 0 2024-08-31T05:21:16.974 INFO:tasks.workunit.client.0.smithi067.stdout:5/287: dwrite db/d26/f45 [0,4194304] 0 2024-08-31T05:21:16.978 INFO:tasks.workunit.client.0.smithi067.stdout:5/288: mknod db/c51 0 2024-08-31T05:21:16.981 INFO:tasks.workunit.client.0.smithi067.stdout:5/289: rename db/d26/d29/f2f to db/d1d/d4f/f52 0 2024-08-31T05:21:16.984 INFO:tasks.workunit.client.0.smithi067.stdout:5/290: read db/d15/f1c [508924,2202] 0 2024-08-31T05:21:16.986 INFO:tasks.workunit.client.0.smithi067.stdout:5/291: mkdir db/d15/d53 0 2024-08-31T05:21:16.990 INFO:tasks.workunit.client.0.smithi067.stdout:5/292: dread db/f21 [0,4194304] 0 2024-08-31T05:21:16.991 INFO:tasks.workunit.client.0.smithi067.stdout:5/293: readlink db/d26/d29/l4e 0 2024-08-31T05:21:16.998 INFO:tasks.workunit.client.0.smithi067.stdout:5/294: dwrite f6 [0,4194304] 0 2024-08-31T05:21:16.998 INFO:tasks.workunit.client.0.smithi067.stdout:5/295: fsync db/d1d/f2d 0 2024-08-31T05:21:17.007 INFO:tasks.workunit.client.0.smithi067.stdout:5/296: dwrite db/f32 [0,4194304] 0 2024-08-31T05:21:17.011 INFO:tasks.workunit.client.0.smithi067.stdout:5/297: mkdir db/d26/d29/d31/d54 0 2024-08-31T05:21:17.013 INFO:tasks.workunit.client.0.smithi067.stdout:5/298: mknod db/d26/d29/d31/c55 0 2024-08-31T05:21:17.022 INFO:tasks.workunit.client.0.smithi067.stdout:5/299: mknod db/d26/d29/d31/c56 0 2024-08-31T05:21:17.024 INFO:tasks.workunit.client.0.smithi067.stdout:5/300: creat db/d26/d29/f57 x:0 0 0 2024-08-31T05:21:17.032 INFO:tasks.workunit.client.0.smithi067.stdout:5/301: dwrite db/f46 [0,4194304] 0 2024-08-31T05:21:17.038 INFO:tasks.workunit.client.0.smithi067.stdout:5/302: fsync db/d15/f22 0 2024-08-31T05:21:17.056 INFO:tasks.workunit.client.0.smithi067.stdout:5/303: dread db/d15/f1c [0,4194304] 0 2024-08-31T05:21:17.060 INFO:tasks.workunit.client.0.smithi067.stdout:5/304: dread db/f46 [0,4194304] 0 2024-08-31T05:21:17.064 INFO:tasks.workunit.client.0.smithi067.stdout:5/305: mkdir db/d58 0 2024-08-31T05:21:17.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:16 smithi073 ceph-mon[24726]: pgmap v29: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 114 MiB/s rd, 305 MiB/s wr, 611 op/s 2024-08-31T05:21:17.378 INFO:tasks.workunit.client.0.smithi067.stdout:6/418: sync 2024-08-31T05:21:17.380 INFO:tasks.workunit.client.0.smithi067.stdout:6/419: creat d1b/d23/d28/f85 x:0 0 0 2024-08-31T05:21:17.383 INFO:tasks.workunit.client.0.smithi067.stdout:6/420: read d1b/d23/f2a [232018,70400] 0 2024-08-31T05:21:17.386 INFO:tasks.workunit.client.0.smithi067.stdout:6/421: mkdir d1b/d23/d28/d45/d5c/d86 0 2024-08-31T05:21:17.389 INFO:tasks.workunit.client.0.smithi067.stdout:6/422: rename d1b/d40/d70/d71/d78/l84 to d1b/d23/d28/l87 0 2024-08-31T05:21:17.392 INFO:tasks.workunit.client.0.smithi067.stdout:6/423: mknod d1b/d23/d61/c88 0 2024-08-31T05:21:17.393 INFO:tasks.workunit.client.0.smithi067.stdout:6/424: read - d1b/d23/d28/f85 zero size 2024-08-31T05:21:17.396 INFO:tasks.workunit.client.0.smithi067.stdout:6/425: mknod d1b/d40/c89 0 2024-08-31T05:21:17.399 INFO:tasks.workunit.client.0.smithi067.stdout:6/426: mknod d1b/d40/d70/c8a 0 2024-08-31T05:21:17.401 INFO:tasks.workunit.client.0.smithi067.stdout:6/427: mknod d1b/d23/d2e/c8b 0 2024-08-31T05:21:17.403 INFO:tasks.workunit.client.0.smithi067.stdout:6/428: dread - d1b/d23/d61/f4e zero size 2024-08-31T05:21:17.405 INFO:tasks.workunit.client.0.smithi067.stdout:6/429: rename d1b/d23/d2e to d1b/d23/d2e/d3b/d8c 22 2024-08-31T05:21:17.406 INFO:tasks.workunit.client.0.smithi067.stdout:6/430: truncate d1b/d23/d2e/f3d 4255412 0 2024-08-31T05:21:17.429 INFO:tasks.workunit.client.0.smithi067.stdout:6/431: write d1b/d23/d28/d45/f5b [2194922,68951] 0 2024-08-31T05:21:17.430 INFO:tasks.workunit.client.0.smithi067.stdout:6/432: write d1b/d23/d28/f55 [1719374,86898] 0 2024-08-31T05:21:17.434 INFO:tasks.workunit.client.0.smithi067.stdout:6/433: mkdir d1b/d23/d28/d45/d8d 0 2024-08-31T05:21:17.448 INFO:tasks.workunit.client.0.smithi067.stdout:6/434: dread f14 [0,4194304] 0 2024-08-31T05:21:17.452 INFO:tasks.workunit.client.0.smithi067.stdout:6/435: rename d1b/d23/d2f to d1b/d8e 0 2024-08-31T05:21:17.454 INFO:tasks.workunit.client.0.smithi067.stdout:6/436: dread - d1b/d23/d28/d45/f65 zero size 2024-08-31T05:21:17.488 INFO:tasks.workunit.client.0.smithi067.stdout:6/437: truncate f7 296033 0 2024-08-31T05:21:17.499 INFO:tasks.workunit.client.0.smithi067.stdout:6/438: dwrite d1b/d23/f2a [0,4194304] 0 2024-08-31T05:21:17.526 INFO:tasks.workunit.client.0.smithi067.stdout:6/439: dread d1b/d8e/f42 [4194304,4194304] 0 2024-08-31T05:21:17.527 INFO:tasks.workunit.client.0.smithi067.stdout:6/440: truncate d1b/d23/f34 3271400 0 2024-08-31T05:21:17.531 INFO:tasks.workunit.client.0.smithi067.stdout:6/441: dread d1b/d23/f4f [0,4194304] 0 2024-08-31T05:21:17.536 INFO:tasks.workunit.client.0.smithi067.stdout:6/442: dwrite d1b/d23/f34 [0,4194304] 0 2024-08-31T05:21:17.538 INFO:tasks.workunit.client.0.smithi067.stdout:6/443: write f18 [4780479,3839] 0 2024-08-31T05:21:17.542 INFO:tasks.workunit.client.0.smithi067.stdout:6/444: link d1b/d40/c53 d1b/d40/d70/d71/d78/c8f 0 2024-08-31T05:21:17.545 INFO:tasks.workunit.client.0.smithi067.stdout:6/445: symlink d1b/d23/d28/d45/d5e/d7b/l90 0 2024-08-31T05:21:17.548 INFO:tasks.workunit.client.0.smithi067.stdout:6/446: stat d1b/d23/d2e/l7f 0 2024-08-31T05:21:17.555 INFO:tasks.workunit.client.0.smithi067.stdout:6/447: getdents d1b/d23/d2e 0 2024-08-31T05:21:17.555 INFO:tasks.workunit.client.0.smithi067.stdout:6/448: truncate d1b/f74 317610 0 2024-08-31T05:21:17.559 INFO:tasks.workunit.client.0.smithi067.stdout:6/449: rename d1b/d40/c50 to d1b/d40/d70/d71/d78/c91 0 2024-08-31T05:21:17.560 INFO:tasks.workunit.client.0.smithi067.stdout:6/450: write f14 [632900,1994] 0 2024-08-31T05:21:17.562 INFO:tasks.workunit.client.0.smithi067.stdout:6/451: truncate d1b/d23/d28/f85 763602 0 2024-08-31T05:21:17.565 INFO:tasks.workunit.client.0.smithi067.stdout:6/452: symlink d1b/d30/l92 0 2024-08-31T05:21:17.568 INFO:tasks.workunit.client.0.smithi067.stdout:6/453: mknod d1b/d23/d28/d45/d5e/c93 0 2024-08-31T05:21:17.570 INFO:tasks.workunit.client.0.smithi067.stdout:6/454: symlink d1b/d23/d28/d45/d5e/l94 0 2024-08-31T05:21:17.580 INFO:tasks.workunit.client.0.smithi067.stdout:6/455: dread d1b/f21 [0,4194304] 0 2024-08-31T05:21:17.584 INFO:tasks.workunit.client.0.smithi067.stdout:6/456: dread d1b/d23/d28/d45/d5e/f5f [0,4194304] 0 2024-08-31T05:21:17.589 INFO:tasks.workunit.client.0.smithi067.stdout:7/212: sync 2024-08-31T05:21:17.589 INFO:tasks.workunit.client.0.smithi067.stdout:3/313: sync 2024-08-31T05:21:17.590 INFO:tasks.workunit.client.0.smithi067.stdout:6/457: getdents d1b/d40/d70 0 2024-08-31T05:21:17.590 INFO:tasks.workunit.client.0.smithi067.stdout:7/213: chown d14/d16/f24 279636 1 2024-08-31T05:21:17.590 INFO:tasks.workunit.client.0.smithi067.stdout:3/314: truncate db/d2e/f38 405704 0 2024-08-31T05:21:17.592 INFO:tasks.workunit.client.0.smithi067.stdout:3/315: fdatasync db/d17/f6c 0 2024-08-31T05:21:17.596 INFO:tasks.workunit.client.0.smithi067.stdout:3/316: write db/d2e/d50/d62/f66 [345885,97756] 0 2024-08-31T05:21:17.601 INFO:tasks.workunit.client.0.smithi067.stdout:3/317: write db/d17/d3f/f61 [844372,104712] 0 2024-08-31T05:21:17.602 INFO:tasks.workunit.client.0.smithi067.stdout:6/458: dwrite d1b/d23/d2e/f3d [4194304,4194304] 0 2024-08-31T05:21:17.602 INFO:tasks.workunit.client.0.smithi067.stdout:6/459: readlink d1b/d23/d28/d45/d5e/d7b/l90 0 2024-08-31T05:21:17.606 INFO:tasks.workunit.client.0.smithi067.stdout:6/460: rename d1b/d23/f4f to d1b/d23/d2e/d3b/f95 0 2024-08-31T05:21:17.609 INFO:tasks.workunit.client.0.smithi067.stdout:3/318: dwrite db/f6f [0,4194304] 0 2024-08-31T05:21:17.609 INFO:tasks.workunit.client.0.smithi067.stdout:3/319: chown db/d17/d3f 399556294 1 2024-08-31T05:21:17.612 INFO:tasks.workunit.client.0.smithi067.stdout:6/461: mkdir d1b/d40/d96 0 2024-08-31T05:21:17.613 INFO:tasks.workunit.client.0.smithi067.stdout:7/214: dwrite d14/d16/f32 [0,4194304] 0 2024-08-31T05:21:17.618 INFO:tasks.workunit.client.0.smithi067.stdout:6/462: chown ca 21943 1 2024-08-31T05:21:17.623 INFO:tasks.workunit.client.0.smithi067.stdout:7/215: unlink d14/d16/d28/d2e/f36 0 2024-08-31T05:21:17.624 INFO:tasks.workunit.client.0.smithi067.stdout:7/216: write d14/d16/f22 [4433898,7804] 0 2024-08-31T05:21:17.634 INFO:tasks.workunit.client.0.smithi067.stdout:7/217: mknod d14/c39 0 2024-08-31T05:21:17.634 INFO:tasks.workunit.client.0.smithi067.stdout:3/320: link db/d55/l70 db/d17/d3f/d54/d56/d6e/l76 0 2024-08-31T05:21:17.635 INFO:tasks.workunit.client.0.smithi067.stdout:7/218: chown c4 42 1 2024-08-31T05:21:17.637 INFO:tasks.workunit.client.0.smithi067.stdout:3/321: symlink db/d2e/d43/l77 0 2024-08-31T05:21:17.638 INFO:tasks.workunit.client.0.smithi067.stdout:3/322: read db/d5a/f5f [232472,105403] 0 2024-08-31T05:21:17.641 INFO:tasks.workunit.client.0.smithi067.stdout:3/323: mknod db/d2e/d50/c78 0 2024-08-31T05:21:17.643 INFO:tasks.workunit.client.0.smithi067.stdout:3/324: dread db/d2e/f38 [0,4194304] 0 2024-08-31T05:21:17.644 INFO:tasks.workunit.client.0.smithi067.stdout:3/325: chown db/d12/d21/c44 103 1 2024-08-31T05:21:17.645 INFO:tasks.workunit.client.0.smithi067.stdout:3/326: write db/d2e/f46 [5669649,55866] 0 2024-08-31T05:21:17.648 INFO:tasks.workunit.client.0.smithi067.stdout:3/327: creat db/d17/f79 x:0 0 0 2024-08-31T05:21:17.652 INFO:tasks.workunit.client.0.smithi067.stdout:3/328: unlink db/d2c/c35 0 2024-08-31T05:21:17.653 INFO:tasks.workunit.client.0.smithi067.stdout:3/329: write db/d12/d21/f52 [684754,21648] 0 2024-08-31T05:21:17.662 INFO:tasks.workunit.client.0.smithi067.stdout:6/463: dwrite f19 [0,4194304] 0 2024-08-31T05:21:17.669 INFO:tasks.workunit.client.0.smithi067.stdout:6/464: unlink d1b/c27 0 2024-08-31T05:21:17.672 INFO:tasks.workunit.client.0.smithi067.stdout:7/219: chown d14/d16/f24 10394 1 2024-08-31T05:21:17.675 INFO:tasks.workunit.client.0.smithi067.stdout:3/330: dread db/f14 [0,4194304] 0 2024-08-31T05:21:17.675 INFO:tasks.workunit.client.0.smithi067.stdout:6/465: creat d1b/d23/d61/f97 x:0 0 0 2024-08-31T05:21:17.681 INFO:tasks.workunit.client.0.smithi067.stdout:7/220: rmdir d14/d16/d28/d2e/d2f 39 2024-08-31T05:21:17.686 INFO:tasks.workunit.client.0.smithi067.stdout:6/466: dwrite d1b/d23/d28/d45/d5c/f75 [4194304,4194304] 0 2024-08-31T05:21:17.688 INFO:tasks.workunit.client.0.smithi067.stdout:7/221: chown d14/d16/f32 1732 1 2024-08-31T05:21:17.689 INFO:tasks.workunit.client.0.smithi067.stdout:7/222: chown l12 1919 1 2024-08-31T05:21:17.689 INFO:tasks.workunit.client.0.smithi067.stdout:7/223: stat cc 0 2024-08-31T05:21:17.689 INFO:tasks.workunit.client.0.smithi067.stdout:6/467: chown d1b/d23/d28/d45/d5c/f75 12 1 2024-08-31T05:21:17.692 INFO:tasks.workunit.client.0.smithi067.stdout:6/468: creat d1b/d40/f98 x:0 0 0 2024-08-31T05:21:17.700 INFO:tasks.workunit.client.0.smithi067.stdout:6/469: dwrite d1b/f74 [0,4194304] 0 2024-08-31T05:21:17.705 INFO:tasks.workunit.client.0.smithi067.stdout:6/470: symlink d1b/d23/d28/d45/d5c/l99 0 2024-08-31T05:21:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:3/331: write f4 [133491,118003] 0 2024-08-31T05:21:17.713 INFO:tasks.workunit.client.0.smithi067.stdout:6/471: dwrite f19 [0,4194304] 0 2024-08-31T05:21:17.721 INFO:tasks.workunit.client.0.smithi067.stdout:6/472: unlink d1b/d40/d70/d71/d78/c7c 0 2024-08-31T05:21:17.728 INFO:tasks.workunit.client.0.smithi067.stdout:3/332: getdents db/d4e 0 2024-08-31T05:21:17.731 INFO:tasks.workunit.client.0.smithi067.stdout:6/473: link d1b/d30/f73 d1b/d7a/f9a 0 2024-08-31T05:21:17.734 INFO:tasks.workunit.client.0.smithi067.stdout:6/474: mknod d1b/d40/d70/d71/d78/c9b 0 2024-08-31T05:21:17.737 INFO:tasks.workunit.client.0.smithi067.stdout:6/475: creat d1b/d23/f9c x:0 0 0 2024-08-31T05:21:17.739 INFO:tasks.workunit.client.0.smithi067.stdout:6/476: creat d1b/d23/d2e/d3b/f9d x:0 0 0 2024-08-31T05:21:17.739 INFO:tasks.workunit.client.0.smithi067.stdout:6/477: fsync d1b/d23/d2e/f3d 0 2024-08-31T05:21:17.745 INFO:tasks.workunit.client.0.smithi067.stdout:6/478: link d1b/d23/d2e/c8b d1b/c9e 0 2024-08-31T05:21:17.753 INFO:tasks.workunit.client.0.smithi067.stdout:3/333: truncate db/d12/f58 3003757 0 2024-08-31T05:21:17.755 INFO:tasks.workunit.client.0.smithi067.stdout:6/479: dread d1b/d23/d28/d45/f5b [0,4194304] 0 2024-08-31T05:21:17.757 INFO:tasks.workunit.client.0.smithi067.stdout:6/480: write d1b/d23/d28/f37 [1486862,11608] 0 2024-08-31T05:21:17.757 INFO:tasks.workunit.client.0.smithi067.stdout:6/481: chown d1b/d23/d2e/l63 3736222 1 2024-08-31T05:21:17.760 INFO:tasks.workunit.client.0.smithi067.stdout:6/482: creat d1b/d23/d28/d45/d8d/f9f x:0 0 0 2024-08-31T05:21:17.765 INFO:tasks.workunit.client.0.smithi067.stdout:6/483: dread d1b/d8e/f42 [4194304,4194304] 0 2024-08-31T05:21:17.768 INFO:tasks.workunit.client.0.smithi067.stdout:6/484: dread f14 [0,4194304] 0 2024-08-31T05:21:17.770 INFO:tasks.workunit.client.0.smithi067.stdout:6/485: truncate d1b/d23/f9c 553705 0 2024-08-31T05:21:17.776 INFO:tasks.workunit.client.0.smithi067.stdout:3/334: write db/d12/d21/f19 [16227,28935] 0 2024-08-31T05:21:17.777 INFO:tasks.workunit.client.0.smithi067.stdout:3/335: truncate db/d17/f79 214103 0 2024-08-31T05:21:17.782 INFO:tasks.workunit.client.0.smithi067.stdout:6/486: link d1b/d40/d70/d71/d78/c80 d1b/d23/d28/d45/d5e/d7b/ca0 0 2024-08-31T05:21:17.782 INFO:tasks.workunit.client.0.smithi067.stdout:3/336: mknod db/d17/d3f/d54/d56/c7a 0 2024-08-31T05:21:17.782 INFO:tasks.workunit.client.0.smithi067.stdout:6/487: stat d1b/d30/l52 0 2024-08-31T05:21:17.791 INFO:tasks.workunit.client.0.smithi067.stdout:3/337: dwrite db/d2c/f31 [0,4194304] 0 2024-08-31T05:21:17.798 INFO:tasks.workunit.client.0.smithi067.stdout:3/338: rename db/d12/d21/c44 to db/d12/c7b 0 2024-08-31T05:21:17.798 INFO:tasks.workunit.client.0.smithi067.stdout:3/339: readlink db/d17/l1c 0 2024-08-31T05:21:17.804 INFO:tasks.workunit.client.0.smithi067.stdout:3/340: rename db/d12/l30 to db/d2e/d50/d62/l7c 0 2024-08-31T05:21:17.817 INFO:tasks.workunit.client.0.smithi067.stdout:3/341: dread db/f10 [0,4194304] 0 2024-08-31T05:21:17.817 INFO:tasks.workunit.client.0.smithi067.stdout:3/342: chown db 3986 1 2024-08-31T05:21:17.822 INFO:tasks.workunit.client.0.smithi067.stdout:3/343: rmdir db/d17/d3f/d54 39 2024-08-31T05:21:17.827 INFO:tasks.workunit.client.0.smithi067.stdout:6/488: dread d1b/d23/d28/f39 [0,4194304] 0 2024-08-31T05:21:17.830 INFO:tasks.workunit.client.0.smithi067.stdout:3/344: rename db/d2e/d50/d4a/f60 to db/d17/d3f/d54/d56/f7d 0 2024-08-31T05:21:17.833 INFO:tasks.workunit.client.0.smithi067.stdout:6/489: link d1b/d23/d28/d45/d5e/c93 d1b/d23/d28/d45/d8d/ca1 0 2024-08-31T05:21:17.834 INFO:tasks.workunit.client.0.smithi067.stdout:6/490: chown d1b/d8e/f42 1871 1 2024-08-31T05:21:17.837 INFO:tasks.workunit.client.0.smithi067.stdout:6/491: creat d1b/d30/fa2 x:0 0 0 2024-08-31T05:21:17.844 INFO:tasks.workunit.client.0.smithi067.stdout:6/492: dwrite d1b/d23/d61/f97 [0,4194304] 0 2024-08-31T05:21:17.846 INFO:tasks.workunit.client.0.smithi067.stdout:3/345: getdents db/d17/d3f/d54/d56 0 2024-08-31T05:21:17.852 INFO:tasks.workunit.client.0.smithi067.stdout:6/493: getdents d1b/d7a 0 2024-08-31T05:21:17.852 INFO:tasks.workunit.client.0.smithi067.stdout:2/347: sync 2024-08-31T05:21:17.852 INFO:tasks.workunit.client.0.smithi067.stdout:1/242: sync 2024-08-31T05:21:17.852 INFO:tasks.workunit.client.0.smithi067.stdout:4/193: sync 2024-08-31T05:21:17.852 INFO:tasks.workunit.client.0.smithi067.stdout:8/341: sync 2024-08-31T05:21:17.852 INFO:tasks.workunit.client.0.smithi067.stdout:6/494: readlink d1b/d30/l92 0 2024-08-31T05:21:17.853 INFO:tasks.workunit.client.0.smithi067.stdout:4/194: read - d4/d1f/f3d zero size 2024-08-31T05:21:17.854 INFO:tasks.workunit.client.0.smithi067.stdout:6/495: read - d1b/d8e/f79 zero size 2024-08-31T05:21:17.855 INFO:tasks.workunit.client.0.smithi067.stdout:8/342: write d0/d4/de/f11 [3791556,94967] 0 2024-08-31T05:21:17.855 INFO:tasks.workunit.client.0.smithi067.stdout:3/346: getdents db/d17/d3f 0 2024-08-31T05:21:17.859 INFO:tasks.workunit.client.0.smithi067.stdout:3/347: write db/d12/f2f [3018509,33401] 0 2024-08-31T05:21:17.862 INFO:tasks.workunit.client.0.smithi067.stdout:3/348: dread - db/d2e/d50/f5c zero size 2024-08-31T05:21:17.862 INFO:tasks.workunit.client.0.smithi067.stdout:1/243: truncate d3/f15 3567953 0 2024-08-31T05:21:17.863 INFO:tasks.workunit.client.0.smithi067.stdout:4/195: chown d4/d13/l33 238241 1 2024-08-31T05:21:17.869 INFO:tasks.workunit.client.0.smithi067.stdout:6/496: dwrite d1b/f74 [0,4194304] 0 2024-08-31T05:21:17.871 INFO:tasks.workunit.client.0.smithi067.stdout:3/349: symlink db/d17/d3f/d54/d56/l7e 0 2024-08-31T05:21:17.874 INFO:tasks.workunit.client.0.smithi067.stdout:6/497: write d1b/d23/d28/d45/d8d/f9f [538219,95783] 0 2024-08-31T05:21:17.875 INFO:tasks.workunit.client.0.smithi067.stdout:4/196: dwrite d4/f10 [0,4194304] 0 2024-08-31T05:21:17.877 INFO:tasks.workunit.client.0.smithi067.stdout:8/343: rename d0/d4/de/d1d/d2c/c51 to d0/d2/dc/d3d/d52/c6f 0 2024-08-31T05:21:17.877 INFO:tasks.workunit.client.0.smithi067.stdout:4/197: chown d4/d1f/l20 0 1 2024-08-31T05:21:17.878 INFO:tasks.workunit.client.0.smithi067.stdout:2/348: dread db/ff [0,4194304] 0 2024-08-31T05:21:17.881 INFO:tasks.workunit.client.0.smithi067.stdout:6/498: chown d1b/d23/d28/d45/d5e/d7b/ca0 1380402570 1 2024-08-31T05:21:17.885 INFO:tasks.workunit.client.0.smithi067.stdout:2/349: mknod db/d12/d1a/d5c/c66 0 2024-08-31T05:21:17.892 INFO:tasks.workunit.client.0.smithi067.stdout:8/344: rename d0/d2/c2a to d0/d4/de/d1d/c70 0 2024-08-31T05:21:17.894 INFO:tasks.workunit.client.0.smithi067.stdout:2/350: symlink db/dd/l67 0 2024-08-31T05:21:17.896 INFO:tasks.workunit.client.0.smithi067.stdout:3/350: getdents db/d12/d21 0 2024-08-31T05:21:17.897 INFO:tasks.workunit.client.0.smithi067.stdout:2/351: readlink db/d12/d24/d3b/l52 0 2024-08-31T05:21:17.899 INFO:tasks.workunit.client.0.smithi067.stdout:6/499: dwrite d1b/d23/d2e/f51 [0,4194304] 0 2024-08-31T05:21:17.900 INFO:tasks.workunit.client.0.smithi067.stdout:3/351: truncate db/d2e/d50/f5c 141029 0 2024-08-31T05:21:17.901 INFO:tasks.workunit.client.0.smithi067.stdout:3/352: dread - db/d17/d3f/f4b zero size 2024-08-31T05:21:17.903 INFO:tasks.workunit.client.0.smithi067.stdout:8/345: rename d0/d4/de/d1d/f39 to d0/d4/f71 0 2024-08-31T05:21:17.904 INFO:tasks.workunit.client.0.smithi067.stdout:8/346: chown d0/d2/da/dd/d1f/l2e 8903 1 2024-08-31T05:21:17.904 INFO:tasks.workunit.client.0.smithi067.stdout:2/352: symlink db/d12/d1a/d1e/d5f/l68 0 2024-08-31T05:21:17.905 INFO:tasks.workunit.client.0.smithi067.stdout:2/353: chown db/d12/d1a 26665630 1 2024-08-31T05:21:17.906 INFO:tasks.workunit.client.0.smithi067.stdout:2/354: fdatasync db/ff 0 2024-08-31T05:21:17.906 INFO:tasks.workunit.client.0.smithi067.stdout:2/355: readlink db/le 0 2024-08-31T05:21:17.906 INFO:tasks.workunit.client.0.smithi067.stdout:4/198: truncate d4/f10 2960029 0 2024-08-31T05:21:17.908 INFO:tasks.workunit.client.0.smithi067.stdout:6/500: creat d1b/d23/d28/fa3 x:0 0 0 2024-08-31T05:21:17.911 INFO:tasks.workunit.client.0.smithi067.stdout:3/353: rmdir db/d5a 39 2024-08-31T05:21:17.913 INFO:tasks.workunit.client.0.smithi067.stdout:8/347: rename d0/c4e to d0/d4/de/d1d/c72 0 2024-08-31T05:21:17.918 INFO:tasks.workunit.client.0.smithi067.stdout:6/501: mkdir d1b/d23/d28/d45/da4 0 2024-08-31T05:21:17.920 INFO:tasks.workunit.client.0.smithi067.stdout:3/354: creat db/d17/d3f/f7f x:0 0 0 2024-08-31T05:21:17.920 INFO:tasks.workunit.client.0.smithi067.stdout:4/199: fsync d4/f10 0 2024-08-31T05:21:17.927 INFO:tasks.workunit.client.0.smithi067.stdout:6/502: dwrite d1b/d23/d2e/f3d [0,4194304] 0 2024-08-31T05:21:17.941 INFO:tasks.workunit.client.0.smithi067.stdout:2/356: fsync db/d12/d1a/d2b/d42/f53 0 2024-08-31T05:21:17.949 INFO:tasks.workunit.client.0.smithi067.stdout:2/357: dwrite db/dd/d13/f29 [0,4194304] 0 2024-08-31T05:21:17.955 INFO:tasks.workunit.client.0.smithi067.stdout:2/358: dread db/f25 [0,4194304] 0 2024-08-31T05:21:18.005 INFO:tasks.workunit.client.0.smithi067.stdout:4/200: getdents d4/d1e/d21 0 2024-08-31T05:21:18.009 INFO:tasks.workunit.client.0.smithi067.stdout:8/348: write d0/f40 [403966,29831] 0 2024-08-31T05:21:18.011 INFO:tasks.workunit.client.0.smithi067.stdout:4/201: mkdir d4/d32/d43 0 2024-08-31T05:21:18.012 INFO:tasks.workunit.client.0.smithi067.stdout:3/355: write db/d5a/f5f [1040218,122219] 0 2024-08-31T05:21:18.014 INFO:tasks.workunit.client.0.smithi067.stdout:3/356: truncate db/d12/f4f 337715 0 2024-08-31T05:21:18.021 INFO:tasks.workunit.client.0.smithi067.stdout:3/357: mknod db/d2c/c80 0 2024-08-31T05:21:18.029 INFO:tasks.workunit.client.0.smithi067.stdout:3/358: dwrite db/d2e/d50/f5c [0,4194304] 0 2024-08-31T05:21:18.036 INFO:tasks.workunit.client.0.smithi067.stdout:3/359: dwrite db/d12/f36 [0,4194304] 0 2024-08-31T05:21:18.045 INFO:tasks.workunit.client.0.smithi067.stdout:0/369: sync 2024-08-31T05:21:18.045 INFO:tasks.workunit.client.0.smithi067.stdout:7/224: sync 2024-08-31T05:21:18.045 INFO:tasks.workunit.client.0.smithi067.stdout:5/306: sync 2024-08-31T05:21:18.045 INFO:tasks.workunit.client.0.smithi067.stdout:9/202: sync 2024-08-31T05:21:18.049 INFO:tasks.workunit.client.0.smithi067.stdout:3/360: dwrite db/f10 [0,4194304] 0 2024-08-31T05:21:18.050 INFO:tasks.workunit.client.0.smithi067.stdout:5/307: chown db/d26/d29/d31/c55 711 1 2024-08-31T05:21:18.052 INFO:tasks.workunit.client.0.smithi067.stdout:3/361: write db/d12/f2f [3835296,99940] 0 2024-08-31T05:21:18.053 INFO:tasks.workunit.client.0.smithi067.stdout:5/308: mkdir db/d15/d59 0 2024-08-31T05:21:18.057 INFO:tasks.workunit.client.0.smithi067.stdout:7/225: link d14/d16/f1b d14/d16/d28/d2e/f3a 0 2024-08-31T05:21:18.059 INFO:tasks.workunit.client.0.smithi067.stdout:5/309: mknod db/d26/d4c/c5a 0 2024-08-31T05:21:18.060 INFO:tasks.workunit.client.0.smithi067.stdout:3/362: dwrite db/f57 [0,4194304] 0 2024-08-31T05:21:18.060 INFO:tasks.workunit.client.0.smithi067.stdout:3/363: stat db/d12/f4f 0 2024-08-31T05:21:18.065 INFO:tasks.workunit.client.0.smithi067.stdout:5/310: fdatasync db/f25 0 2024-08-31T05:21:18.071 INFO:tasks.workunit.client.0.smithi067.stdout:5/311: fdatasync db/d1d/d4f/f52 0 2024-08-31T05:21:18.071 INFO:tasks.workunit.client.0.smithi067.stdout:7/226: dwrite fd [0,4194304] 0 2024-08-31T05:21:18.072 INFO:tasks.workunit.client.0.smithi067.stdout:3/364: link db/d2e/d50/d4a/l59 db/d2e/d6a/l81 0 2024-08-31T05:21:18.072 INFO:tasks.workunit.client.0.smithi067.stdout:5/312: chown db/f46 20939 1 2024-08-31T05:21:18.074 INFO:tasks.workunit.client.0.smithi067.stdout:3/365: dread db/d17/f79 [0,4194304] 0 2024-08-31T05:21:18.075 INFO:tasks.workunit.client.0.smithi067.stdout:5/313: read db/f46 [3235590,47179] 0 2024-08-31T05:21:18.076 INFO:tasks.workunit.client.0.smithi067.stdout:3/366: stat db/d17 0 2024-08-31T05:21:18.078 INFO:tasks.workunit.client.0.smithi067.stdout:5/314: truncate db/d15/d42/f39 5127698 0 2024-08-31T05:21:18.079 INFO:tasks.workunit.client.0.smithi067.stdout:3/367: mkdir db/d12/d21/d82 0 2024-08-31T05:21:18.082 INFO:tasks.workunit.client.0.smithi067.stdout:5/315: unlink f4 0 2024-08-31T05:21:18.083 INFO:tasks.workunit.client.0.smithi067.stdout:3/368: rmdir db 39 2024-08-31T05:21:18.084 INFO:tasks.workunit.client.0.smithi067.stdout:5/316: read db/f46 [1376444,282] 0 2024-08-31T05:21:18.084 INFO:tasks.workunit.client.0.smithi067.stdout:7/227: dwrite d14/d16/f32 [4194304,4194304] 0 2024-08-31T05:21:18.087 INFO:tasks.workunit.client.0.smithi067.stdout:3/369: dread - db/d17/f6c zero size 2024-08-31T05:21:18.090 INFO:tasks.workunit.client.0.smithi067.stdout:5/317: mknod db/d26/d4c/c5b 0 2024-08-31T05:21:18.092 INFO:tasks.workunit.client.0.smithi067.stdout:5/318: write f7 [4148626,42758] 0 2024-08-31T05:21:18.093 INFO:tasks.workunit.client.0.smithi067.stdout:7/228: mknod d14/d16/d28/d2e/c3b 0 2024-08-31T05:21:18.096 INFO:tasks.workunit.client.0.smithi067.stdout:3/370: rename db/d17/d3f/d54/d56/d6e to db/d17/d3f/d54/d56/d6e/d83 22 2024-08-31T05:21:18.097 INFO:tasks.workunit.client.0.smithi067.stdout:5/319: symlink db/d15/d59/l5c 0 2024-08-31T05:21:18.098 INFO:tasks.workunit.client.0.smithi067.stdout:3/371: read db/d12/d21/f19 [23323,108143] 0 2024-08-31T05:21:18.098 INFO:tasks.workunit.client.0.smithi067.stdout:5/320: chown db/f1e 4975659 1 2024-08-31T05:21:18.103 INFO:tasks.workunit.client.0.smithi067.stdout:5/321: dread db/d26/f45 [0,4194304] 0 2024-08-31T05:21:18.109 INFO:tasks.workunit.client.0.smithi067.stdout:5/322: link db/f19 db/d26/d29/d31/f5d 0 2024-08-31T05:21:18.109 INFO:tasks.workunit.client.0.smithi067.stdout:5/323: chown db 285352015 1 2024-08-31T05:21:18.111 INFO:tasks.workunit.client.0.smithi067.stdout:3/372: dwrite db/d17/d3f/d54/d56/f7d [0,4194304] 0 2024-08-31T05:21:18.112 INFO:tasks.workunit.client.0.smithi067.stdout:1/244: sync 2024-08-31T05:21:18.113 INFO:tasks.workunit.client.0.smithi067.stdout:5/324: mknod db/d15/d42/d36/c5e 0 2024-08-31T05:21:18.114 INFO:tasks.workunit.client.0.smithi067.stdout:5/325: write db/d15/d42/f39 [2992031,117578] 0 2024-08-31T05:21:18.115 INFO:tasks.workunit.client.0.smithi067.stdout:5/326: dread - db/d26/d29/f57 zero size 2024-08-31T05:21:18.115 INFO:tasks.workunit.client.0.smithi067.stdout:3/373: unlink db/d2c/c80 0 2024-08-31T05:21:18.116 INFO:tasks.workunit.client.0.smithi067.stdout:1/245: symlink d3/d23/d2d/d2e/l56 0 2024-08-31T05:21:18.124 INFO:tasks.workunit.client.0.smithi067.stdout:3/374: link db/d2e/d50/f68 db/d2e/d50/f84 0 2024-08-31T05:21:18.125 INFO:tasks.workunit.client.0.smithi067.stdout:1/246: mknod d3/c57 0 2024-08-31T05:21:18.132 INFO:tasks.workunit.client.0.smithi067.stdout:9/203: creat dd/df/f43 x:0 0 0 2024-08-31T05:21:18.133 INFO:tasks.workunit.client.0.smithi067.stdout:9/204: chown dd/l3a 378817 1 2024-08-31T05:21:18.136 INFO:tasks.workunit.client.0.smithi067.stdout:2/359: truncate f1 2143342 0 2024-08-31T05:21:18.137 INFO:tasks.workunit.client.0.smithi067.stdout:4/202: creat d4/d1f/f44 x:0 0 0 2024-08-31T05:21:18.142 INFO:tasks.workunit.client.0.smithi067.stdout:9/205: dwrite dd/f2d [0,4194304] 0 2024-08-31T05:21:18.146 INFO:tasks.workunit.client.0.smithi067.stdout:9/206: read - dd/df/f24 zero size 2024-08-31T05:21:18.151 INFO:tasks.workunit.client.0.smithi067.stdout:2/360: dwrite db/ff [0,4194304] 0 2024-08-31T05:21:18.151 INFO:tasks.workunit.client.0.smithi067.stdout:9/207: symlink dd/df/d25/l44 0 2024-08-31T05:21:18.156 INFO:tasks.workunit.client.0.smithi067.stdout:2/361: dread - db/d12/d1a/d1e/d4d/f59 zero size 2024-08-31T05:21:18.157 INFO:tasks.workunit.client.0.smithi067.stdout:8/349: dwrite d0/d4/de/f34 [0,4194304] 0 2024-08-31T05:21:18.160 INFO:tasks.workunit.client.0.smithi067.stdout:2/362: chown db/d12/d1a/d1e/d5f/l68 131086965 1 2024-08-31T05:21:18.166 INFO:tasks.workunit.client.0.smithi067.stdout:8/350: mkdir d0/d2/dc/d62/d73 0 2024-08-31T05:21:18.169 INFO:tasks.workunit.client.0.smithi067.stdout:4/203: dread d4/d13/f1a [4194304,4194304] 0 2024-08-31T05:21:18.169 INFO:tasks.workunit.client.0.smithi067.stdout:8/351: getdents d0/d4/de/d1d/d2c/d3c 0 2024-08-31T05:21:18.172 INFO:tasks.workunit.client.0.smithi067.stdout:4/204: mknod d4/c45 0 2024-08-31T05:21:18.173 INFO:tasks.workunit.client.0.smithi067.stdout:0/370: symlink d1/df/l76 0 2024-08-31T05:21:18.176 INFO:tasks.workunit.client.0.smithi067.stdout:0/371: mkdir d1/d8/d77 0 2024-08-31T05:21:18.177 INFO:tasks.workunit.client.0.smithi067.stdout:6/503: mknod d1b/ca5 0 2024-08-31T05:21:18.178 INFO:tasks.workunit.client.0.smithi067.stdout:8/352: dwrite d0/d2/dc/d62/f69 [0,4194304] 0 2024-08-31T05:21:18.179 INFO:tasks.workunit.client.0.smithi067.stdout:0/372: write d1/df/d17/d43/f64 [847766,7539] 0 2024-08-31T05:21:18.184 INFO:tasks.workunit.client.0.smithi067.stdout:4/205: link d4/d1f/f31 d4/d1e/d21/f46 0 2024-08-31T05:21:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:6/504: mknod d1b/d23/d28/d45/da4/ca6 0 2024-08-31T05:21:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:0/373: write d1/df/d17/f20 [2548288,23945] 0 2024-08-31T05:21:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:6/505: truncate d1b/d30/fa2 171992 0 2024-08-31T05:21:18.188 INFO:tasks.workunit.client.0.smithi067.stdout:7/229: getdents d14/d16/d28/d2e 0 2024-08-31T05:21:18.188 INFO:tasks.workunit.client.0.smithi067.stdout:0/374: write d1/f3a [588936,114843] 0 2024-08-31T05:21:18.192 INFO:tasks.workunit.client.0.smithi067.stdout:4/206: link d4/d9/c11 d4/d1e/c47 0 2024-08-31T05:21:18.195 INFO:tasks.workunit.client.0.smithi067.stdout:6/506: dwrite d1b/d23/d61/f97 [0,4194304] 0 2024-08-31T05:21:18.195 INFO:tasks.workunit.client.0.smithi067.stdout:4/207: mkdir d4/d14/d48 0 2024-08-31T05:21:18.197 INFO:tasks.workunit.client.0.smithi067.stdout:0/375: truncate d1/df/f1d 1174945 0 2024-08-31T05:21:18.203 INFO:tasks.workunit.client.0.smithi067.stdout:6/507: dwrite d1b/f21 [0,4194304] 0 2024-08-31T05:21:18.204 INFO:tasks.workunit.client.0.smithi067.stdout:6/508: chown d1b/d8e/d62/c68 22823 1 2024-08-31T05:21:18.206 INFO:tasks.workunit.client.0.smithi067.stdout:2/363: rename db/d12/d24 to db/d12/d1a/d2b/d3d/d69 0 2024-08-31T05:21:18.206 INFO:tasks.workunit.client.0.smithi067.stdout:5/327: write db/f1b [1295969,102736] 0 2024-08-31T05:21:18.210 INFO:tasks.workunit.client.0.smithi067.stdout:6/509: rename d1b/d23/c6b to d1b/d40/d70/d71/ca7 0 2024-08-31T05:21:18.212 INFO:tasks.workunit.client.0.smithi067.stdout:5/328: mkdir db/d15/d53/d5f 0 2024-08-31T05:21:18.213 INFO:tasks.workunit.client.0.smithi067.stdout:6/510: symlink d1b/d23/d28/d45/d5e/d7b/la8 0 2024-08-31T05:21:18.215 INFO:tasks.workunit.client.0.smithi067.stdout:5/329: mkdir db/d26/d60 0 2024-08-31T05:21:18.220 INFO:tasks.workunit.client.0.smithi067.stdout:5/330: rename db/d1d/l4b to db/d15/d42/l61 0 2024-08-31T05:21:18.222 INFO:tasks.workunit.client.0.smithi067.stdout:9/208: rmdir dd/d20 39 2024-08-31T05:21:18.224 INFO:tasks.workunit.client.0.smithi067.stdout:5/331: dread db/f21 [0,4194304] 0 2024-08-31T05:21:18.225 INFO:tasks.workunit.client.0.smithi067.stdout:9/209: mknod dd/df/c45 0 2024-08-31T05:21:18.230 INFO:tasks.workunit.client.0.smithi067.stdout:3/375: rmdir db/d12/d21 39 2024-08-31T05:21:18.231 INFO:tasks.workunit.client.0.smithi067.stdout:4/208: dread d4/d13/f1c [0,4194304] 0 2024-08-31T05:21:18.232 INFO:tasks.workunit.client.0.smithi067.stdout:8/353: rmdir d0/d2/d61 0 2024-08-31T05:21:18.234 INFO:tasks.workunit.client.0.smithi067.stdout:3/376: dread - db/d17/d3f/f4b zero size 2024-08-31T05:21:18.235 INFO:tasks.workunit.client.0.smithi067.stdout:3/377: stat db/d2e 0 2024-08-31T05:21:18.237 INFO:tasks.workunit.client.0.smithi067.stdout:3/378: fsync db/d17/d3f/f7f 0 2024-08-31T05:21:18.238 INFO:tasks.workunit.client.0.smithi067.stdout:5/332: dread db/d15/f18 [0,4194304] 0 2024-08-31T05:21:18.240 INFO:tasks.workunit.client.0.smithi067.stdout:8/354: truncate d0/d2/da/dd/f4c 807735 0 2024-08-31T05:21:18.242 INFO:tasks.workunit.client.0.smithi067.stdout:3/379: truncate db/f14 3928467 0 2024-08-31T05:21:18.243 INFO:tasks.workunit.client.0.smithi067.stdout:5/333: creat db/d26/f62 x:0 0 0 2024-08-31T05:21:18.244 INFO:tasks.workunit.client.0.smithi067.stdout:8/355: truncate d0/d2/dc/d3d/f67 20449 0 2024-08-31T05:21:18.244 INFO:tasks.workunit.client.0.smithi067.stdout:9/210: dread dd/f1e [0,4194304] 0 2024-08-31T05:21:18.245 INFO:tasks.workunit.client.0.smithi067.stdout:8/356: chown d0/d2/f38 260526081 1 2024-08-31T05:21:18.246 INFO:tasks.workunit.client.0.smithi067.stdout:3/380: mkdir db/d2e/d50/d62/d85 0 2024-08-31T05:21:18.247 INFO:tasks.workunit.client.0.smithi067.stdout:8/357: write d0/f40 [1351322,97163] 0 2024-08-31T05:21:18.252 INFO:tasks.workunit.client.0.smithi067.stdout:4/209: dread d4/d1f/f30 [4194304,4194304] 0 2024-08-31T05:21:18.253 INFO:tasks.workunit.client.0.smithi067.stdout:3/381: dread - db/d12/d21/f26 zero size 2024-08-31T05:21:18.253 INFO:tasks.workunit.client.0.smithi067.stdout:3/382: chown db/d2e 4 1 2024-08-31T05:21:18.253 INFO:tasks.workunit.client.0.smithi067.stdout:9/211: symlink dd/d20/l46 0 2024-08-31T05:21:18.257 INFO:tasks.workunit.client.0.smithi067.stdout:8/358: mkdir d0/d74 0 2024-08-31T05:21:18.257 INFO:tasks.workunit.client.0.smithi067.stdout:0/376: truncate d1/f2c 3171389 0 2024-08-31T05:21:18.260 INFO:tasks.workunit.client.0.smithi067.stdout:5/334: dread db/f19 [0,4194304] 0 2024-08-31T05:21:18.261 INFO:tasks.workunit.client.0.smithi067.stdout:9/212: creat dd/d20/f47 x:0 0 0 2024-08-31T05:21:18.262 INFO:tasks.workunit.client.0.smithi067.stdout:9/213: readlink dd/d20/l29 0 2024-08-31T05:21:18.263 INFO:tasks.workunit.client.0.smithi067.stdout:4/210: truncate d4/d1e/d21/f46 3022227 0 2024-08-31T05:21:18.267 INFO:tasks.workunit.client.0.smithi067.stdout:3/383: dwrite db/f3d [0,4194304] 0 2024-08-31T05:21:18.270 INFO:tasks.workunit.client.0.smithi067.stdout:5/335: creat db/d15/d53/f63 x:0 0 0 2024-08-31T05:21:18.273 INFO:tasks.workunit.client.0.smithi067.stdout:6/511: dwrite f9 [0,4194304] 0 2024-08-31T05:21:18.275 INFO:tasks.workunit.client.0.smithi067.stdout:9/214: rename dd/f2d to dd/df/d25/f48 0 2024-08-31T05:21:18.277 INFO:tasks.workunit.client.0.smithi067.stdout:3/384: dread db/f3d [0,4194304] 0 2024-08-31T05:21:18.278 INFO:tasks.workunit.client.0.smithi067.stdout:4/211: symlink d4/d1e/d21/l49 0 2024-08-31T05:21:18.282 INFO:tasks.workunit.client.0.smithi067.stdout:5/336: dwrite db/d15/f12 [4194304,4194304] 0 2024-08-31T05:21:18.285 INFO:tasks.workunit.client.0.smithi067.stdout:2/364: rmdir db/d12/d1a/d1e/d4d 39 2024-08-31T05:21:18.291 INFO:tasks.workunit.client.0.smithi067.stdout:5/337: dwrite db/d15/f1c [4194304,4194304] 0 2024-08-31T05:21:18.293 INFO:tasks.workunit.client.0.smithi067.stdout:5/338: chown db/d15/d42/d36/c5e 23973 1 2024-08-31T05:21:18.299 INFO:tasks.workunit.client.0.smithi067.stdout:9/215: truncate f6 1465361 0 2024-08-31T05:21:18.301 INFO:tasks.workunit.client.0.smithi067.stdout:9/216: chown dd/df/d25/l37 14597751 1 2024-08-31T05:21:18.301 INFO:tasks.workunit.client.0.smithi067.stdout:8/359: dread d0/d2/da/dd/f35 [0,4194304] 0 2024-08-31T05:21:18.309 INFO:tasks.workunit.client.0.smithi067.stdout:0/377: link d1/dd/d4d/l5a d1/dd/d4d/l78 0 2024-08-31T05:21:18.315 INFO:tasks.workunit.client.0.smithi067.stdout:2/365: creat db/d12/d1a/d1e/d5f/f6a x:0 0 0 2024-08-31T05:21:18.316 INFO:tasks.workunit.client.0.smithi067.stdout:2/366: stat db/d12/d1a/d2b/d3d/d69/l30 0 2024-08-31T05:21:18.319 INFO:tasks.workunit.client.0.smithi067.stdout:6/512: rename d1b/d23/d28/d45/d8d/ca1 to d1b/d23/d28/d45/ca9 0 2024-08-31T05:21:18.323 INFO:tasks.workunit.client.0.smithi067.stdout:0/378: dread d1/df/d29/f49 [0,4194304] 0 2024-08-31T05:21:18.324 INFO:tasks.workunit.client.0.smithi067.stdout:5/339: mknod db/d26/d29/d31/d54/c64 0 2024-08-31T05:21:18.325 INFO:tasks.workunit.client.0.smithi067.stdout:0/379: dread - d1/df/d29/f34 zero size 2024-08-31T05:21:18.326 INFO:tasks.workunit.client.0.smithi067.stdout:8/360: mkdir d0/d75 0 2024-08-31T05:21:18.331 INFO:tasks.workunit.client.0.smithi067.stdout:9/217: rename dd/df/d25/f26 to dd/df/f49 0 2024-08-31T05:21:18.334 INFO:tasks.workunit.client.0.smithi067.stdout:3/385: rmdir db/d2e/d50/d69 0 2024-08-31T05:21:18.338 INFO:tasks.workunit.client.0.smithi067.stdout:5/340: creat db/d26/d4c/f65 x:0 0 0 2024-08-31T05:21:18.349 INFO:tasks.workunit.client.0.smithi067.stdout:9/218: rename dd/df/d25/c32 to dd/df/c4a 0 2024-08-31T05:21:18.351 INFO:tasks.workunit.client.0.smithi067.stdout:3/386: symlink db/d17/l86 0 2024-08-31T05:21:18.351 INFO:tasks.workunit.client.0.smithi067.stdout:3/387: dread - db/d4e/f51 zero size 2024-08-31T05:21:18.356 INFO:tasks.workunit.client.0.smithi067.stdout:2/367: creat db/d12/d1a/d1e/f6b x:0 0 0 2024-08-31T05:21:18.360 INFO:tasks.workunit.client.0.smithi067.stdout:5/341: mkdir db/d26/d29/d31/d54/d66 0 2024-08-31T05:21:18.362 INFO:tasks.workunit.client.0.smithi067.stdout:8/361: creat d0/d4/de/d1d/d2c/d3c/f76 x:0 0 0 2024-08-31T05:21:18.366 INFO:tasks.workunit.client.0.smithi067.stdout:6/513: dwrite d1b/f3e [0,4194304] 0 2024-08-31T05:21:18.368 INFO:tasks.workunit.client.0.smithi067.stdout:3/388: creat db/d5a/f87 x:0 0 0 2024-08-31T05:21:18.369 INFO:tasks.workunit.client.0.smithi067.stdout:3/389: fsync db/d17/f65 0 2024-08-31T05:21:18.370 INFO:tasks.workunit.client.0.smithi067.stdout:2/368: symlink db/dd/d13/l6c 0 2024-08-31T05:21:18.370 INFO:tasks.workunit.client.0.smithi067.stdout:3/390: dread - db/d17/d3f/f4b zero size 2024-08-31T05:21:18.371 INFO:tasks.workunit.client.0.smithi067.stdout:5/342: symlink db/d15/d53/l67 0 2024-08-31T05:21:18.376 INFO:tasks.workunit.client.0.smithi067.stdout:4/212: truncate d4/d1f/f31 758568 0 2024-08-31T05:21:18.382 INFO:tasks.workunit.client.0.smithi067.stdout:9/219: write dd/f1e [1133969,102038] 0 2024-08-31T05:21:18.390 INFO:tasks.workunit.client.0.smithi067.stdout:8/362: rename d0/d2/dc/d28/f3f to d0/d4/de/f77 0 2024-08-31T05:21:18.392 INFO:tasks.workunit.client.0.smithi067.stdout:4/213: creat d4/d14/f4a x:0 0 0 2024-08-31T05:21:18.394 INFO:tasks.workunit.client.0.smithi067.stdout:5/343: dwrite db/d15/d42/d36/f3d [0,4194304] 0 2024-08-31T05:21:18.403 INFO:tasks.workunit.client.0.smithi067.stdout:6/514: truncate d1b/d23/d28/d45/d5c/f75 3852166 0 2024-08-31T05:21:18.408 INFO:tasks.workunit.client.0.smithi067.stdout:6/515: dread d1b/d23/d28/d45/d8d/f9f [0,4194304] 0 2024-08-31T05:21:18.422 INFO:tasks.workunit.client.0.smithi067.stdout:8/363: dread d0/d2/f38 [0,4194304] 0 2024-08-31T05:21:18.423 INFO:tasks.workunit.client.0.smithi067.stdout:8/364: read - d0/d4/de/d1d/d2c/f55 zero size 2024-08-31T05:21:18.533 INFO:tasks.workunit.client.0.smithi067.stdout:5/344: symlink db/d26/d29/d31/d54/d66/l68 0 2024-08-31T05:21:18.591 INFO:tasks.workunit.client.0.smithi067.stdout:3/391: getdents db/d2e/d50 0 2024-08-31T05:21:18.595 INFO:tasks.workunit.client.0.smithi067.stdout:8/365: creat d0/d2/da/dd/d1f/f78 x:0 0 0 2024-08-31T05:21:18.598 INFO:tasks.workunit.client.0.smithi067.stdout:6/516: write f14 [1617273,105363] 0 2024-08-31T05:21:18.600 INFO:tasks.workunit.client.0.smithi067.stdout:5/345: symlink db/d26/l69 0 2024-08-31T05:21:18.603 INFO:tasks.workunit.client.0.smithi067.stdout:9/220: getdents dd/df 0 2024-08-31T05:21:18.606 INFO:tasks.workunit.client.0.smithi067.stdout:4/214: write d4/d9/fa [1723261,66656] 0 2024-08-31T05:21:18.609 INFO:tasks.workunit.client.0.smithi067.stdout:6/517: mkdir d1b/d23/d28/d45/daa 0 2024-08-31T05:21:18.614 INFO:tasks.workunit.client.0.smithi067.stdout:9/221: symlink dd/d20/l4b 0 2024-08-31T05:21:18.615 INFO:tasks.workunit.client.0.smithi067.stdout:6/518: dwrite d1b/d30/fa2 [0,4194304] 0 2024-08-31T05:21:18.615 INFO:tasks.workunit.client.0.smithi067.stdout:9/222: write dd/df/d25/d3b/f41 [951686,120680] 0 2024-08-31T05:21:18.617 INFO:tasks.workunit.client.0.smithi067.stdout:8/366: mknod d0/d4/de/d1d/d2c/d68/c79 0 2024-08-31T05:21:18.617 INFO:tasks.workunit.client.0.smithi067.stdout:9/223: stat dd/c35 0 2024-08-31T05:21:18.619 INFO:tasks.workunit.client.0.smithi067.stdout:4/215: mkdir d4/d9/d4b 0 2024-08-31T05:21:18.622 INFO:tasks.workunit.client.0.smithi067.stdout:4/216: write d4/d1f/f44 [145276,61134] 0 2024-08-31T05:21:18.624 INFO:tasks.workunit.client.0.smithi067.stdout:5/346: link db/f1e db/d26/d60/f6a 0 2024-08-31T05:21:18.625 INFO:tasks.workunit.client.0.smithi067.stdout:3/392: dwrite db/d2e/f38 [0,4194304] 0 2024-08-31T05:21:18.626 INFO:tasks.workunit.client.0.smithi067.stdout:5/347: readlink db/d15/l27 0 2024-08-31T05:21:18.628 INFO:tasks.workunit.client.0.smithi067.stdout:6/519: symlink d1b/d23/d28/d45/da4/lab 0 2024-08-31T05:21:18.628 INFO:tasks.workunit.client.0.smithi067.stdout:3/393: write db/d12/d21/f52 [4237617,10165] 0 2024-08-31T05:21:18.628 INFO:tasks.workunit.client.0.smithi067.stdout:9/224: mknod dd/d20/c4c 0 2024-08-31T05:21:18.630 INFO:tasks.workunit.client.0.smithi067.stdout:9/225: read - dd/df/f27 zero size 2024-08-31T05:21:18.630 INFO:tasks.workunit.client.0.smithi067.stdout:3/394: dread - db/d12/d21/f26 zero size 2024-08-31T05:21:18.643 INFO:tasks.workunit.client.0.smithi067.stdout:4/217: mkdir d4/d32/d4c 0 2024-08-31T05:21:18.647 INFO:tasks.workunit.client.0.smithi067.stdout:8/367: dread d0/f9 [0,4194304] 0 2024-08-31T05:21:18.648 INFO:tasks.workunit.client.0.smithi067.stdout:5/348: dread db/f1b [0,4194304] 0 2024-08-31T05:21:18.651 INFO:tasks.workunit.client.0.smithi067.stdout:9/226: rmdir dd/df/d25/d3b 39 2024-08-31T05:21:18.651 INFO:tasks.workunit.client.0.smithi067.stdout:8/368: dread d0/d4/de/f77 [0,4194304] 0 2024-08-31T05:21:18.655 INFO:tasks.workunit.client.0.smithi067.stdout:4/218: mknod d4/d1e/d21/c4d 0 2024-08-31T05:21:18.658 INFO:tasks.workunit.client.0.smithi067.stdout:5/349: unlink db/d15/f22 0 2024-08-31T05:21:18.665 INFO:tasks.workunit.client.0.smithi067.stdout:6/520: rename d1b/d23/d28/l87 to d1b/d8e/d62/lac 0 2024-08-31T05:21:18.665 INFO:tasks.workunit.client.0.smithi067.stdout:1/247: sync 2024-08-31T05:21:18.665 INFO:tasks.workunit.client.0.smithi067.stdout:1/248: chown d3/d23/d2d/l3e 59980 1 2024-08-31T05:21:18.666 INFO:tasks.workunit.client.0.smithi067.stdout:8/369: dread d0/d2/da/dd/f4c [0,4194304] 0 2024-08-31T05:21:18.667 INFO:tasks.workunit.client.0.smithi067.stdout:8/370: truncate d0/d2/f6c 199276 0 2024-08-31T05:21:18.668 INFO:tasks.workunit.client.0.smithi067.stdout:4/219: mknod d4/d9/c4e 0 2024-08-31T05:21:18.670 INFO:tasks.workunit.client.0.smithi067.stdout:5/350: mknod db/d1d/c6b 0 2024-08-31T05:21:18.673 INFO:tasks.workunit.client.0.smithi067.stdout:4/220: symlink d4/d1e/l4f 0 2024-08-31T05:21:18.674 INFO:tasks.workunit.client.0.smithi067.stdout:4/221: readlink d4/d1f/l22 0 2024-08-31T05:21:18.674 INFO:tasks.workunit.client.0.smithi067.stdout:4/222: chown d4/d1e/c27 1123319837 1 2024-08-31T05:21:18.675 INFO:tasks.workunit.client.0.smithi067.stdout:5/351: symlink db/d26/l6c 0 2024-08-31T05:21:18.676 INFO:tasks.workunit.client.0.smithi067.stdout:6/521: mkdir d1b/dad 0 2024-08-31T05:21:18.750 INFO:tasks.workunit.client.0.smithi067.stdout:3/395: getdents db/d2e/d6a 0 2024-08-31T05:21:18.751 INFO:tasks.workunit.client.0.smithi067.stdout:4/223: rmdir d4/d9 39 2024-08-31T05:21:18.754 INFO:tasks.workunit.client.0.smithi067.stdout:4/224: dread d4/d1e/d21/f3a [0,4194304] 0 2024-08-31T05:21:18.755 INFO:tasks.workunit.client.0.smithi067.stdout:6/522: rmdir d1b/d7a 39 2024-08-31T05:21:18.756 INFO:tasks.workunit.client.0.smithi067.stdout:3/396: rename db/d2e/d43 to db/d17/d3f/d54/d56/d88 0 2024-08-31T05:21:18.757 INFO:tasks.workunit.client.0.smithi067.stdout:8/371: creat d0/d2/dc/f7a x:0 0 0 2024-08-31T05:21:18.759 INFO:tasks.workunit.client.0.smithi067.stdout:5/352: mknod db/d15/d53/d5f/c6d 0 2024-08-31T05:21:18.762 INFO:tasks.workunit.client.0.smithi067.stdout:9/227: getdents dd/df/d25/d3b 0 2024-08-31T05:21:18.764 INFO:tasks.workunit.client.0.smithi067.stdout:4/225: creat d4/d42/f50 x:0 0 0 2024-08-31T05:21:18.768 INFO:tasks.workunit.client.0.smithi067.stdout:6/523: dwrite d1b/d23/d28/d45/f5b [0,4194304] 0 2024-08-31T05:21:18.770 INFO:tasks.workunit.client.0.smithi067.stdout:6/524: write f14 [1624434,62074] 0 2024-08-31T05:21:18.775 INFO:tasks.workunit.client.0.smithi067.stdout:9/228: mkdir dd/d4d 0 2024-08-31T05:21:18.777 INFO:tasks.workunit.client.0.smithi067.stdout:6/525: mkdir d1b/d40/d70/d71/dae 0 2024-08-31T05:21:18.778 INFO:tasks.workunit.client.0.smithi067.stdout:4/226: mknod d4/d14/d48/c51 0 2024-08-31T05:21:18.780 INFO:tasks.workunit.client.0.smithi067.stdout:8/372: getdents d0/d2 0 2024-08-31T05:21:18.784 INFO:tasks.workunit.client.0.smithi067.stdout:8/373: mkdir d0/d4/de/d1d/d7b 0 2024-08-31T05:21:18.787 INFO:tasks.workunit.client.0.smithi067.stdout:8/374: symlink d0/d2/da/dd/d1f/l7c 0 2024-08-31T05:21:18.790 INFO:tasks.workunit.client.0.smithi067.stdout:4/227: getdents d4/d1f 0 2024-08-31T05:21:18.792 INFO:tasks.workunit.client.0.smithi067.stdout:8/375: creat d0/d4/f7d x:0 0 0 2024-08-31T05:21:18.794 INFO:tasks.workunit.client.0.smithi067.stdout:4/228: dread - d4/d1f/d34/f3c zero size 2024-08-31T05:21:18.797 INFO:tasks.workunit.client.0.smithi067.stdout:4/229: write d4/d14/f4a [897697,48985] 0 2024-08-31T05:21:18.801 INFO:tasks.workunit.client.0.smithi067.stdout:8/376: dwrite d0/d4/de/d1d/d2c/d3c/f76 [0,4194304] 0 2024-08-31T05:21:18.803 INFO:tasks.workunit.client.0.smithi067.stdout:8/377: dread d0/d2/da/dd/f4c [0,4194304] 0 2024-08-31T05:21:18.804 INFO:tasks.workunit.client.0.smithi067.stdout:8/378: write d0/f40 [1005825,124295] 0 2024-08-31T05:21:18.808 INFO:tasks.workunit.client.0.smithi067.stdout:8/379: fsync d0/f40 0 2024-08-31T05:21:18.808 INFO:tasks.workunit.client.0.smithi067.stdout:4/230: creat d4/d9/d4b/f52 x:0 0 0 2024-08-31T05:21:18.812 INFO:tasks.workunit.client.0.smithi067.stdout:3/397: truncate db/d2e/f38 3119585 0 2024-08-31T05:21:18.814 INFO:tasks.workunit.client.0.smithi067.stdout:3/398: chown db/d17/d3f/d54/d56/d88/c34 0 1 2024-08-31T05:21:18.817 INFO:tasks.workunit.client.0.smithi067.stdout:4/231: fdatasync d4/f25 0 2024-08-31T05:21:18.817 INFO:tasks.workunit.client.0.smithi067.stdout:4/232: readlink d4/d1e/d21/l49 0 2024-08-31T05:21:18.818 INFO:tasks.workunit.client.0.smithi067.stdout:4/233: write d4/d1f/f44 [744453,7543] 0 2024-08-31T05:21:18.823 INFO:tasks.workunit.client.0.smithi067.stdout:6/526: write fd [745062,3514] 0 2024-08-31T05:21:18.825 INFO:tasks.workunit.client.0.smithi067.stdout:5/353: creat db/d26/d29/d31/f6e x:0 0 0 2024-08-31T05:21:18.829 INFO:tasks.workunit.client.0.smithi067.stdout:4/234: mkdir d4/d1e/d53 0 2024-08-31T05:21:18.831 INFO:tasks.workunit.client.0.smithi067.stdout:6/527: dwrite d1b/d23/f34 [4194304,4194304] 0 2024-08-31T05:21:18.833 INFO:tasks.workunit.client.0.smithi067.stdout:0/380: sync 2024-08-31T05:21:18.833 INFO:tasks.workunit.client.0.smithi067.stdout:2/369: sync 2024-08-31T05:21:18.833 INFO:tasks.workunit.client.0.smithi067.stdout:7/230: sync 2024-08-31T05:21:18.834 INFO:tasks.workunit.client.0.smithi067.stdout:7/231: chown lf 14368048 1 2024-08-31T05:21:18.835 INFO:tasks.workunit.client.0.smithi067.stdout:2/370: fdatasync db/dd/d13/f29 0 2024-08-31T05:21:18.848 INFO:tasks.workunit.client.0.smithi067.stdout:4/235: truncate d4/f10 1909352 0 2024-08-31T05:21:18.849 INFO:tasks.workunit.client.0.smithi067.stdout:6/528: dwrite d1b/d23/d28/d45/d5c/f76 [0,4194304] 0 2024-08-31T05:21:18.852 INFO:tasks.workunit.client.0.smithi067.stdout:2/371: write db/d12/d1a/d1e/d4d/f59 [202353,13487] 0 2024-08-31T05:21:18.852 INFO:tasks.workunit.client.0.smithi067.stdout:5/354: mknod db/d15/d42/d36/c6f 0 2024-08-31T05:21:18.853 INFO:tasks.workunit.client.0.smithi067.stdout:8/380: dwrite d0/d2/dc/f49 [0,4194304] 0 2024-08-31T05:21:18.856 INFO:tasks.workunit.client.0.smithi067.stdout:3/399: dwrite db/d2e/d50/f68 [0,4194304] 0 2024-08-31T05:21:18.857 INFO:tasks.workunit.client.0.smithi067.stdout:3/400: write db/f10 [2614838,28548] 0 2024-08-31T05:21:18.860 INFO:tasks.workunit.client.0.smithi067.stdout:7/232: symlink d14/d16/d28/l3c 0 2024-08-31T05:21:18.864 INFO:tasks.workunit.client.0.smithi067.stdout:4/236: unlink d4/d1f/f31 0 2024-08-31T05:21:18.867 INFO:tasks.workunit.client.0.smithi067.stdout:0/381: creat d1/f79 x:0 0 0 2024-08-31T05:21:18.868 INFO:tasks.workunit.client.0.smithi067.stdout:6/529: rename d1b/d23/d28/f37 to d1b/d23/d28/d45/d5c/faf 0 2024-08-31T05:21:18.869 INFO:tasks.workunit.client.0.smithi067.stdout:2/372: read db/d12/d1a/d1e/f21 [770614,49421] 0 2024-08-31T05:21:18.871 INFO:tasks.workunit.client.0.smithi067.stdout:3/401: dwrite db/f10 [4194304,4194304] 0 2024-08-31T05:21:18.871 INFO:tasks.workunit.client.0.smithi067.stdout:5/355: mknod db/d26/c70 0 2024-08-31T05:21:18.872 INFO:tasks.workunit.client.0.smithi067.stdout:4/237: symlink d4/d1f/l54 0 2024-08-31T05:21:18.874 INFO:tasks.workunit.client.0.smithi067.stdout:0/382: symlink d1/dd/l7a 0 2024-08-31T05:21:18.874 INFO:tasks.workunit.client.0.smithi067.stdout:5/356: write db/d26/f62 [720193,40247] 0 2024-08-31T05:21:18.879 INFO:tasks.workunit.client.0.smithi067.stdout:6/530: symlink d1b/d40/d70/lb0 0 2024-08-31T05:21:18.882 INFO:tasks.workunit.client.0.smithi067.stdout:4/238: dread d4/d1f/f44 [0,4194304] 0 2024-08-31T05:21:18.883 INFO:tasks.workunit.client.0.smithi067.stdout:2/373: mkdir db/d12/d1a/d2b/d3d/d4f/d6d 0 2024-08-31T05:21:18.887 INFO:tasks.workunit.client.0.smithi067.stdout:0/383: write d1/f39 [366736,85692] 0 2024-08-31T05:21:18.895 INFO:tasks.workunit.client.0.smithi067.stdout:0/384: dread d1/dd/d4d/f51 [0,4194304] 0 2024-08-31T05:21:18.896 INFO:tasks.workunit.client.0.smithi067.stdout:0/385: chown d1/df/d17/c2b 4366 1 2024-08-31T05:21:18.898 INFO:tasks.workunit.client.0.smithi067.stdout:5/357: creat db/d26/d60/f71 x:0 0 0 2024-08-31T05:21:18.902 INFO:tasks.workunit.client.0.smithi067.stdout:0/386: readlink d1/dd/d4d/l78 0 2024-08-31T05:21:18.904 INFO:tasks.workunit.client.0.smithi067.stdout:0/387: write d1/df/d29/d37/f56 [802862,54225] 0 2024-08-31T05:21:18.904 INFO:tasks.workunit.client.0.smithi067.stdout:7/233: truncate d14/d16/f32 2714344 0 2024-08-31T05:21:18.909 INFO:tasks.workunit.client.0.smithi067.stdout:6/531: link d1b/d8e/d62/c82 d1b/dad/cb1 0 2024-08-31T05:21:18.910 INFO:tasks.workunit.client.0.smithi067.stdout:3/402: write db/f14 [2759278,41026] 0 2024-08-31T05:21:18.911 INFO:tasks.workunit.client.0.smithi067.stdout:7/234: symlink d14/d16/d28/d2e/l3d 0 2024-08-31T05:21:18.912 INFO:tasks.workunit.client.0.smithi067.stdout:3/403: dread - db/d17/d3f/f4b zero size 2024-08-31T05:21:18.913 INFO:tasks.workunit.client.0.smithi067.stdout:3/404: truncate db/d17/d3f/f7f 431713 0 2024-08-31T05:21:18.916 INFO:tasks.workunit.client.0.smithi067.stdout:5/358: rename db/d15/d42/d36/f3d to db/d1d/d4f/f72 0 2024-08-31T05:21:18.918 INFO:tasks.workunit.client.0.smithi067.stdout:5/359: write db/d26/d29/d31/f6e [593621,51995] 0 2024-08-31T05:21:18.918 INFO:tasks.workunit.client.0.smithi067.stdout:3/405: dread db/d2e/d50/f68 [0,4194304] 0 2024-08-31T05:21:18.919 INFO:tasks.workunit.client.0.smithi067.stdout:3/406: chown db/l29 944 1 2024-08-31T05:21:18.919 INFO:tasks.workunit.client.0.smithi067.stdout:3/407: stat db/d5a/f5f 0 2024-08-31T05:21:18.921 INFO:tasks.workunit.client.0.smithi067.stdout:6/532: fdatasync d1b/d23/d28/d45/f65 0 2024-08-31T05:21:18.922 INFO:tasks.workunit.client.0.smithi067.stdout:2/374: getdents db/d12/d1a/d2b/d3d 0 2024-08-31T05:21:18.924 INFO:tasks.workunit.client.0.smithi067.stdout:2/375: stat db/d12/d1a/d2b/d42/f53 0 2024-08-31T05:21:18.924 INFO:tasks.workunit.client.0.smithi067.stdout:0/388: mknod d1/d8/d77/c7b 0 2024-08-31T05:21:18.930 INFO:tasks.workunit.client.0.smithi067.stdout:2/376: read db/ff [1663273,22731] 0 2024-08-31T05:21:18.931 INFO:tasks.workunit.client.0.smithi067.stdout:5/360: fsync db/f25 0 2024-08-31T05:21:18.933 INFO:tasks.workunit.client.0.smithi067.stdout:3/408: creat db/d2c/f89 x:0 0 0 2024-08-31T05:21:18.935 INFO:tasks.workunit.client.0.smithi067.stdout:5/361: chown db/d26/l69 264 1 2024-08-31T05:21:18.935 INFO:tasks.workunit.client.0.smithi067.stdout:2/377: read db/dd/d13/f28 [383392,91283] 0 2024-08-31T05:21:18.936 INFO:tasks.workunit.client.0.smithi067.stdout:4/239: dwrite d4/d9/fa [0,4194304] 0 2024-08-31T05:21:18.936 INFO:tasks.workunit.client.0.smithi067.stdout:3/409: read db/d2e/d50/f5c [933944,19117] 0 2024-08-31T05:21:18.937 INFO:tasks.workunit.client.0.smithi067.stdout:4/240: chown d4/d9 133 1 2024-08-31T05:21:18.944 INFO:tasks.workunit.client.0.smithi067.stdout:2/378: dwrite db/d12/f39 [0,4194304] 0 2024-08-31T05:21:18.951 INFO:tasks.workunit.client.0.smithi067.stdout:0/389: unlink d1/f79 0 2024-08-31T05:21:18.954 INFO:tasks.workunit.client.0.smithi067.stdout:7/235: dread d14/d16/d28/d2e/d2f/f34 [0,4194304] 0 2024-08-31T05:21:18.961 INFO:tasks.workunit.client.0.smithi067.stdout:7/236: dwrite d14/d16/d28/f35 [0,4194304] 0 2024-08-31T05:21:18.963 INFO:tasks.workunit.client.0.smithi067.stdout:5/362: mkdir db/d15/d42/d36/d73 0 2024-08-31T05:21:18.964 INFO:tasks.workunit.client.0.smithi067.stdout:5/363: chown db/d26/d29/d31/d54/d66 52325639 1 2024-08-31T05:21:18.966 INFO:tasks.workunit.client.0.smithi067.stdout:5/364: read db/d15/d42/f44 [3399567,5856] 0 2024-08-31T05:21:18.967 INFO:tasks.workunit.client.0.smithi067.stdout:0/390: chown d1/dd/c10 6 1 2024-08-31T05:21:18.969 INFO:tasks.workunit.client.0.smithi067.stdout:5/365: truncate db/d1d/d3a/f4a 626488 0 2024-08-31T05:21:18.969 INFO:tasks.workunit.client.0.smithi067.stdout:0/391: chown d1/f67 1 1 2024-08-31T05:21:18.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:18 smithi073 ceph-mon[24726]: pgmap v30: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 74 MiB/s rd, 211 MiB/s wr, 415 op/s 2024-08-31T05:21:18.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:18 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:18.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:18 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:18.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:18 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:21:18.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:18 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:21:18.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:18 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:21:18.978 INFO:tasks.workunit.client.0.smithi067.stdout:7/237: read d14/d16/d28/d2e/f3a [1319774,78499] 0 2024-08-31T05:21:18.979 INFO:tasks.workunit.client.0.smithi067.stdout:7/238: fdatasync f6 0 2024-08-31T05:21:18.980 INFO:tasks.workunit.client.0.smithi067.stdout:4/241: mknod d4/c55 0 2024-08-31T05:21:18.985 INFO:tasks.workunit.client.0.smithi067.stdout:3/410: dread db/d12/f58 [0,4194304] 0 2024-08-31T05:21:18.986 INFO:tasks.workunit.client.0.smithi067.stdout:6/533: getdents d1b/d23/d28/d45/d5c 0 2024-08-31T05:21:18.987 INFO:tasks.workunit.client.0.smithi067.stdout:6/534: write d1b/d23/d28/f85 [250353,28767] 0 2024-08-31T05:21:18.989 INFO:tasks.workunit.client.0.smithi067.stdout:6/535: fdatasync d1b/d23/d28/f2b 0 2024-08-31T05:21:18.995 INFO:tasks.workunit.client.0.smithi067.stdout:2/379: rename db/dd/f11 to db/d12/f6e 0 2024-08-31T05:21:18.996 INFO:tasks.workunit.client.0.smithi067.stdout:0/392: symlink d1/d8/d66/l7c 0 2024-08-31T05:21:19.002 INFO:tasks.workunit.client.0.smithi067.stdout:7/239: mkdir d14/d3e 0 2024-08-31T05:21:19.010 INFO:tasks.workunit.client.0.smithi067.stdout:3/411: rename db/d12/d21/f52 to db/d12/d21/d82/f8a 0 2024-08-31T05:21:19.013 INFO:tasks.workunit.client.0.smithi067.stdout:0/393: symlink d1/df/d29/l7d 0 2024-08-31T05:21:19.014 INFO:tasks.workunit.client.0.smithi067.stdout:4/242: write d4/d13/f24 [590525,16250] 0 2024-08-31T05:21:19.014 INFO:tasks.workunit.client.0.smithi067.stdout:6/536: mknod d1b/d23/d61/d77/cb2 0 2024-08-31T05:21:19.016 INFO:tasks.workunit.client.0.smithi067.stdout:4/243: write d4/d14/f4a [1947363,4673] 0 2024-08-31T05:21:19.017 INFO:tasks.workunit.client.0.smithi067.stdout:7/240: chown d14/d16/d28/l3c 34 1 2024-08-31T05:21:19.019 INFO:tasks.workunit.client.0.smithi067.stdout:3/412: mknod db/d55/c8b 0 2024-08-31T05:21:19.021 INFO:tasks.workunit.client.0.smithi067.stdout:5/366: getdents db/d15/d53 0 2024-08-31T05:21:19.025 INFO:tasks.workunit.client.0.smithi067.stdout:7/241: dwrite fd [0,4194304] 0 2024-08-31T05:21:19.033 INFO:tasks.workunit.client.0.smithi067.stdout:3/413: creat db/d17/d3f/d54/d56/f8c x:0 0 0 2024-08-31T05:21:19.034 INFO:tasks.workunit.client.0.smithi067.stdout:0/394: dread d1/df/d17/f20 [0,4194304] 0 2024-08-31T05:21:19.034 INFO:tasks.workunit.client.0.smithi067.stdout:2/380: creat db/d12/d1a/d2b/d3d/d4f/d63/f6f x:0 0 0 2024-08-31T05:21:19.036 INFO:tasks.workunit.client.0.smithi067.stdout:2/381: write db/d12/d1a/d1e/f54 [742130,87995] 0 2024-08-31T05:21:19.037 INFO:tasks.workunit.client.0.smithi067.stdout:5/367: unlink db/d26/d4c/c5b 0 2024-08-31T05:21:19.044 INFO:tasks.workunit.client.0.smithi067.stdout:3/414: mkdir db/d2e/d6a/d8d 0 2024-08-31T05:21:19.046 INFO:tasks.workunit.client.0.smithi067.stdout:4/244: dwrite d4/d1e/d21/f3a [0,4194304] 0 2024-08-31T05:21:19.050 INFO:tasks.workunit.client.0.smithi067.stdout:5/368: creat db/d26/f74 x:0 0 0 2024-08-31T05:21:19.053 INFO:tasks.workunit.client.0.smithi067.stdout:7/242: mknod d14/d16/d28/c3f 0 2024-08-31T05:21:19.053 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:18 smithi067 ceph-mon[17432]: pgmap v30: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 74 MiB/s rd, 211 MiB/s wr, 415 op/s 2024-08-31T05:21:19.053 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:18 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:19.053 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:18 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:19.053 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:18 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:21:19.053 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:18 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-31T05:21:19.053 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:18 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:21:19.059 INFO:tasks.workunit.client.0.smithi067.stdout:6/537: dwrite d1b/d23/d2e/d3b/f95 [0,4194304] 0 2024-08-31T05:21:19.061 INFO:tasks.workunit.client.0.smithi067.stdout:5/369: creat db/d15/f75 x:0 0 0 2024-08-31T05:21:19.068 INFO:tasks.workunit.client.0.smithi067.stdout:0/395: write d1/f2c [2418247,123702] 0 2024-08-31T05:21:19.069 INFO:tasks.workunit.client.0.smithi067.stdout:4/245: mkdir d4/d56 0 2024-08-31T05:21:19.073 INFO:tasks.workunit.client.0.smithi067.stdout:5/370: mknod db/d1d/d4f/c76 0 2024-08-31T05:21:19.073 INFO:tasks.workunit.client.0.smithi067.stdout:7/243: write d14/f18 [2763374,95442] 0 2024-08-31T05:21:19.073 INFO:tasks.workunit.client.0.smithi067.stdout:4/246: dread - d4/d1e/f3f zero size 2024-08-31T05:21:19.073 INFO:tasks.workunit.client.0.smithi067.stdout:2/382: dread db/dd/f15 [0,4194304] 0 2024-08-31T05:21:19.074 INFO:tasks.workunit.client.0.smithi067.stdout:6/538: mkdir d1b/d40/d96/db3 0 2024-08-31T05:21:19.074 INFO:tasks.workunit.client.0.smithi067.stdout:3/415: link db/d2c/c3c db/d12/d21/d82/c8e 0 2024-08-31T05:21:19.076 INFO:tasks.workunit.client.0.smithi067.stdout:7/244: rename ce to d14/d3e/c40 0 2024-08-31T05:21:19.079 INFO:tasks.workunit.client.0.smithi067.stdout:0/396: link d1/df/d17/d43/f64 d1/dd/f7e 0 2024-08-31T05:21:19.080 INFO:tasks.workunit.client.0.smithi067.stdout:0/397: chown d1/d8 1 1 2024-08-31T05:21:19.082 INFO:tasks.workunit.client.0.smithi067.stdout:3/416: mknod db/d2e/d50/d62/c8f 0 2024-08-31T05:21:19.084 INFO:tasks.workunit.client.0.smithi067.stdout:3/417: dread - db/d4e/f51 zero size 2024-08-31T05:21:19.085 INFO:tasks.workunit.client.0.smithi067.stdout:7/245: chown d14/d16/d28/d2e/c30 10260 1 2024-08-31T05:21:19.085 INFO:tasks.workunit.client.0.smithi067.stdout:5/371: mkdir db/d15/d42/d36/d73/d77 0 2024-08-31T05:21:19.085 INFO:tasks.workunit.client.0.smithi067.stdout:6/539: mknod d1b/d40/d70/d71/dae/cb4 0 2024-08-31T05:21:19.085 INFO:tasks.workunit.client.0.smithi067.stdout:4/247: dwrite d4/d13/f1c [8388608,4194304] 0 2024-08-31T05:21:19.085 INFO:tasks.workunit.client.0.smithi067.stdout:7/246: readlink lf 0 2024-08-31T05:21:19.086 INFO:tasks.workunit.client.0.smithi067.stdout:2/383: creat db/f70 x:0 0 0 2024-08-31T05:21:19.087 INFO:tasks.workunit.client.0.smithi067.stdout:6/540: write d1b/f21 [793982,66101] 0 2024-08-31T05:21:19.088 INFO:tasks.workunit.client.0.smithi067.stdout:0/398: rename d1/df/d29/f34 to d1/df/d17/d43/d48/f7f 0 2024-08-31T05:21:19.091 INFO:tasks.workunit.client.0.smithi067.stdout:4/248: creat d4/d42/f57 x:0 0 0 2024-08-31T05:21:19.092 INFO:tasks.workunit.client.0.smithi067.stdout:7/247: creat d14/d16/f41 x:0 0 0 2024-08-31T05:21:19.096 INFO:tasks.workunit.client.0.smithi067.stdout:5/372: rename db/d26/d29/d31/f5d to db/d1d/f78 0 2024-08-31T05:21:19.097 INFO:tasks.workunit.client.0.smithi067.stdout:2/384: dwrite db/d12/d1a/d1e/d5f/f6a [0,4194304] 0 2024-08-31T05:21:19.097 INFO:tasks.workunit.client.0.smithi067.stdout:0/399: fsync d1/dd/f15 0 2024-08-31T05:21:19.101 INFO:tasks.workunit.client.0.smithi067.stdout:4/249: symlink d4/d42/l58 0 2024-08-31T05:21:19.102 INFO:tasks.workunit.client.0.smithi067.stdout:4/250: chown d4/d13/f1a 1 1 2024-08-31T05:21:19.104 INFO:tasks.workunit.client.0.smithi067.stdout:7/248: creat d14/d16/f42 x:0 0 0 2024-08-31T05:21:19.106 INFO:tasks.workunit.client.0.smithi067.stdout:6/541: creat d1b/d40/d96/db3/fb5 x:0 0 0 2024-08-31T05:21:19.108 INFO:tasks.workunit.client.0.smithi067.stdout:0/400: mkdir d1/df/d17/d43/d80 0 2024-08-31T05:21:19.108 INFO:tasks.workunit.client.0.smithi067.stdout:4/251: mknod d4/d32/c59 0 2024-08-31T05:21:19.112 INFO:tasks.workunit.client.0.smithi067.stdout:2/385: creat db/d12/d1a/d2b/d42/d62/f71 x:0 0 0 2024-08-31T05:21:19.114 INFO:tasks.workunit.client.0.smithi067.stdout:6/542: truncate d1b/d23/d28/d45/f65 98073 0 2024-08-31T05:21:19.114 INFO:tasks.workunit.client.0.smithi067.stdout:2/386: read db/d12/d1a/d1e/d4d/f56 [23720,104485] 0 2024-08-31T05:21:19.116 INFO:tasks.workunit.client.0.smithi067.stdout:0/401: creat d1/d8/d77/f81 x:0 0 0 2024-08-31T05:21:19.116 INFO:tasks.workunit.client.0.smithi067.stdout:4/252: dwrite d4/d9/fa [4194304,4194304] 0 2024-08-31T05:21:19.117 INFO:tasks.workunit.client.0.smithi067.stdout:2/387: read db/d12/d1a/d1e/d5f/f6a [1573292,14145] 0 2024-08-31T05:21:19.118 INFO:tasks.workunit.client.0.smithi067.stdout:6/543: dread d1b/d23/f9c [0,4194304] 0 2024-08-31T05:21:19.119 INFO:tasks.workunit.client.0.smithi067.stdout:4/253: dread - d4/d1e/f3f zero size 2024-08-31T05:21:19.119 INFO:tasks.workunit.client.0.smithi067.stdout:0/402: chown d1/dd/d4d/l5a 806 1 2024-08-31T05:21:19.119 INFO:tasks.workunit.client.0.smithi067.stdout:3/418: getdents db/d12/d21/d82 0 2024-08-31T05:21:19.123 INFO:tasks.workunit.client.0.smithi067.stdout:6/544: read d1b/d23/d28/d45/d5c/f76 [2398444,29280] 0 2024-08-31T05:21:19.126 INFO:tasks.workunit.client.0.smithi067.stdout:2/388: dread db/dd/d2d/f51 [0,4194304] 0 2024-08-31T05:21:19.133 INFO:tasks.workunit.client.0.smithi067.stdout:7/249: rename d14/d16/d28/d2e/l3d to d14/d16/d28/l43 0 2024-08-31T05:21:19.133 INFO:tasks.workunit.client.0.smithi067.stdout:6/545: dwrite fd [0,4194304] 0 2024-08-31T05:21:19.134 INFO:tasks.workunit.client.0.smithi067.stdout:3/419: dwrite db/d2c/f89 [0,4194304] 0 2024-08-31T05:21:19.135 INFO:tasks.workunit.client.0.smithi067.stdout:6/546: readlink d1b/d23/d2e/l57 0 2024-08-31T05:21:19.137 INFO:tasks.workunit.client.0.smithi067.stdout:3/420: readlink db/d17/d3f/d54/d56/d88/l77 0 2024-08-31T05:21:19.141 INFO:tasks.workunit.client.0.smithi067.stdout:4/254: mkdir d4/d9/d5a 0 2024-08-31T05:21:19.142 INFO:tasks.workunit.client.0.smithi067.stdout:5/373: link db/d26/l3f db/d26/d29/d31/d54/d66/l79 0 2024-08-31T05:21:19.148 INFO:tasks.workunit.client.0.smithi067.stdout:7/250: fsync d14/d16/f42 0 2024-08-31T05:21:19.149 INFO:tasks.workunit.client.0.smithi067.stdout:7/251: chown d14/d16/f42 5 1 2024-08-31T05:21:19.150 INFO:tasks.workunit.client.0.smithi067.stdout:7/252: chown d14/d16/d28/d2e/d2f/f34 201 1 2024-08-31T05:21:19.156 INFO:tasks.workunit.client.0.smithi067.stdout:6/547: mkdir d1b/d40/d96/db6 0 2024-08-31T05:21:19.159 INFO:tasks.workunit.client.0.smithi067.stdout:3/421: creat db/d2e/f90 x:0 0 0 2024-08-31T05:21:19.161 INFO:tasks.workunit.client.0.smithi067.stdout:5/374: mkdir db/d26/d29/d31/d7a 0 2024-08-31T05:21:19.163 INFO:tasks.workunit.client.0.smithi067.stdout:4/255: rename d4/d1e/d21/l49 to d4/d1e/d21/l5b 0 2024-08-31T05:21:19.164 INFO:tasks.workunit.client.0.smithi067.stdout:4/256: write d4/d1f/f3d [430322,50910] 0 2024-08-31T05:21:19.164 INFO:tasks.workunit.client.0.smithi067.stdout:7/253: write d14/f1e [4380473,91382] 0 2024-08-31T05:21:19.167 INFO:tasks.workunit.client.0.smithi067.stdout:6/548: mknod d1b/d23/d28/d45/da4/cb7 0 2024-08-31T05:21:19.168 INFO:tasks.workunit.client.0.smithi067.stdout:6/549: chown d1b/d40/d70/lb0 0 1 2024-08-31T05:21:19.170 INFO:tasks.workunit.client.0.smithi067.stdout:5/375: rename db/d15/l27 to db/d26/d60/l7b 0 2024-08-31T05:21:19.170 INFO:tasks.workunit.client.0.smithi067.stdout:0/403: link d1/l31 d1/d8/d77/l82 0 2024-08-31T05:21:19.172 INFO:tasks.workunit.client.0.smithi067.stdout:3/422: mkdir db/d91 0 2024-08-31T05:21:19.174 INFO:tasks.workunit.client.0.smithi067.stdout:7/254: dread f7 [0,4194304] 0 2024-08-31T05:21:19.178 INFO:tasks.workunit.client.0.smithi067.stdout:0/404: dwrite d1/df/d17/f4f [0,4194304] 0 2024-08-31T05:21:19.179 INFO:tasks.workunit.client.0.smithi067.stdout:6/550: link d1b/f21 d1b/d23/d28/d45/daa/fb8 0 2024-08-31T05:21:19.182 INFO:tasks.workunit.client.0.smithi067.stdout:6/551: dread f9 [0,4194304] 0 2024-08-31T05:21:19.188 INFO:tasks.workunit.client.0.smithi067.stdout:3/423: creat db/d2e/d50/d62/d85/f92 x:0 0 0 2024-08-31T05:21:19.189 INFO:tasks.workunit.client.0.smithi067.stdout:6/552: dread d1b/f21 [0,4194304] 0 2024-08-31T05:21:19.191 INFO:tasks.workunit.client.0.smithi067.stdout:7/255: dwrite d14/d16/d28/d2e/d2f/f34 [0,4194304] 0 2024-08-31T05:21:19.192 INFO:tasks.workunit.client.0.smithi067.stdout:7/256: read d14/d16/d28/f35 [2613330,99848] 0 2024-08-31T05:21:19.193 INFO:tasks.workunit.client.0.smithi067.stdout:0/405: creat d1/df/d29/d37/d6f/f83 x:0 0 0 2024-08-31T05:21:19.193 INFO:tasks.workunit.client.0.smithi067.stdout:7/257: chown c10 379126 1 2024-08-31T05:21:19.194 INFO:tasks.workunit.client.0.smithi067.stdout:0/406: write d1/dd/f58 [826341,70756] 0 2024-08-31T05:21:19.194 INFO:tasks.workunit.client.0.smithi067.stdout:5/376: getdents db/d26/d29 0 2024-08-31T05:21:19.196 INFO:tasks.workunit.client.0.smithi067.stdout:3/424: creat db/d2e/d50/d62/d85/f93 x:0 0 0 2024-08-31T05:21:19.198 INFO:tasks.workunit.client.0.smithi067.stdout:6/553: unlink d1b/d23/d28/c6f 0 2024-08-31T05:21:19.201 INFO:tasks.workunit.client.0.smithi067.stdout:1/249: sync 2024-08-31T05:21:19.203 INFO:tasks.workunit.client.0.smithi067.stdout:7/258: unlink lf 0 2024-08-31T05:21:19.206 INFO:tasks.workunit.client.0.smithi067.stdout:6/554: rmdir d1b/d40/d96/db3 39 2024-08-31T05:21:19.208 INFO:tasks.workunit.client.0.smithi067.stdout:1/250: symlink d3/d23/d2d/d2e/l58 0 2024-08-31T05:21:19.208 INFO:tasks.workunit.client.0.smithi067.stdout:0/407: dread d1/dd/f21 [0,4194304] 0 2024-08-31T05:21:19.209 INFO:tasks.workunit.client.0.smithi067.stdout:0/408: truncate d1/f3a 4845836 0 2024-08-31T05:21:19.210 INFO:tasks.workunit.client.0.smithi067.stdout:0/409: read d1/d8/f16 [1415849,18341] 0 2024-08-31T05:21:19.211 INFO:tasks.workunit.client.0.smithi067.stdout:0/410: write d1/d8/f16 [3352233,69194] 0 2024-08-31T05:21:19.213 INFO:tasks.workunit.client.0.smithi067.stdout:5/377: truncate db/d15/d42/f44 650899 0 2024-08-31T05:21:19.214 INFO:tasks.workunit.client.0.smithi067.stdout:3/425: link db/d5a/f87 db/d2e/d50/d62/d85/f94 0 2024-08-31T05:21:19.218 INFO:tasks.workunit.client.0.smithi067.stdout:1/251: unlink d3/f28 0 2024-08-31T05:21:19.221 INFO:tasks.workunit.client.0.smithi067.stdout:1/252: write d3/dd/f54 [837078,90945] 0 2024-08-31T05:21:19.221 INFO:tasks.workunit.client.0.smithi067.stdout:7/259: mknod d14/d16/d28/c44 0 2024-08-31T05:21:19.222 INFO:tasks.workunit.client.0.smithi067.stdout:3/426: dwrite db/d17/d3f/d54/f64 [0,4194304] 0 2024-08-31T05:21:19.224 INFO:tasks.workunit.client.0.smithi067.stdout:5/378: unlink db/d26/l69 0 2024-08-31T05:21:19.224 INFO:tasks.workunit.client.0.smithi067.stdout:3/427: write db/d5a/f5f [884699,128516] 0 2024-08-31T05:21:19.225 INFO:tasks.workunit.client.0.smithi067.stdout:0/411: mkdir d1/df/d17/d43/d48/d6a/d84 0 2024-08-31T05:21:19.226 INFO:tasks.workunit.client.0.smithi067.stdout:0/412: read d1/df/d17/f20 [3806241,43854] 0 2024-08-31T05:21:19.232 INFO:tasks.workunit.client.0.smithi067.stdout:5/379: readlink db/d26/d29/l47 0 2024-08-31T05:21:19.233 INFO:tasks.workunit.client.0.smithi067.stdout:6/555: dwrite f10 [0,4194304] 0 2024-08-31T05:21:19.236 INFO:tasks.workunit.client.0.smithi067.stdout:3/428: mknod db/d2e/c95 0 2024-08-31T05:21:19.236 INFO:tasks.workunit.client.0.smithi067.stdout:0/413: symlink d1/df/d29/d37/d6f/l85 0 2024-08-31T05:21:19.236 INFO:tasks.workunit.client.0.smithi067.stdout:7/260: mknod d14/d16/d28/c45 0 2024-08-31T05:21:19.241 INFO:tasks.workunit.client.0.smithi067.stdout:5/380: mkdir db/d1d/d3a/d7c 0 2024-08-31T05:21:19.242 INFO:tasks.workunit.client.0.smithi067.stdout:6/556: mkdir d1b/d23/d28/db9 0 2024-08-31T05:21:19.243 INFO:tasks.workunit.client.0.smithi067.stdout:6/557: chown d1b/d40/l58 1008 1 2024-08-31T05:21:19.244 INFO:tasks.workunit.client.0.smithi067.stdout:3/429: fdatasync db/d2e/d50/f84 0 2024-08-31T05:21:19.245 INFO:tasks.workunit.client.0.smithi067.stdout:3/430: chown db/d17/l22 898744884 1 2024-08-31T05:21:19.247 INFO:tasks.workunit.client.0.smithi067.stdout:6/558: creat d1b/d23/d61/fba x:0 0 0 2024-08-31T05:21:19.250 INFO:tasks.workunit.client.0.smithi067.stdout:6/559: read f19 [2988334,119533] 0 2024-08-31T05:21:19.254 INFO:tasks.workunit.client.0.smithi067.stdout:1/253: write d3/d23/d2d/d2e/d3a/f48 [748611,100272] 0 2024-08-31T05:21:19.255 INFO:tasks.workunit.client.0.smithi067.stdout:7/261: dread d14/d16/d28/f29 [0,4194304] 0 2024-08-31T05:21:19.256 INFO:tasks.workunit.client.0.smithi067.stdout:6/560: dread d1b/f21 [0,4194304] 0 2024-08-31T05:21:19.260 INFO:tasks.workunit.client.0.smithi067.stdout:3/431: dread db/f14 [0,4194304] 0 2024-08-31T05:21:19.268 INFO:tasks.workunit.client.0.smithi067.stdout:1/254: creat d3/d23/d2d/d2e/d34/f59 x:0 0 0 2024-08-31T05:21:19.268 INFO:tasks.workunit.client.0.smithi067.stdout:5/381: dwrite db/f1e [4194304,4194304] 0 2024-08-31T05:21:19.277 INFO:tasks.workunit.client.0.smithi067.stdout:6/561: creat d1b/d7a/fbb x:0 0 0 2024-08-31T05:21:19.277 INFO:tasks.workunit.client.0.smithi067.stdout:1/255: fsync d3/d23/d2d/d2e/f39 0 2024-08-31T05:21:19.277 INFO:tasks.workunit.client.0.smithi067.stdout:5/382: symlink db/d15/d42/d36/d73/l7d 0 2024-08-31T05:21:19.278 INFO:tasks.workunit.client.0.smithi067.stdout:7/262: dwrite d14/d16/d28/f29 [0,4194304] 0 2024-08-31T05:21:19.285 INFO:tasks.workunit.client.0.smithi067.stdout:7/263: dread d14/d16/d28/f29 [0,4194304] 0 2024-08-31T05:21:19.290 INFO:tasks.workunit.client.0.smithi067.stdout:6/562: creat d1b/fbc x:0 0 0 2024-08-31T05:21:19.290 INFO:tasks.workunit.client.0.smithi067.stdout:3/432: truncate db/d2e/f46 4091260 0 2024-08-31T05:21:19.292 INFO:tasks.workunit.client.0.smithi067.stdout:5/383: getdents db/d26/d29 0 2024-08-31T05:21:19.294 INFO:tasks.workunit.client.0.smithi067.stdout:6/563: mknod d1b/d40/d70/d71/dae/cbd 0 2024-08-31T05:21:19.296 INFO:tasks.workunit.client.0.smithi067.stdout:3/433: creat db/d17/d3f/d54/d56/f96 x:0 0 0 2024-08-31T05:21:19.298 INFO:tasks.workunit.client.0.smithi067.stdout:1/256: link d3/f14 d3/d23/d2d/d2e/d3a/f5a 0 2024-08-31T05:21:19.300 INFO:tasks.workunit.client.0.smithi067.stdout:7/264: link fb d14/d16/d28/d2e/f46 0 2024-08-31T05:21:19.300 INFO:tasks.workunit.client.0.smithi067.stdout:5/384: dwrite db/d26/d29/d31/f41 [0,4194304] 0 2024-08-31T05:21:19.304 INFO:tasks.workunit.client.0.smithi067.stdout:6/564: dwrite f18 [0,4194304] 0 2024-08-31T05:21:19.304 INFO:tasks.workunit.client.0.smithi067.stdout:5/385: write db/d26/f62 [632081,2957] 0 2024-08-31T05:21:19.309 INFO:tasks.workunit.client.0.smithi067.stdout:7/265: truncate f11 331791 0 2024-08-31T05:21:19.309 INFO:tasks.workunit.client.0.smithi067.stdout:5/386: truncate db/d26/d29/d31/f41 4609610 0 2024-08-31T05:21:19.310 INFO:tasks.workunit.client.0.smithi067.stdout:7/266: fsync d14/d16/f41 0 2024-08-31T05:21:19.311 INFO:tasks.workunit.client.0.smithi067.stdout:7/267: readlink d14/d16/d28/l3c 0 2024-08-31T05:21:19.313 INFO:tasks.workunit.client.0.smithi067.stdout:1/257: rename d3/dd/f1c to d3/d23/d2d/d2e/f5b 0 2024-08-31T05:21:19.314 INFO:tasks.workunit.client.0.smithi067.stdout:6/565: fsync f9 0 2024-08-31T05:21:19.316 INFO:tasks.workunit.client.0.smithi067.stdout:5/387: dread db/d26/d60/f6a [4194304,4194304] 0 2024-08-31T05:21:19.322 INFO:tasks.workunit.client.0.smithi067.stdout:3/434: dwrite db/d17/d3f/d54/d56/d88/f28 [4194304,4194304] 0 2024-08-31T05:21:19.325 INFO:tasks.workunit.client.0.smithi067.stdout:7/268: truncate d14/f15 2247271 0 2024-08-31T05:21:19.326 INFO:tasks.workunit.client.0.smithi067.stdout:5/388: dwrite db/d1d/d3a/f4a [0,4194304] 0 2024-08-31T05:21:19.332 INFO:tasks.workunit.client.0.smithi067.stdout:3/435: mkdir db/d55/d97 0 2024-08-31T05:21:19.334 INFO:tasks.workunit.client.0.smithi067.stdout:1/258: getdents d3/d23/d2d/d2e 0 2024-08-31T05:21:19.334 INFO:tasks.workunit.client.0.smithi067.stdout:6/566: getdents d1b/d40/d96/db3 0 2024-08-31T05:21:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:3/436: truncate db/d12/f18 9156362 0 2024-08-31T05:21:19.337 INFO:tasks.workunit.client.0.smithi067.stdout:6/567: symlink d1b/d40/d70/lbe 0 2024-08-31T05:21:19.338 INFO:tasks.workunit.client.0.smithi067.stdout:6/568: truncate d1b/fbc 1011914 0 2024-08-31T05:21:19.340 INFO:tasks.workunit.client.0.smithi067.stdout:6/569: rmdir d1b/d23/d28/d45/da4 39 2024-08-31T05:21:19.342 INFO:tasks.workunit.client.0.smithi067.stdout:6/570: creat d1b/d23/d28/db9/fbf x:0 0 0 2024-08-31T05:21:19.359 INFO:tasks.workunit.client.0.smithi067.stdout:3/437: write db/d2c/f48 [554414,110511] 0 2024-08-31T05:21:19.360 INFO:tasks.workunit.client.0.smithi067.stdout:3/438: dread - db/d2e/d50/d62/d85/f94 zero size 2024-08-31T05:21:19.362 INFO:tasks.workunit.client.0.smithi067.stdout:6/571: truncate d1b/f74 2669629 0 2024-08-31T05:21:19.363 INFO:tasks.workunit.client.0.smithi067.stdout:3/439: mknod db/d2e/d50/d62/d85/c98 0 2024-08-31T05:21:19.366 INFO:tasks.workunit.client.0.smithi067.stdout:3/440: truncate db/d12/f58 978996 0 2024-08-31T05:21:19.367 INFO:tasks.workunit.client.0.smithi067.stdout:6/572: symlink d1b/dad/lc0 0 2024-08-31T05:21:19.369 INFO:tasks.workunit.client.0.smithi067.stdout:6/573: mknod d1b/dad/cc1 0 2024-08-31T05:21:19.371 INFO:tasks.workunit.client.0.smithi067.stdout:6/574: unlink d1b/d23/d28/d45/d5c/f76 0 2024-08-31T05:21:19.373 INFO:tasks.workunit.client.0.smithi067.stdout:6/575: read d1b/d23/d28/d45/d5e/f5f [133272,88047] 0 2024-08-31T05:21:19.374 INFO:tasks.workunit.client.0.smithi067.stdout:6/576: stat d1b/d23/d28/d45/d5e/f5f 0 2024-08-31T05:21:19.378 INFO:tasks.workunit.client.0.smithi067.stdout:6/577: rmdir d1b/d23/d2e/d3b 39 2024-08-31T05:21:19.380 INFO:tasks.workunit.client.0.smithi067.stdout:3/441: write db/d12/d21/f19 [886194,49429] 0 2024-08-31T05:21:19.380 INFO:tasks.workunit.client.0.smithi067.stdout:6/578: rmdir d1b/d23/d28/d45/daa 39 2024-08-31T05:21:19.382 INFO:tasks.workunit.client.0.smithi067.stdout:3/442: fdatasync db/d2e/d50/d62/f66 0 2024-08-31T05:21:19.384 INFO:tasks.workunit.client.0.smithi067.stdout:6/579: unlink d1b/d23/c6e 0 2024-08-31T05:21:19.384 INFO:tasks.workunit.client.0.smithi067.stdout:6/580: stat d1b/d7a 0 2024-08-31T05:21:19.388 INFO:tasks.workunit.client.0.smithi067.stdout:3/443: creat db/d2e/d50/d62/f99 x:0 0 0 2024-08-31T05:21:19.391 INFO:tasks.workunit.client.0.smithi067.stdout:6/581: fdatasync d1b/d30/f73 0 2024-08-31T05:21:19.392 INFO:tasks.workunit.client.0.smithi067.stdout:6/582: fsync d1b/d23/f2a 0 2024-08-31T05:21:19.394 INFO:tasks.workunit.client.0.smithi067.stdout:6/583: fsync d1b/d40/d96/db3/fb5 0 2024-08-31T05:21:19.395 INFO:tasks.workunit.client.0.smithi067.stdout:3/444: dwrite db/f53 [0,4194304] 0 2024-08-31T05:21:19.398 INFO:tasks.workunit.client.0.smithi067.stdout:6/584: symlink d1b/d23/d28/d45/lc2 0 2024-08-31T05:21:19.398 INFO:tasks.workunit.client.0.smithi067.stdout:6/585: dread - d1b/d40/f98 zero size 2024-08-31T05:21:19.401 INFO:tasks.workunit.client.0.smithi067.stdout:3/445: unlink db/d2e/c47 0 2024-08-31T05:21:19.404 INFO:tasks.workunit.client.0.smithi067.stdout:6/586: mknod d1b/dad/cc3 0 2024-08-31T05:21:19.405 INFO:tasks.workunit.client.0.smithi067.stdout:6/587: readlink d1b/d23/d28/l56 0 2024-08-31T05:21:19.407 INFO:tasks.workunit.client.0.smithi067.stdout:6/588: chown d1b/d8e/d62/c82 400700 1 2024-08-31T05:21:19.411 INFO:tasks.workunit.client.0.smithi067.stdout:6/589: rmdir d1b/d23/d28/d45/d5e/d7b 39 2024-08-31T05:21:19.413 INFO:tasks.workunit.client.0.smithi067.stdout:6/590: creat d1b/d23/d61/fc4 x:0 0 0 2024-08-31T05:21:19.415 INFO:tasks.workunit.client.0.smithi067.stdout:6/591: creat d1b/d40/d70/d71/dae/fc5 x:0 0 0 2024-08-31T05:21:19.417 INFO:tasks.workunit.client.0.smithi067.stdout:6/592: chown d1b/d23/d2e/d3b/f48 1 1 2024-08-31T05:21:19.431 INFO:tasks.workunit.client.0.smithi067.stdout:6/593: dread d1b/d23/d2e/f51 [0,4194304] 0 2024-08-31T05:21:19.434 INFO:tasks.workunit.client.0.smithi067.stdout:3/446: write db/d2e/f38 [229338,11753] 0 2024-08-31T05:21:19.435 INFO:tasks.workunit.client.0.smithi067.stdout:3/447: truncate db/d2e/d50/f84 4409662 0 2024-08-31T05:21:19.436 INFO:tasks.workunit.client.0.smithi067.stdout:6/594: rename d1b/dad to d1b/d23/d28/d45/d8d/dc6 0 2024-08-31T05:21:19.441 INFO:tasks.workunit.client.0.smithi067.stdout:3/448: rmdir db/d12/d21 39 2024-08-31T05:21:19.443 INFO:tasks.workunit.client.0.smithi067.stdout:6/595: creat d1b/d40/d70/d71/dae/fc7 x:0 0 0 2024-08-31T05:21:19.444 INFO:tasks.workunit.client.0.smithi067.stdout:3/449: chown db/d2e/d50/d62/l7c 0 1 2024-08-31T05:21:19.481 INFO:tasks.workunit.client.0.smithi067.stdout:3/450: link db/d17/f6c db/d17/d3f/d54/d56/d6e/f9a 0 2024-08-31T05:21:19.481 INFO:tasks.workunit.client.0.smithi067.stdout:3/451: chown db/d2e/d50/d62/d85/f92 151845603 1 2024-08-31T05:21:19.481 INFO:tasks.workunit.client.0.smithi067.stdout:3/452: mknod db/d2e/d50/c9b 0 2024-08-31T05:21:19.511 INFO:tasks.workunit.client.0.smithi067.stdout:3/453: dwrite db/d12/f58 [0,4194304] 0 2024-08-31T05:21:19.513 INFO:tasks.workunit.client.0.smithi067.stdout:3/454: symlink db/d5a/l9c 0 2024-08-31T05:21:19.515 INFO:tasks.workunit.client.0.smithi067.stdout:3/455: chown db/d17/c5d 3215 1 2024-08-31T05:21:19.530 INFO:tasks.workunit.client.0.smithi067.stdout:3/456: dread db/f57 [0,4194304] 0 2024-08-31T05:21:19.532 INFO:tasks.workunit.client.0.smithi067.stdout:3/457: unlink db/d12/d21/f19 0 2024-08-31T05:21:19.546 INFO:tasks.workunit.client.0.smithi067.stdout:3/458: dread db/d2e/f46 [0,4194304] 0 2024-08-31T05:21:19.547 INFO:tasks.workunit.client.0.smithi067.stdout:3/459: getdents db/d4e 0 2024-08-31T05:21:19.548 INFO:tasks.workunit.client.0.smithi067.stdout:3/460: mknod db/d17/d3f/d54/d56/c9d 0 2024-08-31T05:21:19.550 INFO:tasks.workunit.client.0.smithi067.stdout:3/461: creat db/d2e/f9e x:0 0 0 2024-08-31T05:21:19.583 INFO:tasks.workunit.client.0.smithi067.stdout:3/462: dwrite db/d17/d3f/d54/d56/d6e/f9a [0,4194304] 0 2024-08-31T05:21:19.586 INFO:tasks.workunit.client.0.smithi067.stdout:3/463: creat db/d17/d3f/d54/d56/d6e/f9f x:0 0 0 2024-08-31T05:21:19.589 INFO:tasks.workunit.client.0.smithi067.stdout:3/464: truncate db/d2e/f46 2303040 0 2024-08-31T05:21:19.590 INFO:tasks.workunit.client.0.smithi067.stdout:3/465: truncate db/d12/d21/f26 889432 0 2024-08-31T05:21:19.592 INFO:tasks.workunit.client.0.smithi067.stdout:3/466: write db/d12/f18 [4081230,38396] 0 2024-08-31T05:21:19.592 INFO:tasks.workunit.client.0.smithi067.stdout:3/467: readlink l2 0 2024-08-31T05:21:19.594 INFO:tasks.workunit.client.0.smithi067.stdout:3/468: symlink db/d2e/d6a/la0 0 2024-08-31T05:21:19.599 INFO:tasks.workunit.client.0.smithi067.stdout:3/469: dread db/d17/d3f/d54/d56/d6e/f9a [0,4194304] 0 2024-08-31T05:21:19.599 INFO:tasks.workunit.client.0.smithi067.stdout:3/470: dread - db/d4e/f51 zero size 2024-08-31T05:21:19.601 INFO:tasks.workunit.client.0.smithi067.stdout:3/471: readlink db/d17/d3f/l49 0 2024-08-31T05:21:19.602 INFO:tasks.workunit.client.0.smithi067.stdout:3/472: read db/f14 [2214301,53040] 0 2024-08-31T05:21:19.605 INFO:tasks.workunit.client.0.smithi067.stdout:3/473: mkdir db/d2e/da1 0 2024-08-31T05:21:19.606 INFO:tasks.workunit.client.0.smithi067.stdout:3/474: write db/d2e/d50/d62/d85/f93 [704910,125689] 0 2024-08-31T05:21:19.609 INFO:tasks.workunit.client.0.smithi067.stdout:3/475: readlink db/d17/l86 0 2024-08-31T05:21:19.617 INFO:tasks.workunit.client.0.smithi067.stdout:3/476: dwrite f4 [0,4194304] 0 2024-08-31T05:21:19.618 INFO:tasks.workunit.client.0.smithi067.stdout:3/477: rmdir db/d2c 39 2024-08-31T05:21:19.632 INFO:tasks.workunit.client.0.smithi067.stdout:3/478: truncate db/d17/d3f/d54/d56/d6e/f75 207343 0 2024-08-31T05:21:19.632 INFO:tasks.workunit.client.0.smithi067.stdout:3/479: chown db/d5a/l9c 756229 1 2024-08-31T05:21:19.634 INFO:tasks.workunit.client.0.smithi067.stdout:3/480: truncate db/d12/d21/d82/f8a 6225168 0 2024-08-31T05:21:19.641 INFO:tasks.workunit.client.0.smithi067.stdout:3/481: dwrite db/d17/f65 [0,4194304] 0 2024-08-31T05:21:19.642 INFO:tasks.workunit.client.0.smithi067.stdout:9/229: sync 2024-08-31T05:21:19.646 INFO:tasks.workunit.client.0.smithi067.stdout:3/482: dread db/f53 [0,4194304] 0 2024-08-31T05:21:19.656 INFO:tasks.workunit.client.0.smithi067.stdout:3/483: rmdir db/d2e/d50 39 2024-08-31T05:21:19.658 INFO:tasks.workunit.client.0.smithi067.stdout:9/230: dwrite dd/df/f49 [0,4194304] 0 2024-08-31T05:21:19.659 INFO:tasks.workunit.client.0.smithi067.stdout:9/231: chown dd/df/d25/l37 1 1 2024-08-31T05:21:19.663 INFO:tasks.workunit.client.0.smithi067.stdout:3/484: truncate db/d2e/f46 2806085 0 2024-08-31T05:21:19.666 INFO:tasks.workunit.client.0.smithi067.stdout:3/485: symlink db/d2e/da1/la2 0 2024-08-31T05:21:19.667 INFO:tasks.workunit.client.0.smithi067.stdout:3/486: mknod db/d55/ca3 0 2024-08-31T05:21:19.668 INFO:tasks.workunit.client.0.smithi067.stdout:3/487: rmdir db/d12/d21 39 2024-08-31T05:21:19.675 INFO:tasks.workunit.client.0.smithi067.stdout:3/488: unlink db/d2e/d50/d62/d85/f93 0 2024-08-31T05:21:19.679 INFO:tasks.workunit.client.0.smithi067.stdout:3/489: symlink db/d17/d3f/d54/d56/la4 0 2024-08-31T05:21:19.682 INFO:tasks.workunit.client.0.smithi067.stdout:9/232: dread dd/f3d [0,4194304] 0 2024-08-31T05:21:19.685 INFO:tasks.workunit.client.0.smithi067.stdout:9/233: mkdir dd/df/d25/d3b/d4e 0 2024-08-31T05:21:19.688 INFO:tasks.workunit.client.0.smithi067.stdout:3/490: dwrite db/d17/f24 [0,4194304] 0 2024-08-31T05:21:19.692 INFO:tasks.workunit.client.0.smithi067.stdout:3/491: getdents db/d55/d97 0 2024-08-31T05:21:19.693 INFO:tasks.workunit.client.0.smithi067.stdout:9/234: dwrite dd/df/f23 [0,4194304] 0 2024-08-31T05:21:19.695 INFO:tasks.workunit.client.0.smithi067.stdout:3/492: truncate db/d2e/d50/d62/d85/f92 89227 0 2024-08-31T05:21:19.697 INFO:tasks.workunit.client.0.smithi067.stdout:9/235: rename dd/d20/f39 to dd/d4d/f4f 0 2024-08-31T05:21:19.701 INFO:tasks.workunit.client.0.smithi067.stdout:3/493: rename db/d17/d3f/d54/d56/f7d to db/d12/d21/d82/fa5 0 2024-08-31T05:21:19.703 INFO:tasks.workunit.client.0.smithi067.stdout:3/494: dread db/d17/d3f/f7f [0,4194304] 0 2024-08-31T05:21:19.703 INFO:tasks.workunit.client.0.smithi067.stdout:9/236: mkdir dd/df/d25/d3b/d50 0 2024-08-31T05:21:19.704 INFO:tasks.workunit.client.0.smithi067.stdout:9/237: fdatasync dd/df/f11 0 2024-08-31T05:21:19.706 INFO:tasks.workunit.client.0.smithi067.stdout:3/495: write db/d17/d3f/d54/d56/f96 [209871,11029] 0 2024-08-31T05:21:19.706 INFO:tasks.workunit.client.0.smithi067.stdout:3/496: fdatasync db/d12/f1f 0 2024-08-31T05:21:19.713 INFO:tasks.workunit.client.0.smithi067.stdout:9/238: creat dd/df/d3c/f51 x:0 0 0 2024-08-31T05:21:19.714 INFO:tasks.workunit.client.0.smithi067.stdout:3/497: dwrite db/d12/f1f [0,4194304] 0 2024-08-31T05:21:19.720 INFO:tasks.workunit.client.0.smithi067.stdout:3/498: unlink db/f6f 0 2024-08-31T05:21:19.720 INFO:tasks.workunit.client.0.smithi067.stdout:9/239: dwrite dd/f10 [0,4194304] 0 2024-08-31T05:21:19.721 INFO:tasks.workunit.client.0.smithi067.stdout:9/240: chown dd/df/f23 12835 1 2024-08-31T05:21:19.724 INFO:tasks.workunit.client.0.smithi067.stdout:9/241: creat dd/df/d25/d3b/f52 x:0 0 0 2024-08-31T05:21:19.733 INFO:tasks.workunit.client.0.smithi067.stdout:9/242: dwrite dd/f42 [0,4194304] 0 2024-08-31T05:21:19.738 INFO:tasks.workunit.client.0.smithi067.stdout:9/243: getdents dd/df/d25/d3b/d4e 0 2024-08-31T05:21:19.741 INFO:tasks.workunit.client.0.smithi067.stdout:9/244: symlink dd/d4d/l53 0 2024-08-31T05:21:19.744 INFO:tasks.workunit.client.0.smithi067.stdout:9/245: rename dd/f3d to dd/df/f54 0 2024-08-31T05:21:19.744 INFO:tasks.workunit.client.0.smithi067.stdout:9/246: chown dd/d20/f47 221009 1 2024-08-31T05:21:19.746 INFO:tasks.workunit.client.0.smithi067.stdout:9/247: creat dd/d20/f55 x:0 0 0 2024-08-31T05:21:19.747 INFO:tasks.workunit.client.0.smithi067.stdout:9/248: chown dd/l1d 492 1 2024-08-31T05:21:19.751 INFO:tasks.workunit.client.0.smithi067.stdout:9/249: dread dd/df/f54 [0,4194304] 0 2024-08-31T05:21:19.754 INFO:tasks.workunit.client.0.smithi067.stdout:9/250: mknod dd/df/c56 0 2024-08-31T05:21:19.764 INFO:tasks.workunit.client.0.smithi067.stdout:9/251: rmdir dd/df/d25/d3b/d4e 0 2024-08-31T05:21:19.765 INFO:tasks.workunit.client.0.smithi067.stdout:9/252: dread dd/f3f [0,4194304] 0 2024-08-31T05:21:19.767 INFO:tasks.workunit.client.0.smithi067.stdout:9/253: write dd/d20/f55 [503161,85283] 0 2024-08-31T05:21:19.779 INFO:tasks.workunit.client.0.smithi067.stdout:9/254: dread fa [0,4194304] 0 2024-08-31T05:21:19.780 INFO:tasks.workunit.client.0.smithi067.stdout:9/255: chown dd/df/d3c 4740878 1 2024-08-31T05:21:19.799 INFO:tasks.workunit.client.0.smithi067.stdout:9/256: write dd/f2a [190092,9133] 0 2024-08-31T05:21:19.801 INFO:tasks.workunit.client.0.smithi067.stdout:9/257: unlink dd/df/d25/f48 0 2024-08-31T05:21:19.804 INFO:tasks.workunit.client.0.smithi067.stdout:9/258: rename f3 to dd/d4d/f57 0 2024-08-31T05:21:19.806 INFO:tasks.workunit.client.0.smithi067.stdout:9/259: fdatasync dd/df/f12 0 2024-08-31T05:21:19.812 INFO:tasks.workunit.client.0.smithi067.stdout:9/260: dwrite dd/df/f54 [0,4194304] 0 2024-08-31T05:21:19.813 INFO:tasks.workunit.client.0.smithi067.stdout:9/261: readlink dd/df/d25/l44 0 2024-08-31T05:21:19.825 INFO:tasks.workunit.client.0.smithi067.stdout:9/262: dwrite f6 [0,4194304] 0 2024-08-31T05:21:19.826 INFO:tasks.workunit.client.0.smithi067.stdout:9/263: rmdir dd/d4d 39 2024-08-31T05:21:19.829 INFO:tasks.workunit.client.0.smithi067.stdout:9/264: symlink dd/d4d/l58 0 2024-08-31T05:21:19.830 INFO:tasks.workunit.client.0.smithi067.stdout:9/265: write dd/df/f11 [4796663,64108] 0 2024-08-31T05:21:19.834 INFO:tasks.workunit.client.0.smithi067.stdout:9/266: mkdir dd/df/d25/d59 0 2024-08-31T05:21:19.839 INFO:tasks.workunit.client.0.smithi067.stdout:9/267: dread dd/d20/f2b [0,4194304] 0 2024-08-31T05:21:19.841 INFO:tasks.workunit.client.0.smithi067.stdout:9/268: fdatasync dd/d4d/f57 0 2024-08-31T05:21:19.841 INFO:tasks.workunit.client.0.smithi067.stdout:9/269: dread - dd/df/f27 zero size 2024-08-31T05:21:19.845 INFO:tasks.workunit.client.0.smithi067.stdout:9/270: dread dd/d20/f2f [0,4194304] 0 2024-08-31T05:21:19.847 INFO:tasks.workunit.client.0.smithi067.stdout:9/271: truncate dd/df/f1f 259048 0 2024-08-31T05:21:19.849 INFO:tasks.workunit.client.0.smithi067.stdout:9/272: unlink dd/df/d25/l44 0 2024-08-31T05:21:19.852 INFO:tasks.workunit.client.0.smithi067.stdout:8/381: sync 2024-08-31T05:21:19.852 INFO:tasks.workunit.client.0.smithi067.stdout:2/389: sync 2024-08-31T05:21:19.853 INFO:tasks.workunit.client.0.smithi067.stdout:8/382: chown d0/d2/da/l4f 3384 1 2024-08-31T05:21:19.854 INFO:tasks.workunit.client.0.smithi067.stdout:2/390: unlink db/l19 0 2024-08-31T05:21:19.855 INFO:tasks.workunit.client.0.smithi067.stdout:2/391: fdatasync db/d12/d1a/d2b/d42/d62/f71 0 2024-08-31T05:21:19.858 INFO:tasks.workunit.client.0.smithi067.stdout:2/392: symlink db/d12/d1a/l72 0 2024-08-31T05:21:19.858 INFO:tasks.workunit.client.0.smithi067.stdout:8/383: getdents d0/d4/de/d1d/d2c/d68 0 2024-08-31T05:21:19.880 INFO:tasks.workunit.client.0.smithi067.stdout:2/393: unlink db/d12/d1a/d2b/d3d/d69/d3b/l52 0 2024-08-31T05:21:19.880 INFO:tasks.workunit.client.0.smithi067.stdout:9/273: dread dd/f1a [0,4194304] 0 2024-08-31T05:21:19.880 INFO:tasks.workunit.client.0.smithi067.stdout:8/384: chown d0/d4/de/d1d/c72 46 1 2024-08-31T05:21:19.881 INFO:tasks.workunit.client.0.smithi067.stdout:8/385: truncate d0/f9 5063490 0 2024-08-31T05:21:19.883 INFO:tasks.workunit.client.0.smithi067.stdout:8/386: chown d0/d4/de/c36 8386382 1 2024-08-31T05:21:19.884 INFO:tasks.workunit.client.0.smithi067.stdout:9/274: dread dd/f10 [0,4194304] 0 2024-08-31T05:21:19.887 INFO:tasks.workunit.client.0.smithi067.stdout:8/387: truncate d0/d2/da/f57 777858 0 2024-08-31T05:21:19.888 INFO:tasks.workunit.client.0.smithi067.stdout:2/394: link db/d12/d1a/c47 db/d12/d1a/d2b/d3d/c73 0 2024-08-31T05:21:19.888 INFO:tasks.workunit.client.0.smithi067.stdout:9/275: write fa [840439,114654] 0 2024-08-31T05:21:19.893 INFO:tasks.workunit.client.0.smithi067.stdout:9/276: truncate dd/df/d25/f2c 5016043 0 2024-08-31T05:21:19.893 INFO:tasks.workunit.client.0.smithi067.stdout:9/277: rename dd/l3a to dd/d20/l5a 0 2024-08-31T05:21:19.896 INFO:tasks.workunit.client.0.smithi067.stdout:2/395: mknod db/d12/d1a/d2b/d3d/d4f/d6d/c74 0 2024-08-31T05:21:19.896 INFO:tasks.workunit.client.0.smithi067.stdout:9/278: dread dd/d20/f55 [0,4194304] 0 2024-08-31T05:21:19.897 INFO:tasks.workunit.client.0.smithi067.stdout:8/388: getdents d0/d2/dc 0 2024-08-31T05:21:19.901 INFO:tasks.workunit.client.0.smithi067.stdout:8/389: rename d0/d2/dc/d62 to d0/d2/dc/d28/d7e 0 2024-08-31T05:21:19.903 INFO:tasks.workunit.client.0.smithi067.stdout:2/396: rename db/dd/d2d/f51 to db/d12/d1a/d2b/d3d/d4f/d63/f75 0 2024-08-31T05:21:19.904 INFO:tasks.workunit.client.0.smithi067.stdout:9/279: getdents dd/df/d25/d3b 0 2024-08-31T05:21:19.905 INFO:tasks.workunit.client.0.smithi067.stdout:8/390: mknod d0/d4/de/d1d/d2c/c7f 0 2024-08-31T05:21:19.908 INFO:tasks.workunit.client.0.smithi067.stdout:2/397: mknod db/d12/d1a/d2b/c76 0 2024-08-31T05:21:19.908 INFO:tasks.workunit.client.0.smithi067.stdout:9/280: getdents dd/df/d25/d3b/d50 0 2024-08-31T05:21:19.909 INFO:tasks.workunit.client.0.smithi067.stdout:2/398: dread - db/f70 zero size 2024-08-31T05:21:19.909 INFO:tasks.workunit.client.0.smithi067.stdout:2/399: chown db/d12/d1a/d1e 166 1 2024-08-31T05:21:19.915 INFO:tasks.workunit.client.0.smithi067.stdout:2/400: mknod db/d12/d1a/d31/c77 0 2024-08-31T05:21:19.923 INFO:tasks.workunit.client.0.smithi067.stdout:8/391: symlink d0/d2/dc/d28/d7e/d73/l80 0 2024-08-31T05:21:19.926 INFO:tasks.workunit.client.0.smithi067.stdout:2/401: dwrite db/f25 [0,4194304] 0 2024-08-31T05:21:19.928 INFO:tasks.workunit.client.0.smithi067.stdout:8/392: truncate d0/d2/da/dd/f35 4633474 0 2024-08-31T05:21:19.928 INFO:tasks.workunit.client.0.smithi067.stdout:2/402: rmdir db/d12/d1a 39 2024-08-31T05:21:19.937 INFO:tasks.workunit.client.0.smithi067.stdout:8/393: creat d0/d2/dc/d28/f81 x:0 0 0 2024-08-31T05:21:19.940 INFO:tasks.workunit.client.0.smithi067.stdout:2/403: dread db/d12/d1a/d2b/d3d/d4f/d63/f75 [0,4194304] 0 2024-08-31T05:21:19.941 INFO:tasks.workunit.client.0.smithi067.stdout:8/394: symlink d0/d4/d64/l82 0 2024-08-31T05:21:19.944 INFO:tasks.workunit.client.0.smithi067.stdout:8/395: rename d0/d2/da/dd/f4c to d0/d2/f83 0 2024-08-31T05:21:19.946 INFO:tasks.workunit.client.0.smithi067.stdout:8/396: mkdir d0/d2/dc/d28/d7e/d73/d84 0 2024-08-31T05:21:19.948 INFO:tasks.workunit.client.0.smithi067.stdout:2/404: getdents db/d12/d1a/d2b/d3d/d4f 0 2024-08-31T05:21:19.949 INFO:tasks.workunit.client.0.smithi067.stdout:8/397: dread d0/d4/de/f77 [0,4194304] 0 2024-08-31T05:21:19.951 INFO:tasks.workunit.client.0.smithi067.stdout:2/405: creat db/d12/d1a/d2b/d3d/d69/d3b/f78 x:0 0 0 2024-08-31T05:21:19.952 INFO:tasks.workunit.client.0.smithi067.stdout:2/406: read - db/d12/d1a/d2b/f5a zero size 2024-08-31T05:21:19.952 INFO:tasks.workunit.client.0.smithi067.stdout:8/398: creat d0/d2/dc/d28/f85 x:0 0 0 2024-08-31T05:21:19.953 INFO:tasks.workunit.client.0.smithi067.stdout:2/407: truncate db/f3a 502993 0 2024-08-31T05:21:19.959 INFO:tasks.workunit.client.0.smithi067.stdout:8/399: dwrite d0/d4/de/f34 [0,4194304] 0 2024-08-31T05:21:19.960 INFO:tasks.workunit.client.0.smithi067.stdout:2/408: dwrite db/f70 [0,4194304] 0 2024-08-31T05:21:19.969 INFO:tasks.workunit.client.0.smithi067.stdout:8/400: dwrite d0/d4/de/f34 [0,4194304] 0 2024-08-31T05:21:19.969 INFO:tasks.workunit.client.0.smithi067.stdout:8/401: chown d0/d75 2792206 1 2024-08-31T05:21:19.969 INFO:tasks.workunit.client.0.smithi067.stdout:2/409: chown db/d12/f44 0 1 2024-08-31T05:21:19.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:19 smithi073 ceph-mon[24726]: Reconfiguring ceph-exporter.smithi073 (dependencies changed)... 2024-08-31T05:21:19.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:19 smithi073 ceph-mon[24726]: Deploying daemon ceph-exporter.smithi073 on smithi073 2024-08-31T05:21:19.973 INFO:tasks.workunit.client.0.smithi067.stdout:8/402: mknod d0/d2/dc/d28/d7e/c86 0 2024-08-31T05:21:19.974 INFO:tasks.workunit.client.0.smithi067.stdout:2/410: creat db/d12/d1a/d2b/d42/d62/f79 x:0 0 0 2024-08-31T05:21:19.976 INFO:tasks.workunit.client.0.smithi067.stdout:2/411: chown db/d12/d1a/d2b/d3d/d4f/d63/f75 17330 1 2024-08-31T05:21:20.000 INFO:tasks.workunit.client.0.smithi067.stdout:2/412: write db/f4b [982209,111458] 0 2024-08-31T05:21:20.002 INFO:tasks.workunit.client.0.smithi067.stdout:2/413: rmdir db/dd/d13 39 2024-08-31T05:21:20.003 INFO:tasks.workunit.client.0.smithi067.stdout:2/414: chown db/d12/d1a/d5c/c61 192582 1 2024-08-31T05:21:20.005 INFO:tasks.workunit.client.0.smithi067.stdout:2/415: fdatasync db/dd/f33 0 2024-08-31T05:21:20.015 INFO:tasks.workunit.client.0.smithi067.stdout:2/416: write db/d12/d1a/d1e/d4d/f56 [766353,33838] 0 2024-08-31T05:21:20.021 INFO:tasks.workunit.client.0.smithi067.stdout:2/417: write db/d12/d1a/d2b/d40/f4a [471675,48176] 0 2024-08-31T05:21:20.024 INFO:tasks.workunit.client.0.smithi067.stdout:2/418: creat db/d12/d1a/d1e/d4d/f7a x:0 0 0 2024-08-31T05:21:20.027 INFO:tasks.workunit.client.0.smithi067.stdout:2/419: symlink db/d12/d1a/l7b 0 2024-08-31T05:21:20.031 INFO:tasks.workunit.client.0.smithi067.stdout:2/420: dread db/f25 [0,4194304] 0 2024-08-31T05:21:20.032 INFO:tasks.workunit.client.0.smithi067.stdout:2/421: dread - db/d12/d1a/d1e/f6b zero size 2024-08-31T05:21:20.037 INFO:tasks.workunit.client.0.smithi067.stdout:2/422: dwrite db/dd/f4c [0,4194304] 0 2024-08-31T05:21:20.039 INFO:tasks.workunit.client.0.smithi067.stdout:4/257: sync 2024-08-31T05:21:20.040 INFO:tasks.workunit.client.0.smithi067.stdout:4/258: fdatasync d4/d13/f1c 0 2024-08-31T05:21:20.043 INFO:tasks.workunit.client.0.smithi067.stdout:2/423: symlink db/d12/d1a/d2b/d42/d62/l7c 0 2024-08-31T05:21:20.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:19 smithi067 ceph-mon[17432]: Reconfiguring ceph-exporter.smithi073 (dependencies changed)... 2024-08-31T05:21:20.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:19 smithi067 ceph-mon[17432]: Deploying daemon ceph-exporter.smithi073 on smithi073 2024-08-31T05:21:20.099 INFO:tasks.workunit.client.0.smithi067.stdout:4/259: rename d4/d1e/c27 to d4/d14/d48/c5c 0 2024-08-31T05:21:20.100 INFO:tasks.workunit.client.0.smithi067.stdout:4/260: read d4/d1e/d21/f46 [4076013,22998] 0 2024-08-31T05:21:20.101 INFO:tasks.workunit.client.0.smithi067.stdout:4/261: chown d4/l2e 56 1 2024-08-31T05:21:20.102 INFO:tasks.workunit.client.0.smithi067.stdout:2/424: mknod db/d12/d1a/d5c/c7d 0 2024-08-31T05:21:20.102 INFO:tasks.workunit.client.0.smithi067.stdout:2/425: write db/f4b [1850549,44885] 0 2024-08-31T05:21:20.111 INFO:tasks.workunit.client.0.smithi067.stdout:2/426: symlink db/d12/d1a/d2b/d42/d62/l7e 0 2024-08-31T05:21:20.113 INFO:tasks.workunit.client.0.smithi067.stdout:4/262: creat d4/d32/d43/f5d x:0 0 0 2024-08-31T05:21:20.115 INFO:tasks.workunit.client.0.smithi067.stdout:4/263: write d4/d1f/f30 [5145124,29857] 0 2024-08-31T05:21:20.117 INFO:tasks.workunit.client.0.smithi067.stdout:2/427: dwrite db/d12/f39 [0,4194304] 0 2024-08-31T05:21:20.118 INFO:tasks.workunit.client.0.smithi067.stdout:2/428: stat db/dd/d2d/f35 0 2024-08-31T05:21:20.124 INFO:tasks.workunit.client.0.smithi067.stdout:2/429: write db/d12/f23 [4046932,66111] 0 2024-08-31T05:21:20.126 INFO:tasks.workunit.client.0.smithi067.stdout:2/430: creat db/d12/d1a/d2b/d3d/d4f/d6d/f7f x:0 0 0 2024-08-31T05:21:20.128 INFO:tasks.workunit.client.0.smithi067.stdout:2/431: rmdir db/d12/d1a/d2b/d42/d62 39 2024-08-31T05:21:20.129 INFO:tasks.workunit.client.0.smithi067.stdout:4/264: write d4/f10 [2119514,31775] 0 2024-08-31T05:21:20.130 INFO:tasks.workunit.client.0.smithi067.stdout:4/265: write d4/d1e/f3f [222275,10846] 0 2024-08-31T05:21:20.136 INFO:tasks.workunit.client.0.smithi067.stdout:2/432: dwrite db/dd/f4c [4194304,4194304] 0 2024-08-31T05:21:20.140 INFO:tasks.workunit.client.0.smithi067.stdout:2/433: dread db/d12/d1a/d1e/d5f/f6a [0,4194304] 0 2024-08-31T05:21:20.147 INFO:tasks.workunit.client.0.smithi067.stdout:2/434: link db/ff db/d12/d1a/d2b/d42/d62/f80 0 2024-08-31T05:21:20.148 INFO:tasks.workunit.client.0.smithi067.stdout:4/266: dread d4/f25 [0,4194304] 0 2024-08-31T05:21:20.148 INFO:tasks.workunit.client.0.smithi067.stdout:4/267: chown d4/d1e 1 1 2024-08-31T05:21:20.149 INFO:tasks.workunit.client.0.smithi067.stdout:4/268: chown d4/d9/d4b/f52 0 1 2024-08-31T05:21:20.149 INFO:tasks.workunit.client.0.smithi067.stdout:2/435: truncate f4 7174209 0 2024-08-31T05:21:20.149 INFO:tasks.workunit.client.0.smithi067.stdout:4/269: fsync d4/d32/d43/f5d 0 2024-08-31T05:21:20.152 INFO:tasks.workunit.client.0.smithi067.stdout:4/270: creat d4/d9/f5e x:0 0 0 2024-08-31T05:21:20.274 INFO:tasks.workunit.client.0.smithi067.stdout:4/271: creat d4/d14/d48/f5f x:0 0 0 2024-08-31T05:21:20.275 INFO:tasks.workunit.client.0.smithi067.stdout:4/272: dread - d4/d9/d4b/f52 zero size 2024-08-31T05:21:20.278 INFO:tasks.workunit.client.0.smithi067.stdout:4/273: stat d4/d9/c11 0 2024-08-31T05:21:20.278 INFO:tasks.workunit.client.0.smithi067.stdout:4/274: chown d4/d32/d4c 527702 1 2024-08-31T05:21:20.279 INFO:tasks.workunit.client.0.smithi067.stdout:2/436: dwrite db/dd/d13/f28 [0,4194304] 0 2024-08-31T05:21:20.280 INFO:tasks.workunit.client.0.smithi067.stdout:4/275: chown d4/d13/f24 23 1 2024-08-31T05:21:20.282 INFO:tasks.workunit.client.0.smithi067.stdout:4/276: fsync d4/d13/f1a 0 2024-08-31T05:21:20.284 INFO:tasks.workunit.client.0.smithi067.stdout:4/277: dread d4/d1e/f3f [0,4194304] 0 2024-08-31T05:21:20.289 INFO:tasks.workunit.client.0.smithi067.stdout:4/278: dread d4/d13/f24 [0,4194304] 0 2024-08-31T05:21:20.292 INFO:tasks.workunit.client.0.smithi067.stdout:4/279: mkdir d4/d1e/d21/d60 0 2024-08-31T05:21:20.295 INFO:tasks.workunit.client.0.smithi067.stdout:2/437: truncate db/d12/d1a/d1e/d5f/f6a 400591 0 2024-08-31T05:21:20.296 INFO:tasks.workunit.client.0.smithi067.stdout:4/280: truncate d4/d1f/f44 1061826 0 2024-08-31T05:21:20.302 INFO:tasks.workunit.client.0.smithi067.stdout:4/281: creat d4/d1e/d21/d60/f61 x:0 0 0 2024-08-31T05:21:20.302 INFO:tasks.workunit.client.0.smithi067.stdout:4/282: mkdir d4/d1e/d62 0 2024-08-31T05:21:20.303 INFO:tasks.workunit.client.0.smithi067.stdout:4/283: symlink d4/d1e/l63 0 2024-08-31T05:21:20.306 INFO:tasks.workunit.client.0.smithi067.stdout:4/284: truncate d4/d13/f1a 1642603 0 2024-08-31T05:21:20.308 INFO:tasks.workunit.client.0.smithi067.stdout:2/438: truncate db/dd/d13/f14 1424468 0 2024-08-31T05:21:20.309 INFO:tasks.workunit.client.0.smithi067.stdout:4/285: creat d4/d1e/d21/f64 x:0 0 0 2024-08-31T05:21:20.316 INFO:tasks.workunit.client.0.smithi067.stdout:2/439: dwrite db/d12/d1a/d1e/f54 [0,4194304] 0 2024-08-31T05:21:20.318 INFO:tasks.workunit.client.0.smithi067.stdout:4/286: dread d4/d1e/d21/f46 [4194304,4194304] 0 2024-08-31T05:21:20.320 INFO:tasks.workunit.client.0.smithi067.stdout:4/287: creat d4/d14/f65 x:0 0 0 2024-08-31T05:21:20.320 INFO:tasks.workunit.client.0.smithi067.stdout:4/288: readlink d4/l2e 0 2024-08-31T05:21:20.323 INFO:tasks.workunit.client.0.smithi067.stdout:2/440: rename db/d12/d1a/d1e/d4d/l5e to db/d12/d1a/d2b/d3d/d4f/d63/l81 0 2024-08-31T05:21:20.324 INFO:tasks.workunit.client.0.smithi067.stdout:4/289: mkdir d4/d14/d48/d66 0 2024-08-31T05:21:20.325 INFO:tasks.workunit.client.0.smithi067.stdout:4/290: chown d4/d1f/c3e 192524990 1 2024-08-31T05:21:20.326 INFO:tasks.workunit.client.0.smithi067.stdout:2/441: mkdir db/d12/d1a/d2b/d3d/d69/d3b/d82 0 2024-08-31T05:21:20.329 INFO:tasks.workunit.client.0.smithi067.stdout:2/442: unlink db/d12/d1a/l72 0 2024-08-31T05:21:20.330 INFO:tasks.workunit.client.0.smithi067.stdout:2/443: fsync db/dd/d13/f28 0 2024-08-31T05:21:20.330 INFO:tasks.workunit.client.0.smithi067.stdout:4/291: symlink d4/d1e/d53/l67 0 2024-08-31T05:21:20.332 INFO:tasks.workunit.client.0.smithi067.stdout:4/292: unlink d4/l2e 0 2024-08-31T05:21:20.333 INFO:tasks.workunit.client.0.smithi067.stdout:2/444: mknod db/d12/d1a/d2b/d3d/d4f/d63/c83 0 2024-08-31T05:21:20.340 INFO:tasks.workunit.client.0.smithi067.stdout:4/293: getdents d4/d32/d43 0 2024-08-31T05:21:20.342 INFO:tasks.workunit.client.0.smithi067.stdout:4/294: creat d4/d14/d48/f68 x:0 0 0 2024-08-31T05:21:20.343 INFO:tasks.workunit.client.0.smithi067.stdout:4/295: dread - d4/d14/d48/f68 zero size 2024-08-31T05:21:20.344 INFO:tasks.workunit.client.0.smithi067.stdout:4/296: rmdir d4 39 2024-08-31T05:21:20.344 INFO:tasks.workunit.client.0.smithi067.stdout:5/389: sync 2024-08-31T05:21:20.347 INFO:tasks.workunit.client.0.smithi067.stdout:5/390: symlink db/d15/d42/d36/d73/l7e 0 2024-08-31T05:21:20.347 INFO:tasks.workunit.client.0.smithi067.stdout:5/391: write f6 [4658949,91169] 0 2024-08-31T05:21:20.348 INFO:tasks.workunit.client.0.smithi067.stdout:4/297: symlink d4/d1f/l69 0 2024-08-31T05:21:20.348 INFO:tasks.workunit.client.0.smithi067.stdout:2/445: dread db/d12/d1a/d1e/f21 [0,4194304] 0 2024-08-31T05:21:20.352 INFO:tasks.workunit.client.0.smithi067.stdout:5/392: unlink db/d15/f1c 0 2024-08-31T05:21:20.355 INFO:tasks.workunit.client.0.smithi067.stdout:4/298: rename d4/d32/c59 to d4/d1e/d21/c6a 0 2024-08-31T05:21:20.355 INFO:tasks.workunit.client.0.smithi067.stdout:5/393: dread db/d26/d29/d31/f6e [0,4194304] 0 2024-08-31T05:21:20.358 INFO:tasks.workunit.client.0.smithi067.stdout:2/446: symlink db/d12/d1a/d1e/l84 0 2024-08-31T05:21:20.359 INFO:tasks.workunit.client.0.smithi067.stdout:2/447: readlink db/d12/d1a/d2b/l34 0 2024-08-31T05:21:20.359 INFO:tasks.workunit.client.0.smithi067.stdout:2/448: chown db/d12/d1a/f1f 1669378197 1 2024-08-31T05:21:20.362 INFO:tasks.workunit.client.0.smithi067.stdout:4/299: symlink d4/d1f/l6b 0 2024-08-31T05:21:20.363 INFO:tasks.workunit.client.0.smithi067.stdout:5/394: fdatasync db/f25 0 2024-08-31T05:21:20.367 INFO:tasks.workunit.client.0.smithi067.stdout:4/300: creat d4/d1e/d53/f6c x:0 0 0 2024-08-31T05:21:20.369 INFO:tasks.workunit.client.0.smithi067.stdout:5/395: symlink db/d26/d60/l7f 0 2024-08-31T05:21:20.371 INFO:tasks.workunit.client.0.smithi067.stdout:4/301: mkdir d4/d1e/d6d 0 2024-08-31T05:21:20.373 INFO:tasks.workunit.client.0.smithi067.stdout:2/449: link db/d12/d1a/d2b/d3d/d69/l30 db/d12/d1a/d2b/d3d/d69/d3b/d82/l85 0 2024-08-31T05:21:20.373 INFO:tasks.workunit.client.0.smithi067.stdout:5/396: truncate db/f32 9298584 0 2024-08-31T05:21:20.381 INFO:tasks.workunit.client.0.smithi067.stdout:2/450: creat db/d12/d1a/d1e/f86 x:0 0 0 2024-08-31T05:21:20.382 INFO:tasks.workunit.client.0.smithi067.stdout:4/302: getdents d4 0 2024-08-31T05:21:20.388 INFO:tasks.workunit.client.0.smithi067.stdout:2/451: dwrite db/d12/d1a/d2b/d42/d62/f79 [0,4194304] 0 2024-08-31T05:21:20.390 INFO:tasks.workunit.client.0.smithi067.stdout:2/452: readlink db/d12/d1a/d2b/d42/d62/l7e 0 2024-08-31T05:21:20.390 INFO:tasks.workunit.client.0.smithi067.stdout:5/397: truncate db/f32 47022 0 2024-08-31T05:21:20.394 INFO:tasks.workunit.client.0.smithi067.stdout:5/398: chown db/d58 14030503 1 2024-08-31T05:21:20.399 INFO:tasks.workunit.client.0.smithi067.stdout:5/399: creat db/d15/f80 x:0 0 0 2024-08-31T05:21:20.403 INFO:tasks.workunit.client.0.smithi067.stdout:2/453: getdents db/d12/d1a/d2b/d3d/d4f 0 2024-08-31T05:21:20.406 INFO:tasks.workunit.client.0.smithi067.stdout:2/454: truncate db/d12/d1a/d2b/d3d/d4f/d63/f75 534125 0 2024-08-31T05:21:20.413 INFO:tasks.workunit.client.0.smithi067.stdout:2/455: mkdir db/d12/d1a/d2b/d87 0 2024-08-31T05:21:20.420 INFO:tasks.workunit.client.0.smithi067.stdout:5/400: dwrite db/f1e [0,4194304] 0 2024-08-31T05:21:20.421 INFO:tasks.workunit.client.0.smithi067.stdout:2/456: rename db/d12/d1a/d1e/d4d/f56 to db/dd/d13/f88 0 2024-08-31T05:21:20.421 INFO:tasks.workunit.client.0.smithi067.stdout:5/401: chown db/d26/d29/d31 4003 1 2024-08-31T05:21:20.422 INFO:tasks.workunit.client.0.smithi067.stdout:2/457: write db/d12/d1a/d2b/d3d/d4f/d63/f6f [12249,71503] 0 2024-08-31T05:21:20.425 INFO:tasks.workunit.client.0.smithi067.stdout:2/458: stat db/d12/d1a/d2b/d3d/d4f/d63/f6f 0 2024-08-31T05:21:20.427 INFO:tasks.workunit.client.0.smithi067.stdout:5/402: mkdir db/d26/d29/d81 0 2024-08-31T05:21:20.431 INFO:tasks.workunit.client.0.smithi067.stdout:5/403: creat db/d15/d53/f82 x:0 0 0 2024-08-31T05:21:20.434 INFO:tasks.workunit.client.0.smithi067.stdout:2/459: creat db/d12/d1a/d1e/f89 x:0 0 0 2024-08-31T05:21:20.444 INFO:tasks.workunit.client.0.smithi067.stdout:2/460: link db/d12/d1a/d2b/d3d/d69/l2a db/dd/l8a 0 2024-08-31T05:21:20.447 INFO:tasks.workunit.client.0.smithi067.stdout:2/461: creat db/dd/d2d/f8b x:0 0 0 2024-08-31T05:21:20.451 INFO:tasks.workunit.client.0.smithi067.stdout:2/462: mkdir db/d8c 0 2024-08-31T05:21:20.454 INFO:tasks.workunit.client.0.smithi067.stdout:5/404: truncate db/d15/f2a 4113770 0 2024-08-31T05:21:20.559 INFO:tasks.workunit.client.0.smithi067.stdout:2/463: unlink db/d12/d1a/c47 0 2024-08-31T05:21:20.561 INFO:tasks.workunit.client.0.smithi067.stdout:5/405: fsync db/d15/f18 0 2024-08-31T05:21:20.562 INFO:tasks.workunit.client.0.smithi067.stdout:2/464: fsync db/dd/d2d/f35 0 2024-08-31T05:21:20.563 INFO:tasks.workunit.client.0.smithi067.stdout:5/406: write db/d1d/d3a/f43 [1664970,83514] 0 2024-08-31T05:21:20.567 INFO:tasks.workunit.client.0.smithi067.stdout:2/465: rmdir db 39 2024-08-31T05:21:20.569 INFO:tasks.workunit.client.0.smithi067.stdout:5/407: write db/f2e [160485,86422] 0 2024-08-31T05:21:20.573 INFO:tasks.workunit.client.0.smithi067.stdout:2/466: stat db/dd/d13/f14 0 2024-08-31T05:21:20.576 INFO:tasks.workunit.client.0.smithi067.stdout:2/467: mknod db/d12/d1a/d2b/d3d/c8d 0 2024-08-31T05:21:20.579 INFO:tasks.workunit.client.0.smithi067.stdout:5/408: dwrite db/d1d/d4f/f72 [0,4194304] 0 2024-08-31T05:21:20.592 INFO:tasks.workunit.client.0.smithi067.stdout:5/409: link db/f32 db/d15/d42/d36/d73/f83 0 2024-08-31T05:21:20.594 INFO:tasks.workunit.client.0.smithi067.stdout:5/410: creat db/d15/d59/f84 x:0 0 0 2024-08-31T05:21:20.596 INFO:tasks.workunit.client.0.smithi067.stdout:5/411: write db/d26/d29/d31/f48 [361021,90398] 0 2024-08-31T05:21:20.600 INFO:tasks.workunit.client.0.smithi067.stdout:5/412: mknod db/d15/d53/d5f/c85 0 2024-08-31T05:21:20.603 INFO:tasks.workunit.client.0.smithi067.stdout:5/413: mkdir db/d26/d29/d86 0 2024-08-31T05:21:20.603 INFO:tasks.workunit.client.0.smithi067.stdout:2/468: write db/d12/d1a/d1e/f2f [1173752,20854] 0 2024-08-31T05:21:20.604 INFO:tasks.workunit.client.0.smithi067.stdout:2/469: chown db/d12/d1a/d1e/d4d 3591 1 2024-08-31T05:21:20.605 INFO:tasks.workunit.client.0.smithi067.stdout:2/470: fsync db/d12/d1a/d2b/d42/d62/f79 0 2024-08-31T05:21:20.611 INFO:tasks.workunit.client.0.smithi067.stdout:1/259: sync 2024-08-31T05:21:20.611 INFO:tasks.workunit.client.0.smithi067.stdout:0/414: sync 2024-08-31T05:21:20.611 INFO:tasks.workunit.client.0.smithi067.stdout:7/269: sync 2024-08-31T05:21:20.612 INFO:tasks.workunit.client.0.smithi067.stdout:7/270: readlink d14/d16/d28/l3c 0 2024-08-31T05:21:20.613 INFO:tasks.workunit.client.0.smithi067.stdout:0/415: write d1/df/d29/f74 [337551,65144] 0 2024-08-31T05:21:20.613 INFO:tasks.workunit.client.0.smithi067.stdout:7/271: chown d14/d16/d28/d2e/c30 17 1 2024-08-31T05:21:20.614 INFO:tasks.workunit.client.0.smithi067.stdout:7/272: chown l12 493573681 1 2024-08-31T05:21:20.616 INFO:tasks.workunit.client.0.smithi067.stdout:1/260: symlink d3/d23/d2d/d2e/d34/l5c 0 2024-08-31T05:21:20.619 INFO:tasks.workunit.client.0.smithi067.stdout:0/416: dwrite d1/df/d29/f74 [0,4194304] 0 2024-08-31T05:21:20.624 INFO:tasks.workunit.client.0.smithi067.stdout:1/261: mkdir d3/d23/d5d 0 2024-08-31T05:21:20.629 INFO:tasks.workunit.client.0.smithi067.stdout:0/417: mkdir d1/df/d29/d86 0 2024-08-31T05:21:20.629 INFO:tasks.workunit.client.0.smithi067.stdout:0/418: readlink d1/df/d29/l7d 0 2024-08-31T05:21:20.631 INFO:tasks.workunit.client.0.smithi067.stdout:5/414: truncate db/f1b 603390 0 2024-08-31T05:21:20.632 INFO:tasks.workunit.client.0.smithi067.stdout:7/273: symlink d14/d16/d28/d2e/l47 0 2024-08-31T05:21:20.632 INFO:tasks.workunit.client.0.smithi067.stdout:7/274: chown l12 63 1 2024-08-31T05:21:20.636 INFO:tasks.workunit.client.0.smithi067.stdout:0/419: symlink d1/df/d29/l87 0 2024-08-31T05:21:20.641 INFO:tasks.workunit.client.0.smithi067.stdout:7/275: unlink d14/c25 0 2024-08-31T05:21:20.642 INFO:tasks.workunit.client.0.smithi067.stdout:2/471: link db/dd/d2d/f35 db/d12/d1a/d2b/d3d/d4f/f8e 0 2024-08-31T05:21:20.644 INFO:tasks.workunit.client.0.smithi067.stdout:5/415: link db/d26/d29/d31/c56 db/d15/d42/d36/c87 0 2024-08-31T05:21:20.646 INFO:tasks.workunit.client.0.smithi067.stdout:7/276: unlink d14/d16/f1b 0 2024-08-31T05:21:20.653 INFO:tasks.workunit.client.0.smithi067.stdout:0/420: getdents d1/dd/d4d 0 2024-08-31T05:21:20.657 INFO:tasks.workunit.client.0.smithi067.stdout:1/262: truncate d3/dd/f20 1441248 0 2024-08-31T05:21:20.660 INFO:tasks.workunit.client.0.smithi067.stdout:0/421: dwrite d1/df/d17/f4c [0,4194304] 0 2024-08-31T05:21:20.666 INFO:tasks.workunit.client.0.smithi067.stdout:1/263: dwrite d3/d23/d2d/d2e/d3a/f48 [0,4194304] 0 2024-08-31T05:21:20.666 INFO:tasks.workunit.client.0.smithi067.stdout:2/472: rename db/d12/f23 to db/d12/d1a/d2b/d3d/f8f 0 2024-08-31T05:21:20.667 INFO:tasks.workunit.client.0.smithi067.stdout:7/277: write fb [2244315,36950] 0 2024-08-31T05:21:20.668 INFO:tasks.workunit.client.0.smithi067.stdout:5/416: creat db/f88 x:0 0 0 2024-08-31T05:21:20.674 INFO:tasks.workunit.client.0.smithi067.stdout:7/278: rmdir d14/d3e 39 2024-08-31T05:21:20.676 INFO:tasks.workunit.client.0.smithi067.stdout:0/422: getdents d1/df/d17/d43/d80 0 2024-08-31T05:21:20.677 INFO:tasks.workunit.client.0.smithi067.stdout:1/264: symlink d3/dd/d50/l5e 0 2024-08-31T05:21:20.678 INFO:tasks.workunit.client.0.smithi067.stdout:7/279: mknod d14/c48 0 2024-08-31T05:21:20.679 INFO:tasks.workunit.client.0.smithi067.stdout:0/423: mkdir d1/dd/d4d/d88 0 2024-08-31T05:21:20.679 INFO:tasks.workunit.client.0.smithi067.stdout:0/424: chown d1/dd/d18/d52 1992 1 2024-08-31T05:21:20.680 INFO:tasks.workunit.client.0.smithi067.stdout:2/473: getdents db/d12/d1a/d2b/d42/d62 0 2024-08-31T05:21:20.701 INFO:tasks.workunit.client.0.smithi067.stdout:7/280: mkdir d14/d16/d28/d49 0 2024-08-31T05:21:20.702 INFO:tasks.workunit.client.0.smithi067.stdout:2/474: chown db/d12/d1a/d2b/d42/d62/f79 32949302 1 2024-08-31T05:21:20.702 INFO:tasks.workunit.client.0.smithi067.stdout:1/265: write d3/dd/f20 [669743,119090] 0 2024-08-31T05:21:20.702 INFO:tasks.workunit.client.0.smithi067.stdout:0/425: creat d1/dd/d4d/d88/f89 x:0 0 0 2024-08-31T05:21:20.706 INFO:tasks.workunit.client.0.smithi067.stdout:1/266: mknod d3/d23/d2d/c5f 0 2024-08-31T05:21:20.708 INFO:tasks.workunit.client.0.smithi067.stdout:2/475: rename db/d12/d1a/d2b/d3d/c73 to db/d12/d1a/d2b/d40/c90 0 2024-08-31T05:21:20.709 INFO:tasks.workunit.client.0.smithi067.stdout:0/426: dwrite d1/d50/f57 [4194304,4194304] 0 2024-08-31T05:21:20.711 INFO:tasks.workunit.client.0.smithi067.stdout:7/281: getdents d14/d16/d28/d2e 0 2024-08-31T05:21:20.713 INFO:tasks.workunit.client.0.smithi067.stdout:1/267: rename d3/dd/f3d to d3/d23/d5d/f60 0 2024-08-31T05:21:20.715 INFO:tasks.workunit.client.0.smithi067.stdout:0/427: symlink d1/df/d29/d37/d6f/l8a 0 2024-08-31T05:21:20.719 INFO:tasks.workunit.client.0.smithi067.stdout:1/268: creat d3/d23/d5d/f61 x:0 0 0 2024-08-31T05:21:20.723 INFO:tasks.workunit.client.0.smithi067.stdout:1/269: creat d3/d23/d2d/d2e/f62 x:0 0 0 2024-08-31T05:21:20.725 INFO:tasks.workunit.client.0.smithi067.stdout:1/270: mknod d3/d36/c63 0 2024-08-31T05:21:20.726 INFO:tasks.workunit.client.0.smithi067.stdout:0/428: dwrite d1/df/d17/f20 [0,4194304] 0 2024-08-31T05:21:20.729 INFO:tasks.workunit.client.0.smithi067.stdout:1/271: creat d3/d23/d2d/d2e/d34/f64 x:0 0 0 2024-08-31T05:21:20.735 INFO:tasks.workunit.client.0.smithi067.stdout:0/429: dwrite d1/d50/f57 [4194304,4194304] 0 2024-08-31T05:21:20.737 INFO:tasks.workunit.client.0.smithi067.stdout:7/282: dread d14/f15 [0,4194304] 0 2024-08-31T05:21:20.739 INFO:tasks.workunit.client.0.smithi067.stdout:0/430: rmdir d1 39 2024-08-31T05:21:20.741 INFO:tasks.workunit.client.0.smithi067.stdout:1/272: dwrite d3/d23/d2d/d2e/f4b [0,4194304] 0 2024-08-31T05:21:20.743 INFO:tasks.workunit.client.0.smithi067.stdout:1/273: write d3/d23/d2d/d2e/d34/f64 [1008696,69041] 0 2024-08-31T05:21:20.750 INFO:tasks.workunit.client.0.smithi067.stdout:0/431: write d1/df/d17/f61 [108884,125693] 0 2024-08-31T05:21:20.751 INFO:tasks.workunit.client.0.smithi067.stdout:7/283: dwrite f7 [0,4194304] 0 2024-08-31T05:21:20.757 INFO:tasks.workunit.client.0.smithi067.stdout:0/432: rename d1/dd/d4d/f69 to d1/d8/d42/f8b 0 2024-08-31T05:21:20.759 INFO:tasks.workunit.client.0.smithi067.stdout:7/284: fdatasync d14/f20 0 2024-08-31T05:21:20.765 INFO:tasks.workunit.client.0.smithi067.stdout:0/433: dwrite d1/df/d17/f61 [0,4194304] 0 2024-08-31T05:21:20.765 INFO:tasks.workunit.client.0.smithi067.stdout:7/285: dread d14/f15 [0,4194304] 0 2024-08-31T05:21:20.766 INFO:tasks.workunit.client.0.smithi067.stdout:7/286: write f7 [977436,94279] 0 2024-08-31T05:21:20.769 INFO:tasks.workunit.client.0.smithi067.stdout:0/434: creat d1/df/d29/d37/f8c x:0 0 0 2024-08-31T05:21:20.769 INFO:tasks.workunit.client.0.smithi067.stdout:7/287: rmdir d14/d16 39 2024-08-31T05:21:20.769 INFO:tasks.workunit.client.0.smithi067.stdout:0/435: chown d1/df/l76 194 1 2024-08-31T05:21:20.771 INFO:tasks.workunit.client.0.smithi067.stdout:7/288: chown d14/d16/d28/d2e/c30 2 1 2024-08-31T05:21:20.773 INFO:tasks.workunit.client.0.smithi067.stdout:1/274: write d3/dd/f12 [1412027,4183] 0 2024-08-31T05:21:20.774 INFO:tasks.workunit.client.0.smithi067.stdout:7/289: unlink d14/d16/d28/d2e/d2f/f34 0 2024-08-31T05:21:20.778 INFO:tasks.workunit.client.0.smithi067.stdout:1/275: creat d3/d36/f65 x:0 0 0 2024-08-31T05:21:20.779 INFO:tasks.workunit.client.0.smithi067.stdout:1/276: read - d3/f55 zero size 2024-08-31T05:21:20.780 INFO:tasks.workunit.client.0.smithi067.stdout:1/277: mkdir d3/d23/d2d/d2e/d34/d66 0 2024-08-31T05:21:20.784 INFO:tasks.workunit.client.0.smithi067.stdout:0/436: write d1/df/f1d [2056315,43780] 0 2024-08-31T05:21:20.787 INFO:tasks.workunit.client.0.smithi067.stdout:0/437: rmdir d1/d50 39 2024-08-31T05:21:20.789 INFO:tasks.workunit.client.0.smithi067.stdout:0/438: write d1/d50/f6c [1301590,58202] 0 2024-08-31T05:21:20.792 INFO:tasks.workunit.client.0.smithi067.stdout:0/439: mkdir d1/df/d29/d37/d6f/d8d 0 2024-08-31T05:21:20.793 INFO:tasks.workunit.client.0.smithi067.stdout:0/440: creat d1/df/d29/d37/f8e x:0 0 0 2024-08-31T05:21:20.800 INFO:tasks.workunit.client.0.smithi067.stdout:0/441: dwrite d1/d8/d77/f81 [0,4194304] 0 2024-08-31T05:21:20.800 INFO:tasks.workunit.client.0.smithi067.stdout:7/290: dread f6 [0,4194304] 0 2024-08-31T05:21:20.805 INFO:tasks.workunit.client.0.smithi067.stdout:0/442: mkdir d1/d8/d77/d8f 0 2024-08-31T05:21:20.808 INFO:tasks.workunit.client.0.smithi067.stdout:7/291: mkdir d14/d4a 0 2024-08-31T05:21:20.811 INFO:tasks.workunit.client.0.smithi067.stdout:0/443: dwrite d1/f3a [0,4194304] 0 2024-08-31T05:21:20.817 INFO:tasks.workunit.client.0.smithi067.stdout:0/444: dread d1/d8/d42/f8b [0,4194304] 0 2024-08-31T05:21:20.817 INFO:tasks.workunit.client.0.smithi067.stdout:7/292: truncate d14/d16/d28/d2e/f3a 1683527 0 2024-08-31T05:21:20.822 INFO:tasks.workunit.client.0.smithi067.stdout:0/445: mkdir d1/dd/d71/d90 0 2024-08-31T05:21:20.827 INFO:tasks.workunit.client.0.smithi067.stdout:0/446: link d1/df/d17/d43/f64 d1/df/d17/d43/f91 0 2024-08-31T05:21:20.827 INFO:tasks.workunit.client.0.smithi067.stdout:0/447: fsync d1/d50/f6c 0 2024-08-31T05:21:20.831 INFO:tasks.workunit.client.0.smithi067.stdout:7/293: write d14/f20 [670196,89222] 0 2024-08-31T05:21:20.840 INFO:tasks.workunit.client.0.smithi067.stdout:7/294: write d14/d16/d28/d2e/f38 [1113040,87822] 0 2024-08-31T05:21:20.870 INFO:tasks.workunit.client.0.smithi067.stdout:6/596: sync 2024-08-31T05:21:20.871 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:20 smithi073 ceph-mon[24726]: pgmap v31: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 86 MiB/s rd, 248 MiB/s wr, 523 op/s 2024-08-31T05:21:20.876 INFO:tasks.workunit.client.0.smithi067.stdout:6/597: dwrite d1b/d8e/f79 [0,4194304] 0 2024-08-31T05:21:20.878 INFO:tasks.workunit.client.0.smithi067.stdout:6/598: creat d1b/d7a/fc8 x:0 0 0 2024-08-31T05:21:20.898 INFO:tasks.workunit.client.0.smithi067.stdout:6/599: dwrite d1b/d40/f83 [0,4194304] 0 2024-08-31T05:21:20.908 INFO:tasks.workunit.client.0.smithi067.stdout:6/600: write d1b/d23/f9c [109313,33099] 0 2024-08-31T05:21:20.909 INFO:tasks.workunit.client.0.smithi067.stdout:6/601: chown d1b/d23/d28/f85 0 1 2024-08-31T05:21:20.951 INFO:tasks.workunit.client.0.smithi067.stdout:4/303: sync 2024-08-31T05:21:20.951 INFO:tasks.workunit.client.0.smithi067.stdout:9/281: sync 2024-08-31T05:21:20.952 INFO:tasks.workunit.client.0.smithi067.stdout:8/403: sync 2024-08-31T05:21:20.952 INFO:tasks.workunit.client.0.smithi067.stdout:3/499: sync 2024-08-31T05:21:20.952 INFO:tasks.workunit.client.0.smithi067.stdout:9/282: readlink l8 0 2024-08-31T05:21:20.953 INFO:tasks.workunit.client.0.smithi067.stdout:9/283: truncate dd/d20/f2b 583369 0 2024-08-31T05:21:20.954 INFO:tasks.workunit.client.0.smithi067.stdout:3/500: rmdir db/d2e/d50/d62 39 2024-08-31T05:21:20.954 INFO:tasks.workunit.client.0.smithi067.stdout:9/284: fsync dd/f42 0 2024-08-31T05:21:20.955 INFO:tasks.workunit.client.0.smithi067.stdout:9/285: readlink dd/d20/l46 0 2024-08-31T05:21:20.957 INFO:tasks.workunit.client.0.smithi067.stdout:8/404: symlink d0/d2/dc/d28/d7e/d73/d84/l87 0 2024-08-31T05:21:20.961 INFO:tasks.workunit.client.0.smithi067.stdout:9/286: truncate dd/d20/f55 1273046 0 2024-08-31T05:21:20.961 INFO:tasks.workunit.client.0.smithi067.stdout:3/501: dwrite db/d17/f65 [0,4194304] 0 2024-08-31T05:21:20.963 INFO:tasks.workunit.client.0.smithi067.stdout:8/405: creat d0/d2/da/f88 x:0 0 0 2024-08-31T05:21:20.964 INFO:tasks.workunit.client.0.smithi067.stdout:3/502: write db/f57 [4025371,6636] 0 2024-08-31T05:21:20.969 INFO:tasks.workunit.client.0.smithi067.stdout:8/406: mkdir d0/d4/de/d1d/d7b/d89 0 2024-08-31T05:21:20.970 INFO:tasks.workunit.client.0.smithi067.stdout:9/287: dread dd/f22 [0,4194304] 0 2024-08-31T05:21:20.973 INFO:tasks.workunit.client.0.smithi067.stdout:8/407: read d0/d4/de/f34 [142412,22760] 0 2024-08-31T05:21:20.974 INFO:tasks.workunit.client.0.smithi067.stdout:9/288: truncate dd/f10 4514207 0 2024-08-31T05:21:20.975 INFO:tasks.workunit.client.0.smithi067.stdout:3/503: dwrite db/d17/d3f/f4b [0,4194304] 0 2024-08-31T05:21:20.976 INFO:tasks.workunit.client.0.smithi067.stdout:3/504: stat db/d17/d3f/d54/d56/d88/c34 0 2024-08-31T05:21:20.982 INFO:tasks.workunit.client.0.smithi067.stdout:9/289: mkdir dd/df/d5b 0 2024-08-31T05:21:20.983 INFO:tasks.workunit.client.0.smithi067.stdout:9/290: read - dd/df/d25/d3b/f52 zero size 2024-08-31T05:21:20.987 INFO:tasks.workunit.client.0.smithi067.stdout:8/408: creat d0/d4/de/d1d/d2c/f8a x:0 0 0 2024-08-31T05:21:20.988 INFO:tasks.workunit.client.0.smithi067.stdout:3/505: fdatasync db/d2c/f48 0 2024-08-31T05:21:20.995 INFO:tasks.workunit.client.0.smithi067.stdout:9/291: unlink dd/c16 0 2024-08-31T05:21:20.996 INFO:tasks.workunit.client.0.smithi067.stdout:8/409: unlink d0/d2/da/c41 0 2024-08-31T05:21:20.999 INFO:tasks.workunit.client.0.smithi067.stdout:8/410: rmdir d0/d4/de/d1d/d2c/d3c 39 2024-08-31T05:21:21.006 INFO:tasks.workunit.client.0.smithi067.stdout:8/411: creat d0/d4/de/d1d/d7b/d89/f8b x:0 0 0 2024-08-31T05:21:21.008 INFO:tasks.workunit.client.0.smithi067.stdout:8/412: mkdir d0/d2/d6/d8c 0 2024-08-31T05:21:21.010 INFO:tasks.workunit.client.0.smithi067.stdout:8/413: creat d0/d4/de/d1d/d2c/d68/f8d x:0 0 0 2024-08-31T05:21:21.012 INFO:tasks.workunit.client.0.smithi067.stdout:8/414: dread - d0/d2/da/dd/d1f/f78 zero size 2024-08-31T05:21:21.013 INFO:tasks.workunit.client.0.smithi067.stdout:3/506: truncate db/d2c/f89 4085483 0 2024-08-31T05:21:21.015 INFO:tasks.workunit.client.0.smithi067.stdout:9/292: dwrite dd/df/f12 [0,4194304] 0 2024-08-31T05:21:21.023 INFO:tasks.workunit.client.0.smithi067.stdout:8/415: write d0/d4/de/d1d/f60 [413521,78520] 0 2024-08-31T05:21:21.025 INFO:tasks.workunit.client.0.smithi067.stdout:3/507: write db/d12/f18 [227140,128882] 0 2024-08-31T05:21:21.025 INFO:tasks.workunit.client.0.smithi067.stdout:9/293: link c9 dd/d20/c5c 0 2024-08-31T05:21:21.026 INFO:tasks.workunit.client.0.smithi067.stdout:9/294: readlink dd/d20/l4b 0 2024-08-31T05:21:21.029 INFO:tasks.workunit.client.0.smithi067.stdout:8/416: rename d0/d2/da/dd/d1f/c32 to d0/d4/c8e 0 2024-08-31T05:21:21.030 INFO:tasks.workunit.client.0.smithi067.stdout:9/295: mkdir dd/df/d5b/d5d 0 2024-08-31T05:21:21.031 INFO:tasks.workunit.client.0.smithi067.stdout:8/417: mkdir d0/d4/de/d8f 0 2024-08-31T05:21:21.035 INFO:tasks.workunit.client.0.smithi067.stdout:8/418: unlink d0/d2/dc/d28/d7e/d73/l80 0 2024-08-31T05:21:21.042 INFO:tasks.workunit.client.0.smithi067.stdout:8/419: rename d0/d4/c8e to d0/d75/c90 0 2024-08-31T05:21:21.043 INFO:tasks.workunit.client.0.smithi067.stdout:9/296: truncate dd/df/f23 1486035 0 2024-08-31T05:21:21.043 INFO:tasks.workunit.client.0.smithi067.stdout:9/297: chown dd/df 821 1 2024-08-31T05:21:21.045 INFO:tasks.workunit.client.0.smithi067.stdout:3/508: dread db/d12/d21/d82/fa5 [0,4194304] 0 2024-08-31T05:21:21.046 INFO:tasks.workunit.client.0.smithi067.stdout:8/420: unlink d0/d2/dc/d28/f85 0 2024-08-31T05:21:21.049 INFO:tasks.workunit.client.0.smithi067.stdout:9/298: creat dd/df/d25/d3b/f5e x:0 0 0 2024-08-31T05:21:21.051 INFO:tasks.workunit.client.0.smithi067.stdout:3/509: creat db/d17/d3f/d54/fa6 x:0 0 0 2024-08-31T05:21:21.053 INFO:tasks.workunit.client.0.smithi067.stdout:8/421: mkdir d0/d2/dc/d91 0 2024-08-31T05:21:21.054 INFO:tasks.workunit.client.0.smithi067.stdout:3/510: rmdir db/d17/d3f 39 2024-08-31T05:21:21.059 INFO:tasks.workunit.client.0.smithi067.stdout:3/511: symlink db/d12/d21/la7 0 2024-08-31T05:21:21.060 INFO:tasks.workunit.client.0.smithi067.stdout:9/299: creat dd/df/d25/f5f x:0 0 0 2024-08-31T05:21:21.062 INFO:tasks.workunit.client.0.smithi067.stdout:8/422: creat d0/d2/dc/d28/d7e/d73/f92 x:0 0 0 2024-08-31T05:21:21.063 INFO:tasks.workunit.client.0.smithi067.stdout:3/512: dread f4 [0,4194304] 0 2024-08-31T05:21:21.064 INFO:tasks.workunit.client.0.smithi067.stdout:8/423: write d0/d4/de/f11 [849244,16818] 0 2024-08-31T05:21:21.071 INFO:tasks.workunit.client.0.smithi067.stdout:8/424: dwrite d0/d4/de/d1d/d2c/f55 [0,4194304] 0 2024-08-31T05:21:21.072 INFO:tasks.workunit.client.0.smithi067.stdout:9/300: unlink dd/c13 0 2024-08-31T05:21:21.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:20 smithi067 ceph-mon[17432]: pgmap v31: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 86 MiB/s rd, 248 MiB/s wr, 523 op/s 2024-08-31T05:21:21.079 INFO:tasks.workunit.client.0.smithi067.stdout:8/425: rename d0/d2/da/dd/f35 to d0/d2/da/f93 0 2024-08-31T05:21:21.083 INFO:tasks.workunit.client.0.smithi067.stdout:9/301: unlink dd/d20/l5a 0 2024-08-31T05:21:21.087 INFO:tasks.workunit.client.0.smithi067.stdout:9/302: creat dd/d4d/f60 x:0 0 0 2024-08-31T05:21:21.089 INFO:tasks.workunit.client.0.smithi067.stdout:8/426: getdents d0/d4/de/d1d/d2c/d3c 0 2024-08-31T05:21:21.091 INFO:tasks.workunit.client.0.smithi067.stdout:9/303: link fa dd/df/d25/d3b/d50/f61 0 2024-08-31T05:21:21.093 INFO:tasks.workunit.client.0.smithi067.stdout:9/304: creat dd/df/d25/d3b/f62 x:0 0 0 2024-08-31T05:21:21.096 INFO:tasks.workunit.client.0.smithi067.stdout:3/513: truncate db/d17/d3f/d54/d56/d88/f28 6318613 0 2024-08-31T05:21:21.098 INFO:tasks.workunit.client.0.smithi067.stdout:9/305: mkdir dd/d63 0 2024-08-31T05:21:21.099 INFO:tasks.workunit.client.0.smithi067.stdout:9/306: chown dd/df 396 1 2024-08-31T05:21:21.102 INFO:tasks.workunit.client.0.smithi067.stdout:3/514: mknod db/d55/d97/ca8 0 2024-08-31T05:21:21.103 INFO:tasks.workunit.client.0.smithi067.stdout:9/307: mknod dd/df/d5b/c64 0 2024-08-31T05:21:21.106 INFO:tasks.workunit.client.0.smithi067.stdout:8/427: truncate d0/d2/dc/f49 2412792 0 2024-08-31T05:21:21.107 INFO:tasks.workunit.client.0.smithi067.stdout:3/515: rmdir db/d17/d3f/d54 39 2024-08-31T05:21:21.108 INFO:tasks.workunit.client.0.smithi067.stdout:9/308: unlink dd/d20/l46 0 2024-08-31T05:21:21.109 INFO:tasks.workunit.client.0.smithi067.stdout:9/309: write dd/df/f11 [845040,20147] 0 2024-08-31T05:21:21.111 INFO:tasks.workunit.client.0.smithi067.stdout:8/428: creat d0/d4/de/d1d/f94 x:0 0 0 2024-08-31T05:21:21.117 INFO:tasks.workunit.client.0.smithi067.stdout:9/310: creat dd/df/d25/d3b/d50/f65 x:0 0 0 2024-08-31T05:21:21.118 INFO:tasks.workunit.client.0.smithi067.stdout:9/311: write dd/df/d25/d3b/f62 [32033,114089] 0 2024-08-31T05:21:21.125 INFO:tasks.workunit.client.0.smithi067.stdout:3/516: getdents db/d2e/da1 0 2024-08-31T05:21:21.125 INFO:tasks.workunit.client.0.smithi067.stdout:8/429: write d0/d2/f83 [1194157,116002] 0 2024-08-31T05:21:21.127 INFO:tasks.workunit.client.0.smithi067.stdout:9/312: mknod dd/d63/c66 0 2024-08-31T05:21:21.128 INFO:tasks.workunit.client.0.smithi067.stdout:3/517: symlink db/d55/la9 0 2024-08-31T05:21:21.128 INFO:tasks.workunit.client.0.smithi067.stdout:3/518: read - db/d5a/f73 zero size 2024-08-31T05:21:21.130 INFO:tasks.workunit.client.0.smithi067.stdout:8/430: rename d0/d2/da/dd/d1f/l7c to d0/d4/de/d1d/d2c/d68/l95 0 2024-08-31T05:21:21.131 INFO:tasks.workunit.client.0.smithi067.stdout:8/431: truncate d0/d4/f20 5008665 0 2024-08-31T05:21:21.132 INFO:tasks.workunit.client.0.smithi067.stdout:9/313: getdents dd/df/d5b/d5d 0 2024-08-31T05:21:21.135 INFO:tasks.workunit.client.0.smithi067.stdout:9/314: mknod dd/df/c67 0 2024-08-31T05:21:21.139 INFO:tasks.workunit.client.0.smithi067.stdout:8/432: getdents d0/d4/de/d1d/d7b 0 2024-08-31T05:21:21.144 INFO:tasks.workunit.client.0.smithi067.stdout:8/433: chown d0/d4/c2b 123477 1 2024-08-31T05:21:21.144 INFO:tasks.workunit.client.0.smithi067.stdout:9/315: dwrite dd/d4d/f60 [0,4194304] 0 2024-08-31T05:21:21.146 INFO:tasks.workunit.client.0.smithi067.stdout:3/519: dwrite db/d5a/f87 [0,4194304] 0 2024-08-31T05:21:21.146 INFO:tasks.workunit.client.0.smithi067.stdout:8/434: chown d0/d2/dc/d28/d7e/d73/d84 511986692 1 2024-08-31T05:21:21.147 INFO:tasks.workunit.client.0.smithi067.stdout:8/435: stat d0/d2/da/dd/d1f 0 2024-08-31T05:21:21.149 INFO:tasks.workunit.client.0.smithi067.stdout:3/520: symlink db/d4e/laa 0 2024-08-31T05:21:21.149 INFO:tasks.workunit.client.0.smithi067.stdout:8/436: chown d0/d2/dc/d28/d7e/c86 666 1 2024-08-31T05:21:21.152 INFO:tasks.workunit.client.0.smithi067.stdout:8/437: write d0/d4/de/d1d/f94 [954575,117349] 0 2024-08-31T05:21:21.152 INFO:tasks.workunit.client.0.smithi067.stdout:3/521: dread db/d12/f4f [0,4194304] 0 2024-08-31T05:21:21.155 INFO:tasks.workunit.client.0.smithi067.stdout:9/316: dwrite dd/df/d25/d3b/f52 [0,4194304] 0 2024-08-31T05:21:21.158 INFO:tasks.workunit.client.0.smithi067.stdout:3/522: rmdir db/d17/d3f/d54 39 2024-08-31T05:21:21.158 INFO:tasks.workunit.client.0.smithi067.stdout:3/523: stat db/d5a/f87 0 2024-08-31T05:21:21.159 INFO:tasks.workunit.client.0.smithi067.stdout:9/317: fdatasync dd/d20/f2f 0 2024-08-31T05:21:21.164 INFO:tasks.workunit.client.0.smithi067.stdout:8/438: creat d0/f96 x:0 0 0 2024-08-31T05:21:21.167 INFO:tasks.workunit.client.0.smithi067.stdout:9/318: dwrite dd/d4d/f57 [0,4194304] 0 2024-08-31T05:21:21.168 INFO:tasks.workunit.client.0.smithi067.stdout:9/319: chown dd/df/d25 95750 1 2024-08-31T05:21:21.170 INFO:tasks.workunit.client.0.smithi067.stdout:8/439: mknod d0/d2/d6/c97 0 2024-08-31T05:21:21.173 INFO:tasks.workunit.client.0.smithi067.stdout:8/440: fdatasync d0/d2/da/f88 0 2024-08-31T05:21:21.177 INFO:tasks.workunit.client.0.smithi067.stdout:3/524: rename db/d17/c2a to db/d17/d3f/d54/d56/d6e/cab 0 2024-08-31T05:21:21.179 INFO:tasks.workunit.client.0.smithi067.stdout:9/320: dwrite dd/df/f43 [0,4194304] 0 2024-08-31T05:21:21.181 INFO:tasks.workunit.client.0.smithi067.stdout:9/321: readlink dd/df/d25/l37 0 2024-08-31T05:21:21.184 INFO:tasks.workunit.client.0.smithi067.stdout:3/525: write db/d12/d21/d82/f8a [4979932,45160] 0 2024-08-31T05:21:21.185 INFO:tasks.workunit.client.0.smithi067.stdout:9/322: creat dd/df/d25/d3b/d50/f68 x:0 0 0 2024-08-31T05:21:21.186 INFO:tasks.workunit.client.0.smithi067.stdout:8/441: dwrite d0/d4/de/d1d/d2c/d3c/f76 [0,4194304] 0 2024-08-31T05:21:21.190 INFO:tasks.workunit.client.0.smithi067.stdout:9/323: creat dd/df/f69 x:0 0 0 2024-08-31T05:21:21.198 INFO:tasks.workunit.client.0.smithi067.stdout:9/324: dread dd/df/f1f [0,4194304] 0 2024-08-31T05:21:21.198 INFO:tasks.workunit.client.0.smithi067.stdout:9/325: read - dd/f36 zero size 2024-08-31T05:21:21.200 INFO:tasks.workunit.client.0.smithi067.stdout:9/326: symlink dd/d20/l6a 0 2024-08-31T05:21:21.202 INFO:tasks.workunit.client.0.smithi067.stdout:9/327: rmdir dd/df 39 2024-08-31T05:21:21.205 INFO:tasks.workunit.client.0.smithi067.stdout:9/328: dread f6 [0,4194304] 0 2024-08-31T05:21:21.208 INFO:tasks.workunit.client.0.smithi067.stdout:9/329: dread - dd/df/d25/d3b/f3e zero size 2024-08-31T05:21:21.209 INFO:tasks.workunit.client.0.smithi067.stdout:9/330: fsync dd/df/d25/d3b/f5e 0 2024-08-31T05:21:21.210 INFO:tasks.workunit.client.0.smithi067.stdout:9/331: write dd/df/d25/d3b/d50/f68 [44863,128502] 0 2024-08-31T05:21:21.214 INFO:tasks.workunit.client.0.smithi067.stdout:9/332: getdents dd/d63 0 2024-08-31T05:21:21.215 INFO:tasks.workunit.client.0.smithi067.stdout:9/333: write dd/d4d/f60 [5021705,79983] 0 2024-08-31T05:21:21.224 INFO:tasks.workunit.client.0.smithi067.stdout:9/334: rename dd/d4d/f57 to dd/df/d25/f6b 0 2024-08-31T05:21:21.225 INFO:tasks.workunit.client.0.smithi067.stdout:9/335: dread dd/df/d25/d3b/d50/f68 [0,4194304] 0 2024-08-31T05:21:21.232 INFO:tasks.workunit.client.0.smithi067.stdout:9/336: dwrite dd/df/d25/d3b/f5e [0,4194304] 0 2024-08-31T05:21:21.235 INFO:tasks.workunit.client.0.smithi067.stdout:9/337: rmdir dd/df/d25/d3b/d50 39 2024-08-31T05:21:21.241 INFO:tasks.workunit.client.0.smithi067.stdout:9/338: dwrite dd/df/f43 [0,4194304] 0 2024-08-31T05:21:21.245 INFO:tasks.workunit.client.0.smithi067.stdout:9/339: creat dd/df/d25/f6c x:0 0 0 2024-08-31T05:21:21.247 INFO:tasks.workunit.client.0.smithi067.stdout:9/340: mknod dd/df/c6d 0 2024-08-31T05:21:21.251 INFO:tasks.workunit.client.0.smithi067.stdout:9/341: rename dd/df/f49 to dd/df/d5b/f6e 0 2024-08-31T05:21:21.252 INFO:tasks.workunit.client.0.smithi067.stdout:9/342: write dd/df/f11 [4268920,58016] 0 2024-08-31T05:21:21.255 INFO:tasks.workunit.client.0.smithi067.stdout:9/343: dread dd/d20/f2b [0,4194304] 0 2024-08-31T05:21:21.258 INFO:tasks.workunit.client.0.smithi067.stdout:9/344: symlink dd/df/d5b/d5d/l6f 0 2024-08-31T05:21:21.259 INFO:tasks.workunit.client.0.smithi067.stdout:9/345: fsync dd/d20/f2f 0 2024-08-31T05:21:21.272 INFO:tasks.workunit.client.0.smithi067.stdout:9/346: dwrite dd/f3f [0,4194304] 0 2024-08-31T05:21:21.276 INFO:tasks.workunit.client.0.smithi067.stdout:9/347: dread dd/f1a [0,4194304] 0 2024-08-31T05:21:21.277 INFO:tasks.workunit.client.0.smithi067.stdout:9/348: mknod dd/df/d5b/c70 0 2024-08-31T05:21:21.286 INFO:tasks.workunit.client.0.smithi067.stdout:9/349: dwrite dd/df/f2e [0,4194304] 0 2024-08-31T05:21:21.289 INFO:tasks.workunit.client.0.smithi067.stdout:9/350: symlink dd/df/l71 0 2024-08-31T05:21:21.293 INFO:tasks.workunit.client.0.smithi067.stdout:9/351: mkdir dd/d63/d72 0 2024-08-31T05:21:21.299 INFO:tasks.workunit.client.0.smithi067.stdout:9/352: mkdir dd/df/d25/d3b/d50/d73 0 2024-08-31T05:21:21.303 INFO:tasks.workunit.client.0.smithi067.stdout:9/353: dread dd/df/f12 [0,4194304] 0 2024-08-31T05:21:21.303 INFO:tasks.workunit.client.0.smithi067.stdout:9/354: chown f6 3 1 2024-08-31T05:21:21.307 INFO:tasks.workunit.client.0.smithi067.stdout:9/355: mknod dd/c74 0 2024-08-31T05:21:21.308 INFO:tasks.workunit.client.0.smithi067.stdout:9/356: chown dd/df/l14 66378231 1 2024-08-31T05:21:21.308 INFO:tasks.workunit.client.0.smithi067.stdout:9/357: dread - dd/df/f27 zero size 2024-08-31T05:21:21.309 INFO:tasks.workunit.client.0.smithi067.stdout:9/358: write dd/df/d25/f6c [636840,42384] 0 2024-08-31T05:21:21.311 INFO:tasks.workunit.client.0.smithi067.stdout:9/359: symlink dd/df/d5b/l75 0 2024-08-31T05:21:21.314 INFO:tasks.workunit.client.0.smithi067.stdout:9/360: fdatasync dd/d20/f55 0 2024-08-31T05:21:21.318 INFO:tasks.workunit.client.0.smithi067.stdout:9/361: write dd/d20/f2b [523082,91819] 0 2024-08-31T05:21:21.324 INFO:tasks.workunit.client.0.smithi067.stdout:9/362: dwrite dd/df/f24 [0,4194304] 0 2024-08-31T05:21:21.327 INFO:tasks.workunit.client.0.smithi067.stdout:9/363: rename dd/d4d/l53 to dd/df/d25/d59/l76 0 2024-08-31T05:21:21.328 INFO:tasks.workunit.client.0.smithi067.stdout:9/364: write dd/f42 [3923973,21344] 0 2024-08-31T05:21:21.329 INFO:tasks.workunit.client.0.smithi067.stdout:9/365: chown dd/d4d/f4f 379 1 2024-08-31T05:21:21.331 INFO:tasks.workunit.client.0.smithi067.stdout:9/366: unlink dd/df/d5b/c70 0 2024-08-31T05:21:21.336 INFO:tasks.workunit.client.0.smithi067.stdout:9/367: dread dd/df/d25/d3b/d50/f61 [0,4194304] 0 2024-08-31T05:21:21.336 INFO:tasks.workunit.client.0.smithi067.stdout:9/368: chown dd/df/l18 1 1 2024-08-31T05:21:21.347 INFO:tasks.workunit.client.0.smithi067.stdout:9/369: truncate dd/df/f24 4058068 0 2024-08-31T05:21:21.348 INFO:tasks.workunit.client.0.smithi067.stdout:9/370: mknod dd/df/d25/d3b/c77 0 2024-08-31T05:21:21.349 INFO:tasks.workunit.client.0.smithi067.stdout:9/371: symlink dd/d4d/l78 0 2024-08-31T05:21:21.355 INFO:tasks.workunit.client.0.smithi067.stdout:9/372: dwrite dd/df/f11 [0,4194304] 0 2024-08-31T05:21:21.357 INFO:tasks.workunit.client.0.smithi067.stdout:9/373: stat dd/df/d25/d59/l76 0 2024-08-31T05:21:21.360 INFO:tasks.workunit.client.0.smithi067.stdout:9/374: rename dd/l1d to dd/df/d25/d3b/d50/d73/l79 0 2024-08-31T05:21:21.360 INFO:tasks.workunit.client.0.smithi067.stdout:9/375: chown dd/d20 72123 1 2024-08-31T05:21:21.362 INFO:tasks.workunit.client.0.smithi067.stdout:9/376: mkdir dd/df/d5b/d5d/d7a 0 2024-08-31T05:21:21.377 INFO:tasks.workunit.client.0.smithi067.stdout:9/377: stat dd/df/d25/d3b/d50/d73/l79 0 2024-08-31T05:21:21.378 INFO:tasks.workunit.client.0.smithi067.stdout:9/378: fdatasync dd/f22 0 2024-08-31T05:21:21.380 INFO:tasks.workunit.client.0.smithi067.stdout:9/379: symlink dd/l7b 0 2024-08-31T05:21:21.382 INFO:tasks.workunit.client.0.smithi067.stdout:9/380: mknod dd/d63/c7c 0 2024-08-31T05:21:21.383 INFO:tasks.workunit.client.0.smithi067.stdout:9/381: readlink dd/df/l71 0 2024-08-31T05:21:21.397 INFO:tasks.workunit.client.0.smithi067.stdout:9/382: dread dd/df/d25/f2c [0,4194304] 0 2024-08-31T05:21:21.398 INFO:tasks.workunit.client.0.smithi067.stdout:9/383: mknod dd/d4d/c7d 0 2024-08-31T05:21:21.403 INFO:tasks.workunit.client.0.smithi067.stdout:9/384: getdents dd/df/d25/d3b 0 2024-08-31T05:21:21.406 INFO:tasks.workunit.client.0.smithi067.stdout:9/385: rename dd/c35 to dd/df/d25/d59/c7e 0 2024-08-31T05:21:21.410 INFO:tasks.workunit.client.0.smithi067.stdout:9/386: link dd/d4d/l78 dd/df/d25/d3b/d50/d73/l7f 0 2024-08-31T05:21:21.410 INFO:tasks.workunit.client.0.smithi067.stdout:2/476: sync 2024-08-31T05:21:21.410 INFO:tasks.workunit.client.0.smithi067.stdout:1/278: sync 2024-08-31T05:21:21.410 INFO:tasks.workunit.client.0.smithi067.stdout:5/417: sync 2024-08-31T05:21:21.413 INFO:tasks.workunit.client.0.smithi067.stdout:2/477: fsync db/dd/f15 0 2024-08-31T05:21:21.415 INFO:tasks.workunit.client.0.smithi067.stdout:1/279: chown d3/d23/d2d/d2e/d3a/f5a 24101509 1 2024-08-31T05:21:21.422 INFO:tasks.workunit.client.0.smithi067.stdout:9/387: getdents dd/d63/d72 0 2024-08-31T05:21:21.423 INFO:tasks.workunit.client.0.smithi067.stdout:9/388: truncate dd/f3f 4602110 0 2024-08-31T05:21:21.426 INFO:tasks.workunit.client.0.smithi067.stdout:1/280: dread d3/d36/f53 [0,4194304] 0 2024-08-31T05:21:21.427 INFO:tasks.workunit.client.0.smithi067.stdout:9/389: dread dd/f3f [0,4194304] 0 2024-08-31T05:21:21.428 INFO:tasks.workunit.client.0.smithi067.stdout:9/390: write dd/d4d/f60 [1113415,36227] 0 2024-08-31T05:21:21.431 INFO:tasks.workunit.client.0.smithi067.stdout:2/478: mknod db/d12/d1a/d2b/d3d/d69/c91 0 2024-08-31T05:21:21.432 INFO:tasks.workunit.client.0.smithi067.stdout:9/391: dread dd/df/f24 [0,4194304] 0 2024-08-31T05:21:21.432 INFO:tasks.workunit.client.0.smithi067.stdout:9/392: fsync dd/df/d3c/f51 0 2024-08-31T05:21:21.484 INFO:tasks.workunit.client.0.smithi067.stdout:9/393: chown dd/df/d25/d3b/f52 13100 1 2024-08-31T05:21:21.484 INFO:tasks.workunit.client.0.smithi067.stdout:1/281: creat d3/d23/d2d/d2e/d34/d66/f67 x:0 0 0 2024-08-31T05:21:21.485 INFO:tasks.workunit.client.0.smithi067.stdout:5/418: link db/l17 db/d15/l89 0 2024-08-31T05:21:21.485 INFO:tasks.workunit.client.0.smithi067.stdout:9/394: chown dd/df/d5b/d5d/d7a 41251 1 2024-08-31T05:21:21.490 INFO:tasks.workunit.client.0.smithi067.stdout:5/419: dwrite db/d15/f12 [4194304,4194304] 0 2024-08-31T05:21:21.493 INFO:tasks.workunit.client.0.smithi067.stdout:1/282: truncate d3/f15 2741923 0 2024-08-31T05:21:21.493 INFO:tasks.workunit.client.0.smithi067.stdout:1/283: chown d3/l9 18954 1 2024-08-31T05:21:21.495 INFO:tasks.workunit.client.0.smithi067.stdout:5/420: stat db/d15/d42/d36/c87 0 2024-08-31T05:21:21.500 INFO:tasks.workunit.client.0.smithi067.stdout:5/421: creat db/d26/d29/d31/f8a x:0 0 0 2024-08-31T05:21:21.501 INFO:tasks.workunit.client.0.smithi067.stdout:5/422: chown db/d26/d60 52 1 2024-08-31T05:21:21.504 INFO:tasks.workunit.client.0.smithi067.stdout:1/284: write d3/f5 [4600969,5524] 0 2024-08-31T05:21:21.506 INFO:tasks.workunit.client.0.smithi067.stdout:5/423: creat db/d15/d53/d5f/f8b x:0 0 0 2024-08-31T05:21:21.510 INFO:tasks.workunit.client.0.smithi067.stdout:5/424: mkdir db/d26/d29/d31/d54/d8c 0 2024-08-31T05:21:21.517 INFO:tasks.workunit.client.0.smithi067.stdout:5/425: mkdir db/d26/d29/d31/d8d 0 2024-08-31T05:21:21.517 INFO:tasks.workunit.client.0.smithi067.stdout:1/285: write d3/d23/d2d/d2e/d3a/f5a [2157734,99909] 0 2024-08-31T05:21:21.517 INFO:tasks.workunit.client.0.smithi067.stdout:1/286: chown d3/c57 16142 1 2024-08-31T05:21:21.518 INFO:tasks.workunit.client.0.smithi067.stdout:1/287: fdatasync d3/f5 0 2024-08-31T05:21:21.518 INFO:tasks.workunit.client.0.smithi067.stdout:5/426: truncate db/d26/d60/f71 936690 0 2024-08-31T05:21:21.520 INFO:tasks.workunit.client.0.smithi067.stdout:5/427: write db/d26/d60/f6a [8163217,102075] 0 2024-08-31T05:21:21.522 INFO:tasks.workunit.client.0.smithi067.stdout:1/288: truncate d3/dd/f2c 859235 0 2024-08-31T05:21:21.524 INFO:tasks.workunit.client.0.smithi067.stdout:1/289: dread - d3/d23/f3c zero size 2024-08-31T05:21:21.529 INFO:tasks.workunit.client.0.smithi067.stdout:1/290: symlink d3/d36/l68 0 2024-08-31T05:21:21.529 INFO:tasks.workunit.client.0.smithi067.stdout:1/291: chown d3/f27 2 1 2024-08-31T05:21:21.529 INFO:tasks.workunit.client.0.smithi067.stdout:5/428: getdents db/d1d/d4f 0 2024-08-31T05:21:21.529 INFO:tasks.workunit.client.0.smithi067.stdout:1/292: mknod d3/d23/d2d/d2e/d34/c69 0 2024-08-31T05:21:21.531 INFO:tasks.workunit.client.0.smithi067.stdout:5/429: mknod db/d15/d42/d36/d73/d77/c8e 0 2024-08-31T05:21:21.532 INFO:tasks.workunit.client.0.smithi067.stdout:1/293: symlink d3/l6a 0 2024-08-31T05:21:21.536 INFO:tasks.workunit.client.0.smithi067.stdout:5/430: rename db/d15/d42/d36/d73/l7d to db/d15/d53/d5f/l8f 0 2024-08-31T05:21:21.536 INFO:tasks.workunit.client.0.smithi067.stdout:1/294: symlink d3/dd/d50/l6b 0 2024-08-31T05:21:21.536 INFO:tasks.workunit.client.0.smithi067.stdout:1/295: readlink d3/dd/l44 0 2024-08-31T05:21:21.537 INFO:tasks.workunit.client.0.smithi067.stdout:5/431: rename db/d15/d53/d5f/c85 to db/d15/d59/c90 0 2024-08-31T05:21:21.538 INFO:tasks.workunit.client.0.smithi067.stdout:1/296: creat d3/d23/d2d/d2e/d34/f6c x:0 0 0 2024-08-31T05:21:21.538 INFO:tasks.workunit.client.0.smithi067.stdout:5/432: truncate db/d15/d53/f63 412130 0 2024-08-31T05:21:21.538 INFO:tasks.workunit.client.0.smithi067.stdout:1/297: dread - d3/d23/f3c zero size 2024-08-31T05:21:21.545 INFO:tasks.workunit.client.0.smithi067.stdout:1/298: symlink d3/d23/d5d/l6d 0 2024-08-31T05:21:21.545 INFO:tasks.workunit.client.0.smithi067.stdout:1/299: readlink d3/dd/d50/l5e 0 2024-08-31T05:21:21.552 INFO:tasks.workunit.client.0.smithi067.stdout:1/300: getdents d3/d23/d2d/d2e/d34 0 2024-08-31T05:21:21.552 INFO:tasks.workunit.client.0.smithi067.stdout:5/433: write db/f32 [450536,41088] 0 2024-08-31T05:21:21.559 INFO:tasks.workunit.client.0.smithi067.stdout:5/434: getdents db/d26/d60 0 2024-08-31T05:21:21.559 INFO:tasks.workunit.client.0.smithi067.stdout:1/301: dwrite d3/d23/d2d/d2e/d34/f6c [0,4194304] 0 2024-08-31T05:21:21.560 INFO:tasks.workunit.client.0.smithi067.stdout:5/435: stat db/d26/d29/d31/d8d 0 2024-08-31T05:21:21.566 INFO:tasks.workunit.client.0.smithi067.stdout:5/436: creat db/d58/f91 x:0 0 0 2024-08-31T05:21:21.567 INFO:tasks.workunit.client.0.smithi067.stdout:5/437: dread - db/d15/d59/f84 zero size 2024-08-31T05:21:21.568 INFO:tasks.workunit.client.0.smithi067.stdout:1/302: dwrite d3/dd/f54 [0,4194304] 0 2024-08-31T05:21:21.573 INFO:tasks.workunit.client.0.smithi067.stdout:5/438: symlink db/d26/d29/d81/l92 0 2024-08-31T05:21:21.574 INFO:tasks.workunit.client.0.smithi067.stdout:1/303: creat d3/d23/d2d/f6e x:0 0 0 2024-08-31T05:21:21.575 INFO:tasks.workunit.client.0.smithi067.stdout:1/304: chown d3/dd/l2b 5378 1 2024-08-31T05:21:21.578 INFO:tasks.workunit.client.0.smithi067.stdout:1/305: creat d3/d23/d5d/f6f x:0 0 0 2024-08-31T05:21:21.580 INFO:tasks.workunit.client.0.smithi067.stdout:5/439: dwrite f6 [0,4194304] 0 2024-08-31T05:21:21.581 INFO:tasks.workunit.client.0.smithi067.stdout:1/306: creat d3/dd/f70 x:0 0 0 2024-08-31T05:21:21.584 INFO:tasks.workunit.client.0.smithi067.stdout:5/440: mknod db/d15/d42/c93 0 2024-08-31T05:21:21.585 INFO:tasks.workunit.client.0.smithi067.stdout:1/307: mknod d3/dd/d50/c71 0 2024-08-31T05:21:21.588 INFO:tasks.workunit.client.0.smithi067.stdout:1/308: rename d3/d23/d2d/d2e/d3a to d3/d23/d2d/d2e/d34/d66/d72 0 2024-08-31T05:21:21.590 INFO:tasks.workunit.client.0.smithi067.stdout:1/309: mknod d3/dd/c73 0 2024-08-31T05:21:21.595 INFO:tasks.workunit.client.0.smithi067.stdout:1/310: link d3/d23/d2d/d2e/d34/d66/d72/f5a d3/f74 0 2024-08-31T05:21:21.644 INFO:tasks.workunit.client.0.smithi067.stdout:1/311: mknod d3/dd/c75 0 2024-08-31T05:21:21.647 INFO:tasks.workunit.client.0.smithi067.stdout:5/441: dwrite db/d15/f18 [0,4194304] 0 2024-08-31T05:21:21.648 INFO:tasks.workunit.client.0.smithi067.stdout:1/312: unlink d3/c57 0 2024-08-31T05:21:21.648 INFO:tasks.workunit.client.0.smithi067.stdout:5/442: readlink db/d26/d29/d31/l35 0 2024-08-31T05:21:21.648 INFO:tasks.workunit.client.0.smithi067.stdout:1/313: stat d3/d23/d2d/d2e/f39 0 2024-08-31T05:21:21.649 INFO:tasks.workunit.client.0.smithi067.stdout:5/443: dread - db/d26/d4c/f65 zero size 2024-08-31T05:21:21.650 INFO:tasks.workunit.client.0.smithi067.stdout:5/444: read db/d15/f18 [902710,114338] 0 2024-08-31T05:21:21.670 INFO:tasks.workunit.client.0.smithi067.stdout:1/314: dwrite d3/f55 [0,4194304] 0 2024-08-31T05:21:21.678 INFO:tasks.workunit.client.0.smithi067.stdout:5/445: rmdir db/d26/d29/d86 0 2024-08-31T05:21:21.681 INFO:tasks.workunit.client.0.smithi067.stdout:5/446: write db/f21 [4644258,111453] 0 2024-08-31T05:21:21.684 INFO:tasks.workunit.client.0.smithi067.stdout:5/447: creat db/d15/d42/d36/d73/d77/f94 x:0 0 0 2024-08-31T05:21:21.685 INFO:tasks.workunit.client.0.smithi067.stdout:5/448: write db/d15/d42/d36/d73/f83 [490628,71917] 0 2024-08-31T05:21:21.691 INFO:tasks.workunit.client.0.smithi067.stdout:1/315: dread d3/f15 [0,4194304] 0 2024-08-31T05:21:21.693 INFO:tasks.workunit.client.0.smithi067.stdout:1/316: creat d3/d23/f76 x:0 0 0 2024-08-31T05:21:21.696 INFO:tasks.workunit.client.0.smithi067.stdout:1/317: dread - d3/dd/f4e zero size 2024-08-31T05:21:21.699 INFO:tasks.workunit.client.0.smithi067.stdout:5/449: dread db/d15/f2a [0,4194304] 0 2024-08-31T05:21:21.715 INFO:tasks.workunit.client.0.smithi067.stdout:5/450: dread db/d1d/f78 [0,4194304] 0 2024-08-31T05:21:21.723 INFO:tasks.workunit.client.0.smithi067.stdout:5/451: dwrite db/d15/d53/f82 [0,4194304] 0 2024-08-31T05:21:21.726 INFO:tasks.workunit.client.0.smithi067.stdout:5/452: mknod db/d26/c95 0 2024-08-31T05:21:21.730 INFO:tasks.workunit.client.0.smithi067.stdout:5/453: mkdir db/d26/d29/d31/d54/d66/d96 0 2024-08-31T05:21:21.734 INFO:tasks.workunit.client.0.smithi067.stdout:5/454: truncate db/d26/d29/d31/f6e 925281 0 2024-08-31T05:21:21.739 INFO:tasks.workunit.client.0.smithi067.stdout:7/295: sync 2024-08-31T05:21:21.739 INFO:tasks.workunit.client.0.smithi067.stdout:0/448: sync 2024-08-31T05:21:21.739 INFO:tasks.workunit.client.0.smithi067.stdout:3/526: sync 2024-08-31T05:21:21.744 INFO:tasks.workunit.client.0.smithi067.stdout:0/449: creat d1/df/d17/d43/d48/f92 x:0 0 0 2024-08-31T05:21:21.744 INFO:tasks.workunit.client.0.smithi067.stdout:3/527: mknod db/d5a/cac 0 2024-08-31T05:21:21.745 INFO:tasks.workunit.client.0.smithi067.stdout:0/450: read - d1/dd/d18/f60 zero size 2024-08-31T05:21:21.749 INFO:tasks.workunit.client.0.smithi067.stdout:0/451: rename d1/df/d29/l87 to d1/df/d29/l93 0 2024-08-31T05:21:21.754 INFO:tasks.workunit.client.0.smithi067.stdout:0/452: mkdir d1/df/d17/d94 0 2024-08-31T05:21:21.754 INFO:tasks.workunit.client.0.smithi067.stdout:0/453: stat d1/dd/d71 0 2024-08-31T05:21:21.762 INFO:tasks.workunit.client.0.smithi067.stdout:0/454: dwrite d1/df/d17/f4c [0,4194304] 0 2024-08-31T05:21:21.769 INFO:tasks.workunit.client.0.smithi067.stdout:0/455: rename d1/c72 to d1/df/d17/d43/d48/d6a/d84/c95 0 2024-08-31T05:21:21.772 INFO:tasks.workunit.client.0.smithi067.stdout:0/456: symlink d1/dd/d18/l96 0 2024-08-31T05:21:21.777 INFO:tasks.workunit.client.0.smithi067.stdout:0/457: dread d1/df/d29/f74 [0,4194304] 0 2024-08-31T05:21:21.789 INFO:tasks.workunit.client.0.smithi067.stdout:5/455: dwrite db/f25 [0,4194304] 0 2024-08-31T05:21:21.794 INFO:tasks.workunit.client.0.smithi067.stdout:0/458: dwrite d1/df/d17/f20 [0,4194304] 0 2024-08-31T05:21:21.796 INFO:tasks.workunit.client.0.smithi067.stdout:7/296: dwrite d14/d16/f1d [0,4194304] 0 2024-08-31T05:21:21.796 INFO:tasks.workunit.client.0.smithi067.stdout:5/456: readlink db/d26/l3f 0 2024-08-31T05:21:21.804 INFO:tasks.workunit.client.0.smithi067.stdout:0/459: creat d1/df/d17/d43/f97 x:0 0 0 2024-08-31T05:21:21.806 INFO:tasks.workunit.client.0.smithi067.stdout:7/297: creat d14/d4a/f4b x:0 0 0 2024-08-31T05:21:21.808 INFO:tasks.workunit.client.0.smithi067.stdout:5/457: dwrite db/d58/f91 [0,4194304] 0 2024-08-31T05:21:21.814 INFO:tasks.workunit.client.0.smithi067.stdout:0/460: rmdir d1/df/d29/d37/d6f 39 2024-08-31T05:21:21.815 INFO:tasks.workunit.client.0.smithi067.stdout:0/461: chown d1/f39 5 1 2024-08-31T05:21:21.817 INFO:tasks.workunit.client.0.smithi067.stdout:7/298: mknod d14/c4c 0 2024-08-31T05:21:21.819 INFO:tasks.workunit.client.0.smithi067.stdout:5/458: link db/d26/d29/f57 db/d26/d29/d31/f97 0 2024-08-31T05:21:21.819 INFO:tasks.workunit.client.0.smithi067.stdout:0/462: rmdir d1/dd 39 2024-08-31T05:21:21.821 INFO:tasks.workunit.client.0.smithi067.stdout:5/459: read db/d15/f12 [4318262,34821] 0 2024-08-31T05:21:21.824 INFO:tasks.workunit.client.0.smithi067.stdout:5/460: write db/d15/d53/f63 [96547,67267] 0 2024-08-31T05:21:21.825 INFO:tasks.workunit.client.0.smithi067.stdout:0/463: mkdir d1/d8/d42/d98 0 2024-08-31T05:21:21.826 INFO:tasks.workunit.client.0.smithi067.stdout:5/461: rename db to db/d26/d29/d31/d8d/d98 22 2024-08-31T05:21:21.828 INFO:tasks.workunit.client.0.smithi067.stdout:7/299: dwrite d14/d16/d28/d2e/f46 [0,4194304] 0 2024-08-31T05:21:21.831 INFO:tasks.workunit.client.0.smithi067.stdout:5/462: fsync db/d15/f12 0 2024-08-31T05:21:21.833 INFO:tasks.workunit.client.0.smithi067.stdout:7/300: mknod d14/d16/d28/d2e/c4d 0 2024-08-31T05:21:21.841 INFO:tasks.workunit.client.0.smithi067.stdout:7/301: dwrite d14/f20 [0,4194304] 0 2024-08-31T05:21:21.845 INFO:tasks.workunit.client.0.smithi067.stdout:7/302: dread - d14/d16/d28/d2e/f37 zero size 2024-08-31T05:21:21.851 INFO:tasks.workunit.client.0.smithi067.stdout:7/303: fsync d14/d16/d28/d2e/f46 0 2024-08-31T05:21:21.855 INFO:tasks.workunit.client.0.smithi067.stdout:0/464: dwrite d1/d8/f35 [0,4194304] 0 2024-08-31T05:21:21.856 INFO:tasks.workunit.client.0.smithi067.stdout:7/304: creat d14/d16/f4e x:0 0 0 2024-08-31T05:21:21.859 INFO:tasks.workunit.client.0.smithi067.stdout:7/305: creat d14/d16/d28/d2e/d2f/f4f x:0 0 0 2024-08-31T05:21:21.860 INFO:tasks.workunit.client.0.smithi067.stdout:7/306: write d14/d16/f41 [739607,18055] 0 2024-08-31T05:21:21.862 INFO:tasks.workunit.client.0.smithi067.stdout:0/465: truncate d1/dd/d4d/f51 519783 0 2024-08-31T05:21:21.865 INFO:tasks.workunit.client.0.smithi067.stdout:7/307: mkdir d14/d50 0 2024-08-31T05:21:21.865 INFO:tasks.workunit.client.0.smithi067.stdout:0/466: symlink d1/dd/l99 0 2024-08-31T05:21:21.866 INFO:tasks.workunit.client.0.smithi067.stdout:0/467: readlink d1/l5c 0 2024-08-31T05:21:21.867 INFO:tasks.workunit.client.0.smithi067.stdout:7/308: write f6 [818382,126450] 0 2024-08-31T05:21:21.867 INFO:tasks.workunit.client.0.smithi067.stdout:0/468: dread - d1/df/d29/d37/f8e zero size 2024-08-31T05:21:21.868 INFO:tasks.workunit.client.0.smithi067.stdout:7/309: fdatasync fd 0 2024-08-31T05:21:21.868 INFO:tasks.workunit.client.0.smithi067.stdout:7/310: write fd [1123483,32867] 0 2024-08-31T05:21:21.869 INFO:tasks.workunit.client.0.smithi067.stdout:7/311: chown d14/d16/d28/f35 97785346 1 2024-08-31T05:21:21.870 INFO:tasks.workunit.client.0.smithi067.stdout:0/469: creat d1/dd/d18/f9a x:0 0 0 2024-08-31T05:21:21.870 INFO:tasks.workunit.client.0.smithi067.stdout:0/470: readlink d1/dd/d4d/l78 0 2024-08-31T05:21:21.874 INFO:tasks.workunit.client.0.smithi067.stdout:0/471: symlink d1/d8/d42/d98/l9b 0 2024-08-31T05:21:21.874 INFO:tasks.workunit.client.0.smithi067.stdout:7/312: dread d14/f1e [0,4194304] 0 2024-08-31T05:21:21.875 INFO:tasks.workunit.client.0.smithi067.stdout:7/313: fdatasync d14/d16/d28/d2e/f46 0 2024-08-31T05:21:21.875 INFO:tasks.workunit.client.0.smithi067.stdout:0/472: truncate d1/d8/f35 4450527 0 2024-08-31T05:21:21.876 INFO:tasks.workunit.client.0.smithi067.stdout:0/473: write d1/d8/f16 [1084363,113514] 0 2024-08-31T05:21:21.877 INFO:tasks.workunit.client.0.smithi067.stdout:0/474: chown d1/d50/f57 31 1 2024-08-31T05:21:21.878 INFO:tasks.workunit.client.0.smithi067.stdout:0/475: chown d1/df/d17/f20 701806522 1 2024-08-31T05:21:21.880 INFO:tasks.workunit.client.0.smithi067.stdout:7/314: rmdir d14/d50 0 2024-08-31T05:21:21.881 INFO:tasks.workunit.client.0.smithi067.stdout:0/476: symlink d1/df/d29/d86/l9c 0 2024-08-31T05:21:21.882 INFO:tasks.workunit.client.0.smithi067.stdout:0/477: fdatasync d1/dd/d18/f9a 0 2024-08-31T05:21:21.896 INFO:tasks.workunit.client.0.smithi067.stdout:0/478: dread d1/f39 [0,4194304] 0 2024-08-31T05:21:21.899 INFO:tasks.workunit.client.0.smithi067.stdout:0/479: fdatasync d1/f39 0 2024-08-31T05:21:21.904 INFO:tasks.workunit.client.0.smithi067.stdout:0/480: fdatasync d1/d8/f23 0 2024-08-31T05:21:21.905 INFO:tasks.workunit.client.0.smithi067.stdout:7/315: write f11 [579576,108161] 0 2024-08-31T05:21:21.907 INFO:tasks.workunit.client.0.smithi067.stdout:0/481: truncate d1/dd/d4d/d88/f89 1020319 0 2024-08-31T05:21:21.915 INFO:tasks.workunit.client.0.smithi067.stdout:7/316: creat d14/f51 x:0 0 0 2024-08-31T05:21:21.918 INFO:tasks.workunit.client.0.smithi067.stdout:7/317: mkdir d14/d16/d28/d2e/d2f/d52 0 2024-08-31T05:21:21.919 INFO:tasks.workunit.client.0.smithi067.stdout:6/602: sync 2024-08-31T05:21:21.920 INFO:tasks.workunit.client.0.smithi067.stdout:0/482: dwrite d1/dd/f15 [0,4194304] 0 2024-08-31T05:21:21.922 INFO:tasks.workunit.client.0.smithi067.stdout:0/483: creat d1/d50/f9d x:0 0 0 2024-08-31T05:21:21.924 INFO:tasks.workunit.client.0.smithi067.stdout:0/484: chown d1/df/d29/l7d 183836736 1 2024-08-31T05:21:21.926 INFO:tasks.workunit.client.0.smithi067.stdout:7/318: dwrite fd [0,4194304] 0 2024-08-31T05:21:21.930 INFO:tasks.workunit.client.0.smithi067.stdout:6/603: symlink d1b/d23/d28/d45/da4/lc9 0 2024-08-31T05:21:21.932 INFO:tasks.workunit.client.0.smithi067.stdout:0/485: dwrite d1/d50/f9d [0,4194304] 0 2024-08-31T05:21:21.936 INFO:tasks.workunit.client.0.smithi067.stdout:0/486: dread - d1/df/d29/d37/d6f/f83 zero size 2024-08-31T05:21:21.941 INFO:tasks.workunit.client.0.smithi067.stdout:0/487: stat d1/dd/l7a 0 2024-08-31T05:21:21.950 INFO:tasks.workunit.client.0.smithi067.stdout:6/604: rename d1b/c9e to d1b/d23/d28/d45/d8d/cca 0 2024-08-31T05:21:21.952 INFO:tasks.workunit.client.0.smithi067.stdout:0/488: creat d1/df/d17/d94/f9e x:0 0 0 2024-08-31T05:21:21.953 INFO:tasks.workunit.client.0.smithi067.stdout:0/489: read d1/df/f1d [147739,5296] 0 2024-08-31T05:21:21.955 INFO:tasks.workunit.client.0.smithi067.stdout:6/605: getdents d1b/d23/d28/db9 0 2024-08-31T05:21:21.956 INFO:tasks.workunit.client.0.smithi067.stdout:0/490: unlink d1/df/d17/f20 0 2024-08-31T05:21:21.957 INFO:tasks.workunit.client.0.smithi067.stdout:0/491: chown d1/df/d17/d43/d80 88019966 1 2024-08-31T05:21:21.960 INFO:tasks.workunit.client.0.smithi067.stdout:6/606: symlink d1b/d40/d96/db6/lcb 0 2024-08-31T05:21:21.964 INFO:tasks.workunit.client.0.smithi067.stdout:6/607: fdatasync f7 0 2024-08-31T05:21:21.966 INFO:tasks.workunit.client.0.smithi067.stdout:7/319: write d14/d16/d28/d2e/f3a [2128948,114700] 0 2024-08-31T05:21:21.972 INFO:tasks.workunit.client.0.smithi067.stdout:6/608: dwrite d1b/d40/d70/d71/dae/fc5 [0,4194304] 0 2024-08-31T05:21:21.974 INFO:tasks.workunit.client.0.smithi067.stdout:7/320: getdents d14 0 2024-08-31T05:21:21.977 INFO:tasks.workunit.client.0.smithi067.stdout:7/321: mkdir d14/d16/d28/d2e/d53 0 2024-08-31T05:21:21.977 INFO:tasks.workunit.client.0.smithi067.stdout:7/322: fsync d14/f51 0 2024-08-31T05:21:21.978 INFO:tasks.workunit.client.0.smithi067.stdout:6/609: read d1b/d30/f73 [2597048,103319] 0 2024-08-31T05:21:21.979 INFO:tasks.workunit.client.0.smithi067.stdout:6/610: truncate d1b/d40/d96/db3/fb5 20723 0 2024-08-31T05:21:21.981 INFO:tasks.workunit.client.0.smithi067.stdout:7/323: mkdir d14/d54 0 2024-08-31T05:21:21.984 INFO:tasks.workunit.client.0.smithi067.stdout:0/492: write d1/df/d17/d43/f64 [1030788,4842] 0 2024-08-31T05:21:21.985 INFO:tasks.workunit.client.0.smithi067.stdout:0/493: chown d1/df/d17/d43/l5f 471850 1 2024-08-31T05:21:21.986 INFO:tasks.workunit.client.0.smithi067.stdout:0/494: chown d1/df/d29/l2f 24 1 2024-08-31T05:21:21.986 INFO:tasks.workunit.client.0.smithi067.stdout:0/495: fdatasync d1/dd/d4d/d88/f89 0 2024-08-31T05:21:21.988 INFO:tasks.workunit.client.0.smithi067.stdout:0/496: chown d1/dd/d4d/d88/f89 6 1 2024-08-31T05:21:21.992 INFO:tasks.workunit.client.0.smithi067.stdout:6/611: dread d1b/d23/d28/d45/d5c/faf [0,4194304] 0 2024-08-31T05:21:21.995 INFO:tasks.workunit.client.0.smithi067.stdout:7/324: truncate d14/d16/d28/d2e/f3a 2428662 0 2024-08-31T05:21:21.995 INFO:tasks.workunit.client.0.smithi067.stdout:6/612: dread d1b/d23/d28/d45/f65 [0,4194304] 0 2024-08-31T05:21:21.997 INFO:tasks.workunit.client.0.smithi067.stdout:6/613: rmdir d1b/d40/d70/d71/dae 39 2024-08-31T05:21:21.998 INFO:tasks.workunit.client.0.smithi067.stdout:6/614: chown d1b/d23/c26 148 1 2024-08-31T05:21:22.000 INFO:tasks.workunit.client.0.smithi067.stdout:7/325: creat d14/d3e/f55 x:0 0 0 2024-08-31T05:21:22.005 INFO:tasks.workunit.client.0.smithi067.stdout:7/326: rename d14/d16/d28/d2e/l47 to d14/d16/d28/d49/l56 0 2024-08-31T05:21:22.006 INFO:tasks.workunit.client.0.smithi067.stdout:7/327: symlink d14/d54/l57 0 2024-08-31T05:21:22.008 INFO:tasks.workunit.client.0.smithi067.stdout:7/328: symlink d14/d16/d28/d2e/d2f/l58 0 2024-08-31T05:21:22.009 INFO:tasks.workunit.client.0.smithi067.stdout:7/329: creat d14/f59 x:0 0 0 2024-08-31T05:21:22.012 INFO:tasks.workunit.client.0.smithi067.stdout:7/330: creat d14/d16/d28/d2e/f5a x:0 0 0 2024-08-31T05:21:22.013 INFO:tasks.workunit.client.0.smithi067.stdout:7/331: mkdir d14/d16/d5b 0 2024-08-31T05:21:22.021 INFO:tasks.workunit.client.0.smithi067.stdout:6/615: dwrite d1b/f20 [8388608,4194304] 0 2024-08-31T05:21:22.033 INFO:tasks.workunit.client.0.smithi067.stdout:6/616: dwrite f9 [0,4194304] 0 2024-08-31T05:21:22.035 INFO:tasks.workunit.client.0.smithi067.stdout:7/332: read f11 [135078,45000] 0 2024-08-31T05:21:22.035 INFO:tasks.workunit.client.0.smithi067.stdout:6/617: getdents d1b/d8e/d62 0 2024-08-31T05:21:22.036 INFO:tasks.workunit.client.0.smithi067.stdout:7/333: fdatasync fb 0 2024-08-31T05:21:22.037 INFO:tasks.workunit.client.0.smithi067.stdout:7/334: dread - d14/d16/f4e zero size 2024-08-31T05:21:22.037 INFO:tasks.workunit.client.0.smithi067.stdout:6/618: mknod d1b/d23/ccc 0 2024-08-31T05:21:22.038 INFO:tasks.workunit.client.0.smithi067.stdout:6/619: read - d1b/d23/d28/db9/fbf zero size 2024-08-31T05:21:22.039 INFO:tasks.workunit.client.0.smithi067.stdout:7/335: creat d14/d16/d5b/f5c x:0 0 0 2024-08-31T05:21:22.041 INFO:tasks.workunit.client.0.smithi067.stdout:6/620: creat d1b/d23/d2e/d3b/fcd x:0 0 0 2024-08-31T05:21:22.042 INFO:tasks.workunit.client.0.smithi067.stdout:7/336: creat d14/d16/f5d x:0 0 0 2024-08-31T05:21:22.043 INFO:tasks.workunit.client.0.smithi067.stdout:6/621: creat d1b/d40/d96/db3/fce x:0 0 0 2024-08-31T05:21:22.044 INFO:tasks.workunit.client.0.smithi067.stdout:7/337: write f11 [1152238,99420] 0 2024-08-31T05:21:22.048 INFO:tasks.workunit.client.0.smithi067.stdout:6/622: rename d1b/d23/d28/d45/d5e/c93 to d1b/d23/d28/d45/d8d/ccf 0 2024-08-31T05:21:22.062 INFO:tasks.workunit.client.0.smithi067.stdout:6/623: write d1b/d7a/f9a [892361,58392] 0 2024-08-31T05:21:22.067 INFO:tasks.workunit.client.0.smithi067.stdout:7/338: dwrite d14/d16/f2b [0,4194304] 0 2024-08-31T05:21:22.069 INFO:tasks.workunit.client.0.smithi067.stdout:6/624: write d1b/d23/f69 [3219020,65956] 0 2024-08-31T05:21:22.069 INFO:tasks.workunit.client.0.smithi067.stdout:7/339: fdatasync d14/d16/d28/d2e/f46 0 2024-08-31T05:21:22.070 INFO:tasks.workunit.client.0.smithi067.stdout:7/340: stat d14/d16/d28/d2e/d2f 0 2024-08-31T05:21:22.071 INFO:tasks.workunit.client.0.smithi067.stdout:6/625: truncate d1b/d23/f69 4210438 0 2024-08-31T05:21:22.073 INFO:tasks.workunit.client.0.smithi067.stdout:7/341: mkdir d14/d54/d5e 0 2024-08-31T05:21:22.075 INFO:tasks.workunit.client.0.smithi067.stdout:6/626: rename d1b/d23/d28/d45 to d1b/d40/d70/dd0 0 2024-08-31T05:21:22.078 INFO:tasks.workunit.client.0.smithi067.stdout:7/342: creat d14/d16/d28/f5f x:0 0 0 2024-08-31T05:21:22.079 INFO:tasks.workunit.client.0.smithi067.stdout:6/627: truncate d1b/d40/d70/dd0/f65 217335 0 2024-08-31T05:21:22.081 INFO:tasks.workunit.client.0.smithi067.stdout:7/343: creat d14/d16/f60 x:0 0 0 2024-08-31T05:21:22.083 INFO:tasks.workunit.client.0.smithi067.stdout:6/628: mknod d1b/d40/d70/dd0/d8d/cd1 0 2024-08-31T05:21:22.085 INFO:tasks.workunit.client.0.smithi067.stdout:7/344: fsync d14/d16/d28/d2e/f37 0 2024-08-31T05:21:22.086 INFO:tasks.workunit.client.0.smithi067.stdout:6/629: read d1b/d23/d28/f55 [1217420,129606] 0 2024-08-31T05:21:22.091 INFO:tasks.workunit.client.0.smithi067.stdout:7/345: creat d14/d16/d28/d49/f61 x:0 0 0 2024-08-31T05:21:22.092 INFO:tasks.workunit.client.0.smithi067.stdout:7/346: chown d14/d16/d28/d2e/f5a 480 1 2024-08-31T05:21:22.097 INFO:tasks.workunit.client.0.smithi067.stdout:7/347: creat d14/d54/f62 x:0 0 0 2024-08-31T05:21:22.100 INFO:tasks.workunit.client.0.smithi067.stdout:7/348: write d14/f1e [3318157,93011] 0 2024-08-31T05:21:22.101 INFO:tasks.workunit.client.0.smithi067.stdout:7/349: fsync d14/d16/f41 0 2024-08-31T05:21:22.102 INFO:tasks.workunit.client.0.smithi067.stdout:8/442: sync 2024-08-31T05:21:22.102 INFO:tasks.workunit.client.0.smithi067.stdout:4/304: sync 2024-08-31T05:21:22.103 INFO:tasks.workunit.client.0.smithi067.stdout:8/443: write d0/d4/f20 [1997028,59066] 0 2024-08-31T05:21:22.105 INFO:tasks.workunit.client.0.smithi067.stdout:6/630: write d1b/d40/d70/dd0/f65 [229536,110646] 0 2024-08-31T05:21:22.106 INFO:tasks.workunit.client.0.smithi067.stdout:4/305: creat d4/d14/d48/f6e x:0 0 0 2024-08-31T05:21:22.109 INFO:tasks.workunit.client.0.smithi067.stdout:7/350: dwrite f7 [4194304,4194304] 0 2024-08-31T05:21:22.111 INFO:tasks.workunit.client.0.smithi067.stdout:4/306: creat d4/d1e/f6f x:0 0 0 2024-08-31T05:21:22.112 INFO:tasks.workunit.client.0.smithi067.stdout:4/307: fsync d4/f10 0 2024-08-31T05:21:22.113 INFO:tasks.workunit.client.0.smithi067.stdout:8/444: unlink d0/d2/dc/d3d/f5e 0 2024-08-31T05:21:22.114 INFO:tasks.workunit.client.0.smithi067.stdout:8/445: dread - d0/d2/dc/d28/d7e/d73/f92 zero size 2024-08-31T05:21:22.115 INFO:tasks.workunit.client.0.smithi067.stdout:4/308: read d4/d1f/f3d [123193,36915] 0 2024-08-31T05:21:22.115 INFO:tasks.workunit.client.0.smithi067.stdout:4/309: stat d4/d1e/d53/l67 0 2024-08-31T05:21:22.123 INFO:tasks.workunit.client.0.smithi067.stdout:6/631: dwrite d1b/d40/d70/dd0/daa/fb8 [0,4194304] 0 2024-08-31T05:21:22.125 INFO:tasks.workunit.client.0.smithi067.stdout:6/632: write d1b/d23/d28/db9/fbf [675687,56263] 0 2024-08-31T05:21:22.125 INFO:tasks.workunit.client.0.smithi067.stdout:8/446: mkdir d0/d2/dc/d3d/d98 0 2024-08-31T05:21:22.127 INFO:tasks.workunit.client.0.smithi067.stdout:8/447: dread - d0/d4/f7d zero size 2024-08-31T05:21:22.128 INFO:tasks.workunit.client.0.smithi067.stdout:4/310: creat d4/d14/d48/d66/f70 x:0 0 0 2024-08-31T05:21:22.129 INFO:tasks.workunit.client.0.smithi067.stdout:7/351: link d14/c4c d14/d16/d28/d49/c63 0 2024-08-31T05:21:22.129 INFO:tasks.workunit.client.0.smithi067.stdout:7/352: write d14/f59 [382942,15708] 0 2024-08-31T05:21:22.131 INFO:tasks.workunit.client.0.smithi067.stdout:8/448: mkdir d0/d75/d99 0 2024-08-31T05:21:22.131 INFO:tasks.workunit.client.0.smithi067.stdout:7/353: chown d14/d16/d28/d2e/f38 404803 1 2024-08-31T05:21:22.131 INFO:tasks.workunit.client.0.smithi067.stdout:4/311: creat d4/d42/f71 x:0 0 0 2024-08-31T05:21:22.133 INFO:tasks.workunit.client.0.smithi067.stdout:4/312: chown d4/d9/c15 13 1 2024-08-31T05:21:22.134 INFO:tasks.workunit.client.0.smithi067.stdout:6/633: symlink d1b/d40/d70/dd0/d5e/d7b/ld2 0 2024-08-31T05:21:22.138 INFO:tasks.workunit.client.0.smithi067.stdout:8/449: dwrite d0/d2/dc/d3d/f67 [0,4194304] 0 2024-08-31T05:21:22.140 INFO:tasks.workunit.client.0.smithi067.stdout:6/634: creat d1b/d40/d70/dd0/daa/fd3 x:0 0 0 2024-08-31T05:21:22.145 INFO:tasks.workunit.client.0.smithi067.stdout:8/450: creat d0/d4/de/d1d/f9a x:0 0 0 2024-08-31T05:21:22.145 INFO:tasks.workunit.client.0.smithi067.stdout:8/451: truncate d0/d2/dc/d3d/f67 4349570 0 2024-08-31T05:21:22.146 INFO:tasks.workunit.client.0.smithi067.stdout:7/354: rename d14/d16/d28/d49 to d14/d16/d5b/d64 0 2024-08-31T05:21:22.147 INFO:tasks.workunit.client.0.smithi067.stdout:8/452: readlink d0/d2/da/dd/d1f/l47 0 2024-08-31T05:21:22.147 INFO:tasks.workunit.client.0.smithi067.stdout:8/453: chown d0/d2/f83 41226 1 2024-08-31T05:21:22.150 INFO:tasks.workunit.client.0.smithi067.stdout:4/313: rename d4/d9/d4b/f52 to d4/d1f/f72 0 2024-08-31T05:21:22.154 INFO:tasks.workunit.client.0.smithi067.stdout:8/454: dwrite d0/d2/dc/d28/f81 [0,4194304] 0 2024-08-31T05:21:22.208 INFO:tasks.workunit.client.0.smithi067.stdout:4/314: rmdir d4/d1e/d53 39 2024-08-31T05:21:22.209 INFO:tasks.workunit.client.0.smithi067.stdout:6/635: getdents d1b/d40/d70/dd0 0 2024-08-31T05:21:22.218 INFO:tasks.workunit.client.0.smithi067.stdout:8/455: dwrite d0/d2/da/dd/f6a [0,4194304] 0 2024-08-31T05:21:22.219 INFO:tasks.workunit.client.0.smithi067.stdout:6/636: write d1b/d23/d2e/d3b/f48 [2281966,40126] 0 2024-08-31T05:21:22.219 INFO:tasks.workunit.client.0.smithi067.stdout:6/637: stat f9 0 2024-08-31T05:21:22.221 INFO:tasks.workunit.client.0.smithi067.stdout:4/315: link d4/d1e/d21/c2d d4/d1e/d53/c73 0 2024-08-31T05:21:22.222 INFO:tasks.workunit.client.0.smithi067.stdout:4/316: dread - d4/d1e/f6f zero size 2024-08-31T05:21:22.225 INFO:tasks.workunit.client.0.smithi067.stdout:6/638: mknod d1b/d40/d96/db3/cd4 0 2024-08-31T05:21:22.229 INFO:tasks.workunit.client.0.smithi067.stdout:6/639: unlink d1b/d40/d70/dd0/da4/lc9 0 2024-08-31T05:21:22.232 INFO:tasks.workunit.client.0.smithi067.stdout:8/456: write d0/d2/da/f57 [1135614,101062] 0 2024-08-31T05:21:22.233 INFO:tasks.workunit.client.0.smithi067.stdout:6/640: mknod d1b/d40/d96/db6/cd5 0 2024-08-31T05:21:22.233 INFO:tasks.workunit.client.0.smithi067.stdout:8/457: chown d0/d4/f71 276 1 2024-08-31T05:21:22.235 INFO:tasks.workunit.client.0.smithi067.stdout:6/641: truncate f19 1345636 0 2024-08-31T05:21:22.237 INFO:tasks.workunit.client.0.smithi067.stdout:4/317: getdents d4/d1e/d21/d60 0 2024-08-31T05:21:22.240 INFO:tasks.workunit.client.0.smithi067.stdout:8/458: link d0/d2/f24 d0/d2/d6/d8c/f9b 0 2024-08-31T05:21:22.240 INFO:tasks.workunit.client.0.smithi067.stdout:4/318: write d4/d1f/f72 [1016212,33141] 0 2024-08-31T05:21:22.245 INFO:tasks.workunit.client.0.smithi067.stdout:8/459: dread d0/d2/da/dd/f6a [0,4194304] 0 2024-08-31T05:21:22.247 INFO:tasks.workunit.client.0.smithi067.stdout:4/319: dread d4/d1f/f44 [0,4194304] 0 2024-08-31T05:21:22.247 INFO:tasks.workunit.client.0.smithi067.stdout:4/320: stat d4/d9/le 0 2024-08-31T05:21:22.250 INFO:tasks.workunit.client.0.smithi067.stdout:6/642: truncate d1b/d7a/f9a 583007 0 2024-08-31T05:21:22.251 INFO:tasks.workunit.client.0.smithi067.stdout:8/460: creat d0/d75/d99/f9c x:0 0 0 2024-08-31T05:21:22.252 INFO:tasks.workunit.client.0.smithi067.stdout:8/461: read - d0/d4/de/d1d/d2c/f8a zero size 2024-08-31T05:21:22.253 INFO:tasks.workunit.client.0.smithi067.stdout:8/462: chown d0/l1 1078 1 2024-08-31T05:21:22.254 INFO:tasks.workunit.client.0.smithi067.stdout:6/643: stat d1b/d40/d70/d71/dae/cb4 0 2024-08-31T05:21:22.255 INFO:tasks.workunit.client.0.smithi067.stdout:4/321: creat d4/d9/d5a/f74 x:0 0 0 2024-08-31T05:21:22.259 INFO:tasks.workunit.client.0.smithi067.stdout:4/322: mknod d4/d14/d48/d66/c75 0 2024-08-31T05:21:22.262 INFO:tasks.workunit.client.0.smithi067.stdout:4/323: creat d4/f76 x:0 0 0 2024-08-31T05:21:22.272 INFO:tasks.workunit.client.0.smithi067.stdout:8/463: dwrite d0/d2/dc/d28/d7e/f69 [4194304,4194304] 0 2024-08-31T05:21:22.275 INFO:tasks.workunit.client.0.smithi067.stdout:8/464: unlink d0/d4/de/d1d/d2c/c7f 0 2024-08-31T05:21:22.276 INFO:tasks.workunit.client.0.smithi067.stdout:8/465: rmdir d0/d4/de/d1d/d2c/d3c 39 2024-08-31T05:21:22.281 INFO:tasks.workunit.client.0.smithi067.stdout:8/466: link d0/d4/d64/l82 d0/d2/dc/d3d/l9d 0 2024-08-31T05:21:22.472 INFO:tasks.workunit.client.0.smithi067.stdout:2/479: sync 2024-08-31T05:21:22.472 INFO:tasks.workunit.client.0.smithi067.stdout:9/395: sync 2024-08-31T05:21:22.479 INFO:tasks.workunit.client.0.smithi067.stdout:9/396: dwrite dd/df/d25/d3b/d50/f65 [0,4194304] 0 2024-08-31T05:21:22.481 INFO:tasks.workunit.client.0.smithi067.stdout:2/480: mknod db/d12/d1a/d2b/d3d/d69/d3b/d82/c92 0 2024-08-31T05:21:22.487 INFO:tasks.workunit.client.0.smithi067.stdout:9/397: mknod dd/df/d25/c80 0 2024-08-31T05:21:22.494 INFO:tasks.workunit.client.0.smithi067.stdout:9/398: creat dd/df/d25/d59/f81 x:0 0 0 2024-08-31T05:21:22.496 INFO:tasks.workunit.client.0.smithi067.stdout:9/399: dread dd/df/d25/f2c [4194304,4194304] 0 2024-08-31T05:21:22.497 INFO:tasks.workunit.client.0.smithi067.stdout:9/400: chown dd/df/d25/d3b/f52 477 1 2024-08-31T05:21:22.498 INFO:tasks.workunit.client.0.smithi067.stdout:9/401: write dd/df/d3c/f51 [966094,35214] 0 2024-08-31T05:21:22.499 INFO:tasks.workunit.client.0.smithi067.stdout:9/402: chown dd/df/c6d 247539 1 2024-08-31T05:21:22.500 INFO:tasks.workunit.client.0.smithi067.stdout:2/481: link db/dd/d2d/f41 db/d12/d1a/d1e/f93 0 2024-08-31T05:21:22.500 INFO:tasks.workunit.client.0.smithi067.stdout:9/403: chown fa 736492 1 2024-08-31T05:21:22.504 INFO:tasks.workunit.client.0.smithi067.stdout:9/404: dread dd/df/f43 [0,4194304] 0 2024-08-31T05:21:22.505 INFO:tasks.workunit.client.0.smithi067.stdout:9/405: chown dd/df/d25/d59/l76 1125 1 2024-08-31T05:21:22.507 INFO:tasks.workunit.client.0.smithi067.stdout:2/482: rename db/dd/d13/f28 to db/d12/d1a/d1e/d4d/f94 0 2024-08-31T05:21:22.508 INFO:tasks.workunit.client.0.smithi067.stdout:2/483: truncate db/d12/d1a/d1e/f2f 2118028 0 2024-08-31T05:21:22.513 INFO:tasks.workunit.client.0.smithi067.stdout:9/406: symlink dd/d20/l82 0 2024-08-31T05:21:22.517 INFO:tasks.workunit.client.0.smithi067.stdout:2/484: unlink db/dd/d2d/f8b 0 2024-08-31T05:21:22.520 INFO:tasks.workunit.client.0.smithi067.stdout:9/407: dwrite dd/df/f27 [0,4194304] 0 2024-08-31T05:21:22.524 INFO:tasks.workunit.client.0.smithi067.stdout:9/408: creat dd/df/d5b/f83 x:0 0 0 2024-08-31T05:21:22.527 INFO:tasks.workunit.client.0.smithi067.stdout:2/485: dwrite db/d12/d1a/d1e/d4d/f94 [4194304,4194304] 0 2024-08-31T05:21:22.527 INFO:tasks.workunit.client.0.smithi067.stdout:9/409: creat dd/df/d3c/f84 x:0 0 0 2024-08-31T05:21:22.530 INFO:tasks.workunit.client.0.smithi067.stdout:9/410: read dd/df/d25/d3b/d50/f65 [458608,45821] 0 2024-08-31T05:21:22.531 INFO:tasks.workunit.client.0.smithi067.stdout:9/411: fdatasync dd/df/d3c/f84 0 2024-08-31T05:21:22.533 INFO:tasks.workunit.client.0.smithi067.stdout:2/486: creat db/dd/d2d/f95 x:0 0 0 2024-08-31T05:21:22.542 INFO:tasks.workunit.client.0.smithi067.stdout:9/412: creat dd/d63/d72/f85 x:0 0 0 2024-08-31T05:21:22.543 INFO:tasks.workunit.client.0.smithi067.stdout:2/487: creat db/d12/d1a/f96 x:0 0 0 2024-08-31T05:21:22.547 INFO:tasks.workunit.client.0.smithi067.stdout:2/488: symlink db/d12/d1a/d2b/d3d/d69/d3b/l97 0 2024-08-31T05:21:22.553 INFO:tasks.workunit.client.0.smithi067.stdout:9/413: link dd/df/f2e dd/df/d25/d3b/d50/d73/f86 0 2024-08-31T05:21:22.553 INFO:tasks.workunit.client.0.smithi067.stdout:2/489: truncate db/ff 921148 0 2024-08-31T05:21:22.553 INFO:tasks.workunit.client.0.smithi067.stdout:9/414: dread dd/df/f12 [0,4194304] 0 2024-08-31T05:21:22.554 INFO:tasks.workunit.client.0.smithi067.stdout:2/490: dread - db/d12/d1a/d2b/d3d/d69/d3b/f78 zero size 2024-08-31T05:21:22.554 INFO:tasks.workunit.client.0.smithi067.stdout:9/415: dread - dd/df/d3c/f84 zero size 2024-08-31T05:21:22.557 INFO:tasks.workunit.client.0.smithi067.stdout:9/416: rmdir dd/d63 39 2024-08-31T05:21:22.559 INFO:tasks.workunit.client.0.smithi067.stdout:9/417: mknod dd/df/d25/d3b/d50/c87 0 2024-08-31T05:21:22.563 INFO:tasks.workunit.client.0.smithi067.stdout:9/418: rename dd/f22 to dd/d63/f88 0 2024-08-31T05:21:22.565 INFO:tasks.workunit.client.0.smithi067.stdout:9/419: creat dd/df/d5b/d5d/f89 x:0 0 0 2024-08-31T05:21:22.567 INFO:tasks.workunit.client.0.smithi067.stdout:9/420: rmdir dd/df/d25/d3b 39 2024-08-31T05:21:22.577 INFO:tasks.workunit.client.0.smithi067.stdout:9/421: write dd/df/f1f [350499,83829] 0 2024-08-31T05:21:22.577 INFO:tasks.workunit.client.0.smithi067.stdout:9/422: read dd/f1a [304427,65206] 0 2024-08-31T05:21:22.579 INFO:tasks.workunit.client.0.smithi067.stdout:9/423: write dd/d4d/f60 [5606170,28106] 0 2024-08-31T05:21:22.582 INFO:tasks.workunit.client.0.smithi067.stdout:9/424: chown dd/l19 820648658 1 2024-08-31T05:21:22.588 INFO:tasks.workunit.client.0.smithi067.stdout:9/425: dwrite f7 [0,4194304] 0 2024-08-31T05:21:22.596 INFO:tasks.workunit.client.0.smithi067.stdout:9/426: link dd/d63/c7c dd/df/d25/c8a 0 2024-08-31T05:21:22.598 INFO:tasks.workunit.client.0.smithi067.stdout:9/427: read dd/d20/f55 [67138,61653] 0 2024-08-31T05:21:22.602 INFO:tasks.workunit.client.0.smithi067.stdout:9/428: mknod dd/df/d25/c8b 0 2024-08-31T05:21:22.604 INFO:tasks.workunit.client.0.smithi067.stdout:9/429: creat dd/df/d25/d59/f8c x:0 0 0 2024-08-31T05:21:22.608 INFO:tasks.workunit.client.0.smithi067.stdout:9/430: rmdir dd/df/d25/d3b 39 2024-08-31T05:21:22.608 INFO:tasks.workunit.client.0.smithi067.stdout:9/431: chown dd/df/f11 193734 1 2024-08-31T05:21:22.611 INFO:tasks.workunit.client.0.smithi067.stdout:9/432: symlink dd/d63/l8d 0 2024-08-31T05:21:22.613 INFO:tasks.workunit.client.0.smithi067.stdout:9/433: mkdir dd/df/d8e 0 2024-08-31T05:21:22.630 INFO:tasks.workunit.client.0.smithi067.stdout:9/434: write dd/d20/f2f [881897,17080] 0 2024-08-31T05:21:22.630 INFO:tasks.workunit.client.0.smithi067.stdout:9/435: chown dd/df/d25/f6c 0 1 2024-08-31T05:21:22.636 INFO:tasks.workunit.client.0.smithi067.stdout:9/436: creat dd/df/d25/f8f x:0 0 0 2024-08-31T05:21:22.637 INFO:tasks.workunit.client.0.smithi067.stdout:9/437: truncate f7 4568826 0 2024-08-31T05:21:22.638 INFO:tasks.workunit.client.0.smithi067.stdout:9/438: fdatasync dd/df/d25/f6c 0 2024-08-31T05:21:22.643 INFO:tasks.workunit.client.0.smithi067.stdout:9/439: creat dd/df/d25/d3b/d50/f90 x:0 0 0 2024-08-31T05:21:22.646 INFO:tasks.workunit.client.0.smithi067.stdout:9/440: getdents dd/d4d 0 2024-08-31T05:21:22.647 INFO:tasks.workunit.client.0.smithi067.stdout:9/441: chown dd/d20/l82 684486976 1 2024-08-31T05:21:22.647 INFO:tasks.workunit.client.0.smithi067.stdout:9/442: stat dd/df/f2e 0 2024-08-31T05:21:22.650 INFO:tasks.workunit.client.0.smithi067.stdout:9/443: symlink dd/df/d25/l91 0 2024-08-31T05:21:22.651 INFO:tasks.workunit.client.0.smithi067.stdout:9/444: symlink dd/df/d5b/l92 0 2024-08-31T05:21:22.653 INFO:tasks.workunit.client.0.smithi067.stdout:9/445: symlink dd/d63/d72/l93 0 2024-08-31T05:21:22.655 INFO:tasks.workunit.client.0.smithi067.stdout:9/446: mkdir dd/df/d8e/d94 0 2024-08-31T05:21:22.660 INFO:tasks.workunit.client.0.smithi067.stdout:9/447: link dd/df/d25/d59/c7e dd/d63/d72/c95 0 2024-08-31T05:21:22.662 INFO:tasks.workunit.client.0.smithi067.stdout:1/318: sync 2024-08-31T05:21:22.663 INFO:tasks.workunit.client.0.smithi067.stdout:9/448: dread dd/f1a [0,4194304] 0 2024-08-31T05:21:22.667 INFO:tasks.workunit.client.0.smithi067.stdout:9/449: rename dd/d63/l8d to dd/d63/d72/l96 0 2024-08-31T05:21:22.669 INFO:tasks.workunit.client.0.smithi067.stdout:9/450: truncate dd/df/d25/d3b/f3e 252501 0 2024-08-31T05:21:22.669 INFO:tasks.workunit.client.0.smithi067.stdout:9/451: read - dd/df/f69 zero size 2024-08-31T05:21:22.671 INFO:tasks.workunit.client.0.smithi067.stdout:9/452: chown dd/df/d25/d3b/d50/d73/l79 14267916 1 2024-08-31T05:21:22.675 INFO:tasks.workunit.client.0.smithi067.stdout:9/453: creat dd/df/d25/d3b/f97 x:0 0 0 2024-08-31T05:21:22.681 INFO:tasks.workunit.client.0.smithi067.stdout:9/454: dwrite dd/f42 [0,4194304] 0 2024-08-31T05:21:22.688 INFO:tasks.workunit.client.0.smithi067.stdout:1/319: dwrite d3/dd/f4e [0,4194304] 0 2024-08-31T05:21:22.689 INFO:tasks.workunit.client.0.smithi067.stdout:1/320: chown d3/dd/f4e 163 1 2024-08-31T05:21:22.698 INFO:tasks.workunit.client.0.smithi067.stdout:1/321: truncate d3/f55 163744 0 2024-08-31T05:21:22.699 INFO:tasks.workunit.client.0.smithi067.stdout:9/455: dwrite dd/df/f2e [0,4194304] 0 2024-08-31T05:21:22.704 INFO:tasks.workunit.client.0.smithi067.stdout:1/322: creat d3/d23/d2d/d2e/d34/d66/d72/f77 x:0 0 0 2024-08-31T05:21:22.704 INFO:tasks.workunit.client.0.smithi067.stdout:1/323: chown d3/dd/f51 116322 1 2024-08-31T05:21:22.706 INFO:tasks.workunit.client.0.smithi067.stdout:9/456: mkdir dd/df/d25/d59/d98 0 2024-08-31T05:21:22.707 INFO:tasks.workunit.client.0.smithi067.stdout:1/324: symlink d3/l78 0 2024-08-31T05:21:22.709 INFO:tasks.workunit.client.0.smithi067.stdout:9/457: truncate dd/df/d25/d3b/d50/f90 235689 0 2024-08-31T05:21:22.713 INFO:tasks.workunit.client.0.smithi067.stdout:0/497: sync 2024-08-31T05:21:22.713 INFO:tasks.workunit.client.0.smithi067.stdout:7/355: sync 2024-08-31T05:21:22.713 INFO:tasks.workunit.client.0.smithi067.stdout:6/644: sync 2024-08-31T05:21:22.713 INFO:tasks.workunit.client.0.smithi067.stdout:5/463: sync 2024-08-31T05:21:22.713 INFO:tasks.workunit.client.0.smithi067.stdout:3/528: sync 2024-08-31T05:21:22.713 INFO:tasks.workunit.client.0.smithi067.stdout:4/324: sync 2024-08-31T05:21:22.714 INFO:tasks.workunit.client.0.smithi067.stdout:2/491: sync 2024-08-31T05:21:22.714 INFO:tasks.workunit.client.0.smithi067.stdout:8/467: sync 2024-08-31T05:21:22.716 INFO:tasks.workunit.client.0.smithi067.stdout:9/458: creat dd/df/d5b/d5d/f99 x:0 0 0 2024-08-31T05:21:22.717 INFO:tasks.workunit.client.0.smithi067.stdout:6/645: truncate d1b/d8e/f79 4894606 0 2024-08-31T05:21:22.722 INFO:tasks.workunit.client.0.smithi067.stdout:6/646: dread - d1b/d40/f98 zero size 2024-08-31T05:21:22.725 INFO:tasks.workunit.client.0.smithi067.stdout:6/647: stat d1b 0 2024-08-31T05:21:22.729 INFO:tasks.workunit.client.0.smithi067.stdout:5/464: fdatasync db/f1b 0 2024-08-31T05:21:22.731 INFO:tasks.workunit.client.0.smithi067.stdout:9/459: dread dd/f1a [0,4194304] 0 2024-08-31T05:21:22.736 INFO:tasks.workunit.client.0.smithi067.stdout:2/492: dwrite db/dd/f4c [0,4194304] 0 2024-08-31T05:21:22.736 INFO:tasks.workunit.client.0.smithi067.stdout:9/460: readlink dd/d20/l6a 0 2024-08-31T05:21:22.740 INFO:tasks.workunit.client.0.smithi067.stdout:3/529: dwrite db/d17/d3f/d54/fa6 [0,4194304] 0 2024-08-31T05:21:22.744 INFO:tasks.workunit.client.0.smithi067.stdout:8/468: dwrite d0/d75/d99/f9c [0,4194304] 0 2024-08-31T05:21:22.746 INFO:tasks.workunit.client.0.smithi067.stdout:1/325: dwrite d3/dd/f2c [0,4194304] 0 2024-08-31T05:21:22.747 INFO:tasks.workunit.client.0.smithi067.stdout:0/498: truncate d1/df/d17/d43/f64 607898 0 2024-08-31T05:21:22.747 INFO:tasks.workunit.client.0.smithi067.stdout:6/648: mknod d1b/d40/d96/db3/cd6 0 2024-08-31T05:21:22.758 INFO:tasks.workunit.client.0.smithi067.stdout:6/649: creat d1b/d7a/fd7 x:0 0 0 2024-08-31T05:21:22.758 INFO:tasks.workunit.client.0.smithi067.stdout:9/461: read dd/df/d25/d3b/d50/f90 [207085,112573] 0 2024-08-31T05:21:22.758 INFO:tasks.workunit.client.0.smithi067.stdout:1/326: mkdir d3/d23/d79 0 2024-08-31T05:21:22.758 INFO:tasks.workunit.client.0.smithi067.stdout:4/325: dwrite d4/d14/d48/f6e [0,4194304] 0 2024-08-31T05:21:22.759 INFO:tasks.workunit.client.0.smithi067.stdout:3/530: creat db/d2e/d50/d62/fad x:0 0 0 2024-08-31T05:21:22.763 INFO:tasks.workunit.client.0.smithi067.stdout:1/327: read d3/f5 [4186645,935] 0 2024-08-31T05:21:22.766 INFO:tasks.workunit.client.0.smithi067.stdout:1/328: chown d3/d23/d2d/d2e/f37 137 1 2024-08-31T05:21:22.767 INFO:tasks.workunit.client.0.smithi067.stdout:8/469: dwrite d0/d4/f7d [0,4194304] 0 2024-08-31T05:21:22.769 INFO:tasks.workunit.client.0.smithi067.stdout:9/462: dwrite f7 [4194304,4194304] 0 2024-08-31T05:21:22.769 INFO:tasks.workunit.client.0.smithi067.stdout:1/329: readlink d3/d23/l32 0 2024-08-31T05:21:22.770 INFO:tasks.workunit.client.0.smithi067.stdout:9/463: stat dd/df/d3c/f84 0 2024-08-31T05:21:22.770 INFO:tasks.workunit.client.0.smithi067.stdout:6/650: symlink d1b/d40/d70/d71/dae/ld8 0 2024-08-31T05:21:22.774 INFO:tasks.workunit.client.0.smithi067.stdout:3/531: write db/f3d [291682,75504] 0 2024-08-31T05:21:22.774 INFO:tasks.workunit.client.0.smithi067.stdout:5/465: link db/f19 db/d26/d29/f99 0 2024-08-31T05:21:22.775 INFO:tasks.workunit.client.0.smithi067.stdout:4/326: symlink d4/d1e/d53/l77 0 2024-08-31T05:21:22.776 INFO:tasks.workunit.client.0.smithi067.stdout:5/466: write db/f25 [3734247,47016] 0 2024-08-31T05:21:22.778 INFO:tasks.workunit.client.0.smithi067.stdout:8/470: rename d0/d4/de/l4d to d0/d2/da/l9e 0 2024-08-31T05:21:22.782 INFO:tasks.workunit.client.0.smithi067.stdout:4/327: dread - d4/d42/f50 zero size 2024-08-31T05:21:22.783 INFO:tasks.workunit.client.0.smithi067.stdout:9/464: link dd/f10 dd/df/f9a 0 2024-08-31T05:21:22.783 INFO:tasks.workunit.client.0.smithi067.stdout:5/467: dread db/d26/d60/f71 [0,4194304] 0 2024-08-31T05:21:22.787 INFO:tasks.workunit.client.0.smithi067.stdout:9/465: write dd/df/f1f [258889,113440] 0 2024-08-31T05:21:22.787 INFO:tasks.workunit.client.0.smithi067.stdout:5/468: symlink db/d1d/l9a 0 2024-08-31T05:21:22.788 INFO:tasks.workunit.client.0.smithi067.stdout:6/651: dwrite d1b/d23/d2e/d3b/f9d [0,4194304] 0 2024-08-31T05:21:22.789 INFO:tasks.workunit.client.0.smithi067.stdout:8/471: getdents d0/d2/dc/d28/d7e/d73 0 2024-08-31T05:21:22.791 INFO:tasks.workunit.client.0.smithi067.stdout:4/328: symlink d4/d1e/d21/d60/l78 0 2024-08-31T05:21:22.791 INFO:tasks.workunit.client.0.smithi067.stdout:5/469: fdatasync db/d26/d29/d31/f97 0 2024-08-31T05:21:22.793 INFO:tasks.workunit.client.0.smithi067.stdout:8/472: mknod d0/d2/da/dd/c9f 0 2024-08-31T05:21:22.795 INFO:tasks.workunit.client.0.smithi067.stdout:9/466: creat dd/f9b x:0 0 0 2024-08-31T05:21:22.797 INFO:tasks.workunit.client.0.smithi067.stdout:5/470: fsync db/d26/d29/d31/f97 0 2024-08-31T05:21:22.798 INFO:tasks.workunit.client.0.smithi067.stdout:4/329: unlink d4/c17 0 2024-08-31T05:21:22.800 INFO:tasks.workunit.client.0.smithi067.stdout:8/473: fsync d0/d2/dc/f16 0 2024-08-31T05:21:22.801 INFO:tasks.workunit.client.0.smithi067.stdout:5/471: write db/d26/d29/d31/f48 [331187,131012] 0 2024-08-31T05:21:22.876 INFO:tasks.workunit.client.0.smithi067.stdout:9/467: dwrite dd/d4d/f4f [0,4194304] 0 2024-08-31T05:21:22.878 INFO:tasks.workunit.client.0.smithi067.stdout:7/356: truncate d14/d16/d28/d2e/f38 710403 0 2024-08-31T05:21:22.878 INFO:tasks.workunit.client.0.smithi067.stdout:3/532: dread db/d12/f58 [0,4194304] 0 2024-08-31T05:21:22.882 INFO:tasks.workunit.client.0.smithi067.stdout:2/493: write db/ff [1439040,68662] 0 2024-08-31T05:21:22.887 INFO:tasks.workunit.client.0.smithi067.stdout:5/472: dwrite db/d1d/d3a/f43 [0,4194304] 0 2024-08-31T05:21:22.889 INFO:tasks.workunit.client.0.smithi067.stdout:3/533: write db/d17/d3f/d54/d56/d6e/f75 [927144,112378] 0 2024-08-31T05:21:22.890 INFO:tasks.workunit.client.0.smithi067.stdout:1/330: dread d3/f74 [0,4194304] 0 2024-08-31T05:21:22.890 INFO:tasks.workunit.client.0.smithi067.stdout:8/474: dwrite d0/d2/dc/d3d/f5d [0,4194304] 0 2024-08-31T05:21:22.904 INFO:tasks.workunit.client.0.smithi067.stdout:4/330: write d4/d9/fa [7187146,80034] 0 2024-08-31T05:21:22.905 INFO:tasks.workunit.client.0.smithi067.stdout:9/468: dwrite dd/df/d25/f6c [0,4194304] 0 2024-08-31T05:21:22.905 INFO:tasks.workunit.client.0.smithi067.stdout:0/499: stat d1/dd/f7e 0 2024-08-31T05:21:22.906 INFO:tasks.workunit.client.0.smithi067.stdout:7/357: stat d14/l21 0 2024-08-31T05:21:22.906 INFO:tasks.workunit.client.0.smithi067.stdout:2/494: fdatasync db/d12/d1a/d1e/f21 0 2024-08-31T05:21:22.908 INFO:tasks.workunit.client.0.smithi067.stdout:0/500: stat d1/df/d17/f4f 0 2024-08-31T05:21:22.952 INFO:tasks.workunit.client.0.smithi067.stdout:4/331: chown d4/d14/l2f 2 1 2024-08-31T05:21:22.954 INFO:tasks.workunit.client.0.smithi067.stdout:0/501: dread - d1/dd/d18/f60 zero size 2024-08-31T05:21:22.955 INFO:tasks.workunit.client.0.smithi067.stdout:4/332: write d4/d14/f4a [93023,76043] 0 2024-08-31T05:21:22.956 INFO:tasks.workunit.client.0.smithi067.stdout:3/534: dwrite db/d17/d3f/d54/d56/f96 [0,4194304] 0 2024-08-31T05:21:22.987 INFO:tasks.workunit.client.0.smithi067.stdout:3/535: dread db/f3d [0,4194304] 0 2024-08-31T05:21:22.988 INFO:tasks.workunit.client.0.smithi067.stdout:3/536: readlink db/le 0 2024-08-31T05:21:22.997 INFO:tasks.workunit.client.0.smithi067.stdout:7/358: truncate d14/f51 661104 0 2024-08-31T05:21:22.997 INFO:tasks.workunit.client.0.smithi067.stdout:9/469: fdatasync dd/df/f9a 0 2024-08-31T05:21:23.003 INFO:tasks.workunit.client.0.smithi067.stdout:1/331: dwrite d3/f13 [0,4194304] 0 2024-08-31T05:21:23.015 INFO:tasks.workunit.client.0.smithi067.stdout:8/475: rename d0/d2/da/dd/d1f/l2e to d0/d4/de/d1d/d7b/la0 0 2024-08-31T05:21:23.016 INFO:tasks.workunit.client.0.smithi067.stdout:8/476: stat d0/d4/f71 0 2024-08-31T05:21:23.019 INFO:tasks.workunit.client.0.smithi067.stdout:5/473: link db/d26/d29/d31/f48 db/d26/f9b 0 2024-08-31T05:21:23.020 INFO:tasks.workunit.client.0.smithi067.stdout:5/474: write db/d1d/d4f/f72 [4493570,21479] 0 2024-08-31T05:21:23.022 INFO:tasks.workunit.client.0.smithi067.stdout:2/495: symlink db/d12/d1a/d2b/d42/d62/l98 0 2024-08-31T05:21:23.028 INFO:tasks.workunit.client.0.smithi067.stdout:9/470: dread dd/d4d/f60 [0,4194304] 0 2024-08-31T05:21:23.041 INFO:tasks.workunit.client.0.smithi067.stdout:1/332: mknod d3/d23/d2d/d2e/d34/d66/c7a 0 2024-08-31T05:21:23.042 INFO:tasks.workunit.client.0.smithi067.stdout:1/333: stat d3/dd/c22 0 2024-08-31T05:21:23.042 INFO:tasks.workunit.client.0.smithi067.stdout:8/477: readlink d0/d2/dc/l13 0 2024-08-31T05:21:23.046 INFO:tasks.workunit.client.0.smithi067.stdout:9/471: dread dd/df/f24 [0,4194304] 0 2024-08-31T05:21:23.048 INFO:tasks.workunit.client.0.smithi067.stdout:2/496: mkdir db/d12/d1a/d2b/d3d/d69/d3b/d99 0 2024-08-31T05:21:23.049 INFO:tasks.workunit.client.0.smithi067.stdout:2/497: write db/d12/d1a/d2b/d40/f4a [603708,25987] 0 2024-08-31T05:21:23.053 INFO:tasks.workunit.client.0.smithi067.stdout:0/502: truncate d1/d50/f6c 1297353 0 2024-08-31T05:21:23.053 INFO:tasks.workunit.client.0.smithi067.stdout:7/359: rmdir d14/d3e 39 2024-08-31T05:21:23.056 INFO:tasks.workunit.client.0.smithi067.stdout:1/334: symlink d3/d23/d5d/l7b 0 2024-08-31T05:21:23.059 INFO:tasks.workunit.client.0.smithi067.stdout:8/478: symlink d0/d2/dc/d28/d7e/d73/d84/la1 0 2024-08-31T05:21:23.063 INFO:tasks.workunit.client.0.smithi067.stdout:9/472: read dd/df/f23 [1383085,58070] 0 2024-08-31T05:21:23.064 INFO:tasks.workunit.client.0.smithi067.stdout:4/333: link d4/d1e/f6f d4/d13/f79 0 2024-08-31T05:21:23.065 INFO:tasks.workunit.client.0.smithi067.stdout:8/479: dwrite d0/f96 [0,4194304] 0 2024-08-31T05:21:23.067 INFO:tasks.workunit.client.0.smithi067.stdout:2/498: fsync db/d12/d1a/f36 0 2024-08-31T05:21:23.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:22 smithi067 ceph-mon[17432]: pgmap v32: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 70 MiB/s rd, 216 MiB/s wr, 440 op/s 2024-08-31T05:21:23.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:22 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:23.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:22 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:23.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:22 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:21:23.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:22 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:21:23.077 INFO:tasks.workunit.client.0.smithi067.stdout:7/360: symlink d14/d16/d5b/d64/l65 0 2024-08-31T05:21:23.078 INFO:tasks.workunit.client.0.smithi067.stdout:1/335: mkdir d3/d23/d5d/d7c 0 2024-08-31T05:21:23.079 INFO:tasks.workunit.client.0.smithi067.stdout:1/336: chown d3/f14 3 1 2024-08-31T05:21:23.086 INFO:tasks.workunit.client.0.smithi067.stdout:1/337: dwrite d3/d36/f65 [0,4194304] 0 2024-08-31T05:21:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:2/499: truncate db/f5b 1391907 0 2024-08-31T05:21:23.089 INFO:tasks.workunit.client.0.smithi067.stdout:1/338: truncate d3/d23/d2d/d2e/f5b 464248 0 2024-08-31T05:21:23.094 INFO:tasks.workunit.client.0.smithi067.stdout:5/475: getdents db/d26/d29/d31/d54/d66 0 2024-08-31T05:21:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:4/334: mkdir d4/d1e/d7a 0 2024-08-31T05:21:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:7/361: dwrite d14/f18 [4194304,4194304] 0 2024-08-31T05:21:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:4/335: truncate d4/d14/f65 853036 0 2024-08-31T05:21:23.104 INFO:tasks.workunit.client.0.smithi067.stdout:8/480: creat d0/d2/dc/d3d/d52/d6b/fa2 x:0 0 0 2024-08-31T05:21:23.106 INFO:tasks.workunit.client.0.smithi067.stdout:8/481: write d0/d4/de/d1d/d2c/f55 [4433081,20481] 0 2024-08-31T05:21:23.109 INFO:tasks.workunit.client.0.smithi067.stdout:0/503: link d1/d8/f33 d1/df/d17/d43/d80/f9f 0 2024-08-31T05:21:23.115 INFO:tasks.workunit.client.0.smithi067.stdout:5/476: chown db/c34 21 1 2024-08-31T05:21:23.121 INFO:tasks.workunit.client.0.smithi067.stdout:8/482: mkdir d0/d2/dc/d28/d7e/da3 0 2024-08-31T05:21:23.123 INFO:tasks.workunit.client.0.smithi067.stdout:1/339: mknod d3/d23/d79/c7d 0 2024-08-31T05:21:23.125 INFO:tasks.workunit.client.0.smithi067.stdout:0/504: creat d1/dd/d18/fa0 x:0 0 0 2024-08-31T05:21:23.127 INFO:tasks.workunit.client.0.smithi067.stdout:5/477: symlink db/d26/d29/d31/d54/l9c 0 2024-08-31T05:21:23.131 INFO:tasks.workunit.client.0.smithi067.stdout:9/473: link dd/d4d/l78 dd/df/d5b/d5d/d7a/l9c 0 2024-08-31T05:21:23.133 INFO:tasks.workunit.client.0.smithi067.stdout:0/505: dwrite d1/dd/d18/f9a [0,4194304] 0 2024-08-31T05:21:23.146 INFO:tasks.workunit.client.0.smithi067.stdout:8/483: link d0/d2/dc/d3d/d52/d6b/fa2 d0/d4/d64/fa4 0 2024-08-31T05:21:23.147 INFO:tasks.workunit.client.0.smithi067.stdout:0/506: fdatasync d1/d50/f6c 0 2024-08-31T05:21:23.156 INFO:tasks.workunit.client.0.smithi067.stdout:0/507: unlink d1/f2c 0 2024-08-31T05:21:23.160 INFO:tasks.workunit.client.0.smithi067.stdout:8/484: rename d0/d75 to d0/d4/de/d1d/d2c/d3c/da5 0 2024-08-31T05:21:23.160 INFO:tasks.workunit.client.0.smithi067.stdout:8/485: chown d0/d2/dc/d3d/c4b 367050208 1 2024-08-31T05:21:23.162 INFO:tasks.workunit.client.0.smithi067.stdout:0/508: truncate d1/df/f6d 376408 0 2024-08-31T05:21:23.166 INFO:tasks.workunit.client.0.smithi067.stdout:0/509: mkdir d1/df/d29/da1 0 2024-08-31T05:21:23.171 INFO:tasks.workunit.client.0.smithi067.stdout:8/486: getdents d0/d2/d6/d8c 0 2024-08-31T05:21:23.175 INFO:tasks.workunit.client.0.smithi067.stdout:8/487: fsync d0/d2/da/f93 0 2024-08-31T05:21:23.192 INFO:tasks.workunit.client.0.smithi067.stdout:5/478: creat db/d1d/f9d x:0 0 0 2024-08-31T05:21:23.195 INFO:tasks.workunit.client.0.smithi067.stdout:5/479: unlink db/d15/d53/d5f/f8b 0 2024-08-31T05:21:23.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:22 smithi073 ceph-mon[24726]: pgmap v32: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 70 MiB/s rd, 216 MiB/s wr, 440 op/s 2024-08-31T05:21:23.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:22 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:23.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:22 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:23.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:22 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:21:23.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:22 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:21:23.197 INFO:tasks.workunit.client.0.smithi067.stdout:3/537: symlink db/d17/d3f/d54/d56/lae 0 2024-08-31T05:21:23.198 INFO:tasks.workunit.client.0.smithi067.stdout:3/538: write db/d2e/d50/f84 [3976525,96991] 0 2024-08-31T05:21:23.201 INFO:tasks.workunit.client.0.smithi067.stdout:3/539: chown db/d5a/l71 1 1 2024-08-31T05:21:23.202 INFO:tasks.workunit.client.0.smithi067.stdout:3/540: dread - db/d4e/f51 zero size 2024-08-31T05:21:23.205 INFO:tasks.workunit.client.0.smithi067.stdout:2/500: rmdir db/d12/d1a/d1e/d5f 39 2024-08-31T05:21:23.206 INFO:tasks.workunit.client.0.smithi067.stdout:2/501: dread - db/d12/d1a/d1e/f89 zero size 2024-08-31T05:21:23.207 INFO:tasks.workunit.client.0.smithi067.stdout:3/541: creat db/d2e/d50/faf x:0 0 0 2024-08-31T05:21:23.208 INFO:tasks.workunit.client.0.smithi067.stdout:3/542: fsync db/d2e/d50/d62/f66 0 2024-08-31T05:21:23.210 INFO:tasks.workunit.client.0.smithi067.stdout:3/543: creat db/d91/fb0 x:0 0 0 2024-08-31T05:21:23.211 INFO:tasks.workunit.client.0.smithi067.stdout:7/362: write d14/d16/f32 [969670,95824] 0 2024-08-31T05:21:23.211 INFO:tasks.workunit.client.0.smithi067.stdout:3/544: chown db/d2e/d50/d62/d85 4 1 2024-08-31T05:21:23.212 INFO:tasks.workunit.client.0.smithi067.stdout:7/363: write d14/d16/f32 [3142390,122364] 0 2024-08-31T05:21:23.213 INFO:tasks.workunit.client.0.smithi067.stdout:9/474: write fa [1111679,109450] 0 2024-08-31T05:21:23.214 INFO:tasks.workunit.client.0.smithi067.stdout:7/364: truncate d14/d16/f32 3737847 0 2024-08-31T05:21:23.215 INFO:tasks.workunit.client.0.smithi067.stdout:3/545: creat db/d2e/d50/d62/d85/fb1 x:0 0 0 2024-08-31T05:21:23.216 INFO:tasks.workunit.client.0.smithi067.stdout:8/488: getdents d0/d4/d64 0 2024-08-31T05:21:23.218 INFO:tasks.workunit.client.0.smithi067.stdout:9/475: rename fa to dd/df/d25/d59/f9d 0 2024-08-31T05:21:23.220 INFO:tasks.workunit.client.0.smithi067.stdout:7/365: creat d14/d54/f66 x:0 0 0 2024-08-31T05:21:23.222 INFO:tasks.workunit.client.0.smithi067.stdout:7/366: write fb [4475832,17363] 0 2024-08-31T05:21:23.224 INFO:tasks.workunit.client.0.smithi067.stdout:8/489: write d0/d4/de/f77 [1393817,23843] 0 2024-08-31T05:21:23.224 INFO:tasks.workunit.client.0.smithi067.stdout:3/546: dwrite db/d2e/d50/d62/d85/f92 [0,4194304] 0 2024-08-31T05:21:23.230 INFO:tasks.workunit.client.0.smithi067.stdout:8/490: mkdir d0/d2/dc/d28/d7e/d73/d84/da6 0 2024-08-31T05:21:23.231 INFO:tasks.workunit.client.0.smithi067.stdout:7/367: mkdir d14/d54/d5e/d67 0 2024-08-31T05:21:23.232 INFO:tasks.workunit.client.0.smithi067.stdout:7/368: chown d14/f18 1593589 1 2024-08-31T05:21:23.233 INFO:tasks.workunit.client.0.smithi067.stdout:3/547: mknod db/d2e/cb2 0 2024-08-31T05:21:23.234 INFO:tasks.workunit.client.0.smithi067.stdout:9/476: getdents dd/df/d8e 0 2024-08-31T05:21:23.236 INFO:tasks.workunit.client.0.smithi067.stdout:3/548: write db/f57 [4235283,33707] 0 2024-08-31T05:21:23.240 INFO:tasks.workunit.client.0.smithi067.stdout:0/510: dwrite d1/d8/f4b [4194304,4194304] 0 2024-08-31T05:21:23.241 INFO:tasks.workunit.client.0.smithi067.stdout:8/491: truncate d0/d2/da/f42 1416589 0 2024-08-31T05:21:23.244 INFO:tasks.workunit.client.0.smithi067.stdout:9/477: symlink dd/df/d8e/l9e 0 2024-08-31T05:21:23.245 INFO:tasks.workunit.client.0.smithi067.stdout:7/369: dwrite d14/d16/f42 [0,4194304] 0 2024-08-31T05:21:23.249 INFO:tasks.workunit.client.0.smithi067.stdout:3/549: mknod db/d17/d3f/d54/cb3 0 2024-08-31T05:21:23.252 INFO:tasks.workunit.client.0.smithi067.stdout:3/550: write db/f57 [4001480,17028] 0 2024-08-31T05:21:23.257 INFO:tasks.workunit.client.0.smithi067.stdout:9/478: rmdir dd/df/d25/d3b/d50/d73 39 2024-08-31T05:21:23.262 INFO:tasks.workunit.client.0.smithi067.stdout:5/480: dwrite db/f19 [0,4194304] 0 2024-08-31T05:21:23.263 INFO:tasks.workunit.client.0.smithi067.stdout:3/551: chown db/d17/d3f/d54/d56/la4 1534881312 1 2024-08-31T05:21:23.263 INFO:tasks.workunit.client.0.smithi067.stdout:7/370: dwrite d14/d16/d28/f5f [0,4194304] 0 2024-08-31T05:21:23.268 INFO:tasks.workunit.client.0.smithi067.stdout:5/481: readlink db/d26/l3f 0 2024-08-31T05:21:23.270 INFO:tasks.workunit.client.0.smithi067.stdout:0/511: dwrite d1/df/f1d [0,4194304] 0 2024-08-31T05:21:23.272 INFO:tasks.workunit.client.0.smithi067.stdout:9/479: truncate dd/df/d25/d3b/f41 2064064 0 2024-08-31T05:21:23.277 INFO:tasks.workunit.client.0.smithi067.stdout:3/552: symlink db/d17/d3f/d54/d56/lb4 0 2024-08-31T05:21:23.283 INFO:tasks.workunit.client.0.smithi067.stdout:5/482: unlink db/d1d/d4f/f52 0 2024-08-31T05:21:23.284 INFO:tasks.workunit.client.0.smithi067.stdout:3/553: dwrite db/d12/f2f [0,4194304] 0 2024-08-31T05:21:23.288 INFO:tasks.workunit.client.0.smithi067.stdout:9/480: mknod dd/df/d25/d3b/d50/c9f 0 2024-08-31T05:21:23.291 INFO:tasks.workunit.client.0.smithi067.stdout:8/492: dread d0/d4/de/d1d/d2c/d3c/f76 [0,4194304] 0 2024-08-31T05:21:23.293 INFO:tasks.workunit.client.0.smithi067.stdout:0/512: rmdir d1/df/d29/da1 0 2024-08-31T05:21:23.295 INFO:tasks.workunit.client.0.smithi067.stdout:3/554: dwrite db/d5a/f87 [4194304,4194304] 0 2024-08-31T05:21:23.296 INFO:tasks.workunit.client.0.smithi067.stdout:5/483: dwrite db/f25 [0,4194304] 0 2024-08-31T05:21:23.304 INFO:tasks.workunit.client.0.smithi067.stdout:3/555: dread db/d17/d3f/d54/d56/f96 [0,4194304] 0 2024-08-31T05:21:23.306 INFO:tasks.workunit.client.0.smithi067.stdout:8/493: rename d0/d4/de/d1d/d2c/d3c/da5/c90 to d0/d2/ca7 0 2024-08-31T05:21:23.306 INFO:tasks.workunit.client.0.smithi067.stdout:3/556: chown db/d12/d21/d82/f8a 2958 1 2024-08-31T05:21:23.306 INFO:tasks.workunit.client.0.smithi067.stdout:8/494: chown d0/d2/dc/d3d 25 1 2024-08-31T05:21:23.309 INFO:tasks.workunit.client.0.smithi067.stdout:7/371: dread d14/d16/d28/f35 [0,4194304] 0 2024-08-31T05:21:23.310 INFO:tasks.workunit.client.0.smithi067.stdout:3/557: mknod db/d2e/da1/cb5 0 2024-08-31T05:21:23.316 INFO:tasks.workunit.client.0.smithi067.stdout:8/495: unlink d0/d2/dc/d3d/l9d 0 2024-08-31T05:21:23.317 INFO:tasks.workunit.client.0.smithi067.stdout:7/372: dwrite f7 [4194304,4194304] 0 2024-08-31T05:21:23.319 INFO:tasks.workunit.client.0.smithi067.stdout:0/513: rename d1/df/f1d to d1/df/d29/d37/fa2 0 2024-08-31T05:21:23.321 INFO:tasks.workunit.client.0.smithi067.stdout:3/558: dwrite db/d12/f58 [0,4194304] 0 2024-08-31T05:21:23.324 INFO:tasks.workunit.client.0.smithi067.stdout:3/559: truncate db/d91/fb0 206528 0 2024-08-31T05:21:23.325 INFO:tasks.workunit.client.0.smithi067.stdout:3/560: dread - db/d2e/f90 zero size 2024-08-31T05:21:23.325 INFO:tasks.workunit.client.0.smithi067.stdout:3/561: chown db/d5a 15 1 2024-08-31T05:21:23.325 INFO:tasks.workunit.client.0.smithi067.stdout:3/562: chown db/d55 1080 1 2024-08-31T05:21:23.327 INFO:tasks.workunit.client.0.smithi067.stdout:8/496: creat d0/d2/da/dd/d1f/fa8 x:0 0 0 2024-08-31T05:21:23.328 INFO:tasks.workunit.client.0.smithi067.stdout:0/514: mknod d1/df/d29/d37/d6f/ca3 0 2024-08-31T05:21:23.331 INFO:tasks.workunit.client.0.smithi067.stdout:7/373: truncate d14/f15 212608 0 2024-08-31T05:21:23.333 INFO:tasks.workunit.client.0.smithi067.stdout:3/563: rmdir db/d12/d21/d82 39 2024-08-31T05:21:23.336 INFO:tasks.workunit.client.0.smithi067.stdout:8/497: dwrite d0/d4/de/d1d/d2c/d3c/da5/d99/f9c [0,4194304] 0 2024-08-31T05:21:23.337 INFO:tasks.workunit.client.0.smithi067.stdout:0/515: rename d1/d50/f9d to d1/df/d17/d94/fa4 0 2024-08-31T05:21:23.338 INFO:tasks.workunit.client.0.smithi067.stdout:0/516: stat d1/df/l2d 0 2024-08-31T05:21:23.338 INFO:tasks.workunit.client.0.smithi067.stdout:8/498: write d0/d4/de/f77 [1772829,12045] 0 2024-08-31T05:21:23.341 INFO:tasks.workunit.client.0.smithi067.stdout:7/374: mkdir d14/d16/d5b/d68 0 2024-08-31T05:21:23.341 INFO:tasks.workunit.client.0.smithi067.stdout:7/375: stat cc 0 2024-08-31T05:21:23.342 INFO:tasks.workunit.client.0.smithi067.stdout:7/376: write d14/d16/f4e [150608,40899] 0 2024-08-31T05:21:23.342 INFO:tasks.workunit.client.0.smithi067.stdout:3/564: creat db/d2e/da1/fb6 x:0 0 0 2024-08-31T05:21:23.344 INFO:tasks.workunit.client.0.smithi067.stdout:3/565: dread db/d12/d21/f26 [0,4194304] 0 2024-08-31T05:21:23.345 INFO:tasks.workunit.client.0.smithi067.stdout:0/517: creat d1/dd/d71/fa5 x:0 0 0 2024-08-31T05:21:23.346 INFO:tasks.workunit.client.0.smithi067.stdout:3/566: dread db/d91/fb0 [0,4194304] 0 2024-08-31T05:21:23.346 INFO:tasks.workunit.client.0.smithi067.stdout:8/499: mkdir d0/d2/da9 0 2024-08-31T05:21:23.348 INFO:tasks.workunit.client.0.smithi067.stdout:3/567: dread - db/d2e/d50/faf zero size 2024-08-31T05:21:23.349 INFO:tasks.workunit.client.0.smithi067.stdout:7/377: mknod d14/d16/d28/c69 0 2024-08-31T05:21:23.350 INFO:tasks.workunit.client.0.smithi067.stdout:0/518: rename d1/df/d29/d37/d6f/l85 to d1/dd/d4d/d88/la6 0 2024-08-31T05:21:23.351 INFO:tasks.workunit.client.0.smithi067.stdout:0/519: stat d1/df/d29/d37/f8c 0 2024-08-31T05:21:23.352 INFO:tasks.workunit.client.0.smithi067.stdout:7/378: dread d14/d16/f4e [0,4194304] 0 2024-08-31T05:21:23.353 INFO:tasks.workunit.client.0.smithi067.stdout:0/520: dread - d1/df/d17/d43/d48/f92 zero size 2024-08-31T05:21:23.358 INFO:tasks.workunit.client.0.smithi067.stdout:8/500: creat d0/d4/faa x:0 0 0 2024-08-31T05:21:23.361 INFO:tasks.workunit.client.0.smithi067.stdout:3/568: dwrite db/d17/d3f/d54/d56/d6e/f9a [4194304,4194304] 0 2024-08-31T05:21:23.362 INFO:tasks.workunit.client.0.smithi067.stdout:3/569: chown db/d2e/d6a/la0 65909 1 2024-08-31T05:21:23.371 INFO:tasks.workunit.client.0.smithi067.stdout:8/501: dwrite d0/d2/da/f88 [0,4194304] 0 2024-08-31T05:21:23.375 INFO:tasks.workunit.client.0.smithi067.stdout:3/570: link db/d2e/d50/d62/d85/f92 db/d2e/d50/d62/fb7 0 2024-08-31T05:21:23.381 INFO:tasks.workunit.client.0.smithi067.stdout:8/502: dwrite d0/d2/da/dd/d1f/f78 [0,4194304] 0 2024-08-31T05:21:23.389 INFO:tasks.workunit.client.0.smithi067.stdout:7/379: dread d14/d16/f22 [0,4194304] 0 2024-08-31T05:21:23.389 INFO:tasks.workunit.client.0.smithi067.stdout:3/571: getdents db/d12/d21 0 2024-08-31T05:21:23.393 INFO:tasks.workunit.client.0.smithi067.stdout:8/503: dwrite d0/d2/f6c [0,4194304] 0 2024-08-31T05:21:23.393 INFO:tasks.workunit.client.0.smithi067.stdout:7/380: read d14/d16/d28/f5f [3444905,126164] 0 2024-08-31T05:21:23.394 INFO:tasks.workunit.client.0.smithi067.stdout:0/521: dwrite d1/d8/f33 [0,4194304] 0 2024-08-31T05:21:23.398 INFO:tasks.workunit.client.0.smithi067.stdout:7/381: read d14/d16/d28/d2e/f3a [2064145,23299] 0 2024-08-31T05:21:23.403 INFO:tasks.workunit.client.0.smithi067.stdout:8/504: rename d0/d2/dc/d91 to d0/d4/de/d1d/d7b/dab 0 2024-08-31T05:21:23.403 INFO:tasks.workunit.client.0.smithi067.stdout:3/572: link db/d5a/l9c db/d12/d21/lb8 0 2024-08-31T05:21:23.404 INFO:tasks.workunit.client.0.smithi067.stdout:3/573: read db/d2e/d50/d62/fb7 [1466579,56833] 0 2024-08-31T05:21:23.406 INFO:tasks.workunit.client.0.smithi067.stdout:8/505: truncate d0/d4/de/d1d/f9a 382531 0 2024-08-31T05:21:23.412 INFO:tasks.workunit.client.0.smithi067.stdout:3/574: link db/d5a/f87 db/d55/d97/fb9 0 2024-08-31T05:21:23.412 INFO:tasks.workunit.client.0.smithi067.stdout:0/522: write d1/df/d17/d43/f91 [189894,55357] 0 2024-08-31T05:21:23.412 INFO:tasks.workunit.client.0.smithi067.stdout:8/506: getdents d0/d4/d64 0 2024-08-31T05:21:23.417 INFO:tasks.workunit.client.0.smithi067.stdout:0/523: rename d1/d8/c1a to d1/df/d17/d43/d80/ca7 0 2024-08-31T05:21:23.419 INFO:tasks.workunit.client.0.smithi067.stdout:8/507: fdatasync d0/d2/f15 0 2024-08-31T05:21:23.420 INFO:tasks.workunit.client.0.smithi067.stdout:8/508: chown d0/d2/dc/d3d/f5d 0 1 2024-08-31T05:21:23.420 INFO:tasks.workunit.client.0.smithi067.stdout:0/524: creat d1/d8/fa8 x:0 0 0 2024-08-31T05:21:23.421 INFO:tasks.workunit.client.0.smithi067.stdout:3/575: mknod db/d12/d21/cba 0 2024-08-31T05:21:23.426 INFO:tasks.workunit.client.0.smithi067.stdout:8/509: dwrite d0/d4/de/f77 [0,4194304] 0 2024-08-31T05:21:23.436 INFO:tasks.workunit.client.0.smithi067.stdout:0/525: dwrite d1/df/d29/d37/fa2 [0,4194304] 0 2024-08-31T05:21:23.438 INFO:tasks.workunit.client.0.smithi067.stdout:0/526: truncate d1/df/d29/d37/f8e 165107 0 2024-08-31T05:21:23.446 INFO:tasks.workunit.client.0.smithi067.stdout:0/527: mkdir d1/da9 0 2024-08-31T05:21:23.447 INFO:tasks.workunit.client.0.smithi067.stdout:8/510: write d0/d2/d6/d8c/f9b [259195,12316] 0 2024-08-31T05:21:23.449 INFO:tasks.workunit.client.0.smithi067.stdout:0/528: unlink d1/d8/c1e 0 2024-08-31T05:21:23.450 INFO:tasks.workunit.client.0.smithi067.stdout:3/576: truncate db/d12/d21/f26 1235407 0 2024-08-31T05:21:23.452 INFO:tasks.workunit.client.0.smithi067.stdout:0/529: mkdir d1/d50/daa 0 2024-08-31T05:21:23.453 INFO:tasks.workunit.client.0.smithi067.stdout:3/577: creat db/d55/fbb x:0 0 0 2024-08-31T05:21:23.455 INFO:tasks.workunit.client.0.smithi067.stdout:0/530: unlink d1/df/d17/d43/d48/d6a/l6e 0 2024-08-31T05:21:23.458 INFO:tasks.workunit.client.0.smithi067.stdout:0/531: symlink d1/df/d17/d43/lab 0 2024-08-31T05:21:23.461 INFO:tasks.workunit.client.0.smithi067.stdout:3/578: creat db/d12/d21/fbc x:0 0 0 2024-08-31T05:21:23.466 INFO:tasks.workunit.client.0.smithi067.stdout:0/532: dwrite d1/d8/fa8 [0,4194304] 0 2024-08-31T05:21:23.468 INFO:tasks.workunit.client.0.smithi067.stdout:3/579: rename db/d17/d3f/l49 to db/d2e/d6a/d8d/lbd 0 2024-08-31T05:21:23.468 INFO:tasks.workunit.client.0.smithi067.stdout:8/511: dread d0/d4/de/f34 [0,4194304] 0 2024-08-31T05:21:23.469 INFO:tasks.workunit.client.0.smithi067.stdout:3/580: readlink db/d17/d3f/d54/d56/lae 0 2024-08-31T05:21:23.471 INFO:tasks.workunit.client.0.smithi067.stdout:0/533: rmdir d1/d8/d66 39 2024-08-31T05:21:23.476 INFO:tasks.workunit.client.0.smithi067.stdout:3/581: rename db/d17/d3f/d54/d56/d88 to db/dbe 0 2024-08-31T05:21:23.479 INFO:tasks.workunit.client.0.smithi067.stdout:0/534: rename d1/df/d29/d37/d6f to d1/dd/d4d/d88/dac 0 2024-08-31T05:21:23.481 INFO:tasks.workunit.client.0.smithi067.stdout:3/582: creat db/d17/d3f/d54/d56/d6e/fbf x:0 0 0 2024-08-31T05:21:23.482 INFO:tasks.workunit.client.0.smithi067.stdout:0/535: creat d1/dd/d4d/fad x:0 0 0 2024-08-31T05:21:23.482 INFO:tasks.workunit.client.0.smithi067.stdout:0/536: fsync d1/dd/d4d/d88/dac/f83 0 2024-08-31T05:21:23.483 INFO:tasks.workunit.client.0.smithi067.stdout:3/583: mknod db/d2e/d50/d62/cc0 0 2024-08-31T05:21:23.486 INFO:tasks.workunit.client.0.smithi067.stdout:3/584: creat db/d2e/d50/d4a/fc1 x:0 0 0 2024-08-31T05:21:23.486 INFO:tasks.workunit.client.0.smithi067.stdout:0/537: dread d1/dd/d4d/f51 [0,4194304] 0 2024-08-31T05:21:23.488 INFO:tasks.workunit.client.0.smithi067.stdout:3/585: rename db/d55/c8b to db/d55/cc2 0 2024-08-31T05:21:23.516 INFO:tasks.workunit.client.0.smithi067.stdout:0/538: creat d1/df/d17/d43/d80/fae x:0 0 0 2024-08-31T05:21:23.516 INFO:tasks.workunit.client.0.smithi067.stdout:3/586: truncate db/d5a/f73 1031593 0 2024-08-31T05:21:23.517 INFO:tasks.workunit.client.0.smithi067.stdout:0/539: write d1/dd/d4d/fad [906281,52405] 0 2024-08-31T05:21:23.520 INFO:tasks.workunit.client.0.smithi067.stdout:3/587: mkdir db/d2e/d50/d62/dc3 0 2024-08-31T05:21:23.521 INFO:tasks.workunit.client.0.smithi067.stdout:0/540: symlink d1/d50/laf 0 2024-08-31T05:21:23.526 INFO:tasks.workunit.client.0.smithi067.stdout:0/541: creat d1/d8/d42/fb0 x:0 0 0 2024-08-31T05:21:23.527 INFO:tasks.workunit.client.0.smithi067.stdout:0/542: write d1/d8/f35 [4330878,100229] 0 2024-08-31T05:21:23.533 INFO:tasks.workunit.client.0.smithi067.stdout:0/543: fdatasync d1/df/f6d 0 2024-08-31T05:21:23.533 INFO:tasks.workunit.client.0.smithi067.stdout:0/544: stat d1/dd/l7a 0 2024-08-31T05:21:23.538 INFO:tasks.workunit.client.0.smithi067.stdout:0/545: unlink d1/df/d17/d43/f91 0 2024-08-31T05:21:23.582 INFO:tasks.workunit.client.0.smithi067.stdout:0/546: mkdir d1/df/d29/d86/db1 0 2024-08-31T05:21:23.582 INFO:tasks.workunit.client.0.smithi067.stdout:0/547: chown d1/dd/d18 1596 1 2024-08-31T05:21:23.585 INFO:tasks.workunit.client.0.smithi067.stdout:0/548: unlink d1/f3a 0 2024-08-31T05:21:23.593 INFO:tasks.workunit.client.0.smithi067.stdout:3/588: dwrite db/d2e/d50/d62/d85/f94 [8388608,4194304] 0 2024-08-31T05:21:23.597 INFO:tasks.workunit.client.0.smithi067.stdout:3/589: mkdir db/d55/d97/dc4 0 2024-08-31T05:21:23.600 INFO:tasks.workunit.client.0.smithi067.stdout:3/590: symlink db/d91/lc5 0 2024-08-31T05:21:23.601 INFO:tasks.workunit.client.0.smithi067.stdout:0/549: dread d1/d8/d77/f81 [0,4194304] 0 2024-08-31T05:21:23.602 INFO:tasks.workunit.client.0.smithi067.stdout:3/591: rmdir db/d2e/da1 39 2024-08-31T05:21:23.603 INFO:tasks.workunit.client.0.smithi067.stdout:0/550: dread d1/dd/d4d/d88/f89 [0,4194304] 0 2024-08-31T05:21:23.604 INFO:tasks.workunit.client.0.smithi067.stdout:0/551: stat d1/d8/l47 0 2024-08-31T05:21:23.607 INFO:tasks.workunit.client.0.smithi067.stdout:3/592: fdatasync db/dbe/f28 0 2024-08-31T05:21:23.608 INFO:tasks.workunit.client.0.smithi067.stdout:3/593: chown db/d12/f58 3371703 1 2024-08-31T05:21:23.612 INFO:tasks.workunit.client.0.smithi067.stdout:3/594: symlink db/d2e/d50/lc6 0 2024-08-31T05:21:23.613 INFO:tasks.workunit.client.0.smithi067.stdout:3/595: readlink db/d2e/d6a/d8d/lbd 0 2024-08-31T05:21:23.614 INFO:tasks.workunit.client.0.smithi067.stdout:3/596: write db/d12/d21/fbc [294218,22305] 0 2024-08-31T05:21:23.621 INFO:tasks.workunit.client.0.smithi067.stdout:3/597: dwrite db/d2e/f38 [0,4194304] 0 2024-08-31T05:21:23.623 INFO:tasks.workunit.client.0.smithi067.stdout:0/552: dread d1/df/d29/f74 [0,4194304] 0 2024-08-31T05:21:23.628 INFO:tasks.workunit.client.0.smithi067.stdout:0/553: rename d1/d8/d77/c7b to d1/dd/d18/d52/cb2 0 2024-08-31T05:21:23.632 INFO:tasks.workunit.client.0.smithi067.stdout:0/554: dread d1/d8/f33 [0,4194304] 0 2024-08-31T05:21:23.642 INFO:tasks.workunit.client.0.smithi067.stdout:0/555: dwrite d1/dd/d71/fa5 [0,4194304] 0 2024-08-31T05:21:23.642 INFO:tasks.workunit.client.0.smithi067.stdout:3/598: dread db/d2e/d50/f68 [0,4194304] 0 2024-08-31T05:21:23.645 INFO:tasks.workunit.client.0.smithi067.stdout:0/556: creat d1/dd/d4d/d88/dac/fb3 x:0 0 0 2024-08-31T05:21:23.647 INFO:tasks.workunit.client.0.smithi067.stdout:3/599: creat db/fc7 x:0 0 0 2024-08-31T05:21:23.647 INFO:tasks.workunit.client.0.smithi067.stdout:3/600: dread - db/d17/d3f/d54/d56/d6e/f9f zero size 2024-08-31T05:21:23.664 INFO:tasks.workunit.client.0.smithi067.stdout:0/557: rename d1/df/d29/l7d to d1/dd/d71/lb4 0 2024-08-31T05:21:23.667 INFO:tasks.workunit.client.0.smithi067.stdout:6/652: sync 2024-08-31T05:21:23.672 INFO:tasks.workunit.client.0.smithi067.stdout:3/601: mknod db/d17/d3f/d54/cc8 0 2024-08-31T05:21:23.674 INFO:tasks.workunit.client.0.smithi067.stdout:3/602: write db/d17/d3f/d54/d56/d6e/fbf [285914,129880] 0 2024-08-31T05:21:23.676 INFO:tasks.workunit.client.0.smithi067.stdout:0/558: symlink d1/df/d29/d86/db1/lb5 0 2024-08-31T05:21:23.691 INFO:tasks.workunit.client.0.smithi067.stdout:3/603: write db/f53 [3479268,28043] 0 2024-08-31T05:21:23.694 INFO:tasks.workunit.client.0.smithi067.stdout:6/653: write d1b/d7a/f9a [105035,95832] 0 2024-08-31T05:21:23.694 INFO:tasks.workunit.client.0.smithi067.stdout:3/604: dread db/d91/fb0 [0,4194304] 0 2024-08-31T05:21:23.698 INFO:tasks.workunit.client.0.smithi067.stdout:6/654: fdatasync d1b/d23/d2e/f3d 0 2024-08-31T05:21:23.701 INFO:tasks.workunit.client.0.smithi067.stdout:0/559: dwrite d1/dd/f21 [0,4194304] 0 2024-08-31T05:21:23.703 INFO:tasks.workunit.client.0.smithi067.stdout:0/560: write d1/df/d29/d37/fa2 [2747761,71206] 0 2024-08-31T05:21:23.705 INFO:tasks.workunit.client.0.smithi067.stdout:3/605: getdents db/d2e/d50/d4a 0 2024-08-31T05:21:23.707 INFO:tasks.workunit.client.0.smithi067.stdout:3/606: write db/d17/d3f/d54/f64 [456170,126795] 0 2024-08-31T05:21:23.710 INFO:tasks.workunit.client.0.smithi067.stdout:0/561: dread d1/df/d29/d37/f56 [0,4194304] 0 2024-08-31T05:21:23.711 INFO:tasks.workunit.client.0.smithi067.stdout:3/607: fdatasync db/d17/f24 0 2024-08-31T05:21:23.711 INFO:tasks.workunit.client.0.smithi067.stdout:0/562: fdatasync d1/d8/f4b 0 2024-08-31T05:21:23.712 INFO:tasks.workunit.client.0.smithi067.stdout:6/655: getdents d1b/d23/d61 0 2024-08-31T05:21:23.713 INFO:tasks.workunit.client.0.smithi067.stdout:6/656: dread - d1b/d40/d96/db3/fce zero size 2024-08-31T05:21:23.714 INFO:tasks.workunit.client.0.smithi067.stdout:0/563: mkdir d1/dd/d4d/db6 0 2024-08-31T05:21:23.717 INFO:tasks.workunit.client.0.smithi067.stdout:3/608: symlink db/d2e/d50/d62/dc3/lc9 0 2024-08-31T05:21:23.719 INFO:tasks.workunit.client.0.smithi067.stdout:3/609: write db/d5a/f87 [3561617,61388] 0 2024-08-31T05:21:23.719 INFO:tasks.workunit.client.0.smithi067.stdout:6/657: dread d1b/d23/f9c [0,4194304] 0 2024-08-31T05:21:23.719 INFO:tasks.workunit.client.0.smithi067.stdout:0/564: mkdir d1/df/d17/d43/d48/d6a/d84/db7 0 2024-08-31T05:21:23.725 INFO:tasks.workunit.client.0.smithi067.stdout:0/565: symlink d1/dd/d4d/db6/lb8 0 2024-08-31T05:21:23.727 INFO:tasks.workunit.client.0.smithi067.stdout:3/610: dread db/d12/d21/d82/f8a [4194304,4194304] 0 2024-08-31T05:21:23.748 INFO:tasks.workunit.client.0.smithi067.stdout:0/566: truncate d1/dd/d18/f9a 1836692 0 2024-08-31T05:21:23.750 INFO:tasks.workunit.client.0.smithi067.stdout:3/611: write db/d2e/f46 [644133,84286] 0 2024-08-31T05:21:23.752 INFO:tasks.workunit.client.0.smithi067.stdout:0/567: getdents d1/df/d17 0 2024-08-31T05:21:23.755 INFO:tasks.workunit.client.0.smithi067.stdout:0/568: read d1/df/f6b [2843527,36986] 0 2024-08-31T05:21:23.757 INFO:tasks.workunit.client.0.smithi067.stdout:3/612: rename db/d2e/d6a/l81 to db/d12/d21/lca 0 2024-08-31T05:21:23.757 INFO:tasks.workunit.client.0.smithi067.stdout:3/613: stat db/d17/d3f/d54/d56/d6e/f9f 0 2024-08-31T05:21:23.759 INFO:tasks.workunit.client.0.smithi067.stdout:0/569: symlink d1/df/d17/d43/d48/lb9 0 2024-08-31T05:21:23.760 INFO:tasks.workunit.client.0.smithi067.stdout:3/614: stat db/d12/d21/d82/c8e 0 2024-08-31T05:21:23.765 INFO:tasks.workunit.client.0.smithi067.stdout:0/570: fdatasync d1/df/d17/d43/f64 0 2024-08-31T05:21:23.766 INFO:tasks.workunit.client.0.smithi067.stdout:3/615: dwrite db/f57 [0,4194304] 0 2024-08-31T05:21:23.769 INFO:tasks.workunit.client.0.smithi067.stdout:3/616: readlink db/d17/d3f/d54/d56/d6e/l76 0 2024-08-31T05:21:23.770 INFO:tasks.workunit.client.0.smithi067.stdout:3/617: truncate db/d12/f1f 4656029 0 2024-08-31T05:21:23.771 INFO:tasks.workunit.client.0.smithi067.stdout:0/571: rename d1/d8/f35 to d1/dd/d4d/d88/dac/d8d/fba 0 2024-08-31T05:21:23.773 INFO:tasks.workunit.client.0.smithi067.stdout:3/618: rmdir db/d2e/d6a 39 2024-08-31T05:21:23.777 INFO:tasks.workunit.client.0.smithi067.stdout:0/572: symlink d1/dd/d4d/lbb 0 2024-08-31T05:21:23.777 INFO:tasks.workunit.client.0.smithi067.stdout:3/619: mkdir db/d55/d97/dc4/dcb 0 2024-08-31T05:21:23.779 INFO:tasks.workunit.client.0.smithi067.stdout:0/573: unlink d1/f39 0 2024-08-31T05:21:23.781 INFO:tasks.workunit.client.0.smithi067.stdout:3/620: dread db/d2e/d50/d62/d85/f94 [8388608,4194304] 0 2024-08-31T05:21:23.789 INFO:tasks.workunit.client.0.smithi067.stdout:0/574: dwrite d1/df/d29/d37/f56 [0,4194304] 0 2024-08-31T05:21:23.789 INFO:tasks.workunit.client.0.smithi067.stdout:3/621: dread db/d5a/f87 [8388608,4194304] 0 2024-08-31T05:21:23.790 INFO:tasks.workunit.client.0.smithi067.stdout:3/622: stat db/d2e/d50/f5c 0 2024-08-31T05:21:23.794 INFO:tasks.workunit.client.0.smithi067.stdout:0/575: fdatasync d1/df/d29/f74 0 2024-08-31T05:21:23.797 INFO:tasks.workunit.client.0.smithi067.stdout:3/623: unlink db/c23 0 2024-08-31T05:21:23.798 INFO:tasks.workunit.client.0.smithi067.stdout:0/576: read d1/dd/d4d/d88/dac/d8d/fba [3452246,17231] 0 2024-08-31T05:21:23.798 INFO:tasks.workunit.client.0.smithi067.stdout:3/624: chown db/lf 1944897076 1 2024-08-31T05:21:23.804 INFO:tasks.workunit.client.0.smithi067.stdout:3/625: mkdir db/d55/d97/dc4/dcb/dcc 0 2024-08-31T05:21:23.804 INFO:tasks.workunit.client.0.smithi067.stdout:3/626: stat db/dbe/c34 0 2024-08-31T05:21:23.808 INFO:tasks.workunit.client.0.smithi067.stdout:3/627: unlink db/d5a/c5e 0 2024-08-31T05:21:23.809 INFO:tasks.workunit.client.0.smithi067.stdout:3/628: readlink db/d12/d21/lca 0 2024-08-31T05:21:23.810 INFO:tasks.workunit.client.0.smithi067.stdout:3/629: write db/d2e/d50/d62/f99 [184165,91269] 0 2024-08-31T05:21:23.831 INFO:tasks.workunit.client.0.smithi067.stdout:3/630: dwrite db/f3d [0,4194304] 0 2024-08-31T05:21:23.834 INFO:tasks.workunit.client.0.smithi067.stdout:3/631: dread db/d5a/f73 [0,4194304] 0 2024-08-31T05:21:23.838 INFO:tasks.workunit.client.0.smithi067.stdout:0/577: rename d1/df/d29/f49 to d1/d8/d42/fbc 0 2024-08-31T05:21:23.840 INFO:tasks.workunit.client.0.smithi067.stdout:3/632: rename db/d2e/d50/d62/d85/f92 to db/d55/d97/dc4/fcd 0 2024-08-31T05:21:23.842 INFO:tasks.workunit.client.0.smithi067.stdout:0/578: creat d1/df/d17/d94/fbd x:0 0 0 2024-08-31T05:21:23.843 INFO:tasks.workunit.client.0.smithi067.stdout:0/579: chown d1/dd/d71/fa5 469155476 1 2024-08-31T05:21:23.844 INFO:tasks.workunit.client.0.smithi067.stdout:0/580: write d1/d8/f16 [1336012,29010] 0 2024-08-31T05:21:23.846 INFO:tasks.workunit.client.0.smithi067.stdout:3/633: dread db/d2c/f48 [0,4194304] 0 2024-08-31T05:21:23.846 INFO:tasks.workunit.client.0.smithi067.stdout:0/581: read - d1/f67 zero size 2024-08-31T05:21:23.852 INFO:tasks.workunit.client.0.smithi067.stdout:3/634: link db/d17/d3f/d54/f64 db/d55/d97/dc4/dcb/dcc/fce 0 2024-08-31T05:21:23.853 INFO:tasks.workunit.client.0.smithi067.stdout:3/635: readlink db/d55/l70 0 2024-08-31T05:21:23.856 INFO:tasks.workunit.client.0.smithi067.stdout:3/636: stat db/d2e/d50/d62/fb7 0 2024-08-31T05:21:23.857 INFO:tasks.workunit.client.0.smithi067.stdout:0/582: dread - d1/df/d29/d37/f8c zero size 2024-08-31T05:21:23.864 INFO:tasks.workunit.client.0.smithi067.stdout:3/637: getdents db/d17/d3f/d54 0 2024-08-31T05:21:23.865 INFO:tasks.workunit.client.0.smithi067.stdout:0/583: link d1/l5c d1/df/d17/d94/lbe 0 2024-08-31T05:21:23.869 INFO:tasks.workunit.client.0.smithi067.stdout:0/584: mkdir d1/d8/d42/d98/dbf 0 2024-08-31T05:21:23.871 INFO:tasks.workunit.client.0.smithi067.stdout:3/638: dwrite db/d55/fbb [0,4194304] 0 2024-08-31T05:21:23.873 INFO:tasks.workunit.client.0.smithi067.stdout:0/585: mkdir d1/df/d29/d86/dc0 0 2024-08-31T05:21:23.877 INFO:tasks.workunit.client.0.smithi067.stdout:0/586: fsync d1/f67 0 2024-08-31T05:21:23.878 INFO:tasks.workunit.client.0.smithi067.stdout:3/639: creat db/d2e/d6a/fcf x:0 0 0 2024-08-31T05:21:23.879 INFO:tasks.workunit.client.0.smithi067.stdout:3/640: rename db/d17/d3f/d54 to db/d17/d3f/d54/dd0 22 2024-08-31T05:21:23.883 INFO:tasks.workunit.client.0.smithi067.stdout:3/641: mknod db/d2e/d50/d4a/cd1 0 2024-08-31T05:21:23.885 INFO:tasks.workunit.client.0.smithi067.stdout:0/587: getdents d1/df/d29 0 2024-08-31T05:21:23.886 INFO:tasks.workunit.client.0.smithi067.stdout:0/588: truncate d1/dd/d18/f60 594250 0 2024-08-31T05:21:23.887 INFO:tasks.workunit.client.0.smithi067.stdout:3/642: dread db/d17/d3f/d54/d56/d6e/f9a [4194304,4194304] 0 2024-08-31T05:21:23.890 INFO:tasks.workunit.client.0.smithi067.stdout:3/643: truncate db/d17/f6c 9309231 0 2024-08-31T05:21:23.891 INFO:tasks.workunit.client.0.smithi067.stdout:0/589: dread d1/df/d29/f74 [0,4194304] 0 2024-08-31T05:21:23.891 INFO:tasks.workunit.client.0.smithi067.stdout:0/590: stat d1/dd/c1b 0 2024-08-31T05:21:23.892 INFO:tasks.workunit.client.0.smithi067.stdout:3/644: creat db/d4e/fd2 x:0 0 0 2024-08-31T05:21:23.893 INFO:tasks.workunit.client.0.smithi067.stdout:0/591: fdatasync d1/df/d17/d43/d48/f7f 0 2024-08-31T05:21:23.895 INFO:tasks.workunit.client.0.smithi067.stdout:3/645: creat db/d2e/d6a/fd3 x:0 0 0 2024-08-31T05:21:23.896 INFO:tasks.workunit.client.0.smithi067.stdout:0/592: mkdir d1/df/d17/dc1 0 2024-08-31T05:21:23.900 INFO:tasks.workunit.client.0.smithi067.stdout:3/646: symlink db/d17/ld4 0 2024-08-31T05:21:23.900 INFO:tasks.workunit.client.0.smithi067.stdout:3/647: stat db/f10 0 2024-08-31T05:21:23.901 INFO:tasks.workunit.client.0.smithi067.stdout:3/648: fdatasync f4 0 2024-08-31T05:21:23.902 INFO:tasks.workunit.client.0.smithi067.stdout:3/649: write db/d12/f18 [1872031,125796] 0 2024-08-31T05:21:23.906 INFO:tasks.workunit.client.0.smithi067.stdout:3/650: link db/d17/d3f/d54/fa6 db/dbe/fd5 0 2024-08-31T05:21:23.908 INFO:tasks.workunit.client.0.smithi067.stdout:3/651: creat db/d55/d97/dc4/fd6 x:0 0 0 2024-08-31T05:21:23.909 INFO:tasks.workunit.client.0.smithi067.stdout:3/652: symlink db/d91/ld7 0 2024-08-31T05:21:23.913 INFO:tasks.workunit.client.0.smithi067.stdout:3/653: creat db/d12/fd8 x:0 0 0 2024-08-31T05:21:23.916 INFO:tasks.workunit.client.0.smithi067.stdout:3/654: write db/d17/d3f/d54/fa6 [4069747,108005] 0 2024-08-31T05:21:23.917 INFO:tasks.workunit.client.0.smithi067.stdout:3/655: write db/d2e/d50/d62/f99 [342673,54352] 0 2024-08-31T05:21:23.920 INFO:tasks.workunit.client.0.smithi067.stdout:3/656: rmdir db/d55/d97/dc4/dcb 39 2024-08-31T05:21:23.924 INFO:tasks.workunit.client.0.smithi067.stdout:3/657: mknod db/d12/d21/cd9 0 2024-08-31T05:21:23.925 INFO:tasks.workunit.client.0.smithi067.stdout:3/658: chown db/d55/d97/ca8 20 1 2024-08-31T05:21:23.941 INFO:tasks.workunit.client.0.smithi067.stdout:3/659: symlink db/d55/d97/dc4/dcb/dcc/lda 0 2024-08-31T05:21:23.944 INFO:tasks.workunit.client.0.smithi067.stdout:0/593: dread d1/df/d17/d43/f64 [0,4194304] 0 2024-08-31T05:21:23.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:23 smithi073 ceph-mon[24726]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:21:23.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:23 smithi073 ceph-mon[24726]: Upgrade: Need to upgrade myself (mgr.smithi073.zfoyxd) 2024-08-31T05:21:23.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:23 smithi073 ceph-mon[24726]: Upgrade: Need to upgrade myself (mgr.smithi073.zfoyxd) 2024-08-31T05:21:23.946 INFO:tasks.workunit.client.0.smithi067.stdout:0/594: symlink d1/d50/daa/lc2 0 2024-08-31T05:21:23.948 INFO:tasks.workunit.client.0.smithi067.stdout:0/595: chown d1/dd/d18/fa0 12 1 2024-08-31T05:21:23.950 INFO:tasks.workunit.client.0.smithi067.stdout:0/596: mkdir d1/dd/d4d/d88/dac/dc3 0 2024-08-31T05:21:23.977 INFO:tasks.workunit.client.0.smithi067.stdout:3/660: dread db/d17/f65 [0,4194304] 0 2024-08-31T05:21:23.978 INFO:tasks.workunit.client.0.smithi067.stdout:3/661: write db/d17/d3f/d54/d56/d6e/fbf [619288,48958] 0 2024-08-31T05:21:23.992 INFO:tasks.workunit.client.0.smithi067.stdout:3/662: getdents db/d2e 0 2024-08-31T05:21:24.001 INFO:tasks.workunit.client.0.smithi067.stdout:0/597: truncate d1/df/d17/f4c 164910 0 2024-08-31T05:21:24.004 INFO:tasks.workunit.client.0.smithi067.stdout:0/598: creat d1/df/d29/fc4 x:0 0 0 2024-08-31T05:21:24.007 INFO:tasks.workunit.client.0.smithi067.stdout:0/599: creat d1/df/d17/d94/fc5 x:0 0 0 2024-08-31T05:21:24.008 INFO:tasks.workunit.client.0.smithi067.stdout:3/663: dread db/d17/d3f/d54/fa6 [0,4194304] 0 2024-08-31T05:21:24.009 INFO:tasks.workunit.client.0.smithi067.stdout:0/600: mkdir d1/dd/d18/d52/dc6 0 2024-08-31T05:21:24.010 INFO:tasks.workunit.client.0.smithi067.stdout:3/664: symlink db/d91/ldb 0 2024-08-31T05:21:24.015 INFO:tasks.workunit.client.0.smithi067.stdout:0/601: dwrite d1/df/d17/d43/f97 [0,4194304] 0 2024-08-31T05:21:24.017 INFO:tasks.workunit.client.0.smithi067.stdout:3/665: dread db/d2e/d50/f68 [0,4194304] 0 2024-08-31T05:21:24.019 INFO:tasks.workunit.client.0.smithi067.stdout:0/602: write d1/dd/f15 [3237147,27379] 0 2024-08-31T05:21:24.020 INFO:tasks.workunit.client.0.smithi067.stdout:0/603: dread d1/dd/d4d/d88/f89 [0,4194304] 0 2024-08-31T05:21:24.029 INFO:tasks.workunit.client.0.smithi067.stdout:0/604: getdents d1/dd/d18 0 2024-08-31T05:21:24.030 INFO:tasks.workunit.client.0.smithi067.stdout:0/605: write d1/df/d17/d94/fbd [13898,103054] 0 2024-08-31T05:21:24.034 INFO:tasks.workunit.client.0.smithi067.stdout:0/606: creat d1/df/d17/d43/d80/fc7 x:0 0 0 2024-08-31T05:21:24.035 INFO:tasks.workunit.client.0.smithi067.stdout:3/666: dwrite db/d2e/d50/f5c [0,4194304] 0 2024-08-31T05:21:24.039 INFO:tasks.workunit.client.0.smithi067.stdout:0/607: rename d1/d8/d77/l82 to d1/dd/d18/d52/lc8 0 2024-08-31T05:21:24.044 INFO:tasks.workunit.client.0.smithi067.stdout:3/667: creat db/d2e/d50/fdc x:0 0 0 2024-08-31T05:21:24.045 INFO:tasks.workunit.client.0.smithi067.stdout:0/608: mkdir d1/d8/d42/dc9 0 2024-08-31T05:21:24.048 INFO:tasks.workunit.client.0.smithi067.stdout:3/668: dread db/d12/f4f [0,4194304] 0 2024-08-31T05:21:24.049 INFO:tasks.workunit.client.0.smithi067.stdout:0/609: creat d1/dd/d4d/d88/dac/d8d/fca x:0 0 0 2024-08-31T05:21:24.051 INFO:tasks.workunit.client.0.smithi067.stdout:3/669: rmdir db/d55/d97/dc4/dcb/dcc 39 2024-08-31T05:21:24.053 INFO:tasks.workunit.client.0.smithi067.stdout:0/610: dread d1/d8/d77/f81 [0,4194304] 0 2024-08-31T05:21:24.054 INFO:tasks.workunit.client.0.smithi067.stdout:3/670: readlink db/d17/l86 0 2024-08-31T05:21:24.054 INFO:tasks.workunit.client.0.smithi067.stdout:3/671: chown db/d17/d3f/f7f 59913 1 2024-08-31T05:21:24.057 INFO:tasks.workunit.client.0.smithi067.stdout:3/672: chown db/d5a/l9c 3875 1 2024-08-31T05:21:24.063 INFO:tasks.workunit.client.0.smithi067.stdout:0/611: link d1/df/d17/d43/d80/ca7 d1/df/d17/dc1/ccb 0 2024-08-31T05:21:24.067 INFO:tasks.workunit.client.0.smithi067.stdout:0/612: dread d1/d8/d77/f81 [0,4194304] 0 2024-08-31T05:21:24.070 INFO:tasks.workunit.client.0.smithi067.stdout:0/613: dread d1/d8/f33 [0,4194304] 0 2024-08-31T05:21:24.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:23 smithi067 ceph-mon[17432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:21:24.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:23 smithi067 ceph-mon[17432]: Upgrade: Need to upgrade myself (mgr.smithi073.zfoyxd) 2024-08-31T05:21:24.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:23 smithi067 ceph-mon[17432]: Upgrade: Need to upgrade myself (mgr.smithi073.zfoyxd) 2024-08-31T05:21:24.076 INFO:tasks.workunit.client.0.smithi067.stdout:0/614: dwrite d1/df/d17/d94/fbd [0,4194304] 0 2024-08-31T05:21:24.080 INFO:tasks.workunit.client.0.smithi067.stdout:0/615: symlink d1/df/d17/lcc 0 2024-08-31T05:21:24.081 INFO:tasks.workunit.client.0.smithi067.stdout:0/616: chown d1/df/d17/d43/d80/fc7 138362 1 2024-08-31T05:21:24.086 INFO:tasks.workunit.client.0.smithi067.stdout:0/617: write d1/dd/d4d/d88/dac/d8d/fba [3855872,52101] 0 2024-08-31T05:21:24.086 INFO:tasks.workunit.client.0.smithi067.stdout:3/673: dwrite f6 [0,4194304] 0 2024-08-31T05:21:24.088 INFO:tasks.workunit.client.0.smithi067.stdout:3/674: chown db/d2e/da1/la2 0 1 2024-08-31T05:21:24.091 INFO:tasks.workunit.client.0.smithi067.stdout:3/675: symlink db/d17/d3f/d54/d56/d6e/ldd 0 2024-08-31T05:21:24.094 INFO:tasks.workunit.client.0.smithi067.stdout:0/618: creat d1/d8/d42/fcd x:0 0 0 2024-08-31T05:21:24.095 INFO:tasks.workunit.client.0.smithi067.stdout:0/619: chown d1/dd/d71/d90 868 1 2024-08-31T05:21:24.099 INFO:tasks.workunit.client.0.smithi067.stdout:0/620: mknod d1/dd/d18/cce 0 2024-08-31T05:21:24.101 INFO:tasks.workunit.client.0.smithi067.stdout:0/621: creat d1/df/d17/d43/d48/d6a/d84/db7/fcf x:0 0 0 2024-08-31T05:21:24.105 INFO:tasks.workunit.client.0.smithi067.stdout:0/622: mknod d1/d8/d77/d8f/cd0 0 2024-08-31T05:21:24.106 INFO:tasks.workunit.client.0.smithi067.stdout:3/676: write db/d17/d3f/f61 [617842,127812] 0 2024-08-31T05:21:24.108 INFO:tasks.workunit.client.0.smithi067.stdout:0/623: mknod d1/d8/d42/cd1 0 2024-08-31T05:21:24.110 INFO:tasks.workunit.client.0.smithi067.stdout:0/624: write d1/dd/d4d/d88/dac/f83 [330823,115861] 0 2024-08-31T05:21:24.111 INFO:tasks.workunit.client.0.smithi067.stdout:3/677: dread db/d2e/d50/f68 [0,4194304] 0 2024-08-31T05:21:24.113 INFO:tasks.workunit.client.0.smithi067.stdout:0/625: creat d1/df/d17/d43/d48/fd2 x:0 0 0 2024-08-31T05:21:24.117 INFO:tasks.workunit.client.0.smithi067.stdout:3/678: dwrite db/d2c/f48 [0,4194304] 0 2024-08-31T05:21:24.119 INFO:tasks.workunit.client.0.smithi067.stdout:0/626: creat d1/df/d29/fd3 x:0 0 0 2024-08-31T05:21:24.122 INFO:tasks.workunit.client.0.smithi067.stdout:3/679: dread db/f57 [0,4194304] 0 2024-08-31T05:21:24.124 INFO:tasks.workunit.client.0.smithi067.stdout:0/627: rename d1/dd/d4d/db6/lb8 to d1/df/d17/d43/d48/ld4 0 2024-08-31T05:21:24.127 INFO:tasks.workunit.client.0.smithi067.stdout:0/628: read d1/d50/f6c [1025491,17770] 0 2024-08-31T05:21:24.131 INFO:tasks.workunit.client.0.smithi067.stdout:3/680: dwrite db/d2e/f90 [0,4194304] 0 2024-08-31T05:21:24.135 INFO:tasks.workunit.client.0.smithi067.stdout:3/681: creat db/d2e/d50/d62/dc3/fde x:0 0 0 2024-08-31T05:21:24.136 INFO:tasks.workunit.client.0.smithi067.stdout:3/682: stat db/d17/d3f/d54/d56/l7e 0 2024-08-31T05:21:24.137 INFO:tasks.workunit.client.0.smithi067.stdout:0/629: dwrite d1/dd/d18/f60 [0,4194304] 0 2024-08-31T05:21:24.140 INFO:tasks.workunit.client.0.smithi067.stdout:3/683: fdatasync db/f10 0 2024-08-31T05:21:24.144 INFO:tasks.workunit.client.0.smithi067.stdout:3/684: mkdir db/d17/d3f/d54/ddf 0 2024-08-31T05:21:24.146 INFO:tasks.workunit.client.0.smithi067.stdout:3/685: chown db/d2e/f38 36283130 1 2024-08-31T05:21:24.150 INFO:tasks.workunit.client.0.smithi067.stdout:0/630: dwrite d1/df/d29/fd3 [0,4194304] 0 2024-08-31T05:21:24.157 INFO:tasks.workunit.client.0.smithi067.stdout:3/686: dwrite db/d12/fd8 [0,4194304] 0 2024-08-31T05:21:24.161 INFO:tasks.workunit.client.0.smithi067.stdout:3/687: rmdir db/d12 39 2024-08-31T05:21:24.169 INFO:tasks.workunit.client.0.smithi067.stdout:3/688: rename db/d12/f1f to db/dbe/fe0 0 2024-08-31T05:21:24.170 INFO:tasks.workunit.client.0.smithi067.stdout:3/689: dread - db/d2e/d50/fdc zero size 2024-08-31T05:21:24.177 INFO:tasks.workunit.client.0.smithi067.stdout:3/690: getdents db/d55/d97 0 2024-08-31T05:21:24.177 INFO:tasks.workunit.client.0.smithi067.stdout:0/631: truncate d1/df/d17/d94/fa4 528417 0 2024-08-31T05:21:24.180 INFO:tasks.workunit.client.0.smithi067.stdout:0/632: mkdir d1/dd5 0 2024-08-31T05:21:24.181 INFO:tasks.workunit.client.0.smithi067.stdout:0/633: creat d1/d50/fd6 x:0 0 0 2024-08-31T05:21:24.188 INFO:tasks.workunit.client.0.smithi067.stdout:0/634: creat d1/df/d29/d86/fd7 x:0 0 0 2024-08-31T05:21:24.189 INFO:tasks.workunit.client.0.smithi067.stdout:0/635: write d1/df/d17/d43/d80/fae [301302,33465] 0 2024-08-31T05:21:24.191 INFO:tasks.workunit.client.0.smithi067.stdout:0/636: creat d1/df/d17/d43/d48/d6a/d84/db7/fd8 x:0 0 0 2024-08-31T05:21:24.193 INFO:tasks.workunit.client.0.smithi067.stdout:0/637: mknod d1/d8/d77/cd9 0 2024-08-31T05:21:24.196 INFO:tasks.workunit.client.0.smithi067.stdout:0/638: dread d1/dd/d4d/d88/dac/f83 [0,4194304] 0 2024-08-31T05:21:24.199 INFO:tasks.workunit.client.0.smithi067.stdout:0/639: dread d1/dd/d4d/d88/dac/d8d/fba [4194304,4194304] 0 2024-08-31T05:21:24.205 INFO:tasks.workunit.client.0.smithi067.stdout:0/640: creat d1/df/d29/d37/fda x:0 0 0 2024-08-31T05:21:24.206 INFO:tasks.workunit.client.0.smithi067.stdout:0/641: dread - d1/df/d17/d43/d48/d6a/d84/db7/fcf zero size 2024-08-31T05:21:24.207 INFO:tasks.workunit.client.0.smithi067.stdout:0/642: truncate d1/df/d17/d43/d80/f9f 4442863 0 2024-08-31T05:21:24.208 INFO:tasks.workunit.client.0.smithi067.stdout:0/643: chown d1/dd/d4d/d88/dac/fb3 18176 1 2024-08-31T05:21:24.210 INFO:tasks.workunit.client.0.smithi067.stdout:0/644: symlink d1/df/d17/d43/d48/d6a/ldb 0 2024-08-31T05:21:24.211 INFO:tasks.workunit.client.0.smithi067.stdout:0/645: chown d1/df/d29/d86/db1/lb5 4219 1 2024-08-31T05:21:24.220 INFO:tasks.workunit.client.0.smithi067.stdout:0/646: getdents d1/d50 0 2024-08-31T05:21:24.234 INFO:tasks.workunit.client.0.smithi067.stdout:0/647: dread d1/df/d17/d94/fa4 [0,4194304] 0 2024-08-31T05:21:24.235 INFO:tasks.workunit.client.0.smithi067.stdout:0/648: read - d1/dd/d4d/d88/dac/fb3 zero size 2024-08-31T05:21:24.236 INFO:tasks.workunit.client.0.smithi067.stdout:0/649: write d1/d50/fd6 [198941,81758] 0 2024-08-31T05:21:24.237 INFO:tasks.workunit.client.0.smithi067.stdout:0/650: fsync d1/df/d17/d43/d48/d6a/d84/db7/fd8 0 2024-08-31T05:21:24.245 INFO:tasks.workunit.client.0.smithi067.stdout:0/651: truncate d1/d8/f33 6314 0 2024-08-31T05:21:24.250 INFO:tasks.workunit.client.0.smithi067.stdout:0/652: creat d1/d8/d42/dc9/fdc x:0 0 0 2024-08-31T05:21:24.251 INFO:tasks.workunit.client.0.smithi067.stdout:0/653: truncate d1/dd/d18/fa0 40166 0 2024-08-31T05:21:24.252 INFO:tasks.workunit.client.0.smithi067.stdout:0/654: chown d1/dd/d71/d90 6086 1 2024-08-31T05:21:24.264 INFO:tasks.workunit.client.0.smithi067.stdout:0/655: dwrite d1/d8/d42/f8b [0,4194304] 0 2024-08-31T05:21:24.275 INFO:tasks.workunit.client.0.smithi067.stdout:0/656: dwrite d1/d8/d42/dc9/fdc [0,4194304] 0 2024-08-31T05:21:24.275 INFO:tasks.workunit.client.0.smithi067.stdout:0/657: chown d1/dd/d18/l96 12856 1 2024-08-31T05:21:24.281 INFO:tasks.workunit.client.0.smithi067.stdout:0/658: link d1/dd/c10 d1/d8/d77/d8f/cdd 0 2024-08-31T05:21:24.288 INFO:tasks.workunit.client.0.smithi067.stdout:0/659: dwrite d1/df/d29/d86/fd7 [0,4194304] 0 2024-08-31T05:21:24.290 INFO:tasks.workunit.client.0.smithi067.stdout:0/660: fsync d1/dd/d4d/d88/dac/f83 0 2024-08-31T05:21:24.292 INFO:tasks.workunit.client.0.smithi067.stdout:0/661: dread - d1/df/d17/d43/d48/d6a/d84/db7/fd8 zero size 2024-08-31T05:21:24.297 INFO:tasks.workunit.client.0.smithi067.stdout:0/662: rmdir d1/dd/d4d/db6 0 2024-08-31T05:21:24.298 INFO:tasks.workunit.client.0.smithi067.stdout:0/663: truncate d1/dd/f58 1077258 0 2024-08-31T05:21:24.301 INFO:tasks.workunit.client.0.smithi067.stdout:0/664: symlink d1/d8/d42/d98/dbf/lde 0 2024-08-31T05:21:24.303 INFO:tasks.workunit.client.0.smithi067.stdout:0/665: write d1/dd/d4d/d88/dac/d8d/fba [3206221,50683] 0 2024-08-31T05:21:24.304 INFO:tasks.workunit.client.0.smithi067.stdout:0/666: dread - d1/df/d17/d94/fc5 zero size 2024-08-31T05:21:24.304 INFO:tasks.workunit.client.0.smithi067.stdout:0/667: fsync d1/dd/d4d/d88/f89 0 2024-08-31T05:21:24.306 INFO:tasks.workunit.client.0.smithi067.stdout:0/668: truncate d1/dd/d4d/d88/dac/fb3 555760 0 2024-08-31T05:21:24.307 INFO:tasks.workunit.client.0.smithi067.stdout:0/669: write d1/df/d17/d43/d48/f7f [772145,113931] 0 2024-08-31T05:21:24.312 INFO:tasks.workunit.client.0.smithi067.stdout:0/670: dwrite d1/d50/f57 [4194304,4194304] 0 2024-08-31T05:21:24.315 INFO:tasks.workunit.client.0.smithi067.stdout:0/671: creat d1/d8/d42/d98/dbf/fdf x:0 0 0 2024-08-31T05:21:24.328 INFO:tasks.workunit.client.0.smithi067.stdout:0/672: write d1/df/d17/d43/d80/f9f [1019604,119139] 0 2024-08-31T05:21:24.329 INFO:tasks.workunit.client.0.smithi067.stdout:0/673: dread - d1/df/d29/fc4 zero size 2024-08-31T05:21:24.338 INFO:tasks.workunit.client.0.smithi067.stdout:0/674: dread d1/dd/d18/f9a [0,4194304] 0 2024-08-31T05:21:24.342 INFO:tasks.workunit.client.0.smithi067.stdout:0/675: rename d1/dd/d4d/d88/dac/d8d/fba to d1/df/d17/dc1/fe0 0 2024-08-31T05:21:24.343 INFO:tasks.workunit.client.0.smithi067.stdout:0/676: dread d1/df/d29/d37/f8e [0,4194304] 0 2024-08-31T05:21:24.349 INFO:tasks.workunit.client.0.smithi067.stdout:0/677: dwrite d1/df/d17/d94/fc5 [0,4194304] 0 2024-08-31T05:21:24.357 INFO:tasks.workunit.client.0.smithi067.stdout:0/678: link d1/l5c d1/d8/d42/d98/le1 0 2024-08-31T05:21:24.360 INFO:tasks.workunit.client.0.smithi067.stdout:0/679: creat d1/dd/d4d/d88/dac/dc3/fe2 x:0 0 0 2024-08-31T05:21:24.364 INFO:tasks.workunit.client.0.smithi067.stdout:0/680: dread d1/df/d17/d94/fbd [0,4194304] 0 2024-08-31T05:21:24.375 INFO:tasks.workunit.client.0.smithi067.stdout:0/681: truncate d1/df/d17/d94/fc5 2551772 0 2024-08-31T05:21:24.377 INFO:tasks.workunit.client.0.smithi067.stdout:0/682: getdents d1/d50 0 2024-08-31T05:21:24.384 INFO:tasks.workunit.client.0.smithi067.stdout:0/683: truncate d1/df/d29/fd3 3066912 0 2024-08-31T05:21:24.506 INFO:tasks.workunit.client.0.smithi067.stdout:1/340: sync 2024-08-31T05:21:24.506 INFO:tasks.workunit.client.0.smithi067.stdout:4/336: sync 2024-08-31T05:21:24.508 INFO:tasks.workunit.client.0.smithi067.stdout:4/337: creat d4/d9/f7b x:0 0 0 2024-08-31T05:21:24.508 INFO:tasks.workunit.client.0.smithi067.stdout:1/341: rmdir d3/d23/d5d 39 2024-08-31T05:21:24.510 INFO:tasks.workunit.client.0.smithi067.stdout:1/342: write d3/d23/d2d/d2e/d34/d66/f67 [194490,126946] 0 2024-08-31T05:21:24.510 INFO:tasks.workunit.client.0.smithi067.stdout:4/338: mknod d4/d1e/d21/c7c 0 2024-08-31T05:21:24.513 INFO:tasks.workunit.client.0.smithi067.stdout:4/339: creat d4/d1e/d21/f7d x:0 0 0 2024-08-31T05:21:24.514 INFO:tasks.workunit.client.0.smithi067.stdout:4/340: chown d4/d1e/l39 38 1 2024-08-31T05:21:24.517 INFO:tasks.workunit.client.0.smithi067.stdout:1/343: dwrite d3/d23/d2d/d2e/d34/d66/d72/f5a [0,4194304] 0 2024-08-31T05:21:24.524 INFO:tasks.workunit.client.0.smithi067.stdout:1/344: dwrite d3/d23/d2d/d2e/f62 [0,4194304] 0 2024-08-31T05:21:24.525 INFO:tasks.workunit.client.0.smithi067.stdout:1/345: read - d3/dd/f70 zero size 2024-08-31T05:21:24.530 INFO:tasks.workunit.client.0.smithi067.stdout:1/346: creat d3/dd/f7e x:0 0 0 2024-08-31T05:21:24.530 INFO:tasks.workunit.client.0.smithi067.stdout:1/347: stat d3/d23/d79 0 2024-08-31T05:21:24.533 INFO:tasks.workunit.client.0.smithi067.stdout:1/348: mknod d3/d23/d2d/d2e/d34/d66/c7f 0 2024-08-31T05:21:24.535 INFO:tasks.workunit.client.0.smithi067.stdout:1/349: symlink d3/dd/l80 0 2024-08-31T05:21:24.538 INFO:tasks.workunit.client.0.smithi067.stdout:1/350: creat d3/dd/d50/f81 x:0 0 0 2024-08-31T05:21:24.538 INFO:tasks.workunit.client.0.smithi067.stdout:1/351: dread - d3/d23/f3c zero size 2024-08-31T05:21:24.543 INFO:tasks.workunit.client.0.smithi067.stdout:1/352: mkdir d3/d23/d2d/d2e/d34/d66/d72/d82 0 2024-08-31T05:21:24.545 INFO:tasks.workunit.client.0.smithi067.stdout:1/353: symlink d3/d23/d2d/d2e/d34/d66/d72/l83 0 2024-08-31T05:21:24.548 INFO:tasks.workunit.client.0.smithi067.stdout:1/354: creat d3/dd/f84 x:0 0 0 2024-08-31T05:21:24.549 INFO:tasks.workunit.client.0.smithi067.stdout:1/355: rmdir d3 39 2024-08-31T05:21:24.552 INFO:tasks.workunit.client.0.smithi067.stdout:1/356: symlink d3/dd/l85 0 2024-08-31T05:21:24.554 INFO:tasks.workunit.client.0.smithi067.stdout:1/357: symlink d3/d23/d2d/d2e/d34/d66/l86 0 2024-08-31T05:21:24.561 INFO:tasks.workunit.client.0.smithi067.stdout:1/358: dwrite d3/d23/d2d/d2e/d34/d66/d72/f77 [0,4194304] 0 2024-08-31T05:21:24.582 INFO:tasks.workunit.client.0.smithi067.stdout:1/359: dread d3/dd/f4e [0,4194304] 0 2024-08-31T05:21:24.584 INFO:tasks.workunit.client.0.smithi067.stdout:1/360: unlink d3/d23/d2d/l3e 0 2024-08-31T05:21:24.790 INFO:tasks.workunit.client.0.smithi067.stdout:6/658: sync 2024-08-31T05:21:24.790 INFO:tasks.workunit.client.0.smithi067.stdout:2/502: sync 2024-08-31T05:21:24.804 INFO:tasks.workunit.client.0.smithi067.stdout:6/659: dwrite d1b/f74 [0,4194304] 0 2024-08-31T05:21:24.804 INFO:tasks.workunit.client.0.smithi067.stdout:2/503: dread db/d12/d1a/f1f [4194304,4194304] 0 2024-08-31T05:21:24.844 INFO:tasks.workunit.client.0.smithi067.stdout:2/504: symlink db/d8c/l9a 0 2024-08-31T05:21:24.851 INFO:tasks.workunit.client.0.smithi067.stdout:6/660: link d1b/d40/d70/d71/d78/c9b d1b/d23/d2e/cd9 0 2024-08-31T05:21:24.856 INFO:tasks.workunit.client.0.smithi067.stdout:2/505: write db/d12/d1a/d2b/d3d/d4f/f8e [1428635,22492] 0 2024-08-31T05:21:24.857 INFO:tasks.workunit.client.0.smithi067.stdout:6/661: getdents d1b/d40/d70/dd0/d8d 0 2024-08-31T05:21:24.857 INFO:tasks.workunit.client.0.smithi067.stdout:2/506: stat db/d12/d1a/d5c/c61 0 2024-08-31T05:21:24.858 INFO:tasks.workunit.client.0.smithi067.stdout:2/507: fsync db/d12/d1a/d1e/f2f 0 2024-08-31T05:21:24.858 INFO:tasks.workunit.client.0.smithi067.stdout:6/662: dread - d1b/d23/d2e/d3b/fcd zero size 2024-08-31T05:21:24.861 INFO:tasks.workunit.client.0.smithi067.stdout:6/663: rmdir d1b/d23/d2e 39 2024-08-31T05:21:24.863 INFO:tasks.workunit.client.0.smithi067.stdout:2/508: mkdir db/d12/d1a/d2b/d40/d9b 0 2024-08-31T05:21:24.866 INFO:tasks.workunit.client.0.smithi067.stdout:2/509: readlink db/d12/d1a/d5c/l64 0 2024-08-31T05:21:24.868 INFO:tasks.workunit.client.0.smithi067.stdout:2/510: read db/d12/d1a/d2b/d42/d62/f80 [1177890,121791] 0 2024-08-31T05:21:24.871 INFO:tasks.workunit.client.0.smithi067.stdout:6/664: dwrite d1b/d40/d70/dd0/f5b [0,4194304] 0 2024-08-31T05:21:24.871 INFO:tasks.workunit.client.0.smithi067.stdout:2/511: rmdir db/dd 39 2024-08-31T05:21:24.876 INFO:tasks.workunit.client.0.smithi067.stdout:2/512: unlink db/dd/d2d/f95 0 2024-08-31T05:21:24.879 INFO:tasks.workunit.client.0.smithi067.stdout:6/665: mknod d1b/d23/d2e/cda 0 2024-08-31T05:21:24.881 INFO:tasks.workunit.client.0.smithi067.stdout:2/513: rename db/d12/d1a/d5c/c66 to db/d12/d1a/d1e/d4d/c9c 0 2024-08-31T05:21:24.885 INFO:tasks.workunit.client.0.smithi067.stdout:2/514: read db/dd/f17 [2292442,118768] 0 2024-08-31T05:21:24.895 INFO:tasks.workunit.client.0.smithi067.stdout:6/666: dwrite d1b/d30/fa2 [0,4194304] 0 2024-08-31T05:21:24.898 INFO:tasks.workunit.client.0.smithi067.stdout:6/667: mknod d1b/d23/d61/cdb 0 2024-08-31T05:21:24.900 INFO:tasks.workunit.client.0.smithi067.stdout:6/668: readlink d1b/d40/d70/dd0/d8d/dc6/lc0 0 2024-08-31T05:21:24.901 INFO:tasks.workunit.client.0.smithi067.stdout:6/669: write d1b/d23/d28/db9/fbf [1029823,10140] 0 2024-08-31T05:21:24.908 INFO:tasks.workunit.client.0.smithi067.stdout:2/515: dread db/d12/d1a/d2b/d3d/d4f/f8e [0,4194304] 0 2024-08-31T05:21:24.909 INFO:tasks.workunit.client.0.smithi067.stdout:6/670: dwrite d1b/d7a/fbb [0,4194304] 0 2024-08-31T05:21:24.911 INFO:tasks.workunit.client.0.smithi067.stdout:2/516: dread db/dd/f33 [0,4194304] 0 2024-08-31T05:21:24.929 INFO:tasks.workunit.client.0.smithi067.stdout:6/671: write d1b/d23/d61/f97 [3598962,32672] 0 2024-08-31T05:21:24.937 INFO:tasks.workunit.client.0.smithi067.stdout:6/672: dwrite d1b/d30/f73 [0,4194304] 0 2024-08-31T05:21:24.937 INFO:tasks.workunit.client.0.smithi067.stdout:2/517: dwrite f1 [0,4194304] 0 2024-08-31T05:21:24.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:24 smithi073 ceph-mon[24726]: pgmap v33: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 52 MiB/s rd, 155 MiB/s wr, 338 op/s 2024-08-31T05:21:24.954 INFO:tasks.workunit.client.0.smithi067.stdout:6/673: truncate d1b/d7a/f9a 2217418 0 2024-08-31T05:21:24.959 INFO:tasks.workunit.client.0.smithi067.stdout:6/674: write d1b/d23/d61/fba [129467,8161] 0 2024-08-31T05:21:24.961 INFO:tasks.workunit.client.0.smithi067.stdout:6/675: truncate d1b/d40/d70/dd0/daa/fd3 310701 0 2024-08-31T05:21:24.971 INFO:tasks.workunit.client.0.smithi067.stdout:2/518: dread f4 [0,4194304] 0 2024-08-31T05:21:24.977 INFO:tasks.workunit.client.0.smithi067.stdout:6/676: mknod d1b/d23/d61/d77/cdc 0 2024-08-31T05:21:24.977 INFO:tasks.workunit.client.0.smithi067.stdout:2/519: write db/dd/d2d/f35 [853139,92522] 0 2024-08-31T05:21:24.978 INFO:tasks.workunit.client.0.smithi067.stdout:6/677: symlink d1b/d40/d70/ldd 0 2024-08-31T05:21:24.980 INFO:tasks.workunit.client.0.smithi067.stdout:6/678: write d1b/d40/d70/dd0/daa/fd3 [1124613,19515] 0 2024-08-31T05:21:24.981 INFO:tasks.workunit.client.0.smithi067.stdout:6/679: chown d1b/d40/d70/dd0/d5e/l7e 25 1 2024-08-31T05:21:24.981 INFO:tasks.workunit.client.0.smithi067.stdout:2/520: creat db/d12/d1a/d2b/d87/f9d x:0 0 0 2024-08-31T05:21:24.982 INFO:tasks.workunit.client.0.smithi067.stdout:2/521: rename db/d12/d1a/d2b to db/d12/d1a/d2b/d40/d9e 22 2024-08-31T05:21:24.984 INFO:tasks.workunit.client.0.smithi067.stdout:6/680: creat d1b/d40/d70/dd0/da4/fde x:0 0 0 2024-08-31T05:21:24.985 INFO:tasks.workunit.client.0.smithi067.stdout:6/681: readlink d1b/d40/d70/lb0 0 2024-08-31T05:21:24.990 INFO:tasks.workunit.client.0.smithi067.stdout:2/522: dwrite db/d12/d1a/d2b/d3d/d4f/d63/f6f [0,4194304] 0 2024-08-31T05:21:24.993 INFO:tasks.workunit.client.0.smithi067.stdout:2/523: mkdir db/dd/d13/d9f 0 2024-08-31T05:21:24.993 INFO:tasks.workunit.client.0.smithi067.stdout:6/682: dwrite d1b/d23/d2e/d3b/f9d [4194304,4194304] 0 2024-08-31T05:21:24.995 INFO:tasks.workunit.client.0.smithi067.stdout:2/524: truncate db/d12/d1a/d1e/d4d/f7a 402060 0 2024-08-31T05:21:25.000 INFO:tasks.workunit.client.0.smithi067.stdout:2/525: mkdir db/d12/d1a/d2b/d42/da0 0 2024-08-31T05:21:25.001 INFO:tasks.workunit.client.0.smithi067.stdout:2/526: rmdir db/dd/d2d 39 2024-08-31T05:21:25.019 INFO:tasks.workunit.client.0.smithi067.stdout:2/527: write db/d12/d1a/d2b/d42/d62/f80 [444025,120903] 0 2024-08-31T05:21:25.022 INFO:tasks.workunit.client.0.smithi067.stdout:6/683: dwrite d1b/d40/d70/dd0/d8d/f9f [0,4194304] 0 2024-08-31T05:21:25.024 INFO:tasks.workunit.client.0.smithi067.stdout:2/528: rmdir db/d12/d1a/d1e/d4d 39 2024-08-31T05:21:25.029 INFO:tasks.workunit.client.0.smithi067.stdout:2/529: dread db/d12/d1a/d2b/d3d/d4f/f8e [0,4194304] 0 2024-08-31T05:21:25.033 INFO:tasks.workunit.client.0.smithi067.stdout:2/530: mknod db/d12/d1a/d2b/d3d/d69/d3b/ca1 0 2024-08-31T05:21:25.034 INFO:tasks.workunit.client.0.smithi067.stdout:2/531: stat db/d12/d1a/d2b/d3d/d69/c3c 0 2024-08-31T05:21:25.034 INFO:tasks.workunit.client.0.smithi067.stdout:2/532: stat f4 0 2024-08-31T05:21:25.035 INFO:tasks.workunit.client.0.smithi067.stdout:6/684: truncate d1b/d8e/f79 2523798 0 2024-08-31T05:21:25.036 INFO:tasks.workunit.client.0.smithi067.stdout:6/685: chown d1b/d8e/d62/c82 199 1 2024-08-31T05:21:25.037 INFO:tasks.workunit.client.0.smithi067.stdout:2/533: rename ca to db/dd/d13/d9f/ca2 0 2024-08-31T05:21:25.046 INFO:tasks.workunit.client.0.smithi067.stdout:2/534: write db/f5b [1521492,46924] 0 2024-08-31T05:21:25.048 INFO:tasks.workunit.client.0.smithi067.stdout:2/535: write db/d12/f39 [343867,125868] 0 2024-08-31T05:21:25.049 INFO:tasks.workunit.client.0.smithi067.stdout:6/686: dwrite d1b/d23/f34 [4194304,4194304] 0 2024-08-31T05:21:25.050 INFO:tasks.workunit.client.0.smithi067.stdout:2/536: write db/f4b [2307679,127553] 0 2024-08-31T05:21:25.053 INFO:tasks.workunit.client.0.smithi067.stdout:2/537: unlink db/d12/d1a/d1e/c2c 0 2024-08-31T05:21:25.054 INFO:tasks.workunit.client.0.smithi067.stdout:6/687: creat d1b/d23/d28/fdf x:0 0 0 2024-08-31T05:21:25.058 INFO:tasks.workunit.client.0.smithi067.stdout:2/538: unlink db/d12/d1a/d2b/d42/d62/l7c 0 2024-08-31T05:21:25.060 INFO:tasks.workunit.client.0.smithi067.stdout:6/688: rename d1b/d40/d70/dd0/c66 to d1b/d40/d70/dd0/d5c/d86/ce0 0 2024-08-31T05:21:25.061 INFO:tasks.workunit.client.0.smithi067.stdout:2/539: mkdir db/d12/d1a/da3 0 2024-08-31T05:21:25.063 INFO:tasks.workunit.client.0.smithi067.stdout:6/689: creat d1b/d40/d96/db6/fe1 x:0 0 0 2024-08-31T05:21:25.063 INFO:tasks.workunit.client.0.smithi067.stdout:2/540: chown db/d12/d1a/d2b/d42/d62/f79 24749891 1 2024-08-31T05:21:25.064 INFO:tasks.workunit.client.0.smithi067.stdout:6/690: mknod d1b/d7a/ce2 0 2024-08-31T05:21:25.065 INFO:tasks.workunit.client.0.smithi067.stdout:6/691: chown d1b/d23/f34 407 1 2024-08-31T05:21:25.066 INFO:tasks.workunit.client.0.smithi067.stdout:6/692: write d1b/d7a/f9a [2135651,128658] 0 2024-08-31T05:21:25.067 INFO:tasks.workunit.client.0.smithi067.stdout:2/541: creat db/d12/d1a/d2b/d40/d9b/fa4 x:0 0 0 2024-08-31T05:21:25.069 INFO:tasks.workunit.client.0.smithi067.stdout:2/542: dread db/f3a [0,4194304] 0 2024-08-31T05:21:25.070 INFO:tasks.workunit.client.0.smithi067.stdout:6/693: creat d1b/d23/d2e/fe3 x:0 0 0 2024-08-31T05:21:25.071 INFO:tasks.workunit.client.0.smithi067.stdout:6/694: truncate d1b/d23/d2e/fe3 444302 0 2024-08-31T05:21:25.073 INFO:tasks.workunit.client.0.smithi067.stdout:2/543: creat db/d12/d1a/fa5 x:0 0 0 2024-08-31T05:21:25.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:24 smithi067 ceph-mon[17432]: pgmap v33: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 52 MiB/s rd, 155 MiB/s wr, 338 op/s 2024-08-31T05:21:25.075 INFO:tasks.workunit.client.0.smithi067.stdout:2/544: creat db/d12/d1a/d2b/d3d/d4f/d63/fa6 x:0 0 0 2024-08-31T05:21:25.087 INFO:tasks.workunit.client.0.smithi067.stdout:8/512: sync 2024-08-31T05:21:25.087 INFO:tasks.workunit.client.0.smithi067.stdout:4/341: sync 2024-08-31T05:21:25.087 INFO:tasks.workunit.client.0.smithi067.stdout:0/684: sync 2024-08-31T05:21:25.087 INFO:tasks.workunit.client.0.smithi067.stdout:9/481: sync 2024-08-31T05:21:25.088 INFO:tasks.workunit.client.0.smithi067.stdout:3/691: sync 2024-08-31T05:21:25.088 INFO:tasks.workunit.client.0.smithi067.stdout:7/382: sync 2024-08-31T05:21:25.088 INFO:tasks.workunit.client.0.smithi067.stdout:5/484: sync 2024-08-31T05:21:25.088 INFO:tasks.workunit.client.0.smithi067.stdout:1/361: sync 2024-08-31T05:21:25.090 INFO:tasks.workunit.client.0.smithi067.stdout:1/362: dread - d3/dd/f7e zero size 2024-08-31T05:21:25.090 INFO:tasks.workunit.client.0.smithi067.stdout:3/692: write db/d12/f18 [2082968,26770] 0 2024-08-31T05:21:25.090 INFO:tasks.workunit.client.0.smithi067.stdout:6/695: dread d1b/d23/d28/f2b [0,4194304] 0 2024-08-31T05:21:25.093 INFO:tasks.workunit.client.0.smithi067.stdout:4/342: creat d4/d9/f7e x:0 0 0 2024-08-31T05:21:25.093 INFO:tasks.workunit.client.0.smithi067.stdout:2/545: truncate db/f4b 1898831 0 2024-08-31T05:21:25.095 INFO:tasks.workunit.client.0.smithi067.stdout:4/343: read - d4/d1e/d21/d60/f61 zero size 2024-08-31T05:21:25.095 INFO:tasks.workunit.client.0.smithi067.stdout:6/696: chown d1b/d40/d70/d71/d78/c80 62 1 2024-08-31T05:21:25.097 INFO:tasks.workunit.client.0.smithi067.stdout:0/685: dread d1/df/d29/d86/fd7 [0,4194304] 0 2024-08-31T05:21:25.100 INFO:tasks.workunit.client.0.smithi067.stdout:7/383: creat d14/d54/d5e/f6a x:0 0 0 2024-08-31T05:21:25.104 INFO:tasks.workunit.client.0.smithi067.stdout:5/485: truncate db/d1d/f2d 1667136 0 2024-08-31T05:21:25.104 INFO:tasks.workunit.client.0.smithi067.stdout:5/486: chown db/f88 6825580 1 2024-08-31T05:21:25.106 INFO:tasks.workunit.client.0.smithi067.stdout:3/693: truncate db/d55/d97/dc4/dcb/dcc/fce 4323707 0 2024-08-31T05:21:25.108 INFO:tasks.workunit.client.0.smithi067.stdout:1/363: dread d3/d23/d2d/d2e/d34/d66/d72/f48 [0,4194304] 0 2024-08-31T05:21:25.109 INFO:tasks.workunit.client.0.smithi067.stdout:8/513: creat d0/d74/fac x:0 0 0 2024-08-31T05:21:25.110 INFO:tasks.workunit.client.0.smithi067.stdout:8/514: dread - d0/d4/de/d1d/d2c/f8a zero size 2024-08-31T05:21:25.111 INFO:tasks.workunit.client.0.smithi067.stdout:4/344: write d4/d32/d43/f5d [322119,91176] 0 2024-08-31T05:21:25.112 INFO:tasks.workunit.client.0.smithi067.stdout:9/482: mknod dd/df/d25/d3b/ca0 0 2024-08-31T05:21:25.115 INFO:tasks.workunit.client.0.smithi067.stdout:6/697: creat d1b/d23/d61/d77/fe4 x:0 0 0 2024-08-31T05:21:25.116 INFO:tasks.workunit.client.0.smithi067.stdout:0/686: creat d1/dd/d4d/d88/dac/d8d/fe3 x:0 0 0 2024-08-31T05:21:25.118 INFO:tasks.workunit.client.0.smithi067.stdout:0/687: read d1/df/d17/dc1/fe0 [1694821,14685] 0 2024-08-31T05:21:25.118 INFO:tasks.workunit.client.0.smithi067.stdout:3/694: symlink db/d2e/le1 0 2024-08-31T05:21:25.120 INFO:tasks.workunit.client.0.smithi067.stdout:0/688: write d1/df/d29/d37/f8c [605186,60272] 0 2024-08-31T05:21:25.120 INFO:tasks.workunit.client.0.smithi067.stdout:1/364: creat d3/dd/d50/f87 x:0 0 0 2024-08-31T05:21:25.123 INFO:tasks.workunit.client.0.smithi067.stdout:8/515: write d0/d2/da/dd/f6a [923156,13878] 0 2024-08-31T05:21:25.124 INFO:tasks.workunit.client.0.smithi067.stdout:9/483: write f6 [2102854,126615] 0 2024-08-31T05:21:25.126 INFO:tasks.workunit.client.0.smithi067.stdout:0/689: write d1/df/d29/d37/f56 [4531280,92117] 0 2024-08-31T05:21:25.129 INFO:tasks.workunit.client.0.smithi067.stdout:5/487: dwrite db/f2e [0,4194304] 0 2024-08-31T05:21:25.130 INFO:tasks.workunit.client.0.smithi067.stdout:8/516: write d0/d2/dc/d28/d7e/d73/f92 [811740,50115] 0 2024-08-31T05:21:25.130 INFO:tasks.workunit.client.0.smithi067.stdout:9/484: chown dd/df/c45 1 1 2024-08-31T05:21:25.132 INFO:tasks.workunit.client.0.smithi067.stdout:4/345: mkdir d4/d1f/d7f 0 2024-08-31T05:21:25.132 INFO:tasks.workunit.client.0.smithi067.stdout:3/695: dread db/d17/d3f/f7f [0,4194304] 0 2024-08-31T05:21:25.138 INFO:tasks.workunit.client.0.smithi067.stdout:2/546: rename db/d12/d1a/d1e/d5f to db/dd/d2d/da7 0 2024-08-31T05:21:25.138 INFO:tasks.workunit.client.0.smithi067.stdout:0/690: dwrite d1/dd/d4d/fad [0,4194304] 0 2024-08-31T05:21:25.141 INFO:tasks.workunit.client.0.smithi067.stdout:0/691: write d1/df/d29/d37/f56 [5003310,8236] 0 2024-08-31T05:21:25.145 INFO:tasks.workunit.client.0.smithi067.stdout:5/488: rmdir db/d26/d29/d81 39 2024-08-31T05:21:25.147 INFO:tasks.workunit.client.0.smithi067.stdout:6/698: write d1b/d23/d28/f55 [1384162,30290] 0 2024-08-31T05:21:25.147 INFO:tasks.workunit.client.0.smithi067.stdout:5/489: chown db/d15/d42/d36/c6f 7 1 2024-08-31T05:21:25.149 INFO:tasks.workunit.client.0.smithi067.stdout:8/517: stat d0/d2/dc/f48 0 2024-08-31T05:21:25.151 INFO:tasks.workunit.client.0.smithi067.stdout:0/692: dwrite d1/dd/d4d/d88/dac/d8d/fe3 [0,4194304] 0 2024-08-31T05:21:25.153 INFO:tasks.workunit.client.0.smithi067.stdout:0/693: write d1/df/d17/d94/f9e [469261,124421] 0 2024-08-31T05:21:25.158 INFO:tasks.workunit.client.0.smithi067.stdout:3/696: write db/d2e/d50/faf [306805,46676] 0 2024-08-31T05:21:25.162 INFO:tasks.workunit.client.0.smithi067.stdout:8/518: unlink d0/d2/d6/c5a 0 2024-08-31T05:21:25.163 INFO:tasks.workunit.client.0.smithi067.stdout:4/346: write d4/d1e/d21/f3a [1096295,66369] 0 2024-08-31T05:21:25.164 INFO:tasks.workunit.client.0.smithi067.stdout:9/485: truncate dd/df/f9a 3585633 0 2024-08-31T05:21:25.164 INFO:tasks.workunit.client.0.smithi067.stdout:4/347: dread - d4/d1e/d21/d60/f61 zero size 2024-08-31T05:21:25.165 INFO:tasks.workunit.client.0.smithi067.stdout:0/694: mknod d1/df/d17/d94/ce4 0 2024-08-31T05:21:25.168 INFO:tasks.workunit.client.0.smithi067.stdout:2/547: truncate db/d12/d1a/d1e/f2f 221708 0 2024-08-31T05:21:25.170 INFO:tasks.workunit.client.0.smithi067.stdout:1/365: link d3/d23/d2d/d2e/d34/d66/d72/c46 d3/d23/d2d/d2e/d34/d66/c88 0 2024-08-31T05:21:25.173 INFO:tasks.workunit.client.0.smithi067.stdout:5/490: creat db/d26/d29/d31/d54/d8c/f9e x:0 0 0 2024-08-31T05:21:25.174 INFO:tasks.workunit.client.0.smithi067.stdout:3/697: creat db/d17/d3f/d54/fe2 x:0 0 0 2024-08-31T05:21:25.176 INFO:tasks.workunit.client.0.smithi067.stdout:8/519: mknod d0/d2/da/dd/cad 0 2024-08-31T05:21:25.178 INFO:tasks.workunit.client.0.smithi067.stdout:4/348: symlink d4/d1e/d21/l80 0 2024-08-31T05:21:25.179 INFO:tasks.workunit.client.0.smithi067.stdout:8/520: write d0/d2/da/dd/d1f/fa8 [958466,51547] 0 2024-08-31T05:21:25.180 INFO:tasks.workunit.client.0.smithi067.stdout:5/491: dwrite db/d15/f12 [0,4194304] 0 2024-08-31T05:21:25.183 INFO:tasks.workunit.client.0.smithi067.stdout:1/366: creat d3/d23/d2d/d2e/d34/d66/f89 x:0 0 0 2024-08-31T05:21:25.184 INFO:tasks.workunit.client.0.smithi067.stdout:5/492: write db/f88 [889104,6918] 0 2024-08-31T05:21:25.185 INFO:tasks.workunit.client.0.smithi067.stdout:1/367: readlink d3/l9 0 2024-08-31T05:21:25.187 INFO:tasks.workunit.client.0.smithi067.stdout:0/695: dread d1/df/d17/f4c [0,4194304] 0 2024-08-31T05:21:25.187 INFO:tasks.workunit.client.0.smithi067.stdout:3/698: creat db/d2c/fe3 x:0 0 0 2024-08-31T05:21:25.191 INFO:tasks.workunit.client.0.smithi067.stdout:0/696: read d1/df/d17/f4c [104579,28616] 0 2024-08-31T05:21:25.191 INFO:tasks.workunit.client.0.smithi067.stdout:8/521: creat d0/d2/fae x:0 0 0 2024-08-31T05:21:25.191 INFO:tasks.workunit.client.0.smithi067.stdout:4/349: dwrite d4/f76 [0,4194304] 0 2024-08-31T05:21:25.197 INFO:tasks.workunit.client.0.smithi067.stdout:6/699: getdents d1b/d23/d2e/d3b 0 2024-08-31T05:21:25.200 INFO:tasks.workunit.client.0.smithi067.stdout:0/697: truncate d1/d8/d42/fb0 232478 0 2024-08-31T05:21:25.200 INFO:tasks.workunit.client.0.smithi067.stdout:5/493: dwrite db/f88 [0,4194304] 0 2024-08-31T05:21:25.201 INFO:tasks.workunit.client.0.smithi067.stdout:1/368: readlink d3/d23/d5d/l7b 0 2024-08-31T05:21:25.203 INFO:tasks.workunit.client.0.smithi067.stdout:9/486: rmdir dd/df/d25/d59/d98 0 2024-08-31T05:21:25.209 INFO:tasks.workunit.client.0.smithi067.stdout:9/487: readlink dd/df/l71 0 2024-08-31T05:21:25.210 INFO:tasks.workunit.client.0.smithi067.stdout:2/548: dwrite db/d12/d1a/d2b/d42/f53 [0,4194304] 0 2024-08-31T05:21:25.213 INFO:tasks.workunit.client.0.smithi067.stdout:4/350: dwrite d4/d1e/d21/f7d [0,4194304] 0 2024-08-31T05:21:25.216 INFO:tasks.workunit.client.0.smithi067.stdout:8/522: dread d0/d2/f24 [0,4194304] 0 2024-08-31T05:21:25.216 INFO:tasks.workunit.client.0.smithi067.stdout:3/699: symlink db/d12/d21/le4 0 2024-08-31T05:21:25.217 INFO:tasks.workunit.client.0.smithi067.stdout:2/549: dread db/f3a [0,4194304] 0 2024-08-31T05:21:25.219 INFO:tasks.workunit.client.0.smithi067.stdout:1/369: truncate d3/f24 733534 0 2024-08-31T05:21:25.220 INFO:tasks.workunit.client.0.smithi067.stdout:8/523: dread - d0/d4/de/d1d/d2c/f8a zero size 2024-08-31T05:21:25.221 INFO:tasks.workunit.client.0.smithi067.stdout:0/698: dwrite d1/dd/f21 [4194304,4194304] 0 2024-08-31T05:21:25.222 INFO:tasks.workunit.client.0.smithi067.stdout:9/488: write dd/df/d25/d3b/d50/d73/f86 [3736460,37515] 0 2024-08-31T05:21:25.224 INFO:tasks.workunit.client.0.smithi067.stdout:8/524: fdatasync d0/d2/da/f57 0 2024-08-31T05:21:25.231 INFO:tasks.workunit.client.0.smithi067.stdout:5/494: mkdir db/d26/d29/d31/d8d/d9f 0 2024-08-31T05:21:25.231 INFO:tasks.workunit.client.0.smithi067.stdout:4/351: mkdir d4/d1e/d53/d81 0 2024-08-31T05:21:25.231 INFO:tasks.workunit.client.0.smithi067.stdout:3/700: mknod db/d91/ce5 0 2024-08-31T05:21:25.232 INFO:tasks.workunit.client.0.smithi067.stdout:4/352: readlink d4/d1e/l39 0 2024-08-31T05:21:25.233 INFO:tasks.workunit.client.0.smithi067.stdout:1/370: creat d3/d23/d2d/d2e/d34/d66/f8a x:0 0 0 2024-08-31T05:21:25.236 INFO:tasks.workunit.client.0.smithi067.stdout:8/525: dwrite d0/d4/f71 [0,4194304] 0 2024-08-31T05:21:25.237 INFO:tasks.workunit.client.0.smithi067.stdout:8/526: chown d0/d2/dc/d28/d7e/c86 204327 1 2024-08-31T05:21:25.239 INFO:tasks.workunit.client.0.smithi067.stdout:5/495: creat db/d26/d29/d31/fa0 x:0 0 0 2024-08-31T05:21:25.239 INFO:tasks.workunit.client.0.smithi067.stdout:6/700: truncate d1b/d23/d28/f55 1509645 0 2024-08-31T05:21:25.240 INFO:tasks.workunit.client.0.smithi067.stdout:1/371: read d3/dd/f2c [2431199,92955] 0 2024-08-31T05:21:25.240 INFO:tasks.workunit.client.0.smithi067.stdout:8/527: chown d0/d4/de/l10 8167017 1 2024-08-31T05:21:25.241 INFO:tasks.workunit.client.0.smithi067.stdout:3/701: unlink db/d17/d3f/d54/d56/lb4 0 2024-08-31T05:21:25.241 INFO:tasks.workunit.client.0.smithi067.stdout:5/496: write db/d1d/f9d [430519,94629] 0 2024-08-31T05:21:25.243 INFO:tasks.workunit.client.0.smithi067.stdout:1/372: write d3/dd/f20 [1124435,88713] 0 2024-08-31T05:21:25.247 INFO:tasks.workunit.client.0.smithi067.stdout:8/528: chown d0/d4/de/d1d/d2c/f55 3 1 2024-08-31T05:21:25.248 INFO:tasks.workunit.client.0.smithi067.stdout:2/550: getdents db/d12/d1a/d2b/d40/d9b 0 2024-08-31T05:21:25.255 INFO:tasks.workunit.client.0.smithi067.stdout:5/497: symlink db/d15/d42/d36/d73/la1 0 2024-08-31T05:21:25.256 INFO:tasks.workunit.client.0.smithi067.stdout:4/353: dwrite d4/f10 [0,4194304] 0 2024-08-31T05:21:25.262 INFO:tasks.workunit.client.0.smithi067.stdout:3/702: dwrite db/d17/d3f/d54/d56/d6e/f75 [0,4194304] 0 2024-08-31T05:21:25.265 INFO:tasks.workunit.client.0.smithi067.stdout:9/489: write f7 [3844795,80841] 0 2024-08-31T05:21:25.267 INFO:tasks.workunit.client.0.smithi067.stdout:3/703: read db/f57 [1692584,29743] 0 2024-08-31T05:21:25.268 INFO:tasks.workunit.client.0.smithi067.stdout:6/701: truncate d1b/d40/d70/dd0/daa/fd3 550947 0 2024-08-31T05:21:25.271 INFO:tasks.workunit.client.0.smithi067.stdout:6/702: chown d1b/d23/d28 1912695027 1 2024-08-31T05:21:25.273 INFO:tasks.workunit.client.0.smithi067.stdout:4/354: rename d4/d13/f1c to d4/d14/d48/d66/f82 0 2024-08-31T05:21:25.276 INFO:tasks.workunit.client.0.smithi067.stdout:2/551: dwrite db/d12/d1a/d2b/d40/f4a [0,4194304] 0 2024-08-31T05:21:25.278 INFO:tasks.workunit.client.0.smithi067.stdout:8/529: dwrite d0/d4/de/d1d/d2c/f8a [0,4194304] 0 2024-08-31T05:21:25.281 INFO:tasks.workunit.client.0.smithi067.stdout:4/355: chown d4/d1f/l20 1 1 2024-08-31T05:21:25.282 INFO:tasks.workunit.client.0.smithi067.stdout:5/498: dwrite db/d1d/d4f/f72 [4194304,4194304] 0 2024-08-31T05:21:25.282 INFO:tasks.workunit.client.0.smithi067.stdout:6/703: chown d1b/d40/d70/dd0/d5e/f5f 25 1 2024-08-31T05:21:25.283 INFO:tasks.workunit.client.0.smithi067.stdout:5/499: stat db/d26 0 2024-08-31T05:21:25.284 INFO:tasks.workunit.client.0.smithi067.stdout:8/530: chown d0/d2/da/f93 3123 1 2024-08-31T05:21:25.286 INFO:tasks.workunit.client.0.smithi067.stdout:1/373: dread f1 [0,4194304] 0 2024-08-31T05:21:25.290 INFO:tasks.workunit.client.0.smithi067.stdout:3/704: dwrite db/d2c/fe3 [0,4194304] 0 2024-08-31T05:21:25.291 INFO:tasks.workunit.client.0.smithi067.stdout:4/356: mkdir d4/d1e/d7a/d83 0 2024-08-31T05:21:25.291 INFO:tasks.workunit.client.0.smithi067.stdout:5/500: creat db/d15/d42/fa2 x:0 0 0 2024-08-31T05:21:25.293 INFO:tasks.workunit.client.0.smithi067.stdout:4/357: chown d4/d42/l58 2391315 1 2024-08-31T05:21:25.295 INFO:tasks.workunit.client.0.smithi067.stdout:2/552: truncate db/d12/d1a/d1e/f93 310535 0 2024-08-31T05:21:25.296 INFO:tasks.workunit.client.0.smithi067.stdout:8/531: getdents d0/d2/d6 0 2024-08-31T05:21:25.298 INFO:tasks.workunit.client.0.smithi067.stdout:2/553: readlink db/dd/d13/l58 0 2024-08-31T05:21:25.298 INFO:tasks.workunit.client.0.smithi067.stdout:3/705: write db/d17/d3f/d54/d56/d6e/fbf [811605,3710] 0 2024-08-31T05:21:25.298 INFO:tasks.workunit.client.0.smithi067.stdout:5/501: creat db/d26/d29/d31/d54/d66/fa3 x:0 0 0 2024-08-31T05:21:25.299 INFO:tasks.workunit.client.0.smithi067.stdout:4/358: symlink d4/d14/d48/l84 0 2024-08-31T05:21:25.302 INFO:tasks.workunit.client.0.smithi067.stdout:3/706: creat db/d55/fe6 x:0 0 0 2024-08-31T05:21:25.303 INFO:tasks.workunit.client.0.smithi067.stdout:5/502: dread - db/d26/d29/d31/d54/d66/fa3 zero size 2024-08-31T05:21:25.304 INFO:tasks.workunit.client.0.smithi067.stdout:8/532: rename d0/d2/da/dd/c65 to d0/d2/dc/d28/caf 0 2024-08-31T05:21:25.305 INFO:tasks.workunit.client.0.smithi067.stdout:1/374: dwrite d3/dd/f4e [0,4194304] 0 2024-08-31T05:21:25.305 INFO:tasks.workunit.client.0.smithi067.stdout:2/554: mkdir db/d12/d1a/d2b/d40/d9b/da8 0 2024-08-31T05:21:25.307 INFO:tasks.workunit.client.0.smithi067.stdout:4/359: symlink d4/d9/d4b/l85 0 2024-08-31T05:21:25.308 INFO:tasks.workunit.client.0.smithi067.stdout:2/555: mknod db/d8c/ca9 0 2024-08-31T05:21:25.310 INFO:tasks.workunit.client.0.smithi067.stdout:3/707: mknod db/d17/d3f/d54/ddf/ce7 0 2024-08-31T05:21:25.311 INFO:tasks.workunit.client.0.smithi067.stdout:1/375: mkdir d3/d8b 0 2024-08-31T05:21:25.312 INFO:tasks.workunit.client.0.smithi067.stdout:4/360: creat d4/d9/d4b/f86 x:0 0 0 2024-08-31T05:21:25.313 INFO:tasks.workunit.client.0.smithi067.stdout:2/556: truncate db/dd/d2d/f35 4350045 0 2024-08-31T05:21:25.313 INFO:tasks.workunit.client.0.smithi067.stdout:6/704: dread d1b/d40/d70/dd0/d5c/f75 [0,4194304] 0 2024-08-31T05:21:25.316 INFO:tasks.workunit.client.0.smithi067.stdout:4/361: creat d4/d1e/d21/d60/f87 x:0 0 0 2024-08-31T05:21:25.318 INFO:tasks.workunit.client.0.smithi067.stdout:2/557: unlink db/d12/d1a/d2b/f5a 0 2024-08-31T05:21:25.319 INFO:tasks.workunit.client.0.smithi067.stdout:4/362: rmdir d4 39 2024-08-31T05:21:25.320 INFO:tasks.workunit.client.0.smithi067.stdout:6/705: mknod d1b/d40/d70/d71/ce5 0 2024-08-31T05:21:25.322 INFO:tasks.workunit.client.0.smithi067.stdout:3/708: dwrite db/d5a/f87 [12582912,4194304] 0 2024-08-31T05:21:25.324 INFO:tasks.workunit.client.0.smithi067.stdout:3/709: chown db/d2c/fe3 2724792 1 2024-08-31T05:21:25.325 INFO:tasks.workunit.client.0.smithi067.stdout:2/558: creat db/d12/d1a/faa x:0 0 0 2024-08-31T05:21:25.325 INFO:tasks.workunit.client.0.smithi067.stdout:6/706: truncate d1b/d23/d61/f4e 447175 0 2024-08-31T05:21:25.326 INFO:tasks.workunit.client.0.smithi067.stdout:3/710: truncate db/d17/f65 4608723 0 2024-08-31T05:21:25.326 INFO:tasks.workunit.client.0.smithi067.stdout:6/707: fsync d1b/d7a/f9a 0 2024-08-31T05:21:25.327 INFO:tasks.workunit.client.0.smithi067.stdout:5/503: dread db/f46 [0,4194304] 0 2024-08-31T05:21:25.335 INFO:tasks.workunit.client.0.smithi067.stdout:5/504: getdents db/d15/d53 0 2024-08-31T05:21:25.341 INFO:tasks.workunit.client.0.smithi067.stdout:5/505: write f6 [715691,39971] 0 2024-08-31T05:21:25.341 INFO:tasks.workunit.client.0.smithi067.stdout:3/711: dwrite db/d2e/d50/f5c [0,4194304] 0 2024-08-31T05:21:25.344 INFO:tasks.workunit.client.0.smithi067.stdout:6/708: rename d1b/d40/d70/d71/dae to d1b/d40/d70/dd0/d5e/de6 0 2024-08-31T05:21:25.349 INFO:tasks.workunit.client.0.smithi067.stdout:5/506: creat db/d15/d53/d5f/fa4 x:0 0 0 2024-08-31T05:21:25.349 INFO:tasks.workunit.client.0.smithi067.stdout:3/712: symlink db/d17/d3f/d54/d56/le8 0 2024-08-31T05:21:25.355 INFO:tasks.workunit.client.0.smithi067.stdout:3/713: creat db/d4e/fe9 x:0 0 0 2024-08-31T05:21:25.356 INFO:tasks.workunit.client.0.smithi067.stdout:5/507: dread db/f21 [4194304,4194304] 0 2024-08-31T05:21:25.357 INFO:tasks.workunit.client.0.smithi067.stdout:5/508: dread - db/d15/d42/fa2 zero size 2024-08-31T05:21:25.363 INFO:tasks.workunit.client.0.smithi067.stdout:2/559: dread db/d12/f6e [0,4194304] 0 2024-08-31T05:21:25.368 INFO:tasks.workunit.client.0.smithi067.stdout:3/714: symlink db/d55/d97/dc4/dcb/lea 0 2024-08-31T05:21:25.369 INFO:tasks.workunit.client.0.smithi067.stdout:3/715: write db/d5a/f87 [17344136,10951] 0 2024-08-31T05:21:25.372 INFO:tasks.workunit.client.0.smithi067.stdout:8/533: write d0/d2/dc/d3d/d52/d6b/fa2 [530750,82729] 0 2024-08-31T05:21:25.375 INFO:tasks.workunit.client.0.smithi067.stdout:3/716: unlink db/d12/d21/cd9 0 2024-08-31T05:21:25.376 INFO:tasks.workunit.client.0.smithi067.stdout:2/560: fsync db/dd/d2d/da7/f6a 0 2024-08-31T05:21:25.378 INFO:tasks.workunit.client.0.smithi067.stdout:1/376: write f1 [3993531,116057] 0 2024-08-31T05:21:25.379 INFO:tasks.workunit.client.0.smithi067.stdout:1/377: chown d3/d23/d2d/d2e/d34/d66/d72/f48 1984 1 2024-08-31T05:21:25.381 INFO:tasks.workunit.client.0.smithi067.stdout:3/717: creat db/d2e/d50/d62/feb x:0 0 0 2024-08-31T05:21:25.382 INFO:tasks.workunit.client.0.smithi067.stdout:3/718: stat db/d17/d3f/d54/d56/la4 0 2024-08-31T05:21:25.383 INFO:tasks.workunit.client.0.smithi067.stdout:1/378: write d3/dd/f20 [670688,75710] 0 2024-08-31T05:21:25.383 INFO:tasks.workunit.client.0.smithi067.stdout:8/534: mkdir d0/d2/dc/d28/d7e/d73/d84/da6/db0 0 2024-08-31T05:21:25.386 INFO:tasks.workunit.client.0.smithi067.stdout:3/719: dread - db/d2e/d6a/fd3 zero size 2024-08-31T05:21:25.386 INFO:tasks.workunit.client.0.smithi067.stdout:4/363: write d4/d1e/f6f [432917,70937] 0 2024-08-31T05:21:25.387 INFO:tasks.workunit.client.0.smithi067.stdout:8/535: truncate d0/d4/de/f11 4922824 0 2024-08-31T05:21:25.391 INFO:tasks.workunit.client.0.smithi067.stdout:3/720: dread db/d12/f18 [0,4194304] 0 2024-08-31T05:21:25.392 INFO:tasks.workunit.client.0.smithi067.stdout:6/709: write d1b/d23/f2a [1187254,46880] 0 2024-08-31T05:21:25.393 INFO:tasks.workunit.client.0.smithi067.stdout:8/536: rename d0/d2/d6 to d0/d2/dc/d28/d7e/d73/d84/da6/db1 0 2024-08-31T05:21:25.416 INFO:tasks.workunit.client.0.smithi067.stdout:2/561: dread db/dd/d13/f29 [0,4194304] 0 2024-08-31T05:21:25.417 INFO:tasks.workunit.client.0.smithi067.stdout:3/721: mkdir db/d17/d3f/d54/ddf/dec 0 2024-08-31T05:21:25.420 INFO:tasks.workunit.client.0.smithi067.stdout:8/537: rmdir d0/d2/dc/d28/d7e/d73/d84 39 2024-08-31T05:21:25.420 INFO:tasks.workunit.client.0.smithi067.stdout:5/509: write db/d26/f45 [3933328,75310] 0 2024-08-31T05:21:25.421 INFO:tasks.workunit.client.0.smithi067.stdout:8/538: write d0/d4/de/f11 [3858448,9114] 0 2024-08-31T05:21:25.462 INFO:tasks.workunit.client.0.smithi067.stdout:2/562: symlink db/d12/d1a/d2b/d3d/d69/d3b/d99/lab 0 2024-08-31T05:21:25.463 INFO:tasks.workunit.client.0.smithi067.stdout:4/364: truncate d4/d1f/f72 424774 0 2024-08-31T05:21:25.465 INFO:tasks.workunit.client.0.smithi067.stdout:5/510: dwrite db/d15/d42/fa2 [0,4194304] 0 2024-08-31T05:21:25.468 INFO:tasks.workunit.client.0.smithi067.stdout:6/710: getdents d1b/d30 0 2024-08-31T05:21:25.468 INFO:tasks.workunit.client.0.smithi067.stdout:5/511: chown db/f2e 4050 1 2024-08-31T05:21:25.469 INFO:tasks.workunit.client.0.smithi067.stdout:3/722: dread db/d12/f58 [0,4194304] 0 2024-08-31T05:21:25.472 INFO:tasks.workunit.client.0.smithi067.stdout:8/539: creat d0/d2/dc/fb2 x:0 0 0 2024-08-31T05:21:25.473 INFO:tasks.workunit.client.0.smithi067.stdout:4/365: mknod d4/d32/d43/c88 0 2024-08-31T05:21:25.474 INFO:tasks.workunit.client.0.smithi067.stdout:4/366: dread - d4/d9/d5a/f74 zero size 2024-08-31T05:21:25.477 INFO:tasks.workunit.client.0.smithi067.stdout:2/563: mkdir db/d12/d1a/d31/dac 0 2024-08-31T05:21:25.480 INFO:tasks.workunit.client.0.smithi067.stdout:3/723: creat db/d2e/d50/d62/dc3/fed x:0 0 0 2024-08-31T05:21:25.481 INFO:tasks.workunit.client.0.smithi067.stdout:5/512: rename db/d15/d42/d36/c87 to db/d26/d29/d31/d54/d8c/ca5 0 2024-08-31T05:21:25.485 INFO:tasks.workunit.client.0.smithi067.stdout:8/540: fdatasync d0/d2/f24 0 2024-08-31T05:21:25.487 INFO:tasks.workunit.client.0.smithi067.stdout:6/711: write d1b/d23/d28/f85 [896606,65227] 0 2024-08-31T05:21:25.488 INFO:tasks.workunit.client.0.smithi067.stdout:2/564: rmdir db/d12/d1a/d2b/d42/d62 39 2024-08-31T05:21:25.490 INFO:tasks.workunit.client.0.smithi067.stdout:5/513: dwrite db/d15/f80 [0,4194304] 0 2024-08-31T05:21:25.491 INFO:tasks.workunit.client.0.smithi067.stdout:3/724: chown db/d17/l63 64180 1 2024-08-31T05:21:25.494 INFO:tasks.workunit.client.0.smithi067.stdout:6/712: mknod d1b/d40/d96/db6/ce7 0 2024-08-31T05:21:25.499 INFO:tasks.workunit.client.0.smithi067.stdout:5/514: dwrite db/d1d/d4f/f72 [0,4194304] 0 2024-08-31T05:21:25.499 INFO:tasks.workunit.client.0.smithi067.stdout:8/541: mkdir d0/d2/dc/d28/d7e/d73/d84/da6/db1/db3 0 2024-08-31T05:21:25.501 INFO:tasks.workunit.client.0.smithi067.stdout:3/725: mkdir db/d2e/d50/d62/dc3/dee 0 2024-08-31T05:21:25.501 INFO:tasks.workunit.client.0.smithi067.stdout:4/367: truncate d4/d14/d48/f6e 2541603 0 2024-08-31T05:21:25.503 INFO:tasks.workunit.client.0.smithi067.stdout:4/368: read d4/d14/f65 [440749,51966] 0 2024-08-31T05:21:25.503 INFO:tasks.workunit.client.0.smithi067.stdout:2/565: creat db/d12/d1a/d2b/d42/da0/fad x:0 0 0 2024-08-31T05:21:25.508 INFO:tasks.workunit.client.0.smithi067.stdout:8/542: fsync d0/d2/dc/f48 0 2024-08-31T05:21:25.512 INFO:tasks.workunit.client.0.smithi067.stdout:6/713: dwrite d1b/d23/f34 [0,4194304] 0 2024-08-31T05:21:25.513 INFO:tasks.workunit.client.0.smithi067.stdout:2/566: read - db/d12/d1a/d2b/d3d/f46 zero size 2024-08-31T05:21:25.517 INFO:tasks.workunit.client.0.smithi067.stdout:3/726: creat db/d17/d3f/d54/ddf/dec/fef x:0 0 0 2024-08-31T05:21:25.520 INFO:tasks.workunit.client.0.smithi067.stdout:6/714: dread d1b/d40/d70/dd0/f5b [0,4194304] 0 2024-08-31T05:21:25.520 INFO:tasks.workunit.client.0.smithi067.stdout:2/567: dread db/dd/d2d/f35 [0,4194304] 0 2024-08-31T05:21:25.521 INFO:tasks.workunit.client.0.smithi067.stdout:2/568: write db/d12/f39 [1226427,61589] 0 2024-08-31T05:21:25.529 INFO:tasks.workunit.client.0.smithi067.stdout:4/369: rmdir d4/d1f/d7f 0 2024-08-31T05:21:25.530 INFO:tasks.workunit.client.0.smithi067.stdout:5/515: dwrite db/d15/f2a [4194304,4194304] 0 2024-08-31T05:21:25.532 INFO:tasks.workunit.client.0.smithi067.stdout:4/370: truncate d4/d1e/d21/f64 461657 0 2024-08-31T05:21:25.535 INFO:tasks.workunit.client.0.smithi067.stdout:4/371: dread d4/d1e/f6f [0,4194304] 0 2024-08-31T05:21:25.536 INFO:tasks.workunit.client.0.smithi067.stdout:4/372: chown d4/d1e/d21/d60/f87 107729901 1 2024-08-31T05:21:25.540 INFO:tasks.workunit.client.0.smithi067.stdout:5/516: mkdir db/d26/d60/da6 0 2024-08-31T05:21:25.540 INFO:tasks.workunit.client.0.smithi067.stdout:8/543: truncate d0/d2/dc/d28/d7e/f69 1189381 0 2024-08-31T05:21:25.545 INFO:tasks.workunit.client.0.smithi067.stdout:2/569: creat db/d12/d1a/d1e/d4d/fae x:0 0 0 2024-08-31T05:21:25.550 INFO:tasks.workunit.client.0.smithi067.stdout:5/517: fdatasync db/d15/f75 0 2024-08-31T05:21:25.551 INFO:tasks.workunit.client.0.smithi067.stdout:3/727: write db/d2e/f9e [171574,7867] 0 2024-08-31T05:21:25.552 INFO:tasks.workunit.client.0.smithi067.stdout:5/518: chown db/d15/d59 19 1 2024-08-31T05:21:25.552 INFO:tasks.workunit.client.0.smithi067.stdout:8/544: mkdir d0/d2/dc/d28/db4 0 2024-08-31T05:21:25.554 INFO:tasks.workunit.client.0.smithi067.stdout:3/728: truncate db/d2e/d50/fdc 255948 0 2024-08-31T05:21:25.554 INFO:tasks.workunit.client.0.smithi067.stdout:8/545: chown d0/d4/de/d1d/f60 349654910 1 2024-08-31T05:21:25.555 INFO:tasks.workunit.client.0.smithi067.stdout:3/729: chown db/d12/d21/fbc 30681 1 2024-08-31T05:21:25.555 INFO:tasks.workunit.client.0.smithi067.stdout:3/730: chown db/d2c/c3c 116212344 1 2024-08-31T05:21:25.564 INFO:tasks.workunit.client.0.smithi067.stdout:6/715: dwrite d1b/d23/d28/f55 [0,4194304] 0 2024-08-31T05:21:25.565 INFO:tasks.workunit.client.0.smithi067.stdout:6/716: stat d1b/d23/d28/fdf 0 2024-08-31T05:21:25.567 INFO:tasks.workunit.client.0.smithi067.stdout:6/717: write d1b/d23/f69 [1017999,10840] 0 2024-08-31T05:21:25.574 INFO:tasks.workunit.client.0.smithi067.stdout:8/546: dread d0/d2/da/f88 [0,4194304] 0 2024-08-31T05:21:25.577 INFO:tasks.workunit.client.0.smithi067.stdout:4/373: truncate d4/d1e/d21/f64 128714 0 2024-08-31T05:21:25.579 INFO:tasks.workunit.client.0.smithi067.stdout:6/718: fsync d1b/d40/d70/dd0/d5e/de6/fc7 0 2024-08-31T05:21:25.584 INFO:tasks.workunit.client.0.smithi067.stdout:2/570: creat db/dd/faf x:0 0 0 2024-08-31T05:21:25.585 INFO:tasks.workunit.client.0.smithi067.stdout:5/519: dwrite db/d26/f74 [0,4194304] 0 2024-08-31T05:21:25.586 INFO:tasks.workunit.client.0.smithi067.stdout:2/571: write db/d12/d1a/d2b/d40/d9b/fa4 [205380,74021] 0 2024-08-31T05:21:25.587 INFO:tasks.workunit.client.0.smithi067.stdout:5/520: chown db/d26/d29/f57 53 1 2024-08-31T05:21:25.590 INFO:tasks.workunit.client.0.smithi067.stdout:6/719: write d1b/d23/f9c [847420,9013] 0 2024-08-31T05:21:25.592 INFO:tasks.workunit.client.0.smithi067.stdout:8/547: mknod d0/d2/da9/cb5 0 2024-08-31T05:21:25.593 INFO:tasks.workunit.client.0.smithi067.stdout:6/720: write d1b/d23/d61/fba [716387,123479] 0 2024-08-31T05:21:25.594 INFO:tasks.workunit.client.0.smithi067.stdout:4/374: rename d4/d1f/d34/c40 to d4/d1e/d7a/c89 0 2024-08-31T05:21:25.596 INFO:tasks.workunit.client.0.smithi067.stdout:3/731: dread db/d2c/f89 [0,4194304] 0 2024-08-31T05:21:25.601 INFO:tasks.workunit.client.0.smithi067.stdout:2/572: symlink db/dd/d2d/lb0 0 2024-08-31T05:21:25.602 INFO:tasks.workunit.client.0.smithi067.stdout:5/521: mkdir db/d26/d60/da7 0 2024-08-31T05:21:25.603 INFO:tasks.workunit.client.0.smithi067.stdout:8/548: dwrite d0/d2/dc/d3d/f67 [0,4194304] 0 2024-08-31T05:21:25.604 INFO:tasks.workunit.client.0.smithi067.stdout:5/522: write db/d26/d60/f6a [484052,63178] 0 2024-08-31T05:21:25.606 INFO:tasks.workunit.client.0.smithi067.stdout:5/523: write db/d15/d59/f84 [768092,34445] 0 2024-08-31T05:21:25.612 INFO:tasks.workunit.client.0.smithi067.stdout:2/573: mknod db/dd/d2d/cb1 0 2024-08-31T05:21:25.616 INFO:tasks.workunit.client.0.smithi067.stdout:8/549: rmdir d0/d4/de/d1d/d2c/d3c 39 2024-08-31T05:21:25.616 INFO:tasks.workunit.client.0.smithi067.stdout:3/732: dwrite db/dbe/fe0 [0,4194304] 0 2024-08-31T05:21:25.622 INFO:tasks.workunit.client.0.smithi067.stdout:3/733: stat db/d2e/d50/d62/dc3 0 2024-08-31T05:21:25.623 INFO:tasks.workunit.client.0.smithi067.stdout:5/524: stat db/l16 0 2024-08-31T05:21:25.624 INFO:tasks.workunit.client.0.smithi067.stdout:2/574: chown db/d12/d1a/d2b/d42/d62/f79 3867 1 2024-08-31T05:21:25.624 INFO:tasks.workunit.client.0.smithi067.stdout:3/734: mknod db/d2c/cf0 0 2024-08-31T05:21:25.625 INFO:tasks.workunit.client.0.smithi067.stdout:4/375: dread d4/d1f/f30 [4194304,4194304] 0 2024-08-31T05:21:25.628 INFO:tasks.workunit.client.0.smithi067.stdout:6/721: write d1b/d40/d70/dd0/d5e/de6/fc7 [664369,102394] 0 2024-08-31T05:21:25.628 INFO:tasks.workunit.client.0.smithi067.stdout:5/525: rmdir db/d15/d42/d36/d73/d77 39 2024-08-31T05:21:25.630 INFO:tasks.workunit.client.0.smithi067.stdout:2/575: rmdir db/d12/d1a/d31 39 2024-08-31T05:21:25.631 INFO:tasks.workunit.client.0.smithi067.stdout:2/576: write db/f25 [277350,51348] 0 2024-08-31T05:21:25.631 INFO:tasks.workunit.client.0.smithi067.stdout:4/376: truncate d4/d1f/f44 1377361 0 2024-08-31T05:21:25.633 INFO:tasks.workunit.client.0.smithi067.stdout:6/722: mkdir d1b/d40/de8 0 2024-08-31T05:21:25.634 INFO:tasks.workunit.client.0.smithi067.stdout:5/526: dread - db/d15/d42/d36/d73/d77/f94 zero size 2024-08-31T05:21:25.636 INFO:tasks.workunit.client.0.smithi067.stdout:4/377: symlink d4/d32/d43/l8a 0 2024-08-31T05:21:25.637 INFO:tasks.workunit.client.0.smithi067.stdout:5/527: fdatasync db/f1b 0 2024-08-31T05:21:25.638 INFO:tasks.workunit.client.0.smithi067.stdout:8/550: link d0/d4/de/d1d/d2c/d68/c79 d0/d4/cb6 0 2024-08-31T05:21:25.640 INFO:tasks.workunit.client.0.smithi067.stdout:2/577: dwrite db/d12/d1a/d1e/f6b [0,4194304] 0 2024-08-31T05:21:25.640 INFO:tasks.workunit.client.0.smithi067.stdout:3/735: getdents db/d12 0 2024-08-31T05:21:25.640 INFO:tasks.workunit.client.0.smithi067.stdout:5/528: chown db/d26/d29/d31/d54/d8c/f9e 0 1 2024-08-31T05:21:25.642 INFO:tasks.workunit.client.0.smithi067.stdout:2/578: dread - db/d12/d1a/fa5 zero size 2024-08-31T05:21:25.647 INFO:tasks.workunit.client.0.smithi067.stdout:2/579: unlink db/d12/d1a/d1e/l84 0 2024-08-31T05:21:25.648 INFO:tasks.workunit.client.0.smithi067.stdout:2/580: dread - db/d12/d1a/d2b/d3d/d4f/d63/fa6 zero size 2024-08-31T05:21:25.649 INFO:tasks.workunit.client.0.smithi067.stdout:3/736: mknod db/d2e/cf1 0 2024-08-31T05:21:25.650 INFO:tasks.workunit.client.0.smithi067.stdout:3/737: fdatasync db/f3d 0 2024-08-31T05:21:25.651 INFO:tasks.workunit.client.0.smithi067.stdout:3/738: chown db/d17/f65 9 1 2024-08-31T05:21:25.655 INFO:tasks.workunit.client.0.smithi067.stdout:2/581: creat db/d12/d1a/d2b/d40/fb2 x:0 0 0 2024-08-31T05:21:25.658 INFO:tasks.workunit.client.0.smithi067.stdout:3/739: dwrite db/d55/fe6 [0,4194304] 0 2024-08-31T05:21:25.660 INFO:tasks.workunit.client.0.smithi067.stdout:8/551: rmdir d0/d2/dc/d28/d7e/d73/d84/da6/db0 0 2024-08-31T05:21:25.660 INFO:tasks.workunit.client.0.smithi067.stdout:3/740: dread - db/d4e/fd2 zero size 2024-08-31T05:21:25.663 INFO:tasks.workunit.client.0.smithi067.stdout:3/741: write db/d17/f24 [4437696,99582] 0 2024-08-31T05:21:25.664 INFO:tasks.workunit.client.0.smithi067.stdout:8/552: symlink d0/d4/de/lb7 0 2024-08-31T05:21:25.664 INFO:tasks.workunit.client.0.smithi067.stdout:4/378: dwrite d4/d1f/d34/f3c [0,4194304] 0 2024-08-31T05:21:25.671 INFO:tasks.workunit.client.0.smithi067.stdout:3/742: creat db/d2e/d50/d62/dc3/ff2 x:0 0 0 2024-08-31T05:21:25.672 INFO:tasks.workunit.client.0.smithi067.stdout:3/743: fsync f6 0 2024-08-31T05:21:25.673 INFO:tasks.workunit.client.0.smithi067.stdout:3/744: read - db/d17/d3f/d54/d56/d6e/f9f zero size 2024-08-31T05:21:25.683 INFO:tasks.workunit.client.0.smithi067.stdout:8/553: mknod d0/d2/dc/d28/d7e/d73/d84/da6/db1/db3/cb8 0 2024-08-31T05:21:25.684 INFO:tasks.workunit.client.0.smithi067.stdout:2/582: dread db/d12/d1a/d2b/d42/d62/f79 [0,4194304] 0 2024-08-31T05:21:25.687 INFO:tasks.workunit.client.0.smithi067.stdout:3/745: mkdir db/d12/d21/df3 0 2024-08-31T05:21:25.688 INFO:tasks.workunit.client.0.smithi067.stdout:4/379: getdents d4/d1e/d21 0 2024-08-31T05:21:25.691 INFO:tasks.workunit.client.0.smithi067.stdout:8/554: mknod d0/d2/dc/d3d/d98/cb9 0 2024-08-31T05:21:25.693 INFO:tasks.workunit.client.0.smithi067.stdout:3/746: dwrite db/d2e/d50/f5c [0,4194304] 0 2024-08-31T05:21:25.694 INFO:tasks.workunit.client.0.smithi067.stdout:4/380: creat d4/d42/f8b x:0 0 0 2024-08-31T05:21:25.697 INFO:tasks.workunit.client.0.smithi067.stdout:4/381: creat d4/d14/d48/d66/f8c x:0 0 0 2024-08-31T05:21:25.699 INFO:tasks.workunit.client.0.smithi067.stdout:4/382: stat d4/d1e/d21/f46 0 2024-08-31T05:21:25.704 INFO:tasks.workunit.client.0.smithi067.stdout:4/383: dread d4/d1e/f6f [0,4194304] 0 2024-08-31T05:21:25.705 INFO:tasks.workunit.client.0.smithi067.stdout:2/583: write db/d12/d1a/d1e/f21 [1733213,126801] 0 2024-08-31T05:21:25.706 INFO:tasks.workunit.client.0.smithi067.stdout:3/747: dread db/dbe/fd5 [0,4194304] 0 2024-08-31T05:21:25.710 INFO:tasks.workunit.client.0.smithi067.stdout:8/555: dread d0/d2/dc/f16 [0,4194304] 0 2024-08-31T05:21:25.711 INFO:tasks.workunit.client.0.smithi067.stdout:4/384: getdents d4/d9 0 2024-08-31T05:21:25.712 INFO:tasks.workunit.client.0.smithi067.stdout:8/556: fsync d0/d4/f7d 0 2024-08-31T05:21:25.715 INFO:tasks.workunit.client.0.smithi067.stdout:2/584: link db/d12/d1a/d2b/d3d/d4f/d6d/c74 db/d12/d1a/d2b/d42/d62/cb3 0 2024-08-31T05:21:25.717 INFO:tasks.workunit.client.0.smithi067.stdout:3/748: dwrite db/d55/d97/dc4/fd6 [0,4194304] 0 2024-08-31T05:21:25.717 INFO:tasks.workunit.client.0.smithi067.stdout:2/585: fdatasync db/d12/d1a/d1e/f89 0 2024-08-31T05:21:25.718 INFO:tasks.workunit.client.0.smithi067.stdout:8/557: chown d0/d2/dc/d28/d7e/d73/d84/da6/db1/c97 863512823 1 2024-08-31T05:21:25.720 INFO:tasks.workunit.client.0.smithi067.stdout:4/385: rename d4/d1e/d21/d60/l78 to d4/d13/l8d 0 2024-08-31T05:21:25.724 INFO:tasks.workunit.client.0.smithi067.stdout:3/749: write db/d12/f58 [2549546,56409] 0 2024-08-31T05:21:25.724 INFO:tasks.workunit.client.0.smithi067.stdout:2/586: creat db/d12/d1a/d2b/d3d/d4f/d6d/fb4 x:0 0 0 2024-08-31T05:21:25.726 INFO:tasks.workunit.client.0.smithi067.stdout:2/587: readlink db/dd/d13/l58 0 2024-08-31T05:21:25.727 INFO:tasks.workunit.client.0.smithi067.stdout:4/386: creat d4/d42/f8e x:0 0 0 2024-08-31T05:21:25.728 INFO:tasks.workunit.client.0.smithi067.stdout:8/558: dwrite d0/d2/dc/fb2 [0,4194304] 0 2024-08-31T05:21:25.730 INFO:tasks.workunit.client.0.smithi067.stdout:8/559: read d0/d2/dc/f16 [3735527,112861] 0 2024-08-31T05:21:25.731 INFO:tasks.workunit.client.0.smithi067.stdout:3/750: truncate db/dbe/f28 4361183 0 2024-08-31T05:21:25.734 INFO:tasks.workunit.client.0.smithi067.stdout:4/387: read d4/d9/fa [7545121,57017] 0 2024-08-31T05:21:25.735 INFO:tasks.workunit.client.0.smithi067.stdout:4/388: dread - d4/d14/d48/d66/f70 zero size 2024-08-31T05:21:25.737 INFO:tasks.workunit.client.0.smithi067.stdout:4/389: write d4/d1e/d53/f6c [424634,118051] 0 2024-08-31T05:21:25.740 INFO:tasks.workunit.client.0.smithi067.stdout:3/751: unlink db/d2c/c3c 0 2024-08-31T05:21:25.741 INFO:tasks.workunit.client.0.smithi067.stdout:3/752: stat db/d17/d3f/d54/d56/c9d 0 2024-08-31T05:21:25.742 INFO:tasks.workunit.client.0.smithi067.stdout:4/390: truncate d4/d1e/f41 344826 0 2024-08-31T05:21:25.743 INFO:tasks.workunit.client.0.smithi067.stdout:3/753: mknod db/d12/d21/df3/cf4 0 2024-08-31T05:21:25.745 INFO:tasks.workunit.client.0.smithi067.stdout:3/754: chown db/d17/c6b 1281455 1 2024-08-31T05:21:25.747 INFO:tasks.workunit.client.0.smithi067.stdout:3/755: creat db/d2e/d6a/ff5 x:0 0 0 2024-08-31T05:21:25.748 INFO:tasks.workunit.client.0.smithi067.stdout:3/756: chown db/d55/fe6 61491 1 2024-08-31T05:21:25.749 INFO:tasks.workunit.client.0.smithi067.stdout:3/757: write db/d2e/f9e [351767,17782] 0 2024-08-31T05:21:25.753 INFO:tasks.workunit.client.0.smithi067.stdout:3/758: dread db/d2e/f9e [0,4194304] 0 2024-08-31T05:21:25.762 INFO:tasks.workunit.client.0.smithi067.stdout:3/759: getdents db/d12/d21 0 2024-08-31T05:21:25.779 INFO:tasks.workunit.client.0.smithi067.stdout:3/760: getdents db/d2e/d50 0 2024-08-31T05:21:25.782 INFO:tasks.workunit.client.0.smithi067.stdout:8/560: write d0/d2/dc/f48 [2768353,26723] 0 2024-08-31T05:21:25.787 INFO:tasks.workunit.client.0.smithi067.stdout:2/588: dwrite db/d12/d1a/d2b/d3d/f46 [0,4194304] 0 2024-08-31T05:21:25.789 INFO:tasks.workunit.client.0.smithi067.stdout:3/761: symlink db/d2c/lf6 0 2024-08-31T05:21:25.800 INFO:tasks.workunit.client.0.smithi067.stdout:2/589: fdatasync db/d12/d1a/d2b/d3d/f8f 0 2024-08-31T05:21:25.804 INFO:tasks.workunit.client.0.smithi067.stdout:4/391: dwrite d4/d1f/f3d [0,4194304] 0 2024-08-31T05:21:25.814 INFO:tasks.workunit.client.0.smithi067.stdout:2/590: unlink db/d12/d1a/d2b/d40/d9b/fa4 0 2024-08-31T05:21:25.816 INFO:tasks.workunit.client.0.smithi067.stdout:4/392: creat d4/d13/f8f x:0 0 0 2024-08-31T05:21:25.817 INFO:tasks.workunit.client.0.smithi067.stdout:4/393: write d4/d9/d5a/f74 [879981,79293] 0 2024-08-31T05:21:25.825 INFO:tasks.workunit.client.0.smithi067.stdout:8/561: write d0/d2/dc/d28/d7e/f69 [244979,130960] 0 2024-08-31T05:21:25.825 INFO:tasks.workunit.client.0.smithi067.stdout:8/562: fdatasync d0/d2/f24 0 2024-08-31T05:21:25.825 INFO:tasks.workunit.client.0.smithi067.stdout:2/591: mknod db/d12/d1a/d2b/cb5 0 2024-08-31T05:21:25.827 INFO:tasks.workunit.client.0.smithi067.stdout:8/563: dread d0/d2/dc/d3d/f67 [0,4194304] 0 2024-08-31T05:21:25.829 INFO:tasks.workunit.client.0.smithi067.stdout:3/762: dread db/d2c/f31 [0,4194304] 0 2024-08-31T05:21:25.833 INFO:tasks.workunit.client.0.smithi067.stdout:7/384: sync 2024-08-31T05:21:25.833 INFO:tasks.workunit.client.0.smithi067.stdout:4/394: link d4/d32/d43/f5d d4/d32/d4c/f90 0 2024-08-31T05:21:25.833 INFO:tasks.workunit.client.0.smithi067.stdout:4/395: chown d4 5 1 2024-08-31T05:21:25.836 INFO:tasks.workunit.client.0.smithi067.stdout:8/564: rename d0/d2/dc/f16 to d0/d4/de/d1d/d7b/fba 0 2024-08-31T05:21:25.838 INFO:tasks.workunit.client.0.smithi067.stdout:4/396: mknod d4/d1e/d53/c91 0 2024-08-31T05:21:25.839 INFO:tasks.workunit.client.0.smithi067.stdout:4/397: write d4/d14/d48/f5f [287170,50096] 0 2024-08-31T05:21:25.840 INFO:tasks.workunit.client.0.smithi067.stdout:4/398: fsync d4/d14/f4a 0 2024-08-31T05:21:25.845 INFO:tasks.workunit.client.0.smithi067.stdout:7/385: rename d14/f15 to d14/d16/f6b 0 2024-08-31T05:21:25.847 INFO:tasks.workunit.client.0.smithi067.stdout:3/763: link db/d17/d3f/f61 db/ff7 0 2024-08-31T05:21:25.847 INFO:tasks.workunit.client.0.smithi067.stdout:7/386: dread - d14/d16/d5b/f5c zero size 2024-08-31T05:21:25.847 INFO:tasks.workunit.client.0.smithi067.stdout:2/592: getdents db/d12/d1a/d1e/d4d 0 2024-08-31T05:21:25.848 INFO:tasks.workunit.client.0.smithi067.stdout:4/399: dwrite d4/d9/d5a/f74 [0,4194304] 0 2024-08-31T05:21:25.849 INFO:tasks.workunit.client.0.smithi067.stdout:7/387: write f11 [1041159,101885] 0 2024-08-31T05:21:25.852 INFO:tasks.workunit.client.0.smithi067.stdout:3/764: mknod db/d17/d3f/d54/d56/cf8 0 2024-08-31T05:21:25.854 INFO:tasks.workunit.client.0.smithi067.stdout:3/765: fsync db/d2e/d50/d62/dc3/fed 0 2024-08-31T05:21:25.857 INFO:tasks.workunit.client.0.smithi067.stdout:3/766: chown db/d17/d3f/d54/d56/d6e/f75 42619290 1 2024-08-31T05:21:25.857 INFO:tasks.workunit.client.0.smithi067.stdout:4/400: mkdir d4/d1e/d92 0 2024-08-31T05:21:25.858 INFO:tasks.workunit.client.0.smithi067.stdout:7/388: dwrite d14/d16/f60 [0,4194304] 0 2024-08-31T05:21:25.859 INFO:tasks.workunit.client.0.smithi067.stdout:3/767: chown db/d55/d97/dc4 560 1 2024-08-31T05:21:25.865 INFO:tasks.workunit.client.0.smithi067.stdout:4/401: creat d4/d1e/d53/f93 x:0 0 0 2024-08-31T05:21:25.869 INFO:tasks.workunit.client.0.smithi067.stdout:2/593: link db/d12/d1a/d1e/d4d/f59 db/d12/d1a/d2b/d3d/d69/d3b/d99/fb6 0 2024-08-31T05:21:25.870 INFO:tasks.workunit.client.0.smithi067.stdout:2/594: fdatasync db/d12/d1a/d1e/f86 0 2024-08-31T05:21:25.873 INFO:tasks.workunit.client.0.smithi067.stdout:8/565: write d0/d2/dc/f49 [1580370,73587] 0 2024-08-31T05:21:25.874 INFO:tasks.workunit.client.0.smithi067.stdout:2/595: mkdir db/dd/d2d/db7 0 2024-08-31T05:21:25.875 INFO:tasks.workunit.client.0.smithi067.stdout:2/596: stat db/d12/d1a/d2b/d3d/f8f 0 2024-08-31T05:21:25.876 INFO:tasks.workunit.client.0.smithi067.stdout:4/402: mknod d4/d1e/d92/c94 0 2024-08-31T05:21:25.880 INFO:tasks.workunit.client.0.smithi067.stdout:7/389: rmdir d14/d16/d28/d2e/d2f/d52 0 2024-08-31T05:21:25.881 INFO:tasks.workunit.client.0.smithi067.stdout:7/390: write d14/d54/d5e/f6a [580380,4672] 0 2024-08-31T05:21:25.883 INFO:tasks.workunit.client.0.smithi067.stdout:7/391: write d14/d16/d28/d2e/d2f/f4f [996729,52493] 0 2024-08-31T05:21:25.886 INFO:tasks.workunit.client.0.smithi067.stdout:2/597: dread db/d12/d1a/d2b/d3d/d69/d3b/d99/fb6 [0,4194304] 0 2024-08-31T05:21:25.886 INFO:tasks.workunit.client.0.smithi067.stdout:2/598: chown db/dd/d2d 356483340 1 2024-08-31T05:21:25.890 INFO:tasks.workunit.client.0.smithi067.stdout:8/566: write d0/d2/da/f42 [1523817,17486] 0 2024-08-31T05:21:25.892 INFO:tasks.workunit.client.0.smithi067.stdout:2/599: creat db/d12/d1a/d2b/d42/da0/fb8 x:0 0 0 2024-08-31T05:21:25.893 INFO:tasks.workunit.client.0.smithi067.stdout:3/768: dwrite db/d17/f79 [0,4194304] 0 2024-08-31T05:21:25.895 INFO:tasks.workunit.client.0.smithi067.stdout:4/403: truncate d4/d1e/d21/f7d 658768 0 2024-08-31T05:21:25.895 INFO:tasks.workunit.client.0.smithi067.stdout:3/769: readlink db/d17/d3f/d54/d56/l7e 0 2024-08-31T05:21:25.896 INFO:tasks.workunit.client.0.smithi067.stdout:2/600: write db/d12/d1a/d2b/d3d/f46 [1265354,78983] 0 2024-08-31T05:21:25.899 INFO:tasks.workunit.client.0.smithi067.stdout:3/770: write db/d12/d21/fbc [378207,112585] 0 2024-08-31T05:21:25.900 INFO:tasks.workunit.client.0.smithi067.stdout:8/567: dread d0/d2/dc/fb2 [0,4194304] 0 2024-08-31T05:21:25.903 INFO:tasks.workunit.client.0.smithi067.stdout:4/404: chown d4/d1e/d21/c2d 1 1 2024-08-31T05:21:25.903 INFO:tasks.workunit.client.0.smithi067.stdout:8/568: fsync d0/d4/de/d1d/d2c/d68/f8d 0 2024-08-31T05:21:25.904 INFO:tasks.workunit.client.0.smithi067.stdout:4/405: write d4/d1f/f3d [3805129,5666] 0 2024-08-31T05:21:25.907 INFO:tasks.workunit.client.0.smithi067.stdout:3/771: rename db/l29 to db/d55/d97/lf9 0 2024-08-31T05:21:25.907 INFO:tasks.workunit.client.0.smithi067.stdout:3/772: write db/d2c/fe3 [4869003,77342] 0 2024-08-31T05:21:25.909 INFO:tasks.workunit.client.0.smithi067.stdout:7/392: dread d14/f20 [0,4194304] 0 2024-08-31T05:21:25.910 INFO:tasks.workunit.client.0.smithi067.stdout:7/393: dread - d14/d16/d28/d2e/f37 zero size 2024-08-31T05:21:25.912 INFO:tasks.workunit.client.0.smithi067.stdout:8/569: unlink d0/d2/dc/d3d/d52/d6b/fa2 0 2024-08-31T05:21:25.917 INFO:tasks.workunit.client.0.smithi067.stdout:7/394: dwrite d14/d16/f1d [0,4194304] 0 2024-08-31T05:21:25.924 INFO:tasks.workunit.client.0.smithi067.stdout:2/601: truncate db/d12/d1a/d2b/d42/f53 3852604 0 2024-08-31T05:21:25.927 INFO:tasks.workunit.client.0.smithi067.stdout:4/406: mknod d4/d1e/c95 0 2024-08-31T05:21:25.930 INFO:tasks.workunit.client.0.smithi067.stdout:3/773: dwrite db/d17/d3f/d54/d56/f8c [0,4194304] 0 2024-08-31T05:21:25.936 INFO:tasks.workunit.client.0.smithi067.stdout:8/570: symlink d0/d4/de/d1d/d2c/d3c/da5/d99/lbb 0 2024-08-31T05:21:25.938 INFO:tasks.workunit.client.0.smithi067.stdout:7/395: truncate d14/d16/f6b 1010130 0 2024-08-31T05:21:25.940 INFO:tasks.workunit.client.0.smithi067.stdout:2/602: truncate db/d12/f1c 2606619 0 2024-08-31T05:21:25.941 INFO:tasks.workunit.client.0.smithi067.stdout:4/407: mknod d4/d1e/d53/d81/c96 0 2024-08-31T05:21:25.945 INFO:tasks.workunit.client.0.smithi067.stdout:4/408: rename c3 to d4/d13/c97 0 2024-08-31T05:21:25.946 INFO:tasks.workunit.client.0.smithi067.stdout:2/603: dwrite db/d12/d1a/faa [0,4194304] 0 2024-08-31T05:21:25.946 INFO:tasks.workunit.client.0.smithi067.stdout:4/409: stat d4/d14/d48/l84 0 2024-08-31T05:21:25.948 INFO:tasks.workunit.client.0.smithi067.stdout:8/571: mkdir d0/d2/dc/d28/d7e/da3/dbc 0 2024-08-31T05:21:25.949 INFO:tasks.workunit.client.0.smithi067.stdout:4/410: dread d4/d1e/f6f [0,4194304] 0 2024-08-31T05:21:25.951 INFO:tasks.workunit.client.0.smithi067.stdout:4/411: stat d4/d14/d48/d66/c75 0 2024-08-31T05:21:25.955 INFO:tasks.workunit.client.0.smithi067.stdout:7/396: getdents d14/d54/d5e/d67 0 2024-08-31T05:21:25.956 INFO:tasks.workunit.client.0.smithi067.stdout:2/604: dwrite db/d12/d1a/d2b/d40/f4a [0,4194304] 0 2024-08-31T05:21:25.958 INFO:tasks.workunit.client.0.smithi067.stdout:8/572: mkdir d0/d2/dc/d28/d7e/dbd 0 2024-08-31T05:21:25.965 INFO:tasks.workunit.client.0.smithi067.stdout:3/774: link db/c1d db/d2e/cfa 0 2024-08-31T05:21:25.965 INFO:tasks.workunit.client.0.smithi067.stdout:4/412: unlink d4/d1e/c95 0 2024-08-31T05:21:25.966 INFO:tasks.workunit.client.0.smithi067.stdout:7/397: truncate d14/d16/d28/f35 2410190 0 2024-08-31T05:21:25.982 INFO:tasks.workunit.client.0.smithi067.stdout:3/775: chown db/d2e/cb2 600976689 1 2024-08-31T05:21:25.985 INFO:tasks.workunit.client.0.smithi067.stdout:7/398: symlink d14/d16/d5b/d64/l6c 0 2024-08-31T05:21:25.987 INFO:tasks.workunit.client.0.smithi067.stdout:7/399: dread d14/f51 [0,4194304] 0 2024-08-31T05:21:25.989 INFO:tasks.workunit.client.0.smithi067.stdout:2/605: getdents db/d12/d1a/d31/dac 0 2024-08-31T05:21:25.989 INFO:tasks.workunit.client.0.smithi067.stdout:8/573: dread d0/d4/f7d [0,4194304] 0 2024-08-31T05:21:25.993 INFO:tasks.workunit.client.0.smithi067.stdout:7/400: creat d14/d54/d5e/d67/f6d x:0 0 0 2024-08-31T05:21:25.994 INFO:tasks.workunit.client.0.smithi067.stdout:2/606: dread db/d12/d1a/d2b/d3d/d4f/f8e [0,4194304] 0 2024-08-31T05:21:25.994 INFO:tasks.workunit.client.0.smithi067.stdout:7/401: readlink d14/d16/d5b/d64/l65 0 2024-08-31T05:21:25.995 INFO:tasks.workunit.client.0.smithi067.stdout:3/776: link db/d2e/d50/c9b db/d55/cfb 0 2024-08-31T05:21:25.996 INFO:tasks.workunit.client.0.smithi067.stdout:8/574: getdents d0/d2/dc/d28/d7e/d73/d84/da6/db1/d8c 0 2024-08-31T05:21:25.997 INFO:tasks.workunit.client.0.smithi067.stdout:4/413: write d4/d13/f79 [1515501,35568] 0 2024-08-31T05:21:25.998 INFO:tasks.workunit.client.0.smithi067.stdout:2/607: truncate db/d12/d1a/d2b/d3d/d4f/d6d/fb4 1004800 0 2024-08-31T05:21:26.002 INFO:tasks.workunit.client.0.smithi067.stdout:3/777: dwrite db/dbe/fe0 [0,4194304] 0 2024-08-31T05:21:26.003 INFO:tasks.workunit.client.0.smithi067.stdout:7/402: mkdir d14/d16/d5b/d68/d6e 0 2024-08-31T05:21:26.005 INFO:tasks.workunit.client.0.smithi067.stdout:3/778: dread db/d2e/d50/fdc [0,4194304] 0 2024-08-31T05:21:26.007 INFO:tasks.workunit.client.0.smithi067.stdout:3/779: read db/d17/d3f/d54/d56/d6e/f9a [723607,106404] 0 2024-08-31T05:21:26.011 INFO:tasks.workunit.client.0.smithi067.stdout:8/575: stat d0/d4/d64/fa4 0 2024-08-31T05:21:26.013 INFO:tasks.workunit.client.0.smithi067.stdout:8/576: stat d0/d2/dc 0 2024-08-31T05:21:26.014 INFO:tasks.workunit.client.0.smithi067.stdout:7/403: dread d14/f1a [0,4194304] 0 2024-08-31T05:21:26.015 INFO:tasks.workunit.client.0.smithi067.stdout:3/780: dwrite db/d4e/fd2 [0,4194304] 0 2024-08-31T05:21:26.015 INFO:tasks.workunit.client.0.smithi067.stdout:4/414: mknod d4/d1e/d6d/c98 0 2024-08-31T05:21:26.017 INFO:tasks.workunit.client.0.smithi067.stdout:2/608: mknod db/d12/d1a/d2b/d40/d9b/da8/cb9 0 2024-08-31T05:21:26.023 INFO:tasks.workunit.client.0.smithi067.stdout:4/415: dread d4/d1f/d34/f3c [0,4194304] 0 2024-08-31T05:21:26.024 INFO:tasks.workunit.client.0.smithi067.stdout:3/781: dread db/d17/d3f/d54/d56/d6e/fbf [0,4194304] 0 2024-08-31T05:21:26.026 INFO:tasks.workunit.client.0.smithi067.stdout:7/404: rename d14/d16/d28/l3c to d14/d16/d5b/d68/d6e/l6f 0 2024-08-31T05:21:26.028 INFO:tasks.workunit.client.0.smithi067.stdout:7/405: stat d14/d16/d28/d2e/c4d 0 2024-08-31T05:21:26.033 INFO:tasks.workunit.client.0.smithi067.stdout:4/416: creat d4/d1f/f99 x:0 0 0 2024-08-31T05:21:26.035 INFO:tasks.workunit.client.0.smithi067.stdout:8/577: dread d0/d4/de/d1d/d2c/d3c/da5/d99/f9c [0,4194304] 0 2024-08-31T05:21:26.036 INFO:tasks.workunit.client.0.smithi067.stdout:8/578: chown d0/d2/da9 0 1 2024-08-31T05:21:26.038 INFO:tasks.workunit.client.0.smithi067.stdout:2/609: rename db/d12/d1a/d1e/f89 to db/d12/d1a/d2b/d3d/d69/fba 0 2024-08-31T05:21:26.039 INFO:tasks.workunit.client.0.smithi067.stdout:2/610: dread - db/d12/d1a/d1e/d4d/fae zero size 2024-08-31T05:21:26.042 INFO:tasks.workunit.client.0.smithi067.stdout:4/417: write d4/d14/d48/d66/f82 [8586588,118700] 0 2024-08-31T05:21:26.044 INFO:tasks.workunit.client.0.smithi067.stdout:3/782: link db/dbe/fd5 db/d12/d21/ffc 0 2024-08-31T05:21:26.045 INFO:tasks.workunit.client.0.smithi067.stdout:2/611: dread db/dd/d2d/da7/f6a [0,4194304] 0 2024-08-31T05:21:26.049 INFO:tasks.workunit.client.0.smithi067.stdout:7/406: dread fd [0,4194304] 0 2024-08-31T05:21:26.049 INFO:tasks.workunit.client.0.smithi067.stdout:4/418: symlink d4/d13/l9a 0 2024-08-31T05:21:26.051 INFO:tasks.workunit.client.0.smithi067.stdout:8/579: dwrite d0/d4/de/d1d/d2c/d3c/f76 [0,4194304] 0 2024-08-31T05:21:26.052 INFO:tasks.workunit.client.0.smithi067.stdout:4/419: write d4/d9/d5a/f74 [2206434,95613] 0 2024-08-31T05:21:26.053 INFO:tasks.workunit.client.0.smithi067.stdout:3/783: rename db/d5a/f73 to db/d2e/d50/d62/ffd 0 2024-08-31T05:21:26.055 INFO:tasks.workunit.client.0.smithi067.stdout:4/420: stat d4/d14/d48/d66/c75 0 2024-08-31T05:21:26.055 INFO:tasks.workunit.client.0.smithi067.stdout:3/784: stat db/d2e/d6a 0 2024-08-31T05:21:26.058 INFO:tasks.workunit.client.0.smithi067.stdout:3/785: truncate db/dbe/fd5 4278953 0 2024-08-31T05:21:26.058 INFO:tasks.workunit.client.0.smithi067.stdout:7/407: dwrite d14/d16/f41 [0,4194304] 0 2024-08-31T05:21:26.059 INFO:tasks.workunit.client.0.smithi067.stdout:8/580: unlink d0/d2/dc/d28/d7e/c86 0 2024-08-31T05:21:26.060 INFO:tasks.workunit.client.0.smithi067.stdout:7/408: stat d14/d16/d28/d2e/c30 0 2024-08-31T05:21:26.064 INFO:tasks.workunit.client.0.smithi067.stdout:3/786: dread db/d2c/f89 [0,4194304] 0 2024-08-31T05:21:26.066 INFO:tasks.workunit.client.0.smithi067.stdout:3/787: readlink db/d2c/lf6 0 2024-08-31T05:21:26.071 INFO:tasks.workunit.client.0.smithi067.stdout:4/421: creat d4/d1e/d62/f9b x:0 0 0 2024-08-31T05:21:26.073 INFO:tasks.workunit.client.0.smithi067.stdout:3/788: dwrite db/d2e/d50/d62/dc3/fed [0,4194304] 0 2024-08-31T05:21:26.074 INFO:tasks.workunit.client.0.smithi067.stdout:2/612: getdents db/dd/d2d/da7 0 2024-08-31T05:21:26.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:25 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:21:26.079 INFO:tasks.workunit.client.0.smithi067.stdout:7/409: creat d14/d3e/f70 x:0 0 0 2024-08-31T05:21:26.082 INFO:tasks.workunit.client.0.smithi067.stdout:4/422: creat d4/d1e/d21/d60/f9c x:0 0 0 2024-08-31T05:21:26.083 INFO:tasks.workunit.client.0.smithi067.stdout:3/789: dwrite db/d2e/d50/f5c [4194304,4194304] 0 2024-08-31T05:21:26.085 INFO:tasks.workunit.client.0.smithi067.stdout:8/581: creat d0/d2/dc/d3d/fbe x:0 0 0 2024-08-31T05:21:26.085 INFO:tasks.workunit.client.0.smithi067.stdout:2/613: rename db/f25 to db/d12/d1a/d2b/d40/d9b/fbb 0 2024-08-31T05:21:26.088 INFO:tasks.workunit.client.0.smithi067.stdout:7/410: write fd [3297205,57489] 0 2024-08-31T05:21:26.090 INFO:tasks.workunit.client.0.smithi067.stdout:4/423: mkdir d4/d1e/d6d/d9d 0 2024-08-31T05:21:26.090 INFO:tasks.workunit.client.0.smithi067.stdout:7/411: dread - d14/d3e/f70 zero size 2024-08-31T05:21:26.090 INFO:tasks.workunit.client.0.smithi067.stdout:3/790: dwrite db/d55/fe6 [0,4194304] 0 2024-08-31T05:21:26.098 INFO:tasks.workunit.client.0.smithi067.stdout:8/582: creat d0/d4/de/d1d/d7b/d89/fbf x:0 0 0 2024-08-31T05:21:26.099 INFO:tasks.workunit.client.0.smithi067.stdout:7/412: dwrite d14/d3e/f55 [0,4194304] 0 2024-08-31T05:21:26.099 INFO:tasks.workunit.client.0.smithi067.stdout:2/614: symlink db/d12/d1a/d2b/d42/d62/lbc 0 2024-08-31T05:21:26.100 INFO:tasks.workunit.client.0.smithi067.stdout:8/583: stat d0/d2/da/dd/d1f/l47 0 2024-08-31T05:21:26.101 INFO:tasks.workunit.client.0.smithi067.stdout:2/615: write db/d12/d1a/d2b/d3d/f46 [4717509,70939] 0 2024-08-31T05:21:26.102 INFO:tasks.workunit.client.0.smithi067.stdout:8/584: readlink d0/d4/de/l30 0 2024-08-31T05:21:26.105 INFO:tasks.workunit.client.0.smithi067.stdout:3/791: chown db/d2e/d50/d62/fb7 19163 1 2024-08-31T05:21:26.110 INFO:tasks.workunit.client.0.smithi067.stdout:7/413: getdents d14/d16/d28/d2e/d53 0 2024-08-31T05:21:26.110 INFO:tasks.workunit.client.0.smithi067.stdout:3/792: creat db/d91/ffe x:0 0 0 2024-08-31T05:21:26.114 INFO:tasks.workunit.client.0.smithi067.stdout:7/414: unlink d14/d16/d28/f5f 0 2024-08-31T05:21:26.119 INFO:tasks.workunit.client.0.smithi067.stdout:7/415: dwrite fb [0,4194304] 0 2024-08-31T05:21:26.120 INFO:tasks.workunit.client.0.smithi067.stdout:3/793: mkdir db/d12/d21/dff 0 2024-08-31T05:21:26.123 INFO:tasks.workunit.client.0.smithi067.stdout:4/424: write d4/d32/d4c/f90 [1271459,46436] 0 2024-08-31T05:21:26.128 INFO:tasks.workunit.client.0.smithi067.stdout:3/794: rename db/c1d to db/d2e/d50/c100 0 2024-08-31T05:21:26.129 INFO:tasks.workunit.client.0.smithi067.stdout:4/425: truncate d4/d9/f5e 712107 0 2024-08-31T05:21:26.132 INFO:tasks.workunit.client.0.smithi067.stdout:2/616: dwrite db/d12/d1a/f36 [0,4194304] 0 2024-08-31T05:21:26.132 INFO:tasks.workunit.client.0.smithi067.stdout:4/426: mkdir d4/d1f/d9e 0 2024-08-31T05:21:26.134 INFO:tasks.workunit.client.0.smithi067.stdout:8/585: dread d0/d4/de/d1d/d2c/f8a [0,4194304] 0 2024-08-31T05:21:26.137 INFO:tasks.workunit.client.0.smithi067.stdout:2/617: mkdir db/d12/d1a/d2b/d87/dbd 0 2024-08-31T05:21:26.142 INFO:tasks.workunit.client.0.smithi067.stdout:4/427: dwrite d4/d1e/d53/f93 [0,4194304] 0 2024-08-31T05:21:26.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:25 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:21:26.216 INFO:tasks.workunit.client.0.smithi067.stdout:0/699: sync 2024-08-31T05:21:26.335 INFO:tasks.workunit.client.0.smithi067.stdout:2/618: write db/dd/d2d/f35 [3452512,88444] 0 2024-08-31T05:21:26.340 INFO:tasks.workunit.client.0.smithi067.stdout:0/700: chown d1/df/d17/d43/d48/ld4 11269 1 2024-08-31T05:21:26.341 INFO:tasks.workunit.client.0.smithi067.stdout:8/586: dwrite d0/d2/dc/d3d/f67 [0,4194304] 0 2024-08-31T05:21:26.366 INFO:tasks.workunit.client.0.smithi067.stdout:3/795: symlink db/d2e/d50/d62/dc3/l101 0 2024-08-31T05:21:26.367 INFO:tasks.workunit.client.0.smithi067.stdout:3/796: fdatasync db/f3d 0 2024-08-31T05:21:26.367 INFO:tasks.workunit.client.0.smithi067.stdout:8/587: chown d0/d4/de/c36 6073 1 2024-08-31T05:21:26.368 INFO:tasks.workunit.client.0.smithi067.stdout:2/619: unlink db/d12/d1a/d2b/d40/c90 0 2024-08-31T05:21:26.368 INFO:tasks.workunit.client.0.smithi067.stdout:8/588: write d0/d4/de/f11 [67202,43916] 0 2024-08-31T05:21:26.371 INFO:tasks.workunit.client.0.smithi067.stdout:0/701: creat d1/df/d17/d94/fe5 x:0 0 0 2024-08-31T05:21:26.373 INFO:tasks.workunit.client.0.smithi067.stdout:4/428: getdents d4/d14/d48/d66 0 2024-08-31T05:21:26.374 INFO:tasks.workunit.client.0.smithi067.stdout:2/620: write db/d12/d1a/d2b/d3d/d69/fba [575195,76837] 0 2024-08-31T05:21:26.374 INFO:tasks.workunit.client.0.smithi067.stdout:8/589: creat d0/d2/dc/d28/d7e/d73/d84/fc0 x:0 0 0 2024-08-31T05:21:26.377 INFO:tasks.workunit.client.0.smithi067.stdout:4/429: fsync d4/d1e/f26 0 2024-08-31T05:21:26.378 INFO:tasks.workunit.client.0.smithi067.stdout:4/430: fdatasync d4/d13/f79 0 2024-08-31T05:21:26.378 INFO:tasks.workunit.client.0.smithi067.stdout:0/702: mkdir d1/df/d29/d37/de6 0 2024-08-31T05:21:26.382 INFO:tasks.workunit.client.0.smithi067.stdout:8/590: creat d0/d2/da/fc1 x:0 0 0 2024-08-31T05:21:26.382 INFO:tasks.workunit.client.0.smithi067.stdout:2/621: dread db/d12/d1a/d2b/d42/d62/f80 [0,4194304] 0 2024-08-31T05:21:26.383 INFO:tasks.workunit.client.0.smithi067.stdout:8/591: stat d0/d4/de/d1d/d2c 0 2024-08-31T05:21:26.391 INFO:tasks.workunit.client.0.smithi067.stdout:2/622: unlink db/d12/d1a/d2b/d40/f4a 0 2024-08-31T05:21:26.391 INFO:tasks.workunit.client.0.smithi067.stdout:2/623: stat db/d12/f39 0 2024-08-31T05:21:26.394 INFO:tasks.workunit.client.0.smithi067.stdout:8/592: mkdir d0/d2/dc/d3d/d98/dc2 0 2024-08-31T05:21:26.396 INFO:tasks.workunit.client.0.smithi067.stdout:4/431: write d4/d42/f57 [339526,116975] 0 2024-08-31T05:21:26.399 INFO:tasks.workunit.client.0.smithi067.stdout:2/624: creat db/d12/d1a/d31/dac/fbe x:0 0 0 2024-08-31T05:21:26.400 INFO:tasks.workunit.client.0.smithi067.stdout:4/432: write d4/d42/f8b [174499,17593] 0 2024-08-31T05:21:26.401 INFO:tasks.workunit.client.0.smithi067.stdout:0/703: dread d1/df/d29/fd3 [0,4194304] 0 2024-08-31T05:21:26.403 INFO:tasks.workunit.client.0.smithi067.stdout:0/704: rmdir d1 39 2024-08-31T05:21:26.403 INFO:tasks.workunit.client.0.smithi067.stdout:8/593: dwrite d0/d2/f83 [0,4194304] 0 2024-08-31T05:21:26.406 INFO:tasks.workunit.client.0.smithi067.stdout:4/433: unlink d4/d1e/d21/f7d 0 2024-08-31T05:21:26.409 INFO:tasks.workunit.client.0.smithi067.stdout:2/625: dwrite db/dd/d13/f29 [0,4194304] 0 2024-08-31T05:21:26.410 INFO:tasks.workunit.client.0.smithi067.stdout:4/434: symlink d4/d1e/d62/l9f 0 2024-08-31T05:21:26.412 INFO:tasks.workunit.client.0.smithi067.stdout:8/594: symlink d0/d4/de/d1d/d2c/lc3 0 2024-08-31T05:21:26.412 INFO:tasks.workunit.client.0.smithi067.stdout:0/705: rmdir d1/d8/d66 39 2024-08-31T05:21:26.415 INFO:tasks.workunit.client.0.smithi067.stdout:4/435: mknod d4/ca0 0 2024-08-31T05:21:26.415 INFO:tasks.workunit.client.0.smithi067.stdout:0/706: truncate d1/df/d17/f4c 415805 0 2024-08-31T05:21:26.416 INFO:tasks.workunit.client.0.smithi067.stdout:4/436: chown d4/d9/le 41299971 1 2024-08-31T05:21:26.417 INFO:tasks.workunit.client.0.smithi067.stdout:2/626: creat db/d12/fbf x:0 0 0 2024-08-31T05:21:26.417 INFO:tasks.workunit.client.0.smithi067.stdout:2/627: readlink db/le 0 2024-08-31T05:21:26.420 INFO:tasks.workunit.client.0.smithi067.stdout:4/437: creat d4/d1e/fa1 x:0 0 0 2024-08-31T05:21:26.422 INFO:tasks.workunit.client.0.smithi067.stdout:2/628: unlink db/d12/d1a/d1e/d4d/f59 0 2024-08-31T05:21:26.424 INFO:tasks.workunit.client.0.smithi067.stdout:0/707: dwrite d1/dd/f15 [0,4194304] 0 2024-08-31T05:21:26.426 INFO:tasks.workunit.client.0.smithi067.stdout:0/708: stat d1/df/d17/d43/d48/d6a/d84/db7/fcf 0 2024-08-31T05:21:26.431 INFO:tasks.workunit.client.0.smithi067.stdout:2/629: dwrite db/f5b [0,4194304] 0 2024-08-31T05:21:26.437 INFO:tasks.workunit.client.0.smithi067.stdout:0/709: read d1/df/d17/d94/fc5 [1310095,53233] 0 2024-08-31T05:21:26.437 INFO:tasks.workunit.client.0.smithi067.stdout:8/595: dread d0/f9 [0,4194304] 0 2024-08-31T05:21:26.442 INFO:tasks.workunit.client.0.smithi067.stdout:8/596: symlink d0/d2/dc/d28/d7e/d73/lc4 0 2024-08-31T05:21:26.445 INFO:tasks.workunit.client.0.smithi067.stdout:8/597: creat d0/d2/da/fc5 x:0 0 0 2024-08-31T05:21:26.449 INFO:tasks.workunit.client.0.smithi067.stdout:4/438: dread d4/d13/f1a [0,4194304] 0 2024-08-31T05:21:26.450 INFO:tasks.workunit.client.0.smithi067.stdout:4/439: readlink d4/d13/l3b 0 2024-08-31T05:21:26.452 INFO:tasks.workunit.client.0.smithi067.stdout:4/440: mkdir d4/d9/da2 0 2024-08-31T05:21:26.459 INFO:tasks.workunit.client.0.smithi067.stdout:4/441: dwrite d4/d9/d5a/f74 [4194304,4194304] 0 2024-08-31T05:21:26.465 INFO:tasks.workunit.client.0.smithi067.stdout:4/442: mknod d4/d32/d43/ca3 0 2024-08-31T05:21:26.467 INFO:tasks.workunit.client.0.smithi067.stdout:2/630: dwrite db/f3a [0,4194304] 0 2024-08-31T05:21:26.467 INFO:tasks.workunit.client.0.smithi067.stdout:0/710: dread d1/dd/d18/f60 [0,4194304] 0 2024-08-31T05:21:26.477 INFO:tasks.workunit.client.0.smithi067.stdout:4/443: dwrite d4/d14/d48/d66/f70 [0,4194304] 0 2024-08-31T05:21:26.478 INFO:tasks.workunit.client.0.smithi067.stdout:8/598: dwrite d0/d2/f38 [0,4194304] 0 2024-08-31T05:21:26.481 INFO:tasks.workunit.client.0.smithi067.stdout:0/711: rename d1/dd/d4d/d88/dac/f83 to d1/df/d17/d43/d48/fe7 0 2024-08-31T05:21:26.483 INFO:tasks.workunit.client.0.smithi067.stdout:0/712: chown d1/d8/d42/dc9/fdc 713 1 2024-08-31T05:21:26.483 INFO:tasks.workunit.client.0.smithi067.stdout:8/599: dread d0/d2/dc/fb2 [0,4194304] 0 2024-08-31T05:21:26.483 INFO:tasks.workunit.client.0.smithi067.stdout:2/631: creat db/d12/d1a/d1e/fc0 x:0 0 0 2024-08-31T05:21:26.485 INFO:tasks.workunit.client.0.smithi067.stdout:8/600: readlink d0/d2/dc/d28/d7e/d73/d84/la1 0 2024-08-31T05:21:26.487 INFO:tasks.workunit.client.0.smithi067.stdout:0/713: creat d1/df/d17/d43/d48/d6a/d84/db7/fe8 x:0 0 0 2024-08-31T05:21:26.489 INFO:tasks.workunit.client.0.smithi067.stdout:0/714: write d1/d8/d42/fb0 [301821,103903] 0 2024-08-31T05:21:26.490 INFO:tasks.workunit.client.0.smithi067.stdout:0/715: stat d1/df/d17/d94 0 2024-08-31T05:21:26.490 INFO:tasks.workunit.client.0.smithi067.stdout:2/632: mknod db/d12/d1a/d2b/d42/d62/cc1 0 2024-08-31T05:21:26.493 INFO:tasks.workunit.client.0.smithi067.stdout:8/601: mknod d0/d4/de/d8f/cc6 0 2024-08-31T05:21:26.500 INFO:tasks.workunit.client.0.smithi067.stdout:0/716: dwrite d1/df/d17/d43/d48/d6a/d84/db7/fe8 [0,4194304] 0 2024-08-31T05:21:26.503 INFO:tasks.workunit.client.0.smithi067.stdout:2/633: truncate db/d12/d1a/d2b/d3d/d69/d3b/d99/fb6 121134 0 2024-08-31T05:21:26.505 INFO:tasks.workunit.client.0.smithi067.stdout:2/634: symlink db/dd/d13/lc2 0 2024-08-31T05:21:26.507 INFO:tasks.workunit.client.0.smithi067.stdout:0/717: read d1/df/d17/f61 [928532,65661] 0 2024-08-31T05:21:26.509 INFO:tasks.workunit.client.0.smithi067.stdout:2/635: unlink db/d12/d1a/d2b/d3d/d4f/d6d/c74 0 2024-08-31T05:21:26.511 INFO:tasks.workunit.client.0.smithi067.stdout:2/636: chown db/dd/f17 368732350 1 2024-08-31T05:21:26.516 INFO:tasks.workunit.client.0.smithi067.stdout:0/718: dwrite d1/dd/d18/fa0 [0,4194304] 0 2024-08-31T05:21:26.518 INFO:tasks.workunit.client.0.smithi067.stdout:2/637: truncate db/dd/d2d/f5d 415061 0 2024-08-31T05:21:26.521 INFO:tasks.workunit.client.0.smithi067.stdout:0/719: creat d1/df/d17/d43/d80/fe9 x:0 0 0 2024-08-31T05:21:26.523 INFO:tasks.workunit.client.0.smithi067.stdout:2/638: mkdir db/d12/d1a/d5c/dc3 0 2024-08-31T05:21:26.529 INFO:tasks.workunit.client.0.smithi067.stdout:2/639: fsync db/d12/f6e 0 2024-08-31T05:21:26.546 INFO:tasks.workunit.client.0.smithi067.stdout:0/720: write d1/df/d17/f4c [485562,47614] 0 2024-08-31T05:21:26.551 INFO:tasks.workunit.client.0.smithi067.stdout:0/721: mknod d1/df/d29/d86/dc0/cea 0 2024-08-31T05:21:26.553 INFO:tasks.workunit.client.0.smithi067.stdout:2/640: dwrite db/dd/d2d/da7/f6a [0,4194304] 0 2024-08-31T05:21:26.554 INFO:tasks.workunit.client.0.smithi067.stdout:0/722: write d1/df/d17/d43/d48/fd2 [1030162,29202] 0 2024-08-31T05:21:26.562 INFO:tasks.workunit.client.0.smithi067.stdout:0/723: mkdir d1/d8/d42/dc9/deb 0 2024-08-31T05:21:26.564 INFO:tasks.workunit.client.0.smithi067.stdout:2/641: rename db/d12/d1a/d5c to db/d12/d1a/d2b/d42/da0/dc4 0 2024-08-31T05:21:26.567 INFO:tasks.workunit.client.0.smithi067.stdout:0/724: chown d1/dd/d4d/c53 445026318 1 2024-08-31T05:21:26.569 INFO:tasks.workunit.client.0.smithi067.stdout:0/725: write d1/df/d17/d43/d48/d6a/d84/db7/fd8 [320621,104141] 0 2024-08-31T05:21:26.576 INFO:tasks.workunit.client.0.smithi067.stdout:0/726: link d1/dd/d4d/c53 d1/dd/d71/d90/cec 0 2024-08-31T05:21:26.583 INFO:tasks.workunit.client.0.smithi067.stdout:2/642: dread db/d12/d1a/d1e/d4d/f94 [0,4194304] 0 2024-08-31T05:21:26.584 INFO:tasks.workunit.client.0.smithi067.stdout:0/727: write d1/df/d17/d43/f64 [66282,82404] 0 2024-08-31T05:21:26.585 INFO:tasks.workunit.client.0.smithi067.stdout:0/728: chown d1/d50/fd6 3509 1 2024-08-31T05:21:26.586 INFO:tasks.workunit.client.0.smithi067.stdout:2/643: creat db/d12/d1a/d2b/d42/da0/fc5 x:0 0 0 2024-08-31T05:21:26.588 INFO:tasks.workunit.client.0.smithi067.stdout:0/729: mknod d1/dd/ced 0 2024-08-31T05:21:26.591 INFO:tasks.workunit.client.0.smithi067.stdout:2/644: mknod db/dd/cc6 0 2024-08-31T05:21:26.593 INFO:tasks.workunit.client.0.smithi067.stdout:2/645: dread db/d12/d1a/d2b/d40/d9b/fbb [0,4194304] 0 2024-08-31T05:21:26.595 INFO:tasks.workunit.client.0.smithi067.stdout:0/730: creat d1/d8/fee x:0 0 0 2024-08-31T05:21:26.596 INFO:tasks.workunit.client.0.smithi067.stdout:0/731: read d1/d8/f23 [4096433,78350] 0 2024-08-31T05:21:26.597 INFO:tasks.workunit.client.0.smithi067.stdout:2/646: mknod db/dd/d2d/db7/cc7 0 2024-08-31T05:21:26.598 INFO:tasks.workunit.client.0.smithi067.stdout:2/647: dread - db/d12/d1a/d2b/d87/f9d zero size 2024-08-31T05:21:26.600 INFO:tasks.workunit.client.0.smithi067.stdout:0/732: rename d1/d8/d42/dc9/fdc to d1/d8/d42/d98/dbf/fef 0 2024-08-31T05:21:26.603 INFO:tasks.workunit.client.0.smithi067.stdout:2/648: symlink db/dd/d13/lc8 0 2024-08-31T05:21:26.605 INFO:tasks.workunit.client.0.smithi067.stdout:0/733: dread d1/df/d17/d43/d48/fd2 [0,4194304] 0 2024-08-31T05:21:26.605 INFO:tasks.workunit.client.0.smithi067.stdout:0/734: chown d1/f67 109 1 2024-08-31T05:21:26.607 INFO:tasks.workunit.client.0.smithi067.stdout:2/649: creat db/d12/d1a/d2b/d40/d9b/fc9 x:0 0 0 2024-08-31T05:21:26.609 INFO:tasks.workunit.client.0.smithi067.stdout:2/650: truncate db/f70 1611886 0 2024-08-31T05:21:26.613 INFO:tasks.workunit.client.0.smithi067.stdout:0/735: creat d1/d8/ff0 x:0 0 0 2024-08-31T05:21:26.615 INFO:tasks.workunit.client.0.smithi067.stdout:0/736: unlink d1/d8/d42/d98/l9b 0 2024-08-31T05:21:26.616 INFO:tasks.workunit.client.0.smithi067.stdout:0/737: write d1/d50/f57 [865975,19065] 0 2024-08-31T05:21:26.621 INFO:tasks.workunit.client.0.smithi067.stdout:2/651: write db/dd/d13/f14 [2071022,56534] 0 2024-08-31T05:21:26.622 INFO:tasks.workunit.client.0.smithi067.stdout:2/652: chown db/d12/d1a/d1e/d4d/f94 0 1 2024-08-31T05:21:26.624 INFO:tasks.workunit.client.0.smithi067.stdout:0/738: getdents d1/dd/d18/d52/dc6 0 2024-08-31T05:21:26.631 INFO:tasks.workunit.client.0.smithi067.stdout:0/739: dwrite d1/df/d17/f4c [0,4194304] 0 2024-08-31T05:21:26.632 INFO:tasks.workunit.client.0.smithi067.stdout:0/740: dread d1/df/f6d [0,4194304] 0 2024-08-31T05:21:26.633 INFO:tasks.workunit.client.0.smithi067.stdout:2/653: creat db/d12/d1a/d2b/d42/fca x:0 0 0 2024-08-31T05:21:26.634 INFO:tasks.workunit.client.0.smithi067.stdout:0/741: write d1/d8/d42/f8b [2867831,59251] 0 2024-08-31T05:21:26.636 INFO:tasks.workunit.client.0.smithi067.stdout:0/742: chown d1/d8/d42/d98/le1 492 1 2024-08-31T05:21:26.641 INFO:tasks.workunit.client.0.smithi067.stdout:0/743: mkdir d1/d8/d42/d98/df1 0 2024-08-31T05:21:26.641 INFO:tasks.workunit.client.0.smithi067.stdout:2/654: getdents db/dd/d2d 0 2024-08-31T05:21:26.648 INFO:tasks.workunit.client.0.smithi067.stdout:2/655: link db/d12/d1a/d2b/d3d/d69/f26 db/d12/d1a/d2b/d3d/d4f/fcb 0 2024-08-31T05:21:26.651 INFO:tasks.workunit.client.0.smithi067.stdout:0/744: write d1/f67 [575498,126100] 0 2024-08-31T05:21:26.654 INFO:tasks.workunit.client.0.smithi067.stdout:0/745: creat d1/dd/d18/ff2 x:0 0 0 2024-08-31T05:21:26.654 INFO:tasks.workunit.client.0.smithi067.stdout:2/656: truncate db/d12/d1a/d2b/d3d/d69/d3b/d99/fb6 490605 0 2024-08-31T05:21:26.658 INFO:tasks.workunit.client.0.smithi067.stdout:2/657: rename db/d12/d1a/d2b/d40/fb2 to db/d12/d1a/d2b/d3d/d4f/d6d/fcc 0 2024-08-31T05:21:26.659 INFO:tasks.workunit.client.0.smithi067.stdout:0/746: dwrite d1/d8/d42/f8b [0,4194304] 0 2024-08-31T05:21:26.668 INFO:tasks.workunit.client.0.smithi067.stdout:2/658: dwrite db/d12/d1a/d2b/d3d/f8f [4194304,4194304] 0 2024-08-31T05:21:26.677 INFO:tasks.workunit.client.0.smithi067.stdout:2/659: dwrite db/d12/d1a/d2b/d3d/d69/fba [0,4194304] 0 2024-08-31T05:21:26.678 INFO:tasks.workunit.client.0.smithi067.stdout:2/660: stat db/d12/d1a/d2b/d3d/d4f/d63/f6f 0 2024-08-31T05:21:26.682 INFO:tasks.workunit.client.0.smithi067.stdout:0/747: dread d1/d8/f4b [0,4194304] 0 2024-08-31T05:21:26.682 INFO:tasks.workunit.client.0.smithi067.stdout:2/661: rename db/d12/d1a/d31 to db/d8c/dcd 0 2024-08-31T05:21:26.684 INFO:tasks.workunit.client.0.smithi067.stdout:2/662: write db/d12/d1a/f96 [29315,10279] 0 2024-08-31T05:21:26.685 INFO:tasks.workunit.client.0.smithi067.stdout:0/748: truncate d1/d8/d42/d98/dbf/fdf 849116 0 2024-08-31T05:21:26.686 INFO:tasks.workunit.client.0.smithi067.stdout:0/749: chown d1/df/d17/d94 19 1 2024-08-31T05:21:26.687 INFO:tasks.workunit.client.0.smithi067.stdout:0/750: readlink d1/dd/d4d/l5a 0 2024-08-31T05:21:26.695 INFO:tasks.workunit.client.0.smithi067.stdout:2/663: creat db/dd/d13/d9f/fce x:0 0 0 2024-08-31T05:21:26.696 INFO:tasks.workunit.client.0.smithi067.stdout:0/751: truncate d1/df/f6d 1371588 0 2024-08-31T05:21:26.697 INFO:tasks.workunit.client.0.smithi067.stdout:0/752: dread - d1/dd/d4d/d88/dac/dc3/fe2 zero size 2024-08-31T05:21:26.699 INFO:tasks.workunit.client.0.smithi067.stdout:2/664: mknod db/d12/d1a/d2b/d42/da0/ccf 0 2024-08-31T05:21:26.703 INFO:tasks.workunit.client.0.smithi067.stdout:0/753: dwrite d1/df/d17/f4c [0,4194304] 0 2024-08-31T05:21:26.707 INFO:tasks.workunit.client.0.smithi067.stdout:0/754: creat d1/d50/ff3 x:0 0 0 2024-08-31T05:21:26.708 INFO:tasks.workunit.client.0.smithi067.stdout:0/755: chown d1/df/d29/d37/fda 740844 1 2024-08-31T05:21:26.708 INFO:tasks.workunit.client.0.smithi067.stdout:2/665: mknod db/d12/d1a/da3/cd0 0 2024-08-31T05:21:26.712 INFO:tasks.workunit.client.0.smithi067.stdout:2/666: symlink db/d12/d1a/d2b/d3d/d69/d3b/ld1 0 2024-08-31T05:21:26.715 INFO:tasks.workunit.client.0.smithi067.stdout:0/756: creat d1/df/d17/d43/d48/d6a/d84/db7/ff4 x:0 0 0 2024-08-31T05:21:26.716 INFO:tasks.workunit.client.0.smithi067.stdout:0/757: write d1/d50/f57 [4175749,42155] 0 2024-08-31T05:21:26.721 INFO:tasks.workunit.client.0.smithi067.stdout:2/667: mkdir db/d12/d1a/dd2 0 2024-08-31T05:21:26.724 INFO:tasks.workunit.client.0.smithi067.stdout:2/668: symlink db/dd/d2d/db7/ld3 0 2024-08-31T05:21:26.729 INFO:tasks.workunit.client.0.smithi067.stdout:0/758: getdents d1/df/d17/dc1 0 2024-08-31T05:21:26.731 INFO:tasks.workunit.client.0.smithi067.stdout:2/669: rename db/c48 to db/d12/d1a/da3/cd4 0 2024-08-31T05:21:26.733 INFO:tasks.workunit.client.0.smithi067.stdout:0/759: fsync d1/df/f6d 0 2024-08-31T05:21:26.740 INFO:tasks.workunit.client.0.smithi067.stdout:2/670: dwrite db/dd/d13/f88 [0,4194304] 0 2024-08-31T05:21:26.740 INFO:tasks.workunit.client.0.smithi067.stdout:0/760: mkdir d1/dd/d18/d52/dc6/df5 0 2024-08-31T05:21:26.742 INFO:tasks.workunit.client.0.smithi067.stdout:2/671: dread - db/dd/d13/d9f/fce zero size 2024-08-31T05:21:26.747 INFO:tasks.workunit.client.0.smithi067.stdout:2/672: mkdir db/d12/d1a/d1e/d4d/dd5 0 2024-08-31T05:21:26.751 INFO:tasks.workunit.client.0.smithi067.stdout:2/673: mknod db/dd/cd6 0 2024-08-31T05:21:26.752 INFO:tasks.workunit.client.0.smithi067.stdout:2/674: chown db/dd/d13/f88 45136 1 2024-08-31T05:21:26.759 INFO:tasks.workunit.client.0.smithi067.stdout:2/675: getdents db/d12/d1a 0 2024-08-31T05:21:26.763 INFO:tasks.workunit.client.0.smithi067.stdout:2/676: symlink db/dd/ld7 0 2024-08-31T05:21:26.772 INFO:tasks.workunit.client.0.smithi067.stdout:0/761: truncate d1/df/d17/d43/d80/fae 275327 0 2024-08-31T05:21:26.778 INFO:tasks.workunit.client.0.smithi067.stdout:0/762: dread d1/d8/f33 [0,4194304] 0 2024-08-31T05:21:26.782 INFO:tasks.workunit.client.0.smithi067.stdout:0/763: dread d1/d50/f6c [0,4194304] 0 2024-08-31T05:21:26.789 INFO:tasks.workunit.client.0.smithi067.stdout:2/677: dwrite db/d12/d1a/d2b/d3d/d4f/d63/f75 [0,4194304] 0 2024-08-31T05:21:26.813 INFO:tasks.workunit.client.0.smithi067.stdout:0/764: write d1/df/d17/d94/fa4 [927929,69337] 0 2024-08-31T05:21:26.816 INFO:tasks.workunit.client.0.smithi067.stdout:0/765: mkdir d1/d8/d77/df6 0 2024-08-31T05:21:26.817 INFO:tasks.workunit.client.0.smithi067.stdout:0/766: readlink d1/dd/l7a 0 2024-08-31T05:21:26.817 INFO:tasks.workunit.client.0.smithi067.stdout:0/767: stat d1/d8/f4b 0 2024-08-31T05:21:26.819 INFO:tasks.workunit.client.0.smithi067.stdout:0/768: read d1/df/d17/f4c [1508559,121716] 0 2024-08-31T05:21:26.821 INFO:tasks.workunit.client.0.smithi067.stdout:0/769: fdatasync d1/df/d17/d43/d48/fe7 0 2024-08-31T05:21:26.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:26 smithi067 ceph-mon[17432]: pgmap v34: 65 pgs: 65 active+clean; 2.5 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 63 MiB/s rd, 205 MiB/s wr, 459 op/s 2024-08-31T05:21:26.827 INFO:tasks.workunit.client.0.smithi067.stdout:2/678: dwrite db/dd/f33 [0,4194304] 0 2024-08-31T05:21:26.830 INFO:tasks.workunit.client.0.smithi067.stdout:0/770: creat d1/df/d29/d86/db1/ff7 x:0 0 0 2024-08-31T05:21:26.838 INFO:tasks.workunit.client.0.smithi067.stdout:0/771: rename d1/dd/l2e to d1/d8/d42/d98/df1/lf8 0 2024-08-31T05:21:26.838 INFO:tasks.workunit.client.0.smithi067.stdout:2/679: mknod db/d12/d1a/d1e/d4d/dd5/cd8 0 2024-08-31T05:21:26.847 INFO:tasks.workunit.client.0.smithi067.stdout:2/680: getdents db/d12/d1a/d2b/d87/dbd 0 2024-08-31T05:21:26.849 INFO:tasks.workunit.client.0.smithi067.stdout:0/772: rename d1/df/d29/fc4 to d1/df/d29/d37/ff9 0 2024-08-31T05:21:26.850 INFO:tasks.workunit.client.0.smithi067.stdout:2/681: chown db/f70 78510521 1 2024-08-31T05:21:26.851 INFO:tasks.workunit.client.0.smithi067.stdout:2/682: fsync db/d12/d1a/d2b/d3d/f46 0 2024-08-31T05:21:26.853 INFO:tasks.workunit.client.0.smithi067.stdout:0/773: truncate d1/dd/d18/f9a 2327114 0 2024-08-31T05:21:26.857 INFO:tasks.workunit.client.0.smithi067.stdout:0/774: symlink d1/df/d17/d43/d48/d6a/d84/lfa 0 2024-08-31T05:21:26.859 INFO:tasks.workunit.client.0.smithi067.stdout:2/683: link db/d12/fbf db/d12/d1a/d2b/d3d/d4f/d6d/fd9 0 2024-08-31T05:21:26.860 INFO:tasks.workunit.client.0.smithi067.stdout:2/684: write db/dd/f4c [4302431,53202] 0 2024-08-31T05:21:26.866 INFO:tasks.workunit.client.0.smithi067.stdout:2/685: creat db/d12/d1a/d2b/d87/dbd/fda x:0 0 0 2024-08-31T05:21:26.875 INFO:tasks.workunit.client.0.smithi067.stdout:2/686: creat db/d12/d1a/d2b/d42/d62/fdb x:0 0 0 2024-08-31T05:21:26.876 INFO:tasks.workunit.client.0.smithi067.stdout:0/775: write d1/df/d17/f4c [5111672,3903] 0 2024-08-31T05:21:26.885 INFO:tasks.workunit.client.0.smithi067.stdout:0/776: getdents d1/dd 0 2024-08-31T05:21:26.885 INFO:tasks.workunit.client.0.smithi067.stdout:2/687: read db/d12/d1a/d2b/d42/d62/f79 [3302748,42662] 0 2024-08-31T05:21:26.888 INFO:tasks.workunit.client.0.smithi067.stdout:2/688: mkdir db/d12/d1a/da3/ddc 0 2024-08-31T05:21:26.892 INFO:tasks.workunit.client.0.smithi067.stdout:0/777: dwrite d1/df/d17/d94/f9e [0,4194304] 0 2024-08-31T05:21:26.893 INFO:tasks.workunit.client.0.smithi067.stdout:0/778: fsync d1/d50/fd6 0 2024-08-31T05:21:26.895 INFO:tasks.workunit.client.0.smithi067.stdout:2/689: dread db/dd/d13/f29 [0,4194304] 0 2024-08-31T05:21:26.899 INFO:tasks.workunit.client.0.smithi067.stdout:0/779: dwrite d1/dd/f21 [0,4194304] 0 2024-08-31T05:21:26.900 INFO:tasks.workunit.client.0.smithi067.stdout:0/780: write d1/f67 [1492530,51285] 0 2024-08-31T05:21:26.906 INFO:tasks.workunit.client.0.smithi067.stdout:0/781: creat d1/d8/d42/dc9/ffb x:0 0 0 2024-08-31T05:21:26.907 INFO:tasks.workunit.client.0.smithi067.stdout:0/782: dread - d1/df/d17/d43/d48/f92 zero size 2024-08-31T05:21:26.910 INFO:tasks.workunit.client.0.smithi067.stdout:0/783: creat d1/dd/d4d/d88/dac/dc3/ffc x:0 0 0 2024-08-31T05:21:26.925 INFO:tasks.workunit.client.0.smithi067.stdout:0/784: dread d1/df/d17/d94/fbd [0,4194304] 0 2024-08-31T05:21:26.928 INFO:tasks.workunit.client.0.smithi067.stdout:0/785: getdents d1 0 2024-08-31T05:21:26.930 INFO:tasks.workunit.client.0.smithi067.stdout:0/786: rename d1/dd/d4d/d88/dac/dc3 to d1/df/d17/d43/d48/d6a/dfd 0 2024-08-31T05:21:27.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:26 smithi073 ceph-mon[24726]: pgmap v34: 65 pgs: 65 active+clean; 2.5 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 63 MiB/s rd, 205 MiB/s wr, 459 op/s 2024-08-31T05:21:27.398 INFO:tasks.workunit.client.0.smithi067.stdout:9/490: sync 2024-08-31T05:21:27.415 INFO:tasks.workunit.client.0.smithi067.stdout:9/491: dread dd/df/f11 [0,4194304] 0 2024-08-31T05:21:27.419 INFO:tasks.workunit.client.0.smithi067.stdout:9/492: write dd/f3f [5435475,4327] 0 2024-08-31T05:21:27.430 INFO:tasks.workunit.client.0.smithi067.stdout:9/493: write dd/df/d25/d3b/f5e [2801453,56332] 0 2024-08-31T05:21:27.434 INFO:tasks.workunit.client.0.smithi067.stdout:9/494: mknod dd/df/d5b/d5d/d7a/ca1 0 2024-08-31T05:21:27.435 INFO:tasks.workunit.client.0.smithi067.stdout:9/495: mkdir dd/da2 0 2024-08-31T05:21:27.437 INFO:tasks.workunit.client.0.smithi067.stdout:9/496: mkdir dd/d63/da3 0 2024-08-31T05:21:27.440 INFO:tasks.workunit.client.0.smithi067.stdout:9/497: rename dd/d20/f55 to dd/df/d25/fa4 0 2024-08-31T05:21:27.452 INFO:tasks.workunit.client.0.smithi067.stdout:9/498: dwrite dd/df/f11 [0,4194304] 0 2024-08-31T05:21:27.457 INFO:tasks.workunit.client.0.smithi067.stdout:9/499: symlink dd/d63/la5 0 2024-08-31T05:21:27.458 INFO:tasks.workunit.client.0.smithi067.stdout:9/500: symlink dd/d4d/la6 0 2024-08-31T05:21:27.462 INFO:tasks.workunit.client.0.smithi067.stdout:9/501: creat dd/df/d25/d59/fa7 x:0 0 0 2024-08-31T05:21:27.463 INFO:tasks.workunit.client.0.smithi067.stdout:9/502: readlink dd/d63/la5 0 2024-08-31T05:21:27.475 INFO:tasks.workunit.client.0.smithi067.stdout:9/503: truncate dd/df/d25/d3b/d50/d73/f86 3261105 0 2024-08-31T05:21:27.477 INFO:tasks.workunit.client.0.smithi067.stdout:9/504: unlink dd/d4d/f4f 0 2024-08-31T05:21:27.480 INFO:tasks.workunit.client.0.smithi067.stdout:9/505: chown dd/d63/d72/c95 63 1 2024-08-31T05:21:27.480 INFO:tasks.workunit.client.0.smithi067.stdout:9/506: readlink dd/d4d/la6 0 2024-08-31T05:21:27.480 INFO:tasks.workunit.client.0.smithi067.stdout:9/507: readlink dd/l19 0 2024-08-31T05:21:27.490 INFO:tasks.workunit.client.0.smithi067.stdout:9/508: write dd/d63/f88 [1434774,64026] 0 2024-08-31T05:21:27.490 INFO:tasks.workunit.client.0.smithi067.stdout:9/509: dread - dd/f9b zero size 2024-08-31T05:21:27.493 INFO:tasks.workunit.client.0.smithi067.stdout:9/510: unlink dd/d20/l4b 0 2024-08-31T05:21:27.494 INFO:tasks.workunit.client.0.smithi067.stdout:9/511: chown dd/d20/c4c 0 1 2024-08-31T05:21:27.496 INFO:tasks.workunit.client.0.smithi067.stdout:9/512: link dd/f1a dd/da2/fa8 0 2024-08-31T05:21:27.499 INFO:tasks.workunit.client.0.smithi067.stdout:9/513: rename dd/df/d25/d3b/f41 to dd/df/d8e/fa9 0 2024-08-31T05:21:27.502 INFO:tasks.workunit.client.0.smithi067.stdout:9/514: link dd/df/f43 dd/d63/da3/faa 0 2024-08-31T05:21:27.511 INFO:tasks.workunit.client.0.smithi067.stdout:9/515: getdents dd/df/d25/d3b/d50 0 2024-08-31T05:21:27.512 INFO:tasks.workunit.client.0.smithi067.stdout:9/516: write dd/df/f1f [1139148,101998] 0 2024-08-31T05:21:27.513 INFO:tasks.workunit.client.0.smithi067.stdout:9/517: chown dd/df/d25/d3b/d50/f61 592077 1 2024-08-31T05:21:27.516 INFO:tasks.workunit.client.0.smithi067.stdout:9/518: rename dd/df/d25/d3b/f5e to dd/d63/d72/fab 0 2024-08-31T05:21:27.516 INFO:tasks.workunit.client.0.smithi067.stdout:9/519: readlink dd/df/d5b/d5d/l6f 0 2024-08-31T05:21:27.519 INFO:tasks.workunit.client.0.smithi067.stdout:9/520: rename dd/c74 to dd/df/d5b/d5d/cac 0 2024-08-31T05:21:27.521 INFO:tasks.workunit.client.0.smithi067.stdout:9/521: chown dd/d20/f2f 10714793 1 2024-08-31T05:21:27.535 INFO:tasks.workunit.client.0.smithi067.stdout:9/522: dread dd/df/f54 [0,4194304] 0 2024-08-31T05:21:27.541 INFO:tasks.workunit.client.0.smithi067.stdout:9/523: dwrite dd/d63/d72/fab [4194304,4194304] 0 2024-08-31T05:21:27.544 INFO:tasks.workunit.client.0.smithi067.stdout:9/524: mknod dd/d63/cad 0 2024-08-31T05:21:27.546 INFO:tasks.workunit.client.0.smithi067.stdout:9/525: creat dd/df/d25/d59/fae x:0 0 0 2024-08-31T05:21:27.547 INFO:tasks.workunit.client.0.smithi067.stdout:9/526: write f7 [3913854,120446] 0 2024-08-31T05:21:27.551 INFO:tasks.workunit.client.0.smithi067.stdout:9/527: unlink dd/d63/c66 0 2024-08-31T05:21:27.554 INFO:tasks.workunit.client.0.smithi067.stdout:9/528: rename dd/df/d25/c8b to dd/df/d25/d3b/caf 0 2024-08-31T05:21:27.562 INFO:tasks.workunit.client.0.smithi067.stdout:9/529: dwrite dd/df/d25/d59/f9d [0,4194304] 0 2024-08-31T05:21:27.564 INFO:tasks.workunit.client.0.smithi067.stdout:9/530: unlink dd/f3f 0 2024-08-31T05:21:27.568 INFO:tasks.workunit.client.0.smithi067.stdout:9/531: mknod dd/df/d3c/cb0 0 2024-08-31T05:21:27.584 INFO:tasks.workunit.client.0.smithi067.stdout:9/532: dwrite dd/f36 [0,4194304] 0 2024-08-31T05:21:27.585 INFO:tasks.workunit.client.0.smithi067.stdout:9/533: write dd/df/f11 [1504691,17103] 0 2024-08-31T05:21:27.590 INFO:tasks.workunit.client.0.smithi067.stdout:9/534: creat dd/df/d25/d3b/d50/d73/fb1 x:0 0 0 2024-08-31T05:21:27.593 INFO:tasks.workunit.client.0.smithi067.stdout:9/535: creat dd/df/d25/d3b/d50/d73/fb2 x:0 0 0 2024-08-31T05:21:27.601 INFO:tasks.workunit.client.0.smithi067.stdout:9/536: rename dd/d63/d72/l96 to dd/d4d/lb3 0 2024-08-31T05:21:27.603 INFO:tasks.workunit.client.0.smithi067.stdout:9/537: mknod dd/d63/da3/cb4 0 2024-08-31T05:21:27.610 INFO:tasks.workunit.client.0.smithi067.stdout:9/538: dwrite dd/df/d25/d3b/f97 [0,4194304] 0 2024-08-31T05:21:27.622 INFO:tasks.workunit.client.0.smithi067.stdout:9/539: dwrite dd/df/d25/f5f [0,4194304] 0 2024-08-31T05:21:27.629 INFO:tasks.workunit.client.0.smithi067.stdout:9/540: truncate dd/df/d25/d3b/f52 42496 0 2024-08-31T05:21:27.630 INFO:tasks.workunit.client.0.smithi067.stdout:9/541: fsync dd/f42 0 2024-08-31T05:21:27.633 INFO:tasks.workunit.client.0.smithi067.stdout:9/542: mkdir dd/df/db5 0 2024-08-31T05:21:27.636 INFO:tasks.workunit.client.0.smithi067.stdout:9/543: symlink dd/d63/lb6 0 2024-08-31T05:21:27.662 INFO:tasks.workunit.client.0.smithi067.stdout:9/544: write dd/df/f2e [2867673,102341] 0 2024-08-31T05:21:27.666 INFO:tasks.workunit.client.0.smithi067.stdout:6/723: sync 2024-08-31T05:21:27.666 INFO:tasks.workunit.client.0.smithi067.stdout:1/379: sync 2024-08-31T05:21:27.667 INFO:tasks.workunit.client.0.smithi067.stdout:9/545: dread dd/df/d25/d3b/f97 [0,4194304] 0 2024-08-31T05:21:27.667 INFO:tasks.workunit.client.0.smithi067.stdout:6/724: stat d1b/d8e/d62/lac 0 2024-08-31T05:21:27.668 INFO:tasks.workunit.client.0.smithi067.stdout:9/546: stat dd/df/d25/d59/fa7 0 2024-08-31T05:21:27.675 INFO:tasks.workunit.client.0.smithi067.stdout:9/547: symlink dd/lb7 0 2024-08-31T05:21:27.675 INFO:tasks.workunit.client.0.smithi067.stdout:1/380: truncate d3/dd/f4e 1839889 0 2024-08-31T05:21:27.677 INFO:tasks.workunit.client.0.smithi067.stdout:6/725: getdents d1b/d7a 0 2024-08-31T05:21:27.679 INFO:tasks.workunit.client.0.smithi067.stdout:1/381: chown d3/d23/d5d/f60 0 1 2024-08-31T05:21:27.679 INFO:tasks.workunit.client.0.smithi067.stdout:6/726: dread d1b/d40/d96/db3/fb5 [0,4194304] 0 2024-08-31T05:21:27.679 INFO:tasks.workunit.client.0.smithi067.stdout:9/548: truncate dd/df/d25/d3b/d50/f90 294360 0 2024-08-31T05:21:27.682 INFO:tasks.workunit.client.0.smithi067.stdout:1/382: creat d3/dd/d50/f8c x:0 0 0 2024-08-31T05:21:27.686 INFO:tasks.workunit.client.0.smithi067.stdout:1/383: unlink d3/dd/d50/l6b 0 2024-08-31T05:21:27.686 INFO:tasks.workunit.client.0.smithi067.stdout:6/727: dwrite d1b/f74 [0,4194304] 0 2024-08-31T05:21:27.691 INFO:tasks.workunit.client.0.smithi067.stdout:1/384: creat d3/d36/f8d x:0 0 0 2024-08-31T05:21:27.691 INFO:tasks.workunit.client.0.smithi067.stdout:9/549: link dd/d20/c4c dd/df/db5/cb8 0 2024-08-31T05:21:27.693 INFO:tasks.workunit.client.0.smithi067.stdout:9/550: write dd/d63/f88 [255920,34088] 0 2024-08-31T05:21:27.703 INFO:tasks.workunit.client.0.smithi067.stdout:6/728: rename d1b/f3e to d1b/d40/d70/dd0/d5e/de6/fe9 0 2024-08-31T05:21:27.711 INFO:tasks.workunit.client.0.smithi067.stdout:6/729: mknod d1b/d40/de8/cea 0 2024-08-31T05:21:27.712 INFO:tasks.workunit.client.0.smithi067.stdout:6/730: read d1b/d30/f73 [695783,14664] 0 2024-08-31T05:21:27.713 INFO:tasks.workunit.client.0.smithi067.stdout:1/385: write d3/d23/d2d/d2e/d34/f59 [124269,119212] 0 2024-08-31T05:21:27.714 INFO:tasks.workunit.client.0.smithi067.stdout:1/386: readlink d3/d23/d2d/d2e/l58 0 2024-08-31T05:21:27.716 INFO:tasks.workunit.client.0.smithi067.stdout:1/387: read d3/d23/d2d/d2e/f37 [1959557,32316] 0 2024-08-31T05:21:27.951 INFO:tasks.workunit.client.0.smithi067.stdout:7/416: sync 2024-08-31T05:21:27.951 INFO:tasks.workunit.client.0.smithi067.stdout:0/787: sync 2024-08-31T05:21:27.951 INFO:tasks.workunit.client.0.smithi067.stdout:3/797: sync 2024-08-31T05:21:27.951 INFO:tasks.workunit.client.0.smithi067.stdout:4/444: sync 2024-08-31T05:21:27.951 INFO:tasks.workunit.client.0.smithi067.stdout:8/602: sync 2024-08-31T05:21:27.951 INFO:tasks.workunit.client.0.smithi067.stdout:5/529: sync 2024-08-31T05:21:27.951 INFO:tasks.workunit.client.0.smithi067.stdout:2/690: sync 2024-08-31T05:21:27.952 INFO:tasks.workunit.client.0.smithi067.stdout:2/691: stat db/d12/d1a/fa5 0 2024-08-31T05:21:27.954 INFO:tasks.workunit.client.0.smithi067.stdout:2/692: write f1 [2165233,71066] 0 2024-08-31T05:21:27.954 INFO:tasks.workunit.client.0.smithi067.stdout:3/798: write db/fc7 [972396,71952] 0 2024-08-31T05:21:27.958 INFO:tasks.workunit.client.0.smithi067.stdout:3/799: chown db/d17/d3f/d54/d56/d6e/f9a 14221 1 2024-08-31T05:21:27.963 INFO:tasks.workunit.client.0.smithi067.stdout:8/603: dwrite d0/d2/dc/d28/d7e/d73/d84/fc0 [0,4194304] 0 2024-08-31T05:21:27.967 INFO:tasks.workunit.client.0.smithi067.stdout:8/604: dread d0/f9 [0,4194304] 0 2024-08-31T05:21:27.974 INFO:tasks.workunit.client.0.smithi067.stdout:7/417: dread d14/d16/f32 [0,4194304] 0 2024-08-31T05:21:27.987 INFO:tasks.workunit.client.0.smithi067.stdout:8/605: dread d0/d2/f24 [0,4194304] 0 2024-08-31T05:21:27.994 INFO:tasks.workunit.client.0.smithi067.stdout:5/530: mkdir db/d1d/d4f/da8 0 2024-08-31T05:21:27.994 INFO:tasks.workunit.client.0.smithi067.stdout:8/606: dwrite d0/d4/f71 [0,4194304] 0 2024-08-31T05:21:27.997 INFO:tasks.workunit.client.0.smithi067.stdout:8/607: fsync d0/d2/dc/d28/d7e/d73/d84/da6/db1/d8c/f9b 0 2024-08-31T05:21:28.004 INFO:tasks.workunit.client.0.smithi067.stdout:3/800: creat db/d2e/d50/d62/dc3/f102 x:0 0 0 2024-08-31T05:21:28.077 INFO:tasks.workunit.client.0.smithi067.stdout:7/418: dread - d14/d16/f5d zero size 2024-08-31T05:21:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:3/801: creat db/d4e/f103 x:0 0 0 2024-08-31T05:21:28.086 INFO:tasks.workunit.client.0.smithi067.stdout:3/802: creat db/d17/d3f/d54/ddf/f104 x:0 0 0 2024-08-31T05:21:28.088 INFO:tasks.workunit.client.0.smithi067.stdout:2/693: getdents db 0 2024-08-31T05:21:28.093 INFO:tasks.workunit.client.0.smithi067.stdout:8/608: mkdir d0/d4/de/d1d/d2c/d3c/da5/dc7 0 2024-08-31T05:21:28.093 INFO:tasks.workunit.client.0.smithi067.stdout:7/419: dread d14/d16/f1d [0,4194304] 0 2024-08-31T05:21:28.095 INFO:tasks.workunit.client.0.smithi067.stdout:7/420: read - d14/d16/d5b/d64/f61 zero size 2024-08-31T05:21:28.138 INFO:tasks.workunit.client.0.smithi067.stdout:3/803: dwrite db/d17/d3f/f4b [0,4194304] 0 2024-08-31T05:21:28.138 INFO:tasks.workunit.client.0.smithi067.stdout:2/694: dwrite db/f4b [0,4194304] 0 2024-08-31T05:21:28.142 INFO:tasks.workunit.client.0.smithi067.stdout:8/609: rename d0/d2/l12 to d0/d2/da/dd/d1f/lc8 0 2024-08-31T05:21:28.143 INFO:tasks.workunit.client.0.smithi067.stdout:8/610: write d0/d4/f71 [986555,1348] 0 2024-08-31T05:21:28.147 INFO:tasks.workunit.client.0.smithi067.stdout:7/421: rename d14/l21 to d14/d16/d28/d2e/d2f/l71 0 2024-08-31T05:21:28.151 INFO:tasks.workunit.client.0.smithi067.stdout:8/611: mknod d0/d4a/cc9 0 2024-08-31T05:21:28.159 INFO:tasks.workunit.client.0.smithi067.stdout:8/612: symlink d0/d2/dc/d28/d7e/da3/lca 0 2024-08-31T05:21:28.162 INFO:tasks.workunit.client.0.smithi067.stdout:3/804: creat db/d12/d21/d82/f105 x:0 0 0 2024-08-31T05:21:28.163 INFO:tasks.workunit.client.0.smithi067.stdout:2/695: rename l9 to db/dd/ldd 0 2024-08-31T05:21:28.167 INFO:tasks.workunit.client.0.smithi067.stdout:7/422: getdents d14/d16/d28 0 2024-08-31T05:21:28.169 INFO:tasks.workunit.client.0.smithi067.stdout:3/805: dwrite db/d2c/f48 [4194304,4194304] 0 2024-08-31T05:21:28.174 INFO:tasks.workunit.client.0.smithi067.stdout:2/696: write db/d12/d1a/d2b/d42/d62/f80 [1436516,86735] 0 2024-08-31T05:21:28.180 INFO:tasks.workunit.client.0.smithi067.stdout:3/806: link db/d17/d3f/d54/d56/d6e/f9a db/d2e/d50/d62/d85/f106 0 2024-08-31T05:21:28.184 INFO:tasks.workunit.client.0.smithi067.stdout:3/807: symlink db/d55/d97/dc4/dcb/dcc/l107 0 2024-08-31T05:21:28.185 INFO:tasks.workunit.client.0.smithi067.stdout:3/808: fdatasync db/d4e/fe9 0 2024-08-31T05:21:28.187 INFO:tasks.workunit.client.0.smithi067.stdout:7/423: write d14/d4a/f4b [698959,23944] 0 2024-08-31T05:21:28.187 INFO:tasks.workunit.client.0.smithi067.stdout:2/697: getdents db/d12/d1a/d2b/d42/da0/dc4/dc3 0 2024-08-31T05:21:28.189 INFO:tasks.workunit.client.0.smithi067.stdout:3/809: symlink db/d2e/da1/l108 0 2024-08-31T05:21:28.191 INFO:tasks.workunit.client.0.smithi067.stdout:2/698: unlink db/d12/d1a/d2b/d87/f9d 0 2024-08-31T05:21:28.192 INFO:tasks.workunit.client.0.smithi067.stdout:8/613: dread d0/d4/de/d1d/d7b/fba [0,4194304] 0 2024-08-31T05:21:28.196 INFO:tasks.workunit.client.0.smithi067.stdout:2/699: unlink db/dd/d2d/db7/ld3 0 2024-08-31T05:21:28.196 INFO:tasks.workunit.client.0.smithi067.stdout:7/424: getdents d14/d54 0 2024-08-31T05:21:28.197 INFO:tasks.workunit.client.0.smithi067.stdout:2/700: chown db/d12/d1a/d1e/f21 121270 1 2024-08-31T05:21:28.200 INFO:tasks.workunit.client.0.smithi067.stdout:3/810: getdents db/d55/d97/dc4 0 2024-08-31T05:21:28.201 INFO:tasks.workunit.client.0.smithi067.stdout:3/811: write db/d5a/f5f [3317189,63195] 0 2024-08-31T05:21:28.202 INFO:tasks.workunit.client.0.smithi067.stdout:3/812: fdatasync db/d55/d97/fb9 0 2024-08-31T05:21:28.203 INFO:tasks.workunit.client.0.smithi067.stdout:2/701: rename db/d12/d1a/d1e/d4d/fae to db/d12/d1a/da3/fde 0 2024-08-31T05:21:28.205 INFO:tasks.workunit.client.0.smithi067.stdout:8/614: rmdir d0/d2/dc/d28/d7e/da3/dbc 0 2024-08-31T05:21:28.210 INFO:tasks.workunit.client.0.smithi067.stdout:2/702: dwrite db/dd/d13/d9f/fce [0,4194304] 0 2024-08-31T05:21:28.212 INFO:tasks.workunit.client.0.smithi067.stdout:3/813: creat db/d55/d97/dc4/f109 x:0 0 0 2024-08-31T05:21:28.213 INFO:tasks.workunit.client.0.smithi067.stdout:8/615: dwrite d0/d2/da/dd/f6a [0,4194304] 0 2024-08-31T05:21:28.219 INFO:tasks.workunit.client.0.smithi067.stdout:3/814: mknod db/d17/d3f/d54/d56/d6e/c10a 0 2024-08-31T05:21:28.219 INFO:tasks.workunit.client.0.smithi067.stdout:2/703: dwrite db/f5b [0,4194304] 0 2024-08-31T05:21:28.222 INFO:tasks.workunit.client.0.smithi067.stdout:8/616: mkdir d0/d74/dcb 0 2024-08-31T05:21:28.225 INFO:tasks.workunit.client.0.smithi067.stdout:7/425: dwrite f6 [0,4194304] 0 2024-08-31T05:21:28.226 INFO:tasks.workunit.client.0.smithi067.stdout:3/815: mkdir db/d91/d10b 0 2024-08-31T05:21:28.228 INFO:tasks.workunit.client.0.smithi067.stdout:3/816: write db/d2c/f48 [8893342,86721] 0 2024-08-31T05:21:28.229 INFO:tasks.workunit.client.0.smithi067.stdout:8/617: truncate d0/d4/de/d1d/f94 1391384 0 2024-08-31T05:21:28.229 INFO:tasks.workunit.client.0.smithi067.stdout:8/618: readlink d0/l1 0 2024-08-31T05:21:28.233 INFO:tasks.workunit.client.0.smithi067.stdout:7/426: truncate d14/d16/f5d 725489 0 2024-08-31T05:21:28.234 INFO:tasks.workunit.client.0.smithi067.stdout:3/817: rmdir db/d2c 39 2024-08-31T05:21:28.238 INFO:tasks.workunit.client.0.smithi067.stdout:8/619: creat d0/d4/de/d1d/d7b/d89/fcc x:0 0 0 2024-08-31T05:21:28.239 INFO:tasks.workunit.client.0.smithi067.stdout:8/620: readlink d0/d4/de/lb7 0 2024-08-31T05:21:28.239 INFO:tasks.workunit.client.0.smithi067.stdout:8/621: fdatasync d0/d2/fae 0 2024-08-31T05:21:28.242 INFO:tasks.workunit.client.0.smithi067.stdout:8/622: mknod d0/d4/ccd 0 2024-08-31T05:21:28.243 INFO:tasks.workunit.client.0.smithi067.stdout:8/623: stat d0/d2/dc/d28/d7e/da3/lca 0 2024-08-31T05:21:28.246 INFO:tasks.workunit.client.0.smithi067.stdout:8/624: creat d0/d2/dc/d3d/fce x:0 0 0 2024-08-31T05:21:28.250 INFO:tasks.workunit.client.0.smithi067.stdout:8/625: dread d0/d2/dc/fb2 [0,4194304] 0 2024-08-31T05:21:28.254 INFO:tasks.workunit.client.0.smithi067.stdout:7/427: dread d14/d16/d28/f35 [0,4194304] 0 2024-08-31T05:21:28.255 INFO:tasks.workunit.client.0.smithi067.stdout:7/428: chown d14/d16/d28/c3f 4 1 2024-08-31T05:21:28.257 INFO:tasks.workunit.client.0.smithi067.stdout:8/626: dwrite d0/d2/da/fc5 [0,4194304] 0 2024-08-31T05:21:28.259 INFO:tasks.workunit.client.0.smithi067.stdout:8/627: truncate d0/d2/da/f42 2441443 0 2024-08-31T05:21:28.259 INFO:tasks.workunit.client.0.smithi067.stdout:7/429: rmdir d14/d4a 39 2024-08-31T05:21:28.266 INFO:tasks.workunit.client.0.smithi067.stdout:8/628: dwrite d0/d2/f83 [0,4194304] 0 2024-08-31T05:21:28.273 INFO:tasks.workunit.client.0.smithi067.stdout:8/629: creat d0/d2/da/fcf x:0 0 0 2024-08-31T05:21:28.273 INFO:tasks.workunit.client.0.smithi067.stdout:8/630: chown d0/d2/da/f88 208 1 2024-08-31T05:21:28.277 INFO:tasks.workunit.client.0.smithi067.stdout:3/818: dread db/d17/d3f/d54/d56/d6e/f75 [0,4194304] 0 2024-08-31T05:21:28.277 INFO:tasks.workunit.client.0.smithi067.stdout:8/631: link d0/d2/f6c d0/d4/de/d1d/d2c/d3c/fd0 0 2024-08-31T05:21:28.279 INFO:tasks.workunit.client.0.smithi067.stdout:3/819: symlink db/d17/d3f/d54/l10c 0 2024-08-31T05:21:28.280 INFO:tasks.workunit.client.0.smithi067.stdout:8/632: read d0/d2/dc/d28/d7e/f69 [1043403,56442] 0 2024-08-31T05:21:28.280 INFO:tasks.workunit.client.0.smithi067.stdout:3/820: readlink db/d2e/d6a/la0 0 2024-08-31T05:21:28.280 INFO:tasks.workunit.client.0.smithi067.stdout:8/633: chown d0/d2/dc/d3d/d52 2060417 1 2024-08-31T05:21:28.283 INFO:tasks.workunit.client.0.smithi067.stdout:3/821: mknod db/d17/c10d 0 2024-08-31T05:21:28.285 INFO:tasks.workunit.client.0.smithi067.stdout:8/634: rename d0/d4/de/d8f to d0/d2/dc/d28/d7e/d73/d84/dd1 0 2024-08-31T05:21:28.286 INFO:tasks.workunit.client.0.smithi067.stdout:8/635: fsync d0/d4/faa 0 2024-08-31T05:21:28.287 INFO:tasks.workunit.client.0.smithi067.stdout:3/822: fdatasync db/d2e/d50/f84 0 2024-08-31T05:21:28.288 INFO:tasks.workunit.client.0.smithi067.stdout:8/636: chown d0/d4/de/l30 1666 1 2024-08-31T05:21:28.290 INFO:tasks.workunit.client.0.smithi067.stdout:7/430: dwrite d14/d16/d28/d2e/f37 [0,4194304] 0 2024-08-31T05:21:28.291 INFO:tasks.workunit.client.0.smithi067.stdout:7/431: read - d14/d54/d5e/d67/f6d zero size 2024-08-31T05:21:28.291 INFO:tasks.workunit.client.0.smithi067.stdout:7/432: chown d14/d3e 1056 1 2024-08-31T05:21:28.298 INFO:tasks.workunit.client.0.smithi067.stdout:8/637: symlink d0/d2/dc/ld2 0 2024-08-31T05:21:28.303 INFO:tasks.workunit.client.0.smithi067.stdout:3/823: write db/d2c/f31 [1686392,28257] 0 2024-08-31T05:21:28.305 INFO:tasks.workunit.client.0.smithi067.stdout:3/824: chown db/d2e/d50/f5c 130 1 2024-08-31T05:21:28.306 INFO:tasks.workunit.client.0.smithi067.stdout:3/825: write db/d2e/d6a/fcf [153717,65069] 0 2024-08-31T05:21:28.316 INFO:tasks.workunit.client.0.smithi067.stdout:8/638: dread d0/d2/dc/d3d/f67 [0,4194304] 0 2024-08-31T05:21:28.317 INFO:tasks.workunit.client.0.smithi067.stdout:8/639: stat d0/d2/dc/l13 0 2024-08-31T05:21:28.319 INFO:tasks.workunit.client.0.smithi067.stdout:8/640: creat d0/d2/dc/d28/d7e/d73/d84/da6/fd3 x:0 0 0 2024-08-31T05:21:28.321 INFO:tasks.workunit.client.0.smithi067.stdout:3/826: dread db/d12/d21/ffc [0,4194304] 0 2024-08-31T05:21:28.323 INFO:tasks.workunit.client.0.smithi067.stdout:3/827: rmdir db/d17/d3f/d54/ddf 39 2024-08-31T05:21:28.326 INFO:tasks.workunit.client.0.smithi067.stdout:3/828: creat db/d12/d21/f10e x:0 0 0 2024-08-31T05:21:28.326 INFO:tasks.workunit.client.0.smithi067.stdout:3/829: chown db/d2e/d50/f84 53 1 2024-08-31T05:21:28.331 INFO:tasks.workunit.client.0.smithi067.stdout:3/830: symlink db/d12/d21/d82/l10f 0 2024-08-31T05:21:28.333 INFO:tasks.workunit.client.0.smithi067.stdout:8/641: dread d0/d2/dc/d3d/f5d [0,4194304] 0 2024-08-31T05:21:28.338 INFO:tasks.workunit.client.0.smithi067.stdout:8/642: link d0/d4/de/d1d/d2c/d68/f8d d0/d2/da/fd4 0 2024-08-31T05:21:28.340 INFO:tasks.workunit.client.0.smithi067.stdout:8/643: symlink d0/d2/dc/d3d/d98/ld5 0 2024-08-31T05:21:28.349 INFO:tasks.workunit.client.0.smithi067.stdout:3/831: dwrite db/d17/d3f/d54/f64 [0,4194304] 0 2024-08-31T05:21:28.354 INFO:tasks.workunit.client.0.smithi067.stdout:3/832: mkdir db/d2e/d50/d4a/d110 0 2024-08-31T05:21:28.355 INFO:tasks.workunit.client.0.smithi067.stdout:8/644: dread d0/d4/de/d1d/d2c/d3c/fd0 [0,4194304] 0 2024-08-31T05:21:28.359 INFO:tasks.workunit.client.0.smithi067.stdout:3/833: link db/d55/fe6 db/f111 0 2024-08-31T05:21:28.364 INFO:tasks.workunit.client.0.smithi067.stdout:3/834: creat db/d2e/d50/d4a/d110/f112 x:0 0 0 2024-08-31T05:21:28.368 INFO:tasks.workunit.client.0.smithi067.stdout:3/835: truncate db/d17/d3f/f61 414381 0 2024-08-31T05:21:28.370 INFO:tasks.workunit.client.0.smithi067.stdout:8/645: truncate d0/d2/dc/d28/d7e/d73/d84/fc0 2126129 0 2024-08-31T05:21:28.371 INFO:tasks.workunit.client.0.smithi067.stdout:3/836: rmdir db/d2e/d6a/d8d 39 2024-08-31T05:21:28.374 INFO:tasks.workunit.client.0.smithi067.stdout:8/646: symlink d0/d4/de/d1d/d2c/d3c/da5/dc7/ld6 0 2024-08-31T05:21:28.375 INFO:tasks.workunit.client.0.smithi067.stdout:3/837: creat db/d12/d21/dff/f113 x:0 0 0 2024-08-31T05:21:28.378 INFO:tasks.workunit.client.0.smithi067.stdout:8/647: dread d0/d2/da/fc5 [0,4194304] 0 2024-08-31T05:21:28.380 INFO:tasks.workunit.client.0.smithi067.stdout:8/648: chown d0/d4/de/d1d/d2c/d3c/da5/d99/lbb 15 1 2024-08-31T05:21:28.382 INFO:tasks.workunit.client.0.smithi067.stdout:8/649: truncate d0/d2/dc/f49 2807989 0 2024-08-31T05:21:28.386 INFO:tasks.workunit.client.0.smithi067.stdout:8/650: rename d0/d2/dc/d28/d7e/d73/d84/da6/db1/c97 to d0/d4/de/d1d/d7b/d89/cd7 0 2024-08-31T05:21:28.390 INFO:tasks.workunit.client.0.smithi067.stdout:3/838: dwrite db/d2e/d50/d62/d85/f106 [4194304,4194304] 0 2024-08-31T05:21:28.391 INFO:tasks.workunit.client.0.smithi067.stdout:8/651: link d0/d2/dc/fb2 d0/d2/dc/d3d/d98/dc2/fd8 0 2024-08-31T05:21:28.393 INFO:tasks.workunit.client.0.smithi067.stdout:3/839: symlink db/d2e/d50/l114 0 2024-08-31T05:21:28.395 INFO:tasks.workunit.client.0.smithi067.stdout:8/652: rename d0/d2/dc/d3d/f5d to d0/d74/dcb/fd9 0 2024-08-31T05:21:28.395 INFO:tasks.workunit.client.0.smithi067.stdout:3/840: mknod db/d5a/c115 0 2024-08-31T05:21:28.397 INFO:tasks.workunit.client.0.smithi067.stdout:8/653: truncate d0/d4/de/f34 1122516 0 2024-08-31T05:21:28.398 INFO:tasks.workunit.client.0.smithi067.stdout:8/654: read d0/d2/dc/d3d/d98/dc2/fd8 [3206564,103597] 0 2024-08-31T05:21:28.405 INFO:tasks.workunit.client.0.smithi067.stdout:8/655: dwrite d0/d4/f71 [0,4194304] 0 2024-08-31T05:21:28.420 INFO:tasks.workunit.client.0.smithi067.stdout:3/841: dread db/d2e/d50/d62/d85/f94 [8388608,4194304] 0 2024-08-31T05:21:28.421 INFO:tasks.workunit.client.0.smithi067.stdout:3/842: mkdir db/d12/d116 0 2024-08-31T05:21:28.425 INFO:tasks.workunit.client.0.smithi067.stdout:3/843: creat db/d17/d3f/f117 x:0 0 0 2024-08-31T05:21:28.427 INFO:tasks.workunit.client.0.smithi067.stdout:3/844: fdatasync db/d12/f36 0 2024-08-31T05:21:28.432 INFO:tasks.workunit.client.0.smithi067.stdout:8/656: write d0/d74/dcb/fd9 [550381,54324] 0 2024-08-31T05:21:28.434 INFO:tasks.workunit.client.0.smithi067.stdout:3/845: creat db/d17/d3f/d54/ddf/dec/f118 x:0 0 0 2024-08-31T05:21:28.449 INFO:tasks.workunit.client.0.smithi067.stdout:3/846: dwrite db/d17/d3f/d54/d56/f96 [0,4194304] 0 2024-08-31T05:21:28.455 INFO:tasks.workunit.client.0.smithi067.stdout:3/847: creat db/d12/f119 x:0 0 0 2024-08-31T05:21:28.462 INFO:tasks.workunit.client.0.smithi067.stdout:8/657: truncate d0/d4/de/f77 1221768 0 2024-08-31T05:21:28.466 INFO:tasks.workunit.client.0.smithi067.stdout:8/658: mkdir d0/d2/dc/d28/dda 0 2024-08-31T05:21:28.469 INFO:tasks.workunit.client.0.smithi067.stdout:8/659: rename d0/d2/da/f42 to d0/d2/da/dd/d1f/fdb 0 2024-08-31T05:21:28.470 INFO:tasks.workunit.client.0.smithi067.stdout:8/660: chown d0/d2/da/fc1 244 1 2024-08-31T05:21:28.472 INFO:tasks.workunit.client.0.smithi067.stdout:8/661: truncate d0/d4/de/d1d/d7b/d89/fbf 354864 0 2024-08-31T05:21:28.477 INFO:tasks.workunit.client.0.smithi067.stdout:3/848: truncate db/d55/d97/dc4/fd6 1480482 0 2024-08-31T05:21:28.477 INFO:tasks.workunit.client.0.smithi067.stdout:3/849: readlink l2 0 2024-08-31T05:21:28.477 INFO:tasks.workunit.client.0.smithi067.stdout:3/850: read - db/d17/d3f/d54/ddf/dec/fef zero size 2024-08-31T05:21:28.477 INFO:tasks.workunit.client.0.smithi067.stdout:8/662: creat d0/d4/de/d1d/d7b/fdc x:0 0 0 2024-08-31T05:21:28.479 INFO:tasks.workunit.client.0.smithi067.stdout:8/663: mknod d0/d2/dc/d28/d7e/da3/cdd 0 2024-08-31T05:21:28.482 INFO:tasks.workunit.client.0.smithi067.stdout:8/664: fdatasync d0/d4/f20 0 2024-08-31T05:21:28.484 INFO:tasks.workunit.client.0.smithi067.stdout:3/851: dwrite db/d2e/f9e [0,4194304] 0 2024-08-31T05:21:28.486 INFO:tasks.workunit.client.0.smithi067.stdout:3/852: write db/d91/ffe [593009,127366] 0 2024-08-31T05:21:28.491 INFO:tasks.workunit.client.0.smithi067.stdout:3/853: readlink db/d12/d21/d82/l10f 0 2024-08-31T05:21:28.498 INFO:tasks.workunit.client.0.smithi067.stdout:3/854: dwrite db/d17/d3f/d54/fe2 [0,4194304] 0 2024-08-31T05:21:28.505 INFO:tasks.workunit.client.0.smithi067.stdout:8/665: truncate d0/d2/da/f88 77319 0 2024-08-31T05:21:28.507 INFO:tasks.workunit.client.0.smithi067.stdout:3/855: dwrite db/d17/d3f/d54/d56/d6e/f9f [0,4194304] 0 2024-08-31T05:21:28.516 INFO:tasks.workunit.client.0.smithi067.stdout:3/856: rename db/d5a/f5f to db/d17/f11a 0 2024-08-31T05:21:28.524 INFO:tasks.workunit.client.0.smithi067.stdout:3/857: unlink db/d2e/d50/d62/dc3/f102 0 2024-08-31T05:21:28.525 INFO:tasks.workunit.client.0.smithi067.stdout:8/666: link d0/d2/dc/d28/l5f d0/d2/dc/d28/db4/lde 0 2024-08-31T05:21:28.531 INFO:tasks.workunit.client.0.smithi067.stdout:8/667: dwrite d0/d2/da/dd/f6a [0,4194304] 0 2024-08-31T05:21:28.532 INFO:tasks.workunit.client.0.smithi067.stdout:3/858: mkdir db/d2e/d50/d11b 0 2024-08-31T05:21:28.533 INFO:tasks.workunit.client.0.smithi067.stdout:3/859: readlink db/d91/lc5 0 2024-08-31T05:21:28.539 INFO:tasks.workunit.client.0.smithi067.stdout:3/860: dwrite db/d17/d3f/f117 [0,4194304] 0 2024-08-31T05:21:28.542 INFO:tasks.workunit.client.0.smithi067.stdout:3/861: mkdir db/d5a/d11c 0 2024-08-31T05:21:28.544 INFO:tasks.workunit.client.0.smithi067.stdout:3/862: write db/d17/d3f/d54/fe2 [2137618,41411] 0 2024-08-31T05:21:28.549 INFO:tasks.workunit.client.0.smithi067.stdout:8/668: write d0/f9 [2481158,6952] 0 2024-08-31T05:21:28.552 INFO:tasks.workunit.client.0.smithi067.stdout:8/669: creat d0/d2/dc/d28/fdf x:0 0 0 2024-08-31T05:21:28.552 INFO:tasks.workunit.client.0.smithi067.stdout:3/863: dwrite db/d2e/d50/d62/dc3/fde [0,4194304] 0 2024-08-31T05:21:28.555 INFO:tasks.workunit.client.0.smithi067.stdout:8/670: rmdir d0/d4/de/d1d/d7b 39 2024-08-31T05:21:28.557 INFO:tasks.workunit.client.0.smithi067.stdout:8/671: write d0/d2/da/dd/f6a [3801890,77559] 0 2024-08-31T05:21:28.557 INFO:tasks.workunit.client.0.smithi067.stdout:3/864: mknod db/d2e/d50/d62/dc3/dee/c11d 0 2024-08-31T05:21:28.558 INFO:tasks.workunit.client.0.smithi067.stdout:3/865: stat db/d17/d3f/d54/d56/f96 0 2024-08-31T05:21:28.561 INFO:tasks.workunit.client.0.smithi067.stdout:8/672: symlink d0/d4/de/d1d/d7b/le0 0 2024-08-31T05:21:28.563 INFO:tasks.workunit.client.0.smithi067.stdout:8/673: truncate d0/d2/da/f93 3802318 0 2024-08-31T05:21:28.563 INFO:tasks.workunit.client.0.smithi067.stdout:8/674: chown d0 698857553 1 2024-08-31T05:21:28.565 INFO:tasks.workunit.client.0.smithi067.stdout:8/675: creat d0/d2/dc/d3d/d98/fe1 x:0 0 0 2024-08-31T05:21:28.567 INFO:tasks.workunit.client.0.smithi067.stdout:8/676: mknod d0/d4/de/d1d/d2c/d3c/ce2 0 2024-08-31T05:21:28.623 INFO:tasks.workunit.client.0.smithi067.stdout:3/866: write db/f14 [3963786,119069] 0 2024-08-31T05:21:28.628 INFO:tasks.workunit.client.0.smithi067.stdout:3/867: getdents db/dbe 0 2024-08-31T05:21:28.629 INFO:tasks.workunit.client.0.smithi067.stdout:3/868: chown db/f57 10029 1 2024-08-31T05:21:28.631 INFO:tasks.workunit.client.0.smithi067.stdout:3/869: stat db/d17/d3f/d54/d56/d6e/ldd 0 2024-08-31T05:21:28.631 INFO:tasks.workunit.client.0.smithi067.stdout:3/870: readlink db/d55/la9 0 2024-08-31T05:21:28.634 INFO:tasks.workunit.client.0.smithi067.stdout:8/677: dwrite d0/d4/de/d1d/d2c/d68/f8d [0,4194304] 0 2024-08-31T05:21:28.643 INFO:tasks.workunit.client.0.smithi067.stdout:3/871: dwrite db/d12/d21/d82/f8a [4194304,4194304] 0 2024-08-31T05:21:28.644 INFO:tasks.workunit.client.0.smithi067.stdout:3/872: rmdir db/d17 39 2024-08-31T05:21:28.663 INFO:tasks.workunit.client.0.smithi067.stdout:3/873: dread db/d4e/fd2 [0,4194304] 0 2024-08-31T05:21:28.694 INFO:tasks.workunit.client.0.smithi067.stdout:3/874: creat db/d12/d21/f11e x:0 0 0 2024-08-31T05:21:28.699 INFO:tasks.workunit.client.0.smithi067.stdout:3/875: dwrite f4 [0,4194304] 0 2024-08-31T05:21:28.701 INFO:tasks.workunit.client.0.smithi067.stdout:3/876: chown db/d2e/d50/d62/l7c 2 1 2024-08-31T05:21:28.710 INFO:tasks.workunit.client.0.smithi067.stdout:3/877: read db/d17/d3f/d54/d56/f96 [4112546,113503] 0 2024-08-31T05:21:28.766 INFO:tasks.workunit.client.0.smithi067.stdout:3/878: dwrite db/fc7 [0,4194304] 0 2024-08-31T05:21:28.774 INFO:tasks.workunit.client.0.smithi067.stdout:3/879: fsync db/d2e/d50/d62/fad 0 2024-08-31T05:21:28.775 INFO:tasks.workunit.client.0.smithi067.stdout:3/880: fsync db/d2e/d6a/fd3 0 2024-08-31T05:21:28.776 INFO:tasks.workunit.client.0.smithi067.stdout:3/881: write db/f53 [5175838,39767] 0 2024-08-31T05:21:28.785 INFO:tasks.workunit.client.0.smithi067.stdout:3/882: dwrite db/d17/d3f/d54/d56/d6e/f75 [0,4194304] 0 2024-08-31T05:21:28.786 INFO:tasks.workunit.client.0.smithi067.stdout:3/883: dread - db/d12/d21/f10e zero size 2024-08-31T05:21:28.793 INFO:tasks.workunit.client.0.smithi067.stdout:3/884: mkdir db/d12/d21/d82/d11f 0 2024-08-31T05:21:28.803 INFO:tasks.workunit.client.0.smithi067.stdout:3/885: getdents db/d91/d10b 0 2024-08-31T05:21:28.804 INFO:tasks.workunit.client.0.smithi067.stdout:3/886: read db/d17/d3f/d54/fe2 [3013902,16708] 0 2024-08-31T05:21:28.811 INFO:tasks.workunit.client.0.smithi067.stdout:3/887: creat db/d2e/d50/d4a/f120 x:0 0 0 2024-08-31T05:21:28.814 INFO:tasks.workunit.client.0.smithi067.stdout:3/888: mkdir db/d12/d21/dff/d121 0 2024-08-31T05:21:28.815 INFO:tasks.workunit.client.0.smithi067.stdout:3/889: readlink db/dbe/l77 0 2024-08-31T05:21:28.821 INFO:tasks.workunit.client.0.smithi067.stdout:3/890: dread db/d2e/d50/d62/d85/f106 [4194304,4194304] 0 2024-08-31T05:21:28.837 INFO:tasks.workunit.client.0.smithi067.stdout:3/891: dread db/d2c/f31 [0,4194304] 0 2024-08-31T05:21:28.838 INFO:tasks.workunit.client.0.smithi067.stdout:3/892: creat db/d2e/d50/d4a/d110/f122 x:0 0 0 2024-08-31T05:21:28.840 INFO:tasks.workunit.client.0.smithi067.stdout:3/893: unlink l2 0 2024-08-31T05:21:28.855 INFO:tasks.workunit.client.0.smithi067.stdout:3/894: dread db/d2e/f38 [0,4194304] 0 2024-08-31T05:21:28.856 INFO:tasks.workunit.client.0.smithi067.stdout:3/895: write db/d2e/d6a/fcf [296978,13660] 0 2024-08-31T05:21:28.918 INFO:tasks.workunit.client.0.smithi067.stdout:9/551: sync 2024-08-31T05:21:28.919 INFO:tasks.workunit.client.0.smithi067.stdout:9/552: symlink dd/d4d/lb9 0 2024-08-31T05:21:28.921 INFO:tasks.workunit.client.0.smithi067.stdout:9/553: symlink dd/d20/lba 0 2024-08-31T05:21:28.923 INFO:tasks.workunit.client.0.smithi067.stdout:9/554: truncate dd/df/d25/d3b/d50/d73/f86 3771253 0 2024-08-31T05:21:28.927 INFO:tasks.workunit.client.0.smithi067.stdout:9/555: getdents dd/df/d8e 0 2024-08-31T05:21:28.928 INFO:tasks.workunit.client.0.smithi067.stdout:9/556: stat dd/d20/c4c 0 2024-08-31T05:21:28.930 INFO:tasks.workunit.client.0.smithi067.stdout:9/557: creat dd/df/fbb x:0 0 0 2024-08-31T05:21:28.931 INFO:tasks.workunit.client.0.smithi067.stdout:9/558: write dd/df/d25/d59/fa7 [877917,89240] 0 2024-08-31T05:21:28.932 INFO:tasks.workunit.client.0.smithi067.stdout:9/559: chown dd/df/d5b/c64 835 1 2024-08-31T05:21:28.935 INFO:tasks.workunit.client.0.smithi067.stdout:9/560: unlink dd/df/d5b/d5d/f99 0 2024-08-31T05:21:28.939 INFO:tasks.workunit.client.0.smithi067.stdout:9/561: rename dd/df/d5b/f83 to dd/df/d3c/fbc 0 2024-08-31T05:21:28.942 INFO:tasks.workunit.client.0.smithi067.stdout:9/562: creat dd/d63/d72/fbd x:0 0 0 2024-08-31T05:21:28.956 INFO:tasks.workunit.client.0.smithi067.stdout:9/563: write dd/df/f69 [1017978,113763] 0 2024-08-31T05:21:28.960 INFO:tasks.workunit.client.0.smithi067.stdout:9/564: dread dd/df/d25/d3b/f97 [0,4194304] 0 2024-08-31T05:21:28.961 INFO:tasks.workunit.client.0.smithi067.stdout:9/565: rmdir dd/d63/da3 39 2024-08-31T05:21:28.964 INFO:tasks.workunit.client.0.smithi067.stdout:9/566: mkdir dd/df/d3c/dbe 0 2024-08-31T05:21:28.965 INFO:tasks.workunit.client.0.smithi067.stdout:9/567: write dd/df/f24 [893650,21298] 0 2024-08-31T05:21:28.971 INFO:tasks.workunit.client.0.smithi067.stdout:9/568: creat dd/df/d25/fbf x:0 0 0 2024-08-31T05:21:29.000 INFO:tasks.workunit.client.0.smithi067.stdout:9/569: link dd/df/d3c/fbc dd/d63/da3/fc0 0 2024-08-31T05:21:29.006 INFO:tasks.workunit.client.0.smithi067.stdout:9/570: dwrite dd/df/f1f [0,4194304] 0 2024-08-31T05:21:29.024 INFO:tasks.workunit.client.0.smithi067.stdout:9/571: dwrite dd/df/d25/f6c [4194304,4194304] 0 2024-08-31T05:21:29.025 INFO:tasks.workunit.client.0.smithi067.stdout:9/572: truncate dd/df/d25/d59/fae 694071 0 2024-08-31T05:21:29.027 INFO:tasks.workunit.client.0.smithi067.stdout:9/573: dread dd/df/d25/d59/fae [0,4194304] 0 2024-08-31T05:21:29.032 INFO:tasks.workunit.client.0.smithi067.stdout:9/574: mknod dd/df/d25/d3b/d50/d73/cc1 0 2024-08-31T05:21:29.035 INFO:tasks.workunit.client.0.smithi067.stdout:9/575: fsync dd/df/d5b/d5d/f89 0 2024-08-31T05:21:29.037 INFO:tasks.workunit.client.0.smithi067.stdout:9/576: creat dd/da2/fc2 x:0 0 0 2024-08-31T05:21:29.039 INFO:tasks.workunit.client.0.smithi067.stdout:9/577: rename dd/d4d/lb9 to dd/d63/da3/lc3 0 2024-08-31T05:21:29.042 INFO:tasks.workunit.client.0.smithi067.stdout:9/578: creat dd/df/d25/d3b/d50/d73/fc4 x:0 0 0 2024-08-31T05:21:29.042 INFO:tasks.workunit.client.0.smithi067.stdout:9/579: chown dd/f36 1988069 1 2024-08-31T05:21:29.044 INFO:tasks.workunit.client.0.smithi067.stdout:9/580: fdatasync dd/f1e 0 2024-08-31T05:21:29.049 INFO:tasks.workunit.client.0.smithi067.stdout:9/581: dread dd/df/d25/d3b/f52 [0,4194304] 0 2024-08-31T05:21:29.049 INFO:tasks.workunit.client.0.smithi067.stdout:9/582: fsync dd/df/f69 0 2024-08-31T05:21:29.055 INFO:tasks.workunit.client.0.smithi067.stdout:9/583: creat dd/d63/fc5 x:0 0 0 2024-08-31T05:21:29.057 INFO:tasks.workunit.client.0.smithi067.stdout:9/584: mkdir dd/df/dc6 0 2024-08-31T05:21:29.058 INFO:tasks.workunit.client.0.smithi067.stdout:9/585: fsync dd/df/f43 0 2024-08-31T05:21:29.058 INFO:tasks.workunit.client.0.smithi067.stdout:9/586: stat dd/d20/f2b 0 2024-08-31T05:21:29.060 INFO:tasks.workunit.client.0.smithi067.stdout:9/587: unlink dd/d20/f47 0 2024-08-31T05:21:29.063 INFO:tasks.workunit.client.0.smithi067.stdout:9/588: symlink dd/df/d25/lc7 0 2024-08-31T05:21:29.070 INFO:tasks.workunit.client.0.smithi067.stdout:9/589: getdents dd/df/d25/d59 0 2024-08-31T05:21:29.071 INFO:tasks.workunit.client.0.smithi067.stdout:9/590: truncate dd/df/f24 4336049 0 2024-08-31T05:21:29.073 INFO:tasks.workunit.client.0.smithi067.stdout:9/591: dread dd/df/d25/d3b/d50/f90 [0,4194304] 0 2024-08-31T05:21:29.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:28 smithi067 ceph-mon[17432]: pgmap v35: 65 pgs: 65 active+clean; 2.5 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 29 MiB/s rd, 101 MiB/s wr, 251 op/s 2024-08-31T05:21:29.132 INFO:tasks.workunit.client.0.smithi067.stdout:6/731: sync 2024-08-31T05:21:29.134 INFO:tasks.workunit.client.0.smithi067.stdout:9/592: creat dd/df/d8e/d94/fc8 x:0 0 0 2024-08-31T05:21:29.136 INFO:tasks.workunit.client.0.smithi067.stdout:6/732: creat d1b/d23/d28/db9/feb x:0 0 0 2024-08-31T05:21:29.138 INFO:tasks.workunit.client.0.smithi067.stdout:9/593: dread dd/df/d25/f2c [4194304,4194304] 0 2024-08-31T05:21:29.145 INFO:tasks.workunit.client.0.smithi067.stdout:6/733: truncate d1b/d23/f69 322384 0 2024-08-31T05:21:29.147 INFO:tasks.workunit.client.0.smithi067.stdout:9/594: write dd/d20/f2b [307794,12220] 0 2024-08-31T05:21:29.149 INFO:tasks.workunit.client.0.smithi067.stdout:6/734: rename d1b/d23/d61/fba to d1b/d40/d70/dd0/d8d/dc6/fec 0 2024-08-31T05:21:29.151 INFO:tasks.workunit.client.0.smithi067.stdout:6/735: unlink f9 0 2024-08-31T05:21:29.153 INFO:tasks.workunit.client.0.smithi067.stdout:6/736: creat d1b/d40/d70/dd0/daa/fed x:0 0 0 2024-08-31T05:21:29.157 INFO:tasks.workunit.client.0.smithi067.stdout:9/595: link dd/df/d25/d3b/f62 dd/d63/fc9 0 2024-08-31T05:21:29.158 INFO:tasks.workunit.client.0.smithi067.stdout:9/596: chown dd/d63/d72/fbd 419 1 2024-08-31T05:21:29.160 INFO:tasks.workunit.client.0.smithi067.stdout:9/597: truncate dd/d63/da3/faa 4904655 0 2024-08-31T05:21:29.162 INFO:tasks.workunit.client.0.smithi067.stdout:9/598: mkdir dd/d4d/dca 0 2024-08-31T05:21:29.170 INFO:tasks.workunit.client.0.smithi067.stdout:6/737: getdents d1b/d40/d70/dd0/daa 0 2024-08-31T05:21:29.172 INFO:tasks.workunit.client.0.smithi067.stdout:6/738: symlink d1b/d40/d70/dd0/d5c/lee 0 2024-08-31T05:21:29.176 INFO:tasks.workunit.client.0.smithi067.stdout:9/599: write dd/f2a [1456992,79775] 0 2024-08-31T05:21:29.177 INFO:tasks.workunit.client.0.smithi067.stdout:9/600: write dd/df/fbb [613385,66290] 0 2024-08-31T05:21:29.179 INFO:tasks.workunit.client.0.smithi067.stdout:6/739: dwrite d1b/d30/fa2 [0,4194304] 0 2024-08-31T05:21:29.181 INFO:tasks.workunit.client.0.smithi067.stdout:9/601: creat dd/d4d/fcb x:0 0 0 2024-08-31T05:21:29.187 INFO:tasks.workunit.client.0.smithi067.stdout:6/740: link d1b/d40/d70/dd0/da4/cb7 d1b/d23/d2e/cef 0 2024-08-31T05:21:29.190 INFO:tasks.workunit.client.0.smithi067.stdout:9/602: dread dd/df/f23 [0,4194304] 0 2024-08-31T05:21:29.191 INFO:tasks.workunit.client.0.smithi067.stdout:6/741: link f7 d1b/d40/d70/dd0/d8d/dc6/ff0 0 2024-08-31T05:21:29.192 INFO:tasks.workunit.client.0.smithi067.stdout:6/742: write d1b/d23/f2a [560603,97881] 0 2024-08-31T05:21:29.193 INFO:tasks.workunit.client.0.smithi067.stdout:6/743: write d1b/d23/d28/f55 [3427773,32205] 0 2024-08-31T05:21:29.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:28 smithi073 ceph-mon[24726]: pgmap v35: 65 pgs: 65 active+clean; 2.5 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 29 MiB/s rd, 101 MiB/s wr, 251 op/s 2024-08-31T05:21:29.200 INFO:tasks.workunit.client.0.smithi067.stdout:6/744: mkdir d1b/d23/df1 0 2024-08-31T05:21:29.207 INFO:tasks.workunit.client.0.smithi067.stdout:9/603: dread dd/df/f2e [0,4194304] 0 2024-08-31T05:21:29.208 INFO:tasks.workunit.client.0.smithi067.stdout:9/604: fsync dd/df/d25/f8f 0 2024-08-31T05:21:29.210 INFO:tasks.workunit.client.0.smithi067.stdout:9/605: write dd/df/f69 [1524634,95750] 0 2024-08-31T05:21:29.223 INFO:tasks.workunit.client.0.smithi067.stdout:9/606: dread dd/f1e [0,4194304] 0 2024-08-31T05:21:29.227 INFO:tasks.workunit.client.0.smithi067.stdout:9/607: dread dd/df/d25/f5f [0,4194304] 0 2024-08-31T05:21:29.230 INFO:tasks.workunit.client.0.smithi067.stdout:9/608: mkdir dd/df/d8e/dcc 0 2024-08-31T05:21:29.242 INFO:tasks.workunit.client.0.smithi067.stdout:9/609: dwrite dd/f1e [0,4194304] 0 2024-08-31T05:21:29.243 INFO:tasks.workunit.client.0.smithi067.stdout:9/610: chown dd/f42 116897980 1 2024-08-31T05:21:29.246 INFO:tasks.workunit.client.0.smithi067.stdout:9/611: dread dd/df/d25/d3b/d50/f90 [0,4194304] 0 2024-08-31T05:21:29.249 INFO:tasks.workunit.client.0.smithi067.stdout:9/612: rename dd/df/d25/l37 to dd/df/d25/d59/lcd 0 2024-08-31T05:21:29.256 INFO:tasks.workunit.client.0.smithi067.stdout:4/445: sync 2024-08-31T05:21:29.256 INFO:tasks.workunit.client.0.smithi067.stdout:5/531: sync 2024-08-31T05:21:29.256 INFO:tasks.workunit.client.0.smithi067.stdout:0/788: sync 2024-08-31T05:21:29.257 INFO:tasks.workunit.client.0.smithi067.stdout:1/388: sync 2024-08-31T05:21:29.261 INFO:tasks.workunit.client.0.smithi067.stdout:0/789: mkdir d1/df/d17/d43/d48/d6a/d84/db7/dfe 0 2024-08-31T05:21:29.264 INFO:tasks.workunit.client.0.smithi067.stdout:5/532: rename db/d15/d53/d5f to db/d15/d42/d36/d73/da9 0 2024-08-31T05:21:29.266 INFO:tasks.workunit.client.0.smithi067.stdout:9/613: dread dd/d20/f2f [0,4194304] 0 2024-08-31T05:21:29.267 INFO:tasks.workunit.client.0.smithi067.stdout:9/614: dread - dd/d63/d72/fbd zero size 2024-08-31T05:21:29.268 INFO:tasks.workunit.client.0.smithi067.stdout:9/615: chown dd/da2/fc2 3197306 1 2024-08-31T05:21:29.271 INFO:tasks.workunit.client.0.smithi067.stdout:4/446: dread d4/d13/f1a [0,4194304] 0 2024-08-31T05:21:29.277 INFO:tasks.workunit.client.0.smithi067.stdout:9/616: dwrite dd/f9b [0,4194304] 0 2024-08-31T05:21:29.277 INFO:tasks.workunit.client.0.smithi067.stdout:1/389: dread d3/d23/d2d/d2e/d34/d66/d72/f48 [0,4194304] 0 2024-08-31T05:21:29.278 INFO:tasks.workunit.client.0.smithi067.stdout:4/447: fdatasync d4/d9/fa 0 2024-08-31T05:21:29.279 INFO:tasks.workunit.client.0.smithi067.stdout:5/533: dwrite db/f21 [0,4194304] 0 2024-08-31T05:21:29.280 INFO:tasks.workunit.client.0.smithi067.stdout:0/790: getdents d1/d8/d42 0 2024-08-31T05:21:29.282 INFO:tasks.workunit.client.0.smithi067.stdout:4/448: write d4/d14/d48/d66/f70 [3510162,129730] 0 2024-08-31T05:21:29.283 INFO:tasks.workunit.client.0.smithi067.stdout:9/617: fdatasync dd/df/d25/f8f 0 2024-08-31T05:21:29.284 INFO:tasks.workunit.client.0.smithi067.stdout:9/618: dread dd/df/d25/d3b/d50/f90 [0,4194304] 0 2024-08-31T05:21:29.289 INFO:tasks.workunit.client.0.smithi067.stdout:1/390: rename d3/d23/l32 to d3/dd/l8e 0 2024-08-31T05:21:29.292 INFO:tasks.workunit.client.0.smithi067.stdout:9/619: dwrite dd/df/d25/d3b/d50/d73/fc4 [0,4194304] 0 2024-08-31T05:21:29.303 INFO:tasks.workunit.client.0.smithi067.stdout:1/391: mkdir d3/d36/d8f 0 2024-08-31T05:21:29.303 INFO:tasks.workunit.client.0.smithi067.stdout:1/392: chown d3/f19 968269566 1 2024-08-31T05:21:29.307 INFO:tasks.workunit.client.0.smithi067.stdout:0/791: rmdir d1/d8/d77/df6 0 2024-08-31T05:21:29.308 INFO:tasks.workunit.client.0.smithi067.stdout:0/792: write d1/df/d17/d43/d48/f7f [1119938,128187] 0 2024-08-31T05:21:29.311 INFO:tasks.workunit.client.0.smithi067.stdout:9/620: mknod dd/cce 0 2024-08-31T05:21:29.311 INFO:tasks.workunit.client.0.smithi067.stdout:4/449: write d4/d13/f24 [803062,41637] 0 2024-08-31T05:21:29.312 INFO:tasks.workunit.client.0.smithi067.stdout:4/450: read - d4/d9/d4b/f86 zero size 2024-08-31T05:21:29.315 INFO:tasks.workunit.client.0.smithi067.stdout:1/393: creat d3/d23/f90 x:0 0 0 2024-08-31T05:21:29.315 INFO:tasks.workunit.client.0.smithi067.stdout:1/394: stat d3/d36 0 2024-08-31T05:21:29.322 INFO:tasks.workunit.client.0.smithi067.stdout:4/451: write d4/d1e/f41 [693330,19259] 0 2024-08-31T05:21:29.325 INFO:tasks.workunit.client.0.smithi067.stdout:0/793: getdents d1/d8/d77/d8f 0 2024-08-31T05:21:29.329 INFO:tasks.workunit.client.0.smithi067.stdout:1/395: rename d3/dd/f4e to d3/d23/f91 0 2024-08-31T05:21:29.330 INFO:tasks.workunit.client.0.smithi067.stdout:1/396: write d3/dd/d50/f8c [1043281,121749] 0 2024-08-31T05:21:29.331 INFO:tasks.workunit.client.0.smithi067.stdout:0/794: mkdir d1/dd5/dff 0 2024-08-31T05:21:29.332 INFO:tasks.workunit.client.0.smithi067.stdout:1/397: fdatasync d3/d23/d2d/d2e/d34/d66/d72/f77 0 2024-08-31T05:21:29.332 INFO:tasks.workunit.client.0.smithi067.stdout:1/398: chown d3/c30 251 1 2024-08-31T05:21:29.333 INFO:tasks.workunit.client.0.smithi067.stdout:4/452: getdents d4/d9/d4b 0 2024-08-31T05:21:29.333 INFO:tasks.workunit.client.0.smithi067.stdout:0/795: dread - d1/df/d17/d43/d48/d6a/d84/db7/fcf zero size 2024-08-31T05:21:29.334 INFO:tasks.workunit.client.0.smithi067.stdout:0/796: fdatasync d1/d50/ff3 0 2024-08-31T05:21:29.335 INFO:tasks.workunit.client.0.smithi067.stdout:0/797: read d1/df/d17/d43/f97 [332865,54335] 0 2024-08-31T05:21:29.336 INFO:tasks.workunit.client.0.smithi067.stdout:0/798: stat d1/df/d17/d94/fa4 0 2024-08-31T05:21:29.350 INFO:tasks.workunit.client.0.smithi067.stdout:1/399: dread d3/dd/f2c [0,4194304] 0 2024-08-31T05:21:29.353 INFO:tasks.workunit.client.0.smithi067.stdout:4/453: dread d4/f25 [4194304,4194304] 0 2024-08-31T05:21:29.355 INFO:tasks.workunit.client.0.smithi067.stdout:4/454: truncate d4/d1e/d21/d60/f61 987411 0 2024-08-31T05:21:29.357 INFO:tasks.workunit.client.0.smithi067.stdout:1/400: write d3/d23/f33 [10183785,2389] 0 2024-08-31T05:21:29.358 INFO:tasks.workunit.client.0.smithi067.stdout:4/455: mkdir d4/d9/da4 0 2024-08-31T05:21:29.361 INFO:tasks.workunit.client.0.smithi067.stdout:1/401: symlink d3/d23/d2d/d2e/d34/d66/l92 0 2024-08-31T05:21:29.362 INFO:tasks.workunit.client.0.smithi067.stdout:4/456: mkdir d4/da5 0 2024-08-31T05:21:29.364 INFO:tasks.workunit.client.0.smithi067.stdout:1/402: unlink d3/dd/f21 0 2024-08-31T05:21:29.366 INFO:tasks.workunit.client.0.smithi067.stdout:1/403: mkdir d3/d23/d79/d93 0 2024-08-31T05:21:29.369 INFO:tasks.workunit.client.0.smithi067.stdout:4/457: rename d4/d1e/c23 to d4/ca6 0 2024-08-31T05:21:29.371 INFO:tasks.workunit.client.0.smithi067.stdout:1/404: rename d3/d23/d5d/d7c to d3/d23/d2d/d2e/d34/d66/d94 0 2024-08-31T05:21:29.375 INFO:tasks.workunit.client.0.smithi067.stdout:4/458: rename d4/d13/f8f to d4/d56/fa7 0 2024-08-31T05:21:29.375 INFO:tasks.workunit.client.0.smithi067.stdout:1/405: read d3/f13 [2854597,130931] 0 2024-08-31T05:21:29.376 INFO:tasks.workunit.client.0.smithi067.stdout:4/459: write d4/d14/d48/d66/f70 [2730673,108867] 0 2024-08-31T05:21:29.378 INFO:tasks.workunit.client.0.smithi067.stdout:1/406: unlink d3/d23/f76 0 2024-08-31T05:21:29.381 INFO:tasks.workunit.client.0.smithi067.stdout:1/407: rename d3/dd/l44 to d3/d23/d2d/d2e/d34/l95 0 2024-08-31T05:21:29.381 INFO:tasks.workunit.client.0.smithi067.stdout:1/408: readlink d3/d23/d2d/d2e/l56 0 2024-08-31T05:21:29.384 INFO:tasks.workunit.client.0.smithi067.stdout:1/409: mknod d3/dd/d50/c96 0 2024-08-31T05:21:29.385 INFO:tasks.workunit.client.0.smithi067.stdout:4/460: link d4/d1f/f72 d4/d1e/d21/d60/fa8 0 2024-08-31T05:21:29.388 INFO:tasks.workunit.client.0.smithi067.stdout:4/461: dread d4/d14/f65 [0,4194304] 0 2024-08-31T05:21:29.389 INFO:tasks.workunit.client.0.smithi067.stdout:4/462: fdatasync d4/d14/d48/d66/f82 0 2024-08-31T05:21:29.390 INFO:tasks.workunit.client.0.smithi067.stdout:4/463: write d4/d14/d48/d66/f8c [933523,101314] 0 2024-08-31T05:21:29.390 INFO:tasks.workunit.client.0.smithi067.stdout:4/464: stat d4/d32 0 2024-08-31T05:21:29.391 INFO:tasks.workunit.client.0.smithi067.stdout:4/465: readlink d4/d14/d48/l84 0 2024-08-31T05:21:29.391 INFO:tasks.workunit.client.0.smithi067.stdout:4/466: chown d4/da5 17 1 2024-08-31T05:21:29.398 INFO:tasks.workunit.client.0.smithi067.stdout:4/467: rename d4/d1e/d21 to d4/d1e/d7a/d83/da9 0 2024-08-31T05:21:29.401 INFO:tasks.workunit.client.0.smithi067.stdout:4/468: rename d4/d14/f65 to d4/d9/d5a/faa 0 2024-08-31T05:21:29.404 INFO:tasks.workunit.client.0.smithi067.stdout:4/469: write d4/d1f/d34/f3c [2304860,120367] 0 2024-08-31T05:21:29.404 INFO:tasks.workunit.client.0.smithi067.stdout:1/410: dwrite d3/d36/f65 [0,4194304] 0 2024-08-31T05:21:29.408 INFO:tasks.workunit.client.0.smithi067.stdout:4/470: getdents d4/d9/da2 0 2024-08-31T05:21:29.409 INFO:tasks.workunit.client.0.smithi067.stdout:4/471: truncate d4/d42/f8b 316201 0 2024-08-31T05:21:29.410 INFO:tasks.workunit.client.0.smithi067.stdout:4/472: chown d4/d14/d48/d66/f8c 0 1 2024-08-31T05:21:29.413 INFO:tasks.workunit.client.0.smithi067.stdout:4/473: mknod d4/d1f/d34/cab 0 2024-08-31T05:21:29.422 INFO:tasks.workunit.client.0.smithi067.stdout:1/411: dwrite d3/d23/d2d/d2e/f5b [0,4194304] 0 2024-08-31T05:21:29.434 INFO:tasks.workunit.client.0.smithi067.stdout:4/474: dread d4/d1e/d7a/d83/da9/f3a [0,4194304] 0 2024-08-31T05:21:29.435 INFO:tasks.workunit.client.0.smithi067.stdout:1/412: dwrite d3/dd/f2c [0,4194304] 0 2024-08-31T05:21:29.436 INFO:tasks.workunit.client.0.smithi067.stdout:4/475: mkdir d4/d9/d4b/dac 0 2024-08-31T05:21:29.440 INFO:tasks.workunit.client.0.smithi067.stdout:1/413: symlink d3/d8b/l97 0 2024-08-31T05:21:29.441 INFO:tasks.workunit.client.0.smithi067.stdout:4/476: mknod d4/d1f/d34/cad 0 2024-08-31T05:21:29.443 INFO:tasks.workunit.client.0.smithi067.stdout:4/477: write d4/d1f/f30 [4844436,124240] 0 2024-08-31T05:21:29.445 INFO:tasks.workunit.client.0.smithi067.stdout:1/414: rename d3/f74 to d3/d23/f98 0 2024-08-31T05:21:29.445 INFO:tasks.workunit.client.0.smithi067.stdout:1/415: dread - d3/dd/f70 zero size 2024-08-31T05:21:29.446 INFO:tasks.workunit.client.0.smithi067.stdout:4/478: dread - d4/d42/f50 zero size 2024-08-31T05:21:29.446 INFO:tasks.workunit.client.0.smithi067.stdout:4/479: chown d4/d1e/f41 163 1 2024-08-31T05:21:29.447 INFO:tasks.workunit.client.0.smithi067.stdout:4/480: fdatasync d4/d14/d48/d66/f82 0 2024-08-31T05:21:29.447 INFO:tasks.workunit.client.0.smithi067.stdout:1/416: truncate d3/dd/fe 8331376 0 2024-08-31T05:21:29.448 INFO:tasks.workunit.client.0.smithi067.stdout:1/417: dread - d3/d23/f90 zero size 2024-08-31T05:21:29.449 INFO:tasks.workunit.client.0.smithi067.stdout:4/481: mkdir d4/d1e/d62/dae 0 2024-08-31T05:21:29.450 INFO:tasks.workunit.client.0.smithi067.stdout:4/482: write d4/d42/f57 [391787,50723] 0 2024-08-31T05:21:29.453 INFO:tasks.workunit.client.0.smithi067.stdout:1/418: getdents d3/d23/d2d/d2e/d34/d66/d94 0 2024-08-31T05:21:29.455 INFO:tasks.workunit.client.0.smithi067.stdout:4/483: rename d4/d1f/f30 to d4/d14/d48/d66/faf 0 2024-08-31T05:21:29.457 INFO:tasks.workunit.client.0.smithi067.stdout:4/484: mkdir d4/d1e/d92/db0 0 2024-08-31T05:21:29.459 INFO:tasks.workunit.client.0.smithi067.stdout:1/419: read d3/d23/d2d/d2e/d34/f6c [3681458,116857] 0 2024-08-31T05:21:29.463 INFO:tasks.workunit.client.0.smithi067.stdout:4/485: dwrite d4/d9/d5a/f74 [4194304,4194304] 0 2024-08-31T05:21:29.463 INFO:tasks.workunit.client.0.smithi067.stdout:1/420: fdatasync d3/d23/d5d/f6f 0 2024-08-31T05:21:29.465 INFO:tasks.workunit.client.0.smithi067.stdout:1/421: chown d3/d23/l25 0 1 2024-08-31T05:21:29.485 INFO:tasks.workunit.client.0.smithi067.stdout:1/422: dread d3/d23/f91 [0,4194304] 0 2024-08-31T05:21:29.487 INFO:tasks.workunit.client.0.smithi067.stdout:4/486: dread d4/d1f/d34/f3c [0,4194304] 0 2024-08-31T05:21:29.488 INFO:tasks.workunit.client.0.smithi067.stdout:1/423: creat d3/d36/d8f/f99 x:0 0 0 2024-08-31T05:21:29.493 INFO:tasks.workunit.client.0.smithi067.stdout:1/424: getdents d3/d23/d79 0 2024-08-31T05:21:29.493 INFO:tasks.workunit.client.0.smithi067.stdout:4/487: dwrite d4/d1e/fa1 [0,4194304] 0 2024-08-31T05:21:29.497 INFO:tasks.workunit.client.0.smithi067.stdout:1/425: dread d3/f13 [4194304,4194304] 0 2024-08-31T05:21:29.500 INFO:tasks.workunit.client.0.smithi067.stdout:1/426: dread d3/dd/f2c [0,4194304] 0 2024-08-31T05:21:29.504 INFO:tasks.workunit.client.0.smithi067.stdout:1/427: mkdir d3/d23/d2d/d2e/d34/d66/d9a 0 2024-08-31T05:21:29.505 INFO:tasks.workunit.client.0.smithi067.stdout:1/428: fdatasync d3/dd/d50/f81 0 2024-08-31T05:21:29.506 INFO:tasks.workunit.client.0.smithi067.stdout:4/488: rmdir d4/d9/d4b/dac 0 2024-08-31T05:21:29.507 INFO:tasks.workunit.client.0.smithi067.stdout:1/429: mknod d3/d23/d2d/d2e/c9b 0 2024-08-31T05:21:29.508 INFO:tasks.workunit.client.0.smithi067.stdout:4/489: write d4/d14/d48/d66/faf [2552456,86871] 0 2024-08-31T05:21:29.510 INFO:tasks.workunit.client.0.smithi067.stdout:1/430: rename d3/dd/l85 to d3/dd/d50/l9c 0 2024-08-31T05:21:29.516 INFO:tasks.workunit.client.0.smithi067.stdout:4/490: dwrite d4/d9/d5a/f74 [4194304,4194304] 0 2024-08-31T05:21:29.519 INFO:tasks.workunit.client.0.smithi067.stdout:1/431: dread d3/d23/d2d/d2e/d34/d66/d72/f4f [0,4194304] 0 2024-08-31T05:21:29.527 INFO:tasks.workunit.client.0.smithi067.stdout:1/432: dwrite d3/dd/f20 [0,4194304] 0 2024-08-31T05:21:29.532 INFO:tasks.workunit.client.0.smithi067.stdout:1/433: mkdir d3/d23/d2d/d2e/d34/d66/d94/d9d 0 2024-08-31T05:21:29.539 INFO:tasks.workunit.client.0.smithi067.stdout:4/491: write d4/d42/f50 [181921,4482] 0 2024-08-31T05:21:29.543 INFO:tasks.workunit.client.0.smithi067.stdout:4/492: dread d4/d14/d48/d66/faf [4194304,4194304] 0 2024-08-31T05:21:29.553 INFO:tasks.workunit.client.0.smithi067.stdout:1/434: dwrite d3/d36/f53 [0,4194304] 0 2024-08-31T05:21:29.556 INFO:tasks.workunit.client.0.smithi067.stdout:1/435: mknod d3/d23/d2d/d2e/d34/d66/d9a/c9e 0 2024-08-31T05:21:29.567 INFO:tasks.workunit.client.0.smithi067.stdout:1/436: dwrite d3/d23/d5d/f60 [0,4194304] 0 2024-08-31T05:21:29.569 INFO:tasks.workunit.client.0.smithi067.stdout:1/437: write d3/dd/f20 [3255861,100472] 0 2024-08-31T05:21:29.571 INFO:tasks.workunit.client.0.smithi067.stdout:1/438: write d3/d23/f98 [769583,130379] 0 2024-08-31T05:21:29.576 INFO:tasks.workunit.client.0.smithi067.stdout:1/439: rename d3/d23/d2d/f6e to d3/d23/d2d/d2e/d34/d66/d72/d82/f9f 0 2024-08-31T05:21:29.576 INFO:tasks.workunit.client.0.smithi067.stdout:1/440: chown d3/l3b 470 1 2024-08-31T05:21:29.578 INFO:tasks.workunit.client.0.smithi067.stdout:1/441: symlink d3/d23/d2d/d2e/d34/d66/la0 0 2024-08-31T05:21:29.579 INFO:tasks.workunit.client.0.smithi067.stdout:1/442: readlink d3/d23/l26 0 2024-08-31T05:21:29.584 INFO:tasks.workunit.client.0.smithi067.stdout:1/443: dread d3/f55 [0,4194304] 0 2024-08-31T05:21:29.586 INFO:tasks.workunit.client.0.smithi067.stdout:1/444: symlink d3/d23/d79/d93/la1 0 2024-08-31T05:21:29.592 INFO:tasks.workunit.client.0.smithi067.stdout:1/445: dwrite d3/dd/d50/f87 [0,4194304] 0 2024-08-31T05:21:29.593 INFO:tasks.workunit.client.0.smithi067.stdout:1/446: readlink d3/d23/d2d/d2e/d34/l5c 0 2024-08-31T05:21:29.596 INFO:tasks.workunit.client.0.smithi067.stdout:1/447: symlink d3/la2 0 2024-08-31T05:21:29.597 INFO:tasks.workunit.client.0.smithi067.stdout:1/448: write d3/dd/f84 [421413,103058] 0 2024-08-31T05:21:29.608 INFO:tasks.workunit.client.0.smithi067.stdout:1/449: write d3/f52 [340283,14280] 0 2024-08-31T05:21:29.616 INFO:tasks.workunit.client.0.smithi067.stdout:1/450: truncate d3/d23/f98 1537503 0 2024-08-31T05:21:29.620 INFO:tasks.workunit.client.0.smithi067.stdout:1/451: getdents d3/d23/d2d/d2e/d34/d66/d72 0 2024-08-31T05:21:29.621 INFO:tasks.workunit.client.0.smithi067.stdout:1/452: fdatasync d3/d23/f90 0 2024-08-31T05:21:29.625 INFO:tasks.workunit.client.0.smithi067.stdout:1/453: dread d3/d23/d5d/f60 [0,4194304] 0 2024-08-31T05:21:29.627 INFO:tasks.workunit.client.0.smithi067.stdout:1/454: mkdir d3/d23/d2d/d2e/d34/da3 0 2024-08-31T05:21:29.627 INFO:tasks.workunit.client.0.smithi067.stdout:1/455: stat d3/c30 0 2024-08-31T05:21:29.629 INFO:tasks.workunit.client.0.smithi067.stdout:1/456: fdatasync d3/d23/d5d/f61 0 2024-08-31T05:21:29.636 INFO:tasks.workunit.client.0.smithi067.stdout:1/457: rename d3/d23/d2d/d2e/f37 to d3/d23/d79/fa4 0 2024-08-31T05:21:29.639 INFO:tasks.workunit.client.0.smithi067.stdout:1/458: creat d3/d23/d79/fa5 x:0 0 0 2024-08-31T05:21:29.645 INFO:tasks.workunit.client.0.smithi067.stdout:1/459: truncate d3/d36/f53 2848603 0 2024-08-31T05:21:29.647 INFO:tasks.workunit.client.0.smithi067.stdout:1/460: creat d3/d23/d79/fa6 x:0 0 0 2024-08-31T05:21:29.648 INFO:tasks.workunit.client.0.smithi067.stdout:1/461: write d3/d36/f65 [395813,3768] 0 2024-08-31T05:21:29.649 INFO:tasks.workunit.client.0.smithi067.stdout:1/462: read d3/f55 [6094,103914] 0 2024-08-31T05:21:29.651 INFO:tasks.workunit.client.0.smithi067.stdout:1/463: fsync d3/f55 0 2024-08-31T05:21:29.659 INFO:tasks.workunit.client.0.smithi067.stdout:1/464: dwrite d3/f19 [0,4194304] 0 2024-08-31T05:21:29.665 INFO:tasks.workunit.client.0.smithi067.stdout:1/465: symlink d3/d23/d2d/la7 0 2024-08-31T05:21:29.670 INFO:tasks.workunit.client.0.smithi067.stdout:1/466: link d3/d23/d2d/d2e/d34/d66/d72/c46 d3/ca8 0 2024-08-31T05:21:29.671 INFO:tasks.workunit.client.0.smithi067.stdout:1/467: readlink d3/d23/d5d/l6d 0 2024-08-31T05:21:29.674 INFO:tasks.workunit.client.0.smithi067.stdout:1/468: mknod d3/d23/d2d/d2e/d34/d66/d94/d9d/ca9 0 2024-08-31T05:21:29.675 INFO:tasks.workunit.client.0.smithi067.stdout:1/469: chown d3/dd/c4c 1590097 1 2024-08-31T05:21:29.677 INFO:tasks.workunit.client.0.smithi067.stdout:1/470: mknod d3/d23/d2d/d2e/d34/d66/d9a/caa 0 2024-08-31T05:21:29.677 INFO:tasks.workunit.client.0.smithi067.stdout:1/471: chown d3/f55 60128 1 2024-08-31T05:21:29.680 INFO:tasks.workunit.client.0.smithi067.stdout:1/472: creat d3/d23/d2d/d2e/d34/d66/fab x:0 0 0 2024-08-31T05:21:29.688 INFO:tasks.workunit.client.0.smithi067.stdout:1/473: write d3/d23/f91 [2490392,16082] 0 2024-08-31T05:21:29.690 INFO:tasks.workunit.client.0.smithi067.stdout:1/474: unlink d3/d23/d2d/d2e/d34/f6c 0 2024-08-31T05:21:29.691 INFO:tasks.workunit.client.0.smithi067.stdout:1/475: readlink d3/dd/d50/l5e 0 2024-08-31T05:21:29.692 INFO:tasks.workunit.client.0.smithi067.stdout:1/476: fsync d3/d23/d2d/d2e/d34/d66/f8a 0 2024-08-31T05:21:29.697 INFO:tasks.workunit.client.0.smithi067.stdout:1/477: read d3/d23/d79/fa4 [1341461,51988] 0 2024-08-31T05:21:29.698 INFO:tasks.workunit.client.0.smithi067.stdout:1/478: mknod d3/d23/d2d/d2e/d34/d66/d94/cac 0 2024-08-31T05:21:29.699 INFO:tasks.workunit.client.0.smithi067.stdout:1/479: chown d3/dd/d50/f81 21028 1 2024-08-31T05:21:29.722 INFO:tasks.workunit.client.0.smithi067.stdout:1/480: dread d3/d23/d2d/d2e/f62 [0,4194304] 0 2024-08-31T05:21:29.724 INFO:tasks.workunit.client.0.smithi067.stdout:1/481: dread d3/d23/d2d/d2e/d34/d66/d72/f4f [0,4194304] 0 2024-08-31T05:21:29.726 INFO:tasks.workunit.client.0.smithi067.stdout:1/482: getdents d3/d23/d2d/d2e/d34/da3 0 2024-08-31T05:21:29.727 INFO:tasks.workunit.client.0.smithi067.stdout:1/483: write d3/dd/d50/f8c [1059810,120187] 0 2024-08-31T05:21:29.731 INFO:tasks.workunit.client.0.smithi067.stdout:1/484: symlink d3/d23/d2d/d2e/d34/d66/d72/d82/lad 0 2024-08-31T05:21:29.731 INFO:tasks.workunit.client.0.smithi067.stdout:2/704: sync 2024-08-31T05:21:29.734 INFO:tasks.workunit.client.0.smithi067.stdout:1/485: creat d3/d23/d2d/d2e/d34/d66/d94/d9d/fae x:0 0 0 2024-08-31T05:21:29.736 INFO:tasks.workunit.client.0.smithi067.stdout:1/486: write d3/d23/d2d/d2e/d34/d66/fab [190644,103953] 0 2024-08-31T05:21:29.743 INFO:tasks.workunit.client.0.smithi067.stdout:1/487: dread d3/d23/d79/fa4 [0,4194304] 0 2024-08-31T05:21:29.745 INFO:tasks.workunit.client.0.smithi067.stdout:2/705: dread db/d12/f39 [0,4194304] 0 2024-08-31T05:21:29.748 INFO:tasks.workunit.client.0.smithi067.stdout:1/488: rename d3/dd/l35 to d3/d23/d79/laf 0 2024-08-31T05:21:29.754 INFO:tasks.workunit.client.0.smithi067.stdout:1/489: truncate d3/dd/f51 51459 0 2024-08-31T05:21:29.755 INFO:tasks.workunit.client.0.smithi067.stdout:1/490: write d3/d23/d79/fa6 [230029,17128] 0 2024-08-31T05:21:29.770 INFO:tasks.workunit.client.0.smithi067.stdout:1/491: creat d3/d23/fb0 x:0 0 0 2024-08-31T05:21:29.775 INFO:tasks.workunit.client.0.smithi067.stdout:1/492: mkdir d3/d23/db1 0 2024-08-31T05:21:29.776 INFO:tasks.workunit.client.0.smithi067.stdout:1/493: stat d3/d23/d2d/d2e/d34/c4d 0 2024-08-31T05:21:29.779 INFO:tasks.workunit.client.0.smithi067.stdout:1/494: creat d3/d23/d2d/d2e/fb2 x:0 0 0 2024-08-31T05:21:29.782 INFO:tasks.workunit.client.0.smithi067.stdout:1/495: creat d3/d23/d79/fb3 x:0 0 0 2024-08-31T05:21:29.783 INFO:tasks.workunit.client.0.smithi067.stdout:1/496: write d3/d23/d2d/d2e/d34/d66/d72/f48 [3861593,1767] 0 2024-08-31T05:21:29.784 INFO:tasks.workunit.client.0.smithi067.stdout:1/497: fdatasync d3/d36/f65 0 2024-08-31T05:21:29.785 INFO:tasks.workunit.client.0.smithi067.stdout:1/498: chown d3/d23/d79/d93 378726 1 2024-08-31T05:21:29.839 INFO:tasks.workunit.client.0.smithi067.stdout:1/499: dwrite d3/f15 [0,4194304] 0 2024-08-31T05:21:29.849 INFO:tasks.workunit.client.0.smithi067.stdout:1/500: dread d3/d23/d2d/d2e/d34/d66/d72/f5a [0,4194304] 0 2024-08-31T05:21:29.853 INFO:tasks.workunit.client.0.smithi067.stdout:1/501: symlink d3/d23/d2d/d2e/d34/da3/lb4 0 2024-08-31T05:21:29.855 INFO:tasks.workunit.client.0.smithi067.stdout:1/502: mkdir d3/dd/d50/db5 0 2024-08-31T05:21:29.856 INFO:tasks.workunit.client.0.smithi067.stdout:1/503: mkdir d3/d23/db1/db6 0 2024-08-31T05:21:29.861 INFO:tasks.workunit.client.0.smithi067.stdout:1/504: getdents d3/d36/d8f 0 2024-08-31T05:21:29.862 INFO:tasks.workunit.client.0.smithi067.stdout:1/505: fsync d3/d23/d79/fa4 0 2024-08-31T05:21:29.863 INFO:tasks.workunit.client.0.smithi067.stdout:1/506: readlink d3/d23/d2d/la7 0 2024-08-31T05:21:29.868 INFO:tasks.workunit.client.0.smithi067.stdout:1/507: rename d3/dd/l80 to d3/lb7 0 2024-08-31T05:21:29.871 INFO:tasks.workunit.client.0.smithi067.stdout:1/508: creat d3/d23/d2d/d2e/d34/da3/fb8 x:0 0 0 2024-08-31T05:21:29.875 INFO:tasks.workunit.client.0.smithi067.stdout:1/509: link d3/d23/d2d/d2e/d34/da3/fb8 d3/d23/d2d/d2e/d34/d66/d94/fb9 0 2024-08-31T05:21:29.877 INFO:tasks.workunit.client.0.smithi067.stdout:1/510: symlink d3/d23/d2d/d2e/d34/d66/d9a/lba 0 2024-08-31T05:21:29.888 INFO:tasks.workunit.client.0.smithi067.stdout:1/511: write d3/d23/f3c [209016,61169] 0 2024-08-31T05:21:29.894 INFO:tasks.workunit.client.0.smithi067.stdout:1/512: dwrite d3/f52 [0,4194304] 0 2024-08-31T05:21:29.895 INFO:tasks.workunit.client.0.smithi067.stdout:1/513: chown d3/d36/l42 18339 1 2024-08-31T05:21:29.901 INFO:tasks.workunit.client.0.smithi067.stdout:1/514: dwrite d3/d23/d2d/d2e/d34/d66/f67 [0,4194304] 0 2024-08-31T05:21:29.902 INFO:tasks.workunit.client.0.smithi067.stdout:1/515: write d3/d23/d2d/d2e/f5b [2068877,7548] 0 2024-08-31T05:21:29.906 INFO:tasks.workunit.client.0.smithi067.stdout:1/516: creat d3/d23/d2d/d2e/d34/d66/d72/d82/fbb x:0 0 0 2024-08-31T05:21:29.907 INFO:tasks.workunit.client.0.smithi067.stdout:1/517: write d3/d36/d8f/f99 [1031427,1748] 0 2024-08-31T05:21:29.911 INFO:tasks.workunit.client.0.smithi067.stdout:1/518: dread d3/f52 [0,4194304] 0 2024-08-31T05:21:29.912 INFO:tasks.workunit.client.0.smithi067.stdout:1/519: fsync d3/d36/d8f/f99 0 2024-08-31T05:21:29.926 INFO:tasks.workunit.client.0.smithi067.stdout:1/520: dwrite d3/f13 [4194304,4194304] 0 2024-08-31T05:21:29.933 INFO:tasks.workunit.client.0.smithi067.stdout:1/521: getdents d3/d23/d79 0 2024-08-31T05:21:29.935 INFO:tasks.workunit.client.0.smithi067.stdout:1/522: mkdir d3/d23/d2d/d2e/d34/dbc 0 2024-08-31T05:21:29.936 INFO:tasks.workunit.client.0.smithi067.stdout:1/523: stat d3/dd/l2b 0 2024-08-31T05:21:29.936 INFO:tasks.workunit.client.0.smithi067.stdout:1/524: chown d3/d23/d2d 16 1 2024-08-31T05:21:29.938 INFO:tasks.workunit.client.0.smithi067.stdout:1/525: rmdir d3/d23/d2d/d2e/d34/da3 39 2024-08-31T05:21:29.939 INFO:tasks.workunit.client.0.smithi067.stdout:1/526: mknod d3/dd/d50/cbd 0 2024-08-31T05:21:29.942 INFO:tasks.workunit.client.0.smithi067.stdout:1/527: truncate d3/d23/d2d/d2e/d34/f64 591345 0 2024-08-31T05:21:29.943 INFO:tasks.workunit.client.0.smithi067.stdout:7/433: sync 2024-08-31T05:21:29.944 INFO:tasks.workunit.client.0.smithi067.stdout:1/528: mknod d3/d23/d2d/d2e/d34/d66/d9a/cbe 0 2024-08-31T05:21:29.944 INFO:tasks.workunit.client.0.smithi067.stdout:7/434: rmdir d14/d3e 39 2024-08-31T05:21:29.946 INFO:tasks.workunit.client.0.smithi067.stdout:1/529: unlink d3/d23/f33 0 2024-08-31T05:21:29.951 INFO:tasks.workunit.client.0.smithi067.stdout:1/530: mknod d3/cbf 0 2024-08-31T05:21:29.954 INFO:tasks.workunit.client.0.smithi067.stdout:1/531: symlink d3/d23/d2d/d2e/d34/da3/lc0 0 2024-08-31T05:21:29.958 INFO:tasks.workunit.client.0.smithi067.stdout:1/532: creat d3/d23/d2d/d2e/d34/d66/d72/fc1 x:0 0 0 2024-08-31T05:21:29.960 INFO:tasks.workunit.client.0.smithi067.stdout:7/435: dread d14/d16/d28/d2e/f37 [0,4194304] 0 2024-08-31T05:21:29.963 INFO:tasks.workunit.client.0.smithi067.stdout:1/533: mkdir d3/dd/d50/db5/dc2 0 2024-08-31T05:21:29.964 INFO:tasks.workunit.client.0.smithi067.stdout:7/436: rename l12 to d14/d54/d5e/l72 0 2024-08-31T05:21:29.967 INFO:tasks.workunit.client.0.smithi067.stdout:7/437: truncate d14/d16/f32 3898255 0 2024-08-31T05:21:29.967 INFO:tasks.workunit.client.0.smithi067.stdout:7/438: stat d14/d54/d5e/f6a 0 2024-08-31T05:21:29.973 INFO:tasks.workunit.client.0.smithi067.stdout:7/439: dwrite d14/d16/f41 [4194304,4194304] 0 2024-08-31T05:21:29.985 INFO:tasks.workunit.client.0.smithi067.stdout:7/440: dwrite f7 [0,4194304] 0 2024-08-31T05:21:29.993 INFO:tasks.workunit.client.0.smithi067.stdout:7/441: rename d14/d16/d28/c31 to d14/d16/d28/c73 0 2024-08-31T05:21:29.996 INFO:tasks.workunit.client.0.smithi067.stdout:7/442: link d14/d4a/f4b d14/d16/d5b/d68/f74 0 2024-08-31T05:21:29.998 INFO:tasks.workunit.client.0.smithi067.stdout:7/443: creat d14/d54/d5e/f75 x:0 0 0 2024-08-31T05:21:29.999 INFO:tasks.workunit.client.0.smithi067.stdout:7/444: creat d14/d4a/f76 x:0 0 0 2024-08-31T05:21:30.001 INFO:tasks.workunit.client.0.smithi067.stdout:7/445: symlink d14/d16/d5b/d68/l77 0 2024-08-31T05:21:30.010 INFO:tasks.workunit.client.0.smithi067.stdout:7/446: getdents d14/d54/d5e 0 2024-08-31T05:21:30.016 INFO:tasks.workunit.client.0.smithi067.stdout:7/447: getdents d14/d16/d5b/d68 0 2024-08-31T05:21:30.019 INFO:tasks.workunit.client.0.smithi067.stdout:7/448: mkdir d14/d16/d28/d78 0 2024-08-31T05:21:30.020 INFO:tasks.workunit.client.0.smithi067.stdout:7/449: write d14/d16/f24 [8879593,77469] 0 2024-08-31T05:21:30.347 INFO:tasks.workunit.client.0.smithi067.stdout:8/678: sync 2024-08-31T05:21:30.473 INFO:tasks.workunit.client.0.smithi067.stdout:1/534: sync 2024-08-31T05:21:30.473 INFO:tasks.workunit.client.0.smithi067.stdout:5/534: sync 2024-08-31T05:21:30.473 INFO:tasks.workunit.client.0.smithi067.stdout:9/621: sync 2024-08-31T05:21:30.473 INFO:tasks.workunit.client.0.smithi067.stdout:0/799: sync 2024-08-31T05:21:30.473 INFO:tasks.workunit.client.0.smithi067.stdout:2/706: sync 2024-08-31T05:21:30.473 INFO:tasks.workunit.client.0.smithi067.stdout:7/450: sync 2024-08-31T05:21:30.474 INFO:tasks.workunit.client.0.smithi067.stdout:3/896: sync 2024-08-31T05:21:30.474 INFO:tasks.workunit.client.0.smithi067.stdout:4/493: sync 2024-08-31T05:21:30.474 INFO:tasks.workunit.client.0.smithi067.stdout:6/745: sync 2024-08-31T05:21:30.475 INFO:tasks.workunit.client.0.smithi067.stdout:1/535: readlink d3/l3b 0 2024-08-31T05:21:30.475 INFO:tasks.workunit.client.0.smithi067.stdout:6/746: stat d1b/d23/f34 0 2024-08-31T05:21:30.475 INFO:tasks.workunit.client.0.smithi067.stdout:2/707: stat db/dd/d13/lc2 0 2024-08-31T05:21:30.476 INFO:tasks.workunit.client.0.smithi067.stdout:0/800: chown d1/c2 18 1 2024-08-31T05:21:30.476 INFO:tasks.workunit.client.0.smithi067.stdout:4/494: truncate d4/d1f/d34/f3c 4973624 0 2024-08-31T05:21:30.482 INFO:tasks.workunit.client.0.smithi067.stdout:6/747: symlink d1b/d7a/lf2 0 2024-08-31T05:21:30.483 INFO:tasks.workunit.client.0.smithi067.stdout:6/748: dread - d1b/d23/d61/d77/fe4 zero size 2024-08-31T05:21:30.483 INFO:tasks.workunit.client.0.smithi067.stdout:1/536: fdatasync d3/f27 0 2024-08-31T05:21:30.487 INFO:tasks.workunit.client.0.smithi067.stdout:0/801: mkdir d1/df/d17/d43/d48/d100 0 2024-08-31T05:21:30.493 INFO:tasks.workunit.client.0.smithi067.stdout:0/802: dwrite d1/df/d17/d43/d48/f7f [0,4194304] 0 2024-08-31T05:21:30.495 INFO:tasks.workunit.client.0.smithi067.stdout:5/535: write db/f19 [2480470,58652] 0 2024-08-31T05:21:30.496 INFO:tasks.workunit.client.0.smithi067.stdout:3/897: write db/d2e/da1/fb6 [869605,92284] 0 2024-08-31T05:21:30.503 INFO:tasks.workunit.client.0.smithi067.stdout:6/749: unlink d1b/f20 0 2024-08-31T05:21:30.507 INFO:tasks.workunit.client.0.smithi067.stdout:1/537: mknod d3/dd/d50/cc3 0 2024-08-31T05:21:30.507 INFO:tasks.workunit.client.0.smithi067.stdout:7/451: dwrite d14/d16/d28/d2e/f3a [0,4194304] 0 2024-08-31T05:21:30.509 INFO:tasks.workunit.client.0.smithi067.stdout:1/538: chown d3/d23/d2d/d2e/d34/d66/d72/l83 2 1 2024-08-31T05:21:30.510 INFO:tasks.workunit.client.0.smithi067.stdout:0/803: mknod d1/d50/c101 0 2024-08-31T05:21:30.514 INFO:tasks.workunit.client.0.smithi067.stdout:5/536: read db/d1d/f2d [1639709,74284] 0 2024-08-31T05:21:30.515 INFO:tasks.workunit.client.0.smithi067.stdout:6/750: symlink d1b/d40/d70/dd0/lf3 0 2024-08-31T05:21:30.518 INFO:tasks.workunit.client.0.smithi067.stdout:7/452: mknod d14/d54/d5e/c79 0 2024-08-31T05:21:30.520 INFO:tasks.workunit.client.0.smithi067.stdout:4/495: link d4/d1f/d34/cab d4/d42/cb1 0 2024-08-31T05:21:30.521 INFO:tasks.workunit.client.0.smithi067.stdout:4/496: dread - d4/d1f/f99 zero size 2024-08-31T05:21:30.522 INFO:tasks.workunit.client.0.smithi067.stdout:0/804: rmdir d1/df/d17/d43/d48/d6a/d84/db7 39 2024-08-31T05:21:30.525 INFO:tasks.workunit.client.0.smithi067.stdout:2/708: truncate db/d12/d1a/d2b/d3d/f8f 5677063 0 2024-08-31T05:21:30.526 INFO:tasks.workunit.client.0.smithi067.stdout:9/622: link dd/df/d5b/l75 dd/lcf 0 2024-08-31T05:21:30.532 INFO:tasks.workunit.client.0.smithi067.stdout:3/898: truncate db/d17/d3f/f117 1507019 0 2024-08-31T05:21:30.533 INFO:tasks.workunit.client.0.smithi067.stdout:1/539: mkdir d3/d23/db1/db6/dc4 0 2024-08-31T05:21:30.533 INFO:tasks.workunit.client.0.smithi067.stdout:9/623: dwrite dd/d63/fc5 [0,4194304] 0 2024-08-31T05:21:30.537 INFO:tasks.workunit.client.0.smithi067.stdout:2/709: rmdir db/dd/d13 39 2024-08-31T05:21:30.540 INFO:tasks.workunit.client.0.smithi067.stdout:2/710: chown db/l32 33008 1 2024-08-31T05:21:30.541 INFO:tasks.workunit.client.0.smithi067.stdout:9/624: unlink dd/df/f2e 0 2024-08-31T05:21:30.545 INFO:tasks.workunit.client.0.smithi067.stdout:6/751: dwrite d1b/d23/d2e/f51 [0,4194304] 0 2024-08-31T05:21:30.546 INFO:tasks.workunit.client.0.smithi067.stdout:7/453: dwrite d14/d54/f66 [0,4194304] 0 2024-08-31T05:21:30.546 INFO:tasks.workunit.client.0.smithi067.stdout:1/540: truncate d3/d23/d5d/f61 749785 0 2024-08-31T05:21:30.549 INFO:tasks.workunit.client.0.smithi067.stdout:0/805: rename d1/d8/d66/l7c to d1/d8/d42/d98/df1/l102 0 2024-08-31T05:21:30.556 INFO:tasks.workunit.client.0.smithi067.stdout:9/625: mkdir dd/da2/dd0 0 2024-08-31T05:21:30.558 INFO:tasks.workunit.client.0.smithi067.stdout:7/454: mknod d14/d16/d5b/c7a 0 2024-08-31T05:21:30.558 INFO:tasks.workunit.client.0.smithi067.stdout:6/752: dwrite d1b/d23/d28/fdf [0,4194304] 0 2024-08-31T05:21:30.560 INFO:tasks.workunit.client.0.smithi067.stdout:6/753: read - d1b/d23/d28/db9/feb zero size 2024-08-31T05:21:30.561 INFO:tasks.workunit.client.0.smithi067.stdout:0/806: rename d1/c5 to d1/d8/d42/d98/c103 0 2024-08-31T05:21:30.562 INFO:tasks.workunit.client.0.smithi067.stdout:0/807: readlink d1/d50/laf 0 2024-08-31T05:21:30.570 INFO:tasks.workunit.client.0.smithi067.stdout:4/497: getdents d4/d1e/d62 0 2024-08-31T05:21:30.570 INFO:tasks.workunit.client.0.smithi067.stdout:9/626: symlink dd/da2/ld1 0 2024-08-31T05:21:30.574 INFO:tasks.workunit.client.0.smithi067.stdout:0/808: creat d1/dd/d4d/f104 x:0 0 0 2024-08-31T05:21:30.574 INFO:tasks.workunit.client.0.smithi067.stdout:8/679: sync 2024-08-31T05:21:30.581 INFO:tasks.workunit.client.0.smithi067.stdout:6/754: rename d1b/d40/c53 to d1b/d40/d96/db6/cf4 0 2024-08-31T05:21:30.592 INFO:tasks.workunit.client.0.smithi067.stdout:7/455: dwrite d14/d4a/f4b [0,4194304] 0 2024-08-31T05:21:30.594 INFO:tasks.workunit.client.0.smithi067.stdout:4/498: creat d4/d1e/d62/dae/fb2 x:0 0 0 2024-08-31T05:21:30.596 INFO:tasks.workunit.client.0.smithi067.stdout:4/499: chown d4/d42/l58 7 1 2024-08-31T05:21:30.598 INFO:tasks.workunit.client.0.smithi067.stdout:4/500: read d4/f76 [9955,33447] 0 2024-08-31T05:21:30.599 INFO:tasks.workunit.client.0.smithi067.stdout:0/809: symlink d1/df/d29/d37/l105 0 2024-08-31T05:21:30.600 INFO:tasks.workunit.client.0.smithi067.stdout:0/810: stat d1/dd/l7a 0 2024-08-31T05:21:30.600 INFO:tasks.workunit.client.0.smithi067.stdout:1/541: dwrite d3/d23/d2d/d2e/d34/d66/d72/d82/f9f [0,4194304] 0 2024-08-31T05:21:30.601 INFO:tasks.workunit.client.0.smithi067.stdout:8/680: write d0/d4/d64/fa4 [436226,3747] 0 2024-08-31T05:21:30.602 INFO:tasks.workunit.client.0.smithi067.stdout:3/899: link db/d17/l22 db/d55/d97/dc4/dcb/l123 0 2024-08-31T05:21:30.605 INFO:tasks.workunit.client.0.smithi067.stdout:3/900: dread db/d17/d3f/f7f [0,4194304] 0 2024-08-31T05:21:30.607 INFO:tasks.workunit.client.0.smithi067.stdout:2/711: link db/d12/d1a/d2b/d3d/d69/d3b/d82/c92 db/d12/d1a/d2b/d3d/d69/d3b/d99/cdf 0 2024-08-31T05:21:30.607 INFO:tasks.workunit.client.0.smithi067.stdout:3/901: truncate db/d17/f6c 9425446 0 2024-08-31T05:21:30.608 INFO:tasks.workunit.client.0.smithi067.stdout:9/627: truncate dd/f9b 2070383 0 2024-08-31T05:21:30.609 INFO:tasks.workunit.client.0.smithi067.stdout:2/712: chown db/d12/d1a/d2b/d3d/d69/d3b/d82 785 1 2024-08-31T05:21:30.612 INFO:tasks.workunit.client.0.smithi067.stdout:7/456: creat d14/d16/d5b/d68/f7b x:0 0 0 2024-08-31T05:21:30.616 INFO:tasks.workunit.client.0.smithi067.stdout:6/755: unlink d1b/d23/c4b 0 2024-08-31T05:21:30.618 INFO:tasks.workunit.client.0.smithi067.stdout:0/811: rename d1/d8/d77/f81 to d1/df/d17/d43/d48/d100/f106 0 2024-08-31T05:21:30.621 INFO:tasks.workunit.client.0.smithi067.stdout:0/812: truncate d1/df/d17/d94/fe5 5434 0 2024-08-31T05:21:30.628 INFO:tasks.workunit.client.0.smithi067.stdout:4/501: dread d4/d1e/f26 [0,4194304] 0 2024-08-31T05:21:30.629 INFO:tasks.workunit.client.0.smithi067.stdout:4/502: write d4/d32/d4c/f90 [1762016,74479] 0 2024-08-31T05:21:30.630 INFO:tasks.workunit.client.0.smithi067.stdout:4/503: chown d4/d42 1830 1 2024-08-31T05:21:30.631 INFO:tasks.workunit.client.0.smithi067.stdout:4/504: chown d4/d9/f7e 10326506 1 2024-08-31T05:21:30.632 INFO:tasks.workunit.client.0.smithi067.stdout:4/505: truncate d4/d9/f7e 630598 0 2024-08-31T05:21:30.633 INFO:tasks.workunit.client.0.smithi067.stdout:4/506: stat d4/d14/d48/d66/f82 0 2024-08-31T05:21:30.634 INFO:tasks.workunit.client.0.smithi067.stdout:6/756: creat d1b/d40/de8/ff5 x:0 0 0 2024-08-31T05:21:30.635 INFO:tasks.workunit.client.0.smithi067.stdout:6/757: fsync d1b/d23/d28/f85 0 2024-08-31T05:21:30.636 INFO:tasks.workunit.client.0.smithi067.stdout:1/542: rename d3/d36/d8f to d3/d23/d2d/d2e/d34/d66/d72/d82/dc5 0 2024-08-31T05:21:30.637 INFO:tasks.workunit.client.0.smithi067.stdout:7/457: write d14/f51 [369058,62437] 0 2024-08-31T05:21:30.639 INFO:tasks.workunit.client.0.smithi067.stdout:0/813: rmdir d1/dd/d4d/d88/dac 39 2024-08-31T05:21:30.642 INFO:tasks.workunit.client.0.smithi067.stdout:9/628: mknod dd/df/dc6/cd2 0 2024-08-31T05:21:30.642 INFO:tasks.workunit.client.0.smithi067.stdout:9/629: dread - dd/da2/fc2 zero size 2024-08-31T05:21:30.646 INFO:tasks.workunit.client.0.smithi067.stdout:8/681: truncate d0/d2/da/dd/d1f/fa8 162261 0 2024-08-31T05:21:30.646 INFO:tasks.workunit.client.0.smithi067.stdout:8/682: chown d0/d2/da/fcf 29 1 2024-08-31T05:21:30.647 INFO:tasks.workunit.client.0.smithi067.stdout:3/902: write db/d2e/f46 [13345,128172] 0 2024-08-31T05:21:30.648 INFO:tasks.workunit.client.0.smithi067.stdout:8/683: write d0/d74/dcb/fd9 [4211479,7772] 0 2024-08-31T05:21:30.648 INFO:tasks.workunit.client.0.smithi067.stdout:4/507: truncate d4/d42/f71 732633 0 2024-08-31T05:21:30.648 INFO:tasks.workunit.client.0.smithi067.stdout:4/508: chown d4/d9/d4b 0 1 2024-08-31T05:21:30.651 INFO:tasks.workunit.client.0.smithi067.stdout:2/713: rename db/dd/d13/l37 to db/d12/d1a/d1e/d4d/le0 0 2024-08-31T05:21:30.652 INFO:tasks.workunit.client.0.smithi067.stdout:1/543: creat d3/d8b/fc6 x:0 0 0 2024-08-31T05:21:30.652 INFO:tasks.workunit.client.0.smithi067.stdout:1/544: chown d3/dd/d50/f8c 1445031801 1 2024-08-31T05:21:30.654 INFO:tasks.workunit.client.0.smithi067.stdout:1/545: write d3/d23/d2d/d2e/d34/d66/f89 [177132,67584] 0 2024-08-31T05:21:30.655 INFO:tasks.workunit.client.0.smithi067.stdout:7/458: symlink d14/d16/d5b/l7c 0 2024-08-31T05:21:30.655 INFO:tasks.workunit.client.0.smithi067.stdout:1/546: truncate d3/dd/f20 4956045 0 2024-08-31T05:21:30.656 INFO:tasks.workunit.client.0.smithi067.stdout:0/814: fdatasync d1/df/f6d 0 2024-08-31T05:21:30.657 INFO:tasks.workunit.client.0.smithi067.stdout:0/815: fsync d1/df/d29/d37/f56 0 2024-08-31T05:21:30.659 INFO:tasks.workunit.client.0.smithi067.stdout:9/630: mknod dd/df/d25/d3b/d50/cd3 0 2024-08-31T05:21:30.659 INFO:tasks.workunit.client.0.smithi067.stdout:1/547: write d3/d23/d2d/d2e/d34/d66/d72/d82/f9f [1305302,27921] 0 2024-08-31T05:21:30.663 INFO:tasks.workunit.client.0.smithi067.stdout:7/459: dwrite d14/d16/f60 [0,4194304] 0 2024-08-31T05:21:30.664 INFO:tasks.workunit.client.0.smithi067.stdout:3/903: rmdir db/d12/d21/dff 39 2024-08-31T05:21:30.664 INFO:tasks.workunit.client.0.smithi067.stdout:7/460: truncate d14/d4a/f76 391470 0 2024-08-31T05:21:30.667 INFO:tasks.workunit.client.0.smithi067.stdout:6/758: rename d1b/d40/d70/dd0/d5e/l94 to d1b/d23/d28/lf6 0 2024-08-31T05:21:30.671 INFO:tasks.workunit.client.0.smithi067.stdout:2/714: mkdir db/d12/d1a/d2b/d3d/d4f/de1 0 2024-08-31T05:21:30.681 INFO:tasks.workunit.client.0.smithi067.stdout:0/816: unlink d1/df/d29/d37/l105 0 2024-08-31T05:21:30.684 INFO:tasks.workunit.client.0.smithi067.stdout:1/548: creat d3/d23/d2d/d2e/d34/da3/fc7 x:0 0 0 2024-08-31T05:21:30.685 INFO:tasks.workunit.client.0.smithi067.stdout:1/549: stat d3/d23/d2d/d2e/d34/d66 0 2024-08-31T05:21:30.686 INFO:tasks.workunit.client.0.smithi067.stdout:1/550: write d3/d23/d2d/d2e/fb2 [565940,53910] 0 2024-08-31T05:21:30.691 INFO:tasks.workunit.client.0.smithi067.stdout:8/684: rename d0/d2/dc/d28/d7e/dbd to d0/d4/de/d1d/d2c/d68/de3 0 2024-08-31T05:21:30.691 INFO:tasks.workunit.client.0.smithi067.stdout:3/904: dwrite db/d17/d3f/d54/fa6 [0,4194304] 0 2024-08-31T05:21:30.692 INFO:tasks.workunit.client.0.smithi067.stdout:3/905: write db/f53 [3690328,60848] 0 2024-08-31T05:21:30.693 INFO:tasks.workunit.client.0.smithi067.stdout:6/759: truncate d1b/d7a/fbb 5214598 0 2024-08-31T05:21:30.694 INFO:tasks.workunit.client.0.smithi067.stdout:6/760: chown d1b/d40/d96/db6 713529 1 2024-08-31T05:21:30.695 INFO:tasks.workunit.client.0.smithi067.stdout:6/761: readlink d1b/d40/d70/dd0/d5e/d7b/ld2 0 2024-08-31T05:21:30.697 INFO:tasks.workunit.client.0.smithi067.stdout:6/762: chown d1b/d40/d70/dd0/d5c/c6a 7696676 1 2024-08-31T05:21:30.698 INFO:tasks.workunit.client.0.smithi067.stdout:7/461: creat d14/d16/d28/d78/f7d x:0 0 0 2024-08-31T05:21:30.702 INFO:tasks.workunit.client.0.smithi067.stdout:1/551: creat d3/dd/fc8 x:0 0 0 2024-08-31T05:21:30.702 INFO:tasks.workunit.client.0.smithi067.stdout:0/817: dwrite d1/dd/d4d/d88/dac/d8d/fe3 [0,4194304] 0 2024-08-31T05:21:30.702 INFO:tasks.workunit.client.0.smithi067.stdout:9/631: write dd/df/d25/d59/f81 [948132,63664] 0 2024-08-31T05:21:30.706 INFO:tasks.workunit.client.0.smithi067.stdout:1/552: dread d3/d23/d2d/d2e/d34/d66/f89 [0,4194304] 0 2024-08-31T05:21:30.707 INFO:tasks.workunit.client.0.smithi067.stdout:8/685: creat d0/d2/dc/d28/d7e/d73/d84/da6/db1/db3/fe4 x:0 0 0 2024-08-31T05:21:30.710 INFO:tasks.workunit.client.0.smithi067.stdout:7/462: dread d14/d54/d5e/f6a [0,4194304] 0 2024-08-31T05:21:30.711 INFO:tasks.workunit.client.0.smithi067.stdout:3/906: mkdir db/d17/d3f/d54/ddf/dec/d124 0 2024-08-31T05:21:30.711 INFO:tasks.workunit.client.0.smithi067.stdout:9/632: dread dd/df/f11 [4194304,4194304] 0 2024-08-31T05:21:30.715 INFO:tasks.workunit.client.0.smithi067.stdout:9/633: read dd/df/f69 [1594717,23658] 0 2024-08-31T05:21:30.717 INFO:tasks.workunit.client.0.smithi067.stdout:8/686: dwrite d0/d2/f24 [0,4194304] 0 2024-08-31T05:21:30.732 INFO:tasks.workunit.client.0.smithi067.stdout:3/907: unlink db/d12/d21/d82/l10f 0 2024-08-31T05:21:30.734 INFO:tasks.workunit.client.0.smithi067.stdout:2/715: truncate f1 1186971 0 2024-08-31T05:21:30.734 INFO:tasks.workunit.client.0.smithi067.stdout:3/908: write db/d17/d3f/d54/ddf/f104 [409820,78921] 0 2024-08-31T05:21:30.735 INFO:tasks.workunit.client.0.smithi067.stdout:2/716: fdatasync db/d12/d1a/d2b/d40/d9b/fc9 0 2024-08-31T05:21:30.736 INFO:tasks.workunit.client.0.smithi067.stdout:3/909: truncate db/d55/d97/dc4/f109 229496 0 2024-08-31T05:21:30.743 INFO:tasks.workunit.client.0.smithi067.stdout:6/763: dwrite f14 [0,4194304] 0 2024-08-31T05:21:30.745 INFO:tasks.workunit.client.0.smithi067.stdout:1/553: write d3/f14 [238368,16005] 0 2024-08-31T05:21:30.753 INFO:tasks.workunit.client.0.smithi067.stdout:3/910: dread db/d55/d97/fb9 [12582912,4194304] 0 2024-08-31T05:21:30.757 INFO:tasks.workunit.client.0.smithi067.stdout:9/634: mkdir dd/df/d3c/dbe/dd4 0 2024-08-31T05:21:30.760 INFO:tasks.workunit.client.0.smithi067.stdout:6/764: rmdir d1b/d40/d96 39 2024-08-31T05:21:30.761 INFO:tasks.workunit.client.0.smithi067.stdout:1/554: rmdir d3/d23/d2d 39 2024-08-31T05:21:30.763 INFO:tasks.workunit.client.0.smithi067.stdout:3/911: mkdir db/d17/d3f/d54/ddf/d125 0 2024-08-31T05:21:30.764 INFO:tasks.workunit.client.0.smithi067.stdout:3/912: chown db/d2c/fe3 398845 1 2024-08-31T05:21:30.765 INFO:tasks.workunit.client.0.smithi067.stdout:0/818: getdents d1/df/d29 0 2024-08-31T05:21:30.767 INFO:tasks.workunit.client.0.smithi067.stdout:6/765: dwrite d1b/d23/d28/f2b [0,4194304] 0 2024-08-31T05:21:30.768 INFO:tasks.workunit.client.0.smithi067.stdout:7/463: getdents d14/d16/d28/d2e/d2f 0 2024-08-31T05:21:30.768 INFO:tasks.workunit.client.0.smithi067.stdout:1/555: stat d3/d23/d2d/d2e/d34/c4d 0 2024-08-31T05:21:30.770 INFO:tasks.workunit.client.0.smithi067.stdout:8/687: getdents d0/d4/de/d1d/d2c/d3c/da5/dc7 0 2024-08-31T05:21:30.770 INFO:tasks.workunit.client.0.smithi067.stdout:7/464: chown d14/d16/d5b/d64/l65 59 1 2024-08-31T05:21:30.773 INFO:tasks.workunit.client.0.smithi067.stdout:8/688: write d0/d4/f7d [1940248,91652] 0 2024-08-31T05:21:30.773 INFO:tasks.workunit.client.0.smithi067.stdout:9/635: truncate dd/d63/fc9 515373 0 2024-08-31T05:21:30.774 INFO:tasks.workunit.client.0.smithi067.stdout:1/556: creat d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/fc9 x:0 0 0 2024-08-31T05:21:30.775 INFO:tasks.workunit.client.0.smithi067.stdout:1/557: fdatasync d3/dd/fc8 0 2024-08-31T05:21:30.775 INFO:tasks.workunit.client.0.smithi067.stdout:6/766: symlink d1b/d40/d70/dd0/d8d/dc6/lf7 0 2024-08-31T05:21:30.777 INFO:tasks.workunit.client.0.smithi067.stdout:1/558: write d3/dd/f20 [1106025,86074] 0 2024-08-31T05:21:30.777 INFO:tasks.workunit.client.0.smithi067.stdout:6/767: fdatasync d1b/d40/d70/dd0/d5e/de6/fc7 0 2024-08-31T05:21:30.780 INFO:tasks.workunit.client.0.smithi067.stdout:7/465: creat d14/d16/d28/d2e/f7e x:0 0 0 2024-08-31T05:21:30.781 INFO:tasks.workunit.client.0.smithi067.stdout:9/636: mknod dd/d20/cd5 0 2024-08-31T05:21:30.783 INFO:tasks.workunit.client.0.smithi067.stdout:9/637: readlink l8 0 2024-08-31T05:21:30.784 INFO:tasks.workunit.client.0.smithi067.stdout:7/466: dread - d14/d16/d5b/f5c zero size 2024-08-31T05:21:30.784 INFO:tasks.workunit.client.0.smithi067.stdout:2/717: dwrite db/f70 [0,4194304] 0 2024-08-31T05:21:30.785 INFO:tasks.workunit.client.0.smithi067.stdout:7/467: chown d14/d16/f24 17541 1 2024-08-31T05:21:30.794 INFO:tasks.workunit.client.0.smithi067.stdout:8/689: mkdir d0/d2/dc/d3d/de5 0 2024-08-31T05:21:30.795 INFO:tasks.workunit.client.0.smithi067.stdout:0/819: dread d1/df/d29/d37/fa2 [0,4194304] 0 2024-08-31T05:21:30.796 INFO:tasks.workunit.client.0.smithi067.stdout:7/468: creat d14/d16/d28/d2e/f7f x:0 0 0 2024-08-31T05:21:30.797 INFO:tasks.workunit.client.0.smithi067.stdout:0/820: truncate d1/df/d17/d94/f9e 4794375 0 2024-08-31T05:21:30.800 INFO:tasks.workunit.client.0.smithi067.stdout:6/768: rename d1b/d8e/c36 to d1b/d40/d70/dd0/d5e/d7b/cf8 0 2024-08-31T05:21:30.803 INFO:tasks.workunit.client.0.smithi067.stdout:7/469: mkdir d14/d16/d5b/d68/d80 0 2024-08-31T05:21:30.804 INFO:tasks.workunit.client.0.smithi067.stdout:6/769: dread d1b/d23/d28/f2b [0,4194304] 0 2024-08-31T05:21:30.807 INFO:tasks.workunit.client.0.smithi067.stdout:0/821: creat d1/df/d29/d86/dc0/f107 x:0 0 0 2024-08-31T05:21:30.807 INFO:tasks.workunit.client.0.smithi067.stdout:0/822: chown d1/d8/f33 934 1 2024-08-31T05:21:30.809 INFO:tasks.workunit.client.0.smithi067.stdout:9/638: rename dd/df/c6d to dd/df/db5/cd6 0 2024-08-31T05:21:30.812 INFO:tasks.workunit.client.0.smithi067.stdout:7/470: readlink d14/d16/d5b/d64/l56 0 2024-08-31T05:21:30.814 INFO:tasks.workunit.client.0.smithi067.stdout:6/770: creat d1b/d40/d70/ff9 x:0 0 0 2024-08-31T05:21:30.814 INFO:tasks.workunit.client.0.smithi067.stdout:1/559: link d3/f24 d3/d23/db1/db6/fca 0 2024-08-31T05:21:30.817 INFO:tasks.workunit.client.0.smithi067.stdout:0/823: creat d1/dd/d18/d52/dc6/f108 x:0 0 0 2024-08-31T05:21:30.819 INFO:tasks.workunit.client.0.smithi067.stdout:2/718: rename db/d12/fbf to db/fe2 0 2024-08-31T05:21:30.824 INFO:tasks.workunit.client.0.smithi067.stdout:7/471: creat d14/d4a/f81 x:0 0 0 2024-08-31T05:21:30.827 INFO:tasks.workunit.client.0.smithi067.stdout:0/824: mkdir d1/d8/d42/d98/df1/d109 0 2024-08-31T05:21:30.828 INFO:tasks.workunit.client.0.smithi067.stdout:0/825: read - d1/df/d29/d86/db1/ff7 zero size 2024-08-31T05:21:30.829 INFO:tasks.workunit.client.0.smithi067.stdout:7/472: creat d14/d54/d5e/f82 x:0 0 0 2024-08-31T05:21:30.833 INFO:tasks.workunit.client.0.smithi067.stdout:1/560: dwrite d3/d23/d5d/f60 [4194304,4194304] 0 2024-08-31T05:21:30.833 INFO:tasks.workunit.client.0.smithi067.stdout:0/826: unlink d1/dd/l99 0 2024-08-31T05:21:30.834 INFO:tasks.workunit.client.0.smithi067.stdout:7/473: mknod d14/d4a/c83 0 2024-08-31T05:21:30.837 INFO:tasks.workunit.client.0.smithi067.stdout:0/827: symlink d1/dd/l10a 0 2024-08-31T05:21:30.837 INFO:tasks.workunit.client.0.smithi067.stdout:9/639: dread dd/df/f11 [0,4194304] 0 2024-08-31T05:21:30.838 INFO:tasks.workunit.client.0.smithi067.stdout:1/561: unlink d3/dd/d50/f8c 0 2024-08-31T05:21:30.840 INFO:tasks.workunit.client.0.smithi067.stdout:1/562: write d3/d23/d2d/d2e/d34/d66/d72/f5a [1193388,48869] 0 2024-08-31T05:21:30.845 INFO:tasks.workunit.client.0.smithi067.stdout:9/640: creat dd/df/d25/d3b/d50/fd7 x:0 0 0 2024-08-31T05:21:30.849 INFO:tasks.workunit.client.0.smithi067.stdout:7/474: truncate d14/d16/d28/d2e/f38 16664 0 2024-08-31T05:21:30.851 INFO:tasks.workunit.client.0.smithi067.stdout:1/563: creat d3/d23/d2d/d2e/d34/d66/d94/d9d/fcb x:0 0 0 2024-08-31T05:21:30.856 INFO:tasks.workunit.client.0.smithi067.stdout:7/475: symlink d14/d54/l84 0 2024-08-31T05:21:30.860 INFO:tasks.workunit.client.0.smithi067.stdout:0/828: dread d1/df/d17/d94/f9e [0,4194304] 0 2024-08-31T05:21:30.860 INFO:tasks.workunit.client.0.smithi067.stdout:1/564: dread d3/d23/d2d/d2e/d34/d66/f89 [0,4194304] 0 2024-08-31T05:21:30.861 INFO:tasks.workunit.client.0.smithi067.stdout:7/476: mkdir d14/d4a/d85 0 2024-08-31T05:21:30.862 INFO:tasks.workunit.client.0.smithi067.stdout:0/829: readlink d1/dd/l10a 0 2024-08-31T05:21:30.866 INFO:tasks.workunit.client.0.smithi067.stdout:0/830: read d1/dd/d18/fa0 [1862915,10534] 0 2024-08-31T05:21:30.868 INFO:tasks.workunit.client.0.smithi067.stdout:0/831: write d1/d8/fee [266971,100657] 0 2024-08-31T05:21:30.868 INFO:tasks.workunit.client.0.smithi067.stdout:9/641: dread dd/d4d/f60 [0,4194304] 0 2024-08-31T05:21:30.874 INFO:tasks.workunit.client.0.smithi067.stdout:0/832: mknod d1/dd/c10b 0 2024-08-31T05:21:30.876 INFO:tasks.workunit.client.0.smithi067.stdout:9/642: creat dd/d20/fd8 x:0 0 0 2024-08-31T05:21:30.876 INFO:tasks.workunit.client.0.smithi067.stdout:8/690: dwrite d0/d2/dc/d28/d7e/d73/d84/fc0 [0,4194304] 0 2024-08-31T05:21:30.878 INFO:tasks.workunit.client.0.smithi067.stdout:9/643: creat dd/df/fd9 x:0 0 0 2024-08-31T05:21:30.881 INFO:tasks.workunit.client.0.smithi067.stdout:8/691: creat d0/d2/fe6 x:0 0 0 2024-08-31T05:21:30.894 INFO:tasks.workunit.client.0.smithi067.stdout:6/771: write f18 [23245,13056] 0 2024-08-31T05:21:30.897 INFO:tasks.workunit.client.0.smithi067.stdout:6/772: creat d1b/d7a/ffa x:0 0 0 2024-08-31T05:21:30.903 INFO:tasks.workunit.client.0.smithi067.stdout:9/644: dread dd/df/d25/d3b/f97 [0,4194304] 0 2024-08-31T05:21:30.907 INFO:tasks.workunit.client.0.smithi067.stdout:6/773: fsync d1b/fbc 0 2024-08-31T05:21:30.907 INFO:tasks.workunit.client.0.smithi067.stdout:2/719: link db/dd/cc6 db/d12/d1a/d2b/d3d/d69/d3b/d82/ce3 0 2024-08-31T05:21:30.910 INFO:tasks.workunit.client.0.smithi067.stdout:9/645: write dd/df/d8e/fa9 [1023474,23171] 0 2024-08-31T05:21:30.926 INFO:tasks.workunit.client.0.smithi067.stdout:9/646: getdents dd/d63/da3 0 2024-08-31T05:21:30.927 INFO:tasks.workunit.client.0.smithi067.stdout:2/720: getdents db/d8c 0 2024-08-31T05:21:30.928 INFO:tasks.workunit.client.0.smithi067.stdout:9/647: write dd/df/d25/f6c [9213542,4893] 0 2024-08-31T05:21:30.935 INFO:tasks.workunit.client.0.smithi067.stdout:9/648: rmdir dd/df/d8e 39 2024-08-31T05:21:30.935 INFO:tasks.workunit.client.0.smithi067.stdout:2/721: rmdir db/d12/d1a/d2b/d3d/d4f 39 2024-08-31T05:21:30.936 INFO:tasks.workunit.client.0.smithi067.stdout:1/565: truncate d3/f19 2740040 0 2024-08-31T05:21:30.939 INFO:tasks.workunit.client.0.smithi067.stdout:1/566: write d3/d23/d2d/d2e/d34/d66/d72/f5a [1001380,107095] 0 2024-08-31T05:21:30.946 INFO:tasks.workunit.client.0.smithi067.stdout:1/567: symlink d3/d23/d2d/d2e/d34/da3/lcc 0 2024-08-31T05:21:30.948 INFO:tasks.workunit.client.0.smithi067.stdout:9/649: creat dd/df/d3c/dbe/fda x:0 0 0 2024-08-31T05:21:30.948 INFO:tasks.workunit.client.0.smithi067.stdout:7/477: dwrite d14/d16/d28/d2e/f5a [0,4194304] 0 2024-08-31T05:21:30.953 INFO:tasks.workunit.client.0.smithi067.stdout:2/722: creat db/d12/d1a/d2b/d3d/d69/d3b/fe4 x:0 0 0 2024-08-31T05:21:30.957 INFO:tasks.workunit.client.0.smithi067.stdout:1/568: creat d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/fcd x:0 0 0 2024-08-31T05:21:30.960 INFO:tasks.workunit.client.0.smithi067.stdout:6/774: write d1b/d40/d70/dd0/daa/fb8 [1839006,130409] 0 2024-08-31T05:21:30.961 INFO:tasks.workunit.client.0.smithi067.stdout:2/723: mkdir db/dd/d13/de5 0 2024-08-31T05:21:30.961 INFO:tasks.workunit.client.0.smithi067.stdout:8/692: dwrite d0/d4/de/f77 [0,4194304] 0 2024-08-31T05:21:30.961 INFO:tasks.workunit.client.0.smithi067.stdout:9/650: rename dd/d20/f2f to dd/df/d25/d59/fdb 0 2024-08-31T05:21:30.962 INFO:tasks.workunit.client.0.smithi067.stdout:6/775: chown d1b/d23 54553 1 2024-08-31T05:21:30.965 INFO:tasks.workunit.client.0.smithi067.stdout:7/478: truncate d14/d54/d5e/f6a 87811 0 2024-08-31T05:21:30.967 INFO:tasks.workunit.client.0.smithi067.stdout:9/651: rmdir dd/d63/da3 39 2024-08-31T05:21:30.974 INFO:tasks.workunit.client.0.smithi067.stdout:6/776: dread d1b/d40/d70/dd0/daa/fd3 [0,4194304] 0 2024-08-31T05:21:30.976 INFO:tasks.workunit.client.0.smithi067.stdout:8/693: fsync d0/d4/de/f34 0 2024-08-31T05:21:30.979 INFO:tasks.workunit.client.0.smithi067.stdout:8/694: readlink d0/d4/de/l44 0 2024-08-31T05:21:30.988 INFO:tasks.workunit.client.0.smithi067.stdout:6/777: symlink d1b/d40/d70/dd0/lfb 0 2024-08-31T05:21:30.990 INFO:tasks.workunit.client.0.smithi067.stdout:1/569: getdents d3/dd 0 2024-08-31T05:21:30.990 INFO:tasks.workunit.client.0.smithi067.stdout:9/652: dwrite dd/df/d25/d3b/f97 [0,4194304] 0 2024-08-31T05:21:30.991 INFO:tasks.workunit.client.0.smithi067.stdout:2/724: getdents db/d12/d1a/d2b 0 2024-08-31T05:21:30.999 INFO:tasks.workunit.client.0.smithi067.stdout:2/725: dwrite db/dd/d2d/f35 [4194304,4194304] 0 2024-08-31T05:21:31.002 INFO:tasks.workunit.client.0.smithi067.stdout:7/479: dread d14/f18 [4194304,4194304] 0 2024-08-31T05:21:31.003 INFO:tasks.workunit.client.0.smithi067.stdout:7/480: write d14/d16/f41 [246531,108075] 0 2024-08-31T05:21:31.039 INFO:tasks.workunit.client.0.smithi067.stdout:8/695: symlink d0/d2/dc/d3d/d98/le7 0 2024-08-31T05:21:31.041 INFO:tasks.workunit.client.0.smithi067.stdout:1/570: mkdir d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce 0 2024-08-31T05:21:31.047 INFO:tasks.workunit.client.0.smithi067.stdout:1/571: truncate d3/f55 304989 0 2024-08-31T05:21:31.049 INFO:tasks.workunit.client.0.smithi067.stdout:2/726: rename f1 to db/d12/d1a/d2b/d87/fe6 0 2024-08-31T05:21:31.051 INFO:tasks.workunit.client.0.smithi067.stdout:2/727: chown db/d12/d1a/d2b/d3d/d69/d3b/d99/cdf 10170150 1 2024-08-31T05:21:31.054 INFO:tasks.workunit.client.0.smithi067.stdout:1/572: creat d3/dd/fcf x:0 0 0 2024-08-31T05:21:31.055 INFO:tasks.workunit.client.0.smithi067.stdout:7/481: dwrite d14/d16/d28/f29 [4194304,4194304] 0 2024-08-31T05:21:31.057 INFO:tasks.workunit.client.0.smithi067.stdout:8/696: rename d0/d4/de/d1d/d2c/d3c/da5/d99/lbb to d0/d2/da/le8 0 2024-08-31T05:21:31.060 INFO:tasks.workunit.client.0.smithi067.stdout:2/728: mkdir db/d12/d1a/d2b/d3d/d69/d3b/d82/de7 0 2024-08-31T05:21:31.062 INFO:tasks.workunit.client.0.smithi067.stdout:1/573: dread d3/d23/d5d/f61 [0,4194304] 0 2024-08-31T05:21:31.065 INFO:tasks.workunit.client.0.smithi067.stdout:7/482: readlink d14/d16/d28/l2c 0 2024-08-31T05:21:31.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:30 smithi067 ceph-mon[17432]: pgmap v36: 65 pgs: 65 active+clean; 2.3 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 43 MiB/s rd, 130 MiB/s wr, 346 op/s 2024-08-31T05:21:31.075 INFO:tasks.workunit.client.0.smithi067.stdout:7/483: creat d14/d16/f86 x:0 0 0 2024-08-31T05:21:31.075 INFO:tasks.workunit.client.0.smithi067.stdout:2/729: creat db/d12/d1a/d2b/d3d/d4f/fe8 x:0 0 0 2024-08-31T05:21:31.078 INFO:tasks.workunit.client.0.smithi067.stdout:7/484: mkdir d14/d16/d5b/d68/d87 0 2024-08-31T05:21:31.079 INFO:tasks.workunit.client.0.smithi067.stdout:1/574: link d3/d23/d2d/d2e/d34/d66/d9a/c9e d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/cd0 0 2024-08-31T05:21:31.082 INFO:tasks.workunit.client.0.smithi067.stdout:1/575: symlink d3/d23/d2d/d2e/d34/d66/d72/ld1 0 2024-08-31T05:21:31.083 INFO:tasks.workunit.client.0.smithi067.stdout:1/576: fdatasync d3/dd/fc8 0 2024-08-31T05:21:31.083 INFO:tasks.workunit.client.0.smithi067.stdout:7/485: mknod d14/d16/d28/c88 0 2024-08-31T05:21:31.084 INFO:tasks.workunit.client.0.smithi067.stdout:7/486: fsync d14/d4a/f4b 0 2024-08-31T05:21:31.085 INFO:tasks.workunit.client.0.smithi067.stdout:1/577: symlink d3/d23/d2d/d2e/d34/d66/d94/d9d/ld2 0 2024-08-31T05:21:31.087 INFO:tasks.workunit.client.0.smithi067.stdout:7/487: creat d14/d16/f89 x:0 0 0 2024-08-31T05:21:31.088 INFO:tasks.workunit.client.0.smithi067.stdout:1/578: mkdir d3/dd3 0 2024-08-31T05:21:31.094 INFO:tasks.workunit.client.0.smithi067.stdout:7/488: dwrite d14/d4a/f4b [4194304,4194304] 0 2024-08-31T05:21:31.099 INFO:tasks.workunit.client.0.smithi067.stdout:1/579: dwrite d3/d23/d79/fa4 [0,4194304] 0 2024-08-31T05:21:31.104 INFO:tasks.workunit.client.0.smithi067.stdout:1/580: mkdir d3/d23/db1/dd4 0 2024-08-31T05:21:31.104 INFO:tasks.workunit.client.0.smithi067.stdout:6/778: dwrite d1b/fbc [0,4194304] 0 2024-08-31T05:21:31.105 INFO:tasks.workunit.client.0.smithi067.stdout:1/581: dread - d3/d23/d5d/f6f zero size 2024-08-31T05:21:31.107 INFO:tasks.workunit.client.0.smithi067.stdout:8/697: truncate d0/d4/de/d1d/d2c/f8a 928293 0 2024-08-31T05:21:31.108 INFO:tasks.workunit.client.0.smithi067.stdout:6/779: creat d1b/d40/d70/dd0/da4/ffc x:0 0 0 2024-08-31T05:21:31.109 INFO:tasks.workunit.client.0.smithi067.stdout:6/780: fdatasync d1b/d40/d70/ff9 0 2024-08-31T05:21:31.112 INFO:tasks.workunit.client.0.smithi067.stdout:1/582: creat d3/d23/d79/fd5 x:0 0 0 2024-08-31T05:21:31.114 INFO:tasks.workunit.client.0.smithi067.stdout:6/781: dread d1b/d40/d70/dd0/d5e/f5f [0,4194304] 0 2024-08-31T05:21:31.115 INFO:tasks.workunit.client.0.smithi067.stdout:6/782: fsync d1b/d23/d28/fdf 0 2024-08-31T05:21:31.121 INFO:tasks.workunit.client.0.smithi067.stdout:2/730: dwrite db/d12/d1a/d1e/d4d/f7a [0,4194304] 0 2024-08-31T05:21:31.121 INFO:tasks.workunit.client.0.smithi067.stdout:8/698: rename d0/d4/de/d1d/d2c/d3c to d0/d2/dc/d28/d7e/d73/de9 0 2024-08-31T05:21:31.123 INFO:tasks.workunit.client.0.smithi067.stdout:6/783: symlink d1b/d40/de8/lfd 0 2024-08-31T05:21:31.123 INFO:tasks.workunit.client.0.smithi067.stdout:1/583: mkdir d3/dd3/dd6 0 2024-08-31T05:21:31.125 INFO:tasks.workunit.client.0.smithi067.stdout:2/731: creat db/d8c/fe9 x:0 0 0 2024-08-31T05:21:31.129 INFO:tasks.workunit.client.0.smithi067.stdout:8/699: unlink d0/d2/da/fcf 0 2024-08-31T05:21:31.133 INFO:tasks.workunit.client.0.smithi067.stdout:1/584: dwrite d3/d23/f90 [0,4194304] 0 2024-08-31T05:21:31.133 INFO:tasks.workunit.client.0.smithi067.stdout:6/784: truncate f7 850055 0 2024-08-31T05:21:31.136 INFO:tasks.workunit.client.0.smithi067.stdout:8/700: creat d0/d4/de/d1d/d2c/d68/de3/fea x:0 0 0 2024-08-31T05:21:31.137 INFO:tasks.workunit.client.0.smithi067.stdout:1/585: truncate d3/d23/f3c 1129463 0 2024-08-31T05:21:31.137 INFO:tasks.workunit.client.0.smithi067.stdout:2/732: dwrite db/dd/d13/f14 [0,4194304] 0 2024-08-31T05:21:31.140 INFO:tasks.workunit.client.0.smithi067.stdout:8/701: read d0/d2/da/fd4 [110,15333] 0 2024-08-31T05:21:31.140 INFO:tasks.workunit.client.0.smithi067.stdout:2/733: readlink db/d12/d1a/d2b/d3d/d69/d3b/l57 0 2024-08-31T05:21:31.147 INFO:tasks.workunit.client.0.smithi067.stdout:1/586: symlink d3/d23/d2d/d2e/d34/d66/d94/d9d/ld7 0 2024-08-31T05:21:31.149 INFO:tasks.workunit.client.0.smithi067.stdout:8/702: creat d0/d4/de/d1d/d7b/feb x:0 0 0 2024-08-31T05:21:31.150 INFO:tasks.workunit.client.0.smithi067.stdout:8/703: chown d0/d2/dc/d28/d7e/d73/d84/da6/db1/d8c 3887 1 2024-08-31T05:21:31.151 INFO:tasks.workunit.client.0.smithi067.stdout:8/704: chown d0/d2/dc/d28/d7e/d73/d84/dd1 2043 1 2024-08-31T05:21:31.153 INFO:tasks.workunit.client.0.smithi067.stdout:2/734: dread - db/d12/d1a/fa5 zero size 2024-08-31T05:21:31.155 INFO:tasks.workunit.client.0.smithi067.stdout:1/587: creat d3/d8b/fd8 x:0 0 0 2024-08-31T05:21:31.159 INFO:tasks.workunit.client.0.smithi067.stdout:2/735: rename db/d12/d1a/f96 to db/d12/d1a/d2b/d40/d9b/da8/fea 0 2024-08-31T05:21:31.160 INFO:tasks.workunit.client.0.smithi067.stdout:8/705: read d0/d2/da/dd/d1f/f78 [2681181,99871] 0 2024-08-31T05:21:31.161 INFO:tasks.workunit.client.0.smithi067.stdout:1/588: creat d3/d23/d2d/d2e/d34/d66/d9a/fd9 x:0 0 0 2024-08-31T05:21:31.164 INFO:tasks.workunit.client.0.smithi067.stdout:8/706: stat d0/d4/de/f11 0 2024-08-31T05:21:31.164 INFO:tasks.workunit.client.0.smithi067.stdout:1/589: write d3/d23/f90 [3532106,27931] 0 2024-08-31T05:21:31.167 INFO:tasks.workunit.client.0.smithi067.stdout:1/590: chown d3/d23/d2d/d2e 79276146 1 2024-08-31T05:21:31.168 INFO:tasks.workunit.client.0.smithi067.stdout:6/785: dwrite d1b/d23/d28/f39 [4194304,4194304] 0 2024-08-31T05:21:31.172 INFO:tasks.workunit.client.0.smithi067.stdout:8/707: mknod d0/d2/dc/d28/d7e/d73/de9/da5/cec 0 2024-08-31T05:21:31.178 INFO:tasks.workunit.client.0.smithi067.stdout:1/591: dwrite d3/d23/d2d/d2e/d34/d66/d94/d9d/fae [0,4194304] 0 2024-08-31T05:21:31.180 INFO:tasks.workunit.client.0.smithi067.stdout:1/592: dread - d3/d23/d79/fb3 zero size 2024-08-31T05:21:31.180 INFO:tasks.workunit.client.0.smithi067.stdout:2/736: dread db/dd/d2d/da7/f6a [0,4194304] 0 2024-08-31T05:21:31.182 INFO:tasks.workunit.client.0.smithi067.stdout:8/708: mknod d0/d4/de/ced 0 2024-08-31T05:21:31.182 INFO:tasks.workunit.client.0.smithi067.stdout:1/593: chown d3/d23/d79 5083156 1 2024-08-31T05:21:31.183 INFO:tasks.workunit.client.0.smithi067.stdout:2/737: chown db/d12/d1a/dd2 4380353 1 2024-08-31T05:21:31.183 INFO:tasks.workunit.client.0.smithi067.stdout:1/594: fsync d3/dd/fcf 0 2024-08-31T05:21:31.183 INFO:tasks.workunit.client.0.smithi067.stdout:5/537: sync 2024-08-31T05:21:31.184 INFO:tasks.workunit.client.0.smithi067.stdout:4/509: sync 2024-08-31T05:21:31.185 INFO:tasks.workunit.client.0.smithi067.stdout:5/538: chown db/d1d/c6b 8958 1 2024-08-31T05:21:31.188 INFO:tasks.workunit.client.0.smithi067.stdout:2/738: fdatasync db/f4b 0 2024-08-31T05:21:31.188 INFO:tasks.workunit.client.0.smithi067.stdout:6/786: write d1b/d40/d70/dd0/d5c/faf [2277116,120865] 0 2024-08-31T05:21:31.189 INFO:tasks.workunit.client.0.smithi067.stdout:1/595: creat d3/d8b/fda x:0 0 0 2024-08-31T05:21:31.193 INFO:tasks.workunit.client.0.smithi067.stdout:5/539: rmdir db/d15/d53 39 2024-08-31T05:21:31.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:30 smithi073 ceph-mon[24726]: pgmap v36: 65 pgs: 65 active+clean; 2.3 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 43 MiB/s rd, 130 MiB/s wr, 346 op/s 2024-08-31T05:21:31.196 INFO:tasks.workunit.client.0.smithi067.stdout:1/596: dread d3/d23/d2d/d2e/d34/d66/d72/f5a [0,4194304] 0 2024-08-31T05:21:31.196 INFO:tasks.workunit.client.0.smithi067.stdout:1/597: chown d3/d23/d2d/la7 765387 1 2024-08-31T05:21:31.201 INFO:tasks.workunit.client.0.smithi067.stdout:1/598: dread d3/d23/f98 [0,4194304] 0 2024-08-31T05:21:31.204 INFO:tasks.workunit.client.0.smithi067.stdout:8/709: dread d0/d4/de/d1d/d2c/d68/f8d [0,4194304] 0 2024-08-31T05:21:31.207 INFO:tasks.workunit.client.0.smithi067.stdout:2/739: link db/d12/d1a/d2b/d3d/f46 db/d8c/dcd/feb 0 2024-08-31T05:21:31.208 INFO:tasks.workunit.client.0.smithi067.stdout:6/787: write d1b/d40/d70/dd0/f65 [577706,71113] 0 2024-08-31T05:21:31.211 INFO:tasks.workunit.client.0.smithi067.stdout:4/510: dwrite d4/d1e/d53/f6c [0,4194304] 0 2024-08-31T05:21:31.216 INFO:tasks.workunit.client.0.smithi067.stdout:1/599: creat d3/d23/db1/dd4/fdb x:0 0 0 2024-08-31T05:21:31.217 INFO:tasks.workunit.client.0.smithi067.stdout:1/600: fdatasync d3/d23/d79/fd5 0 2024-08-31T05:21:31.221 INFO:tasks.workunit.client.0.smithi067.stdout:8/710: symlink d0/d2/dc/d3d/de5/lee 0 2024-08-31T05:21:31.223 INFO:tasks.workunit.client.0.smithi067.stdout:1/601: dread d3/dd/f12 [0,4194304] 0 2024-08-31T05:21:31.225 INFO:tasks.workunit.client.0.smithi067.stdout:5/540: creat db/faa x:0 0 0 2024-08-31T05:21:31.226 INFO:tasks.workunit.client.0.smithi067.stdout:6/788: mknod d1b/d23/df1/cfe 0 2024-08-31T05:21:31.227 INFO:tasks.workunit.client.0.smithi067.stdout:2/740: truncate db/d12/f1c 1959581 0 2024-08-31T05:21:31.231 INFO:tasks.workunit.client.0.smithi067.stdout:8/711: dread d0/d2/f15 [0,4194304] 0 2024-08-31T05:21:31.231 INFO:tasks.workunit.client.0.smithi067.stdout:5/541: fsync db/d1d/d3a/f4a 0 2024-08-31T05:21:31.233 INFO:tasks.workunit.client.0.smithi067.stdout:6/789: read - d1b/d23/d2e/d3b/fcd zero size 2024-08-31T05:21:31.234 INFO:tasks.workunit.client.0.smithi067.stdout:1/602: dread d3/d23/d2d/d2e/d34/d66/d72/f5a [0,4194304] 0 2024-08-31T05:21:31.236 INFO:tasks.workunit.client.0.smithi067.stdout:4/511: write d4/d1f/f44 [1583480,102717] 0 2024-08-31T05:21:31.236 INFO:tasks.workunit.client.0.smithi067.stdout:6/790: readlink d1b/d40/d70/dd0/d8d/dc6/lf7 0 2024-08-31T05:21:31.237 INFO:tasks.workunit.client.0.smithi067.stdout:1/603: readlink d3/d23/d2d/d2e/d34/d66/d94/d9d/ld2 0 2024-08-31T05:21:31.237 INFO:tasks.workunit.client.0.smithi067.stdout:8/712: truncate d0/d2/dc/d28/d7e/d73/d84/da6/db1/d8c/f9b 4667228 0 2024-08-31T05:21:31.239 INFO:tasks.workunit.client.0.smithi067.stdout:2/741: mkdir db/d12/d1a/d2b/d3d/d69/dec 0 2024-08-31T05:21:31.242 INFO:tasks.workunit.client.0.smithi067.stdout:1/604: fdatasync d3/f52 0 2024-08-31T05:21:31.243 INFO:tasks.workunit.client.0.smithi067.stdout:4/512: write d4/f76 [1572721,20281] 0 2024-08-31T05:21:31.247 INFO:tasks.workunit.client.0.smithi067.stdout:2/742: mkdir db/d8c/dcd/dac/ded 0 2024-08-31T05:21:31.252 INFO:tasks.workunit.client.0.smithi067.stdout:8/713: mknod d0/d2/dc/cef 0 2024-08-31T05:21:31.255 INFO:tasks.workunit.client.0.smithi067.stdout:1/605: write d3/d23/f98 [3591695,117583] 0 2024-08-31T05:21:31.256 INFO:tasks.workunit.client.0.smithi067.stdout:5/542: dwrite db/d26/d60/f71 [0,4194304] 0 2024-08-31T05:21:31.262 INFO:tasks.workunit.client.0.smithi067.stdout:5/543: fsync db/d15/d42/f44 0 2024-08-31T05:21:31.262 INFO:tasks.workunit.client.0.smithi067.stdout:1/606: mknod d3/d23/d2d/d2e/cdc 0 2024-08-31T05:21:31.264 INFO:tasks.workunit.client.0.smithi067.stdout:6/791: dwrite d1b/d23/d2e/d3b/f9d [4194304,4194304] 0 2024-08-31T05:21:31.272 INFO:tasks.workunit.client.0.smithi067.stdout:2/743: dwrite db/d12/d1a/d2b/d42/fca [0,4194304] 0 2024-08-31T05:21:31.275 INFO:tasks.workunit.client.0.smithi067.stdout:4/513: dwrite d4/d13/f1a [0,4194304] 0 2024-08-31T05:21:31.276 INFO:tasks.workunit.client.0.smithi067.stdout:8/714: dwrite d0/d4/faa [0,4194304] 0 2024-08-31T05:21:31.278 INFO:tasks.workunit.client.0.smithi067.stdout:5/544: dread - db/d15/d42/d36/d73/d77/f94 zero size 2024-08-31T05:21:31.279 INFO:tasks.workunit.client.0.smithi067.stdout:8/715: stat d0/d2/da/dd 0 2024-08-31T05:21:31.282 INFO:tasks.workunit.client.0.smithi067.stdout:1/607: dwrite d3/d23/d5d/f60 [0,4194304] 0 2024-08-31T05:21:31.287 INFO:tasks.workunit.client.0.smithi067.stdout:6/792: write d1b/d23/d61/f97 [1325509,59017] 0 2024-08-31T05:21:31.290 INFO:tasks.workunit.client.0.smithi067.stdout:4/514: mkdir d4/d32/d4c/db3 0 2024-08-31T05:21:31.292 INFO:tasks.workunit.client.0.smithi067.stdout:8/716: rename d0/d2/dc/d28/d7e to d0/d4/de/df0 0 2024-08-31T05:21:31.294 INFO:tasks.workunit.client.0.smithi067.stdout:4/515: rmdir d4/d1e/d62/dae 39 2024-08-31T05:21:31.296 INFO:tasks.workunit.client.0.smithi067.stdout:6/793: mkdir d1b/d40/d96/db3/dff 0 2024-08-31T05:21:31.298 INFO:tasks.workunit.client.0.smithi067.stdout:4/516: rename d4/d1e/d7a to d4/d9/db4 0 2024-08-31T05:21:31.299 INFO:tasks.workunit.client.0.smithi067.stdout:6/794: fdatasync fd 0 2024-08-31T05:21:31.301 INFO:tasks.workunit.client.0.smithi067.stdout:1/608: getdents d3/d23/d2d/d2e/d34/d66/d9a 0 2024-08-31T05:21:31.303 INFO:tasks.workunit.client.0.smithi067.stdout:6/795: dread d1b/d23/d28/fdf [0,4194304] 0 2024-08-31T05:21:31.307 INFO:tasks.workunit.client.0.smithi067.stdout:1/609: creat d3/d23/d2d/fdd x:0 0 0 2024-08-31T05:21:31.315 INFO:tasks.workunit.client.0.smithi067.stdout:1/610: dread d3/d23/d2d/d2e/d34/d66/d72/f4f [0,4194304] 0 2024-08-31T05:21:31.320 INFO:tasks.workunit.client.0.smithi067.stdout:2/744: dwrite db/d12/d1a/d2b/d3d/d69/f26 [4194304,4194304] 0 2024-08-31T05:21:31.324 INFO:tasks.workunit.client.0.smithi067.stdout:5/545: dwrite db/d26/d29/f38 [4194304,4194304] 0 2024-08-31T05:21:31.324 INFO:tasks.workunit.client.0.smithi067.stdout:4/517: dread d4/d14/d48/f6e [0,4194304] 0 2024-08-31T05:21:31.325 INFO:tasks.workunit.client.0.smithi067.stdout:1/611: rename d3/dd/l2b to d3/d8b/lde 0 2024-08-31T05:21:31.333 INFO:tasks.workunit.client.0.smithi067.stdout:6/796: write d1b/d40/d70/dd0/d5e/de6/fe9 [2153867,116179] 0 2024-08-31T05:21:31.334 INFO:tasks.workunit.client.0.smithi067.stdout:8/717: dread d0/d2/dc/f48 [0,4194304] 0 2024-08-31T05:21:31.334 INFO:tasks.workunit.client.0.smithi067.stdout:2/745: truncate db/d12/d1a/d2b/d40/d9b/da8/fea 902358 0 2024-08-31T05:21:31.334 INFO:tasks.workunit.client.0.smithi067.stdout:4/518: truncate d4/d1e/f41 1675360 0 2024-08-31T05:21:31.334 INFO:tasks.workunit.client.0.smithi067.stdout:1/612: mkdir d3/d23/d2d/d2e/d34/da3/ddf 0 2024-08-31T05:21:31.336 INFO:tasks.workunit.client.0.smithi067.stdout:5/546: read db/d15/d53/f82 [521364,64132] 0 2024-08-31T05:21:31.340 INFO:tasks.workunit.client.0.smithi067.stdout:4/519: rename d4/d1f/f99 to d4/d9/d4b/fb5 0 2024-08-31T05:21:31.346 INFO:tasks.workunit.client.0.smithi067.stdout:1/613: creat d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/fe0 x:0 0 0 2024-08-31T05:21:31.349 INFO:tasks.workunit.client.0.smithi067.stdout:2/746: dread db/d12/d1a/d1e/f93 [0,4194304] 0 2024-08-31T05:21:31.350 INFO:tasks.workunit.client.0.smithi067.stdout:5/547: creat db/d26/d60/fab x:0 0 0 2024-08-31T05:21:31.351 INFO:tasks.workunit.client.0.smithi067.stdout:2/747: chown db/d12/d1a/d2b/d87/dbd 2792782 1 2024-08-31T05:21:31.353 INFO:tasks.workunit.client.0.smithi067.stdout:4/520: creat d4/d9/db4/d83/da9/fb6 x:0 0 0 2024-08-31T05:21:31.353 INFO:tasks.workunit.client.0.smithi067.stdout:1/614: dwrite d3/f14 [0,4194304] 0 2024-08-31T05:21:31.353 INFO:tasks.workunit.client.0.smithi067.stdout:2/748: read db/d12/d1a/d1e/f93 [40113,82648] 0 2024-08-31T05:21:31.355 INFO:tasks.workunit.client.0.smithi067.stdout:1/615: read d3/dd/f51 [2329641,109128] 0 2024-08-31T05:21:31.355 INFO:tasks.workunit.client.0.smithi067.stdout:8/718: creat d0/d4/de/d1d/ff1 x:0 0 0 2024-08-31T05:21:31.360 INFO:tasks.workunit.client.0.smithi067.stdout:5/548: mkdir db/d26/d29/d31/d7a/dac 0 2024-08-31T05:21:31.364 INFO:tasks.workunit.client.0.smithi067.stdout:4/521: dwrite d4/d1e/fa1 [0,4194304] 0 2024-08-31T05:21:31.366 INFO:tasks.workunit.client.0.smithi067.stdout:2/749: dread db/d12/d1a/d2b/d3d/d69/f26 [4194304,4194304] 0 2024-08-31T05:21:31.367 INFO:tasks.workunit.client.0.smithi067.stdout:1/616: mkdir d3/d23/d2d/d2e/d34/d66/d72/d82/de1 0 2024-08-31T05:21:31.367 INFO:tasks.workunit.client.0.smithi067.stdout:6/797: dwrite d1b/d8e/f79 [0,4194304] 0 2024-08-31T05:21:31.370 INFO:tasks.workunit.client.0.smithi067.stdout:3/913: sync 2024-08-31T05:21:31.372 INFO:tasks.workunit.client.0.smithi067.stdout:4/522: fdatasync d4/d9/db4/d83/da9/f46 0 2024-08-31T05:21:31.374 INFO:tasks.workunit.client.0.smithi067.stdout:4/523: read d4/d14/d48/d66/faf [5277418,114346] 0 2024-08-31T05:21:31.377 INFO:tasks.workunit.client.0.smithi067.stdout:6/798: mkdir d1b/d40/d70/dd0/d8d/dc6/d100 0 2024-08-31T05:21:31.379 INFO:tasks.workunit.client.0.smithi067.stdout:2/750: mknod db/d12/d1a/d2b/d3d/d69/d3b/d82/cee 0 2024-08-31T05:21:31.380 INFO:tasks.workunit.client.0.smithi067.stdout:3/914: creat db/d55/f126 x:0 0 0 2024-08-31T05:21:31.383 INFO:tasks.workunit.client.0.smithi067.stdout:3/915: chown db/d17/d3f/d54/d56/d6e/f9f 4089212 1 2024-08-31T05:21:31.384 INFO:tasks.workunit.client.0.smithi067.stdout:8/719: dwrite d0/d4/de/d1d/d7b/fba [0,4194304] 0 2024-08-31T05:21:31.386 INFO:tasks.workunit.client.0.smithi067.stdout:2/751: mkdir db/d12/d1a/d2b/d3d/d4f/d6d/def 0 2024-08-31T05:21:31.388 INFO:tasks.workunit.client.0.smithi067.stdout:4/524: mknod d4/da5/cb7 0 2024-08-31T05:21:31.390 INFO:tasks.workunit.client.0.smithi067.stdout:8/720: symlink d0/d4/de/df0/d73/d84/dd1/lf2 0 2024-08-31T05:21:31.391 INFO:tasks.workunit.client.0.smithi067.stdout:8/721: read - d0/d2/fae zero size 2024-08-31T05:21:31.392 INFO:tasks.workunit.client.0.smithi067.stdout:8/722: fsync d0/d2/fe6 0 2024-08-31T05:21:31.393 INFO:tasks.workunit.client.0.smithi067.stdout:1/617: getdents d3/d23/d2d 0 2024-08-31T05:21:31.401 INFO:tasks.workunit.client.0.smithi067.stdout:3/916: link db/d12/fd8 db/d55/d97/dc4/dcb/dcc/f127 0 2024-08-31T05:21:31.403 INFO:tasks.workunit.client.0.smithi067.stdout:3/917: fsync db/d12/d21/f11e 0 2024-08-31T05:21:31.403 INFO:tasks.workunit.client.0.smithi067.stdout:5/549: dwrite db/f1e [4194304,4194304] 0 2024-08-31T05:21:31.408 INFO:tasks.workunit.client.0.smithi067.stdout:2/752: dread db/d12/d1a/d2b/d87/fe6 [0,4194304] 0 2024-08-31T05:21:31.413 INFO:tasks.workunit.client.0.smithi067.stdout:2/753: mknod db/d8c/dcd/dac/cf0 0 2024-08-31T05:21:31.416 INFO:tasks.workunit.client.0.smithi067.stdout:3/918: unlink db/d17/d3f/d54/d56/d6e/cab 0 2024-08-31T05:21:31.419 INFO:tasks.workunit.client.0.smithi067.stdout:8/723: dread d0/d2/dc/d28/f81 [0,4194304] 0 2024-08-31T05:21:31.419 INFO:tasks.workunit.client.0.smithi067.stdout:2/754: mknod db/dd/d2d/db7/cf1 0 2024-08-31T05:21:31.419 INFO:tasks.workunit.client.0.smithi067.stdout:1/618: write f1 [3769887,64095] 0 2024-08-31T05:21:31.420 INFO:tasks.workunit.client.0.smithi067.stdout:3/919: creat db/d4e/f128 x:0 0 0 2024-08-31T05:21:31.421 INFO:tasks.workunit.client.0.smithi067.stdout:2/755: chown db/d12/d1a/d2b/d42/d62/fdb 591666 1 2024-08-31T05:21:31.421 INFO:tasks.workunit.client.0.smithi067.stdout:4/525: truncate d4/d1e/d53/f6c 675639 0 2024-08-31T05:21:31.514 INFO:tasks.workunit.client.0.smithi067.stdout:5/550: write db/d15/f80 [1800379,397] 0 2024-08-31T05:21:31.514 INFO:tasks.workunit.client.0.smithi067.stdout:1/619: symlink d3/d23/d2d/d2e/d34/d66/d94/le2 0 2024-08-31T05:21:31.514 INFO:tasks.workunit.client.0.smithi067.stdout:2/756: chown db/d12/d1a/d2b/d3d/d69/d3b/f78 355078340 1 2024-08-31T05:21:31.515 INFO:tasks.workunit.client.0.smithi067.stdout:4/526: mknod d4/d9/d4b/cb8 0 2024-08-31T05:21:31.516 INFO:tasks.workunit.client.0.smithi067.stdout:2/757: fdatasync db/d8c/dcd/dac/fbe 0 2024-08-31T05:21:31.517 INFO:tasks.workunit.client.0.smithi067.stdout:8/724: mknod d0/d4/cf3 0 2024-08-31T05:21:31.518 INFO:tasks.workunit.client.0.smithi067.stdout:2/758: readlink db/dd/d13/lc8 0 2024-08-31T05:21:31.518 INFO:tasks.workunit.client.0.smithi067.stdout:5/551: mkdir db/d15/d59/dad 0 2024-08-31T05:21:31.518 INFO:tasks.workunit.client.0.smithi067.stdout:4/527: write d4/d14/d48/d66/f82 [10396673,79316] 0 2024-08-31T05:21:31.520 INFO:tasks.workunit.client.0.smithi067.stdout:4/528: chown d4/d1f/c3e 18459 1 2024-08-31T05:21:31.521 INFO:tasks.workunit.client.0.smithi067.stdout:1/620: creat d3/d23/db1/db6/dc4/fe3 x:0 0 0 2024-08-31T05:21:31.523 INFO:tasks.workunit.client.0.smithi067.stdout:3/920: dwrite db/d17/d3f/d54/d56/f96 [0,4194304] 0 2024-08-31T05:21:31.524 INFO:tasks.workunit.client.0.smithi067.stdout:5/552: mknod db/d15/d59/cae 0 2024-08-31T05:21:31.527 INFO:tasks.workunit.client.0.smithi067.stdout:2/759: mknod db/d12/d1a/d2b/d3d/d69/d3b/d82/cf2 0 2024-08-31T05:21:31.529 INFO:tasks.workunit.client.0.smithi067.stdout:8/725: dwrite d0/d2/f15 [0,4194304] 0 2024-08-31T05:21:31.532 INFO:tasks.workunit.client.0.smithi067.stdout:8/726: write d0/d4/de/d1d/d7b/fba [4533068,114938] 0 2024-08-31T05:21:31.534 INFO:tasks.workunit.client.0.smithi067.stdout:8/727: write d0/d74/dcb/fd9 [3978255,77115] 0 2024-08-31T05:21:31.537 INFO:tasks.workunit.client.0.smithi067.stdout:2/760: unlink db/d12/d1a/d2b/d42/da0/dc4/l64 0 2024-08-31T05:21:31.542 INFO:tasks.workunit.client.0.smithi067.stdout:8/728: unlink d0/d4/de/d1d/d7b/d89/f8b 0 2024-08-31T05:21:31.543 INFO:tasks.workunit.client.0.smithi067.stdout:5/553: mkdir db/d15/d42/d36/d73/daf 0 2024-08-31T05:21:31.546 INFO:tasks.workunit.client.0.smithi067.stdout:5/554: chown db/d26/d29/d31/d54/d66/l79 7990333 1 2024-08-31T05:21:31.547 INFO:tasks.workunit.client.0.smithi067.stdout:8/729: creat d0/d4/de/df0/d73/d84/da6/db1/ff4 x:0 0 0 2024-08-31T05:21:31.549 INFO:tasks.workunit.client.0.smithi067.stdout:2/761: unlink db/d12/d1a/d2b/d3d/f8f 0 2024-08-31T05:21:31.549 INFO:tasks.workunit.client.0.smithi067.stdout:4/529: dwrite d4/d9/fa [4194304,4194304] 0 2024-08-31T05:21:31.554 INFO:tasks.workunit.client.0.smithi067.stdout:2/762: chown db/d12/d1a/d2b/d42/da0/dc4/c7d 17 1 2024-08-31T05:21:31.554 INFO:tasks.workunit.client.0.smithi067.stdout:4/530: mkdir d4/d1f/db9 0 2024-08-31T05:21:31.557 INFO:tasks.workunit.client.0.smithi067.stdout:1/621: dwrite d3/dd/f12 [0,4194304] 0 2024-08-31T05:21:31.560 INFO:tasks.workunit.client.0.smithi067.stdout:4/531: dread d4/d42/f50 [0,4194304] 0 2024-08-31T05:21:31.561 INFO:tasks.workunit.client.0.smithi067.stdout:4/532: fsync d4/d42/f8b 0 2024-08-31T05:21:31.563 INFO:tasks.workunit.client.0.smithi067.stdout:2/763: creat db/d12/d1a/d1e/d4d/dd5/ff3 x:0 0 0 2024-08-31T05:21:31.567 INFO:tasks.workunit.client.0.smithi067.stdout:1/622: mkdir d3/d23/db1/dd4/de4 0 2024-08-31T05:21:31.570 INFO:tasks.workunit.client.0.smithi067.stdout:1/623: write d3/d23/d2d/d2e/fb2 [1423314,27903] 0 2024-08-31T05:21:31.571 INFO:tasks.workunit.client.0.smithi067.stdout:4/533: dwrite d4/d14/d48/d66/f70 [0,4194304] 0 2024-08-31T05:21:31.573 INFO:tasks.workunit.client.0.smithi067.stdout:1/624: readlink d3/l6a 0 2024-08-31T05:21:31.573 INFO:tasks.workunit.client.0.smithi067.stdout:8/730: dread d0/d4/de/f34 [0,4194304] 0 2024-08-31T05:21:31.574 INFO:tasks.workunit.client.0.smithi067.stdout:5/555: dwrite db/d15/d42/f39 [4194304,4194304] 0 2024-08-31T05:21:31.576 INFO:tasks.workunit.client.0.smithi067.stdout:8/731: write d0/d2/dc/d3d/fce [371105,31313] 0 2024-08-31T05:21:31.578 INFO:tasks.workunit.client.0.smithi067.stdout:2/764: rename db/d12/d1a/d2b/d42 to db/d8c/dcd/df4 0 2024-08-31T05:21:31.579 INFO:tasks.workunit.client.0.smithi067.stdout:8/732: fsync d0/d4/de/df0/d73/d84/da6/db1/d8c/f9b 0 2024-08-31T05:21:31.580 INFO:tasks.workunit.client.0.smithi067.stdout:4/534: truncate d4/d42/f8e 435717 0 2024-08-31T05:21:31.581 INFO:tasks.workunit.client.0.smithi067.stdout:5/556: rmdir db/d26/d29 39 2024-08-31T05:21:31.585 INFO:tasks.workunit.client.0.smithi067.stdout:4/535: mknod d4/d1e/d53/d81/cba 0 2024-08-31T05:21:31.586 INFO:tasks.workunit.client.0.smithi067.stdout:1/625: creat d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/fe5 x:0 0 0 2024-08-31T05:21:31.587 INFO:tasks.workunit.client.0.smithi067.stdout:5/557: rename db/d26 to db/d26/d29/d31/d8d/db0 22 2024-08-31T05:21:31.588 INFO:tasks.workunit.client.0.smithi067.stdout:5/558: stat db/d1d/d3a/f43 0 2024-08-31T05:21:31.588 INFO:tasks.workunit.client.0.smithi067.stdout:4/536: mkdir d4/d9/dbb 0 2024-08-31T05:21:31.590 INFO:tasks.workunit.client.0.smithi067.stdout:1/626: symlink d3/d23/d2d/le6 0 2024-08-31T05:21:31.590 INFO:tasks.workunit.client.0.smithi067.stdout:8/733: link d0/d4/c56 d0/d4a/cf5 0 2024-08-31T05:21:31.594 INFO:tasks.workunit.client.0.smithi067.stdout:4/537: mknod d4/d9/db4/d83/da9/cbc 0 2024-08-31T05:21:31.599 INFO:tasks.workunit.client.0.smithi067.stdout:4/538: creat d4/d1f/fbd x:0 0 0 2024-08-31T05:21:31.603 INFO:tasks.workunit.client.0.smithi067.stdout:4/539: dread d4/d14/d48/d66/f8c [0,4194304] 0 2024-08-31T05:21:31.603 INFO:tasks.workunit.client.0.smithi067.stdout:4/540: chown d4/d14/d48 176 1 2024-08-31T05:21:31.605 INFO:tasks.workunit.client.0.smithi067.stdout:4/541: read d4/d32/d4c/f90 [1072222,82168] 0 2024-08-31T05:21:31.606 INFO:tasks.workunit.client.0.smithi067.stdout:4/542: fdatasync d4/d1e/f41 0 2024-08-31T05:21:31.608 INFO:tasks.workunit.client.0.smithi067.stdout:2/765: write db/dd/f15 [1421527,28265] 0 2024-08-31T05:21:31.614 INFO:tasks.workunit.client.0.smithi067.stdout:2/766: creat db/d12/d1a/d1e/d4d/ff5 x:0 0 0 2024-08-31T05:21:31.616 INFO:tasks.workunit.client.0.smithi067.stdout:5/559: write db/d26/d29/d31/f97 [932147,70727] 0 2024-08-31T05:21:31.617 INFO:tasks.workunit.client.0.smithi067.stdout:2/767: chown db/le 2 1 2024-08-31T05:21:31.620 INFO:tasks.workunit.client.0.smithi067.stdout:5/560: unlink db/d26/d60/f71 0 2024-08-31T05:21:31.624 INFO:tasks.workunit.client.0.smithi067.stdout:4/543: write d4/d42/f71 [1355596,93092] 0 2024-08-31T05:21:31.625 INFO:tasks.workunit.client.0.smithi067.stdout:5/561: read db/f88 [3293458,48958] 0 2024-08-31T05:21:31.627 INFO:tasks.workunit.client.0.smithi067.stdout:5/562: write db/d26/d29/f99 [2340951,74908] 0 2024-08-31T05:21:31.628 INFO:tasks.workunit.client.0.smithi067.stdout:4/544: truncate d4/d1e/f3f 146208 0 2024-08-31T05:21:31.628 INFO:tasks.workunit.client.0.smithi067.stdout:1/627: write d3/d23/d2d/d2e/f4b [574592,59834] 0 2024-08-31T05:21:31.637 INFO:tasks.workunit.client.0.smithi067.stdout:5/563: write db/f32 [1453011,74756] 0 2024-08-31T05:21:31.637 INFO:tasks.workunit.client.0.smithi067.stdout:4/545: mknod d4/d9/da2/cbe 0 2024-08-31T05:21:31.639 INFO:tasks.workunit.client.0.smithi067.stdout:4/546: write d4/d9/d5a/f74 [5311948,73563] 0 2024-08-31T05:21:31.645 INFO:tasks.workunit.client.0.smithi067.stdout:4/547: symlink d4/d1e/d53/d81/lbf 0 2024-08-31T05:21:31.645 INFO:tasks.workunit.client.0.smithi067.stdout:4/548: chown d4/d32/d43 127797 1 2024-08-31T05:21:31.646 INFO:tasks.workunit.client.0.smithi067.stdout:1/628: link d3/d23/d79/d93/la1 d3/d23/le7 0 2024-08-31T05:21:31.649 INFO:tasks.workunit.client.0.smithi067.stdout:5/564: write db/d15/d42/f44 [2559153,25912] 0 2024-08-31T05:21:31.649 INFO:tasks.workunit.client.0.smithi067.stdout:1/629: rmdir d3/d23/d2d/d2e/d34/d66/d72 39 2024-08-31T05:21:31.653 INFO:tasks.workunit.client.0.smithi067.stdout:5/565: creat db/d15/d42/d36/d73/da9/fb1 x:0 0 0 2024-08-31T05:21:31.653 INFO:tasks.workunit.client.0.smithi067.stdout:4/549: dwrite d4/d1f/fbd [0,4194304] 0 2024-08-31T05:21:31.654 INFO:tasks.workunit.client.0.smithi067.stdout:4/550: chown d4/d1e/d62/l9f 19686 1 2024-08-31T05:21:31.655 INFO:tasks.workunit.client.0.smithi067.stdout:1/630: truncate d3/dd/fe 2306387 0 2024-08-31T05:21:31.735 INFO:tasks.workunit.client.0.smithi067.stdout:4/551: rmdir d4/d32/d43 39 2024-08-31T05:21:31.738 INFO:tasks.workunit.client.0.smithi067.stdout:4/552: dread - d4/d14/d48/f68 zero size 2024-08-31T05:21:31.740 INFO:tasks.workunit.client.0.smithi067.stdout:4/553: mkdir d4/d42/dc0 0 2024-08-31T05:21:31.741 INFO:tasks.workunit.client.0.smithi067.stdout:4/554: truncate d4/d13/f79 1874406 0 2024-08-31T05:21:31.741 INFO:tasks.workunit.client.0.smithi067.stdout:1/631: rmdir d3/d23/d2d/d2e/d34/d66/d72/d82/de1 0 2024-08-31T05:21:31.743 INFO:tasks.workunit.client.0.smithi067.stdout:4/555: symlink d4/d9/da2/lc1 0 2024-08-31T05:21:31.749 INFO:tasks.workunit.client.0.smithi067.stdout:1/632: rename d3/dd to d3/d23/d2d/d2e/d34/d66/de8 0 2024-08-31T05:21:31.750 INFO:tasks.workunit.client.0.smithi067.stdout:4/556: link d4/d9/db4/d83/da9/d60/f9c d4/da5/fc2 0 2024-08-31T05:21:31.750 INFO:tasks.workunit.client.0.smithi067.stdout:1/633: read d3/d23/d2d/d2e/d34/d66/de8/f84 [309508,57836] 0 2024-08-31T05:21:31.752 INFO:tasks.workunit.client.0.smithi067.stdout:4/557: rmdir d4/d32 39 2024-08-31T05:21:31.755 INFO:tasks.workunit.client.0.smithi067.stdout:1/634: creat d3/d23/db1/db6/fe9 x:0 0 0 2024-08-31T05:21:31.759 INFO:tasks.workunit.client.0.smithi067.stdout:1/635: rename d3/d23/d5d/l6d to d3/d23/d2d/d2e/d34/d66/d72/d82/lea 0 2024-08-31T05:21:31.761 INFO:tasks.workunit.client.0.smithi067.stdout:1/636: chown d3/d23/db1/db6/fca 10076090 1 2024-08-31T05:21:31.765 INFO:tasks.workunit.client.0.smithi067.stdout:1/637: rename d3/d23/d2d/d2e/d34/d66/d94/le2 to d3/d23/d2d/d2e/d34/d66/d94/d9d/leb 0 2024-08-31T05:21:31.768 INFO:tasks.workunit.client.0.smithi067.stdout:1/638: creat d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/fec x:0 0 0 2024-08-31T05:21:31.769 INFO:tasks.workunit.client.0.smithi067.stdout:1/639: dread - d3/d23/d2d/d2e/f39 zero size 2024-08-31T05:21:31.771 INFO:tasks.workunit.client.0.smithi067.stdout:1/640: chown d3/d23/d2d/d2e/d34/d66/de8 322 1 2024-08-31T05:21:31.776 INFO:tasks.workunit.client.0.smithi067.stdout:1/641: mkdir d3/d23/d2d/d2e/d34/d66/d72/ded 0 2024-08-31T05:21:31.777 INFO:tasks.workunit.client.0.smithi067.stdout:1/642: chown d3/d23/d79/fa5 62881721 1 2024-08-31T05:21:31.780 INFO:tasks.workunit.client.0.smithi067.stdout:1/643: mkdir d3/d23/d79/d93/dee 0 2024-08-31T05:21:31.787 INFO:tasks.workunit.client.0.smithi067.stdout:1/644: dwrite d3/d23/d2d/d2e/d34/d66/de8/f51 [0,4194304] 0 2024-08-31T05:21:31.790 INFO:tasks.workunit.client.0.smithi067.stdout:1/645: write d3/d23/d2d/d2e/d34/d66/d72/d82/f9f [3272065,51672] 0 2024-08-31T05:21:31.791 INFO:tasks.workunit.client.0.smithi067.stdout:1/646: readlink d3/d23/d2d/d2e/d34/d66/la0 0 2024-08-31T05:21:31.794 INFO:tasks.workunit.client.0.smithi067.stdout:4/558: dwrite d4/d32/d43/f5d [0,4194304] 0 2024-08-31T05:21:31.794 INFO:tasks.workunit.client.0.smithi067.stdout:1/647: write d3/d8b/fc6 [34929,118391] 0 2024-08-31T05:21:31.795 INFO:tasks.workunit.client.0.smithi067.stdout:1/648: fdatasync d3/d23/d79/fa5 0 2024-08-31T05:21:31.797 INFO:tasks.workunit.client.0.smithi067.stdout:1/649: readlink d3/d23/d2d/d2e/d34/d66/de8/l8e 0 2024-08-31T05:21:31.799 INFO:tasks.workunit.client.0.smithi067.stdout:4/559: mknod d4/da5/cc3 0 2024-08-31T05:21:31.803 INFO:tasks.workunit.client.0.smithi067.stdout:4/560: creat d4/d9/db4/d83/da9/fc4 x:0 0 0 2024-08-31T05:21:31.806 INFO:tasks.workunit.client.0.smithi067.stdout:1/650: mknod d3/d23/d2d/d2e/d34/cef 0 2024-08-31T05:21:31.809 INFO:tasks.workunit.client.0.smithi067.stdout:4/561: symlink d4/d32/lc5 0 2024-08-31T05:21:31.814 INFO:tasks.workunit.client.0.smithi067.stdout:1/651: dwrite d3/d23/d2d/d2e/d34/d66/d72/fc1 [0,4194304] 0 2024-08-31T05:21:31.814 INFO:tasks.workunit.client.0.smithi067.stdout:4/562: dread d4/d13/f24 [0,4194304] 0 2024-08-31T05:21:31.816 INFO:tasks.workunit.client.0.smithi067.stdout:1/652: truncate d3/d23/d79/fd5 121463 0 2024-08-31T05:21:31.818 INFO:tasks.workunit.client.0.smithi067.stdout:4/563: read d4/d1e/f3f [59731,40813] 0 2024-08-31T05:21:31.819 INFO:tasks.workunit.client.0.smithi067.stdout:4/564: chown d4/d9/d4b/cb8 3620 1 2024-08-31T05:21:31.820 INFO:tasks.workunit.client.0.smithi067.stdout:1/653: getdents d3/d23/d79/d93/dee 0 2024-08-31T05:21:31.820 INFO:tasks.workunit.client.0.smithi067.stdout:4/565: fdatasync d4/d9/db4/d83/da9/fc4 0 2024-08-31T05:21:31.821 INFO:tasks.workunit.client.0.smithi067.stdout:1/654: chown d3/d23/d2d/d2e/d34/d66/d72 37 1 2024-08-31T05:21:31.823 INFO:tasks.workunit.client.0.smithi067.stdout:4/566: unlink d4/d1f/l37 0 2024-08-31T05:21:31.828 INFO:tasks.workunit.client.0.smithi067.stdout:1/655: dwrite d3/d23/d2d/d2e/f4b [0,4194304] 0 2024-08-31T05:21:31.832 INFO:tasks.workunit.client.0.smithi067.stdout:1/656: symlink d3/d23/db1/lf0 0 2024-08-31T05:21:31.835 INFO:tasks.workunit.client.0.smithi067.stdout:4/567: getdents d4/d9/d4b 0 2024-08-31T05:21:31.838 INFO:tasks.workunit.client.0.smithi067.stdout:4/568: mknod d4/d13/cc6 0 2024-08-31T05:21:31.839 INFO:tasks.workunit.client.0.smithi067.stdout:4/569: write d4/f76 [3363157,23396] 0 2024-08-31T05:21:31.844 INFO:tasks.workunit.client.0.smithi067.stdout:1/657: dread d3/d23/d2d/d2e/f62 [0,4194304] 0 2024-08-31T05:21:31.845 INFO:tasks.workunit.client.0.smithi067.stdout:4/570: mkdir d4/d32/dc7 0 2024-08-31T05:21:31.848 INFO:tasks.workunit.client.0.smithi067.stdout:4/571: link d4/d14/c36 d4/d13/cc8 0 2024-08-31T05:21:31.849 INFO:tasks.workunit.client.0.smithi067.stdout:4/572: dread - d4/d9/d4b/f86 zero size 2024-08-31T05:21:31.855 INFO:tasks.workunit.client.0.smithi067.stdout:4/573: dwrite d4/d1e/d62/f9b [0,4194304] 0 2024-08-31T05:21:31.861 INFO:tasks.workunit.client.0.smithi067.stdout:4/574: symlink d4/d9/d5a/lc9 0 2024-08-31T05:21:31.864 INFO:tasks.workunit.client.0.smithi067.stdout:4/575: rmdir d4/d56 39 2024-08-31T05:21:31.870 INFO:tasks.workunit.client.0.smithi067.stdout:4/576: mknod d4/d32/d4c/db3/cca 0 2024-08-31T05:21:31.871 INFO:tasks.workunit.client.0.smithi067.stdout:4/577: stat d4/d9/db4/d83/da9/d60/f61 0 2024-08-31T05:21:31.872 INFO:tasks.workunit.client.0.smithi067.stdout:4/578: read d4/d1e/d62/f9b [786471,26173] 0 2024-08-31T05:21:31.873 INFO:tasks.workunit.client.0.smithi067.stdout:4/579: chown d4/d32/d43 14572342 1 2024-08-31T05:21:31.874 INFO:tasks.workunit.client.0.smithi067.stdout:4/580: chown d4/d1e/d53/d81/lbf 0 1 2024-08-31T05:21:31.901 INFO:tasks.workunit.client.0.smithi067.stdout:4/581: write d4/d1e/d53/f6c [1264472,82080] 0 2024-08-31T05:21:31.903 INFO:tasks.workunit.client.0.smithi067.stdout:4/582: creat d4/d42/fcb x:0 0 0 2024-08-31T05:21:31.931 INFO:tasks.workunit.client.0.smithi067.stdout:4/583: dwrite d4/d9/db4/d83/da9/d60/fa8 [0,4194304] 0 2024-08-31T05:21:31.934 INFO:tasks.workunit.client.0.smithi067.stdout:4/584: creat d4/d9/db4/fcc x:0 0 0 2024-08-31T05:21:31.945 INFO:tasks.workunit.client.0.smithi067.stdout:4/585: dwrite d4/d1e/d62/f9b [0,4194304] 0 2024-08-31T05:21:31.946 INFO:tasks.workunit.client.0.smithi067.stdout:4/586: symlink d4/da5/lcd 0 2024-08-31T05:21:31.946 INFO:tasks.workunit.client.0.smithi067.stdout:4/587: chown d4/d9/cb 1 1 2024-08-31T05:21:31.957 INFO:tasks.workunit.client.0.smithi067.stdout:4/588: dwrite d4/d9/db4/d83/da9/f64 [0,4194304] 0 2024-08-31T05:21:31.959 INFO:tasks.workunit.client.0.smithi067.stdout:4/589: creat d4/d32/d4c/db3/fce x:0 0 0 2024-08-31T05:21:31.961 INFO:tasks.workunit.client.0.smithi067.stdout:4/590: creat d4/d32/d43/fcf x:0 0 0 2024-08-31T05:21:31.964 INFO:tasks.workunit.client.0.smithi067.stdout:4/591: creat d4/d1e/d92/fd0 x:0 0 0 2024-08-31T05:21:31.972 INFO:tasks.workunit.client.0.smithi067.stdout:4/592: getdents d4/d1e/d53 0 2024-08-31T05:21:31.972 INFO:tasks.workunit.client.0.smithi067.stdout:4/593: dread - d4/d9/d4b/fb5 zero size 2024-08-31T05:21:31.976 INFO:tasks.workunit.client.0.smithi067.stdout:4/594: truncate d4/d9/d5a/faa 1500939 0 2024-08-31T05:21:31.980 INFO:tasks.workunit.client.0.smithi067.stdout:4/595: dread d4/d42/f71 [0,4194304] 0 2024-08-31T05:21:31.985 INFO:tasks.workunit.client.0.smithi067.stdout:4/596: creat d4/d14/d48/d66/fd1 x:0 0 0 2024-08-31T05:21:31.986 INFO:tasks.workunit.client.0.smithi067.stdout:4/597: write d4/d9/db4/d83/da9/fb6 [773772,36466] 0 2024-08-31T05:21:31.994 INFO:tasks.workunit.client.0.smithi067.stdout:4/598: write d4/d9/db4/d83/da9/f46 [3831013,44463] 0 2024-08-31T05:21:32.046 INFO:tasks.workunit.client.0.smithi067.stdout:4/599: mknod d4/d1f/db9/cd2 0 2024-08-31T05:21:32.048 INFO:tasks.workunit.client.0.smithi067.stdout:4/600: truncate d4/d9/d5a/faa 1322602 0 2024-08-31T05:21:32.067 INFO:tasks.workunit.client.0.smithi067.stdout:4/601: getdents d4/d1f/db9 0 2024-08-31T05:21:32.074 INFO:tasks.workunit.client.0.smithi067.stdout:4/602: write d4/d9/f7b [852907,34236] 0 2024-08-31T05:21:32.077 INFO:tasks.workunit.client.0.smithi067.stdout:4/603: symlink d4/d14/ld3 0 2024-08-31T05:21:32.078 INFO:tasks.workunit.client.0.smithi067.stdout:4/604: creat d4/d9/d5a/fd4 x:0 0 0 2024-08-31T05:21:32.083 INFO:tasks.workunit.client.0.smithi067.stdout:4/605: dread d4/d13/f79 [0,4194304] 0 2024-08-31T05:21:32.084 INFO:tasks.workunit.client.0.smithi067.stdout:4/606: write d4/d42/f8b [1539,48978] 0 2024-08-31T05:21:32.097 INFO:tasks.workunit.client.0.smithi067.stdout:4/607: truncate d4/d1f/f72 2648182 0 2024-08-31T05:21:32.100 INFO:tasks.workunit.client.0.smithi067.stdout:4/608: dread d4/d9/db4/d83/da9/f46 [4194304,4194304] 0 2024-08-31T05:21:32.102 INFO:tasks.workunit.client.0.smithi067.stdout:4/609: mkdir d4/d42/dd5 0 2024-08-31T05:21:32.107 INFO:tasks.workunit.client.0.smithi067.stdout:4/610: dwrite d4/d1e/d62/f9b [0,4194304] 0 2024-08-31T05:21:32.121 INFO:tasks.workunit.client.0.smithi067.stdout:4/611: dwrite d4/d9/db4/d83/da9/d60/f87 [0,4194304] 0 2024-08-31T05:21:32.127 INFO:tasks.workunit.client.0.smithi067.stdout:4/612: creat d4/d56/fd6 x:0 0 0 2024-08-31T05:21:32.129 INFO:tasks.workunit.client.0.smithi067.stdout:4/613: symlink d4/d9/d5a/ld7 0 2024-08-31T05:21:32.133 INFO:tasks.workunit.client.0.smithi067.stdout:4/614: link d4/d14/f4a d4/d14/fd8 0 2024-08-31T05:21:32.136 INFO:tasks.workunit.client.0.smithi067.stdout:4/615: creat d4/d9/dbb/fd9 x:0 0 0 2024-08-31T05:21:32.136 INFO:tasks.workunit.client.0.smithi067.stdout:4/616: stat d4/d9/d5a/f74 0 2024-08-31T05:21:32.137 INFO:tasks.workunit.client.0.smithi067.stdout:4/617: stat d4/d1f/l20 0 2024-08-31T05:21:32.139 INFO:tasks.workunit.client.0.smithi067.stdout:4/618: symlink d4/d42/dc0/lda 0 2024-08-31T05:21:32.141 INFO:tasks.workunit.client.0.smithi067.stdout:4/619: unlink d4/d1e/d53/d81/c96 0 2024-08-31T05:21:32.143 INFO:tasks.workunit.client.0.smithi067.stdout:4/620: creat d4/d32/d43/fdb x:0 0 0 2024-08-31T05:21:32.144 INFO:tasks.workunit.client.0.smithi067.stdout:4/621: write d4/d9/f7e [1047547,101826] 0 2024-08-31T05:21:32.150 INFO:tasks.workunit.client.0.smithi067.stdout:4/622: chown d4/d14/fd8 284957 1 2024-08-31T05:21:32.150 INFO:tasks.workunit.client.0.smithi067.stdout:4/623: symlink d4/ldc 0 2024-08-31T05:21:32.171 INFO:tasks.workunit.client.0.smithi067.stdout:4/624: dwrite d4/d1e/f26 [0,4194304] 0 2024-08-31T05:21:32.181 INFO:tasks.workunit.client.0.smithi067.stdout:4/625: read d4/d9/db4/d83/da9/fb6 [722185,83372] 0 2024-08-31T05:21:32.181 INFO:tasks.workunit.client.0.smithi067.stdout:4/626: chown d4/d32/d43/f5d 10 1 2024-08-31T05:21:32.186 INFO:tasks.workunit.client.0.smithi067.stdout:4/627: getdents d4/d9/da2 0 2024-08-31T05:21:32.200 INFO:tasks.workunit.client.0.smithi067.stdout:4/628: write d4/d14/fd8 [1469026,4433] 0 2024-08-31T05:21:32.203 INFO:tasks.workunit.client.0.smithi067.stdout:4/629: fdatasync d4/f25 0 2024-08-31T05:21:32.204 INFO:tasks.workunit.client.0.smithi067.stdout:4/630: write d4/d32/d4c/db3/fce [784431,5427] 0 2024-08-31T05:21:32.206 INFO:tasks.workunit.client.0.smithi067.stdout:4/631: write d4/d9/fa [9282444,129313] 0 2024-08-31T05:21:32.212 INFO:tasks.workunit.client.0.smithi067.stdout:4/632: dwrite d4/d9/d5a/f74 [4194304,4194304] 0 2024-08-31T05:21:32.234 INFO:tasks.workunit.client.0.smithi067.stdout:4/633: dread d4/f10 [0,4194304] 0 2024-08-31T05:21:32.259 INFO:tasks.workunit.client.0.smithi067.stdout:4/634: chown d4/d14/d48/d66/fd1 334835970 1 2024-08-31T05:21:32.259 INFO:tasks.workunit.client.0.smithi067.stdout:4/635: write d4/d9/d4b/f86 [917613,20645] 0 2024-08-31T05:21:32.260 INFO:tasks.workunit.client.0.smithi067.stdout:4/636: stat d4/d1e/l39 0 2024-08-31T05:21:32.260 INFO:tasks.workunit.client.0.smithi067.stdout:4/637: rmdir d4/d42 39 2024-08-31T05:21:32.260 INFO:tasks.workunit.client.0.smithi067.stdout:4/638: dread d4/d9/f7e [0,4194304] 0 2024-08-31T05:21:32.260 INFO:tasks.workunit.client.0.smithi067.stdout:4/639: dread d4/d1f/d34/f3c [0,4194304] 0 2024-08-31T05:21:32.260 INFO:tasks.workunit.client.0.smithi067.stdout:4/640: unlink d4/d14/d48/d66/f8c 0 2024-08-31T05:21:32.266 INFO:tasks.workunit.client.0.smithi067.stdout:4/641: write d4/d1e/f6f [2414789,68104] 0 2024-08-31T05:21:32.270 INFO:tasks.workunit.client.0.smithi067.stdout:4/642: rename d4/d9/dbb/fd9 to d4/d9/d4b/fdd 0 2024-08-31T05:21:32.270 INFO:tasks.workunit.client.0.smithi067.stdout:4/643: fdatasync d4/d56/fa7 0 2024-08-31T05:21:32.282 INFO:tasks.workunit.client.0.smithi067.stdout:4/644: dwrite d4/d14/d48/f6e [0,4194304] 0 2024-08-31T05:21:32.283 INFO:tasks.workunit.client.0.smithi067.stdout:4/645: readlink d4/d14/l2f 0 2024-08-31T05:21:32.291 INFO:tasks.workunit.client.0.smithi067.stdout:4/646: unlink d4/d42/f8e 0 2024-08-31T05:21:32.293 INFO:tasks.workunit.client.0.smithi067.stdout:4/647: mknod d4/d42/dd5/cde 0 2024-08-31T05:21:32.295 INFO:tasks.workunit.client.0.smithi067.stdout:4/648: symlink d4/da5/ldf 0 2024-08-31T05:21:32.297 INFO:tasks.workunit.client.0.smithi067.stdout:4/649: stat d4/d13/cc8 0 2024-08-31T05:21:32.299 INFO:tasks.workunit.client.0.smithi067.stdout:4/650: unlink d4/d42/dd5/cde 0 2024-08-31T05:21:32.302 INFO:tasks.workunit.client.0.smithi067.stdout:4/651: dread d4/d13/f79 [0,4194304] 0 2024-08-31T05:21:32.302 INFO:tasks.workunit.client.0.smithi067.stdout:4/652: readlink d4/d14/d48/l84 0 2024-08-31T05:21:32.305 INFO:tasks.workunit.client.0.smithi067.stdout:4/653: write d4/d13/f79 [3029867,113152] 0 2024-08-31T05:21:32.310 INFO:tasks.workunit.client.0.smithi067.stdout:4/654: dwrite d4/f25 [0,4194304] 0 2024-08-31T05:21:32.311 INFO:tasks.workunit.client.0.smithi067.stdout:4/655: fdatasync d4/d9/fa 0 2024-08-31T05:21:32.312 INFO:tasks.workunit.client.0.smithi067.stdout:4/656: read - d4/d9/d4b/fdd zero size 2024-08-31T05:21:32.316 INFO:tasks.workunit.client.0.smithi067.stdout:4/657: symlink d4/d9/d4b/le0 0 2024-08-31T05:21:32.319 INFO:tasks.workunit.client.0.smithi067.stdout:4/658: mkdir d4/d9/dbb/de1 0 2024-08-31T05:21:32.328 INFO:tasks.workunit.client.0.smithi067.stdout:4/659: dread d4/d1e/f41 [0,4194304] 0 2024-08-31T05:21:32.330 INFO:tasks.workunit.client.0.smithi067.stdout:4/660: creat d4/d32/d43/fe2 x:0 0 0 2024-08-31T05:21:32.330 INFO:tasks.workunit.client.0.smithi067.stdout:4/661: readlink d4/d1e/d62/l9f 0 2024-08-31T05:21:32.332 INFO:tasks.workunit.client.0.smithi067.stdout:4/662: mkdir d4/d42/de3 0 2024-08-31T05:21:32.332 INFO:tasks.workunit.client.0.smithi067.stdout:4/663: fsync d4/d42/f8b 0 2024-08-31T05:21:32.334 INFO:tasks.workunit.client.0.smithi067.stdout:4/664: write d4/d14/d48/f6e [4546096,43529] 0 2024-08-31T05:21:32.343 INFO:tasks.workunit.client.0.smithi067.stdout:4/665: dwrite d4/d1f/f3d [0,4194304] 0 2024-08-31T05:21:32.345 INFO:tasks.workunit.client.0.smithi067.stdout:4/666: write d4/d1e/f26 [3955349,80078] 0 2024-08-31T05:21:32.347 INFO:tasks.workunit.client.0.smithi067.stdout:4/667: unlink d4/d1f/l20 0 2024-08-31T05:21:32.354 INFO:tasks.workunit.client.0.smithi067.stdout:4/668: creat d4/d9/fe4 x:0 0 0 2024-08-31T05:21:32.354 INFO:tasks.workunit.client.0.smithi067.stdout:4/669: readlink d4/d1e/d53/l67 0 2024-08-31T05:21:32.354 INFO:tasks.workunit.client.0.smithi067.stdout:4/670: mknod d4/d32/d43/ce5 0 2024-08-31T05:21:32.354 INFO:tasks.workunit.client.0.smithi067.stdout:4/671: write d4/f76 [3243053,95375] 0 2024-08-31T05:21:32.357 INFO:tasks.workunit.client.0.smithi067.stdout:4/672: rename d4/d1f/d34/cab to d4/d32/d4c/db3/ce6 0 2024-08-31T05:21:32.357 INFO:tasks.workunit.client.0.smithi067.stdout:4/673: readlink d4/d9/db4/d83/da9/l5b 0 2024-08-31T05:21:32.358 INFO:tasks.workunit.client.0.smithi067.stdout:4/674: write d4/d32/d43/fdb [114404,30201] 0 2024-08-31T05:21:32.374 INFO:tasks.workunit.client.0.smithi067.stdout:4/675: truncate d4/d1f/f3d 56508 0 2024-08-31T05:21:32.377 INFO:tasks.workunit.client.0.smithi067.stdout:4/676: mkdir d4/d14/d48/d66/de7 0 2024-08-31T05:21:32.379 INFO:tasks.workunit.client.0.smithi067.stdout:4/677: write d4/d9/db4/d83/da9/fb6 [1761944,113417] 0 2024-08-31T05:21:32.380 INFO:tasks.workunit.client.0.smithi067.stdout:4/678: stat d4/d1f/fbd 0 2024-08-31T05:21:32.389 INFO:tasks.workunit.client.0.smithi067.stdout:4/679: write d4/da5/fc2 [559154,47242] 0 2024-08-31T05:21:32.394 INFO:tasks.workunit.client.0.smithi067.stdout:4/680: dwrite d4/d56/fd6 [0,4194304] 0 2024-08-31T05:21:32.396 INFO:tasks.workunit.client.0.smithi067.stdout:4/681: write d4/d14/d48/f6e [3575066,91788] 0 2024-08-31T05:21:32.400 INFO:tasks.workunit.client.0.smithi067.stdout:4/682: rename d4/d14/d48/d66/fd1 to d4/d9/db4/fe8 0 2024-08-31T05:21:32.404 INFO:tasks.workunit.client.0.smithi067.stdout:4/683: dread d4/d32/d43/f5d [0,4194304] 0 2024-08-31T05:21:32.408 INFO:tasks.workunit.client.0.smithi067.stdout:4/684: truncate d4/d1e/f41 1103430 0 2024-08-31T05:21:32.409 INFO:tasks.workunit.client.0.smithi067.stdout:4/685: write d4/d9/db4/d83/da9/d60/f61 [1535943,61637] 0 2024-08-31T05:21:32.412 INFO:tasks.workunit.client.0.smithi067.stdout:4/686: dread d4/d9/d5a/faa [0,4194304] 0 2024-08-31T05:21:32.412 INFO:tasks.workunit.client.0.smithi067.stdout:4/687: chown d4/d9/c15 1374232022 1 2024-08-31T05:21:32.413 INFO:tasks.workunit.client.0.smithi067.stdout:4/688: fdatasync d4/d9/f7b 0 2024-08-31T05:21:32.414 INFO:tasks.workunit.client.0.smithi067.stdout:4/689: read - d4/d14/d48/f68 zero size 2024-08-31T05:21:32.414 INFO:tasks.workunit.client.0.smithi067.stdout:4/690: chown d4/d9/db4/d83/da9/d60/f9c 2 1 2024-08-31T05:21:32.417 INFO:tasks.workunit.client.0.smithi067.stdout:4/691: creat d4/d32/d4c/fe9 x:0 0 0 2024-08-31T05:21:32.417 INFO:tasks.workunit.client.0.smithi067.stdout:4/692: chown d4/d32/d43/ca3 16315921 1 2024-08-31T05:21:32.418 INFO:tasks.workunit.client.0.smithi067.stdout:4/693: write d4/da5/fc2 [110651,118503] 0 2024-08-31T05:21:32.419 INFO:tasks.workunit.client.0.smithi067.stdout:4/694: readlink d4/d1f/l69 0 2024-08-31T05:21:32.424 INFO:tasks.workunit.client.0.smithi067.stdout:4/695: dwrite d4/d32/d43/fdb [0,4194304] 0 2024-08-31T05:21:32.427 INFO:tasks.workunit.client.0.smithi067.stdout:4/696: unlink d4/d9/db4/d83/da9/f64 0 2024-08-31T05:21:32.429 INFO:tasks.workunit.client.0.smithi067.stdout:4/697: mkdir d4/d1e/dea 0 2024-08-31T05:21:32.435 INFO:tasks.workunit.client.0.smithi067.stdout:4/698: dwrite d4/d56/fd6 [0,4194304] 0 2024-08-31T05:21:32.437 INFO:tasks.workunit.client.0.smithi067.stdout:4/699: fdatasync d4/d14/d48/d66/faf 0 2024-08-31T05:21:32.442 INFO:tasks.workunit.client.0.smithi067.stdout:4/700: creat d4/d14/d48/d66/feb x:0 0 0 2024-08-31T05:21:32.449 INFO:tasks.workunit.client.0.smithi067.stdout:4/701: getdents d4/d1e/d53/d81 0 2024-08-31T05:21:32.451 INFO:tasks.workunit.client.0.smithi067.stdout:4/702: creat d4/d14/d48/d66/de7/fec x:0 0 0 2024-08-31T05:21:32.453 INFO:tasks.workunit.client.0.smithi067.stdout:4/703: symlink d4/d9/dbb/de1/led 0 2024-08-31T05:21:32.460 INFO:tasks.workunit.client.0.smithi067.stdout:4/704: dwrite d4/d32/d43/f5d [0,4194304] 0 2024-08-31T05:21:32.463 INFO:tasks.workunit.client.0.smithi067.stdout:4/705: creat d4/d9/da4/fee x:0 0 0 2024-08-31T05:21:32.464 INFO:tasks.workunit.client.0.smithi067.stdout:4/706: chown d4/d1e/f6f 49670430 1 2024-08-31T05:21:32.558 INFO:tasks.workunit.client.0.smithi067.stdout:0/833: sync 2024-08-31T05:21:32.571 INFO:tasks.workunit.client.0.smithi067.stdout:0/834: dread d1/dd/d4d/d88/dac/d8d/fe3 [0,4194304] 0 2024-08-31T05:21:32.816 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T05:21:32.817 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-08-31T05:21:32.835 INFO:tasks.workunit.client.0.smithi067.stdout:6/799: sync 2024-08-31T05:21:32.836 INFO:tasks.workunit.client.0.smithi067.stdout:9/653: sync 2024-08-31T05:21:32.836 INFO:tasks.workunit.client.0.smithi067.stdout:7/489: sync 2024-08-31T05:21:32.836 INFO:tasks.workunit.client.0.smithi067.stdout:7/490: chown d14/d16/f22 8131 1 2024-08-31T05:21:32.839 INFO:tasks.workunit.client.0.smithi067.stdout:6/800: creat d1b/d40/d70/dd0/d8d/f101 x:0 0 0 2024-08-31T05:21:32.840 INFO:tasks.workunit.client.0.smithi067.stdout:7/491: mknod d14/d16/d5b/d68/d6e/c8a 0 2024-08-31T05:21:32.843 INFO:tasks.workunit.client.0.smithi067.stdout:9/654: dwrite dd/df/f9a [4194304,4194304] 0 2024-08-31T05:21:32.849 INFO:tasks.workunit.client.0.smithi067.stdout:6/801: dwrite d1b/d23/d28/f85 [0,4194304] 0 2024-08-31T05:21:32.850 INFO:tasks.workunit.client.0.smithi067.stdout:6/802: dread - d1b/d7a/ffa zero size 2024-08-31T05:21:32.850 INFO:tasks.workunit.client.0.smithi067.stdout:9/655: creat dd/df/d8e/dcc/fdc x:0 0 0 2024-08-31T05:21:32.854 INFO:tasks.workunit.client.0.smithi067.stdout:7/492: dwrite fd [0,4194304] 0 2024-08-31T05:21:32.855 INFO:tasks.workunit.client.0.smithi067.stdout:6/803: creat d1b/d40/d70/dd0/da4/f102 x:0 0 0 2024-08-31T05:21:32.858 INFO:tasks.workunit.client.0.smithi067.stdout:6/804: truncate d1b/d40/d70/dd0/daa/fed 660116 0 2024-08-31T05:21:32.858 INFO:tasks.workunit.client.0.smithi067.stdout:9/656: rename dd/df/f11 to dd/d63/da3/fdd 0 2024-08-31T05:21:32.858 INFO:tasks.workunit.client.0.smithi067.stdout:6/805: stat d1b/d23/d2e/l67 0 2024-08-31T05:21:32.860 INFO:tasks.workunit.client.0.smithi067.stdout:7/493: creat d14/d16/d5b/d64/f8b x:0 0 0 2024-08-31T05:21:32.860 INFO:tasks.workunit.client.0.smithi067.stdout:6/806: readlink d1b/d40/d70/dd0/d5e/de6/ld8 0 2024-08-31T05:21:32.864 INFO:tasks.workunit.client.0.smithi067.stdout:9/657: rename dd/df/d25/d3b/f97 to dd/d4d/fde 0 2024-08-31T05:21:32.868 INFO:tasks.workunit.client.0.smithi067.stdout:6/807: creat d1b/d40/d70/dd0/d8d/dc6/d100/f103 x:0 0 0 2024-08-31T05:21:32.868 INFO:tasks.workunit.client.0.smithi067.stdout:6/808: chown d1b/d7a/fd7 1 1 2024-08-31T05:21:32.869 INFO:tasks.workunit.client.0.smithi067.stdout:7/494: getdents d14/d3e 0 2024-08-31T05:21:32.870 INFO:tasks.workunit.client.0.smithi067.stdout:6/809: write d1b/d40/d70/ff9 [965699,22692] 0 2024-08-31T05:21:32.870 INFO:tasks.workunit.client.0.smithi067.stdout:7/495: mkdir d14/d16/d5b/d8c 0 2024-08-31T05:21:32.871 INFO:tasks.workunit.client.0.smithi067.stdout:6/810: readlink d1b/d40/d70/dd0/d8d/dc6/lc0 0 2024-08-31T05:21:32.872 INFO:tasks.workunit.client.0.smithi067.stdout:9/658: read dd/d63/da3/faa [3272426,13333] 0 2024-08-31T05:21:32.873 INFO:tasks.workunit.client.0.smithi067.stdout:7/496: fdatasync d14/d16/d28/d2e/d2f/f4f 0 2024-08-31T05:21:32.876 INFO:tasks.workunit.client.0.smithi067.stdout:6/811: unlink d1b/d40/d70/dd0/d8d/ccf 0 2024-08-31T05:21:32.878 INFO:tasks.workunit.client.0.smithi067.stdout:9/659: creat dd/fdf x:0 0 0 2024-08-31T05:21:32.879 INFO:tasks.workunit.client.0.smithi067.stdout:6/812: creat d1b/d40/d70/dd0/daa/f104 x:0 0 0 2024-08-31T05:21:32.882 INFO:tasks.workunit.client.0.smithi067.stdout:9/660: mkdir dd/df/d3c/dbe/dd4/de0 0 2024-08-31T05:21:32.886 INFO:tasks.workunit.client.0.smithi067.stdout:9/661: symlink dd/d4d/dca/le1 0 2024-08-31T05:21:32.890 INFO:tasks.workunit.client.0.smithi067.stdout:6/813: write d1b/d23/f69 [884112,43910] 0 2024-08-31T05:21:32.897 INFO:tasks.workunit.client.0.smithi067.stdout:7/497: dread d14/f18 [0,4194304] 0 2024-08-31T05:21:32.898 INFO:tasks.workunit.client.0.smithi067.stdout:9/662: dwrite dd/df/d25/f2c [0,4194304] 0 2024-08-31T05:21:32.904 INFO:tasks.workunit.client.0.smithi067.stdout:7/498: dread d14/d16/d28/d2e/f38 [0,4194304] 0 2024-08-31T05:21:32.905 INFO:tasks.workunit.client.0.smithi067.stdout:3/921: sync 2024-08-31T05:21:32.906 INFO:tasks.workunit.client.0.smithi067.stdout:7/499: chown d14/d16/d5b 228529 1 2024-08-31T05:21:32.907 INFO:tasks.workunit.client.0.smithi067.stdout:6/814: dread d1b/d23/d2e/d3b/f95 [0,4194304] 0 2024-08-31T05:21:32.908 INFO:tasks.workunit.client.0.smithi067.stdout:3/922: fsync db/d17/d3f/d54/d56/d6e/f9f 0 2024-08-31T05:21:32.911 INFO:tasks.workunit.client.0.smithi067.stdout:7/500: dread d14/d16/f5d [0,4194304] 0 2024-08-31T05:21:32.912 INFO:tasks.workunit.client.0.smithi067.stdout:9/663: dwrite dd/df/d5b/f6e [0,4194304] 0 2024-08-31T05:21:32.913 INFO:tasks.workunit.client.0.smithi067.stdout:6/815: mknod d1b/d40/d96/db3/c105 0 2024-08-31T05:21:32.913 INFO:tasks.workunit.client.0.smithi067.stdout:7/501: chown d14/d16/d28/d2e/c3b 119582 1 2024-08-31T05:21:32.916 INFO:tasks.workunit.client.0.smithi067.stdout:7/502: chown d14/d16/d5b/d64/f61 31824557 1 2024-08-31T05:21:32.920 INFO:tasks.workunit.client.0.smithi067.stdout:3/923: write db/d12/d21/fbc [1260700,81925] 0 2024-08-31T05:21:32.921 INFO:tasks.workunit.client.0.smithi067.stdout:7/503: mkdir d14/d16/d28/d2e/d2f/d8d 0 2024-08-31T05:21:32.924 INFO:tasks.workunit.client.0.smithi067.stdout:6/816: write d1b/d40/d70/dd0/daa/fb8 [1182537,77439] 0 2024-08-31T05:21:32.924 INFO:tasks.workunit.client.0.smithi067.stdout:7/504: write d14/d16/d28/d78/f7d [367338,56565] 0 2024-08-31T05:21:32.926 INFO:tasks.workunit.client.0.smithi067.stdout:6/817: chown d1b/d8e/d62/lac 1905184 1 2024-08-31T05:21:32.927 INFO:tasks.workunit.client.0.smithi067.stdout:3/924: rename db/d17/d3f/d54/cc8 to db/d2e/d50/d11b/c129 0 2024-08-31T05:21:32.929 INFO:tasks.workunit.client.0.smithi067.stdout:3/925: chown db/f53 6 1 2024-08-31T05:21:32.929 INFO:tasks.workunit.client.0.smithi067.stdout:6/818: write d1b/d40/d70/dd0/d8d/f101 [521883,68544] 0 2024-08-31T05:21:32.933 INFO:tasks.workunit.client.0.smithi067.stdout:6/819: creat d1b/d40/d96/db3/dff/f106 x:0 0 0 2024-08-31T05:21:32.936 INFO:tasks.workunit.client.0.smithi067.stdout:3/926: write db/f10 [3528579,83627] 0 2024-08-31T05:21:32.937 INFO:tasks.workunit.client.0.smithi067.stdout:6/820: mkdir d1b/d40/d70/dd0/d5c/d107 0 2024-08-31T05:21:32.940 INFO:tasks.workunit.client.0.smithi067.stdout:9/664: dread dd/df/f24 [0,4194304] 0 2024-08-31T05:21:32.944 INFO:tasks.workunit.client.0.smithi067.stdout:6/821: write d1b/d23/d61/f4e [100692,106158] 0 2024-08-31T05:21:32.946 INFO:tasks.workunit.client.0.smithi067.stdout:3/927: rename db/d12/d21/f26 to db/d2e/d6a/f12a 0 2024-08-31T05:21:32.949 INFO:tasks.workunit.client.0.smithi067.stdout:7/505: dread d14/f20 [0,4194304] 0 2024-08-31T05:21:32.950 INFO:tasks.workunit.client.0.smithi067.stdout:7/506: write d14/d16/d5b/d64/f8b [563658,101710] 0 2024-08-31T05:21:32.952 INFO:tasks.workunit.client.0.smithi067.stdout:7/507: write d14/d4a/f76 [348173,58349] 0 2024-08-31T05:21:32.956 INFO:tasks.workunit.client.0.smithi067.stdout:9/665: dread dd/d63/fc5 [0,4194304] 0 2024-08-31T05:21:32.961 INFO:tasks.workunit.client.0.smithi067.stdout:9/666: dwrite dd/f36 [0,4194304] 0 2024-08-31T05:21:32.968 INFO:tasks.workunit.client.0.smithi067.stdout:6/822: dread d1b/d23/d28/f39 [4194304,4194304] 0 2024-08-31T05:21:32.979 INFO:tasks.workunit.client.0.smithi067.stdout:3/928: symlink db/dbe/l12b 0 2024-08-31T05:21:32.986 INFO:tasks.workunit.client.0.smithi067.stdout:1/658: sync 2024-08-31T05:21:32.986 INFO:tasks.workunit.client.0.smithi067.stdout:0/835: sync 2024-08-31T05:21:32.986 INFO:tasks.workunit.client.0.smithi067.stdout:2/768: sync 2024-08-31T05:21:32.986 INFO:tasks.workunit.client.0.smithi067.stdout:8/734: sync 2024-08-31T05:21:32.986 INFO:tasks.workunit.client.0.smithi067.stdout:4/707: sync 2024-08-31T05:21:32.986 INFO:tasks.workunit.client.0.smithi067.stdout:5/566: sync 2024-08-31T05:21:32.986 INFO:tasks.workunit.client.0.smithi067.stdout:9/667: mknod dd/d4d/ce2 0 2024-08-31T05:21:32.992 INFO:tasks.workunit.client.0.smithi067.stdout:7/508: mknod d14/d16/d5b/d68/d80/c8e 0 2024-08-31T05:21:32.995 INFO:tasks.workunit.client.0.smithi067.stdout:5/567: mknod db/d1d/d4f/cb2 0 2024-08-31T05:21:32.997 INFO:tasks.workunit.client.0.smithi067.stdout:7/509: dread - d14/d16/d5b/d64/f61 zero size 2024-08-31T05:21:32.998 INFO:tasks.workunit.client.0.smithi067.stdout:8/735: dwrite d0/d2/fe6 [0,4194304] 0 2024-08-31T05:21:32.999 INFO:tasks.workunit.client.0.smithi067.stdout:4/708: dwrite d4/d14/d48/d66/feb [0,4194304] 0 2024-08-31T05:21:32.999 INFO:tasks.workunit.client.0.smithi067.stdout:0/836: rmdir d1/dd/d18/d52/dc6 39 2024-08-31T05:21:33.005 INFO:tasks.workunit.client.0.smithi067.stdout:3/929: mkdir db/d2e/d6a/d12c 0 2024-08-31T05:21:33.026 INFO:tasks.workunit.client.0.smithi067.stdout:7/510: fdatasync d14/d16/f42 0 2024-08-31T05:21:33.028 INFO:tasks.workunit.client.0.smithi067.stdout:5/568: dread db/d26/f62 [0,4194304] 0 2024-08-31T05:21:33.030 INFO:tasks.workunit.client.0.smithi067.stdout:4/709: rename d4/d1e/f6f to d4/d1e/dea/fef 0 2024-08-31T05:21:33.031 INFO:tasks.workunit.client.0.smithi067.stdout:4/710: write d4/d14/d48/d66/de7/fec [179496,71265] 0 2024-08-31T05:21:33.032 INFO:tasks.workunit.client.0.smithi067.stdout:6/823: symlink d1b/d40/d70/dd0/d5e/l108 0 2024-08-31T05:21:33.033 INFO:tasks.workunit.client.0.smithi067.stdout:6/824: fsync d1b/d23/f2a 0 2024-08-31T05:21:33.034 INFO:tasks.workunit.client.0.smithi067.stdout:2/769: creat db/d8c/dcd/df4/ff6 x:0 0 0 2024-08-31T05:21:33.036 INFO:tasks.workunit.client.0.smithi067.stdout:1/659: rmdir d3/dd3/dd6 0 2024-08-31T05:21:33.039 INFO:tasks.workunit.client.0.smithi067.stdout:7/511: mkdir d14/d54/d5e/d8f 0 2024-08-31T05:21:33.045 INFO:tasks.workunit.client.0.smithi067.stdout:4/711: creat d4/d32/d43/ff0 x:0 0 0 2024-08-31T05:21:33.051 INFO:tasks.workunit.client.0.smithi067.stdout:4/712: dwrite d4/d9/db4/d83/da9/fb6 [0,4194304] 0 2024-08-31T05:21:33.055 INFO:tasks.workunit.client.0.smithi067.stdout:0/837: symlink d1/df/d17/l10c 0 2024-08-31T05:21:33.057 INFO:tasks.workunit.client.0.smithi067.stdout:9/668: getdents dd/d4d/dca 0 2024-08-31T05:21:33.067 INFO:tasks.workunit.client.0.smithi067.stdout:8/736: getdents d0/d4a 0 2024-08-31T05:21:33.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:32 smithi067 ceph-mon[17432]: pgmap v37: 65 pgs: 65 active+clean; 2.3 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 38 MiB/s rd, 110 MiB/s wr, 277 op/s 2024-08-31T05:21:33.080 INFO:tasks.workunit.client.0.smithi067.stdout:0/838: creat d1/dd/d18/d52/dc6/f10d x:0 0 0 2024-08-31T05:21:33.082 INFO:tasks.workunit.client.0.smithi067.stdout:3/930: rmdir db/d55/d97/dc4/dcb 39 2024-08-31T05:21:33.084 INFO:tasks.workunit.client.0.smithi067.stdout:0/839: symlink d1/dd/d4d/d88/dac/l10e 0 2024-08-31T05:21:33.084 INFO:tasks.workunit.client.0.smithi067.stdout:2/770: dread db/dd/d13/d9f/fce [0,4194304] 0 2024-08-31T05:21:33.086 INFO:tasks.workunit.client.0.smithi067.stdout:9/669: getdents dd/d63/d72 0 2024-08-31T05:21:33.088 INFO:tasks.workunit.client.0.smithi067.stdout:3/931: rmdir db/d12/d21/dff 39 2024-08-31T05:21:33.091 INFO:tasks.workunit.client.0.smithi067.stdout:9/670: fsync dd/df/f12 0 2024-08-31T05:21:33.092 INFO:tasks.workunit.client.0.smithi067.stdout:6/825: mknod d1b/d40/d70/c109 0 2024-08-31T05:21:33.093 INFO:tasks.workunit.client.0.smithi067.stdout:2/771: readlink db/d12/d1a/d2b/l55 0 2024-08-31T05:21:33.097 INFO:tasks.workunit.client.0.smithi067.stdout:6/826: dread - d1b/d40/d96/db3/fce zero size 2024-08-31T05:21:33.099 INFO:tasks.workunit.client.0.smithi067.stdout:6/827: write d1b/d40/de8/ff5 [856394,100633] 0 2024-08-31T05:21:33.099 INFO:tasks.workunit.client.0.smithi067.stdout:3/932: mknod db/d55/d97/dc4/c12d 0 2024-08-31T05:21:33.100 INFO:tasks.workunit.client.0.smithi067.stdout:6/828: chown d1b/d40/d70/c8a 23 1 2024-08-31T05:21:33.105 INFO:tasks.workunit.client.0.smithi067.stdout:6/829: creat d1b/d23/df1/f10a x:0 0 0 2024-08-31T05:21:33.107 INFO:tasks.workunit.client.0.smithi067.stdout:9/671: creat dd/df/d25/fe3 x:0 0 0 2024-08-31T05:21:33.107 INFO:tasks.workunit.client.0.smithi067.stdout:3/933: mkdir db/d2e/d12e 0 2024-08-31T05:21:33.109 INFO:tasks.workunit.client.0.smithi067.stdout:5/569: write db/d1d/f9d [63003,27076] 0 2024-08-31T05:21:33.112 INFO:tasks.workunit.client.0.smithi067.stdout:6/830: creat d1b/d40/d70/dd0/f10b x:0 0 0 2024-08-31T05:21:33.114 INFO:tasks.workunit.client.0.smithi067.stdout:9/672: creat dd/d63/fe4 x:0 0 0 2024-08-31T05:21:33.116 INFO:tasks.workunit.client.0.smithi067.stdout:3/934: dwrite db/d2e/d6a/fd3 [0,4194304] 0 2024-08-31T05:21:33.117 INFO:tasks.workunit.client.0.smithi067.stdout:5/570: truncate db/d1d/d3a/f43 512132 0 2024-08-31T05:21:33.119 INFO:tasks.workunit.client.0.smithi067.stdout:5/571: write db/d15/f80 [4048738,57968] 0 2024-08-31T05:21:33.122 INFO:tasks.workunit.client.0.smithi067.stdout:3/935: mknod db/d4e/c12f 0 2024-08-31T05:21:33.123 INFO:tasks.workunit.client.0.smithi067.stdout:9/673: dwrite dd/df/f1f [0,4194304] 0 2024-08-31T05:21:33.124 INFO:tasks.workunit.client.0.smithi067.stdout:3/936: chown db/dbe/l12b 511 1 2024-08-31T05:21:33.125 INFO:tasks.workunit.client.0.smithi067.stdout:5/572: mknod db/d1d/d3a/d7c/cb3 0 2024-08-31T05:21:33.125 INFO:tasks.workunit.client.0.smithi067.stdout:8/737: rmdir d0/d4/de/df0 39 2024-08-31T05:21:33.129 INFO:tasks.workunit.client.0.smithi067.stdout:8/738: dread - d0/d4/de/d1d/ff1 zero size 2024-08-31T05:21:33.133 INFO:tasks.workunit.client.0.smithi067.stdout:5/573: rename db/d15/f2a to db/d26/d60/da6/fb4 0 2024-08-31T05:21:33.136 INFO:tasks.workunit.client.0.smithi067.stdout:1/660: dwrite d3/d36/f53 [0,4194304] 0 2024-08-31T05:21:33.136 INFO:tasks.workunit.client.0.smithi067.stdout:5/574: stat db/d26/d29/d31/d54/d66/l79 0 2024-08-31T05:21:33.138 INFO:tasks.workunit.client.0.smithi067.stdout:4/713: dwrite d4/d42/f50 [0,4194304] 0 2024-08-31T05:21:33.139 INFO:tasks.workunit.client.0.smithi067.stdout:5/575: chown db/d26/d4c/f65 30 1 2024-08-31T05:21:33.144 INFO:tasks.workunit.client.0.smithi067.stdout:5/576: write db/d15/f80 [3946818,61441] 0 2024-08-31T05:21:33.145 INFO:tasks.workunit.client.0.smithi067.stdout:8/739: creat d0/ff6 x:0 0 0 2024-08-31T05:21:33.146 INFO:tasks.workunit.client.0.smithi067.stdout:4/714: creat d4/d32/d43/ff1 x:0 0 0 2024-08-31T05:21:33.147 INFO:tasks.workunit.client.0.smithi067.stdout:1/661: truncate d3/d23/d2d/d2e/d34/d66/f89 112624 0 2024-08-31T05:21:33.148 INFO:tasks.workunit.client.0.smithi067.stdout:2/772: write db/d8c/dcd/df4/da0/fc5 [1045105,91246] 0 2024-08-31T05:21:33.148 INFO:tasks.workunit.client.0.smithi067.stdout:8/740: fsync d0/d2/fe6 0 2024-08-31T05:21:33.153 INFO:tasks.workunit.client.0.smithi067.stdout:4/715: truncate d4/d32/d43/fdb 4783807 0 2024-08-31T05:21:33.153 INFO:tasks.workunit.client.0.smithi067.stdout:6/831: write fd [2171889,23277] 0 2024-08-31T05:21:33.155 INFO:tasks.workunit.client.0.smithi067.stdout:0/840: dwrite d1/df/d17/d43/d48/d6a/d84/db7/ff4 [0,4194304] 0 2024-08-31T05:21:33.159 INFO:tasks.workunit.client.0.smithi067.stdout:1/662: symlink d3/d23/d79/lf1 0 2024-08-31T05:21:33.163 INFO:tasks.workunit.client.0.smithi067.stdout:9/674: write dd/d63/da3/faa [1987572,14160] 0 2024-08-31T05:21:33.164 INFO:tasks.workunit.client.0.smithi067.stdout:5/577: dread db/f32 [0,4194304] 0 2024-08-31T05:21:33.165 INFO:tasks.workunit.client.0.smithi067.stdout:4/716: dread d4/d14/d48/d66/f70 [0,4194304] 0 2024-08-31T05:21:33.166 INFO:tasks.workunit.client.0.smithi067.stdout:3/937: truncate db/f53 198741 0 2024-08-31T05:21:33.169 INFO:tasks.workunit.client.0.smithi067.stdout:1/663: dread d3/d23/f3c [0,4194304] 0 2024-08-31T05:21:33.170 INFO:tasks.workunit.client.0.smithi067.stdout:6/832: creat d1b/d40/d70/f10c x:0 0 0 2024-08-31T05:21:33.171 INFO:tasks.workunit.client.0.smithi067.stdout:2/773: symlink db/d12/d1a/da3/ddc/lf7 0 2024-08-31T05:21:33.175 INFO:tasks.workunit.client.0.smithi067.stdout:4/717: dwrite d4/d42/f57 [0,4194304] 0 2024-08-31T05:21:33.176 INFO:tasks.workunit.client.0.smithi067.stdout:4/718: chown d4/da5/cb7 8376 1 2024-08-31T05:21:33.182 INFO:tasks.workunit.client.0.smithi067.stdout:5/578: truncate db/d15/d42/fa2 1048509 0 2024-08-31T05:21:33.184 INFO:tasks.workunit.client.0.smithi067.stdout:5/579: read db/d15/d53/f82 [473071,38350] 0 2024-08-31T05:21:33.185 INFO:tasks.workunit.client.0.smithi067.stdout:3/938: creat db/d2e/d50/d62/dc3/f130 x:0 0 0 2024-08-31T05:21:33.192 INFO:tasks.workunit.client.0.smithi067.stdout:8/741: getdents d0/d4/d64 0 2024-08-31T05:21:33.192 INFO:tasks.workunit.client.0.smithi067.stdout:0/841: dwrite d1/dd/d4d/d88/f89 [0,4194304] 0 2024-08-31T05:21:33.194 INFO:tasks.workunit.client.0.smithi067.stdout:4/719: symlink d4/d9/da2/lf2 0 2024-08-31T05:21:33.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:32 smithi073 ceph-mon[24726]: pgmap v37: 65 pgs: 65 active+clean; 2.3 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 38 MiB/s rd, 110 MiB/s wr, 277 op/s 2024-08-31T05:21:33.195 INFO:tasks.workunit.client.0.smithi067.stdout:9/675: write dd/df/d25/d3b/d50/d73/fc4 [1271358,16772] 0 2024-08-31T05:21:33.197 INFO:tasks.workunit.client.0.smithi067.stdout:9/676: fsync dd/df/d25/d3b/d50/fd7 0 2024-08-31T05:21:33.200 INFO:tasks.workunit.client.0.smithi067.stdout:1/664: mknod d3/d23/d2d/cf2 0 2024-08-31T05:21:33.206 INFO:tasks.workunit.client.0.smithi067.stdout:0/842: rmdir d1/df/d29/d86/db1 39 2024-08-31T05:21:33.207 INFO:tasks.workunit.client.0.smithi067.stdout:0/843: readlink d1/df/d17/l10c 0 2024-08-31T05:21:33.211 INFO:tasks.workunit.client.0.smithi067.stdout:5/580: write db/f88 [2762046,114954] 0 2024-08-31T05:21:33.211 INFO:tasks.workunit.client.0.smithi067.stdout:3/939: write db/d17/d3f/d54/fe2 [3107368,70860] 0 2024-08-31T05:21:33.215 INFO:tasks.workunit.client.0.smithi067.stdout:1/665: readlink d3/d23/d2d/d2e/d34/da3/lc0 0 2024-08-31T05:21:33.216 INFO:tasks.workunit.client.0.smithi067.stdout:6/833: rename d1b/d40/d70/dd0/d5e/f5f to d1b/d40/d96/f10d 0 2024-08-31T05:21:33.218 INFO:tasks.workunit.client.0.smithi067.stdout:8/742: dwrite d0/d4/de/f11 [0,4194304] 0 2024-08-31T05:21:33.219 INFO:tasks.workunit.client.0.smithi067.stdout:2/774: link db/d8c/dcd/df4/da0/fc5 db/dd/d13/ff8 0 2024-08-31T05:21:33.221 INFO:tasks.workunit.client.0.smithi067.stdout:2/775: dread - db/d12/d1a/da3/fde zero size 2024-08-31T05:21:33.225 INFO:tasks.workunit.client.0.smithi067.stdout:4/720: mknod d4/d1e/d62/dae/cf3 0 2024-08-31T05:21:33.225 INFO:tasks.workunit.client.0.smithi067.stdout:9/677: symlink dd/df/d25/d3b/d50/d73/le5 0 2024-08-31T05:21:33.226 INFO:tasks.workunit.client.0.smithi067.stdout:6/834: dwrite d1b/d40/d70/dd0/daa/fb8 [0,4194304] 0 2024-08-31T05:21:33.227 INFO:tasks.workunit.client.0.smithi067.stdout:4/721: write d4/d42/f8b [602762,122304] 0 2024-08-31T05:21:33.234 INFO:tasks.workunit.client.0.smithi067.stdout:3/940: dwrite db/d12/d21/dff/f113 [0,4194304] 0 2024-08-31T05:21:33.238 INFO:tasks.workunit.client.0.smithi067.stdout:2/776: unlink db/d12/d1a/d2b/l55 0 2024-08-31T05:21:33.240 INFO:tasks.workunit.client.0.smithi067.stdout:9/678: mknod dd/d4d/ce6 0 2024-08-31T05:21:33.240 INFO:tasks.workunit.client.0.smithi067.stdout:5/581: write db/d26/f9b [1317903,112888] 0 2024-08-31T05:21:33.241 INFO:tasks.workunit.client.0.smithi067.stdout:6/835: dread - d1b/d40/d96/db6/fe1 zero size 2024-08-31T05:21:33.242 INFO:tasks.workunit.client.0.smithi067.stdout:0/844: dwrite d1/df/d17/d43/d80/f9f [0,4194304] 0 2024-08-31T05:21:33.243 INFO:tasks.workunit.client.0.smithi067.stdout:4/722: symlink d4/d42/dd5/lf4 0 2024-08-31T05:21:33.244 INFO:tasks.workunit.client.0.smithi067.stdout:8/743: write d0/d4/de/df0/d73/d84/da6/db1/db3/fe4 [237274,1152] 0 2024-08-31T05:21:33.244 INFO:tasks.workunit.client.0.smithi067.stdout:4/723: read d4/d1e/f26 [2769998,129357] 0 2024-08-31T05:21:33.245 INFO:tasks.workunit.client.0.smithi067.stdout:3/941: symlink db/d17/d3f/d54/d56/l131 0 2024-08-31T05:21:33.247 INFO:tasks.workunit.client.0.smithi067.stdout:2/777: symlink db/d8c/lf9 0 2024-08-31T05:21:33.248 INFO:tasks.workunit.client.0.smithi067.stdout:9/679: unlink dd/df/d25/f6b 0 2024-08-31T05:21:33.249 INFO:tasks.workunit.client.0.smithi067.stdout:9/680: chown dd/df/d25/d3b/d50/f61 2 1 2024-08-31T05:21:33.254 INFO:tasks.workunit.client.0.smithi067.stdout:6/836: symlink d1b/d40/d96/db3/dff/l10e 0 2024-08-31T05:21:33.255 INFO:tasks.workunit.client.0.smithi067.stdout:5/582: read db/f25 [468487,17187] 0 2024-08-31T05:21:33.255 INFO:tasks.workunit.client.0.smithi067.stdout:6/837: chown d1b/d23/d28/l56 2 1 2024-08-31T05:21:33.255 INFO:tasks.workunit.client.0.smithi067.stdout:4/724: symlink d4/d9/db4/lf5 0 2024-08-31T05:21:33.257 INFO:tasks.workunit.client.0.smithi067.stdout:1/666: link d3/d23/d2d/d2e/d34/d66/d94/cac d3/d23/cf3 0 2024-08-31T05:21:33.258 INFO:tasks.workunit.client.0.smithi067.stdout:1/667: fsync d3/d23/d2d/d2e/d34/d66/de8/f7e 0 2024-08-31T05:21:33.259 INFO:tasks.workunit.client.0.smithi067.stdout:9/681: unlink dd/df/c4a 0 2024-08-31T05:21:33.260 INFO:tasks.workunit.client.0.smithi067.stdout:9/682: chown dd/f1e 3704 1 2024-08-31T05:21:33.261 INFO:tasks.workunit.client.0.smithi067.stdout:8/744: symlink d0/lf7 0 2024-08-31T05:21:33.262 INFO:tasks.workunit.client.0.smithi067.stdout:6/838: mknod d1b/d30/c10f 0 2024-08-31T05:21:33.264 INFO:tasks.workunit.client.0.smithi067.stdout:6/839: write d1b/d23/d2e/f51 [3742813,35437] 0 2024-08-31T05:21:33.264 INFO:tasks.workunit.client.0.smithi067.stdout:4/725: creat d4/d14/d48/d66/ff6 x:0 0 0 2024-08-31T05:21:33.271 INFO:tasks.workunit.client.0.smithi067.stdout:4/726: dwrite d4/d9/d5a/f74 [8388608,4194304] 0 2024-08-31T05:21:33.275 INFO:tasks.workunit.client.0.smithi067.stdout:9/683: creat dd/df/d8e/fe7 x:0 0 0 2024-08-31T05:21:33.280 INFO:tasks.workunit.client.0.smithi067.stdout:6/840: unlink d1b/d40/d96/db3/cd6 0 2024-08-31T05:21:33.285 INFO:tasks.workunit.client.0.smithi067.stdout:4/727: fdatasync d4/d9/f7e 0 2024-08-31T05:21:33.285 INFO:tasks.workunit.client.0.smithi067.stdout:3/942: dread db/d55/d97/dc4/dcb/dcc/fce [0,4194304] 0 2024-08-31T05:21:33.287 INFO:tasks.workunit.client.0.smithi067.stdout:2/778: dread db/f5b [0,4194304] 0 2024-08-31T05:21:33.289 INFO:tasks.workunit.client.0.smithi067.stdout:6/841: truncate d1b/d40/d96/db3/fb5 454674 0 2024-08-31T05:21:33.290 INFO:tasks.workunit.client.0.smithi067.stdout:4/728: creat d4/d9/db4/d83/ff7 x:0 0 0 2024-08-31T05:21:33.295 INFO:tasks.workunit.client.0.smithi067.stdout:1/668: getdents d3/d23/d2d/d2e/d34/d66/d72/d82 0 2024-08-31T05:21:33.295 INFO:tasks.workunit.client.0.smithi067.stdout:5/583: dwrite db/d15/d42/d36/d73/d77/f94 [0,4194304] 0 2024-08-31T05:21:33.297 INFO:tasks.workunit.client.0.smithi067.stdout:6/842: write d1b/d40/d70/dd0/da4/ffc [457725,112060] 0 2024-08-31T05:21:33.299 INFO:tasks.workunit.client.0.smithi067.stdout:8/745: truncate d0/d4/faa 1393836 0 2024-08-31T05:21:33.300 INFO:tasks.workunit.client.0.smithi067.stdout:3/943: mknod db/d12/d21/d82/d11f/c132 0 2024-08-31T05:21:33.301 INFO:tasks.workunit.client.0.smithi067.stdout:4/729: mkdir d4/d9/da2/df8 0 2024-08-31T05:21:33.303 INFO:tasks.workunit.client.0.smithi067.stdout:9/684: dwrite f6 [0,4194304] 0 2024-08-31T05:21:33.303 INFO:tasks.workunit.client.0.smithi067.stdout:2/779: creat db/d12/d1a/d2b/d3d/d69/ffa x:0 0 0 2024-08-31T05:21:33.305 INFO:tasks.workunit.client.0.smithi067.stdout:2/780: write db/d12/d1a/d1e/d4d/ff5 [467231,95186] 0 2024-08-31T05:21:33.306 INFO:tasks.workunit.client.0.smithi067.stdout:5/584: rename db/d26/d29/d31/d7a/dac to db/d26/d4c/db5 0 2024-08-31T05:21:33.309 INFO:tasks.workunit.client.0.smithi067.stdout:6/843: mkdir d1b/d40/d70/dd0/d5c/d110 0 2024-08-31T05:21:33.311 INFO:tasks.workunit.client.0.smithi067.stdout:8/746: mkdir d0/d4/de/df0/d73/d84/da6/db1/df8 0 2024-08-31T05:21:33.320 INFO:tasks.workunit.client.0.smithi067.stdout:2/781: write db/dd/d2d/da7/f6a [1590558,14493] 0 2024-08-31T05:21:33.321 INFO:tasks.workunit.client.0.smithi067.stdout:9/685: dwrite dd/df/d25/f5f [0,4194304] 0 2024-08-31T05:21:33.322 INFO:tasks.workunit.client.0.smithi067.stdout:2/782: chown db/d12/d1a/d2b/d3d/d69/dec 181 1 2024-08-31T05:21:33.325 INFO:tasks.workunit.client.0.smithi067.stdout:2/783: truncate db/d12/d1a/d1e/d4d/ff5 993213 0 2024-08-31T05:21:33.329 INFO:tasks.workunit.client.0.smithi067.stdout:1/669: write d3/d23/d2d/d2e/d34/f64 [683183,7228] 0 2024-08-31T05:21:33.330 INFO:tasks.workunit.client.0.smithi067.stdout:6/844: creat d1b/d40/d70/dd0/d5c/d110/f111 x:0 0 0 2024-08-31T05:21:33.332 INFO:tasks.workunit.client.0.smithi067.stdout:8/747: truncate d0/d2/f24 3061852 0 2024-08-31T05:21:33.335 INFO:tasks.workunit.client.0.smithi067.stdout:3/944: rename db/d91/ld7 to db/d2e/d6a/l133 0 2024-08-31T05:21:33.337 INFO:tasks.workunit.client.0.smithi067.stdout:3/945: write db/d4e/fe9 [6244,2913] 0 2024-08-31T05:21:33.340 INFO:tasks.workunit.client.0.smithi067.stdout:6/845: truncate d1b/d23/d2e/d3b/f95 3746451 0 2024-08-31T05:21:33.341 INFO:tasks.workunit.client.0.smithi067.stdout:6/846: fdatasync d1b/d40/d70/dd0/da4/ffc 0 2024-08-31T05:21:33.344 INFO:tasks.workunit.client.0.smithi067.stdout:4/730: getdents d4/d9/db4/d83/da9 0 2024-08-31T05:21:33.346 INFO:tasks.workunit.client.0.smithi067.stdout:3/946: dwrite db/d4e/fe9 [0,4194304] 0 2024-08-31T05:21:33.347 INFO:tasks.workunit.client.0.smithi067.stdout:4/731: stat d4/d14/d48/d66/ff6 0 2024-08-31T05:21:33.349 INFO:tasks.workunit.client.0.smithi067.stdout:1/670: write d3/d23/d2d/d2e/d34/d66/de8/f2c [4429763,122939] 0 2024-08-31T05:21:33.350 INFO:tasks.workunit.client.0.smithi067.stdout:5/585: rename db/d15/d42/d36/d73/da9/c6d to db/d26/d4c/db5/cb6 0 2024-08-31T05:21:33.350 INFO:tasks.workunit.client.0.smithi067.stdout:4/732: read d4/f76 [391803,106328] 0 2024-08-31T05:21:33.352 INFO:tasks.workunit.client.0.smithi067.stdout:4/733: write d4/d13/f1a [3515955,99417] 0 2024-08-31T05:21:33.354 INFO:tasks.workunit.client.0.smithi067.stdout:4/734: dread - d4/d9/db4/d83/da9/fc4 zero size 2024-08-31T05:21:33.355 INFO:tasks.workunit.client.0.smithi067.stdout:2/784: creat db/dd/d13/ffb x:0 0 0 2024-08-31T05:21:33.358 INFO:tasks.workunit.client.0.smithi067.stdout:8/748: dread d0/d2/da/dd/d1f/fdb [0,4194304] 0 2024-08-31T05:21:33.364 INFO:tasks.workunit.client.0.smithi067.stdout:1/671: mkdir d3/d8b/df4 0 2024-08-31T05:21:33.365 INFO:tasks.workunit.client.0.smithi067.stdout:5/586: write db/f32 [486600,91766] 0 2024-08-31T05:21:33.366 INFO:tasks.workunit.client.0.smithi067.stdout:4/735: fdatasync d4/d13/f79 0 2024-08-31T05:21:33.368 INFO:tasks.workunit.client.0.smithi067.stdout:2/785: chown db/d12/d1a/d2b/d40/d9b/da8/fea 4433 1 2024-08-31T05:21:33.369 INFO:tasks.workunit.client.0.smithi067.stdout:8/749: read d0/d4/faa [414538,71806] 0 2024-08-31T05:21:33.443 INFO:tasks.workunit.client.0.smithi067.stdout:8/750: write d0/d2/fe6 [4165965,23290] 0 2024-08-31T05:21:33.444 INFO:tasks.workunit.client.0.smithi067.stdout:3/947: getdents db/d2e/d6a/d12c 0 2024-08-31T05:21:33.445 INFO:tasks.workunit.client.0.smithi067.stdout:7/512: sync 2024-08-31T05:21:33.446 INFO:tasks.workunit.client.0.smithi067.stdout:6/847: dread d1b/d8e/f42 [4194304,4194304] 0 2024-08-31T05:21:33.446 INFO:tasks.workunit.client.0.smithi067.stdout:9/686: rename dd/df/d25/fbf to dd/df/d25/d3b/fe8 0 2024-08-31T05:21:33.447 INFO:tasks.workunit.client.0.smithi067.stdout:7/513: chown d14/d54/d5e 509588352 1 2024-08-31T05:21:33.448 INFO:tasks.workunit.client.0.smithi067.stdout:8/751: write d0/d4/de/df0/d73/d84/da6/db1/ff4 [995754,47501] 0 2024-08-31T05:21:33.448 INFO:tasks.workunit.client.0.smithi067.stdout:6/848: stat d1b/d40/d70/dd0/d5e/l7e 0 2024-08-31T05:21:33.490 INFO:tasks.workunit.client.0.smithi067.stdout:7/514: write d14/d16/f86 [403073,74951] 0 2024-08-31T05:21:33.491 INFO:tasks.workunit.client.0.smithi067.stdout:4/736: link d4/d13/f24 d4/d14/ff9 0 2024-08-31T05:21:33.491 INFO:tasks.workunit.client.0.smithi067.stdout:9/687: creat dd/df/d25/d3b/d50/fe9 x:0 0 0 2024-08-31T05:21:33.492 INFO:tasks.workunit.client.0.smithi067.stdout:8/752: readlink d0/d4/de/lb7 0 2024-08-31T05:21:33.494 INFO:tasks.workunit.client.0.smithi067.stdout:4/737: read d4/d42/f8b [372733,94107] 0 2024-08-31T05:21:33.494 INFO:tasks.workunit.client.0.smithi067.stdout:3/948: mknod db/d17/d3f/d54/ddf/dec/d124/c134 0 2024-08-31T05:21:33.496 INFO:tasks.workunit.client.0.smithi067.stdout:6/849: read f7 [526624,54609] 0 2024-08-31T05:21:33.498 INFO:tasks.workunit.client.0.smithi067.stdout:3/949: write db/d2e/d50/d4a/d110/f112 [908952,60702] 0 2024-08-31T05:21:33.499 INFO:tasks.workunit.client.0.smithi067.stdout:5/587: dwrite db/d15/d42/fa2 [0,4194304] 0 2024-08-31T05:21:33.501 INFO:tasks.workunit.client.0.smithi067.stdout:7/515: fsync d14/d16/d28/f35 0 2024-08-31T05:21:33.502 INFO:tasks.workunit.client.0.smithi067.stdout:3/950: write db/d12/d21/fbc [361678,13897] 0 2024-08-31T05:21:33.504 INFO:tasks.workunit.client.0.smithi067.stdout:4/738: mknod d4/d56/cfa 0 2024-08-31T05:21:33.506 INFO:tasks.workunit.client.0.smithi067.stdout:4/739: dread - d4/d32/d43/fcf zero size 2024-08-31T05:21:33.507 INFO:tasks.workunit.client.0.smithi067.stdout:4/740: fsync d4/d42/fcb 0 2024-08-31T05:21:33.512 INFO:tasks.workunit.client.0.smithi067.stdout:5/588: chown db/d26/d29/d81/l92 23729789 1 2024-08-31T05:21:33.513 INFO:tasks.workunit.client.0.smithi067.stdout:5/589: stat db/d15/d42/c93 0 2024-08-31T05:21:33.513 INFO:tasks.workunit.client.0.smithi067.stdout:4/741: dread d4/d32/d43/fdb [0,4194304] 0 2024-08-31T05:21:33.514 INFO:tasks.workunit.client.0.smithi067.stdout:4/742: chown d4/d9/db4/d83/da9/d60/f61 221 1 2024-08-31T05:21:33.515 INFO:tasks.workunit.client.0.smithi067.stdout:7/516: mkdir d14/d16/d5b/d64/d90 0 2024-08-31T05:21:33.516 INFO:tasks.workunit.client.0.smithi067.stdout:6/850: dread d1b/d8e/f42 [0,4194304] 0 2024-08-31T05:21:33.516 INFO:tasks.workunit.client.0.smithi067.stdout:9/688: truncate dd/df/d25/d3b/d50/d73/fb2 895024 0 2024-08-31T05:21:33.517 INFO:tasks.workunit.client.0.smithi067.stdout:7/517: write d14/d16/f60 [2184843,70122] 0 2024-08-31T05:21:33.519 INFO:tasks.workunit.client.0.smithi067.stdout:8/753: creat d0/d2/dc/ff9 x:0 0 0 2024-08-31T05:21:33.522 INFO:tasks.workunit.client.0.smithi067.stdout:8/754: write d0/d4/de/f77 [214059,11762] 0 2024-08-31T05:21:33.523 INFO:tasks.workunit.client.0.smithi067.stdout:9/689: mkdir dd/df/d5b/d5d/dea 0 2024-08-31T05:21:33.524 INFO:tasks.workunit.client.0.smithi067.stdout:6/851: mknod d1b/d40/d96/db6/c112 0 2024-08-31T05:21:33.526 INFO:tasks.workunit.client.0.smithi067.stdout:9/690: chown dd/df/d25/d3b/ca0 1452337 1 2024-08-31T05:21:33.526 INFO:tasks.workunit.client.0.smithi067.stdout:7/518: dwrite d14/d54/d5e/d67/f6d [0,4194304] 0 2024-08-31T05:21:33.527 INFO:tasks.workunit.client.0.smithi067.stdout:6/852: chown d1b/d8e/d62/c68 20 1 2024-08-31T05:21:33.528 INFO:tasks.workunit.client.0.smithi067.stdout:5/590: truncate db/f49 74090 0 2024-08-31T05:21:33.532 INFO:tasks.workunit.client.0.smithi067.stdout:3/951: dread db/d2e/d50/d62/d85/f106 [4194304,4194304] 0 2024-08-31T05:21:33.534 INFO:tasks.workunit.client.0.smithi067.stdout:4/743: write d4/f10 [4900667,55019] 0 2024-08-31T05:21:33.539 INFO:tasks.workunit.client.0.smithi067.stdout:9/691: creat dd/d4d/dca/feb x:0 0 0 2024-08-31T05:21:33.541 INFO:tasks.workunit.client.0.smithi067.stdout:5/591: symlink db/d15/d59/lb7 0 2024-08-31T05:21:33.542 INFO:tasks.workunit.client.0.smithi067.stdout:5/592: chown db/d26/d4c 1 1 2024-08-31T05:21:33.544 INFO:tasks.workunit.client.0.smithi067.stdout:5/593: write db/d1d/f78 [2554415,63702] 0 2024-08-31T05:21:33.545 INFO:tasks.workunit.client.0.smithi067.stdout:4/744: chown d4/d9/db4/d83/da9/d60/fa8 1581645204 1 2024-08-31T05:21:33.546 INFO:tasks.workunit.client.0.smithi067.stdout:9/692: mknod dd/df/d3c/cec 0 2024-08-31T05:21:33.549 INFO:tasks.workunit.client.0.smithi067.stdout:9/693: dread - dd/df/d8e/fe7 zero size 2024-08-31T05:21:33.551 INFO:tasks.workunit.client.0.smithi067.stdout:7/519: dwrite d14/f20 [0,4194304] 0 2024-08-31T05:21:33.551 INFO:tasks.workunit.client.0.smithi067.stdout:4/745: creat d4/d32/d4c/db3/ffb x:0 0 0 2024-08-31T05:21:33.552 INFO:tasks.workunit.client.0.smithi067.stdout:6/853: dread d1b/d40/f83 [0,4194304] 0 2024-08-31T05:21:33.554 INFO:tasks.workunit.client.0.smithi067.stdout:4/746: truncate d4/d9/da4/fee 831103 0 2024-08-31T05:21:33.554 INFO:tasks.workunit.client.0.smithi067.stdout:8/755: getdents d0/d4/de/df0/d73/de9 0 2024-08-31T05:21:33.555 INFO:tasks.workunit.client.0.smithi067.stdout:6/854: write d1b/d40/de8/ff5 [1181034,88829] 0 2024-08-31T05:21:33.560 INFO:tasks.workunit.client.0.smithi067.stdout:3/952: write db/ff7 [221584,90158] 0 2024-08-31T05:21:33.562 INFO:tasks.workunit.client.0.smithi067.stdout:7/520: dwrite d14/f20 [4194304,4194304] 0 2024-08-31T05:21:33.562 INFO:tasks.workunit.client.0.smithi067.stdout:7/521: chown d14/d54/d5e/c79 0 1 2024-08-31T05:21:33.564 INFO:tasks.workunit.client.0.smithi067.stdout:7/522: dread - d14/d16/d5b/f5c zero size 2024-08-31T05:21:33.568 INFO:tasks.workunit.client.0.smithi067.stdout:5/594: write db/d26/d29/d31/f6e [525978,110880] 0 2024-08-31T05:21:33.569 INFO:tasks.workunit.client.0.smithi067.stdout:4/747: mknod d4/d32/d4c/cfc 0 2024-08-31T05:21:33.572 INFO:tasks.workunit.client.0.smithi067.stdout:8/756: rename d0/d2/dc/d3d/f67 to d0/d2/da/ffa 0 2024-08-31T05:21:33.577 INFO:tasks.workunit.client.0.smithi067.stdout:6/855: mknod d1b/d40/d70/dd0/d5c/d107/c113 0 2024-08-31T05:21:33.578 INFO:tasks.workunit.client.0.smithi067.stdout:4/748: rename d4/d9/db4/lf5 to d4/d1e/dea/lfd 0 2024-08-31T05:21:33.579 INFO:tasks.workunit.client.0.smithi067.stdout:8/757: readlink d0/d4/de/d1d/d7b/la0 0 2024-08-31T05:21:33.579 INFO:tasks.workunit.client.0.smithi067.stdout:4/749: chown d4/d9/c11 24752 1 2024-08-31T05:21:33.580 INFO:tasks.workunit.client.0.smithi067.stdout:4/750: dread - d4/d56/fa7 zero size 2024-08-31T05:21:33.583 INFO:tasks.workunit.client.0.smithi067.stdout:6/856: chown d1b/d23/d28/lf6 0 1 2024-08-31T05:21:33.585 INFO:tasks.workunit.client.0.smithi067.stdout:8/758: symlink d0/d2/da9/lfb 0 2024-08-31T05:21:33.586 INFO:tasks.workunit.client.0.smithi067.stdout:9/694: getdents dd/df/d5b 0 2024-08-31T05:21:33.586 INFO:tasks.workunit.client.0.smithi067.stdout:9/695: stat dd/df/db5 0 2024-08-31T05:21:33.588 INFO:tasks.workunit.client.0.smithi067.stdout:4/751: mkdir d4/d9/d5a/dfe 0 2024-08-31T05:21:33.589 INFO:tasks.workunit.client.0.smithi067.stdout:3/953: write db/d55/d97/dc4/fcd [2191521,104927] 0 2024-08-31T05:21:33.589 INFO:tasks.workunit.client.0.smithi067.stdout:5/595: write db/f49 [693444,28596] 0 2024-08-31T05:21:33.592 INFO:tasks.workunit.client.0.smithi067.stdout:6/857: mkdir d1b/d40/d70/d71/d114 0 2024-08-31T05:21:33.594 INFO:tasks.workunit.client.0.smithi067.stdout:4/752: truncate d4/d32/d43/fdb 2159480 0 2024-08-31T05:21:33.594 INFO:tasks.workunit.client.0.smithi067.stdout:6/858: truncate d1b/d40/d96/db3/dff/f106 951231 0 2024-08-31T05:21:33.596 INFO:tasks.workunit.client.0.smithi067.stdout:9/696: truncate dd/d63/da3/fc0 1029307 0 2024-08-31T05:21:33.598 INFO:tasks.workunit.client.0.smithi067.stdout:3/954: write db/f3d [3805935,89455] 0 2024-08-31T05:21:33.600 INFO:tasks.workunit.client.0.smithi067.stdout:5/596: mknod db/d26/d29/d31/d54/d66/d96/cb8 0 2024-08-31T05:21:33.601 INFO:tasks.workunit.client.0.smithi067.stdout:5/597: write db/d1d/f78 [2852834,120659] 0 2024-08-31T05:21:33.602 INFO:tasks.workunit.client.0.smithi067.stdout:6/859: rmdir d1b/d8e 39 2024-08-31T05:21:33.603 INFO:tasks.workunit.client.0.smithi067.stdout:4/753: mkdir d4/da5/dff 0 2024-08-31T05:21:33.605 INFO:tasks.workunit.client.0.smithi067.stdout:8/759: link d0/d4/de/d1d/c72 d0/d4/cfc 0 2024-08-31T05:21:33.606 INFO:tasks.workunit.client.0.smithi067.stdout:3/955: fdatasync db/d17/d3f/f7f 0 2024-08-31T05:21:33.607 INFO:tasks.workunit.client.0.smithi067.stdout:3/956: chown db/d17/d3f/d54/ddf/ce7 248450752 1 2024-08-31T05:21:33.609 INFO:tasks.workunit.client.0.smithi067.stdout:5/598: fdatasync db/d15/d59/f84 0 2024-08-31T05:21:33.612 INFO:tasks.workunit.client.0.smithi067.stdout:6/860: symlink d1b/d40/d70/dd0/d5c/d107/l115 0 2024-08-31T05:21:33.612 INFO:tasks.workunit.client.0.smithi067.stdout:4/754: creat d4/d9/db4/d83/da9/f100 x:0 0 0 2024-08-31T05:21:33.614 INFO:tasks.workunit.client.0.smithi067.stdout:9/697: unlink dd/df/d25/d3b/d50/d73/cc1 0 2024-08-31T05:21:33.620 INFO:tasks.workunit.client.0.smithi067.stdout:8/760: mkdir d0/d2/dc/d28/dda/dfd 0 2024-08-31T05:21:33.621 INFO:tasks.workunit.client.0.smithi067.stdout:5/599: mkdir db/d26/db9 0 2024-08-31T05:21:33.627 INFO:tasks.workunit.client.0.smithi067.stdout:8/761: unlink d0/d2/dc/d28/fdf 0 2024-08-31T05:21:33.636 INFO:tasks.workunit.client.0.smithi067.stdout:9/698: getdents dd/d20 0 2024-08-31T05:21:33.640 INFO:tasks.workunit.client.0.smithi067.stdout:9/699: stat dd/df/d25/d3b/d50/d73/fb1 0 2024-08-31T05:21:33.640 INFO:tasks.workunit.client.0.smithi067.stdout:8/762: link d0/d4/de/df0/d73/d84/da6/db1/d8c/f9b d0/d4/d64/ffe 0 2024-08-31T05:21:33.642 INFO:tasks.workunit.client.0.smithi067.stdout:5/600: dwrite db/d26/d29/d31/d54/d8c/f9e [0,4194304] 0 2024-08-31T05:21:33.643 INFO:tasks.workunit.client.0.smithi067.stdout:9/700: fdatasync dd/d63/d72/fab 0 2024-08-31T05:21:33.645 INFO:tasks.workunit.client.0.smithi067.stdout:8/763: write d0/d4/f7d [3416752,99595] 0 2024-08-31T05:21:33.647 INFO:tasks.workunit.client.0.smithi067.stdout:4/755: dwrite d4/d32/d43/fdb [0,4194304] 0 2024-08-31T05:21:33.649 INFO:tasks.workunit.client.0.smithi067.stdout:4/756: write d4/d32/d43/fdb [4625032,39753] 0 2024-08-31T05:21:33.650 INFO:tasks.workunit.client.0.smithi067.stdout:5/601: dread - db/d15/d42/d36/d73/da9/fa4 zero size 2024-08-31T05:21:33.652 INFO:tasks.workunit.client.0.smithi067.stdout:9/701: symlink dd/df/d3c/dbe/dd4/led 0 2024-08-31T05:21:33.655 INFO:tasks.workunit.client.0.smithi067.stdout:8/764: creat d0/d4/de/df0/d73/de9/da5/dc7/fff x:0 0 0 2024-08-31T05:21:33.657 INFO:tasks.workunit.client.0.smithi067.stdout:5/602: dread db/f49 [0,4194304] 0 2024-08-31T05:21:33.660 INFO:tasks.workunit.client.0.smithi067.stdout:9/702: dread dd/df/f23 [0,4194304] 0 2024-08-31T05:21:33.661 INFO:tasks.workunit.client.0.smithi067.stdout:4/757: dwrite d4/d9/db4/fcc [0,4194304] 0 2024-08-31T05:21:33.661 INFO:tasks.workunit.client.0.smithi067.stdout:8/765: symlink d0/d2/dc/d28/l100 0 2024-08-31T05:21:33.663 INFO:tasks.workunit.client.0.smithi067.stdout:9/703: dread - dd/df/d5b/d5d/f89 zero size 2024-08-31T05:21:33.664 INFO:tasks.workunit.client.0.smithi067.stdout:4/758: read d4/d9/fa [8447006,67481] 0 2024-08-31T05:21:33.665 INFO:tasks.workunit.client.0.smithi067.stdout:5/603: symlink db/d26/d29/d31/d8d/d9f/lba 0 2024-08-31T05:21:33.667 INFO:tasks.workunit.client.0.smithi067.stdout:8/766: mkdir d0/d4/de/df0/d73/de9/da5/dc7/d101 0 2024-08-31T05:21:33.669 INFO:tasks.workunit.client.0.smithi067.stdout:8/767: write d0/d2/dc/f49 [3265339,61522] 0 2024-08-31T05:21:33.669 INFO:tasks.workunit.client.0.smithi067.stdout:4/759: creat d4/d42/dd5/f101 x:0 0 0 2024-08-31T05:21:33.670 INFO:tasks.workunit.client.0.smithi067.stdout:8/768: stat d0/d4/ccd 0 2024-08-31T05:21:33.670 INFO:tasks.workunit.client.0.smithi067.stdout:4/760: fsync d4/d32/d4c/db3/fce 0 2024-08-31T05:21:33.671 INFO:tasks.workunit.client.0.smithi067.stdout:5/604: fdatasync db/f49 0 2024-08-31T05:21:33.672 INFO:tasks.workunit.client.0.smithi067.stdout:8/769: write d0/d4/de/d1d/d2c/d68/de3/fea [915485,38686] 0 2024-08-31T05:21:33.677 INFO:tasks.workunit.client.0.smithi067.stdout:4/761: creat d4/d1e/d92/db0/f102 x:0 0 0 2024-08-31T05:21:33.679 INFO:tasks.workunit.client.0.smithi067.stdout:4/762: dread d4/d9/d5a/faa [0,4194304] 0 2024-08-31T05:21:33.681 INFO:tasks.workunit.client.0.smithi067.stdout:4/763: symlink d4/d9/db4/l103 0 2024-08-31T05:21:33.687 INFO:tasks.workunit.client.0.smithi067.stdout:5/605: dread db/f46 [0,4194304] 0 2024-08-31T05:21:33.691 INFO:tasks.workunit.client.0.smithi067.stdout:8/770: dwrite d0/d2/dc/d3d/fbe [0,4194304] 0 2024-08-31T05:21:33.691 INFO:tasks.workunit.client.0.smithi067.stdout:5/606: creat db/d15/d42/d36/d73/daf/fbb x:0 0 0 2024-08-31T05:21:33.695 INFO:tasks.workunit.client.0.smithi067.stdout:5/607: symlink db/d15/d42/d36/d73/da9/lbc 0 2024-08-31T05:21:33.697 INFO:tasks.workunit.client.0.smithi067.stdout:4/764: dwrite d4/d1e/d53/f93 [0,4194304] 0 2024-08-31T05:21:33.699 INFO:tasks.workunit.client.0.smithi067.stdout:4/765: mknod d4/d9/d4b/c104 0 2024-08-31T05:21:33.699 INFO:tasks.workunit.client.0.smithi067.stdout:8/771: dread d0/d4/de/d1d/f60 [0,4194304] 0 2024-08-31T05:21:33.700 INFO:tasks.workunit.client.0.smithi067.stdout:5/608: truncate db/d15/d42/d36/d73/da9/fa4 470505 0 2024-08-31T05:21:33.703 INFO:tasks.workunit.client.0.smithi067.stdout:8/772: creat d0/d4/de/d1d/f102 x:0 0 0 2024-08-31T05:21:33.706 INFO:tasks.workunit.client.0.smithi067.stdout:8/773: write d0/d4/de/df0/d73/d84/da6/fd3 [884474,78083] 0 2024-08-31T05:21:33.706 INFO:tasks.workunit.client.0.smithi067.stdout:4/766: link d4/l18 d4/d9/d5a/dfe/l105 0 2024-08-31T05:21:33.711 INFO:tasks.workunit.client.0.smithi067.stdout:4/767: chown d4/d14/l2f 62 1 2024-08-31T05:21:33.714 INFO:tasks.workunit.client.0.smithi067.stdout:4/768: mkdir d4/d56/d106 0 2024-08-31T05:21:33.714 INFO:tasks.workunit.client.0.smithi067.stdout:8/774: dwrite d0/d4/de/d1d/d7b/d89/fcc [0,4194304] 0 2024-08-31T05:21:33.716 INFO:tasks.workunit.client.0.smithi067.stdout:4/769: symlink d4/d42/dd5/l107 0 2024-08-31T05:21:33.718 INFO:tasks.workunit.client.0.smithi067.stdout:8/775: unlink d0/d2/f38 0 2024-08-31T05:21:33.720 INFO:tasks.workunit.client.0.smithi067.stdout:8/776: unlink d0/d2/da/ffa 0 2024-08-31T05:21:33.727 INFO:tasks.workunit.client.0.smithi067.stdout:4/770: dread d4/d1f/f44 [0,4194304] 0 2024-08-31T05:21:33.730 INFO:tasks.workunit.client.0.smithi067.stdout:4/771: creat d4/d9/d4b/f108 x:0 0 0 2024-08-31T05:21:33.737 INFO:tasks.workunit.client.0.smithi067.stdout:4/772: dwrite d4/d13/f1a [0,4194304] 0 2024-08-31T05:21:33.737 INFO:tasks.workunit.client.0.smithi067.stdout:5/609: dread db/d26/f45 [0,4194304] 0 2024-08-31T05:21:33.741 INFO:tasks.workunit.client.0.smithi067.stdout:8/777: dwrite d0/d4/de/df0/d73/de9/f76 [0,4194304] 0 2024-08-31T05:21:33.743 INFO:tasks.workunit.client.0.smithi067.stdout:8/778: stat d0/d2/dc/d3d/de5 0 2024-08-31T05:21:33.747 INFO:tasks.workunit.client.0.smithi067.stdout:4/773: mknod d4/d1e/d53/c109 0 2024-08-31T05:21:33.748 INFO:tasks.workunit.client.0.smithi067.stdout:4/774: chown d4/d9/db4/l103 1829 1 2024-08-31T05:21:33.749 INFO:tasks.workunit.client.0.smithi067.stdout:4/775: stat d4/d9/d5a/f74 0 2024-08-31T05:21:33.749 INFO:tasks.workunit.client.0.smithi067.stdout:8/779: chown d0/d2/f24 161946894 1 2024-08-31T05:21:33.751 INFO:tasks.workunit.client.0.smithi067.stdout:8/780: write d0/d4/de/d1d/d7b/feb [310605,59563] 0 2024-08-31T05:21:33.756 INFO:tasks.workunit.client.0.smithi067.stdout:4/776: dwrite d4/d13/f79 [0,4194304] 0 2024-08-31T05:21:33.757 INFO:tasks.workunit.client.0.smithi067.stdout:8/781: mkdir d0/d4/de/df0/d73/d103 0 2024-08-31T05:21:33.758 INFO:tasks.workunit.client.0.smithi067.stdout:4/777: chown d4/d14/d48/f6e 9378 1 2024-08-31T05:21:33.759 INFO:tasks.workunit.client.0.smithi067.stdout:8/782: chown d0/d2/dc/d28/l100 504 1 2024-08-31T05:21:33.760 INFO:tasks.workunit.client.0.smithi067.stdout:4/778: mknod d4/d14/c10a 0 2024-08-31T05:21:33.761 INFO:tasks.workunit.client.0.smithi067.stdout:4/779: stat d4/d13/l3b 0 2024-08-31T05:21:33.769 INFO:tasks.workunit.client.0.smithi067.stdout:8/783: rename d0/d2/dc/d28/db4/lde to d0/d4/de/df0/d73/d84/da6/db1/df8/l104 0 2024-08-31T05:21:33.771 INFO:tasks.workunit.client.0.smithi067.stdout:4/780: dwrite d4/d14/d48/d66/f70 [0,4194304] 0 2024-08-31T05:21:33.773 INFO:tasks.workunit.client.0.smithi067.stdout:8/784: mkdir d0/d2/dc/d28/d105 0 2024-08-31T05:21:33.775 INFO:tasks.workunit.client.0.smithi067.stdout:5/610: truncate db/d1d/f2d 1342054 0 2024-08-31T05:21:33.776 INFO:tasks.workunit.client.0.smithi067.stdout:8/785: rmdir d0/d4a 39 2024-08-31T05:21:33.778 INFO:tasks.workunit.client.0.smithi067.stdout:5/611: mknod db/d1d/d4f/da8/cbd 0 2024-08-31T05:21:33.779 INFO:tasks.workunit.client.0.smithi067.stdout:4/781: dwrite d4/d9/d4b/f86 [0,4194304] 0 2024-08-31T05:21:33.779 INFO:tasks.workunit.client.0.smithi067.stdout:5/612: readlink db/d26/d29/l3c 0 2024-08-31T05:21:33.783 INFO:tasks.workunit.client.0.smithi067.stdout:5/613: creat db/d26/d29/d31/fbe x:0 0 0 2024-08-31T05:21:33.787 INFO:tasks.workunit.client.0.smithi067.stdout:8/786: dwrite d0/d2/da/fc5 [4194304,4194304] 0 2024-08-31T05:21:33.797 INFO:tasks.workunit.client.0.smithi067.stdout:4/782: dread d4/d32/d4c/f90 [0,4194304] 0 2024-08-31T05:21:33.798 INFO:tasks.workunit.client.0.smithi067.stdout:4/783: truncate d4/d42/fcb 203343 0 2024-08-31T05:21:33.815 INFO:tasks.workunit.client.0.smithi067.stdout:8/787: dread d0/d4/de/df0/d73/de9/fd0 [0,4194304] 0 2024-08-31T05:21:33.823 INFO:tasks.workunit.client.0.smithi067.stdout:0/845: sync 2024-08-31T05:21:33.830 INFO:tasks.workunit.client.0.smithi067.stdout:5/614: getdents db/d26/d29/d31 0 2024-08-31T05:21:33.831 INFO:tasks.workunit.client.0.smithi067.stdout:5/615: chown db/d26/d4c 2437 1 2024-08-31T05:21:33.832 INFO:tasks.workunit.client.0.smithi067.stdout:8/788: getdents d0/d4/de/df0/d73/d84 0 2024-08-31T05:21:33.833 INFO:tasks.workunit.client.0.smithi067.stdout:8/789: dread - d0/d4/de/d1d/d7b/fdc zero size 2024-08-31T05:21:33.836 INFO:tasks.workunit.client.0.smithi067.stdout:0/846: read d1/df/d17/d94/fbd [1315859,37628] 0 2024-08-31T05:21:33.839 INFO:tasks.workunit.client.0.smithi067.stdout:8/790: rename d0/d4/de/ced to d0/d2/dc/d3d/d52/d6b/c106 0 2024-08-31T05:21:33.840 INFO:tasks.workunit.client.0.smithi067.stdout:5/616: creat db/d15/d42/d36/d73/fbf x:0 0 0 2024-08-31T05:21:33.841 INFO:tasks.workunit.client.0.smithi067.stdout:0/847: mkdir d1/df/d17/d94/d10f 0 2024-08-31T05:21:33.846 INFO:tasks.workunit.client.0.smithi067.stdout:8/791: symlink d0/d4a/l107 0 2024-08-31T05:21:33.849 INFO:tasks.workunit.client.0.smithi067.stdout:5/617: dwrite db/f32 [0,4194304] 0 2024-08-31T05:21:33.853 INFO:tasks.workunit.client.0.smithi067.stdout:8/792: mknod d0/d4/de/df0/c108 0 2024-08-31T05:21:33.854 INFO:tasks.workunit.client.0.smithi067.stdout:8/793: write d0/d2/f83 [1454616,67788] 0 2024-08-31T05:21:33.859 INFO:tasks.workunit.client.0.smithi067.stdout:8/794: truncate d0/d2/dc/d28/f81 2294198 0 2024-08-31T05:21:33.860 INFO:tasks.workunit.client.0.smithi067.stdout:4/784: write d4/d9/db4/d83/da9/d60/fa8 [2279905,86655] 0 2024-08-31T05:21:33.860 INFO:tasks.workunit.client.0.smithi067.stdout:8/795: readlink d0/d2/da/dd/d1f/l47 0 2024-08-31T05:21:33.862 INFO:tasks.workunit.client.0.smithi067.stdout:4/785: write d4/d32/d4c/db3/ffb [637734,103699] 0 2024-08-31T05:21:33.863 INFO:tasks.workunit.client.0.smithi067.stdout:8/796: symlink d0/d2/dc/d3d/d98/l109 0 2024-08-31T05:21:33.864 INFO:tasks.workunit.client.0.smithi067.stdout:8/797: chown d0/d4/de/c36 12 1 2024-08-31T05:21:33.868 INFO:tasks.workunit.client.0.smithi067.stdout:8/798: symlink d0/d2/dc/d28/dda/l10a 0 2024-08-31T05:21:33.870 INFO:tasks.workunit.client.0.smithi067.stdout:4/786: mknod d4/da5/dff/c10b 0 2024-08-31T05:21:33.881 INFO:tasks.workunit.client.0.smithi067.stdout:0/848: write d1/df/d17/d94/f9e [3656042,70162] 0 2024-08-31T05:21:33.886 INFO:tasks.workunit.client.0.smithi067.stdout:8/799: rename d0/d2/da/le8 to d0/d4/de/d1d/d2c/l10b 0 2024-08-31T05:21:33.886 INFO:tasks.workunit.client.0.smithi067.stdout:5/618: write db/d26/f62 [832986,7452] 0 2024-08-31T05:21:33.887 INFO:tasks.workunit.client.0.smithi067.stdout:8/800: chown d0/d2/dc/d3d/de5/lee 130041506 1 2024-08-31T05:21:33.889 INFO:tasks.workunit.client.0.smithi067.stdout:0/849: rename d1/dd/d18/d52/c59 to d1/df/d29/c110 0 2024-08-31T05:21:33.892 INFO:tasks.workunit.client.0.smithi067.stdout:4/787: truncate d4/f10 700568 0 2024-08-31T05:21:33.894 INFO:tasks.workunit.client.0.smithi067.stdout:0/850: rmdir d1/df/d17/d43/d48/d6a/dfd 39 2024-08-31T05:21:33.895 INFO:tasks.workunit.client.0.smithi067.stdout:0/851: chown d1/dd/d4d/lbb 287 1 2024-08-31T05:21:33.896 INFO:tasks.workunit.client.0.smithi067.stdout:8/801: mkdir d0/d4/de/df0/d73/de9/da5/dc7/d101/d10c 0 2024-08-31T05:21:33.897 INFO:tasks.workunit.client.0.smithi067.stdout:4/788: mkdir d4/d56/d10c 0 2024-08-31T05:21:33.898 INFO:tasks.workunit.client.0.smithi067.stdout:4/789: chown d4/d1e/d53/d81 0 1 2024-08-31T05:21:33.903 INFO:tasks.workunit.client.0.smithi067.stdout:5/619: truncate db/f32 3445821 0 2024-08-31T05:21:33.906 INFO:tasks.workunit.client.0.smithi067.stdout:0/852: rename d1/l31 to d1/d8/d42/l111 0 2024-08-31T05:21:33.909 INFO:tasks.workunit.client.0.smithi067.stdout:4/790: creat d4/d9/d5a/dfe/f10d x:0 0 0 2024-08-31T05:21:33.912 INFO:tasks.workunit.client.0.smithi067.stdout:8/802: write d0/d4/de/d1d/f94 [1647314,65354] 0 2024-08-31T05:21:33.913 INFO:tasks.workunit.client.0.smithi067.stdout:8/803: fdatasync d0/d2/dc/ff9 0 2024-08-31T05:21:33.914 INFO:tasks.workunit.client.0.smithi067.stdout:5/620: mknod db/d26/d29/cc0 0 2024-08-31T05:21:33.914 INFO:tasks.workunit.client.0.smithi067.stdout:5/621: stat db/d26/f9b 0 2024-08-31T05:21:33.916 INFO:tasks.workunit.client.0.smithi067.stdout:4/791: mkdir d4/d1e/d92/db0/d10e 0 2024-08-31T05:21:33.920 INFO:tasks.workunit.client.0.smithi067.stdout:0/853: stat d1/d8/d42/d98/c103 0 2024-08-31T05:21:33.923 INFO:tasks.workunit.client.0.smithi067.stdout:0/854: creat d1/dd/d4d/f112 x:0 0 0 2024-08-31T05:21:33.924 INFO:tasks.workunit.client.0.smithi067.stdout:4/792: rmdir d4/d56/d10c 0 2024-08-31T05:21:33.925 INFO:tasks.workunit.client.0.smithi067.stdout:5/622: getdents db/d26/d29/d81 0 2024-08-31T05:21:33.927 INFO:tasks.workunit.client.0.smithi067.stdout:4/793: rename d4/d1e/d62/dae/fb2 to d4/d9/da2/df8/f10f 0 2024-08-31T05:21:33.929 INFO:tasks.workunit.client.0.smithi067.stdout:8/804: dread d0/d4/f71 [0,4194304] 0 2024-08-31T05:21:33.930 INFO:tasks.workunit.client.0.smithi067.stdout:8/805: chown d0/d4/de/l44 13214 1 2024-08-31T05:21:33.933 INFO:tasks.workunit.client.0.smithi067.stdout:5/623: creat db/d15/fc1 x:0 0 0 2024-08-31T05:21:33.933 INFO:tasks.workunit.client.0.smithi067.stdout:0/855: write d1/d8/f16 [4102235,94937] 0 2024-08-31T05:21:33.935 INFO:tasks.workunit.client.0.smithi067.stdout:4/794: dwrite d4/d32/d43/ff0 [0,4194304] 0 2024-08-31T05:21:33.936 INFO:tasks.workunit.client.0.smithi067.stdout:4/795: stat d4/d1f/db9 0 2024-08-31T05:21:33.939 INFO:tasks.workunit.client.0.smithi067.stdout:0/856: rename d1/dd/d4d/d88 to d1/df/d17/d43/d80/d113 0 2024-08-31T05:21:33.942 INFO:tasks.workunit.client.0.smithi067.stdout:0/857: unlink d1/dd/d4d/l63 0 2024-08-31T05:21:33.943 INFO:tasks.workunit.client.0.smithi067.stdout:4/796: creat d4/d1f/d9e/f110 x:0 0 0 2024-08-31T05:21:33.944 INFO:tasks.workunit.client.0.smithi067.stdout:8/806: link d0/d4/de/df0/da3/lca d0/d4/de/df0/d73/d84/da6/db1/d8c/l10d 0 2024-08-31T05:21:33.945 INFO:tasks.workunit.client.0.smithi067.stdout:8/807: write d0/d2/fae [789787,123789] 0 2024-08-31T05:21:33.946 INFO:tasks.workunit.client.0.smithi067.stdout:4/797: creat d4/d1e/d6d/f111 x:0 0 0 2024-08-31T05:21:33.949 INFO:tasks.workunit.client.0.smithi067.stdout:0/858: mknod d1/df/d17/d43/d80/d113/c114 0 2024-08-31T05:21:33.954 INFO:tasks.workunit.client.0.smithi067.stdout:8/808: dwrite d0/d2/f6c [0,4194304] 0 2024-08-31T05:21:33.955 INFO:tasks.workunit.client.0.smithi067.stdout:0/859: mknod d1/df/d17/d43/d48/d6a/dfd/c115 0 2024-08-31T05:21:33.965 INFO:tasks.workunit.client.0.smithi067.stdout:0/860: dread d1/dd/d18/f9a [0,4194304] 0 2024-08-31T05:21:33.966 INFO:tasks.workunit.client.0.smithi067.stdout:8/809: dread d0/d4/faa [0,4194304] 0 2024-08-31T05:21:33.968 INFO:tasks.workunit.client.0.smithi067.stdout:0/861: symlink d1/df/l116 0 2024-08-31T05:21:33.968 INFO:tasks.workunit.client.0.smithi067.stdout:4/798: truncate d4/d9/d4b/f86 3322657 0 2024-08-31T05:21:33.968 INFO:tasks.workunit.client.0.smithi067.stdout:8/810: write d0/d4/de/df0/d73/d84/da6/db1/db3/fe4 [821318,6459] 0 2024-08-31T05:21:33.970 INFO:tasks.workunit.client.0.smithi067.stdout:4/799: fdatasync d4/d14/f4a 0 2024-08-31T05:21:33.970 INFO:tasks.workunit.client.0.smithi067.stdout:0/862: dread - d1/d8/ff0 zero size 2024-08-31T05:21:33.973 INFO:tasks.workunit.client.0.smithi067.stdout:8/811: rmdir d0/d2/dc/d3d/d98 39 2024-08-31T05:21:33.975 INFO:tasks.workunit.client.0.smithi067.stdout:4/800: dread d4/d9/f7e [0,4194304] 0 2024-08-31T05:21:33.975 INFO:tasks.workunit.client.0.smithi067.stdout:0/863: mkdir d1/dd5/dff/d117 0 2024-08-31T05:21:33.977 INFO:tasks.workunit.client.0.smithi067.stdout:8/812: creat d0/d2/dc/d3d/de5/f10e x:0 0 0 2024-08-31T05:21:33.979 INFO:tasks.workunit.client.0.smithi067.stdout:4/801: mknod d4/d42/de3/c112 0 2024-08-31T05:21:33.981 INFO:tasks.workunit.client.0.smithi067.stdout:8/813: creat d0/d2/dc/d3d/de5/f10f x:0 0 0 2024-08-31T05:21:33.981 INFO:tasks.workunit.client.0.smithi067.stdout:4/802: truncate d4/d32/d4c/db3/ffb 1404677 0 2024-08-31T05:21:33.983 INFO:tasks.workunit.client.0.smithi067.stdout:8/814: symlink d0/d4a/l110 0 2024-08-31T05:21:33.986 INFO:tasks.workunit.client.0.smithi067.stdout:8/815: creat d0/d4/de/d1d/d2c/d68/de3/f111 x:0 0 0 2024-08-31T05:21:33.989 INFO:tasks.workunit.client.0.smithi067.stdout:4/803: link d4/d13/f24 d4/d42/dc0/f113 0 2024-08-31T05:21:33.991 INFO:tasks.workunit.client.0.smithi067.stdout:8/816: dread d0/d4/de/df0/d73/d84/da6/db1/ff4 [0,4194304] 0 2024-08-31T05:21:33.993 INFO:tasks.workunit.client.0.smithi067.stdout:4/804: mknod d4/d9/dbb/de1/c114 0 2024-08-31T05:21:33.994 INFO:tasks.workunit.client.0.smithi067.stdout:4/805: read d4/d32/d43/ff0 [340577,113861] 0 2024-08-31T05:21:33.999 INFO:tasks.workunit.client.0.smithi067.stdout:8/817: rename d0/d2/da/dd/f6a to d0/d2/da9/f112 0 2024-08-31T05:21:33.999 INFO:tasks.workunit.client.0.smithi067.stdout:0/864: truncate d1/df/d29/d86/fd7 4147532 0 2024-08-31T05:21:34.025 INFO:tasks.workunit.client.0.smithi067.stdout:0/865: mknod d1/d8/d77/c118 0 2024-08-31T05:21:34.032 INFO:tasks.workunit.client.0.smithi067.stdout:4/806: getdents d4/d9/dbb 0 2024-08-31T05:21:34.033 INFO:tasks.workunit.client.0.smithi067.stdout:4/807: write d4/d14/d48/d66/de7/fec [77325,24735] 0 2024-08-31T05:21:34.035 INFO:tasks.workunit.client.0.smithi067.stdout:4/808: write d4/d9/db4/d83/da9/d60/f61 [1912836,22461] 0 2024-08-31T05:21:34.036 INFO:tasks.workunit.client.0.smithi067.stdout:4/809: dread - d4/d9/d4b/f108 zero size 2024-08-31T05:21:34.036 INFO:tasks.workunit.client.0.smithi067.stdout:4/810: readlink d4/d1f/l22 0 2024-08-31T05:21:34.043 INFO:tasks.workunit.client.0.smithi067.stdout:4/811: dwrite d4/d1e/d6d/f111 [0,4194304] 0 2024-08-31T05:21:34.045 INFO:tasks.workunit.client.0.smithi067.stdout:4/812: symlink d4/d1e/d53/d81/l115 0 2024-08-31T05:21:34.047 INFO:tasks.workunit.client.0.smithi067.stdout:4/813: chown d4/d32/dc7 233367 1 2024-08-31T05:21:34.052 INFO:tasks.workunit.client.0.smithi067.stdout:4/814: write d4/d14/d48/d66/de7/fec [411059,115076] 0 2024-08-31T05:21:34.053 INFO:tasks.workunit.client.0.smithi067.stdout:8/818: dwrite d0/d2/da/dd/d1f/fa8 [0,4194304] 0 2024-08-31T05:21:34.053 INFO:tasks.workunit.client.0.smithi067.stdout:0/866: dwrite d1/df/d17/d43/d48/f92 [0,4194304] 0 2024-08-31T05:21:34.055 INFO:tasks.workunit.client.0.smithi067.stdout:0/867: stat d1/df/d17/l10c 0 2024-08-31T05:21:34.056 INFO:tasks.workunit.client.0.smithi067.stdout:4/815: creat d4/d1f/d9e/f116 x:0 0 0 2024-08-31T05:21:34.058 INFO:tasks.workunit.client.0.smithi067.stdout:4/816: mknod d4/d9/da2/df8/c117 0 2024-08-31T05:21:34.063 INFO:tasks.workunit.client.0.smithi067.stdout:4/817: mkdir d4/d32/d118 0 2024-08-31T05:21:34.066 INFO:tasks.workunit.client.0.smithi067.stdout:4/818: mknod d4/d1e/d92/db0/d10e/c119 0 2024-08-31T05:21:34.067 INFO:tasks.workunit.client.0.smithi067.stdout:4/819: chown d4/da5/fc2 457694934 1 2024-08-31T05:21:34.068 INFO:tasks.workunit.client.0.smithi067.stdout:8/819: write d0/d4/de/df0/d73/f92 [121610,127784] 0 2024-08-31T05:21:34.069 INFO:tasks.workunit.client.0.smithi067.stdout:4/820: creat d4/d1f/d34/f11a x:0 0 0 2024-08-31T05:21:34.071 INFO:tasks.workunit.client.0.smithi067.stdout:4/821: creat d4/d9/da4/f11b x:0 0 0 2024-08-31T05:21:34.073 INFO:tasks.workunit.client.0.smithi067.stdout:4/822: mkdir d4/d1f/db9/d11c 0 2024-08-31T05:21:34.075 INFO:tasks.workunit.client.0.smithi067.stdout:4/823: creat d4/d14/f11d x:0 0 0 2024-08-31T05:21:34.078 INFO:tasks.workunit.client.0.smithi067.stdout:4/824: link d4/d1e/c47 d4/d14/c11e 0 2024-08-31T05:21:34.081 INFO:tasks.workunit.client.0.smithi067.stdout:8/820: dread d0/f96 [0,4194304] 0 2024-08-31T05:21:34.082 INFO:tasks.workunit.client.0.smithi067.stdout:4/825: creat d4/f11f x:0 0 0 2024-08-31T05:21:34.083 INFO:tasks.workunit.client.0.smithi067.stdout:4/826: dread - d4/d42/dd5/f101 zero size 2024-08-31T05:21:34.086 INFO:tasks.workunit.client.0.smithi067.stdout:4/827: mkdir d4/d1e/dea/d120 0 2024-08-31T05:21:34.088 INFO:tasks.workunit.client.0.smithi067.stdout:4/828: creat d4/d1e/dea/d120/f121 x:0 0 0 2024-08-31T05:21:34.091 INFO:tasks.workunit.client.0.smithi067.stdout:4/829: mkdir d4/d1e/d53/d81/d122 0 2024-08-31T05:21:34.094 INFO:tasks.workunit.client.0.smithi067.stdout:4/830: getdents d4/d9/dbb/de1 0 2024-08-31T05:21:34.095 INFO:tasks.workunit.client.0.smithi067.stdout:4/831: rmdir d4/d13 39 2024-08-31T05:21:34.096 INFO:tasks.workunit.client.0.smithi067.stdout:4/832: readlink d4/d1e/d53/d81/lbf 0 2024-08-31T05:21:34.097 INFO:tasks.workunit.client.0.smithi067.stdout:8/821: dread d0/d4/de/df0/d73/d84/fc0 [0,4194304] 0 2024-08-31T05:21:34.098 INFO:tasks.workunit.client.0.smithi067.stdout:4/833: read d4/d14/d48/f6e [57558,85475] 0 2024-08-31T05:21:34.099 INFO:tasks.workunit.client.0.smithi067.stdout:8/822: read d0/d2/da/dd/d1f/fa8 [1745283,14216] 0 2024-08-31T05:21:34.104 INFO:tasks.workunit.client.0.smithi067.stdout:4/834: getdents d4/d9/dbb 0 2024-08-31T05:21:34.104 INFO:tasks.workunit.client.0.smithi067.stdout:4/835: readlink d4/d1f/l69 0 2024-08-31T05:21:34.109 INFO:tasks.workunit.client.0.smithi067.stdout:8/823: dwrite d0/d4/d64/fa4 [0,4194304] 0 2024-08-31T05:21:34.118 INFO:tasks.workunit.client.0.smithi067.stdout:4/836: dwrite d4/d14/d48/f6e [0,4194304] 0 2024-08-31T05:21:34.122 INFO:tasks.workunit.client.0.smithi067.stdout:4/837: truncate d4/d32/d4c/db3/ffb 1496924 0 2024-08-31T05:21:34.124 INFO:tasks.workunit.client.0.smithi067.stdout:8/824: dwrite d0/d4/de/df0/d73/de9/da5/d99/f9c [4194304,4194304] 0 2024-08-31T05:21:34.133 INFO:tasks.workunit.client.0.smithi067.stdout:4/838: mknod d4/d9/db4/d83/da9/d60/c123 0 2024-08-31T05:21:34.133 INFO:tasks.workunit.client.0.smithi067.stdout:8/825: creat d0/d2/da/f113 x:0 0 0 2024-08-31T05:21:34.139 INFO:tasks.workunit.client.0.smithi067.stdout:4/839: mkdir d4/da5/dff/d124 0 2024-08-31T05:21:34.145 INFO:tasks.workunit.client.0.smithi067.stdout:8/826: write d0/f9 [1392429,116596] 0 2024-08-31T05:21:34.150 INFO:tasks.workunit.client.0.smithi067.stdout:4/840: dwrite d4/d9/db4/fe8 [0,4194304] 0 2024-08-31T05:21:34.154 INFO:tasks.workunit.client.0.smithi067.stdout:4/841: mknod d4/d9/d5a/dfe/c125 0 2024-08-31T05:21:34.156 INFO:tasks.workunit.client.0.smithi067.stdout:4/842: symlink d4/d1e/d92/db0/l126 0 2024-08-31T05:21:34.157 INFO:tasks.workunit.client.0.smithi067.stdout:4/843: write d4/f25 [2921838,25115] 0 2024-08-31T05:21:34.158 INFO:tasks.workunit.client.0.smithi067.stdout:4/844: chown d4/d42/f8b 0 1 2024-08-31T05:21:34.160 INFO:tasks.workunit.client.0.smithi067.stdout:4/845: chown d4/d1e/d92/db0/f102 400 1 2024-08-31T05:21:34.162 INFO:tasks.workunit.client.0.smithi067.stdout:4/846: mknod d4/d1e/dea/c127 0 2024-08-31T05:21:34.165 INFO:tasks.workunit.client.0.smithi067.stdout:4/847: fdatasync d4/d9/d5a/faa 0 2024-08-31T05:21:34.168 INFO:tasks.workunit.client.0.smithi067.stdout:4/848: rename d4/d9/d5a/f74 to d4/d1e/d92/f128 0 2024-08-31T05:21:34.168 INFO:tasks.workunit.client.0.smithi067.stdout:4/849: chown d4/d1f/d9e 0 1 2024-08-31T05:21:34.171 INFO:tasks.workunit.client.0.smithi067.stdout:4/850: rmdir d4/d1e/d53/d81 39 2024-08-31T05:21:34.172 INFO:tasks.workunit.client.0.smithi067.stdout:8/827: dread d0/d2/f83 [0,4194304] 0 2024-08-31T05:21:34.174 INFO:tasks.workunit.client.0.smithi067.stdout:8/828: dread d0/d4/de/d1d/d7b/d89/fbf [0,4194304] 0 2024-08-31T05:21:34.188 INFO:tasks.workunit.client.0.smithi067.stdout:1/672: sync 2024-08-31T05:21:34.188 INFO:tasks.workunit.client.0.smithi067.stdout:4/851: truncate d4/d1e/d53/f93 996474 0 2024-08-31T05:21:34.189 INFO:tasks.workunit.client.0.smithi067.stdout:4/852: write d4/da5/fc2 [417206,109043] 0 2024-08-31T05:21:34.194 INFO:tasks.workunit.client.0.smithi067.stdout:4/853: symlink d4/d32/l129 0 2024-08-31T05:21:34.196 INFO:tasks.workunit.client.0.smithi067.stdout:4/854: truncate d4/d1e/d92/db0/f102 697622 0 2024-08-31T05:21:34.199 INFO:tasks.workunit.client.0.smithi067.stdout:1/673: rename d3/d23/d2d/d2e/d34/d66/d72/d82/f9f to d3/d23/d2d/ff5 0 2024-08-31T05:21:34.201 INFO:tasks.workunit.client.0.smithi067.stdout:8/829: getdents d0/d2 0 2024-08-31T05:21:34.202 INFO:tasks.workunit.client.0.smithi067.stdout:8/830: readlink d0/d2/da/l4f 0 2024-08-31T05:21:34.203 INFO:tasks.workunit.client.0.smithi067.stdout:8/831: fsync d0/d4/de/d1d/d2c/d68/de3/fea 0 2024-08-31T05:21:34.211 INFO:tasks.workunit.client.0.smithi067.stdout:1/674: mkdir d3/d23/d2d/d2e/d34/dbc/df6 0 2024-08-31T05:21:34.213 INFO:tasks.workunit.client.0.smithi067.stdout:1/675: write d3/d23/d2d/d2e/d34/d66/d72/d82/fbb [818231,119557] 0 2024-08-31T05:21:34.217 INFO:tasks.workunit.client.0.smithi067.stdout:8/832: creat d0/d4/d64/f114 x:0 0 0 2024-08-31T05:21:34.218 INFO:tasks.workunit.client.0.smithi067.stdout:1/676: creat d3/d23/d2d/d2e/d34/dbc/ff7 x:0 0 0 2024-08-31T05:21:34.220 INFO:tasks.workunit.client.0.smithi067.stdout:8/833: chown d0/d4/de/d1d/d7b/d89/fbf 1794614493 1 2024-08-31T05:21:34.220 INFO:tasks.workunit.client.0.smithi067.stdout:4/855: dwrite d4/d42/dc0/f113 [0,4194304] 0 2024-08-31T05:21:34.228 INFO:tasks.workunit.client.0.smithi067.stdout:1/677: mkdir d3/df8 0 2024-08-31T05:21:34.229 INFO:tasks.workunit.client.0.smithi067.stdout:8/834: dwrite d0/d4/de/df0/d73/d84/da6/db1/db3/fe4 [0,4194304] 0 2024-08-31T05:21:34.231 INFO:tasks.workunit.client.0.smithi067.stdout:1/678: dread - d3/d23/d2d/d2e/d34/da3/fb8 zero size 2024-08-31T05:21:34.232 INFO:tasks.workunit.client.0.smithi067.stdout:1/679: dread - d3/d23/db1/dd4/fdb zero size 2024-08-31T05:21:34.233 INFO:tasks.workunit.client.0.smithi067.stdout:4/856: creat d4/d9/db4/d83/da9/f12a x:0 0 0 2024-08-31T05:21:34.233 INFO:tasks.workunit.client.0.smithi067.stdout:1/680: dread - d3/d23/d79/fb3 zero size 2024-08-31T05:21:34.242 INFO:tasks.workunit.client.0.smithi067.stdout:4/857: dwrite d4/d1e/dea/d120/f121 [0,4194304] 0 2024-08-31T05:21:34.243 INFO:tasks.workunit.client.0.smithi067.stdout:8/835: link d0/d2/da/c2f d0/d4/de/df0/d73/c115 0 2024-08-31T05:21:34.248 INFO:tasks.workunit.client.0.smithi067.stdout:4/858: symlink d4/d1f/db9/d11c/l12b 0 2024-08-31T05:21:34.250 INFO:tasks.workunit.client.0.smithi067.stdout:4/859: readlink d4/d1e/dea/lfd 0 2024-08-31T05:21:34.251 INFO:tasks.workunit.client.0.smithi067.stdout:1/681: truncate d3/d23/d2d/d2e/d34/d66/f67 1348152 0 2024-08-31T05:21:34.251 INFO:tasks.workunit.client.0.smithi067.stdout:8/836: write d0/f96 [3652809,69132] 0 2024-08-31T05:21:34.253 INFO:tasks.workunit.client.0.smithi067.stdout:4/860: unlink d4/d1f/fbd 0 2024-08-31T05:21:34.254 INFO:tasks.workunit.client.0.smithi067.stdout:1/682: truncate d3/d23/d2d/fdd 700407 0 2024-08-31T05:21:34.257 INFO:tasks.workunit.client.0.smithi067.stdout:8/837: unlink d0/d2/dc/d28/caf 0 2024-08-31T05:21:34.258 INFO:tasks.workunit.client.0.smithi067.stdout:4/861: creat d4/d32/d118/f12c x:0 0 0 2024-08-31T05:21:34.259 INFO:tasks.workunit.client.0.smithi067.stdout:1/683: truncate d3/f19 1620760 0 2024-08-31T05:21:34.261 INFO:tasks.workunit.client.0.smithi067.stdout:8/838: rename d0/d4/de/df0/d73/de9 to d0/d2/da/dd/d116 0 2024-08-31T05:21:34.262 INFO:tasks.workunit.client.0.smithi067.stdout:4/862: mknod d4/d9/db4/c12d 0 2024-08-31T05:21:34.266 INFO:tasks.workunit.client.0.smithi067.stdout:8/839: mkdir d0/d4/de/d117 0 2024-08-31T05:21:34.269 INFO:tasks.workunit.client.0.smithi067.stdout:8/840: rename d0/d2/dc/d3d/d98/fe1 to d0/d2/dc/d28/f118 0 2024-08-31T05:21:34.271 INFO:tasks.workunit.client.0.smithi067.stdout:8/841: symlink d0/d2/dc/d3d/d98/l119 0 2024-08-31T05:21:34.273 INFO:tasks.workunit.client.0.smithi067.stdout:8/842: write d0/d4/de/d1d/d2c/d68/de3/f111 [1042716,85434] 0 2024-08-31T05:21:34.277 INFO:tasks.workunit.client.0.smithi067.stdout:8/843: symlink d0/d2/da/dd/d116/da5/dc7/d101/d10c/l11a 0 2024-08-31T05:21:34.279 INFO:tasks.workunit.client.0.smithi067.stdout:8/844: read d0/d2/da/dd/d1f/f78 [2188743,34947] 0 2024-08-31T05:21:34.279 INFO:tasks.workunit.client.0.smithi067.stdout:8/845: chown d0/d4/de/df0/da3 0 1 2024-08-31T05:21:34.286 INFO:tasks.workunit.client.0.smithi067.stdout:1/684: dwrite d3/f55 [0,4194304] 0 2024-08-31T05:21:34.287 INFO:tasks.workunit.client.0.smithi067.stdout:8/846: dwrite d0/d4/de/d1d/d7b/fba [0,4194304] 0 2024-08-31T05:21:34.289 INFO:tasks.workunit.client.0.smithi067.stdout:8/847: truncate d0/d4/de/df0/d73/f92 1033620 0 2024-08-31T05:21:34.290 INFO:tasks.workunit.client.0.smithi067.stdout:1/685: mkdir d3/d23/d2d/d2e/df9 0 2024-08-31T05:21:34.293 INFO:tasks.workunit.client.0.smithi067.stdout:8/848: symlink d0/d4/de/d1d/d7b/d89/l11b 0 2024-08-31T05:21:34.295 INFO:tasks.workunit.client.0.smithi067.stdout:8/849: chown d0/d2/dc/d3d/d98/ld5 12 1 2024-08-31T05:21:34.296 INFO:tasks.workunit.client.0.smithi067.stdout:8/850: dread - d0/ff6 zero size 2024-08-31T05:21:34.297 INFO:tasks.workunit.client.0.smithi067.stdout:1/686: rename d3/d23/cf3 to d3/d23/d2d/d2e/d34/da3/ddf/cfa 0 2024-08-31T05:21:34.305 INFO:tasks.workunit.client.0.smithi067.stdout:1/687: mkdir d3/d23/db1/dd4/de4/dfb 0 2024-08-31T05:21:34.307 INFO:tasks.workunit.client.0.smithi067.stdout:8/851: link d0/d2/da/dd/c5b d0/d4/de/df0/d73/d84/dd1/c11c 0 2024-08-31T05:21:34.309 INFO:tasks.workunit.client.0.smithi067.stdout:8/852: fsync d0/d4/de/d1d/f9a 0 2024-08-31T05:21:34.312 INFO:tasks.workunit.client.0.smithi067.stdout:1/688: rename d3/d23/d2d/d2e/d34/dbc to d3/dfc 0 2024-08-31T05:21:34.312 INFO:tasks.workunit.client.0.smithi067.stdout:1/689: readlink d3/d23/d79/laf 0 2024-08-31T05:21:34.316 INFO:tasks.workunit.client.0.smithi067.stdout:1/690: rename d3/d23/db1/dd4/de4/dfb to d3/d23/db1/dd4/dfd 0 2024-08-31T05:21:34.316 INFO:tasks.workunit.client.0.smithi067.stdout:1/691: write d3/f15 [2040319,91313] 0 2024-08-31T05:21:34.320 INFO:tasks.workunit.client.0.smithi067.stdout:1/692: unlink d3/d23/d2d/d2e/d34/da3/fc7 0 2024-08-31T05:21:34.320 INFO:tasks.workunit.client.0.smithi067.stdout:1/693: fsync d3/d23/f91 0 2024-08-31T05:21:34.323 INFO:tasks.workunit.client.0.smithi067.stdout:1/694: symlink d3/d23/d2d/d2e/d34/d66/de8/d50/db5/lfe 0 2024-08-31T05:21:34.330 INFO:tasks.workunit.client.0.smithi067.stdout:8/853: dwrite d0/d2/da/dd/d1f/f78 [0,4194304] 0 2024-08-31T05:21:34.334 INFO:tasks.workunit.client.0.smithi067.stdout:8/854: mkdir d0/d4/d11d 0 2024-08-31T05:21:34.337 INFO:tasks.workunit.client.0.smithi067.stdout:8/855: mkdir d0/d4/de/d11e 0 2024-08-31T05:21:34.339 INFO:tasks.workunit.client.0.smithi067.stdout:8/856: write d0/d2/da/fc5 [199227,46655] 0 2024-08-31T05:21:34.339 INFO:tasks.workunit.client.0.smithi067.stdout:1/695: dread d3/d23/d2d/d2e/d34/d66/d72/f77 [0,4194304] 0 2024-08-31T05:21:34.343 INFO:tasks.workunit.client.0.smithi067.stdout:8/857: creat d0/d2/da/dd/d116/da5/dc7/f11f x:0 0 0 2024-08-31T05:21:34.345 INFO:tasks.workunit.client.0.smithi067.stdout:8/858: getdents d0/d74 0 2024-08-31T05:21:34.346 INFO:tasks.workunit.client.0.smithi067.stdout:1/696: dwrite d3/d23/d2d/d2e/d34/d66/fab [0,4194304] 0 2024-08-31T05:21:34.346 INFO:tasks.workunit.client.0.smithi067.stdout:1/697: chown d3/f15 55 1 2024-08-31T05:21:34.350 INFO:tasks.workunit.client.0.smithi067.stdout:1/698: rmdir d3/d23/d2d/d2e/d34/d66/d72/ded 0 2024-08-31T05:21:34.352 INFO:tasks.workunit.client.0.smithi067.stdout:8/859: dwrite d0/d2/fe6 [0,4194304] 0 2024-08-31T05:21:34.354 INFO:tasks.workunit.client.0.smithi067.stdout:1/699: truncate d3/d23/d2d/d2e/d34/d66/de8/f7e 61544 0 2024-08-31T05:21:34.358 INFO:tasks.workunit.client.0.smithi067.stdout:1/700: rmdir d3/d23/d2d/d2e 39 2024-08-31T05:21:34.359 INFO:tasks.workunit.client.0.smithi067.stdout:8/860: read d0/d74/dcb/fd9 [3988505,98167] 0 2024-08-31T05:21:34.361 INFO:tasks.workunit.client.0.smithi067.stdout:8/861: dread - d0/d2/da/dd/d116/da5/dc7/f11f zero size 2024-08-31T05:21:34.364 INFO:tasks.workunit.client.0.smithi067.stdout:8/862: rename d0/d4/de/l18 to d0/d4/de/df0/l120 0 2024-08-31T05:21:34.365 INFO:tasks.workunit.client.0.smithi067.stdout:8/863: stat d0/d4/de/df0/d73/d84/dd1/lf2 0 2024-08-31T05:21:34.367 INFO:tasks.workunit.client.0.smithi067.stdout:8/864: symlink d0/d4/de/df0/d73/d84/l121 0 2024-08-31T05:21:34.372 INFO:tasks.workunit.client.0.smithi067.stdout:8/865: dread d0/d4/de/d1d/d2c/d68/de3/fea [0,4194304] 0 2024-08-31T05:21:34.376 INFO:tasks.workunit.client.0.smithi067.stdout:1/701: dread d3/f19 [0,4194304] 0 2024-08-31T05:21:34.377 INFO:tasks.workunit.client.0.smithi067.stdout:1/702: dread - d3/d8b/fda zero size 2024-08-31T05:21:34.378 INFO:tasks.workunit.client.0.smithi067.stdout:1/703: chown d3/d23/d2d/d2e/d34/d66/de8/d50/db5 129992 1 2024-08-31T05:21:34.379 INFO:tasks.workunit.client.0.smithi067.stdout:1/704: stat d3/d23/d2d/d2e/d34/c4a 0 2024-08-31T05:21:34.383 INFO:tasks.workunit.client.0.smithi067.stdout:8/866: truncate d0/d4/de/d1d/d7b/d89/fcc 1799579 0 2024-08-31T05:21:34.385 INFO:tasks.workunit.client.0.smithi067.stdout:1/705: getdents d3/d23/d2d/d2e/d34/da3/ddf 0 2024-08-31T05:21:34.388 INFO:tasks.workunit.client.0.smithi067.stdout:1/706: write d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/fec [1032619,81003] 0 2024-08-31T05:21:34.389 INFO:tasks.workunit.client.0.smithi067.stdout:8/867: dwrite d0/d4/de/d1d/d2c/d68/de3/f111 [0,4194304] 0 2024-08-31T05:21:34.394 INFO:tasks.workunit.client.0.smithi067.stdout:8/868: mkdir d0/d2/da/dd/d116/d122 0 2024-08-31T05:21:34.397 INFO:tasks.workunit.client.0.smithi067.stdout:1/707: link d3/d23/d2d/d2e/l49 d3/d23/db1/db6/dc4/lff 0 2024-08-31T05:21:34.398 INFO:tasks.workunit.client.0.smithi067.stdout:1/708: dread - d3/d23/d2d/d2e/f39 zero size 2024-08-31T05:21:34.400 INFO:tasks.workunit.client.0.smithi067.stdout:8/869: creat d0/d2/dc/d3d/f123 x:0 0 0 2024-08-31T05:21:34.402 INFO:tasks.workunit.client.0.smithi067.stdout:1/709: mknod d3/d8b/df4/c100 0 2024-08-31T05:21:34.403 INFO:tasks.workunit.client.0.smithi067.stdout:1/710: write d3/f55 [2555885,116695] 0 2024-08-31T05:21:34.403 INFO:tasks.workunit.client.0.smithi067.stdout:8/870: rename d0/d4/de/df0/c108 to d0/d2/da/dd/d116/d122/c124 0 2024-08-31T05:21:34.405 INFO:tasks.workunit.client.0.smithi067.stdout:8/871: write d0/d2/dc/d3d/de5/f10f [405280,18534] 0 2024-08-31T05:21:34.405 INFO:tasks.workunit.client.0.smithi067.stdout:8/872: chown d0/d4/de/c36 6629 1 2024-08-31T05:21:34.407 INFO:tasks.workunit.client.0.smithi067.stdout:1/711: getdents d3/d23/d2d/d2e/df9 0 2024-08-31T05:21:34.408 INFO:tasks.workunit.client.0.smithi067.stdout:1/712: dread - d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/fe0 zero size 2024-08-31T05:21:34.409 INFO:tasks.workunit.client.0.smithi067.stdout:1/713: write d3/d23/d5d/f60 [5243143,126050] 0 2024-08-31T05:21:34.420 INFO:tasks.workunit.client.0.smithi067.stdout:1/714: mkdir d3/dfc/df6/d101 0 2024-08-31T05:21:34.426 INFO:tasks.workunit.client.0.smithi067.stdout:1/715: link d3/d23/f98 d3/d8b/df4/f102 0 2024-08-31T05:21:34.432 INFO:tasks.workunit.client.0.smithi067.stdout:1/716: creat d3/f103 x:0 0 0 2024-08-31T05:21:34.434 INFO:tasks.workunit.client.0.smithi067.stdout:1/717: creat d3/d23/d2d/d2e/df9/f104 x:0 0 0 2024-08-31T05:21:34.437 INFO:tasks.workunit.client.0.smithi067.stdout:1/718: dread - d3/d23/d2d/d2e/d34/d66/de8/f70 zero size 2024-08-31T05:21:34.437 INFO:tasks.workunit.client.0.smithi067.stdout:8/873: dwrite d0/d2/dc/d28/f81 [0,4194304] 0 2024-08-31T05:21:34.444 INFO:tasks.workunit.client.0.smithi067.stdout:8/874: dwrite d0/d2/da/fc5 [0,4194304] 0 2024-08-31T05:21:34.444 INFO:tasks.workunit.client.0.smithi067.stdout:1/719: dread d3/d23/d2d/d2e/d34/f64 [0,4194304] 0 2024-08-31T05:21:34.446 INFO:tasks.workunit.client.0.smithi067.stdout:8/875: fdatasync d0/f40 0 2024-08-31T05:21:34.447 INFO:tasks.workunit.client.0.smithi067.stdout:1/720: mknod d3/d23/db1/c105 0 2024-08-31T05:21:34.448 INFO:tasks.workunit.client.0.smithi067.stdout:1/721: chown d3/d23/d2d/c2f 4369 1 2024-08-31T05:21:34.450 INFO:tasks.workunit.client.0.smithi067.stdout:1/722: truncate d3/d23/db1/dd4/fdb 297938 0 2024-08-31T05:21:34.452 INFO:tasks.workunit.client.0.smithi067.stdout:8/876: truncate d0/d4/de/d1d/d2c/d68/de3/fea 801113 0 2024-08-31T05:21:34.452 INFO:tasks.workunit.client.0.smithi067.stdout:1/723: stat d3/d23/d2d/d2e/d34/d66/de8/fcf 0 2024-08-31T05:21:34.605 INFO:tasks.workunit.client.0.smithi067.stdout:1/724: creat d3/d23/d79/d93/dee/f106 x:0 0 0 2024-08-31T05:21:34.691 INFO:tasks.workunit.client.0.smithi067.stdout:8/877: write d0/d4/de/d1d/f60 [1525957,91193] 0 2024-08-31T05:21:34.692 INFO:tasks.workunit.client.0.smithi067.stdout:1/725: getdents d3/d23/d2d/d2e/df9 0 2024-08-31T05:21:34.693 INFO:tasks.workunit.client.0.smithi067.stdout:8/878: chown d0/d4/de/d1d/d7b/dab 1 1 2024-08-31T05:21:34.695 INFO:tasks.workunit.client.0.smithi067.stdout:8/879: truncate d0/d4/de/df0/d73/f92 1878051 0 2024-08-31T05:21:34.697 INFO:tasks.workunit.client.0.smithi067.stdout:8/880: truncate d0/d2/dc/d3d/de5/f10e 411885 0 2024-08-31T05:21:34.704 INFO:tasks.workunit.client.0.smithi067.stdout:1/726: dwrite d3/d23/d5d/f6f [0,4194304] 0 2024-08-31T05:21:34.705 INFO:tasks.workunit.client.0.smithi067.stdout:1/727: write d3/d23/d2d/d2e/d34/d66/d72/fc1 [4919313,52171] 0 2024-08-31T05:21:34.785 INFO:tasks.workunit.client.0.smithi067.stdout:1/728: creat d3/d23/d2d/d2e/d34/f107 x:0 0 0 2024-08-31T05:21:34.792 INFO:tasks.workunit.client.0.smithi067.stdout:1/729: getdents d3/d23/d2d/d2e/d34 0 2024-08-31T05:21:34.795 INFO:tasks.workunit.client.0.smithi067.stdout:1/730: unlink d3/d23/d2d/d2e/d34/da3/lb4 0 2024-08-31T05:21:34.805 INFO:tasks.workunit.client.0.smithi067.stdout:1/731: write d3/d8b/df4/f102 [2649424,23920] 0 2024-08-31T05:21:34.806 INFO:tasks.workunit.client.0.smithi067.stdout:1/732: write d3/f15 [4667413,96276] 0 2024-08-31T05:21:34.811 INFO:tasks.workunit.client.0.smithi067.stdout:1/733: rename d3/d36/f8d to d3/d23/d2d/d2e/d34/d66/de8/d50/db5/dc2/f108 0 2024-08-31T05:21:34.814 INFO:tasks.workunit.client.0.smithi067.stdout:1/734: truncate d3/d36/f65 3318265 0 2024-08-31T05:21:34.839 INFO:tasks.workunit.client.0.smithi067.stdout:2/786: sync 2024-08-31T05:21:34.842 INFO:tasks.workunit.client.0.smithi067.stdout:2/787: truncate db/d12/d1a/d1e/d4d/dd5/ff3 477272 0 2024-08-31T05:21:34.850 INFO:tasks.workunit.client.0.smithi067.stdout:2/788: rename db/d12/d1a/dd2 to db/d12/d1a/d2b/d3d/d4f/d6d/dfc 0 2024-08-31T05:21:34.850 INFO:tasks.workunit.client.0.smithi067.stdout:1/735: write d3/f19 [2658173,39336] 0 2024-08-31T05:21:34.856 INFO:tasks.workunit.client.0.smithi067.stdout:1/736: mknod d3/d23/d2d/d2e/d34/d66/de8/d50/db5/dc2/c109 0 2024-08-31T05:21:34.859 INFO:tasks.workunit.client.0.smithi067.stdout:1/737: creat d3/d23/d5d/f10a x:0 0 0 2024-08-31T05:21:34.865 INFO:tasks.workunit.client.0.smithi067.stdout:1/738: mkdir d3/d23/d2d/d2e/d34/d66/d72/d10b 0 2024-08-31T05:21:34.873 INFO:tasks.workunit.client.0.smithi067.stdout:1/739: dwrite d3/d23/d2d/d2e/d34/d66/de8/f20 [4194304,4194304] 0 2024-08-31T05:21:34.881 INFO:tasks.workunit.client.0.smithi067.stdout:2/789: dwrite db/dd/f17 [4194304,4194304] 0 2024-08-31T05:21:34.884 INFO:tasks.workunit.client.0.smithi067.stdout:1/740: symlink d3/d23/l10c 0 2024-08-31T05:21:34.886 INFO:tasks.workunit.client.0.smithi067.stdout:1/741: stat d3/d23/d2d/d2e/d34/d66/d72/d82/lea 0 2024-08-31T05:21:34.888 INFO:tasks.workunit.client.0.smithi067.stdout:1/742: write d3/d23/d2d/d2e/d34/d66/d9a/fd9 [389853,17099] 0 2024-08-31T05:21:34.889 INFO:tasks.workunit.client.0.smithi067.stdout:2/790: unlink db/d12/d1a/da3/fde 0 2024-08-31T05:21:34.892 INFO:tasks.workunit.client.0.smithi067.stdout:2/791: chown db/f70 925 1 2024-08-31T05:21:34.899 INFO:tasks.workunit.client.0.smithi067.stdout:1/743: getdents d3/d36 0 2024-08-31T05:21:34.899 INFO:tasks.workunit.client.0.smithi067.stdout:1/744: chown d3/d23/d2d/le6 24830982 1 2024-08-31T05:21:34.902 INFO:tasks.workunit.client.0.smithi067.stdout:1/745: truncate d3/d23/d2d/d2e/d34/d66/de8/f7e 160586 0 2024-08-31T05:21:34.905 INFO:tasks.workunit.client.0.smithi067.stdout:1/746: mkdir d3/d23/d2d/d10d 0 2024-08-31T05:21:34.907 INFO:tasks.workunit.client.0.smithi067.stdout:7/523: sync 2024-08-31T05:21:34.907 INFO:tasks.workunit.client.0.smithi067.stdout:3/957: sync 2024-08-31T05:21:34.907 INFO:tasks.workunit.client.0.smithi067.stdout:1/747: creat d3/dd3/f10e x:0 0 0 2024-08-31T05:21:34.909 INFO:tasks.workunit.client.0.smithi067.stdout:7/524: readlink la 0 2024-08-31T05:21:34.909 INFO:tasks.workunit.client.0.smithi067.stdout:7/525: fsync d14/d16/f41 0 2024-08-31T05:21:34.910 INFO:tasks.workunit.client.0.smithi067.stdout:3/958: mknod db/d55/d97/c135 0 2024-08-31T05:21:34.913 INFO:tasks.workunit.client.0.smithi067.stdout:7/526: mkdir d14/d54/d91 0 2024-08-31T05:21:34.918 INFO:tasks.workunit.client.0.smithi067.stdout:3/959: creat db/d17/f136 x:0 0 0 2024-08-31T05:21:34.925 INFO:tasks.workunit.client.0.smithi067.stdout:3/960: truncate db/d2e/d50/d4a/d110/f122 723099 0 2024-08-31T05:21:34.926 INFO:tasks.workunit.client.0.smithi067.stdout:1/748: dwrite d3/d23/d2d/d2e/d34/da3/fb8 [0,4194304] 0 2024-08-31T05:21:34.926 INFO:tasks.workunit.client.0.smithi067.stdout:2/792: dread db/d12/d1a/d2b/d3d/d4f/f8e [4194304,4194304] 0 2024-08-31T05:21:34.933 INFO:tasks.workunit.client.0.smithi067.stdout:1/749: mknod d3/d23/d2d/d2e/d34/d66/de8/d50/c10f 0 2024-08-31T05:21:34.934 INFO:tasks.workunit.client.0.smithi067.stdout:7/527: dread f6 [0,4194304] 0 2024-08-31T05:21:34.938 INFO:tasks.workunit.client.0.smithi067.stdout:2/793: write db/d12/d1a/d2b/d3d/d69/d3b/d99/fb6 [539286,80736] 0 2024-08-31T05:21:34.940 INFO:tasks.workunit.client.0.smithi067.stdout:1/750: mknod d3/d23/d2d/d2e/d34/d66/c110 0 2024-08-31T05:21:34.941 INFO:tasks.workunit.client.0.smithi067.stdout:7/528: dread d14/d16/f4e [0,4194304] 0 2024-08-31T05:21:34.943 INFO:tasks.workunit.client.0.smithi067.stdout:7/529: chown d14/d4a/f81 10 1 2024-08-31T05:21:34.943 INFO:tasks.workunit.client.0.smithi067.stdout:2/794: write db/d12/d1a/d2b/d3d/d4f/d63/f6f [2916152,52239] 0 2024-08-31T05:21:34.944 INFO:tasks.workunit.client.0.smithi067.stdout:7/530: readlink d14/d16/d28/d2e/d2f/l71 0 2024-08-31T05:21:34.945 INFO:tasks.workunit.client.0.smithi067.stdout:1/751: mknod d3/d23/d2d/d2e/c111 0 2024-08-31T05:21:34.948 INFO:tasks.workunit.client.0.smithi067.stdout:7/531: write d14/d54/d5e/d67/f6d [1281457,109138] 0 2024-08-31T05:21:34.951 INFO:tasks.workunit.client.0.smithi067.stdout:2/795: rename db/dd/f15 to db/d8c/dcd/df4/da0/dc4/ffd 0 2024-08-31T05:21:34.955 INFO:tasks.workunit.client.0.smithi067.stdout:2/796: fsync db/d8c/dcd/df4/da0/fc5 0 2024-08-31T05:21:34.957 INFO:tasks.workunit.client.0.smithi067.stdout:3/961: dread db/d2e/d50/d62/dc3/fed [0,4194304] 0 2024-08-31T05:21:34.957 INFO:tasks.workunit.client.0.smithi067.stdout:3/962: stat db/f14 0 2024-08-31T05:21:34.960 INFO:tasks.workunit.client.0.smithi067.stdout:7/532: write d14/f1e [5498477,93588] 0 2024-08-31T05:21:34.961 INFO:tasks.workunit.client.0.smithi067.stdout:1/752: dread d3/d36/f65 [0,4194304] 0 2024-08-31T05:21:34.966 INFO:tasks.workunit.client.0.smithi067.stdout:6/861: sync 2024-08-31T05:21:34.966 INFO:tasks.workunit.client.0.smithi067.stdout:0/868: sync 2024-08-31T05:21:34.966 INFO:tasks.workunit.client.0.smithi067.stdout:9/704: sync 2024-08-31T05:21:34.966 INFO:tasks.workunit.client.0.smithi067.stdout:5/624: sync 2024-08-31T05:21:34.966 INFO:tasks.workunit.client.0.smithi067.stdout:4/863: sync 2024-08-31T05:21:34.966 INFO:tasks.workunit.client.0.smithi067.stdout:8/881: sync 2024-08-31T05:21:34.966 INFO:tasks.workunit.client.0.smithi067.stdout:7/533: fsync f11 0 2024-08-31T05:21:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.965+0000 7fa58e028640 1 -- 172.21.15.67:0/3429184920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58009cbd0 msgr2=0x7fa58009d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.965+0000 7fa58e028640 1 --2- 172.21.15.67:0/3429184920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58009cbd0 0x7fa58009d050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa584009880 tx=0x7fa58402a4b0 comp rx=0 tx=0).stop 2024-08-31T05:21:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.965+0000 7fa58e028640 1 -- 172.21.15.67:0/3429184920 shutdown_connections 2024-08-31T05:21:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.965+0000 7fa58e028640 1 --2- 172.21.15.67:0/3429184920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58009cbd0 0x7fa58009d050 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.965+0000 7fa58e028640 1 --2- 172.21.15.67:0/3429184920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa58009b9d0 0x7fa58009bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.965+0000 7fa58e028640 1 -- 172.21.15.67:0/3429184920 >> 172.21.15.67:0/3429184920 conn(0x7fa58000abb0 msgr2=0x7fa58000afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:34.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.966+0000 7fa58e028640 1 -- 172.21.15.67:0/3429184920 shutdown_connections 2024-08-31T05:21:34.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.966+0000 7fa58e028640 1 -- 172.21.15.67:0/3429184920 wait complete. 2024-08-31T05:21:34.969 INFO:tasks.workunit.client.0.smithi067.stdout:0/869: dread - d1/d50/ff3 zero size 2024-08-31T05:21:34.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.966+0000 7fa58e028640 1 Processor -- start 2024-08-31T05:21:34.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.966+0000 7fa58e028640 1 -- start start 2024-08-31T05:21:34.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.967+0000 7fa58e028640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa58009b9d0 0x7fa580131490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:34.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.967+0000 7fa58e028640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58009cbd0 0x7fa5801319d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:34.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.967+0000 7fa58e028640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa5800a47f0 con 0x7fa58009b9d0 2024-08-31T05:21:34.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.967+0000 7fa58e028640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa5800a4670 con 0x7fa58009cbd0 2024-08-31T05:21:34.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.967+0000 7fa58d026640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa58009b9d0 0x7fa580131490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:34.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.967+0000 7fa58d026640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa58009b9d0 0x7fa580131490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42504/0 (socket says 172.21.15.67:42504) 2024-08-31T05:21:34.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.967+0000 7fa58d026640 1 -- 172.21.15.67:0/67196262 learned_addr learned my addr 172.21.15.67:0/67196262 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:21:34.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.967+0000 7fa58c825640 1 --2- 172.21.15.67:0/67196262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58009cbd0 0x7fa5801319d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:34.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.968+0000 7fa58d026640 1 -- 172.21.15.67:0/67196262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58009cbd0 msgr2=0x7fa5801319d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:34.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.968+0000 7fa58d026640 1 --2- 172.21.15.67:0/67196262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58009cbd0 0x7fa5801319d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:34.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.968+0000 7fa58d026640 1 -- 172.21.15.67:0/67196262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa580132050 con 0x7fa58009b9d0 2024-08-31T05:21:34.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.969+0000 7fa58d026640 1 --2- 172.21.15.67:0/67196262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa58009b9d0 0x7fa580131490 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa57800e940 tx=0x7fa57800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:34.972 INFO:tasks.workunit.client.0.smithi067.stdout:5/625: write db/f49 [659817,80469] 0 2024-08-31T05:21:34.973 INFO:tasks.workunit.client.0.smithi067.stdout:7/534: write d14/d16/f60 [4825430,89133] 0 2024-08-31T05:21:34.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.974+0000 7fa57e7fc640 1 -- 172.21.15.67:0/67196262 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa57800cac0 con 0x7fa58009b9d0 2024-08-31T05:21:34.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.974+0000 7fa57e7fc640 1 -- 172.21.15.67:0/67196262 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa57800cc60 con 0x7fa58009b9d0 2024-08-31T05:21:34.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.974+0000 7fa57e7fc640 1 -- 172.21.15.67:0/67196262 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa578003de0 con 0x7fa58009b9d0 2024-08-31T05:21:34.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.974+0000 7fa58e028640 1 -- 172.21.15.67:0/67196262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa580136a90 con 0x7fa58009b9d0 2024-08-31T05:21:34.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.974+0000 7fa58e028640 1 -- 172.21.15.67:0/67196262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa580137020 con 0x7fa58009b9d0 2024-08-31T05:21:34.979 INFO:tasks.workunit.client.0.smithi067.stdout:6/862: creat d1b/d40/d70/f116 x:0 0 0 2024-08-31T05:21:34.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.976+0000 7fa58e028640 1 -- 172.21.15.67:0/67196262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa58009bdd0 con 0x7fa58009b9d0 2024-08-31T05:21:34.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.977+0000 7fa57e7fc640 1 -- 172.21.15.67:0/67196262 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7fa578003f80 con 0x7fa58009b9d0 2024-08-31T05:21:34.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.978+0000 7fa57e7fc640 1 --2- 172.21.15.67:0/67196262 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fa574074040 0x7fa574076500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:34.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.978+0000 7fa57e7fc640 1 -- 172.21.15.67:0/67196262 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7fa578095c10 con 0x7fa58009b9d0 2024-08-31T05:21:34.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.978+0000 7fa58c825640 1 --2- 172.21.15.67:0/67196262 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fa574074040 0x7fa574076500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:34.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.979+0000 7fa58c825640 1 --2- 172.21.15.67:0/67196262 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fa574074040 0x7fa574076500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa580132940 tx=0x7fa584005a20 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:34.986 INFO:tasks.workunit.client.0.smithi067.stdout:7/535: mkdir d14/d4a/d92 0 2024-08-31T05:21:34.986 INFO:tasks.workunit.client.0.smithi067.stdout:1/753: dwrite d3/d23/d2d/d2e/d34/d66/f8a [0,4194304] 0 2024-08-31T05:21:34.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:34.987+0000 7fa57e7fc640 1 -- 172.21.15.67:0/67196262 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fa57805d6c0 con 0x7fa58009b9d0 2024-08-31T05:21:34.992 INFO:tasks.workunit.client.0.smithi067.stdout:3/963: dwrite db/dbe/fe0 [0,4194304] 0 2024-08-31T05:21:34.992 INFO:tasks.workunit.client.0.smithi067.stdout:2/797: dwrite db/fe2 [0,4194304] 0 2024-08-31T05:21:34.993 INFO:tasks.workunit.client.0.smithi067.stdout:4/864: dwrite d4/d13/f1a [0,4194304] 0 2024-08-31T05:21:34.999 INFO:tasks.workunit.client.0.smithi067.stdout:5/626: write f6 [1077256,64135] 0 2024-08-31T05:21:34.999 INFO:tasks.workunit.client.0.smithi067.stdout:7/536: write d14/d16/f89 [755382,112255] 0 2024-08-31T05:21:35.008 INFO:tasks.workunit.client.0.smithi067.stdout:9/705: dwrite dd/df/d25/f5f [0,4194304] 0 2024-08-31T05:21:35.017 INFO:tasks.workunit.client.0.smithi067.stdout:3/964: creat db/dbe/f137 x:0 0 0 2024-08-31T05:21:35.020 INFO:tasks.workunit.client.0.smithi067.stdout:7/537: fsync d14/d16/f42 0 2024-08-31T05:21:35.021 INFO:tasks.workunit.client.0.smithi067.stdout:7/538: dread - d14/d4a/f81 zero size 2024-08-31T05:21:35.023 INFO:tasks.workunit.client.0.smithi067.stdout:1/754: symlink d3/d23/d2d/d2e/d34/d66/d72/d82/l112 0 2024-08-31T05:21:35.025 INFO:tasks.workunit.client.0.smithi067.stdout:6/863: mkdir d1b/d40/d117 0 2024-08-31T05:21:35.028 INFO:tasks.workunit.client.0.smithi067.stdout:0/870: rename d1/df/d29/d37/f56 to d1/df/d17/d43/d48/f119 0 2024-08-31T05:21:35.029 INFO:tasks.workunit.client.0.smithi067.stdout:3/965: write db/d17/f6c [3241219,77548] 0 2024-08-31T05:21:35.035 INFO:tasks.workunit.client.0.smithi067.stdout:5/627: fsync db/d15/d42/f44 0 2024-08-31T05:21:35.039 INFO:tasks.workunit.client.0.smithi067.stdout:3/966: dwrite db/d55/d97/dc4/fcd [4194304,4194304] 0 2024-08-31T05:21:35.040 INFO:tasks.workunit.client.0.smithi067.stdout:9/706: dread dd/df/f12 [0,4194304] 0 2024-08-31T05:21:35.040 INFO:tasks.workunit.client.0.smithi067.stdout:6/864: symlink d1b/d40/d70/dd0/daa/l118 0 2024-08-31T05:21:35.049 INFO:tasks.workunit.client.0.smithi067.stdout:4/865: getdents d4/d42/dd5 0 2024-08-31T05:21:35.056 INFO:tasks.workunit.client.0.smithi067.stdout:8/882: dwrite d0/d4/de/d1d/d2c/d68/de3/fea [0,4194304] 0 2024-08-31T05:21:35.058 INFO:tasks.workunit.client.0.smithi067.stdout:7/539: rename d14/d16/d28/c2d to d14/d16/d5b/d64/c93 0 2024-08-31T05:21:35.061 INFO:tasks.workunit.client.0.smithi067.stdout:0/871: mknod d1/d8/d42/c11a 0 2024-08-31T05:21:35.061 INFO:tasks.workunit.client.0.smithi067.stdout:7/540: read d14/f1a [16997,65184] 0 2024-08-31T05:21:35.063 INFO:tasks.workunit.client.0.smithi067.stdout:9/707: write dd/d63/d72/fab [4981283,113066] 0 2024-08-31T05:21:35.065 INFO:tasks.workunit.client.0.smithi067.stdout:3/967: truncate db/d2e/d50/f5c 633746 0 2024-08-31T05:21:35.068 INFO:tasks.workunit.client.0.smithi067.stdout:1/755: getdents d3/d23/d79 0 2024-08-31T05:21:35.069 INFO:tasks.workunit.client.0.smithi067.stdout:1/756: chown d3/d23/d2d/d2e/d34/c69 87 1 2024-08-31T05:21:35.072 INFO:tasks.workunit.client.0.smithi067.stdout:1/757: write d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/fec [489438,13107] 0 2024-08-31T05:21:35.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:34 smithi067 ceph-mon[17432]: pgmap v38: 65 pgs: 65 active+clean; 2.3 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 32 MiB/s rd, 96 MiB/s wr, 254 op/s 2024-08-31T05:21:35.081 INFO:tasks.workunit.client.0.smithi067.stdout:3/968: dread - db/d4e/f103 zero size 2024-08-31T05:21:35.083 INFO:tasks.workunit.client.0.smithi067.stdout:8/883: creat d0/d2/dc/d28/dda/dfd/f125 x:0 0 0 2024-08-31T05:21:35.083 INFO:tasks.workunit.client.0.smithi067.stdout:7/541: dwrite d14/d3e/f70 [0,4194304] 0 2024-08-31T05:21:35.083 INFO:tasks.workunit.client.0.smithi067.stdout:3/969: dread - db/d2e/d50/d62/dc3/f130 zero size 2024-08-31T05:21:35.085 INFO:tasks.workunit.client.0.smithi067.stdout:4/866: truncate d4/d42/dc0/f113 3473660 0 2024-08-31T05:21:35.088 INFO:tasks.workunit.client.0.smithi067.stdout:9/708: write dd/d4d/fcb [480889,13693] 0 2024-08-31T05:21:35.091 INFO:tasks.workunit.client.0.smithi067.stdout:1/758: creat d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/f113 x:0 0 0 2024-08-31T05:21:35.094 INFO:tasks.workunit.client.0.smithi067.stdout:6/865: getdents d1b/d40/d70/dd0/da4 0 2024-08-31T05:21:35.098 INFO:tasks.workunit.client.0.smithi067.stdout:4/867: creat d4/d32/d4c/db3/f12e x:0 0 0 2024-08-31T05:21:35.099 INFO:tasks.workunit.client.0.smithi067.stdout:7/542: rename d14/d16/d28/d2e/d2f to d14/d16/d5b/d94 0 2024-08-31T05:21:35.101 INFO:tasks.workunit.client.0.smithi067.stdout:9/709: creat dd/df/d5b/fee x:0 0 0 2024-08-31T05:21:35.101 INFO:tasks.workunit.client.0.smithi067.stdout:1/759: mknod d3/d23/db1/dd4/c114 0 2024-08-31T05:21:35.104 INFO:tasks.workunit.client.0.smithi067.stdout:3/970: fsync db/d55/d97/dc4/fd6 0 2024-08-31T05:21:35.108 INFO:tasks.workunit.client.0.smithi067.stdout:4/868: dwrite d4/d1e/d92/db0/f102 [0,4194304] 0 2024-08-31T05:21:35.111 INFO:tasks.workunit.client.0.smithi067.stdout:7/543: dwrite d14/d16/f86 [0,4194304] 0 2024-08-31T05:21:35.113 INFO:tasks.workunit.client.0.smithi067.stdout:7/544: chown d14/d54/d5e/l72 36337 1 2024-08-31T05:21:35.115 INFO:tasks.workunit.client.0.smithi067.stdout:3/971: mknod db/d2e/da1/c138 0 2024-08-31T05:21:35.116 INFO:tasks.workunit.client.0.smithi067.stdout:6/866: link d1b/d7a/lf2 d1b/d40/d70/dd0/d5c/d86/l119 0 2024-08-31T05:21:35.117 INFO:tasks.workunit.client.0.smithi067.stdout:6/867: stat d1b/d40/d96/db3/dff/f106 0 2024-08-31T05:21:35.119 INFO:tasks.workunit.client.0.smithi067.stdout:7/545: write f7 [8832102,71336] 0 2024-08-31T05:21:35.123 INFO:tasks.workunit.client.0.smithi067.stdout:6/868: creat d1b/d7a/f11a x:0 0 0 2024-08-31T05:21:35.129 INFO:tasks.workunit.client.0.smithi067.stdout:4/869: mkdir d4/d56/d106/d12f 0 2024-08-31T05:21:35.135 INFO:tasks.workunit.client.0.smithi067.stdout:9/710: getdents dd/df 0 2024-08-31T05:21:35.135 INFO:tasks.workunit.client.0.smithi067.stdout:8/884: truncate d0/f96 1937301 0 2024-08-31T05:21:35.136 INFO:tasks.workunit.client.0.smithi067.stdout:8/885: chown d0/d4/de/d1d/f94 113 1 2024-08-31T05:21:35.137 INFO:tasks.workunit.client.0.smithi067.stdout:3/972: fdatasync db/d2e/d6a/f12a 0 2024-08-31T05:21:35.137 INFO:tasks.workunit.client.0.smithi067.stdout:9/711: chown dd/d4d/ce6 13425 1 2024-08-31T05:21:35.139 INFO:tasks.workunit.client.0.smithi067.stdout:6/869: mknod d1b/d40/d96/db3/dff/c11b 0 2024-08-31T05:21:35.143 INFO:tasks.workunit.client.0.smithi067.stdout:6/870: dread d1b/d40/d70/dd0/daa/fd3 [0,4194304] 0 2024-08-31T05:21:35.147 INFO:tasks.workunit.client.0.smithi067.stdout:9/712: fdatasync dd/df/d25/f8f 0 2024-08-31T05:21:35.150 INFO:tasks.workunit.client.0.smithi067.stdout:4/870: creat d4/da5/dff/d124/f130 x:0 0 0 2024-08-31T05:21:35.153 INFO:tasks.workunit.client.0.smithi067.stdout:7/546: dwrite d14/d16/f2b [0,4194304] 0 2024-08-31T05:21:35.162 INFO:tasks.workunit.client.0.smithi067.stdout:4/871: mknod d4/d9/d5a/c131 0 2024-08-31T05:21:35.163 INFO:tasks.workunit.client.0.smithi067.stdout:4/872: truncate d4/d1f/d9e/f110 79227 0 2024-08-31T05:21:35.164 INFO:tasks.workunit.client.0.smithi067.stdout:7/547: truncate d14/d3e/f55 4404371 0 2024-08-31T05:21:35.165 INFO:tasks.workunit.client.0.smithi067.stdout:4/873: write d4/d9/db4/d83/da9/fc4 [308607,65740] 0 2024-08-31T05:21:35.166 INFO:tasks.workunit.client.0.smithi067.stdout:6/871: creat d1b/d40/d70/d71/d114/f11c x:0 0 0 2024-08-31T05:21:35.166 INFO:tasks.workunit.client.0.smithi067.stdout:4/874: fdatasync d4/d32/d4c/db3/ffb 0 2024-08-31T05:21:35.169 INFO:tasks.workunit.client.0.smithi067.stdout:3/973: creat db/d55/d97/dc4/f139 x:0 0 0 2024-08-31T05:21:35.170 INFO:tasks.workunit.client.0.smithi067.stdout:9/713: mknod dd/df/d25/d3b/cef 0 2024-08-31T05:21:35.175 INFO:tasks.workunit.client.0.smithi067.stdout:3/974: dwrite db/f3d [0,4194304] 0 2024-08-31T05:21:35.178 INFO:tasks.workunit.client.0.smithi067.stdout:4/875: creat d4/d9/f132 x:0 0 0 2024-08-31T05:21:35.178 INFO:tasks.workunit.client.0.smithi067.stdout:8/886: getdents d0/d4/de/d1d/d7b 0 2024-08-31T05:21:35.181 INFO:tasks.workunit.client.0.smithi067.stdout:9/714: mkdir dd/d4d/dca/df0 0 2024-08-31T05:21:35.184 INFO:tasks.workunit.client.0.smithi067.stdout:8/887: dread d0/d4/de/df0/d73/d84/fc0 [0,4194304] 0 2024-08-31T05:21:35.184 INFO:tasks.workunit.client.0.smithi067.stdout:8/888: readlink d0/d4/de/d1d/d2c/lc3 0 2024-08-31T05:21:35.185 INFO:tasks.workunit.client.0.smithi067.stdout:3/975: rename db/d2e/d50/d4a to db/d12/d13a 0 2024-08-31T05:21:35.189 INFO:tasks.workunit.client.0.smithi067.stdout:7/548: creat d14/f95 x:0 0 0 2024-08-31T05:21:35.191 INFO:tasks.workunit.client.0.smithi067.stdout:4/876: mknod d4/d32/c133 0 2024-08-31T05:21:35.192 INFO:tasks.workunit.client.0.smithi067.stdout:7/549: chown d14/d16/d28/d78/f7d 63 1 2024-08-31T05:21:35.195 INFO:tasks.workunit.client.0.smithi067.stdout:7/550: write d14/f51 [1677272,41709] 0 2024-08-31T05:21:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:34 smithi073 ceph-mon[24726]: pgmap v38: 65 pgs: 65 active+clean; 2.3 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 32 MiB/s rd, 96 MiB/s wr, 254 op/s 2024-08-31T05:21:35.196 INFO:tasks.workunit.client.0.smithi067.stdout:3/976: dwrite db/d55/d97/dc4/fcd [0,4194304] 0 2024-08-31T05:21:35.197 INFO:tasks.workunit.client.0.smithi067.stdout:8/889: dwrite d0/d2/dc/d3d/de5/f10e [0,4194304] 0 2024-08-31T05:21:35.201 INFO:tasks.workunit.client.0.smithi067.stdout:7/551: write d14/d16/d28/d2e/f5a [2486665,33180] 0 2024-08-31T05:21:35.208 INFO:tasks.workunit.client.0.smithi067.stdout:3/977: dwrite db/d17/d3f/d54/d56/d6e/f9a [4194304,4194304] 0 2024-08-31T05:21:35.232 INFO:tasks.workunit.client.0.smithi067.stdout:8/890: dread d0/d2/da/dd/d116/f76 [0,4194304] 0 2024-08-31T05:21:35.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.296+0000 7fa58e028640 1 -- 172.21.15.67:0/67196262 --> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa5800a1100 con 0x7fa574074040 2024-08-31T05:21:35.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.298+0000 7fa57e7fc640 1 -- 172.21.15.67:0/67196262 <== mgr.24383 v2:172.21.15.73:6828/1567621854 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7fa5800a1100 con 0x7fa574074040 2024-08-31T05:21:35.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.300+0000 7fa58e028640 1 -- 172.21.15.67:0/67196262 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fa574074040 msgr2=0x7fa574076500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:35.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.300+0000 7fa58e028640 1 --2- 172.21.15.67:0/67196262 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fa574074040 0x7fa574076500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa580132940 tx=0x7fa584005a20 comp rx=0 tx=0).stop 2024-08-31T05:21:35.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.300+0000 7fa58e028640 1 -- 172.21.15.67:0/67196262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa58009b9d0 msgr2=0x7fa580131490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:35.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.300+0000 7fa58e028640 1 --2- 172.21.15.67:0/67196262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa58009b9d0 0x7fa580131490 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa57800e940 tx=0x7fa57800ee00 comp rx=0 tx=0).stop 2024-08-31T05:21:35.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.300+0000 7fa58e028640 1 -- 172.21.15.67:0/67196262 shutdown_connections 2024-08-31T05:21:35.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.300+0000 7fa58e028640 1 --2- 172.21.15.67:0/67196262 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fa574074040 0x7fa574076500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:35.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.300+0000 7fa58e028640 1 --2- 172.21.15.67:0/67196262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa58009cbd0 0x7fa5801319d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:35.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.300+0000 7fa58e028640 1 --2- 172.21.15.67:0/67196262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa58009b9d0 0x7fa580131490 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:35.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.300+0000 7fa58e028640 1 -- 172.21.15.67:0/67196262 >> 172.21.15.67:0/67196262 conn(0x7fa58000abb0 msgr2=0x7fa58009a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:35.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.300+0000 7fa58e028640 1 -- 172.21.15.67:0/67196262 shutdown_connections 2024-08-31T05:21:35.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.300+0000 7fa58e028640 1 -- 172.21.15.67:0/67196262 wait complete. 2024-08-31T05:21:35.313 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:21:35.333 INFO:tasks.workunit.client.0.smithi067.stdout:8/891: mkdir d0/d2/da/dd/d1f/d126 0 2024-08-31T05:21:35.335 INFO:tasks.workunit.client.0.smithi067.stdout:4/877: symlink d4/d1e/d53/d81/d122/l134 0 2024-08-31T05:21:35.342 INFO:tasks.workunit.client.0.smithi067.stdout:4/878: truncate d4/d9/db4/d83/da9/f3a 1178025 0 2024-08-31T05:21:35.343 INFO:tasks.workunit.client.0.smithi067.stdout:3/978: dread db/d2e/f38 [0,4194304] 0 2024-08-31T05:21:35.343 INFO:tasks.workunit.client.0.smithi067.stdout:4/879: chown d4/f76 2 1 2024-08-31T05:21:35.344 INFO:tasks.workunit.client.0.smithi067.stdout:4/880: read - d4/d9/f132 zero size 2024-08-31T05:21:35.344 INFO:tasks.workunit.client.0.smithi067.stdout:8/892: link d0/d2/dc/d3d/d98/ld5 d0/d2/dc/d3d/d98/l127 0 2024-08-31T05:21:35.346 INFO:tasks.workunit.client.0.smithi067.stdout:9/715: write dd/df/f54 [1540688,17882] 0 2024-08-31T05:21:35.346 INFO:tasks.workunit.client.0.smithi067.stdout:8/893: dread - d0/d2/dc/d3d/f123 zero size 2024-08-31T05:21:35.349 INFO:tasks.workunit.client.0.smithi067.stdout:4/881: unlink d4/d14/d48/d66/ff6 0 2024-08-31T05:21:35.353 INFO:tasks.workunit.client.0.smithi067.stdout:8/894: symlink d0/d2/da9/l128 0 2024-08-31T05:21:35.358 INFO:tasks.workunit.client.0.smithi067.stdout:8/895: creat d0/d4/de/df0/d73/d84/f129 x:0 0 0 2024-08-31T05:21:35.358 INFO:tasks.workunit.client.0.smithi067.stdout:3/979: rename db/d12/d21/lca to db/d55/d97/dc4/dcb/l13b 0 2024-08-31T05:21:35.360 INFO:tasks.workunit.client.0.smithi067.stdout:7/552: dwrite d14/d16/d28/f35 [0,4194304] 0 2024-08-31T05:21:35.368 INFO:tasks.workunit.client.0.smithi067.stdout:7/553: creat d14/d4a/d85/f96 x:0 0 0 2024-08-31T05:21:35.368 INFO:tasks.workunit.client.0.smithi067.stdout:8/896: dwrite d0/d2/da9/f112 [0,4194304] 0 2024-08-31T05:21:35.370 INFO:tasks.workunit.client.0.smithi067.stdout:7/554: chown d14/d16/d5b/l7c 8739 1 2024-08-31T05:21:35.371 INFO:tasks.workunit.client.0.smithi067.stdout:8/897: write d0/d2/dc/d3d/f123 [80534,61059] 0 2024-08-31T05:21:35.371 INFO:tasks.workunit.client.0.smithi067.stdout:7/555: readlink d14/d16/d5b/l7c 0 2024-08-31T05:21:35.372 INFO:tasks.workunit.client.0.smithi067.stdout:3/980: link db/d2e/c95 db/d91/d10b/c13c 0 2024-08-31T05:21:35.373 INFO:tasks.workunit.client.0.smithi067.stdout:7/556: chown d14/d54/d5e/d67/f6d 1109 1 2024-08-31T05:21:35.382 INFO:tasks.workunit.client.0.smithi067.stdout:7/557: dwrite d14/f20 [8388608,4194304] 0 2024-08-31T05:21:35.382 INFO:tasks.workunit.client.0.smithi067.stdout:3/981: read db/d12/d21/d82/fa5 [2292820,28378] 0 2024-08-31T05:21:35.383 INFO:tasks.workunit.client.0.smithi067.stdout:7/558: chown d14/d4a/d85/f96 0 1 2024-08-31T05:21:35.386 INFO:tasks.workunit.client.0.smithi067.stdout:7/559: creat d14/d4a/f97 x:0 0 0 2024-08-31T05:21:35.387 INFO:tasks.workunit.client.0.smithi067.stdout:3/982: mknod db/d12/d21/df3/c13d 0 2024-08-31T05:21:35.389 INFO:tasks.workunit.client.0.smithi067.stdout:7/560: rename d14/d54/l57 to d14/d4a/l98 0 2024-08-31T05:21:35.390 INFO:tasks.workunit.client.0.smithi067.stdout:3/983: mknod db/d2e/d50/d62/c13e 0 2024-08-31T05:21:35.392 INFO:tasks.workunit.client.0.smithi067.stdout:7/561: symlink d14/d16/d5b/d68/d6e/l99 0 2024-08-31T05:21:35.395 INFO:tasks.workunit.client.0.smithi067.stdout:7/562: creat d14/d16/d5b/d68/d6e/f9a x:0 0 0 2024-08-31T05:21:35.403 INFO:tasks.workunit.client.0.smithi067.stdout:8/898: write d0/d4/de/d1d/d2c/f55 [3254771,11819] 0 2024-08-31T05:21:35.410 INFO:tasks.workunit.client.0.smithi067.stdout:8/899: truncate d0/d2/da/dd/d1f/fdb 1769248 0 2024-08-31T05:21:35.412 INFO:tasks.workunit.client.0.smithi067.stdout:8/900: chown d0/d4/de/d1d/f60 474893926 1 2024-08-31T05:21:35.414 INFO:tasks.workunit.client.0.smithi067.stdout:8/901: fdatasync d0/d2/da/fd4 0 2024-08-31T05:21:35.417 INFO:tasks.workunit.client.0.smithi067.stdout:7/563: truncate d14/d3e/f70 4097033 0 2024-08-31T05:21:35.418 INFO:tasks.workunit.client.0.smithi067.stdout:3/984: dread db/d2e/d50/d62/dc3/fde [0,4194304] 0 2024-08-31T05:21:35.423 INFO:tasks.workunit.client.0.smithi067.stdout:3/985: creat db/d12/d21/df3/f13f x:0 0 0 2024-08-31T05:21:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.423+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/1768795185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c8102900 msgr2=0x7fd0c8102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.423+0000 7fd0ccd5e640 1 --2- 172.21.15.67:0/1768795185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c8102900 0x7fd0c8102d80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009880 tx=0x7fd0b002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:21:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.423+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/1768795185 shutdown_connections 2024-08-31T05:21:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.423+0000 7fd0ccd5e640 1 --2- 172.21.15.67:0/1768795185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c8102900 0x7fd0c8102d80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.423+0000 7fd0ccd5e640 1 --2- 172.21.15.67:0/1768795185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c8101700 0x7fd0c8101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.423+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/1768795185 >> 172.21.15.67:0/1768795185 conn(0x7fd0c80fce90 msgr2=0x7fd0c80ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.423+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/1768795185 shutdown_connections 2024-08-31T05:21:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.423+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/1768795185 wait complete. 2024-08-31T05:21:35.427 INFO:tasks.workunit.client.0.smithi067.stdout:8/902: truncate d0/d2/dc/f7a 6735 0 2024-08-31T05:21:35.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.424+0000 7fd0ccd5e640 1 Processor -- start 2024-08-31T05:21:35.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.424+0000 7fd0ccd5e640 1 -- start start 2024-08-31T05:21:35.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.424+0000 7fd0ccd5e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c8101700 0x7fd0c8199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:35.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.424+0000 7fd0ccd5e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c8102900 0x7fd0c81999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:35.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.424+0000 7fd0ccd5e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c810a520 con 0x7fd0c8101700 2024-08-31T05:21:35.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.424+0000 7fd0ccd5e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c810a3a0 con 0x7fd0c8102900 2024-08-31T05:21:35.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.424+0000 7fd0c659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c8101700 0x7fd0c8199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:35.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.424+0000 7fd0bffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c8102900 0x7fd0c81999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:35.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.424+0000 7fd0bffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c8102900 0x7fd0c81999b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:56550/0 (socket says 172.21.15.67:56550) 2024-08-31T05:21:35.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.424+0000 7fd0c659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c8101700 0x7fd0c8199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42508/0 (socket says 172.21.15.67:42508) 2024-08-31T05:21:35.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.424+0000 7fd0bffff640 1 -- 172.21.15.67:0/999635701 learned_addr learned my addr 172.21.15.67:0/999635701 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:21:35.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.425+0000 7fd0bffff640 1 -- 172.21.15.67:0/999635701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c8101700 msgr2=0x7fd0c8199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:35.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.425+0000 7fd0bffff640 1 --2- 172.21.15.67:0/999635701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c8101700 0x7fd0c8199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:35.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.425+0000 7fd0bffff640 1 -- 172.21.15.67:0/999635701 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c819a030 con 0x7fd0c8102900 2024-08-31T05:21:35.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.425+0000 7fd0bffff640 1 --2- 172.21.15.67:0/999635701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c8102900 0x7fd0c81999b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0006010 tx=0x7fd0b0004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.425+0000 7fd0bf7fe640 1 -- 172.21.15.67:0/999635701 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd0b003f070 con 0x7fd0c8102900 2024-08-31T05:21:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.425+0000 7fd0bf7fe640 1 -- 172.21.15.67:0/999635701 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd0b00049d0 con 0x7fd0c8102900 2024-08-31T05:21:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.425+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/999635701 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c819ea10 con 0x7fd0c8102900 2024-08-31T05:21:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.425+0000 7fd0bf7fe640 1 -- 172.21.15.67:0/999635701 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd0b0035030 con 0x7fd0c8102900 2024-08-31T05:21:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.426+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/999635701 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c819eee0 con 0x7fd0c8102900 2024-08-31T05:21:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.427+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/999635701 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c8101b00 con 0x7fd0c8102900 2024-08-31T05:21:35.431 INFO:tasks.workunit.client.0.smithi067.stdout:8/903: write d0/d2/da/dd/d116/da5/dc7/fff [671403,54205] 0 2024-08-31T05:21:35.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.427+0000 7fd0bf7fe640 1 -- 172.21.15.67:0/999635701 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7fd0b0042070 con 0x7fd0c8102900 2024-08-31T05:21:35.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.428+0000 7fd0bf7fe640 1 --2- 172.21.15.67:0/999635701 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fd0b4073f50 0x7fd0b4076410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:35.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.428+0000 7fd0c659c640 1 --2- 172.21.15.67:0/999635701 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fd0b4073f50 0x7fd0b4076410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:35.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.429+0000 7fd0bf7fe640 1 -- 172.21.15.67:0/999635701 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7fd0b00b6080 con 0x7fd0c8102900 2024-08-31T05:21:35.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.429+0000 7fd0c659c640 1 --2- 172.21.15.67:0/999635701 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fd0b4073f50 0x7fd0b4076410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8102760 tx=0x7fd0b8005f90 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:35.433 INFO:tasks.workunit.client.0.smithi067.stdout:8/904: readlink d0/d2/dc/d3d/d98/l109 0 2024-08-31T05:21:35.434 INFO:tasks.workunit.client.0.smithi067.stdout:7/564: dwrite d14/f1a [0,4194304] 0 2024-08-31T05:21:35.436 INFO:tasks.workunit.client.0.smithi067.stdout:8/905: mkdir d0/d4a/d12a 0 2024-08-31T05:21:35.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.434+0000 7fd0bf7fe640 1 -- 172.21.15.67:0/999635701 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fd0b0081c40 con 0x7fd0c8102900 2024-08-31T05:21:35.445 INFO:tasks.workunit.client.0.smithi067.stdout:3/986: dread db/d2e/f9e [0,4194304] 0 2024-08-31T05:21:35.446 INFO:tasks.workunit.client.0.smithi067.stdout:8/906: mkdir d0/d2/dc/d3d/d12b 0 2024-08-31T05:21:35.452 INFO:tasks.workunit.client.0.smithi067.stdout:7/565: dwrite d14/d16/f1d [0,4194304] 0 2024-08-31T05:21:35.453 INFO:tasks.workunit.client.0.smithi067.stdout:8/907: symlink d0/d2/da/dd/d116/da5/dc7/d101/d10c/l12c 0 2024-08-31T05:21:35.453 INFO:tasks.workunit.client.0.smithi067.stdout:3/987: dread db/dbe/fe0 [0,4194304] 0 2024-08-31T05:21:35.455 INFO:tasks.workunit.client.0.smithi067.stdout:8/908: readlink d0/d4/d64/l82 0 2024-08-31T05:21:35.457 INFO:tasks.workunit.client.0.smithi067.stdout:8/909: write d0/d4/de/d1d/f60 [2661656,34767] 0 2024-08-31T05:21:35.465 INFO:tasks.workunit.client.0.smithi067.stdout:8/910: creat d0/d4/de/df0/d73/d84/da6/db1/d8c/f12d x:0 0 0 2024-08-31T05:21:35.469 INFO:tasks.workunit.client.0.smithi067.stdout:7/566: link d14/c48 d14/d4a/c9b 0 2024-08-31T05:21:35.471 INFO:tasks.workunit.client.0.smithi067.stdout:7/567: dread - d14/d54/f62 zero size 2024-08-31T05:21:35.473 INFO:tasks.workunit.client.0.smithi067.stdout:8/911: rename d0/d4/de/df0/d73/d84/da6/db1/d8c/l10d to d0/d4/de/d1d/d7b/d89/l12e 0 2024-08-31T05:21:35.473 INFO:tasks.workunit.client.0.smithi067.stdout:7/568: rmdir d14/d16/d28 39 2024-08-31T05:21:35.475 INFO:tasks.workunit.client.0.smithi067.stdout:3/988: dwrite db/d2e/d50/d62/f66 [0,4194304] 0 2024-08-31T05:21:35.477 INFO:tasks.workunit.client.0.smithi067.stdout:8/912: write d0/d2/dc/d28/dda/dfd/f125 [917346,86565] 0 2024-08-31T05:21:35.481 INFO:tasks.workunit.client.0.smithi067.stdout:3/989: unlink db/d5a/l71 0 2024-08-31T05:21:35.484 INFO:tasks.workunit.client.0.smithi067.stdout:7/569: unlink d14/d16/d5b/d68/d6e/l6f 0 2024-08-31T05:21:35.485 INFO:tasks.workunit.client.0.smithi067.stdout:7/570: chown fd 3225641 1 2024-08-31T05:21:35.486 INFO:tasks.workunit.client.0.smithi067.stdout:8/913: symlink d0/d4/de/d1d/d2c/d68/de3/l12f 0 2024-08-31T05:21:35.493 INFO:tasks.workunit.client.0.smithi067.stdout:7/571: truncate d14/d16/f32 3322377 0 2024-08-31T05:21:35.493 INFO:tasks.workunit.client.0.smithi067.stdout:3/990: write db/d55/d97/dc4/fd6 [2283383,54051] 0 2024-08-31T05:21:35.495 INFO:tasks.workunit.client.0.smithi067.stdout:7/572: dread d14/d16/f5d [0,4194304] 0 2024-08-31T05:21:35.495 INFO:tasks.workunit.client.0.smithi067.stdout:7/573: stat d14/d16/c2a 0 2024-08-31T05:21:35.496 INFO:tasks.workunit.client.0.smithi067.stdout:3/991: unlink db/d17/l86 0 2024-08-31T05:21:35.500 INFO:tasks.workunit.client.0.smithi067.stdout:3/992: read db/d17/f24 [1196187,30470] 0 2024-08-31T05:21:35.504 INFO:tasks.workunit.client.0.smithi067.stdout:8/914: dwrite d0/d4/de/df0/d73/d84/da6/db1/d8c/f9b [0,4194304] 0 2024-08-31T05:21:35.510 INFO:tasks.workunit.client.0.smithi067.stdout:3/993: symlink db/d2e/d50/l140 0 2024-08-31T05:21:35.512 INFO:tasks.workunit.client.0.smithi067.stdout:3/994: stat db/d2e/d50/l114 0 2024-08-31T05:21:35.515 INFO:tasks.workunit.client.0.smithi067.stdout:7/574: dwrite d14/d54/d5e/f75 [0,4194304] 0 2024-08-31T05:21:35.516 INFO:tasks.workunit.client.0.smithi067.stdout:3/995: symlink db/d55/l141 0 2024-08-31T05:21:35.516 INFO:tasks.workunit.client.0.smithi067.stdout:8/915: dwrite d0/d4/de/d1d/f60 [0,4194304] 0 2024-08-31T05:21:35.521 INFO:tasks.workunit.client.0.smithi067.stdout:3/996: dread db/d2e/d50/fdc [0,4194304] 0 2024-08-31T05:21:35.526 INFO:tasks.workunit.client.0.smithi067.stdout:8/916: unlink d0/d4a/cf5 0 2024-08-31T05:21:35.527 INFO:tasks.workunit.client.0.smithi067.stdout:8/917: write d0/d2/dc/ff9 [331095,85382] 0 2024-08-31T05:21:35.531 INFO:tasks.workunit.client.0.smithi067.stdout:8/918: creat d0/d4/de/df0/d73/d84/dd1/f130 x:0 0 0 2024-08-31T05:21:35.533 INFO:tasks.workunit.client.0.smithi067.stdout:7/575: rename d14/d16/d5b/d68/d6e/c8a to d14/d16/d28/c9c 0 2024-08-31T05:21:35.534 INFO:tasks.workunit.client.0.smithi067.stdout:3/997: link db/d12/d21/d82/c8e db/d2e/d50/d62/c142 0 2024-08-31T05:21:35.538 INFO:tasks.workunit.client.0.smithi067.stdout:7/576: dread d14/d16/d28/d2e/f38 [0,4194304] 0 2024-08-31T05:21:35.539 INFO:tasks.workunit.client.0.smithi067.stdout:8/919: dwrite d0/d4/de/d1d/f94 [0,4194304] 0 2024-08-31T05:21:35.545 INFO:tasks.workunit.client.0.smithi067.stdout:3/998: dwrite db/d17/d3f/d54/ddf/f104 [0,4194304] 0 2024-08-31T05:21:35.545 INFO:tasks.workunit.client.0.smithi067.stdout:8/920: mknod d0/d2/dc/d3d/d12b/c131 0 2024-08-31T05:21:35.547 INFO:tasks.workunit.client.0.smithi067.stdout:8/921: read - d0/d2/da/f113 zero size 2024-08-31T05:21:35.560 INFO:tasks.workunit.client.0.smithi067.stdout:8/922: link d0/d4/de/d1d/d7b/fba d0/d4/de/d1d/d7b/dab/f132 0 2024-08-31T05:21:35.563 INFO:tasks.workunit.client.0.smithi067.stdout:8/923: symlink d0/d2/da/dd/d116/da5/dc7/l133 0 2024-08-31T05:21:35.565 INFO:tasks.workunit.client.0.smithi067.stdout:7/577: write d14/d16/f4e [142756,122416] 0 2024-08-31T05:21:35.566 INFO:tasks.workunit.client.0.smithi067.stdout:8/924: creat d0/d2/dc/d3d/d98/dc2/f134 x:0 0 0 2024-08-31T05:21:35.568 INFO:tasks.workunit.client.0.smithi067.stdout:8/925: dread - d0/d4/de/df0/d73/d84/da6/db1/d8c/f12d zero size 2024-08-31T05:21:35.570 INFO:tasks.workunit.client.0.smithi067.stdout:8/926: chown d0/d4/de/df0/d73/d84/da6/db1/db3/fe4 1 1 2024-08-31T05:21:35.575 INFO:tasks.workunit.client.0.smithi067.stdout:3/999: dwrite db/d2e/d50/d62/dc3/fed [0,4194304] 0 2024-08-31T05:21:35.581 INFO:tasks.workunit.client.0.smithi067.stdout:8/927: dwrite d0/d4/de/df0/d73/d84/dd1/f130 [0,4194304] 0 2024-08-31T05:21:35.583 INFO:tasks.workunit.client.0.smithi067.stdout:7/578: dread d14/d16/f32 [0,4194304] 0 2024-08-31T05:21:35.583 INFO:tasks.workunit.client.0.smithi067.stdout:8/928: chown d0/d2/da/dd/d1f/l54 160354777 1 2024-08-31T05:21:35.584 INFO:tasks.workunit.client.0.smithi067.stdout:7/579: write d14/d16/f41 [2728284,25900] 0 2024-08-31T05:21:35.586 INFO:tasks.workunit.client.0.smithi067.stdout:8/929: write d0/d2/da/dd/d116/da5/d99/f9c [403238,23551] 0 2024-08-31T05:21:35.587 INFO:tasks.workunit.client.0.smithi067.stdout:8/930: chown d0/d4/de/d1d/d7b/fba 0 1 2024-08-31T05:21:35.589 INFO:tasks.workunit.client.0.smithi067.stdout:7/580: mknod d14/d54/d5e/d67/c9d 0 2024-08-31T05:21:35.592 INFO:tasks.workunit.client.0.smithi067.stdout:8/931: mknod d0/d4/c135 0 2024-08-31T05:21:35.593 INFO:tasks.workunit.client.0.smithi067.stdout:8/932: write d0/d4/de/d1d/f60 [2583001,89341] 0 2024-08-31T05:21:35.594 INFO:tasks.workunit.client.0.smithi067.stdout:8/933: chown d0/d4/faa 17 1 2024-08-31T05:21:35.596 INFO:tasks.workunit.client.0.smithi067.stdout:7/581: getdents d14/d4a 0 2024-08-31T05:21:35.598 INFO:tasks.workunit.client.0.smithi067.stdout:8/934: mknod d0/d4/de/df0/d73/d84/da6/db1/c136 0 2024-08-31T05:21:35.598 INFO:tasks.workunit.client.0.smithi067.stdout:8/935: chown d0/d2/da/dd/d1f/d126 3 1 2024-08-31T05:21:35.599 INFO:tasks.workunit.client.0.smithi067.stdout:7/582: creat d14/d3e/f9e x:0 0 0 2024-08-31T05:21:35.600 INFO:tasks.workunit.client.0.smithi067.stdout:8/936: dread - d0/d4/de/d1d/ff1 zero size 2024-08-31T05:21:35.604 INFO:tasks.workunit.client.0.smithi067.stdout:7/583: creat d14/d16/d28/f9f x:0 0 0 2024-08-31T05:21:35.607 INFO:tasks.workunit.client.0.smithi067.stdout:8/937: dwrite d0/d2/dc/d3d/d98/dc2/f134 [0,4194304] 0 2024-08-31T05:21:35.609 INFO:tasks.workunit.client.0.smithi067.stdout:8/938: stat d0/d2/da/dd/cad 0 2024-08-31T05:21:35.612 INFO:tasks.workunit.client.0.smithi067.stdout:7/584: dwrite f6 [0,4194304] 0 2024-08-31T05:21:35.612 INFO:tasks.workunit.client.0.smithi067.stdout:8/939: dread d0/d4/de/d1d/f9a [0,4194304] 0 2024-08-31T05:21:35.615 INFO:tasks.workunit.client.0.smithi067.stdout:7/585: chown d14/d16/d5b/d68/l77 5 1 2024-08-31T05:21:35.618 INFO:tasks.workunit.client.0.smithi067.stdout:8/940: creat d0/d2/dc/d28/d105/f137 x:0 0 0 2024-08-31T05:21:35.620 INFO:tasks.workunit.client.0.smithi067.stdout:7/586: creat d14/d16/d28/fa0 x:0 0 0 2024-08-31T05:21:35.622 INFO:tasks.workunit.client.0.smithi067.stdout:7/587: stat d14/d16/d5b/d68/d80 0 2024-08-31T05:21:35.623 INFO:tasks.workunit.client.0.smithi067.stdout:7/588: read - d14/d16/d28/d2e/f7e zero size 2024-08-31T05:21:35.632 INFO:tasks.workunit.client.0.smithi067.stdout:7/589: write d14/d16/d28/d2e/f37 [1479704,79894] 0 2024-08-31T05:21:35.633 INFO:tasks.workunit.client.0.smithi067.stdout:8/941: dwrite d0/d2/da/dd/d116/f76 [0,4194304] 0 2024-08-31T05:21:35.641 INFO:tasks.workunit.client.0.smithi067.stdout:8/942: creat d0/d4/f138 x:0 0 0 2024-08-31T05:21:35.641 INFO:tasks.workunit.client.0.smithi067.stdout:8/943: chown d0/d2/da 1 1 2024-08-31T05:21:35.643 INFO:tasks.workunit.client.0.smithi067.stdout:8/944: write d0/d4/de/d1d/f102 [627328,54779] 0 2024-08-31T05:21:35.647 INFO:tasks.workunit.client.0.smithi067.stdout:8/945: mkdir d0/d2/da/dd/d139 0 2024-08-31T05:21:35.652 INFO:tasks.workunit.client.0.smithi067.stdout:7/590: truncate d14/d54/f66 1919242 0 2024-08-31T05:21:35.652 INFO:tasks.workunit.client.0.smithi067.stdout:2/798: sync 2024-08-31T05:21:35.652 INFO:tasks.workunit.client.0.smithi067.stdout:5/628: sync 2024-08-31T05:21:35.654 INFO:tasks.workunit.client.0.smithi067.stdout:7/591: symlink d14/d4a/la1 0 2024-08-31T05:21:35.655 INFO:tasks.workunit.client.0.smithi067.stdout:7/592: readlink d14/d4a/l98 0 2024-08-31T05:21:35.655 INFO:tasks.workunit.client.0.smithi067.stdout:5/629: write db/d15/d42/d36/d73/d77/f94 [432804,106754] 0 2024-08-31T05:21:35.659 INFO:tasks.workunit.client.0.smithi067.stdout:2/799: rename db/d12/d1a/d2b/d3d/d4f/d63 to db/d12/d1a/d2b/d3d/d69/d3b/dfe 0 2024-08-31T05:21:35.660 INFO:tasks.workunit.client.0.smithi067.stdout:7/593: truncate d14/d16/d5b/d94/f4f 1597239 0 2024-08-31T05:21:35.662 INFO:tasks.workunit.client.0.smithi067.stdout:5/630: rename db/d58/f91 to db/d1d/d3a/fc2 0 2024-08-31T05:21:35.665 INFO:tasks.workunit.client.0.smithi067.stdout:2/800: rename db/d8c/dcd/dac/ded to db/d12/d1a/d1e/d4d/dd5/dff 0 2024-08-31T05:21:35.669 INFO:tasks.workunit.client.0.smithi067.stdout:5/631: creat db/d26/d29/d31/d54/d8c/fc3 x:0 0 0 2024-08-31T05:21:35.672 INFO:tasks.workunit.client.0.smithi067.stdout:8/946: dwrite d0/d4/de/d1d/d2c/d68/f8d [0,4194304] 0 2024-08-31T05:21:35.673 INFO:tasks.workunit.client.0.smithi067.stdout:5/632: creat db/d15/d42/d36/fc4 x:0 0 0 2024-08-31T05:21:35.674 INFO:tasks.workunit.client.0.smithi067.stdout:8/947: chown d0/d4/de/lb7 13 1 2024-08-31T05:21:35.678 INFO:tasks.workunit.client.0.smithi067.stdout:8/948: fdatasync d0/d4/de/d1d/d7b/fba 0 2024-08-31T05:21:35.682 INFO:tasks.workunit.client.0.smithi067.stdout:5/633: symlink db/lc5 0 2024-08-31T05:21:35.695 INFO:tasks.workunit.client.0.smithi067.stdout:8/949: creat d0/f13a x:0 0 0 2024-08-31T05:21:35.698 INFO:tasks.workunit.client.0.smithi067.stdout:8/950: mkdir d0/d2/da/dd/d116/da5/dc7/d101/d10c/d13b 0 2024-08-31T05:21:35.700 INFO:tasks.workunit.client.0.smithi067.stdout:5/634: dread db/f88 [0,4194304] 0 2024-08-31T05:21:35.701 INFO:tasks.workunit.client.0.smithi067.stdout:8/951: symlink d0/d4/de/df0/d73/d84/da6/l13c 0 2024-08-31T05:21:35.703 INFO:tasks.workunit.client.0.smithi067.stdout:2/801: dread db/d12/d1a/f36 [0,4194304] 0 2024-08-31T05:21:35.704 INFO:tasks.workunit.client.0.smithi067.stdout:5/635: creat db/d26/d29/d81/fc6 x:0 0 0 2024-08-31T05:21:35.705 INFO:tasks.workunit.client.0.smithi067.stdout:5/636: write db/d15/d42/d36/fc4 [61484,41066] 0 2024-08-31T05:21:35.710 INFO:tasks.workunit.client.0.smithi067.stdout:2/802: creat db/d12/d1a/d2b/d3d/d69/dec/f100 x:0 0 0 2024-08-31T05:21:35.717 INFO:tasks.workunit.client.0.smithi067.stdout:8/952: write d0/d2/dc/d28/f118 [333542,75019] 0 2024-08-31T05:21:35.720 INFO:tasks.workunit.client.0.smithi067.stdout:2/803: truncate db/d12/d1a/d1e/d4d/f94 2755595 0 2024-08-31T05:21:35.724 INFO:tasks.workunit.client.0.smithi067.stdout:2/804: mknod db/d12/d1a/d2b/d3d/d69/d3b/d82/c101 0 2024-08-31T05:21:35.727 INFO:tasks.workunit.client.0.smithi067.stdout:2/805: creat db/d12/d1a/d2b/d3d/d4f/d6d/def/f102 x:0 0 0 2024-08-31T05:21:35.729 INFO:tasks.workunit.client.0.smithi067.stdout:2/806: symlink db/dd/d2d/db7/l103 0 2024-08-31T05:21:35.731 INFO:tasks.workunit.client.0.smithi067.stdout:8/953: dread d0/d2/dc/d3d/d98/dc2/fd8 [0,4194304] 0 2024-08-31T05:21:35.736 INFO:tasks.workunit.client.0.smithi067.stdout:8/954: dread d0/d4/de/d1d/d2c/d68/de3/fea [0,4194304] 0 2024-08-31T05:21:35.741 INFO:tasks.workunit.client.0.smithi067.stdout:8/955: creat d0/d4/de/df0/d73/d84/da6/db1/db3/f13d x:0 0 0 2024-08-31T05:21:35.748 INFO:tasks.workunit.client.0.smithi067.stdout:8/956: dwrite d0/d2/da/f113 [0,4194304] 0 2024-08-31T05:21:35.749 INFO:tasks.workunit.client.0.smithi067.stdout:2/807: truncate db/f70 1002795 0 2024-08-31T05:21:35.751 INFO:tasks.workunit.client.0.smithi067.stdout:2/808: read db/d12/d1a/d2b/d3d/f46 [3698957,946] 0 2024-08-31T05:21:35.761 INFO:tasks.workunit.client.0.smithi067.stdout:2/809: symlink db/d12/d1a/d2b/d3d/d4f/l104 0 2024-08-31T05:21:35.763 INFO:tasks.workunit.client.0.smithi067.stdout:8/957: link d0/d4/de/d1d/d2c/d68/c79 d0/d4/de/d1d/d7b/d89/c13e 0 2024-08-31T05:21:35.764 INFO:tasks.workunit.client.0.smithi067.stdout:8/958: truncate d0/d4/f7d 5004661 0 2024-08-31T05:21:35.769 INFO:tasks.workunit.client.0.smithi067.stdout:8/959: mknod d0/d4a/d12a/c13f 0 2024-08-31T05:21:35.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.771+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/999635701 --> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd0c8075b70 con 0x7fd0b4073f50 2024-08-31T05:21:35.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.772+0000 7fd0bf7fe640 1 -- 172.21.15.67:0/999635701 <== mgr.24383 v2:172.21.15.73:6828/1567621854 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7fd0c8075b70 con 0x7fd0b4073f50 2024-08-31T05:21:35.777 INFO:tasks.workunit.client.0.smithi067.stdout:8/960: dwrite d0/d4/de/df0/d73/d84/da6/db1/ff4 [0,4194304] 0 2024-08-31T05:21:35.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.776+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/999635701 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fd0b4073f50 msgr2=0x7fd0b4076410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:35.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.776+0000 7fd0ccd5e640 1 --2- 172.21.15.67:0/999635701 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fd0b4073f50 0x7fd0b4076410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8102760 tx=0x7fd0b8005f90 comp rx=0 tx=0).stop 2024-08-31T05:21:35.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.776+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/999635701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c8102900 msgr2=0x7fd0c81999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:35.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.776+0000 7fd0ccd5e640 1 --2- 172.21.15.67:0/999635701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c8102900 0x7fd0c81999b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0006010 tx=0x7fd0b0004570 comp rx=0 tx=0).stop 2024-08-31T05:21:35.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.776+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/999635701 shutdown_connections 2024-08-31T05:21:35.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.776+0000 7fd0ccd5e640 1 --2- 172.21.15.67:0/999635701 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fd0b4073f50 0x7fd0b4076410 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:35.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.776+0000 7fd0ccd5e640 1 --2- 172.21.15.67:0/999635701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c8102900 0x7fd0c81999b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:35.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.776+0000 7fd0ccd5e640 1 --2- 172.21.15.67:0/999635701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c8101700 0x7fd0c8199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:35.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.776+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/999635701 >> 172.21.15.67:0/999635701 conn(0x7fd0c80fce90 msgr2=0x7fd0c8074450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:35.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.776+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/999635701 shutdown_connections 2024-08-31T05:21:35.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.776+0000 7fd0ccd5e640 1 -- 172.21.15.67:0/999635701 wait complete. 2024-08-31T05:21:35.791 INFO:tasks.workunit.client.0.smithi067.stdout:8/961: mkdir d0/d2/dc/d140 0 2024-08-31T05:21:35.800 INFO:tasks.workunit.client.0.smithi067.stdout:8/962: creat d0/d4/de/d1d/d2c/f141 x:0 0 0 2024-08-31T05:21:35.806 INFO:tasks.workunit.client.0.smithi067.stdout:8/963: dwrite d0/d2/da/dd/d1f/f78 [0,4194304] 0 2024-08-31T05:21:35.840 INFO:tasks.workunit.client.0.smithi067.stdout:8/964: truncate d0/d4/de/df0/d73/d84/da6/fd3 859552 0 2024-08-31T05:21:35.848 INFO:tasks.workunit.client.0.smithi067.stdout:8/965: dwrite d0/d4/de/f11 [4194304,4194304] 0 2024-08-31T05:21:35.850 INFO:tasks.workunit.client.0.smithi067.stdout:8/966: write d0/d2/da/dd/d116/fd0 [2654103,117073] 0 2024-08-31T05:21:35.862 INFO:tasks.workunit.client.0.smithi067.stdout:8/967: creat d0/d4/de/f142 x:0 0 0 2024-08-31T05:21:35.875 INFO:tasks.workunit.client.0.smithi067.stdout:0/872: sync 2024-08-31T05:21:35.876 INFO:tasks.workunit.client.0.smithi067.stdout:0/873: chown d1/df/l116 27410 1 2024-08-31T05:21:35.881 INFO:tasks.workunit.client.0.smithi067.stdout:0/874: mkdir d1/df/d17/d43/d80/d113/dac/d8d/d11b 0 2024-08-31T05:21:35.882 INFO:tasks.workunit.client.0.smithi067.stdout:0/875: chown d1/d8/d42/fb0 2194 1 2024-08-31T05:21:35.885 INFO:tasks.workunit.client.0.smithi067.stdout:0/876: mkdir d1/d8/d66/d11c 0 2024-08-31T05:21:35.886 INFO:tasks.workunit.client.0.smithi067.stdout:8/968: write d0/d4/de/df0/d73/d84/da6/fd3 [936735,21487] 0 2024-08-31T05:21:35.888 INFO:tasks.workunit.client.0.smithi067.stdout:0/877: unlink d1/dd/d18/cce 0 2024-08-31T05:21:35.889 INFO:tasks.workunit.client.0.smithi067.stdout:8/969: symlink d0/d4/de/df0/d73/d84/da6/db1/l143 0 2024-08-31T05:21:35.890 INFO:tasks.workunit.client.0.smithi067.stdout:0/878: truncate d1/dd/d18/d52/dc6/f10d 184669 0 2024-08-31T05:21:35.892 INFO:tasks.workunit.client.0.smithi067.stdout:0/879: mknod d1/df/d17/d43/d80/d113/dac/c11d 0 2024-08-31T05:21:35.898 INFO:tasks.workunit.client.0.smithi067.stdout:0/880: mknod d1/df/d17/d94/d10f/c11e 0 2024-08-31T05:21:35.898 INFO:tasks.workunit.client.0.smithi067.stdout:8/970: write d0/d2/da/dd/d1f/fa8 [3575240,100817] 0 2024-08-31T05:21:35.900 INFO:tasks.workunit.client.0.smithi067.stdout:0/881: creat d1/d8/d77/f11f x:0 0 0 2024-08-31T05:21:35.902 INFO:tasks.workunit.client.0.smithi067.stdout:8/971: rename d0/f9 to d0/d2/dc/d3d/de5/f144 0 2024-08-31T05:21:35.904 INFO:tasks.workunit.client.0.smithi067.stdout:0/882: chown d1/d8/d42/cd1 11 1 2024-08-31T05:21:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.902+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2727255719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d30104b00 msgr2=0x7f6d30104f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.902+0000 7f6d34dfc640 1 --2- 172.21.15.67:0/2727255719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d30104b00 0x7f6d30104f80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009880 tx=0x7f6d2402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:21:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.902+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2727255719 shutdown_connections 2024-08-31T05:21:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.902+0000 7f6d34dfc640 1 --2- 172.21.15.67:0/2727255719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d30104b00 0x7f6d30104f80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.902+0000 7f6d34dfc640 1 --2- 172.21.15.67:0/2727255719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d30103900 0x7f6d30103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.902+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2727255719 >> 172.21.15.67:0/2727255719 conn(0x7f6d300ff090 msgr2=0x7f6d301014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.902+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2727255719 shutdown_connections 2024-08-31T05:21:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.902+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2727255719 wait complete. 2024-08-31T05:21:35.906 INFO:tasks.workunit.client.0.smithi067.stdout:0/883: write d1/d8/f16 [1392463,126828] 0 2024-08-31T05:21:35.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.903+0000 7f6d34dfc640 1 Processor -- start 2024-08-31T05:21:35.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.903+0000 7f6d34dfc640 1 -- start start 2024-08-31T05:21:35.907 INFO:tasks.workunit.client.0.smithi067.stdout:8/972: creat d0/d4/de/df0/d73/d84/da6/f145 x:0 0 0 2024-08-31T05:21:35.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.904+0000 7f6d34dfc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d30103900 0x7f6d30199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:35.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.904+0000 7f6d34dfc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d30104b00 0x7f6d30199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:35.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.904+0000 7f6d2e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d30103900 0x7f6d30199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:35.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.904+0000 7f6d2e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d30103900 0x7f6d30199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42522/0 (socket says 172.21.15.67:42522) 2024-08-31T05:21:35.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.904+0000 7f6d2e59c640 1 -- 172.21.15.67:0/2520194153 learned_addr learned my addr 172.21.15.67:0/2520194153 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:21:35.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.904+0000 7f6d34dfc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3010c740 con 0x7f6d30103900 2024-08-31T05:21:35.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.904+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2520194153 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3010c5c0 con 0x7f6d30104b00 2024-08-31T05:21:35.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.904+0000 7f6d2dd9b640 1 --2- 172.21.15.67:0/2520194153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d30104b00 0x7f6d30199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:35.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.904+0000 7f6d2e59c640 1 -- 172.21.15.67:0/2520194153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d30104b00 msgr2=0x7f6d30199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:35.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.904+0000 7f6d2e59c640 1 --2- 172.21.15.67:0/2520194153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d30104b00 0x7f6d30199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:35.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.904+0000 7f6d2e59c640 1 -- 172.21.15.67:0/2520194153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d30199ff0 con 0x7f6d30103900 2024-08-31T05:21:35.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.905+0000 7f6d2e59c640 1 --2- 172.21.15.67:0/2520194153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d30103900 0x7f6d30199430 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000e940 tx=0x7f6d2000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:35.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.905+0000 7f6d1f7fe640 1 -- 172.21.15.67:0/2520194153 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d2000cac0 con 0x7f6d30103900 2024-08-31T05:21:35.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.905+0000 7f6d1f7fe640 1 -- 172.21.15.67:0/2520194153 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d2000cc60 con 0x7f6d30103900 2024-08-31T05:21:35.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.906+0000 7f6d1f7fe640 1 -- 172.21.15.67:0/2520194153 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d20003e30 con 0x7f6d30103900 2024-08-31T05:21:35.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.906+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2520194153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d30076430 con 0x7f6d30103900 2024-08-31T05:21:35.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.906+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2520194153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d30076990 con 0x7f6d30103900 2024-08-31T05:21:35.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.907+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2520194153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d30103d00 con 0x7f6d30103900 2024-08-31T05:21:35.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.908+0000 7f6d1f7fe640 1 -- 172.21.15.67:0/2520194153 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7f6d20004000 con 0x7f6d30103900 2024-08-31T05:21:35.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.908+0000 7f6d1f7fe640 1 --2- 172.21.15.67:0/2520194153 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f6d18073f50 0x7f6d18076410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:35.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.908+0000 7f6d1f7fe640 1 -- 172.21.15.67:0/2520194153 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f6d20095a60 con 0x7f6d30103900 2024-08-31T05:21:35.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.909+0000 7f6d2dd9b640 1 --2- 172.21.15.67:0/2520194153 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f6d18073f50 0x7f6d18076410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:35.912 INFO:tasks.workunit.client.0.smithi067.stdout:8/973: mknod d0/d4/de/d1d/d2c/d68/c146 0 2024-08-31T05:21:35.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.910+0000 7f6d2dd9b640 1 --2- 172.21.15.67:0/2520194153 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f6d18073f50 0x7f6d18076410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6d24000c00 tx=0x7f6d240058d0 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:35.913 INFO:tasks.workunit.client.0.smithi067.stdout:0/884: symlink d1/d8/d66/d11c/l120 0 2024-08-31T05:21:35.916 INFO:tasks.workunit.client.0.smithi067.stdout:8/974: dread d0/d2/da/dd/d116/f76 [0,4194304] 0 2024-08-31T05:21:35.916 INFO:tasks.workunit.client.0.smithi067.stdout:0/885: symlink d1/d8/d77/l121 0 2024-08-31T05:21:35.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:35.915+0000 7f6d1f7fe640 1 -- 172.21.15.67:0/2520194153 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f6d2005d4b0 con 0x7f6d30103900 2024-08-31T05:21:35.924 INFO:tasks.workunit.client.0.smithi067.stdout:8/975: dwrite d0/d2/f24 [4194304,4194304] 0 2024-08-31T05:21:35.927 INFO:tasks.workunit.client.0.smithi067.stdout:0/886: link d1/l5c d1/df/d17/d43/d48/d6a/l122 0 2024-08-31T05:21:35.928 INFO:tasks.workunit.client.0.smithi067.stdout:0/887: stat d1/df/d17/d43/d80/d113/dac/d8d/fca 0 2024-08-31T05:21:35.929 INFO:tasks.workunit.client.0.smithi067.stdout:8/976: write d0/d2/f83 [291599,91721] 0 2024-08-31T05:21:35.932 INFO:tasks.workunit.client.0.smithi067.stdout:8/977: mkdir d0/d2/d147 0 2024-08-31T05:21:35.933 INFO:tasks.workunit.client.0.smithi067.stdout:0/888: dread - d1/df/d17/d43/d48/d6a/d84/db7/fcf zero size 2024-08-31T05:21:35.933 INFO:tasks.workunit.client.0.smithi067.stdout:8/978: fsync d0/d4/de/d1d/f94 0 2024-08-31T05:21:35.935 INFO:tasks.workunit.client.0.smithi067.stdout:8/979: dread - d0/d4/de/df0/d73/d84/da6/f145 zero size 2024-08-31T05:21:35.938 INFO:tasks.workunit.client.0.smithi067.stdout:0/889: creat d1/dd/d71/f123 x:0 0 0 2024-08-31T05:21:35.938 INFO:tasks.workunit.client.0.smithi067.stdout:0/890: chown d1/df/l116 626696 1 2024-08-31T05:21:35.943 INFO:tasks.workunit.client.0.smithi067.stdout:0/891: creat d1/dd/d18/d52/dc6/df5/f124 x:0 0 0 2024-08-31T05:21:35.946 INFO:tasks.workunit.client.0.smithi067.stdout:8/980: dread d0/d4/de/f34 [0,4194304] 0 2024-08-31T05:21:35.952 INFO:tasks.workunit.client.0.smithi067.stdout:8/981: unlink d0/d2/dc/d3d/d98/dc2/fd8 0 2024-08-31T05:21:35.957 INFO:tasks.workunit.client.0.smithi067.stdout:8/982: rename d0/d4/de/df0/d73/d103 to d0/d2/da/dd/d1f/d148 0 2024-08-31T05:21:35.959 INFO:tasks.workunit.client.0.smithi067.stdout:8/983: write d0/d2/dc/f49 [379950,39577] 0 2024-08-31T05:21:35.963 INFO:tasks.workunit.client.0.smithi067.stdout:0/892: dwrite d1/df/d17/d43/d48/d6a/d84/db7/fd8 [0,4194304] 0 2024-08-31T05:21:35.965 INFO:tasks.workunit.client.0.smithi067.stdout:8/984: creat d0/d4/de/f149 x:0 0 0 2024-08-31T05:21:35.966 INFO:tasks.workunit.client.0.smithi067.stdout:8/985: truncate d0/d4/f71 4655096 0 2024-08-31T05:21:35.968 INFO:tasks.workunit.client.0.smithi067.stdout:0/893: mkdir d1/dd/d71/d125 0 2024-08-31T05:21:35.970 INFO:tasks.workunit.client.0.smithi067.stdout:8/986: rmdir d0/d4/de/df0/d73/d84/da6/db1/db3 39 2024-08-31T05:21:35.971 INFO:tasks.workunit.client.0.smithi067.stdout:8/987: chown d0/d2/da/dd/c43 701088 1 2024-08-31T05:21:35.976 INFO:tasks.workunit.client.0.smithi067.stdout:0/894: symlink d1/d8/d42/l126 0 2024-08-31T05:21:35.978 INFO:tasks.workunit.client.0.smithi067.stdout:8/988: mkdir d0/d4/de/d1d/d14a 0 2024-08-31T05:21:35.983 INFO:tasks.workunit.client.0.smithi067.stdout:0/895: mkdir d1/df/d17/d43/d48/d6a/d84/d127 0 2024-08-31T05:21:35.985 INFO:tasks.workunit.client.0.smithi067.stdout:0/896: mknod d1/dd5/dff/c128 0 2024-08-31T05:21:35.987 INFO:tasks.workunit.client.0.smithi067.stdout:0/897: mkdir d1/df/d17/d94/d129 0 2024-08-31T05:21:35.991 INFO:tasks.workunit.client.0.smithi067.stdout:0/898: link d1/d8/ff0 d1/df/d17/d43/d48/d100/f12a 0 2024-08-31T05:21:35.993 INFO:tasks.workunit.client.0.smithi067.stdout:0/899: write d1/d8/fee [339215,11658] 0 2024-08-31T05:21:35.993 INFO:tasks.workunit.client.0.smithi067.stdout:8/989: dwrite d0/d74/fac [0,4194304] 0 2024-08-31T05:21:35.998 INFO:tasks.workunit.client.0.smithi067.stdout:8/990: rmdir d0/d2/da/dd/d1f 39 2024-08-31T05:21:35.999 INFO:tasks.workunit.client.0.smithi067.stdout:8/991: fsync d0/d2/dc/d28/f81 0 2024-08-31T05:21:36.003 INFO:tasks.workunit.client.0.smithi067.stdout:0/900: mkdir d1/df/d17/d43/d48/d6a/d84/d127/d12b 0 2024-08-31T05:21:36.010 INFO:tasks.workunit.client.0.smithi067.stdout:8/992: mkdir d0/d4a/d12a/d14b 0 2024-08-31T05:21:36.035 INFO:tasks.workunit.client.0.smithi067.stdout:0/901: fdatasync d1/df/d17/d43/d80/fc7 0 2024-08-31T05:21:36.036 INFO:tasks.workunit.client.0.smithi067.stdout:8/993: symlink d0/d2/da/dd/d116/da5/dc7/l14c 0 2024-08-31T05:21:36.039 INFO:tasks.workunit.client.0.smithi067.stdout:0/902: read d1/d8/d42/fbc [2984609,123258] 0 2024-08-31T05:21:36.043 INFO:tasks.workunit.client.0.smithi067.stdout:0/903: unlink d1/d8/d42/fcd 0 2024-08-31T05:21:36.044 INFO:tasks.workunit.client.0.smithi067.stdout:8/994: dread d0/d4/de/d1d/d2c/f8a [0,4194304] 0 2024-08-31T05:21:36.045 INFO:tasks.workunit.client.0.smithi067.stdout:8/995: stat d0/d4/de/d1d/d2c 0 2024-08-31T05:21:36.046 INFO:tasks.workunit.client.0.smithi067.stdout:0/904: mknod d1/d50/daa/c12c 0 2024-08-31T05:21:36.060 INFO:tasks.workunit.client.0.smithi067.stdout:8/996: getdents d0/d4/de/d1d/d2c 0 2024-08-31T05:21:36.061 INFO:tasks.workunit.client.0.smithi067.stdout:8/997: fdatasync d0/d4/de/df0/d73/d84/da6/db1/ff4 0 2024-08-31T05:21:36.063 INFO:tasks.workunit.client.0.smithi067.stdout:8/998: dread - d0/d4/de/df0/d73/d84/da6/db1/d8c/f12d zero size 2024-08-31T05:21:36.068 INFO:tasks.workunit.client.0.smithi067.stdout:8/999: dread d0/d2/dc/d3d/de5/f10e [0,4194304] 0 2024-08-31T05:21:36.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:35 smithi067 ceph-mon[17432]: Upgrade: Updating mgr.smithi067.hftacj 2024-08-31T05:21:36.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:35 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:36.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:35 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.hftacj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T05:21:36.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:35 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.hftacj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T05:21:36.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:35 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T05:21:36.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:35 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:21:36.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:35 smithi067 ceph-mon[17432]: Deploying daemon mgr.smithi067.hftacj on smithi067 2024-08-31T05:21:36.075 INFO:tasks.workunit.client.0.smithi067.stdout:0/905: dwrite d1/d8/fa8 [4194304,4194304] 0 2024-08-31T05:21:36.079 INFO:tasks.workunit.client.0.smithi067.stdout:0/906: mknod d1/dd5/dff/c12d 0 2024-08-31T05:21:36.085 INFO:tasks.workunit.client.0.smithi067.stdout:1/760: sync 2024-08-31T05:21:36.085 INFO:tasks.workunit.client.0.smithi067.stdout:9/716: sync 2024-08-31T05:21:36.085 INFO:tasks.workunit.client.0.smithi067.stdout:6/872: sync 2024-08-31T05:21:36.086 INFO:tasks.workunit.client.0.smithi067.stdout:1/761: fsync d3/f15 0 2024-08-31T05:21:36.088 INFO:tasks.workunit.client.0.smithi067.stdout:9/717: chown dd/df/d8e/dcc/fdc 4839 1 2024-08-31T05:21:36.092 INFO:tasks.workunit.client.0.smithi067.stdout:0/907: dwrite d1/df/d17/d43/d80/fe9 [0,4194304] 0 2024-08-31T05:21:36.097 INFO:tasks.workunit.client.0.smithi067.stdout:1/762: dwrite d3/d23/d79/fb3 [0,4194304] 0 2024-08-31T05:21:36.101 INFO:tasks.workunit.client.0.smithi067.stdout:0/908: symlink d1/df/d17/d94/d10f/l12e 0 2024-08-31T05:21:36.104 INFO:tasks.workunit.client.0.smithi067.stdout:1/763: chown d3/d23/d2d/d2e/d34/d66/de8/d50/l9c 2 1 2024-08-31T05:21:36.108 INFO:tasks.workunit.client.0.smithi067.stdout:9/718: link dd/df/f12 dd/df/d25/ff1 0 2024-08-31T05:21:36.112 INFO:tasks.workunit.client.0.smithi067.stdout:1/764: symlink d3/d23/d2d/d2e/d34/d66/de8/d50/db5/dc2/l115 0 2024-08-31T05:21:36.115 INFO:tasks.workunit.client.0.smithi067.stdout:1/765: dread d3/d23/db1/dd4/fdb [0,4194304] 0 2024-08-31T05:21:36.116 INFO:tasks.workunit.client.0.smithi067.stdout:1/766: truncate d3/f52 4628120 0 2024-08-31T05:21:36.116 INFO:tasks.workunit.client.0.smithi067.stdout:9/719: read dd/df/d3c/f51 [984638,81541] 0 2024-08-31T05:21:36.119 INFO:tasks.workunit.client.0.smithi067.stdout:9/720: creat dd/df/d8e/d94/ff2 x:0 0 0 2024-08-31T05:21:36.121 INFO:tasks.workunit.client.0.smithi067.stdout:1/767: mkdir d3/dfc/df6/d101/d116 0 2024-08-31T05:21:36.121 INFO:tasks.workunit.client.0.smithi067.stdout:0/909: write d1/df/d29/d37/f8e [1158551,54443] 0 2024-08-31T05:21:36.122 INFO:tasks.workunit.client.0.smithi067.stdout:1/768: stat d3/d36/f53 0 2024-08-31T05:21:36.122 INFO:tasks.workunit.client.0.smithi067.stdout:9/721: creat dd/da2/ff3 x:0 0 0 2024-08-31T05:21:36.126 INFO:tasks.workunit.client.0.smithi067.stdout:0/910: creat d1/df/d17/d94/f12f x:0 0 0 2024-08-31T05:21:36.128 INFO:tasks.workunit.client.0.smithi067.stdout:1/769: unlink d3/ca8 0 2024-08-31T05:21:36.132 INFO:tasks.workunit.client.0.smithi067.stdout:1/770: mkdir d3/d23/d2d/d10d/d117 0 2024-08-31T05:21:36.136 INFO:tasks.workunit.client.0.smithi067.stdout:9/722: rename dd/df/d3c/fbc to dd/df/d25/d3b/d50/d73/ff4 0 2024-08-31T05:21:36.138 INFO:tasks.workunit.client.0.smithi067.stdout:0/911: link d1/df/d17/l75 d1/d8/l130 0 2024-08-31T05:21:36.145 INFO:tasks.workunit.client.0.smithi067.stdout:0/912: dwrite d1/dd/d18/d52/dc6/f10d [0,4194304] 0 2024-08-31T05:21:36.152 INFO:tasks.workunit.client.0.smithi067.stdout:0/913: mkdir d1/d8/d42/d131 0 2024-08-31T05:21:36.160 INFO:tasks.workunit.client.0.smithi067.stdout:1/771: dwrite d3/d23/d5d/f61 [0,4194304] 0 2024-08-31T05:21:36.165 INFO:tasks.workunit.client.0.smithi067.stdout:9/723: dwrite dd/df/fbb [0,4194304] 0 2024-08-31T05:21:36.177 INFO:tasks.workunit.client.0.smithi067.stdout:0/914: write d1/df/d29/d86/db1/ff7 [366232,8107] 0 2024-08-31T05:21:36.179 INFO:tasks.workunit.client.0.smithi067.stdout:9/724: creat dd/df/d5b/d5d/dea/ff5 x:0 0 0 2024-08-31T05:21:36.185 INFO:tasks.workunit.client.0.smithi067.stdout:1/772: dwrite d3/d36/f65 [0,4194304] 0 2024-08-31T05:21:36.190 INFO:tasks.workunit.client.0.smithi067.stdout:9/725: dwrite dd/d63/da3/faa [0,4194304] 0 2024-08-31T05:21:36.194 INFO:tasks.workunit.client.0.smithi067.stdout:1/773: rename d3/d23/d2d/d2e/d34/d66/de8/c22 to d3/dfc/df6/c118 0 2024-08-31T05:21:36.197 INFO:tasks.workunit.client.0.smithi067.stdout:9/726: dread dd/df/f12 [0,4194304] 0 2024-08-31T05:21:36.198 INFO:tasks.workunit.client.0.smithi067.stdout:9/727: read - dd/da2/ff3 zero size 2024-08-31T05:21:36.199 INFO:tasks.workunit.client.0.smithi067.stdout:0/915: truncate d1/df/d17/d43/d80/d113/f89 3321832 0 2024-08-31T05:21:36.200 INFO:tasks.workunit.client.0.smithi067.stdout:1/774: mkdir d3/d36/d119 0 2024-08-31T05:21:36.201 INFO:tasks.workunit.client.0.smithi067.stdout:1/775: fdatasync d3/d23/f98 0 2024-08-31T05:21:36.204 INFO:tasks.workunit.client.0.smithi067.stdout:9/728: symlink dd/df/d3c/dbe/dd4/de0/lf6 0 2024-08-31T05:21:36.218 INFO:tasks.workunit.client.0.smithi067.stdout:1/776: write d3/f5 [487399,118561] 0 2024-08-31T05:21:36.221 INFO:tasks.workunit.client.0.smithi067.stdout:1/777: mknod d3/dfc/df6/d101/c11a 0 2024-08-31T05:21:36.222 INFO:tasks.workunit.client.0.smithi067.stdout:0/916: dwrite d1/df/f6b [0,4194304] 0 2024-08-31T05:21:36.224 INFO:tasks.workunit.client.0.smithi067.stdout:1/778: truncate d3/f24 1176314 0 2024-08-31T05:21:36.225 INFO:tasks.workunit.client.0.smithi067.stdout:0/917: mknod d1/df/d17/d43/d80/c132 0 2024-08-31T05:21:36.228 INFO:tasks.workunit.client.0.smithi067.stdout:1/779: creat d3/d23/d2d/d2e/d34/d66/de8/d50/f11b x:0 0 0 2024-08-31T05:21:36.230 INFO:tasks.workunit.client.0.smithi067.stdout:0/918: mkdir d1/df/d17/d43/d48/d6a/d84/d127/d12b/d133 0 2024-08-31T05:21:36.231 INFO:tasks.workunit.client.0.smithi067.stdout:1/780: creat d3/d23/db1/db6/dc4/f11c x:0 0 0 2024-08-31T05:21:36.235 INFO:tasks.workunit.client.0.smithi067.stdout:9/729: dread dd/d63/fc5 [0,4194304] 0 2024-08-31T05:21:36.236 INFO:tasks.workunit.client.0.smithi067.stdout:0/919: dread d1/dd/d18/d52/dc6/f10d [0,4194304] 0 2024-08-31T05:21:36.237 INFO:tasks.workunit.client.0.smithi067.stdout:1/781: creat d3/d23/d2d/d2e/d34/d66/d72/f11d x:0 0 0 2024-08-31T05:21:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.235+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2520194153 --> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6d300623d0 con 0x7f6d18073f50 2024-08-31T05:21:36.238 INFO:tasks.workunit.client.0.smithi067.stdout:0/920: write d1/df/d29/d86/db1/ff7 [964998,116452] 0 2024-08-31T05:21:36.242 INFO:tasks.workunit.client.0.smithi067.stdout:1/782: symlink d3/d23/d2d/d2e/d34/da3/l11e 0 2024-08-31T05:21:36.242 INFO:tasks.workunit.client.0.smithi067.stdout:1/783: fdatasync d3/d23/f98 0 2024-08-31T05:21:36.245 INFO:tasks.workunit.client.0.smithi067.stdout:9/730: truncate dd/d63/da3/fdd 2469199 0 2024-08-31T05:21:36.247 INFO:tasks.workunit.client.0.smithi067.stdout:1/784: dread - d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/fcd zero size 2024-08-31T05:21:36.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.245+0000 7f6d1f7fe640 1 -- 172.21.15.67:0/2520194153 <== mgr.24383 v2:172.21.15.73:6828/1567621854 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f6d300623d0 con 0x7f6d18073f50 2024-08-31T05:21:36.248 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:21:36.248 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (6m) 63s ago 8m 25.1M - 0.25.0 c8568f914cd2 cad2b6757f0e 2024-08-31T05:21:36.248 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 starting - - - - 2024-08-31T05:21:36.248 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 starting - - - - 2024-08-31T05:21:36.248 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (8m) 63s ago 8m 6895k - 19.1.1-242-g244a32d3 395b9209a980 a47c71179c57 2024-08-31T05:21:36.248 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (7m) 65s ago 7m 6895k - 19.1.1-242-g244a32d3 395b9209a980 5f2ce08c4451 2024-08-31T05:21:36.248 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (6m) 63s ago 8m 76.3M - 9.4.12 2bacad6d85d8 ac51e53c0deb 2024-08-31T05:21:36.248 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (3m) 63s ago 3m 126M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:21:36.248 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (3m) 63s ago 3m 141M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:21:36.248 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (3m) 65s ago 3m 12.3M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:21:36.248 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (3m) 65s ago 3m 14.1M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:21:36.248 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:9283,8765,8443 running (9m) 63s ago 9m 281M - 19.1.1-242-g244a32d3 395b9209a980 436d56f83ade 2024-08-31T05:21:36.249 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (92s) 65s ago 7m 564M - 19.3.0-4560-gd19e6118 79f4cde5e369 d18b213f9418 2024-08-31T05:21:36.249 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (9m) 63s ago 9m 53.8M 2048M 19.1.1-242-g244a32d3 395b9209a980 7082a38c8108 2024-08-31T05:21:36.249 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (7m) 65s ago 7m 38.1M 2048M 19.1.1-242-g244a32d3 395b9209a980 30ccf0ed274b 2024-08-31T05:21:36.249 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (8m) 63s ago 8m 16.8M - 1.5.0 0da6a335fe13 d7c795c5bd95 2024-08-31T05:21:36.249 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (7m) 65s ago 7m 16.4M - 1.5.0 0da6a335fe13 f718603a0e92 2024-08-31T05:21:36.249 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (6m) 63s ago 6m 72.9M 1216M 19.1.1-242-g244a32d3 395b9209a980 b9f3f60b65f9 2024-08-31T05:21:36.249 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (5m) 63s ago 5m 82.7M 1216M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:21:36.249 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (5m) 63s ago 5m 72.1M 1216M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:21:36.249 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (5m) 65s ago 5m 88.5M 2240M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:21:36.249 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (4m) 65s ago 4m 84.1M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:21:36.249 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (4m) 65s ago 4m 76.5M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:21:36.249 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 starting - - - - 2024-08-31T05:21:36.250 INFO:tasks.workunit.client.0.smithi067.stdout:9/731: rename dd/f1e to dd/d4d/dca/ff7 0 2024-08-31T05:21:36.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.248+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2520194153 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f6d18073f50 msgr2=0x7f6d18076410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:36.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.248+0000 7f6d34dfc640 1 --2- 172.21.15.67:0/2520194153 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f6d18073f50 0x7f6d18076410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6d24000c00 tx=0x7f6d240058d0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.248+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2520194153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d30103900 msgr2=0x7f6d30199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:36.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.248+0000 7f6d34dfc640 1 --2- 172.21.15.67:0/2520194153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d30103900 0x7f6d30199430 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000e940 tx=0x7f6d2000ee00 comp rx=0 tx=0).stop 2024-08-31T05:21:36.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.248+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2520194153 shutdown_connections 2024-08-31T05:21:36.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.248+0000 7f6d34dfc640 1 --2- 172.21.15.67:0/2520194153 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f6d18073f50 0x7f6d18076410 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.248+0000 7f6d34dfc640 1 --2- 172.21.15.67:0/2520194153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d30104b00 0x7f6d30199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.248+0000 7f6d34dfc640 1 --2- 172.21.15.67:0/2520194153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d30103900 0x7f6d30199430 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.248+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2520194153 >> 172.21.15.67:0/2520194153 conn(0x7f6d300ff090 msgr2=0x7f6d30107f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:36.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.248+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2520194153 shutdown_connections 2024-08-31T05:21:36.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.249+0000 7f6d34dfc640 1 -- 172.21.15.67:0/2520194153 wait complete. 2024-08-31T05:21:36.252 INFO:tasks.workunit.client.0.smithi067.stdout:9/732: write dd/df/d25/f5f [4533582,123506] 0 2024-08-31T05:21:36.254 INFO:tasks.workunit.client.0.smithi067.stdout:1/785: dwrite d3/d23/d2d/d2e/d34/f107 [0,4194304] 0 2024-08-31T05:21:36.255 INFO:tasks.workunit.client.0.smithi067.stdout:1/786: readlink d3/d23/l25 0 2024-08-31T05:21:36.257 INFO:tasks.workunit.client.0.smithi067.stdout:0/921: write d1/df/d29/d86/fd7 [281398,88794] 0 2024-08-31T05:21:36.259 INFO:tasks.workunit.client.0.smithi067.stdout:9/733: creat dd/df/d8e/ff8 x:0 0 0 2024-08-31T05:21:36.260 INFO:tasks.workunit.client.0.smithi067.stdout:9/734: chown f6 1958 1 2024-08-31T05:21:36.262 INFO:tasks.workunit.client.0.smithi067.stdout:0/922: mknod d1/df/d29/d86/dc0/c134 0 2024-08-31T05:21:36.266 INFO:tasks.workunit.client.0.smithi067.stdout:1/787: rename d3/d23/d2d/d2e/d34/da3/l11e to d3/d23/db1/db6/dc4/l11f 0 2024-08-31T05:21:36.267 INFO:tasks.workunit.client.0.smithi067.stdout:1/788: truncate d3/d8b/fd8 449347 0 2024-08-31T05:21:36.268 INFO:tasks.workunit.client.0.smithi067.stdout:9/735: creat dd/d63/d72/ff9 x:0 0 0 2024-08-31T05:21:36.270 INFO:tasks.workunit.client.0.smithi067.stdout:0/923: mknod d1/dd/d18/d52/dc6/df5/c135 0 2024-08-31T05:21:36.272 INFO:tasks.workunit.client.0.smithi067.stdout:0/924: chown d1/dd/d4d/lbb 171882 1 2024-08-31T05:21:36.272 INFO:tasks.workunit.client.0.smithi067.stdout:0/925: stat d1/dd 0 2024-08-31T05:21:36.273 INFO:tasks.workunit.client.0.smithi067.stdout:9/736: creat dd/df/d5b/ffa x:0 0 0 2024-08-31T05:21:36.276 INFO:tasks.workunit.client.0.smithi067.stdout:1/789: dwrite d3/d23/d2d/d2e/d34/d66/d72/f77 [0,4194304] 0 2024-08-31T05:21:36.277 INFO:tasks.workunit.client.0.smithi067.stdout:1/790: readlink d3/d23/d2d/d2e/d34/d66/l86 0 2024-08-31T05:21:36.279 INFO:tasks.workunit.client.0.smithi067.stdout:1/791: readlink d3/d23/d2d/d2e/d34/d66/la0 0 2024-08-31T05:21:36.280 INFO:tasks.workunit.client.0.smithi067.stdout:0/926: creat d1/df/d29/d86/dc0/f136 x:0 0 0 2024-08-31T05:21:36.287 INFO:tasks.workunit.client.0.smithi067.stdout:1/792: link d3/d23/d2d/d2e/c9b d3/d23/d2d/d2e/d34/d66/de8/d50/db5/dc2/c120 0 2024-08-31T05:21:36.291 INFO:tasks.workunit.client.0.smithi067.stdout:1/793: fdatasync d3/d23/d2d/d2e/d34/d66/d72/f4f 0 2024-08-31T05:21:36.295 INFO:tasks.workunit.client.0.smithi067.stdout:1/794: chown d3/lb7 156318 1 2024-08-31T05:21:36.296 INFO:tasks.workunit.client.0.smithi067.stdout:1/795: fdatasync d3/d23/d2d/d2e/d34/d66/d72/f5a 0 2024-08-31T05:21:36.296 INFO:tasks.workunit.client.0.smithi067.stdout:1/796: readlink d3/lb7 0 2024-08-31T05:21:36.300 INFO:tasks.workunit.client.0.smithi067.stdout:1/797: mknod d3/df8/c121 0 2024-08-31T05:21:36.301 INFO:tasks.workunit.client.0.smithi067.stdout:1/798: truncate d3/dfc/ff7 823024 0 2024-08-31T05:21:36.303 INFO:tasks.workunit.client.0.smithi067.stdout:9/737: write dd/d63/f88 [37326,92155] 0 2024-08-31T05:21:36.305 INFO:tasks.workunit.client.0.smithi067.stdout:1/799: creat d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/f122 x:0 0 0 2024-08-31T05:21:36.307 INFO:tasks.workunit.client.0.smithi067.stdout:0/927: write d1/dd/d4d/f104 [1026181,65356] 0 2024-08-31T05:21:36.309 INFO:tasks.workunit.client.0.smithi067.stdout:1/800: creat d3/d23/d2d/d2e/d34/d66/de8/f123 x:0 0 0 2024-08-31T05:21:36.311 INFO:tasks.workunit.client.0.smithi067.stdout:1/801: write d3/d23/d2d/d2e/d34/d66/de8/f51 [4519574,50985] 0 2024-08-31T05:21:36.311 INFO:tasks.workunit.client.0.smithi067.stdout:0/928: creat d1/d8/d77/f137 x:0 0 0 2024-08-31T05:21:36.313 INFO:tasks.workunit.client.0.smithi067.stdout:1/802: stat d3/d23/d2d/d2e/d34/d66/de8/c75 0 2024-08-31T05:21:36.316 INFO:tasks.workunit.client.0.smithi067.stdout:0/929: unlink d1/df/d29/c70 0 2024-08-31T05:21:36.321 INFO:tasks.workunit.client.0.smithi067.stdout:9/738: dread dd/df/d25/f6c [0,4194304] 0 2024-08-31T05:21:36.323 INFO:tasks.workunit.client.0.smithi067.stdout:1/803: link d3/f55 d3/d23/db1/db6/f124 0 2024-08-31T05:21:36.331 INFO:tasks.workunit.client.0.smithi067.stdout:9/739: creat dd/d63/ffb x:0 0 0 2024-08-31T05:21:36.336 INFO:tasks.workunit.client.0.smithi067.stdout:0/930: dwrite d1/dd/f21 [4194304,4194304] 0 2024-08-31T05:21:36.339 INFO:tasks.workunit.client.0.smithi067.stdout:0/931: rmdir d1/dd/d18/d52/dc6 39 2024-08-31T05:21:36.342 INFO:tasks.workunit.client.0.smithi067.stdout:4/882: sync 2024-08-31T05:21:36.343 INFO:tasks.workunit.client.0.smithi067.stdout:4/883: dread d4/d1f/d9e/f110 [0,4194304] 0 2024-08-31T05:21:36.345 INFO:tasks.workunit.client.0.smithi067.stdout:4/884: chown d4/da5/cc3 1 1 2024-08-31T05:21:36.346 INFO:tasks.workunit.client.0.smithi067.stdout:0/932: truncate d1/df/d17/d94/fe5 475929 0 2024-08-31T05:21:36.348 INFO:tasks.workunit.client.0.smithi067.stdout:9/740: dread dd/df/d5b/f6e [0,4194304] 0 2024-08-31T05:21:36.350 INFO:tasks.workunit.client.0.smithi067.stdout:4/885: symlink d4/d56/l135 0 2024-08-31T05:21:36.352 INFO:tasks.workunit.client.0.smithi067.stdout:4/886: chown d4/c45 1933078 1 2024-08-31T05:21:36.356 INFO:tasks.workunit.client.0.smithi067.stdout:9/741: dwrite dd/df/d8e/d94/ff2 [0,4194304] 0 2024-08-31T05:21:36.357 INFO:tasks.workunit.client.0.smithi067.stdout:0/933: unlink d1/d8/d42/d98/df1/l102 0 2024-08-31T05:21:36.358 INFO:tasks.workunit.client.0.smithi067.stdout:4/887: creat d4/d9/d5a/dfe/f136 x:0 0 0 2024-08-31T05:21:36.359 INFO:tasks.workunit.client.0.smithi067.stdout:4/888: fsync d4/d42/fcb 0 2024-08-31T05:21:36.360 INFO:tasks.workunit.client.0.smithi067.stdout:9/742: truncate dd/d20/f2b 1242175 0 2024-08-31T05:21:36.364 INFO:tasks.workunit.client.0.smithi067.stdout:0/934: mkdir d1/dd/d18/d52/dc6/d138 0 2024-08-31T05:21:36.380 INFO:tasks.workunit.client.0.smithi067.stdout:4/889: creat d4/d1e/f137 x:0 0 0 2024-08-31T05:21:36.385 INFO:tasks.workunit.client.0.smithi067.stdout:9/743: write dd/df/d3c/f84 [20758,61617] 0 2024-08-31T05:21:36.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.383+0000 7fae32bf0640 1 -- 172.21.15.67:0/2208385042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae2c104ae0 msgr2=0x7fae2c106ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:36.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.383+0000 7fae32bf0640 1 --2- 172.21.15.67:0/2208385042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae2c104ae0 0x7fae2c106ed0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fae180098b0 tx=0x7fae1802a4d0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.383+0000 7fae32bf0640 1 -- 172.21.15.67:0/2208385042 shutdown_connections 2024-08-31T05:21:36.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.383+0000 7fae32bf0640 1 --2- 172.21.15.67:0/2208385042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae2c104ae0 0x7fae2c106ed0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.383+0000 7fae32bf0640 1 --2- 172.21.15.67:0/2208385042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae2c1021b0 0x7fae2c1045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.383+0000 7fae32bf0640 1 -- 172.21.15.67:0/2208385042 >> 172.21.15.67:0/2208385042 conn(0x7fae2c0fbdd0 msgr2=0x7fae2c0fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:36.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.383+0000 7fae32bf0640 1 -- 172.21.15.67:0/2208385042 shutdown_connections 2024-08-31T05:21:36.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.383+0000 7fae32bf0640 1 -- 172.21.15.67:0/2208385042 wait complete. 2024-08-31T05:21:36.387 INFO:tasks.workunit.client.0.smithi067.stdout:9/744: dread - dd/df/d8e/fe7 zero size 2024-08-31T05:21:36.387 INFO:tasks.workunit.client.0.smithi067.stdout:4/890: link d4/d1f/db9/cd2 d4/c138 0 2024-08-31T05:21:36.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.384+0000 7fae32bf0640 1 Processor -- start 2024-08-31T05:21:36.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.384+0000 7fae32bf0640 1 -- start start 2024-08-31T05:21:36.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.384+0000 7fae32bf0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae2c1021b0 0x7fae2c072e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:36.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.384+0000 7fae32bf0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae2c104ae0 0x7fae2c0733b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:36.388 INFO:tasks.workunit.client.0.smithi067.stdout:9/745: dread - dd/d4d/dca/feb zero size 2024-08-31T05:21:36.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.384+0000 7fae32bf0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c10a550 con 0x7fae2c104ae0 2024-08-31T05:21:36.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.384+0000 7fae32bf0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c10a3d0 con 0x7fae2c1021b0 2024-08-31T05:21:36.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.384+0000 7fae3098c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae2c1021b0 0x7fae2c072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:36.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.384+0000 7fae3098c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae2c1021b0 0x7fae2c072e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:56574/0 (socket says 172.21.15.67:56574) 2024-08-31T05:21:36.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.384+0000 7fae3098c640 1 -- 172.21.15.67:0/3511240493 learned_addr learned my addr 172.21.15.67:0/3511240493 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:21:36.389 INFO:tasks.workunit.client.0.smithi067.stdout:0/935: truncate d1/df/d17/d43/d48/f92 2271811 0 2024-08-31T05:21:36.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.385+0000 7fae2bfff640 1 --2- 172.21.15.67:0/3511240493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae2c104ae0 0x7fae2c0733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:36.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.385+0000 7fae3098c640 1 -- 172.21.15.67:0/3511240493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae2c104ae0 msgr2=0x7fae2c0733b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:36.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.385+0000 7fae3098c640 1 --2- 172.21.15.67:0/3511240493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae2c104ae0 0x7fae2c0733b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.385+0000 7fae3098c640 1 -- 172.21.15.67:0/3511240493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c073a30 con 0x7fae2c1021b0 2024-08-31T05:21:36.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.385+0000 7fae3098c640 1 --2- 172.21.15.67:0/3511240493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae2c1021b0 0x7fae2c072e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae2000d8d0 tx=0x7fae2000dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:36.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.385+0000 7fae29ffb640 1 -- 172.21.15.67:0/3511240493 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae20017030 con 0x7fae2c1021b0 2024-08-31T05:21:36.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.385+0000 7fae32bf0640 1 -- 172.21.15.67:0/3511240493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2c1a2d30 con 0x7fae2c1021b0 2024-08-31T05:21:36.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.386+0000 7fae29ffb640 1 -- 172.21.15.67:0/3511240493 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae20004020 con 0x7fae2c1021b0 2024-08-31T05:21:36.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.386+0000 7fae29ffb640 1 -- 172.21.15.67:0/3511240493 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae200047a0 con 0x7fae2c1021b0 2024-08-31T05:21:36.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.386+0000 7fae32bf0640 1 -- 172.21.15.67:0/3511240493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae2c1a32c0 con 0x7fae2c1021b0 2024-08-31T05:21:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.387+0000 7fae32bf0640 1 -- 172.21.15.67:0/3511240493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae2c1a3630 con 0x7fae2c1021b0 2024-08-31T05:21:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.388+0000 7fae29ffb640 1 -- 172.21.15.67:0/3511240493 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7fae20004a50 con 0x7fae2c1021b0 2024-08-31T05:21:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.388+0000 7fae29ffb640 1 --2- 172.21.15.67:0/3511240493 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fae1c073ff0 0x7fae1c0764b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.389+0000 7fae29ffb640 1 -- 172.21.15.67:0/3511240493 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7fae20018070 con 0x7fae2c1021b0 2024-08-31T05:21:36.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.389+0000 7fae2bfff640 1 --2- 172.21.15.67:0/3511240493 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fae1c073ff0 0x7fae1c0764b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:36.392 INFO:tasks.workunit.client.0.smithi067.stdout:0/936: unlink d1/d8/f16 0 2024-08-31T05:21:36.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.389+0000 7fae2bfff640 1 --2- 172.21.15.67:0/3511240493 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fae1c073ff0 0x7fae1c0764b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fae180096c0 tx=0x7fae18000bc0 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:36.393 INFO:tasks.workunit.client.0.smithi067.stdout:9/746: truncate dd/df/f12 152888 0 2024-08-31T05:21:36.393 INFO:tasks.workunit.client.0.smithi067.stdout:9/747: dread - dd/df/d5b/ffa zero size 2024-08-31T05:21:36.395 INFO:tasks.workunit.client.0.smithi067.stdout:9/748: getdents dd/d20 0 2024-08-31T05:21:36.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.393+0000 7fae29ffb640 1 -- 172.21.15.67:0/3511240493 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fae200659c0 con 0x7fae2c1021b0 2024-08-31T05:21:36.396 INFO:tasks.workunit.client.0.smithi067.stdout:0/937: mknod d1/d8/d42/dc9/deb/c139 0 2024-08-31T05:21:36.398 INFO:tasks.workunit.client.0.smithi067.stdout:0/938: creat d1/df/d17/d43/f13a x:0 0 0 2024-08-31T05:21:36.398 INFO:tasks.workunit.client.0.smithi067.stdout:9/749: truncate dd/df/d25/d3b/d50/f65 3766583 0 2024-08-31T05:21:36.399 INFO:tasks.workunit.client.0.smithi067.stdout:0/939: chown d1/df/d29/d86/fd7 13439739 1 2024-08-31T05:21:36.402 INFO:tasks.workunit.client.0.smithi067.stdout:0/940: getdents d1/d8/d66/d11c 0 2024-08-31T05:21:36.402 INFO:tasks.workunit.client.0.smithi067.stdout:0/941: fdatasync d1/dd/f21 0 2024-08-31T05:21:36.404 INFO:tasks.workunit.client.0.smithi067.stdout:0/942: creat d1/dd/d18/d52/dc6/df5/f13b x:0 0 0 2024-08-31T05:21:36.406 INFO:tasks.workunit.client.0.smithi067.stdout:0/943: mkdir d1/d8/d42/dc9/deb/d13c 0 2024-08-31T05:21:36.406 INFO:tasks.workunit.client.0.smithi067.stdout:0/944: stat d1 0 2024-08-31T05:21:36.407 INFO:tasks.workunit.client.0.smithi067.stdout:0/945: write d1/dd/d4d/f112 [963338,120212] 0 2024-08-31T05:21:36.408 INFO:tasks.workunit.client.0.smithi067.stdout:0/946: readlink d1/df/l2d 0 2024-08-31T05:21:36.437 INFO:tasks.workunit.client.0.smithi067.stdout:0/947: dwrite d1/df/d29/d37/fda [0,4194304] 0 2024-08-31T05:21:36.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:35 smithi073 ceph-mon[24726]: Upgrade: Updating mgr.smithi067.hftacj 2024-08-31T05:21:36.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:35 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:36.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:35 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.hftacj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T05:21:36.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:35 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.hftacj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T05:21:36.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:35 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T05:21:36.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:35 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:21:36.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:35 smithi073 ceph-mon[24726]: Deploying daemon mgr.smithi067.hftacj on smithi067 2024-08-31T05:21:36.447 INFO:tasks.workunit.client.0.smithi067.stdout:0/948: mknod d1/d8/d42/dc9/deb/d13c/c13d 0 2024-08-31T05:21:36.450 INFO:tasks.workunit.client.0.smithi067.stdout:0/949: mknod d1/dd/d71/d125/c13e 0 2024-08-31T05:21:36.451 INFO:tasks.workunit.client.0.smithi067.stdout:0/950: write d1/df/d29/d86/fd7 [1961546,38803] 0 2024-08-31T05:21:36.523 INFO:tasks.workunit.client.0.smithi067.stdout:0/951: creat d1/dd/d18/d52/f13f x:0 0 0 2024-08-31T05:21:36.523 INFO:tasks.workunit.client.0.smithi067.stdout:0/952: chown d1/d8/fee 4694 1 2024-08-31T05:21:36.527 INFO:tasks.workunit.client.0.smithi067.stdout:0/953: dread d1/df/d17/d43/d80/fae [0,4194304] 0 2024-08-31T05:21:36.529 INFO:tasks.workunit.client.0.smithi067.stdout:0/954: chown d1/df/d29/l2f 19 1 2024-08-31T05:21:36.533 INFO:tasks.workunit.client.0.smithi067.stdout:0/955: rename d1/df/d17/d43/d80 to d1/dd/d18/d52/dc6/d140 0 2024-08-31T05:21:36.533 INFO:tasks.workunit.client.0.smithi067.stdout:0/956: stat d1/df/d17/d43/d48/fd2 0 2024-08-31T05:21:36.536 INFO:tasks.workunit.client.0.smithi067.stdout:0/957: truncate d1/d8/d42/fbc 3216279 0 2024-08-31T05:21:36.538 INFO:tasks.workunit.client.0.smithi067.stdout:0/958: write d1/df/d17/d43/d48/d6a/d84/db7/fd8 [80709,23138] 0 2024-08-31T05:21:36.553 INFO:tasks.workunit.client.0.smithi067.stdout:0/959: dwrite d1/d8/f4b [4194304,4194304] 0 2024-08-31T05:21:36.556 INFO:tasks.workunit.client.0.smithi067.stdout:0/960: chown d1/d8/d42/d98/df1/lf8 2 1 2024-08-31T05:21:36.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.698+0000 7fae32bf0640 1 -- 172.21.15.67:0/3511240493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fae2c1a3e90 con 0x7fae2c1021b0 2024-08-31T05:21:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.698+0000 7fae29ffb640 1 -- 172.21.15.67:0/3511240493 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7fae200634c0 con 0x7fae2c1021b0 2024-08-31T05:21:36.701 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:21:36.701 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:21:36.701 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2 2024-08-31T05:21:36.701 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:21:36.701 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:21:36.702 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 1, 2024-08-31T05:21:36.702 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 1 2024-08-31T05:21:36.702 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:21:36.702 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:21:36.702 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 6 2024-08-31T05:21:36.702 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:21:36.702 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:21:36.702 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:21:36.702 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:21:36.702 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:21:36.702 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 13, 2024-08-31T05:21:36.702 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 1 2024-08-31T05:21:36.702 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:21:36.702 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:21:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.701+0000 7fae32bf0640 1 -- 172.21.15.67:0/3511240493 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fae1c073ff0 msgr2=0x7fae1c0764b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.701+0000 7fae32bf0640 1 --2- 172.21.15.67:0/3511240493 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fae1c073ff0 0x7fae1c0764b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fae180096c0 tx=0x7fae18000bc0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.701+0000 7fae32bf0640 1 -- 172.21.15.67:0/3511240493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae2c1021b0 msgr2=0x7fae2c072e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.701+0000 7fae32bf0640 1 --2- 172.21.15.67:0/3511240493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae2c1021b0 0x7fae2c072e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae2000d8d0 tx=0x7fae2000dd90 comp rx=0 tx=0).stop 2024-08-31T05:21:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.701+0000 7fae32bf0640 1 -- 172.21.15.67:0/3511240493 shutdown_connections 2024-08-31T05:21:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.701+0000 7fae32bf0640 1 --2- 172.21.15.67:0/3511240493 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7fae1c073ff0 0x7fae1c0764b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.701+0000 7fae32bf0640 1 --2- 172.21.15.67:0/3511240493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae2c104ae0 0x7fae2c0733b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.701+0000 7fae32bf0640 1 --2- 172.21.15.67:0/3511240493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae2c1021b0 0x7fae2c072e70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.701+0000 7fae32bf0640 1 -- 172.21.15.67:0/3511240493 >> 172.21.15.67:0/3511240493 conn(0x7fae2c0fbdd0 msgr2=0x7fae2c0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.701+0000 7fae32bf0640 1 -- 172.21.15.67:0/3511240493 shutdown_connections 2024-08-31T05:21:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.701+0000 7fae32bf0640 1 -- 172.21.15.67:0/3511240493 wait complete. 2024-08-31T05:21:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.810+0000 7f6f3a18c640 1 -- 172.21.15.67:0/2777394309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f34073040 msgr2=0x7f6f34073420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.810+0000 7f6f3a18c640 1 --2- 172.21.15.67:0/2777394309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f34073040 0x7f6f34073420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009880 tx=0x7f6f2802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.810+0000 7f6f3a18c640 1 -- 172.21.15.67:0/2777394309 shutdown_connections 2024-08-31T05:21:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.810+0000 7f6f3a18c640 1 --2- 172.21.15.67:0/2777394309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f34108f90 0x7f6f34109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.810+0000 7f6f3a18c640 1 --2- 172.21.15.67:0/2777394309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f34073040 0x7f6f34073420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.810+0000 7f6f3a18c640 1 -- 172.21.15.67:0/2777394309 >> 172.21.15.67:0/2777394309 conn(0x7f6f3406e7f0 msgr2=0x7f6f34070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.810+0000 7f6f3a18c640 1 -- 172.21.15.67:0/2777394309 shutdown_connections 2024-08-31T05:21:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.811+0000 7f6f3a18c640 1 -- 172.21.15.67:0/2777394309 wait complete. 2024-08-31T05:21:36.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.811+0000 7f6f3a18c640 1 Processor -- start 2024-08-31T05:21:36.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.812+0000 7f6f3a18c640 1 -- start start 2024-08-31T05:21:36.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.812+0000 7f6f3a18c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f34073040 0x7f6f341a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:36.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.812+0000 7f6f3a18c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f34108f90 0x7f6f341a65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:36.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.812+0000 7f6f3a18c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6f34119350 con 0x7f6f34108f90 2024-08-31T05:21:36.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.812+0000 7f6f3a18c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6f341191d0 con 0x7f6f34073040 2024-08-31T05:21:36.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.812+0000 7f6f32ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f34108f90 0x7f6f341a65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:36.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.812+0000 7f6f32ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f34108f90 0x7f6f341a65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42554/0 (socket says 172.21.15.67:42554) 2024-08-31T05:21:36.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.812+0000 7f6f337fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f34073040 0x7f6f341a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:36.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.812+0000 7f6f32ffd640 1 -- 172.21.15.67:0/817153698 learned_addr learned my addr 172.21.15.67:0/817153698 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:21:36.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.812+0000 7f6f32ffd640 1 -- 172.21.15.67:0/817153698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f34073040 msgr2=0x7f6f341a6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:36.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.812+0000 7f6f32ffd640 1 --2- 172.21.15.67:0/817153698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f34073040 0x7f6f341a6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:36.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.812+0000 7f6f32ffd640 1 -- 172.21.15.67:0/817153698 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f341a6c40 con 0x7f6f34108f90 2024-08-31T05:21:36.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.812+0000 7f6f337fe640 1 --2- 172.21.15.67:0/817153698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f34073040 0x7f6f341a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:21:36.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.813+0000 7f6f32ffd640 1 --2- 172.21.15.67:0/817153698 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f34108f90 0x7f6f341a65c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400e970 tx=0x7f6f2400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:36.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.813+0000 7f6f30ff9640 1 -- 172.21.15.67:0/817153698 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f2400cac0 con 0x7f6f34108f90 2024-08-31T05:21:36.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.813+0000 7f6f3a18c640 1 -- 172.21.15.67:0/817153698 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f341ab680 con 0x7f6f34108f90 2024-08-31T05:21:36.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.813+0000 7f6f30ff9640 1 -- 172.21.15.67:0/817153698 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f2400cc60 con 0x7f6f34108f90 2024-08-31T05:21:36.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.813+0000 7f6f30ff9640 1 -- 172.21.15.67:0/817153698 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f24018720 con 0x7f6f34108f90 2024-08-31T05:21:36.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.813+0000 7f6f3a18c640 1 -- 172.21.15.67:0/817153698 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f341abc10 con 0x7f6f34108f90 2024-08-31T05:21:36.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.814+0000 7f6f3a18c640 1 -- 172.21.15.67:0/817153698 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f34073420 con 0x7f6f34108f90 2024-08-31T05:21:36.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.815+0000 7f6f30ff9640 1 -- 172.21.15.67:0/817153698 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) ==== 97215+0+0 (secure 0 0 0) 0x7f6f24010430 con 0x7f6f34108f90 2024-08-31T05:21:36.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.815+0000 7f6f30ff9640 1 --2- 172.21.15.67:0/817153698 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f6f1c073ff0 0x7f6f1c0764b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:36.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.816+0000 7f6f30ff9640 1 -- 172.21.15.67:0/817153698 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f6f240959c0 con 0x7f6f34108f90 2024-08-31T05:21:36.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.816+0000 7f6f337fe640 1 --2- 172.21.15.67:0/817153698 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f6f1c073ff0 0x7f6f1c0764b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:36.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.816+0000 7f6f337fe640 1 --2- 172.21.15.67:0/817153698 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f6f1c073ff0 0x7f6f1c0764b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f2802aa10 tx=0x7f6f2802a9a0 comp rx=0 tx=0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:36.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:36.820+0000 7f6f30ff9640 1 -- 172.21.15.67:0/817153698 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f6f24061600 con 0x7f6f34108f90 2024-08-31T05:21:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:37.051+0000 7f6f3a18c640 1 -- 172.21.15.67:0/817153698 --> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6f3410d580 con 0x7f6f1c073ff0 2024-08-31T05:21:37.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:37.052+0000 7f6f30ff9640 1 -- 172.21.15.67:0/817153698 <== mgr.24383 v2:172.21.15.73:6828/1567621854 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f6f3410d580 con 0x7f6f1c073ff0 2024-08-31T05:21:37.055 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:21:37.055 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:21:37.055 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:21:37.055 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-31T05:21:37.055 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [], 2024-08-31T05:21:37.055 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "1/2 daemons upgraded", 2024-08-31T05:21:37.055 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading mgr daemons", 2024-08-31T05:21:37.055 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:21:37.055 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:21:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:37.055+0000 7f6f3a18c640 1 -- 172.21.15.67:0/817153698 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f6f1c073ff0 msgr2=0x7f6f1c0764b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:37.055+0000 7f6f3a18c640 1 --2- 172.21.15.67:0/817153698 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f6f1c073ff0 0x7f6f1c0764b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f2802aa10 tx=0x7f6f2802a9a0 comp rx=0 tx=0).stop 2024-08-31T05:21:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:37.055+0000 7f6f3a18c640 1 -- 172.21.15.67:0/817153698 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f34108f90 msgr2=0x7f6f341a65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:37.055+0000 7f6f3a18c640 1 --2- 172.21.15.67:0/817153698 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f34108f90 0x7f6f341a65c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400e970 tx=0x7f6f2400ee30 comp rx=0 tx=0).stop 2024-08-31T05:21:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:37.055+0000 7f6f3a18c640 1 -- 172.21.15.67:0/817153698 shutdown_connections 2024-08-31T05:21:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:37.055+0000 7f6f3a18c640 1 --2- 172.21.15.67:0/817153698 >> [v2:172.21.15.73:6828/1567621854,v1:172.21.15.73:6829/1567621854] conn(0x7f6f1c073ff0 0x7f6f1c0764b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:37.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:37.055+0000 7f6f3a18c640 1 --2- 172.21.15.67:0/817153698 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f34108f90 0x7f6f341a65c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:37.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:37.055+0000 7f6f3a18c640 1 --2- 172.21.15.67:0/817153698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f34073040 0x7f6f341a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:37.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:37.055+0000 7f6f3a18c640 1 -- 172.21.15.67:0/817153698 >> 172.21.15.67:0/817153698 conn(0x7f6f3406e7f0 msgr2=0x7f6f34071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:37.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:37.056+0000 7f6f3a18c640 1 -- 172.21.15.67:0/817153698 shutdown_connections 2024-08-31T05:21:37.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:21:37.056+0000 7f6f3a18c640 1 -- 172.21.15.67:0/817153698 wait complete. 2024-08-31T05:21:37.203 INFO:tasks.workunit.client.0.smithi067.stdout:7/594: sync 2024-08-31T05:21:37.206 INFO:tasks.workunit.client.0.smithi067.stdout:7/595: creat d14/d54/d91/fa2 x:0 0 0 2024-08-31T05:21:37.250 INFO:tasks.workunit.client.0.smithi067.stdout:7/596: dwrite d14/d16/d5b/d68/f7b [0,4194304] 0 2024-08-31T05:21:37.251 INFO:tasks.workunit.client.0.smithi067.stdout:7/597: chown d14/d16/d5b/d94/l71 595395 1 2024-08-31T05:21:37.254 INFO:tasks.workunit.client.0.smithi067.stdout:7/598: unlink d14/d54/d5e/d67/c9d 0 2024-08-31T05:21:37.255 INFO:tasks.workunit.client.0.smithi067.stdout:7/599: stat d14/d16/d28/l2c 0 2024-08-31T05:21:37.256 INFO:tasks.workunit.client.0.smithi067.stdout:7/600: stat d14/d16/f5d 0 2024-08-31T05:21:37.257 INFO:tasks.workunit.client.0.smithi067.stdout:7/601: truncate d14/d4a/d85/f96 839951 0 2024-08-31T05:21:37.259 INFO:tasks.workunit.client.0.smithi067.stdout:7/602: read d14/d16/f2b [2932985,58834] 0 2024-08-31T05:21:37.260 INFO:tasks.workunit.client.0.smithi067.stdout:7/603: chown d14/d4a/c9b 129647086 1 2024-08-31T05:21:37.262 INFO:tasks.workunit.client.0.smithi067.stdout:7/604: unlink d14/d54/d5e/f75 0 2024-08-31T05:21:37.263 INFO:tasks.workunit.client.0.smithi067.stdout:7/605: fsync d14/d54/d91/fa2 0 2024-08-31T05:21:37.269 INFO:tasks.workunit.client.0.smithi067.stdout:7/606: dwrite d14/d54/d5e/d67/f6d [0,4194304] 0 2024-08-31T05:21:37.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:36 smithi067 ceph-mon[17432]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:37.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:36 smithi067 ceph-mon[17432]: pgmap v39: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 51 MiB/s rd, 146 MiB/s wr, 396 op/s 2024-08-31T05:21:37.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:36 smithi067 ceph-mon[17432]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:37.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:36 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3511240493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:21:37.412 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:36 smithi073 ceph-mon[24726]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:37.412 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:36 smithi073 ceph-mon[24726]: pgmap v39: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 51 MiB/s rd, 146 MiB/s wr, 396 op/s 2024-08-31T05:21:37.412 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:36 smithi073 ceph-mon[24726]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:37.412 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:36 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3511240493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:21:37.457 INFO:tasks.workunit.client.0.smithi067.stdout:5/637: sync 2024-08-31T05:21:37.457 INFO:tasks.workunit.client.0.smithi067.stdout:2/810: sync 2024-08-31T05:21:37.479 INFO:tasks.workunit.client.0.smithi067.stdout:2/811: write db/d12/d1a/d2b/d3d/d69/d3b/dfe/fa6 [577658,79257] 0 2024-08-31T05:21:37.479 INFO:tasks.workunit.client.0.smithi067.stdout:5/638: write db/d15/d42/d36/d73/f83 [3116373,52990] 0 2024-08-31T05:21:37.481 INFO:tasks.workunit.client.0.smithi067.stdout:5/639: read db/d1d/f9d [408687,41469] 0 2024-08-31T05:21:37.482 INFO:tasks.workunit.client.0.smithi067.stdout:5/640: stat db/f88 0 2024-08-31T05:21:37.483 INFO:tasks.workunit.client.0.smithi067.stdout:5/641: dread - db/d15/d42/d36/d73/fbf zero size 2024-08-31T05:21:37.485 INFO:tasks.workunit.client.0.smithi067.stdout:5/642: fsync db/f46 0 2024-08-31T05:21:37.486 INFO:tasks.workunit.client.0.smithi067.stdout:5/643: chown db/d26/d29/d81/fc6 37804 1 2024-08-31T05:21:37.489 INFO:tasks.workunit.client.0.smithi067.stdout:1/804: sync 2024-08-31T05:21:37.489 INFO:tasks.workunit.client.0.smithi067.stdout:6/873: sync 2024-08-31T05:21:37.490 INFO:tasks.workunit.client.0.smithi067.stdout:5/644: unlink db/d26/d29/d31/f48 0 2024-08-31T05:21:37.491 INFO:tasks.workunit.client.0.smithi067.stdout:1/805: chown d3/dfc/ff7 1721884 1 2024-08-31T05:21:37.493 INFO:tasks.workunit.client.0.smithi067.stdout:5/645: chown db/d26/d29/d31/d54/d8c/fc3 178296055 1 2024-08-31T05:21:37.493 INFO:tasks.workunit.client.0.smithi067.stdout:2/812: dread db/d12/d1a/f1f [0,4194304] 0 2024-08-31T05:21:37.493 INFO:tasks.workunit.client.0.smithi067.stdout:6/874: rename d1b/d23/d61/f7d to d1b/d30/f11d 0 2024-08-31T05:21:37.495 INFO:tasks.workunit.client.0.smithi067.stdout:1/806: mknod d3/dd3/c125 0 2024-08-31T05:21:37.495 INFO:tasks.workunit.client.0.smithi067.stdout:1/807: readlink d3/l78 0 2024-08-31T05:21:37.496 INFO:tasks.workunit.client.0.smithi067.stdout:5/646: mkdir db/d15/d42/d36/dc7 0 2024-08-31T05:21:37.497 INFO:tasks.workunit.client.0.smithi067.stdout:1/808: write d3/d23/db1/db6/dc4/f11c [590381,6939] 0 2024-08-31T05:21:37.499 INFO:tasks.workunit.client.0.smithi067.stdout:2/813: chown db/d12/d1a/d1e/d4d/le0 377 1 2024-08-31T05:21:37.512 INFO:tasks.workunit.client.0.smithi067.stdout:1/809: rename d3/d23/d79/fa4 to d3/d23/d2d/d2e/d34/d66/f126 0 2024-08-31T05:21:37.513 INFO:tasks.workunit.client.0.smithi067.stdout:6/875: truncate d1b/d23/f34 2079696 0 2024-08-31T05:21:37.517 INFO:tasks.workunit.client.0.smithi067.stdout:5/647: getdents db/d1d/d4f 0 2024-08-31T05:21:37.518 INFO:tasks.workunit.client.0.smithi067.stdout:5/648: write db/f32 [2723805,49048] 0 2024-08-31T05:21:37.521 INFO:tasks.workunit.client.0.smithi067.stdout:2/814: dwrite db/d12/d1a/d1e/f54 [0,4194304] 0 2024-08-31T05:21:37.523 INFO:tasks.workunit.client.0.smithi067.stdout:6/876: creat d1b/d40/d70/dd0/d5e/d7b/f11e x:0 0 0 2024-08-31T05:21:37.529 INFO:tasks.workunit.client.0.smithi067.stdout:2/815: fsync db/d12/d1a/d2b/d3d/d4f/fe8 0 2024-08-31T05:21:37.536 INFO:tasks.workunit.client.0.smithi067.stdout:1/810: dwrite d3/d23/d2d/d2e/f39 [0,4194304] 0 2024-08-31T05:21:37.539 INFO:tasks.workunit.client.0.smithi067.stdout:6/877: symlink d1b/d40/d70/dd0/d5e/l11f 0 2024-08-31T05:21:37.541 INFO:tasks.workunit.client.0.smithi067.stdout:1/811: creat d3/d23/db1/dd4/de4/f127 x:0 0 0 2024-08-31T05:21:37.541 INFO:tasks.workunit.client.0.smithi067.stdout:5/649: getdents db/d15/d42/d36/d73/d77 0 2024-08-31T05:21:37.542 INFO:tasks.workunit.client.0.smithi067.stdout:4/891: sync 2024-08-31T05:21:37.542 INFO:tasks.workunit.client.0.smithi067.stdout:9/750: sync 2024-08-31T05:21:37.542 INFO:tasks.workunit.client.0.smithi067.stdout:0/961: sync 2024-08-31T05:21:37.542 INFO:tasks.workunit.client.0.smithi067.stdout:7/607: sync 2024-08-31T05:21:37.544 INFO:tasks.workunit.client.0.smithi067.stdout:7/608: fsync d14/d16/f4e 0 2024-08-31T05:21:37.545 INFO:tasks.workunit.client.0.smithi067.stdout:7/609: stat d14/d54/l84 0 2024-08-31T05:21:37.553 INFO:tasks.workunit.client.0.smithi067.stdout:4/892: dwrite d4/d9/da4/f11b [0,4194304] 0 2024-08-31T05:21:37.555 INFO:tasks.workunit.client.0.smithi067.stdout:2/816: dwrite db/d12/d1a/d2b/d3d/d69/d3b/f78 [0,4194304] 0 2024-08-31T05:21:37.559 INFO:tasks.workunit.client.0.smithi067.stdout:4/893: truncate d4/d9/db4/d83/ff7 407235 0 2024-08-31T05:21:37.561 INFO:tasks.workunit.client.0.smithi067.stdout:9/751: write dd/df/d25/d59/f8c [956075,49923] 0 2024-08-31T05:21:37.562 INFO:tasks.workunit.client.0.smithi067.stdout:2/817: write db/d8c/dcd/df4/ff6 [385538,35605] 0 2024-08-31T05:21:37.562 INFO:tasks.workunit.client.0.smithi067.stdout:5/650: dwrite db/f2e [0,4194304] 0 2024-08-31T05:21:37.563 INFO:tasks.workunit.client.0.smithi067.stdout:9/752: chown dd/df/l30 0 1 2024-08-31T05:21:37.564 INFO:tasks.workunit.client.0.smithi067.stdout:0/962: unlink d1/dd/d18/d52/dc6/d140/d113/f89 0 2024-08-31T05:21:37.568 INFO:tasks.workunit.client.0.smithi067.stdout:7/610: unlink d14/d16/d5b/d64/c93 0 2024-08-31T05:21:37.572 INFO:tasks.workunit.client.0.smithi067.stdout:4/894: fdatasync d4/d1f/f44 0 2024-08-31T05:21:37.575 INFO:tasks.workunit.client.0.smithi067.stdout:5/651: symlink db/d15/d42/d36/d73/da9/lc8 0 2024-08-31T05:21:37.576 INFO:tasks.workunit.client.0.smithi067.stdout:2/818: creat db/d12/d1a/d2b/d3d/d69/d3b/f105 x:0 0 0 2024-08-31T05:21:37.577 INFO:tasks.workunit.client.0.smithi067.stdout:0/963: creat d1/dd/d18/d52/dc6/f141 x:0 0 0 2024-08-31T05:21:37.579 INFO:tasks.workunit.client.0.smithi067.stdout:7/611: creat d14/d16/d28/d78/fa3 x:0 0 0 2024-08-31T05:21:37.591 INFO:tasks.workunit.client.0.smithi067.stdout:4/895: creat d4/d1e/f139 x:0 0 0 2024-08-31T05:21:37.599 INFO:tasks.workunit.client.0.smithi067.stdout:9/753: rename dd/d20/f2b to dd/df/d25/ffc 0 2024-08-31T05:21:37.603 INFO:tasks.workunit.client.0.smithi067.stdout:4/896: mknod d4/d56/c13a 0 2024-08-31T05:21:37.604 INFO:tasks.workunit.client.0.smithi067.stdout:5/652: dread db/d26/f74 [0,4194304] 0 2024-08-31T05:21:37.604 INFO:tasks.workunit.client.0.smithi067.stdout:4/897: write d4/d56/fa7 [423774,62195] 0 2024-08-31T05:21:37.605 INFO:tasks.workunit.client.0.smithi067.stdout:4/898: stat d4/d9/d4b/l85 0 2024-08-31T05:21:37.605 INFO:tasks.workunit.client.0.smithi067.stdout:2/819: getdents db/d12/d1a/d1e/d4d 0 2024-08-31T05:21:37.609 INFO:tasks.workunit.client.0.smithi067.stdout:2/820: chown db/d12/d1a/d2b/d3d/d4f/l104 7 1 2024-08-31T05:21:37.612 INFO:tasks.workunit.client.0.smithi067.stdout:0/964: dwrite d1/df/d17/d43/d48/fe7 [0,4194304] 0 2024-08-31T05:21:37.612 INFO:tasks.workunit.client.0.smithi067.stdout:7/612: write d14/d54/d5e/f6a [100369,25401] 0 2024-08-31T05:21:37.613 INFO:tasks.workunit.client.0.smithi067.stdout:4/899: truncate d4/d14/d48/f5f 673574 0 2024-08-31T05:21:37.614 INFO:tasks.workunit.client.0.smithi067.stdout:7/613: dread - d14/d16/d5b/d64/f61 zero size 2024-08-31T05:21:37.615 INFO:tasks.workunit.client.0.smithi067.stdout:0/965: chown d1/d8/d42/fb0 38737375 1 2024-08-31T05:21:37.620 INFO:tasks.workunit.client.0.smithi067.stdout:5/653: getdents db/d1d/d4f/da8 0 2024-08-31T05:21:37.623 INFO:tasks.workunit.client.0.smithi067.stdout:0/966: mkdir d1/df/d29/d86/dc0/d142 0 2024-08-31T05:21:37.624 INFO:tasks.workunit.client.0.smithi067.stdout:2/821: truncate db/dd/d13/f88 1403468 0 2024-08-31T05:21:37.624 INFO:tasks.workunit.client.0.smithi067.stdout:7/614: dwrite d14/d16/d5b/f5c [0,4194304] 0 2024-08-31T05:21:37.624 INFO:tasks.workunit.client.0.smithi067.stdout:9/754: dwrite dd/df/d25/f6c [0,4194304] 0 2024-08-31T05:21:37.626 INFO:tasks.workunit.client.0.smithi067.stdout:7/615: stat d14/d16/f5d 0 2024-08-31T05:21:37.628 INFO:tasks.workunit.client.0.smithi067.stdout:5/654: unlink db/f1b 0 2024-08-31T05:21:37.631 INFO:tasks.workunit.client.0.smithi067.stdout:0/967: creat d1/d8/d42/dc9/f143 x:0 0 0 2024-08-31T05:21:37.638 INFO:tasks.workunit.client.0.smithi067.stdout:2/822: link db/dd/d13/ffb db/d12/d1a/d1e/d4d/f106 0 2024-08-31T05:21:37.640 INFO:tasks.workunit.client.0.smithi067.stdout:0/968: symlink d1/dd/d18/d52/dc6/df5/l144 0 2024-08-31T05:21:37.644 INFO:tasks.workunit.client.0.smithi067.stdout:5/655: mknod db/d26/d29/d31/cc9 0 2024-08-31T05:21:37.647 INFO:tasks.workunit.client.0.smithi067.stdout:7/616: write d14/d16/d5b/d68/f74 [2964694,121311] 0 2024-08-31T05:21:37.649 INFO:tasks.workunit.client.0.smithi067.stdout:5/656: dread db/f49 [0,4194304] 0 2024-08-31T05:21:37.649 INFO:tasks.workunit.client.0.smithi067.stdout:9/755: write dd/df/d25/fa4 [1944853,62231] 0 2024-08-31T05:21:37.649 INFO:tasks.workunit.client.0.smithi067.stdout:2/823: dread - db/d12/d1a/d2b/d3d/d69/d3b/fe4 zero size 2024-08-31T05:21:37.650 INFO:tasks.workunit.client.0.smithi067.stdout:4/900: write d4/d14/d48/f5f [1343037,95012] 0 2024-08-31T05:21:37.651 INFO:tasks.workunit.client.0.smithi067.stdout:0/969: truncate d1/dd/d18/f9a 2372275 0 2024-08-31T05:21:37.652 INFO:tasks.workunit.client.0.smithi067.stdout:9/756: read dd/df/f9a [4063026,8202] 0 2024-08-31T05:21:37.654 INFO:tasks.workunit.client.0.smithi067.stdout:0/970: truncate d1/df/d29/d86/dc0/f136 578616 0 2024-08-31T05:21:37.655 INFO:tasks.workunit.client.0.smithi067.stdout:7/617: mkdir d14/d4a/d85/da4 0 2024-08-31T05:21:37.657 INFO:tasks.workunit.client.0.smithi067.stdout:5/657: chown db/d26/f45 215028070 1 2024-08-31T05:21:37.657 INFO:tasks.workunit.client.0.smithi067.stdout:2/824: stat db/dd/d13/lc8 0 2024-08-31T05:21:37.661 INFO:tasks.workunit.client.0.smithi067.stdout:4/901: mknod d4/d9/da2/df8/c13b 0 2024-08-31T05:21:37.662 INFO:tasks.workunit.client.0.smithi067.stdout:9/757: rename dd/df/dc6 to dd/df/d25/d3b/d50/dfd 0 2024-08-31T05:21:37.664 INFO:tasks.workunit.client.0.smithi067.stdout:2/825: dwrite db/d12/d1a/d2b/d3d/d69/d3b/f105 [0,4194304] 0 2024-08-31T05:21:37.666 INFO:tasks.workunit.client.0.smithi067.stdout:2/826: chown db/d12/d1a/d2b/d3d/f46 776098 1 2024-08-31T05:21:37.670 INFO:tasks.workunit.client.0.smithi067.stdout:7/618: fdatasync d14/d54/f62 0 2024-08-31T05:21:37.671 INFO:tasks.workunit.client.0.smithi067.stdout:7/619: chown c4 11534 1 2024-08-31T05:21:37.676 INFO:tasks.workunit.client.0.smithi067.stdout:4/902: creat d4/d1f/d9e/f13c x:0 0 0 2024-08-31T05:21:37.678 INFO:tasks.workunit.client.0.smithi067.stdout:4/903: truncate d4/d9/d5a/dfe/f10d 431127 0 2024-08-31T05:21:37.678 INFO:tasks.workunit.client.0.smithi067.stdout:4/904: chown d4/da5 513639215 1 2024-08-31T05:21:37.683 INFO:tasks.workunit.client.0.smithi067.stdout:7/620: rename d14/d16/d5b/d64/f61 to d14/d54/d5e/d67/fa5 0 2024-08-31T05:21:37.684 INFO:tasks.workunit.client.0.smithi067.stdout:4/905: creat d4/d1e/d6d/f13d x:0 0 0 2024-08-31T05:21:37.686 INFO:tasks.workunit.client.0.smithi067.stdout:2/827: write db/d12/d1a/f36 [2875161,13523] 0 2024-08-31T05:21:37.688 INFO:tasks.workunit.client.0.smithi067.stdout:9/758: dread dd/df/d8e/fa9 [0,4194304] 0 2024-08-31T05:21:37.689 INFO:tasks.workunit.client.0.smithi067.stdout:7/621: creat d14/d54/d5e/fa6 x:0 0 0 2024-08-31T05:21:37.691 INFO:tasks.workunit.client.0.smithi067.stdout:5/658: getdents db/d26/d29 0 2024-08-31T05:21:37.691 INFO:tasks.workunit.client.0.smithi067.stdout:0/971: dread d1/dd/d71/fa5 [0,4194304] 0 2024-08-31T05:21:37.692 INFO:tasks.workunit.client.0.smithi067.stdout:2/828: symlink db/d12/d1a/d2b/d3d/d4f/l107 0 2024-08-31T05:21:37.692 INFO:tasks.workunit.client.0.smithi067.stdout:5/659: chown db/d1d/d3a/d7c 0 1 2024-08-31T05:21:37.692 INFO:tasks.workunit.client.0.smithi067.stdout:9/759: dread - dd/d20/fd8 zero size 2024-08-31T05:21:37.701 INFO:tasks.workunit.client.0.smithi067.stdout:2/829: creat db/d8c/dcd/df4/da0/dc4/f108 x:0 0 0 2024-08-31T05:21:37.703 INFO:tasks.workunit.client.0.smithi067.stdout:9/760: rename dd/df/d25/d59/fa7 to dd/df/d5b/d5d/d7a/ffe 0 2024-08-31T05:21:37.704 INFO:tasks.workunit.client.0.smithi067.stdout:4/906: truncate d4/d9/db4/d83/da9/d60/f61 1874043 0 2024-08-31T05:21:37.704 INFO:tasks.workunit.client.0.smithi067.stdout:9/761: chown dd/df/d5b/fee 537005 1 2024-08-31T05:21:37.705 INFO:tasks.workunit.client.0.smithi067.stdout:5/660: write db/f49 [1591520,59864] 0 2024-08-31T05:21:37.706 INFO:tasks.workunit.client.0.smithi067.stdout:0/972: write d1/df/d17/f4f [3746326,46155] 0 2024-08-31T05:21:37.706 INFO:tasks.workunit.client.0.smithi067.stdout:9/762: fdatasync dd/df/d25/f6c 0 2024-08-31T05:21:37.708 INFO:tasks.workunit.client.0.smithi067.stdout:2/830: creat db/d12/d1a/d2b/d3d/d69/d3b/f109 x:0 0 0 2024-08-31T05:21:37.708 INFO:tasks.workunit.client.0.smithi067.stdout:4/907: creat d4/d9/d4b/f13e x:0 0 0 2024-08-31T05:21:37.709 INFO:tasks.workunit.client.0.smithi067.stdout:0/973: chown d1/d8/d42/dc9/f143 23667679 1 2024-08-31T05:21:37.712 INFO:tasks.workunit.client.0.smithi067.stdout:7/622: dread d14/d16/d28/d2e/f3a [0,4194304] 0 2024-08-31T05:21:37.713 INFO:tasks.workunit.client.0.smithi067.stdout:5/661: mknod db/d15/cca 0 2024-08-31T05:21:37.716 INFO:tasks.workunit.client.0.smithi067.stdout:9/763: dwrite dd/df/d25/f6c [0,4194304] 0 2024-08-31T05:21:37.717 INFO:tasks.workunit.client.0.smithi067.stdout:9/764: chown dd/df/l14 405 1 2024-08-31T05:21:37.717 INFO:tasks.workunit.client.0.smithi067.stdout:2/831: dread db/d12/d1a/d2b/d3d/d69/d3b/f105 [0,4194304] 0 2024-08-31T05:21:37.718 INFO:tasks.workunit.client.0.smithi067.stdout:4/908: mkdir d4/d1e/d92/db0/d10e/d13f 0 2024-08-31T05:21:37.724 INFO:tasks.workunit.client.0.smithi067.stdout:0/974: truncate d1/dd/d4d/fad 1835583 0 2024-08-31T05:21:37.724 INFO:tasks.workunit.client.0.smithi067.stdout:0/975: chown d1/dd5/dff/c12d 706 1 2024-08-31T05:21:37.732 INFO:tasks.workunit.client.0.smithi067.stdout:4/909: unlink d4/d1e/d92/db0/d10e/c119 0 2024-08-31T05:21:37.736 INFO:tasks.workunit.client.0.smithi067.stdout:0/976: fsync d1/df/d17/d43/d48/d6a/d84/db7/fe8 0 2024-08-31T05:21:37.736 INFO:tasks.workunit.client.0.smithi067.stdout:0/977: chown d1/dd/d4d/lbb 7 1 2024-08-31T05:21:37.740 INFO:tasks.workunit.client.0.smithi067.stdout:7/623: truncate d14/d16/d5b/d94/f4f 1936788 0 2024-08-31T05:21:37.744 INFO:tasks.workunit.client.0.smithi067.stdout:5/662: dwrite f7 [0,4194304] 0 2024-08-31T05:21:37.747 INFO:tasks.workunit.client.0.smithi067.stdout:5/663: dread - db/d26/d29/d31/fa0 zero size 2024-08-31T05:21:37.747 INFO:tasks.workunit.client.0.smithi067.stdout:2/832: write db/d12/f6e [4160090,101117] 0 2024-08-31T05:21:37.750 INFO:tasks.workunit.client.0.smithi067.stdout:7/624: dwrite d14/f95 [0,4194304] 0 2024-08-31T05:21:37.752 INFO:tasks.workunit.client.0.smithi067.stdout:0/978: creat d1/df/d17/dc1/f145 x:0 0 0 2024-08-31T05:21:37.753 INFO:tasks.workunit.client.0.smithi067.stdout:5/664: read db/d1d/f9d [951,126614] 0 2024-08-31T05:21:37.757 INFO:tasks.workunit.client.0.smithi067.stdout:9/765: write dd/df/d25/ff1 [1043121,108339] 0 2024-08-31T05:21:37.760 INFO:tasks.workunit.client.0.smithi067.stdout:4/910: getdents d4/d1e/d92/db0/d10e/d13f 0 2024-08-31T05:21:37.760 INFO:tasks.workunit.client.0.smithi067.stdout:4/911: readlink d4/d9/db4/l103 0 2024-08-31T05:21:37.764 INFO:tasks.workunit.client.0.smithi067.stdout:0/979: mknod d1/dd/d4d/c146 0 2024-08-31T05:21:37.764 INFO:tasks.workunit.client.0.smithi067.stdout:5/665: creat db/d26/d29/d31/fcb x:0 0 0 2024-08-31T05:21:37.765 INFO:tasks.workunit.client.0.smithi067.stdout:5/666: readlink db/d26/d29/d81/l92 0 2024-08-31T05:21:37.767 INFO:tasks.workunit.client.0.smithi067.stdout:4/912: creat d4/d9/db4/f140 x:0 0 0 2024-08-31T05:21:37.769 INFO:tasks.workunit.client.0.smithi067.stdout:5/667: dread db/f2e [0,4194304] 0 2024-08-31T05:21:37.777 INFO:tasks.workunit.client.0.smithi067.stdout:0/980: dread d1/df/d17/d43/f64 [0,4194304] 0 2024-08-31T05:21:37.778 INFO:tasks.workunit.client.0.smithi067.stdout:9/766: mkdir dd/df/d25/d3b/d50/d73/dff 0 2024-08-31T05:21:37.779 INFO:tasks.workunit.client.0.smithi067.stdout:9/767: truncate dd/d63/d72/ff9 38146 0 2024-08-31T05:21:37.784 INFO:tasks.workunit.client.0.smithi067.stdout:9/768: dread dd/df/d25/f6c [0,4194304] 0 2024-08-31T05:21:37.786 INFO:tasks.workunit.client.0.smithi067.stdout:2/833: dread db/d8c/dcd/df4/f53 [0,4194304] 0 2024-08-31T05:21:37.787 INFO:tasks.workunit.client.0.smithi067.stdout:0/981: symlink d1/d8/d42/dc9/deb/l147 0 2024-08-31T05:21:37.789 INFO:tasks.workunit.client.0.smithi067.stdout:7/625: truncate d14/f20 3633495 0 2024-08-31T05:21:37.801 INFO:tasks.workunit.client.0.smithi067.stdout:9/769: mkdir dd/df/d25/d59/d100 0 2024-08-31T05:21:37.801 INFO:tasks.workunit.client.0.smithi067.stdout:9/770: chown dd/df/d25 412038102 1 2024-08-31T05:21:37.802 INFO:tasks.workunit.client.0.smithi067.stdout:2/834: mknod db/d8c/c10a 0 2024-08-31T05:21:37.802 INFO:tasks.workunit.client.0.smithi067.stdout:9/771: write dd/da2/ff3 [343201,95405] 0 2024-08-31T05:21:37.803 INFO:tasks.workunit.client.0.smithi067.stdout:2/835: stat db/d12/d1a/d2b/d3d/d69/d3b/d82/cf2 0 2024-08-31T05:21:37.804 INFO:tasks.workunit.client.0.smithi067.stdout:2/836: chown db/d12/d1a/d2b/d3d/d4f/d6d 3 1 2024-08-31T05:21:37.809 INFO:tasks.workunit.client.0.smithi067.stdout:5/668: dwrite db/faa [0,4194304] 0 2024-08-31T05:21:37.809 INFO:tasks.workunit.client.0.smithi067.stdout:7/626: rmdir d14/d16/d5b/d94 39 2024-08-31T05:21:37.810 INFO:tasks.workunit.client.0.smithi067.stdout:4/913: write d4/d9/db4/d83/da9/d60/f61 [209219,56306] 0 2024-08-31T05:21:37.815 INFO:tasks.workunit.client.0.smithi067.stdout:0/982: symlink d1/df/l148 0 2024-08-31T05:21:37.818 INFO:tasks.workunit.client.0.smithi067.stdout:5/669: dwrite db/d15/f12 [0,4194304] 0 2024-08-31T05:21:37.819 INFO:tasks.workunit.client.0.smithi067.stdout:5/670: write db/f19 [4414853,93169] 0 2024-08-31T05:21:37.821 INFO:tasks.workunit.client.0.smithi067.stdout:4/914: creat d4/d32/d4c/f141 x:0 0 0 2024-08-31T05:21:37.825 INFO:tasks.workunit.client.0.smithi067.stdout:7/627: mkdir d14/d54/d91/da7 0 2024-08-31T05:21:37.831 INFO:tasks.workunit.client.0.smithi067.stdout:5/671: rename db/d15/d42/d36/d73/la1 to db/d15/d42/d36/lcc 0 2024-08-31T05:21:37.838 INFO:tasks.workunit.client.0.smithi067.stdout:0/983: mkdir d1/dd/d18/d52/dc6/d140/d113/d149 0 2024-08-31T05:21:37.840 INFO:tasks.workunit.client.0.smithi067.stdout:5/672: symlink db/d26/d29/d31/d54/d8c/lcd 0 2024-08-31T05:21:37.844 INFO:tasks.workunit.client.0.smithi067.stdout:4/915: link d4/d32/d43/fe2 d4/d13/f142 0 2024-08-31T05:21:37.847 INFO:tasks.workunit.client.0.smithi067.stdout:4/916: chown d4/d1e/d53/d81/cba 1697564 1 2024-08-31T05:21:37.847 INFO:tasks.workunit.client.0.smithi067.stdout:2/837: dread db/d8c/dcd/df4/fca [0,4194304] 0 2024-08-31T05:21:37.847 INFO:tasks.workunit.client.0.smithi067.stdout:5/673: dwrite db/d15/d42/fa2 [0,4194304] 0 2024-08-31T05:21:37.853 INFO:tasks.workunit.client.0.smithi067.stdout:5/674: read db/f2e [1099349,42118] 0 2024-08-31T05:21:37.859 INFO:tasks.workunit.client.0.smithi067.stdout:2/838: mkdir db/dd/d2d/da7/d10b 0 2024-08-31T05:21:37.860 INFO:tasks.workunit.client.0.smithi067.stdout:4/917: dwrite d4/d1e/d92/f128 [4194304,4194304] 0 2024-08-31T05:21:37.861 INFO:tasks.workunit.client.0.smithi067.stdout:5/675: creat db/d26/d29/d31/fce x:0 0 0 2024-08-31T05:21:37.867 INFO:tasks.workunit.client.0.smithi067.stdout:4/918: rename d4/d56/fa7 to d4/d9/db4/d83/da9/f143 0 2024-08-31T05:21:37.868 INFO:tasks.workunit.client.0.smithi067.stdout:4/919: read - d4/d9/fe4 zero size 2024-08-31T05:21:37.871 INFO:tasks.workunit.client.0.smithi067.stdout:4/920: truncate d4/d1f/f72 3050621 0 2024-08-31T05:21:37.872 INFO:tasks.workunit.client.0.smithi067.stdout:0/984: dread d1/dd/d18/d52/dc6/d140/f9f [0,4194304] 0 2024-08-31T05:21:37.876 INFO:tasks.workunit.client.0.smithi067.stdout:5/676: mkdir db/d15/d59/dad/dcf 0 2024-08-31T05:21:37.880 INFO:tasks.workunit.client.0.smithi067.stdout:4/921: mknod d4/d1e/d53/d81/d122/c144 0 2024-08-31T05:21:37.888 INFO:tasks.workunit.client.0.smithi067.stdout:4/922: mknod d4/d1e/d62/dae/c145 0 2024-08-31T05:21:37.890 INFO:tasks.workunit.client.0.smithi067.stdout:2/839: link db/d12/d1a/da3/ddc/lf7 db/d8c/dcd/dac/l10c 0 2024-08-31T05:21:37.890 INFO:tasks.workunit.client.0.smithi067.stdout:4/923: write d4/d32/d43/ff1 [95925,26516] 0 2024-08-31T05:21:37.893 INFO:tasks.workunit.client.0.smithi067.stdout:0/985: symlink d1/df/d17/d43/d48/d6a/l14a 0 2024-08-31T05:21:37.897 INFO:tasks.workunit.client.0.smithi067.stdout:2/840: readlink db/dd/d13/l58 0 2024-08-31T05:21:37.898 INFO:tasks.workunit.client.0.smithi067.stdout:2/841: chown db/d12/d1a/d1e/f86 3218 1 2024-08-31T05:21:37.899 INFO:tasks.workunit.client.0.smithi067.stdout:2/842: chown db/d8c/lf9 1247024 1 2024-08-31T05:21:37.899 INFO:tasks.workunit.client.0.smithi067.stdout:4/924: rename d4/d1e/d62/f9b to d4/d32/d4c/f146 0 2024-08-31T05:21:37.900 INFO:tasks.workunit.client.0.smithi067.stdout:4/925: fsync d4/d1f/d34/f11a 0 2024-08-31T05:21:37.901 INFO:tasks.workunit.client.0.smithi067.stdout:4/926: write d4/d1e/f139 [247763,64029] 0 2024-08-31T05:21:37.901 INFO:tasks.workunit.client.0.smithi067.stdout:7/628: write d14/d16/f42 [517173,84416] 0 2024-08-31T05:21:37.903 INFO:tasks.workunit.client.0.smithi067.stdout:0/986: creat d1/dd/d18/d52/dc6/d140/d113/dac/d8d/f14b x:0 0 0 2024-08-31T05:21:37.905 INFO:tasks.workunit.client.0.smithi067.stdout:4/927: dread d4/d1e/f139 [0,4194304] 0 2024-08-31T05:21:37.906 INFO:tasks.workunit.client.0.smithi067.stdout:4/928: chown d4/d14/d48/l84 409982435 1 2024-08-31T05:21:37.908 INFO:tasks.workunit.client.0.smithi067.stdout:2/843: creat db/d12/d1a/d1e/d4d/dd5/f10d x:0 0 0 2024-08-31T05:21:37.912 INFO:tasks.workunit.client.0.smithi067.stdout:4/929: dwrite d4/d32/d4c/fe9 [0,4194304] 0 2024-08-31T05:21:37.914 INFO:tasks.workunit.client.0.smithi067.stdout:0/987: unlink d1/d50/daa/c12c 0 2024-08-31T05:21:37.914 INFO:tasks.workunit.client.0.smithi067.stdout:4/930: truncate d4/d9/db4/d83/da9/f100 795529 0 2024-08-31T05:21:37.915 INFO:tasks.workunit.client.0.smithi067.stdout:4/931: stat d4/d14/d48/d66/f70 0 2024-08-31T05:21:37.916 INFO:tasks.workunit.client.0.smithi067.stdout:0/988: write d1/dd/d18/d52/dc6/d140/fe9 [3297439,8715] 0 2024-08-31T05:21:37.924 INFO:tasks.workunit.client.0.smithi067.stdout:2/844: dwrite db/d12/d1a/d2b/d3d/d4f/f8e [4194304,4194304] 0 2024-08-31T05:21:37.924 INFO:tasks.workunit.client.0.smithi067.stdout:7/629: link d14/d16/f89 d14/d54/d91/da7/fa8 0 2024-08-31T05:21:37.934 INFO:tasks.workunit.client.0.smithi067.stdout:7/630: rmdir d14/d54/d91 39 2024-08-31T05:21:37.935 INFO:tasks.workunit.client.0.smithi067.stdout:2/845: mknod db/d12/d1a/d2b/d40/d9b/da8/c10e 0 2024-08-31T05:21:37.937 INFO:tasks.workunit.client.0.smithi067.stdout:4/932: dread d4/d1e/d53/f93 [0,4194304] 0 2024-08-31T05:21:37.938 INFO:tasks.workunit.client.0.smithi067.stdout:0/989: mknod d1/df/d17/d43/d48/d6a/d84/d127/d12b/d133/c14c 0 2024-08-31T05:21:37.940 INFO:tasks.workunit.client.0.smithi067.stdout:4/933: symlink d4/d13/l147 0 2024-08-31T05:21:37.945 INFO:tasks.workunit.client.0.smithi067.stdout:7/631: dwrite d14/d3e/f9e [0,4194304] 0 2024-08-31T05:21:37.960 INFO:tasks.workunit.client.0.smithi067.stdout:4/934: dread d4/d9/db4/d83/da9/f46 [4194304,4194304] 0 2024-08-31T05:21:37.961 INFO:tasks.workunit.client.0.smithi067.stdout:4/935: fdatasync d4/d9/fe4 0 2024-08-31T05:21:37.962 INFO:tasks.workunit.client.0.smithi067.stdout:4/936: chown d4/d32/d4c/f146 260 1 2024-08-31T05:21:37.966 INFO:tasks.workunit.client.0.smithi067.stdout:4/937: dread d4/d1e/d92/f128 [4194304,4194304] 0 2024-08-31T05:21:37.983 INFO:tasks.workunit.client.0.smithi067.stdout:2/846: link db/d12/d1a/d1e/f2f db/dd/d13/d9f/f10f 0 2024-08-31T05:21:37.986 INFO:tasks.workunit.client.0.smithi067.stdout:7/632: creat d14/d3e/fa9 x:0 0 0 2024-08-31T05:21:37.987 INFO:tasks.workunit.client.0.smithi067.stdout:7/633: chown d14/d16/c2a 82 1 2024-08-31T05:21:37.996 INFO:tasks.workunit.client.0.smithi067.stdout:2/847: creat db/d12/d1a/d2b/d87/dbd/f110 x:0 0 0 2024-08-31T05:21:37.998 INFO:tasks.workunit.client.0.smithi067.stdout:4/938: getdents d4/d9/d4b 0 2024-08-31T05:21:38.003 INFO:tasks.workunit.client.0.smithi067.stdout:4/939: mknod d4/d1e/d6d/c148 0 2024-08-31T05:21:38.005 INFO:tasks.workunit.client.0.smithi067.stdout:2/848: creat db/d12/d1a/d2b/d3d/d69/d3b/d82/de7/f111 x:0 0 0 2024-08-31T05:21:38.007 INFO:tasks.workunit.client.0.smithi067.stdout:7/634: dread d14/d16/d28/d2e/f46 [0,4194304] 0 2024-08-31T05:21:38.008 INFO:tasks.workunit.client.0.smithi067.stdout:2/849: mkdir db/dd/d2d/d112 0 2024-08-31T05:21:38.009 INFO:tasks.workunit.client.0.smithi067.stdout:2/850: chown db/d8c/dcd/c77 106 1 2024-08-31T05:21:38.019 INFO:tasks.workunit.client.0.smithi067.stdout:7/635: creat d14/d54/d5e/d8f/faa x:0 0 0 2024-08-31T05:21:38.020 INFO:tasks.workunit.client.0.smithi067.stdout:5/677: write db/d1d/d3a/f4a [3604500,53065] 0 2024-08-31T05:21:38.020 INFO:tasks.workunit.client.0.smithi067.stdout:2/851: truncate db/d12/d1a/d2b/d3d/d69/f26 7531665 0 2024-08-31T05:21:38.031 INFO:tasks.workunit.client.0.smithi067.stdout:5/678: dread db/d1d/f2d [0,4194304] 0 2024-08-31T05:21:38.061 INFO:tasks.workunit.client.0.smithi067.stdout:7/636: symlink d14/d4a/d85/da4/lab 0 2024-08-31T05:21:38.062 INFO:tasks.workunit.client.0.smithi067.stdout:2/852: mknod db/d12/d1a/d2b/d3d/d4f/de1/c113 0 2024-08-31T05:21:38.064 INFO:tasks.workunit.client.0.smithi067.stdout:5/679: getdents db/d15/d42/d36/dc7 0 2024-08-31T05:21:38.067 INFO:tasks.workunit.client.0.smithi067.stdout:2/853: fdatasync db/d12/d1a/d2b/d3d/d69/d3b/f105 0 2024-08-31T05:21:38.073 INFO:tasks.workunit.client.0.smithi067.stdout:5/680: mkdir db/d1d/d4f/dd0 0 2024-08-31T05:21:38.078 INFO:tasks.workunit.client.0.smithi067.stdout:7/637: fsync d14/d16/d5b/d94/f4f 0 2024-08-31T05:21:38.081 INFO:tasks.workunit.client.0.smithi067.stdout:5/681: creat db/d26/d29/d81/fd1 x:0 0 0 2024-08-31T05:21:38.083 INFO:tasks.workunit.client.0.smithi067.stdout:7/638: truncate d14/d16/d28/d2e/f5a 4431373 0 2024-08-31T05:21:38.086 INFO:tasks.workunit.client.0.smithi067.stdout:2/854: dwrite db/d8c/dcd/df4/da0/dc4/ffd [0,4194304] 0 2024-08-31T05:21:38.093 INFO:tasks.workunit.client.0.smithi067.stdout:7/639: mknod d14/d16/d5b/cac 0 2024-08-31T05:21:38.094 INFO:tasks.workunit.client.0.smithi067.stdout:7/640: stat la 0 2024-08-31T05:21:38.094 INFO:tasks.workunit.client.0.smithi067.stdout:5/682: dwrite db/d26/d29/d31/fcb [0,4194304] 0 2024-08-31T05:21:38.100 INFO:tasks.workunit.client.0.smithi067.stdout:5/683: rmdir db/d15/d59/dad 39 2024-08-31T05:21:38.101 INFO:tasks.workunit.client.0.smithi067.stdout:0/990: dwrite d1/df/d17/d43/d48/d6a/dfd/ffc [0,4194304] 0 2024-08-31T05:21:38.103 INFO:tasks.workunit.client.0.smithi067.stdout:7/641: fsync d14/d3e/f9e 0 2024-08-31T05:21:38.108 INFO:tasks.workunit.client.0.smithi067.stdout:2/855: dwrite db/d12/d1a/d2b/d3d/d69/d3b/f109 [0,4194304] 0 2024-08-31T05:21:38.110 INFO:tasks.workunit.client.0.smithi067.stdout:7/642: mknod d14/d16/d5b/d64/cad 0 2024-08-31T05:21:38.117 INFO:tasks.workunit.client.0.smithi067.stdout:0/991: readlink d1/df/d17/d94/lbe 0 2024-08-31T05:21:38.120 INFO:tasks.workunit.client.0.smithi067.stdout:5/684: unlink db/d15/d42/d36/d73/da9/fb1 0 2024-08-31T05:21:38.124 INFO:tasks.workunit.client.0.smithi067.stdout:2/856: symlink db/d12/d1a/d2b/d3d/d69/dec/l114 0 2024-08-31T05:21:38.125 INFO:tasks.workunit.client.0.smithi067.stdout:2/857: read - db/d8c/dcd/df4/da0/dc4/f108 zero size 2024-08-31T05:21:38.130 INFO:tasks.workunit.client.0.smithi067.stdout:0/992: mknod d1/df/d17/d43/d48/d6a/d84/d127/d12b/c14d 0 2024-08-31T05:21:38.130 INFO:tasks.workunit.client.0.smithi067.stdout:2/858: dread db/d12/d1a/d2b/d3d/d69/d3b/f78 [0,4194304] 0 2024-08-31T05:21:38.132 INFO:tasks.workunit.client.0.smithi067.stdout:5/685: fdatasync db/f21 0 2024-08-31T05:21:38.133 INFO:tasks.workunit.client.0.smithi067.stdout:2/859: truncate db/d12/d1a/d1e/d4d/dd5/f10d 1035624 0 2024-08-31T05:21:38.135 INFO:tasks.workunit.client.0.smithi067.stdout:7/643: mkdir d14/d16/d5b/d94/d8d/dae 0 2024-08-31T05:21:38.136 INFO:tasks.workunit.client.0.smithi067.stdout:7/644: write d14/d54/d5e/d67/f6d [4100996,18540] 0 2024-08-31T05:21:38.144 INFO:tasks.workunit.client.0.smithi067.stdout:2/860: dwrite db/d12/d1a/d2b/d3d/d69/dec/f100 [0,4194304] 0 2024-08-31T05:21:38.145 INFO:tasks.workunit.client.0.smithi067.stdout:7/645: mknod d14/d16/d5b/d94/d8d/caf 0 2024-08-31T05:21:38.149 INFO:tasks.workunit.client.0.smithi067.stdout:5/686: mknod db/d15/d59/dad/dcf/cd2 0 2024-08-31T05:21:38.150 INFO:tasks.workunit.client.0.smithi067.stdout:2/861: mknod db/d12/d1a/d2b/d3d/d69/d3b/d82/de7/c115 0 2024-08-31T05:21:38.157 INFO:tasks.workunit.client.0.smithi067.stdout:5/687: unlink db/d15/d59/c90 0 2024-08-31T05:21:38.169 INFO:tasks.workunit.client.0.smithi067.stdout:7/646: dread d14/f1a [0,4194304] 0 2024-08-31T05:21:38.170 INFO:tasks.workunit.client.0.smithi067.stdout:7/647: read - d14/d54/f62 zero size 2024-08-31T05:21:38.173 INFO:tasks.workunit.client.0.smithi067.stdout:7/648: rmdir d14/d54/d91 39 2024-08-31T05:21:38.174 INFO:tasks.workunit.client.0.smithi067.stdout:7/649: chown d14/d4a/c83 3176308 1 2024-08-31T05:21:38.187 INFO:tasks.workunit.client.0.smithi067.stdout:7/650: dread d14/d16/f2b [0,4194304] 0 2024-08-31T05:21:38.189 INFO:tasks.workunit.client.0.smithi067.stdout:7/651: mkdir d14/d16/d5b/d94/db0 0 2024-08-31T05:21:38.190 INFO:tasks.workunit.client.0.smithi067.stdout:7/652: readlink d14/d4a/l98 0 2024-08-31T05:21:38.190 INFO:tasks.workunit.client.0.smithi067.stdout:7/653: fsync f6 0 2024-08-31T05:21:38.193 INFO:tasks.workunit.client.0.smithi067.stdout:7/654: mknod d14/d16/d28/d2e/d53/cb1 0 2024-08-31T05:21:38.194 INFO:tasks.workunit.client.0.smithi067.stdout:7/655: fdatasync d14/d54/d5e/f6a 0 2024-08-31T05:21:38.196 INFO:tasks.workunit.client.0.smithi067.stdout:7/656: unlink d14/d16/f1d 0 2024-08-31T05:21:38.202 INFO:tasks.workunit.client.0.smithi067.stdout:7/657: dwrite d14/d16/d28/f9f [0,4194304] 0 2024-08-31T05:21:38.207 INFO:tasks.workunit.client.0.smithi067.stdout:7/658: creat d14/d16/d28/d78/fb2 x:0 0 0 2024-08-31T05:21:38.227 INFO:tasks.workunit.client.0.smithi067.stdout:0/993: write d1/df/d17/d43/d48/d6a/d84/db7/fe8 [1599779,18468] 0 2024-08-31T05:21:38.236 INFO:tasks.workunit.client.0.smithi067.stdout:2/862: write db/f3a [3073254,84130] 0 2024-08-31T05:21:38.236 INFO:tasks.workunit.client.0.smithi067.stdout:5/688: write db/f2e [1467797,72477] 0 2024-08-31T05:21:38.241 INFO:tasks.workunit.client.0.smithi067.stdout:0/994: dread d1/df/d29/d86/fd7 [0,4194304] 0 2024-08-31T05:21:38.241 INFO:tasks.workunit.client.0.smithi067.stdout:2/863: mkdir db/d12/d1a/d2b/d40/d116 0 2024-08-31T05:21:38.243 INFO:tasks.workunit.client.0.smithi067.stdout:5/689: getdents db/d1d/d4f/dd0 0 2024-08-31T05:21:38.244 INFO:tasks.workunit.client.0.smithi067.stdout:5/690: dread - db/d26/d29/d81/fd1 zero size 2024-08-31T05:21:38.245 INFO:tasks.workunit.client.0.smithi067.stdout:0/995: creat d1/d8/d42/dc9/f14e x:0 0 0 2024-08-31T05:21:38.245 INFO:tasks.workunit.client.0.smithi067.stdout:5/691: dread - db/d15/fc1 zero size 2024-08-31T05:21:38.247 INFO:tasks.workunit.client.0.smithi067.stdout:2/864: fsync db/d12/d1a/d2b/d3d/d4f/d6d/fb4 0 2024-08-31T05:21:38.250 INFO:tasks.workunit.client.0.smithi067.stdout:2/865: write db/d12/d1a/d1e/d4d/dd5/ff3 [1511906,3340] 0 2024-08-31T05:21:38.250 INFO:tasks.workunit.client.0.smithi067.stdout:5/692: mkdir db/d26/dd3 0 2024-08-31T05:21:38.253 INFO:tasks.workunit.client.0.smithi067.stdout:0/996: dwrite d1/dd/d18/d52/dc6/df5/f124 [0,4194304] 0 2024-08-31T05:21:38.258 INFO:tasks.workunit.client.0.smithi067.stdout:0/997: dread - d1/d8/d77/f11f zero size 2024-08-31T05:21:38.258 INFO:tasks.workunit.client.0.smithi067.stdout:2/866: truncate db/d12/d1a/d2b/d3d/f46 5433522 0 2024-08-31T05:21:38.260 INFO:tasks.workunit.client.0.smithi067.stdout:5/693: dwrite db/d26/d29/f99 [0,4194304] 0 2024-08-31T05:21:38.260 INFO:tasks.workunit.client.0.smithi067.stdout:7/659: symlink d14/lb3 0 2024-08-31T05:21:38.264 INFO:tasks.workunit.client.0.smithi067.stdout:5/694: creat db/d15/d53/fd4 x:0 0 0 2024-08-31T05:21:38.265 INFO:tasks.workunit.client.0.smithi067.stdout:0/998: dread d1/dd/d4d/f104 [0,4194304] 0 2024-08-31T05:21:38.267 INFO:tasks.workunit.client.0.smithi067.stdout:7/660: symlink d14/d3e/lb4 0 2024-08-31T05:21:38.268 INFO:tasks.workunit.client.0.smithi067.stdout:2/867: creat db/d8c/dcd/df4/da0/dc4/dc3/f117 x:0 0 0 2024-08-31T05:21:38.272 INFO:tasks.workunit.client.0.smithi067.stdout:0/999: rename d1/df/d29/d86/dc0/f136 to d1/df/d29/d86/db1/f14f 0 2024-08-31T05:21:38.273 INFO:tasks.workunit.client.0.smithi067.stdout:4/940: creat d4/d14/f149 x:0 0 0 2024-08-31T05:21:38.273 INFO:tasks.workunit.client.0.smithi067.stdout:2/868: dread - db/d8c/dcd/df4/da0/fad zero size 2024-08-31T05:21:38.278 INFO:tasks.workunit.client.0.smithi067.stdout:5/695: mknod db/d26/d4c/db5/cd5 0 2024-08-31T05:21:38.280 INFO:tasks.workunit.client.0.smithi067.stdout:4/941: dwrite d4/d32/d4c/f141 [0,4194304] 0 2024-08-31T05:21:38.287 INFO:tasks.workunit.client.0.smithi067.stdout:5/696: chown db/c51 3006150 1 2024-08-31T05:21:38.289 INFO:tasks.workunit.client.0.smithi067.stdout:4/942: dwrite d4/d32/d4c/fe9 [0,4194304] 0 2024-08-31T05:21:38.295 INFO:tasks.workunit.client.0.smithi067.stdout:4/943: mknod d4/d1f/c14a 0 2024-08-31T05:21:38.297 INFO:tasks.workunit.client.0.smithi067.stdout:2/869: rename db/dd/d2d/da7/f6a to db/d12/d1a/d2b/d3d/d69/d3b/d99/f118 0 2024-08-31T05:21:38.298 INFO:tasks.workunit.client.0.smithi067.stdout:2/870: stat db/d12/d1a/d1e/d4d/le0 0 2024-08-31T05:21:38.298 INFO:tasks.workunit.client.0.smithi067.stdout:2/871: chown db/d8c/dcd/df4/da0/dc4/dc3 1782 1 2024-08-31T05:21:38.304 INFO:tasks.workunit.client.0.smithi067.stdout:6/878: sync 2024-08-31T05:21:38.305 INFO:tasks.workunit.client.0.smithi067.stdout:9/772: sync 2024-08-31T05:21:38.305 INFO:tasks.workunit.client.0.smithi067.stdout:1/812: sync 2024-08-31T05:21:38.305 INFO:tasks.workunit.client.0.smithi067.stdout:7/661: truncate d14/f51 842511 0 2024-08-31T05:21:38.306 INFO:tasks.workunit.client.0.smithi067.stdout:7/662: chown d14/d16/d5b/d94 40184 1 2024-08-31T05:21:38.309 INFO:tasks.workunit.client.0.smithi067.stdout:2/872: creat db/d12/d1a/d2b/d3d/d69/d3b/d99/f119 x:0 0 0 2024-08-31T05:21:38.314 INFO:tasks.workunit.client.0.smithi067.stdout:4/944: getdents d4/da5 0 2024-08-31T05:21:38.314 INFO:tasks.workunit.client.0.smithi067.stdout:4/945: chown d4/d9/d5a/lc9 212 1 2024-08-31T05:21:38.315 INFO:tasks.workunit.client.0.smithi067.stdout:4/946: stat d4/d9/d4b/cb8 0 2024-08-31T05:21:38.316 INFO:tasks.workunit.client.0.smithi067.stdout:7/663: mknod d14/d3e/cb5 0 2024-08-31T05:21:38.317 INFO:tasks.workunit.client.0.smithi067.stdout:5/697: truncate db/d26/d29/f99 3862702 0 2024-08-31T05:21:38.318 INFO:tasks.workunit.client.0.smithi067.stdout:9/773: fdatasync dd/df/d25/d3b/f62 0 2024-08-31T05:21:38.321 INFO:tasks.workunit.client.0.smithi067.stdout:1/813: write d3/d23/d79/fa5 [524614,23034] 0 2024-08-31T05:21:38.323 INFO:tasks.workunit.client.0.smithi067.stdout:6/879: write d1b/d40/d70/dd0/d8d/dc6/d100/f103 [418517,33545] 0 2024-08-31T05:21:38.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:37 smithi067 ceph-mon[17432]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:38.329 INFO:tasks.workunit.client.0.smithi067.stdout:5/698: dwrite db/d15/d42/d36/d73/daf/fbb [0,4194304] 0 2024-08-31T05:21:38.330 INFO:tasks.workunit.client.0.smithi067.stdout:9/774: dread dd/df/d8e/d94/ff2 [0,4194304] 0 2024-08-31T05:21:38.333 INFO:tasks.workunit.client.0.smithi067.stdout:1/814: symlink d3/d23/d2d/d2e/d34/l128 0 2024-08-31T05:21:38.337 INFO:tasks.workunit.client.0.smithi067.stdout:6/880: truncate d1b/d40/d70/dd0/daa/fd3 602146 0 2024-08-31T05:21:38.338 INFO:tasks.workunit.client.0.smithi067.stdout:5/699: mknod db/d15/d42/d36/d73/daf/cd6 0 2024-08-31T05:21:38.339 INFO:tasks.workunit.client.0.smithi067.stdout:4/947: dwrite d4/d32/d43/fe2 [0,4194304] 0 2024-08-31T05:21:38.339 INFO:tasks.workunit.client.0.smithi067.stdout:9/775: symlink dd/df/d3c/dbe/dd4/l101 0 2024-08-31T05:21:38.342 INFO:tasks.workunit.client.0.smithi067.stdout:7/664: dwrite d14/d16/d28/f29 [0,4194304] 0 2024-08-31T05:21:38.345 INFO:tasks.workunit.client.0.smithi067.stdout:5/700: mkdir db/d26/d29/d31/d54/d8c/dd7 0 2024-08-31T05:21:38.345 INFO:tasks.workunit.client.0.smithi067.stdout:9/776: symlink dd/df/d25/d3b/d50/dfd/l102 0 2024-08-31T05:21:38.347 INFO:tasks.workunit.client.0.smithi067.stdout:4/948: unlink d4/f10 0 2024-08-31T05:21:38.349 INFO:tasks.workunit.client.0.smithi067.stdout:1/815: creat d3/f129 x:0 0 0 2024-08-31T05:21:38.352 INFO:tasks.workunit.client.0.smithi067.stdout:5/701: truncate db/d26/d4c/f65 752587 0 2024-08-31T05:21:38.358 INFO:tasks.workunit.client.0.smithi067.stdout:9/777: symlink dd/df/d25/d3b/d50/d73/dff/l103 0 2024-08-31T05:21:38.359 INFO:tasks.workunit.client.0.smithi067.stdout:5/702: truncate db/d1d/f2d 1406788 0 2024-08-31T05:21:38.359 INFO:tasks.workunit.client.0.smithi067.stdout:9/778: dread - dd/df/d5b/d5d/f89 zero size 2024-08-31T05:21:38.366 INFO:tasks.workunit.client.0.smithi067.stdout:5/703: mkdir db/d15/d42/dd8 0 2024-08-31T05:21:38.366 INFO:tasks.workunit.client.0.smithi067.stdout:4/949: link d4/d1f/d34/cad d4/d1e/dea/d120/c14b 0 2024-08-31T05:21:38.366 INFO:tasks.workunit.client.0.smithi067.stdout:6/881: dread d1b/d40/d70/dd0/d5c/faf [0,4194304] 0 2024-08-31T05:21:38.368 INFO:tasks.workunit.client.0.smithi067.stdout:7/665: getdents d14/d4a 0 2024-08-31T05:21:38.372 INFO:tasks.workunit.client.0.smithi067.stdout:5/704: chown db/d26/d29/d31/d54/d66/fa3 157 1 2024-08-31T05:21:38.372 INFO:tasks.workunit.client.0.smithi067.stdout:4/950: dread d4/d9/d5a/dfe/f10d [0,4194304] 0 2024-08-31T05:21:38.372 INFO:tasks.workunit.client.0.smithi067.stdout:1/816: dwrite d3/f55 [4194304,4194304] 0 2024-08-31T05:21:38.376 INFO:tasks.workunit.client.0.smithi067.stdout:4/951: write d4/d32/d4c/db3/f12e [741926,120049] 0 2024-08-31T05:21:38.377 INFO:tasks.workunit.client.0.smithi067.stdout:9/779: dread dd/f1a [0,4194304] 0 2024-08-31T05:21:38.379 INFO:tasks.workunit.client.0.smithi067.stdout:4/952: read d4/d42/f57 [1708892,79307] 0 2024-08-31T05:21:38.380 INFO:tasks.workunit.client.0.smithi067.stdout:1/817: mkdir d3/d23/db1/db6/d12a 0 2024-08-31T05:21:38.380 INFO:tasks.workunit.client.0.smithi067.stdout:6/882: mkdir d1b/d23/d120 0 2024-08-31T05:21:38.386 INFO:tasks.workunit.client.0.smithi067.stdout:4/953: fdatasync d4/d32/d4c/f146 0 2024-08-31T05:21:38.387 INFO:tasks.workunit.client.0.smithi067.stdout:5/705: dread db/d26/d29/d31/f97 [0,4194304] 0 2024-08-31T05:21:38.390 INFO:tasks.workunit.client.0.smithi067.stdout:6/883: creat d1b/d40/d70/dd0/d5c/d110/f121 x:0 0 0 2024-08-31T05:21:38.393 INFO:tasks.workunit.client.0.smithi067.stdout:9/780: write dd/df/d3c/f51 [1148768,16568] 0 2024-08-31T05:21:38.393 INFO:tasks.workunit.client.0.smithi067.stdout:7/666: dwrite d14/f51 [0,4194304] 0 2024-08-31T05:21:38.394 INFO:tasks.workunit.client.0.smithi067.stdout:1/818: mknod d3/d23/d2d/d2e/d34/d66/d94/c12b 0 2024-08-31T05:21:38.398 INFO:tasks.workunit.client.0.smithi067.stdout:5/706: mknod db/d15/d59/dad/dcf/cd9 0 2024-08-31T05:21:38.399 INFO:tasks.workunit.client.0.smithi067.stdout:6/884: creat d1b/d40/d70/dd0/d5c/d86/f122 x:0 0 0 2024-08-31T05:21:38.400 INFO:tasks.workunit.client.0.smithi067.stdout:4/954: dwrite d4/d9/d4b/f13e [0,4194304] 0 2024-08-31T05:21:38.402 INFO:tasks.workunit.client.0.smithi067.stdout:7/667: mknod d14/d16/d5b/d94/d8d/cb6 0 2024-08-31T05:21:38.408 INFO:tasks.workunit.client.0.smithi067.stdout:4/955: rename d4/d1e/d6d/f13d to d4/d14/d48/f14c 0 2024-08-31T05:21:38.410 INFO:tasks.workunit.client.0.smithi067.stdout:7/668: dwrite d14/d4a/f4b [0,4194304] 0 2024-08-31T05:21:38.414 INFO:tasks.workunit.client.0.smithi067.stdout:4/956: mknod d4/d42/c14d 0 2024-08-31T05:21:38.423 INFO:tasks.workunit.client.0.smithi067.stdout:5/707: write db/d26/d29/d31/d54/d66/fa3 [951707,92704] 0 2024-08-31T05:21:38.425 INFO:tasks.workunit.client.0.smithi067.stdout:4/957: write d4/d9/da2/df8/f10f [191216,53243] 0 2024-08-31T05:21:38.426 INFO:tasks.workunit.client.0.smithi067.stdout:6/885: link d1b/d40/d70/dd0/d5e/l11f d1b/d40/d96/db3/dff/l123 0 2024-08-31T05:21:38.429 INFO:tasks.workunit.client.0.smithi067.stdout:9/781: dwrite dd/df/d8e/d94/fc8 [0,4194304] 0 2024-08-31T05:21:38.430 INFO:tasks.workunit.client.0.smithi067.stdout:5/708: creat db/d26/d4c/db5/fda x:0 0 0 2024-08-31T05:21:38.431 INFO:tasks.workunit.client.0.smithi067.stdout:5/709: chown db/c34 2 1 2024-08-31T05:21:38.431 INFO:tasks.workunit.client.0.smithi067.stdout:4/958: symlink d4/d32/l14e 0 2024-08-31T05:21:38.432 INFO:tasks.workunit.client.0.smithi067.stdout:5/710: write db/f32 [2764528,102903] 0 2024-08-31T05:21:38.432 INFO:tasks.workunit.client.0.smithi067.stdout:4/959: chown d4/f11f 1 1 2024-08-31T05:21:38.435 INFO:tasks.workunit.client.0.smithi067.stdout:6/886: symlink d1b/d40/d70/dd0/d5c/l124 0 2024-08-31T05:21:38.439 INFO:tasks.workunit.client.0.smithi067.stdout:7/669: truncate d14/d16/f42 2254465 0 2024-08-31T05:21:38.439 INFO:tasks.workunit.client.0.smithi067.stdout:7/670: stat d14/d4a 0 2024-08-31T05:21:38.440 INFO:tasks.workunit.client.0.smithi067.stdout:5/711: symlink db/d1d/d4f/ldb 0 2024-08-31T05:21:38.443 INFO:tasks.workunit.client.0.smithi067.stdout:4/960: mkdir d4/d42/de3/d14f 0 2024-08-31T05:21:38.444 INFO:tasks.workunit.client.0.smithi067.stdout:4/961: chown d4/d1e/d53/c73 0 1 2024-08-31T05:21:38.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:37 smithi073 ceph-mon[24726]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:38.445 INFO:tasks.workunit.client.0.smithi067.stdout:6/887: dread d1b/d40/d70/dd0/da4/ffc [0,4194304] 0 2024-08-31T05:21:38.446 INFO:tasks.workunit.client.0.smithi067.stdout:7/671: fdatasync d14/d16/d5b/d64/f8b 0 2024-08-31T05:21:38.452 INFO:tasks.workunit.client.0.smithi067.stdout:9/782: dwrite dd/f2a [0,4194304] 0 2024-08-31T05:21:38.459 INFO:tasks.workunit.client.0.smithi067.stdout:4/962: dwrite d4/d1e/dea/fef [0,4194304] 0 2024-08-31T05:21:38.459 INFO:tasks.workunit.client.0.smithi067.stdout:5/712: write db/d26/f74 [4514013,107246] 0 2024-08-31T05:21:38.461 INFO:tasks.workunit.client.0.smithi067.stdout:5/713: chown db/d1d/d4f/ldb 244540 1 2024-08-31T05:21:38.462 INFO:tasks.workunit.client.0.smithi067.stdout:6/888: dread d1b/d23/d28/db9/fbf [0,4194304] 0 2024-08-31T05:21:38.465 INFO:tasks.workunit.client.0.smithi067.stdout:7/672: rename d14/d16/d5b/d64/c63 to d14/d16/d28/cb7 0 2024-08-31T05:21:38.474 INFO:tasks.workunit.client.0.smithi067.stdout:9/783: rename dd/df/d25/d3b/f62 to dd/d20/f104 0 2024-08-31T05:21:38.476 INFO:tasks.workunit.client.0.smithi067.stdout:4/963: creat d4/f150 x:0 0 0 2024-08-31T05:21:38.477 INFO:tasks.workunit.client.0.smithi067.stdout:7/673: rename d14/d16/d5b/d94/f4f to d14/d4a/fb8 0 2024-08-31T05:21:38.479 INFO:tasks.workunit.client.0.smithi067.stdout:4/964: creat d4/d1e/dea/f151 x:0 0 0 2024-08-31T05:21:38.481 INFO:tasks.workunit.client.0.smithi067.stdout:7/674: unlink d14/d16/d28/d2e/c3b 0 2024-08-31T05:21:38.483 INFO:tasks.workunit.client.0.smithi067.stdout:9/784: dread dd/df/d25/d59/f81 [0,4194304] 0 2024-08-31T05:21:38.485 INFO:tasks.workunit.client.0.smithi067.stdout:9/785: fsync dd/d63/f88 0 2024-08-31T05:21:38.486 INFO:tasks.workunit.client.0.smithi067.stdout:7/675: symlink d14/d16/d28/d2e/lb9 0 2024-08-31T05:21:38.493 INFO:tasks.workunit.client.0.smithi067.stdout:4/965: dwrite d4/d1e/dea/fef [0,4194304] 0 2024-08-31T05:21:38.495 INFO:tasks.workunit.client.0.smithi067.stdout:5/714: dwrite db/d26/d29/d31/fa0 [0,4194304] 0 2024-08-31T05:21:38.496 INFO:tasks.workunit.client.0.smithi067.stdout:6/889: dwrite d1b/d40/d70/dd0/d5e/de6/fc7 [0,4194304] 0 2024-08-31T05:21:38.499 INFO:tasks.workunit.client.0.smithi067.stdout:9/786: rename dd/df/d5b/d5d/d7a/ca1 to dd/d4d/c105 0 2024-08-31T05:21:38.506 INFO:tasks.workunit.client.0.smithi067.stdout:7/676: creat d14/d16/d5b/d94/d8d/dae/fba x:0 0 0 2024-08-31T05:21:38.509 INFO:tasks.workunit.client.0.smithi067.stdout:9/787: rename dd/d63/d72/c95 to dd/df/d25/c106 0 2024-08-31T05:21:38.512 INFO:tasks.workunit.client.0.smithi067.stdout:7/677: stat d14/d16/d28/c45 0 2024-08-31T05:21:38.517 INFO:tasks.workunit.client.0.smithi067.stdout:7/678: fdatasync d14/d54/f66 0 2024-08-31T05:21:38.526 INFO:tasks.workunit.client.0.smithi067.stdout:7/679: dwrite d14/d16/d28/fa0 [0,4194304] 0 2024-08-31T05:21:38.532 INFO:tasks.workunit.client.0.smithi067.stdout:7/680: creat d14/d4a/d85/da4/fbb x:0 0 0 2024-08-31T05:21:38.534 INFO:tasks.workunit.client.0.smithi067.stdout:6/890: dread d1b/d23/f34 [0,4194304] 0 2024-08-31T05:21:38.539 INFO:tasks.workunit.client.0.smithi067.stdout:6/891: fdatasync d1b/d40/d70/dd0/f5b 0 2024-08-31T05:21:38.539 INFO:tasks.workunit.client.0.smithi067.stdout:9/788: dwrite dd/d63/fc9 [0,4194304] 0 2024-08-31T05:21:38.542 INFO:tasks.workunit.client.0.smithi067.stdout:7/681: dwrite d14/d3e/f9e [0,4194304] 0 2024-08-31T05:21:38.545 INFO:tasks.workunit.client.0.smithi067.stdout:7/682: chown d14/d16/d28/d2e/f5a 211 1 2024-08-31T05:21:38.549 INFO:tasks.workunit.client.0.smithi067.stdout:9/789: rename dd/df/d3c/dbe/dd4/de0/lf6 to dd/df/d5b/d5d/dea/l107 0 2024-08-31T05:21:38.550 INFO:tasks.workunit.client.0.smithi067.stdout:9/790: chown dd/df/d5b/c64 43 1 2024-08-31T05:21:38.553 INFO:tasks.workunit.client.0.smithi067.stdout:7/683: creat d14/d54/d5e/fbc x:0 0 0 2024-08-31T05:21:38.555 INFO:tasks.workunit.client.0.smithi067.stdout:9/791: unlink dd/df/f24 0 2024-08-31T05:21:38.562 INFO:tasks.workunit.client.0.smithi067.stdout:9/792: dwrite dd/df/f43 [0,4194304] 0 2024-08-31T05:21:38.564 INFO:tasks.workunit.client.0.smithi067.stdout:7/684: getdents d14/d16/d28 0 2024-08-31T05:21:38.566 INFO:tasks.workunit.client.0.smithi067.stdout:9/793: read dd/df/d25/d59/f81 [97716,112863] 0 2024-08-31T05:21:38.567 INFO:tasks.workunit.client.0.smithi067.stdout:6/892: dwrite f19 [0,4194304] 0 2024-08-31T05:21:38.571 INFO:tasks.workunit.client.0.smithi067.stdout:7/685: mknod d14/d16/d5b/d68/d87/cbd 0 2024-08-31T05:21:38.575 INFO:tasks.workunit.client.0.smithi067.stdout:6/893: mkdir d1b/d40/d70/dd0/d5c/d125 0 2024-08-31T05:21:38.585 INFO:tasks.workunit.client.0.smithi067.stdout:6/894: write d1b/d30/f73 [2221470,73068] 0 2024-08-31T05:21:38.585 INFO:tasks.workunit.client.0.smithi067.stdout:7/686: truncate d14/d54/d5e/d67/f6d 1087788 0 2024-08-31T05:21:38.588 INFO:tasks.workunit.client.0.smithi067.stdout:6/895: chown d1b/d40/d70/dd0/f65 257809568 1 2024-08-31T05:21:38.589 INFO:tasks.workunit.client.0.smithi067.stdout:7/687: creat d14/d16/d5b/d94/fbe x:0 0 0 2024-08-31T05:21:38.590 INFO:tasks.workunit.client.0.smithi067.stdout:9/794: dread dd/df/d25/d59/fdb [0,4194304] 0 2024-08-31T05:21:38.591 INFO:tasks.workunit.client.0.smithi067.stdout:7/688: mkdir d14/d4a/d85/da4/dbf 0 2024-08-31T05:21:38.592 INFO:tasks.workunit.client.0.smithi067.stdout:7/689: readlink d14/lb3 0 2024-08-31T05:21:38.596 INFO:tasks.workunit.client.0.smithi067.stdout:9/795: rename dd/df/f43 to dd/d4d/dca/f108 0 2024-08-31T05:21:38.601 INFO:tasks.workunit.client.0.smithi067.stdout:7/690: rmdir d14/d54/d91/da7 39 2024-08-31T05:21:38.604 INFO:tasks.workunit.client.0.smithi067.stdout:6/896: link d1b/d40/d96/f10d d1b/d8e/f126 0 2024-08-31T05:21:38.605 INFO:tasks.workunit.client.0.smithi067.stdout:9/796: creat dd/df/d25/f109 x:0 0 0 2024-08-31T05:21:38.605 INFO:tasks.workunit.client.0.smithi067.stdout:9/797: readlink dd/df/d25/d3b/d50/d73/le5 0 2024-08-31T05:21:38.607 INFO:tasks.workunit.client.0.smithi067.stdout:6/897: mkdir d1b/d40/d96/db3/d127 0 2024-08-31T05:21:38.609 INFO:tasks.workunit.client.0.smithi067.stdout:9/798: rename dd/df/d25/d59/fae to dd/df/d5b/d5d/f10a 0 2024-08-31T05:21:38.611 INFO:tasks.workunit.client.0.smithi067.stdout:6/898: symlink d1b/d40/d70/dd0/da4/l128 0 2024-08-31T05:21:38.612 INFO:tasks.workunit.client.0.smithi067.stdout:9/799: fsync dd/d4d/f60 0 2024-08-31T05:21:38.614 INFO:tasks.workunit.client.0.smithi067.stdout:7/691: write d14/d54/d91/da7/fa8 [1369311,92961] 0 2024-08-31T05:21:38.617 INFO:tasks.workunit.client.0.smithi067.stdout:9/800: creat dd/df/d5b/d5d/f10b x:0 0 0 2024-08-31T05:21:38.618 INFO:tasks.workunit.client.0.smithi067.stdout:9/801: write dd/df/fbb [27659,39272] 0 2024-08-31T05:21:38.623 INFO:tasks.workunit.client.0.smithi067.stdout:9/802: creat dd/d4d/f10c x:0 0 0 2024-08-31T05:21:38.624 INFO:tasks.workunit.client.0.smithi067.stdout:6/899: rmdir d1b/d40/d117 0 2024-08-31T05:21:38.625 INFO:tasks.workunit.client.0.smithi067.stdout:6/900: chown c5 224842 1 2024-08-31T05:21:38.629 INFO:tasks.workunit.client.0.smithi067.stdout:9/803: dwrite dd/d63/ffb [0,4194304] 0 2024-08-31T05:21:38.631 INFO:tasks.workunit.client.0.smithi067.stdout:6/901: dread - d1b/d7a/ffa zero size 2024-08-31T05:21:38.634 INFO:tasks.workunit.client.0.smithi067.stdout:9/804: rmdir dd/df/d25/d3b 39 2024-08-31T05:21:38.635 INFO:tasks.workunit.client.0.smithi067.stdout:7/692: truncate d14/d54/d91/da7/fa8 1206609 0 2024-08-31T05:21:38.635 INFO:tasks.workunit.client.0.smithi067.stdout:7/693: readlink d14/d16/d5b/d94/l71 0 2024-08-31T05:21:38.636 INFO:tasks.workunit.client.0.smithi067.stdout:6/902: symlink d1b/d40/d96/db3/l129 0 2024-08-31T05:21:38.639 INFO:tasks.workunit.client.0.smithi067.stdout:7/694: mkdir d14/d16/d5b/d68/d6e/dc0 0 2024-08-31T05:21:38.641 INFO:tasks.workunit.client.0.smithi067.stdout:9/805: fsync dd/df/d25/d3b/fe8 0 2024-08-31T05:21:38.648 INFO:tasks.workunit.client.0.smithi067.stdout:9/806: creat dd/df/d8e/f10d x:0 0 0 2024-08-31T05:21:38.656 INFO:tasks.workunit.client.0.smithi067.stdout:6/903: dwrite d1b/d7a/ffa [0,4194304] 0 2024-08-31T05:21:38.657 INFO:tasks.workunit.client.0.smithi067.stdout:6/904: chown d1b/d40/d70/dd0/daa/l118 470 1 2024-08-31T05:21:38.664 INFO:tasks.workunit.client.0.smithi067.stdout:6/905: rename d1b/d23/d61/d77 to d1b/d40/d70/dd0/d5c/d12a 0 2024-08-31T05:21:38.665 INFO:tasks.workunit.client.0.smithi067.stdout:9/807: dwrite dd/df/d25/f2c [0,4194304] 0 2024-08-31T05:21:38.668 INFO:tasks.workunit.client.0.smithi067.stdout:6/906: truncate d1b/d7a/fc8 316736 0 2024-08-31T05:21:38.669 INFO:tasks.workunit.client.0.smithi067.stdout:9/808: truncate dd/f1a 542033 0 2024-08-31T05:21:38.670 INFO:tasks.workunit.client.0.smithi067.stdout:9/809: chown dd/df/d25/d3b 56331753 1 2024-08-31T05:21:38.671 INFO:tasks.workunit.client.0.smithi067.stdout:6/907: mknod d1b/d40/d70/dd0/d5c/c12b 0 2024-08-31T05:21:38.674 INFO:tasks.workunit.client.0.smithi067.stdout:6/908: unlink d1b/d40/d70/dd0/da4/f102 0 2024-08-31T05:21:38.677 INFO:tasks.workunit.client.0.smithi067.stdout:7/695: dread d14/d16/f89 [0,4194304] 0 2024-08-31T05:21:38.687 INFO:tasks.workunit.client.0.smithi067.stdout:7/696: link d14/d16/f89 d14/d16/d5b/d64/d90/fc1 0 2024-08-31T05:21:38.687 INFO:tasks.workunit.client.0.smithi067.stdout:6/909: write d1b/d40/d70/dd0/daa/fd3 [123194,79797] 0 2024-08-31T05:21:38.690 INFO:tasks.workunit.client.0.smithi067.stdout:9/810: dwrite dd/df/d25/d3b/f3e [0,4194304] 0 2024-08-31T05:21:38.691 INFO:tasks.workunit.client.0.smithi067.stdout:9/811: fdatasync dd/df/d25/d3b/d50/d73/fc4 0 2024-08-31T05:21:38.693 INFO:tasks.workunit.client.0.smithi067.stdout:7/697: creat d14/d54/d5e/d67/fc2 x:0 0 0 2024-08-31T05:21:38.694 INFO:tasks.workunit.client.0.smithi067.stdout:6/910: mkdir d1b/d23/d12c 0 2024-08-31T05:21:38.697 INFO:tasks.workunit.client.0.smithi067.stdout:9/812: fdatasync dd/df/d8e/d94/ff2 0 2024-08-31T05:21:38.698 INFO:tasks.workunit.client.0.smithi067.stdout:7/698: unlink f11 0 2024-08-31T05:21:38.701 INFO:tasks.workunit.client.0.smithi067.stdout:7/699: symlink d14/d16/d5b/d68/d87/lc3 0 2024-08-31T05:21:38.703 INFO:tasks.workunit.client.0.smithi067.stdout:9/813: dwrite dd/d63/d72/fab [4194304,4194304] 0 2024-08-31T05:21:38.708 INFO:tasks.workunit.client.0.smithi067.stdout:6/911: creat d1b/d40/d70/d71/f12d x:0 0 0 2024-08-31T05:21:38.708 INFO:tasks.workunit.client.0.smithi067.stdout:9/814: creat dd/d4d/dca/f10e x:0 0 0 2024-08-31T05:21:38.710 INFO:tasks.workunit.client.0.smithi067.stdout:7/700: dwrite d14/d16/d28/d78/fa3 [0,4194304] 0 2024-08-31T05:21:38.715 INFO:tasks.workunit.client.0.smithi067.stdout:7/701: rmdir d14/d16/d5b/d68 39 2024-08-31T05:21:38.719 INFO:tasks.workunit.client.0.smithi067.stdout:7/702: dread d14/d16/f89 [0,4194304] 0 2024-08-31T05:21:38.719 INFO:tasks.workunit.client.0.smithi067.stdout:6/912: getdents d1b/d30 0 2024-08-31T05:21:38.720 INFO:tasks.workunit.client.0.smithi067.stdout:7/703: write d14/d4a/d85/da4/fbb [451871,12629] 0 2024-08-31T05:21:38.724 INFO:tasks.workunit.client.0.smithi067.stdout:7/704: dread d14/d16/f2b [0,4194304] 0 2024-08-31T05:21:38.728 INFO:tasks.workunit.client.0.smithi067.stdout:6/913: dread d1b/d40/d70/dd0/d8d/f101 [0,4194304] 0 2024-08-31T05:21:38.791 INFO:tasks.workunit.client.0.smithi067.stdout:7/705: dread d14/f59 [0,4194304] 0 2024-08-31T05:21:38.793 INFO:tasks.workunit.client.0.smithi067.stdout:6/914: mkdir d1b/d40/d70/dd0/d5e/d7b/d12e 0 2024-08-31T05:21:38.795 INFO:tasks.workunit.client.0.smithi067.stdout:9/815: dwrite dd/df/fd9 [0,4194304] 0 2024-08-31T05:21:38.795 INFO:tasks.workunit.client.0.smithi067.stdout:6/915: write d1b/d23/f2a [561397,39799] 0 2024-08-31T05:21:38.812 INFO:tasks.workunit.client.0.smithi067.stdout:9/816: stat dd/da2/fa8 0 2024-08-31T05:21:38.815 INFO:tasks.workunit.client.0.smithi067.stdout:6/916: rename d1b/d23/d28/fdf to d1b/d40/d70/d71/d78/f12f 0 2024-08-31T05:21:38.816 INFO:tasks.workunit.client.0.smithi067.stdout:6/917: fsync d1b/d40/d70/dd0/daa/fb8 0 2024-08-31T05:21:38.816 INFO:tasks.workunit.client.0.smithi067.stdout:7/706: creat d14/d16/d5b/d68/d6e/dc0/fc4 x:0 0 0 2024-08-31T05:21:38.821 INFO:tasks.workunit.client.0.smithi067.stdout:6/918: dwrite d1b/d40/d70/f116 [0,4194304] 0 2024-08-31T05:21:38.823 INFO:tasks.workunit.client.0.smithi067.stdout:6/919: readlink d1b/d40/d70/dd0/d5c/d107/l115 0 2024-08-31T05:21:38.832 INFO:tasks.workunit.client.0.smithi067.stdout:6/920: fsync d1b/d40/d70/d71/d78/f12f 0 2024-08-31T05:21:38.835 INFO:tasks.workunit.client.0.smithi067.stdout:6/921: write d1b/d40/d70/dd0/d8d/dc6/fec [23703,71889] 0 2024-08-31T05:21:38.839 INFO:tasks.workunit.client.0.smithi067.stdout:6/922: creat d1b/d40/d70/dd0/d8d/f130 x:0 0 0 2024-08-31T05:21:38.840 INFO:tasks.workunit.client.0.smithi067.stdout:7/707: truncate d14/f95 2013556 0 2024-08-31T05:21:38.841 INFO:tasks.workunit.client.0.smithi067.stdout:7/708: dread - d14/d54/d91/fa2 zero size 2024-08-31T05:21:38.842 INFO:tasks.workunit.client.0.smithi067.stdout:9/817: dwrite dd/df/d25/d3b/d50/d73/ff4 [0,4194304] 0 2024-08-31T05:21:38.842 INFO:tasks.workunit.client.0.smithi067.stdout:7/709: stat d14/d16/d28/d2e/f7e 0 2024-08-31T05:21:38.843 INFO:tasks.workunit.client.0.smithi067.stdout:7/710: fsync d14/d4a/f81 0 2024-08-31T05:21:38.847 INFO:tasks.workunit.client.0.smithi067.stdout:9/818: creat dd/df/d3c/dbe/dd4/de0/f10f x:0 0 0 2024-08-31T05:21:38.848 INFO:tasks.workunit.client.0.smithi067.stdout:7/711: creat d14/d4a/fc5 x:0 0 0 2024-08-31T05:21:38.848 INFO:tasks.workunit.client.0.smithi067.stdout:9/819: write dd/df/d8e/d94/ff2 [4600835,114647] 0 2024-08-31T05:21:38.853 INFO:tasks.workunit.client.0.smithi067.stdout:7/712: unlink d14/d16/d28/d2e/f7e 0 2024-08-31T05:21:38.860 INFO:tasks.workunit.client.0.smithi067.stdout:9/820: link dd/d4d/f10c dd/d63/d72/f110 0 2024-08-31T05:21:38.861 INFO:tasks.workunit.client.0.smithi067.stdout:6/923: dread d1b/d7a/f9a [0,4194304] 0 2024-08-31T05:21:38.862 INFO:tasks.workunit.client.0.smithi067.stdout:6/924: chown d1b/d40/d70/f10c 3128 1 2024-08-31T05:21:38.864 INFO:tasks.workunit.client.0.smithi067.stdout:7/713: rename d14/d16/f86 to d14/d16/fc6 0 2024-08-31T05:21:38.865 INFO:tasks.workunit.client.0.smithi067.stdout:9/821: mknod dd/df/d8e/dcc/c111 0 2024-08-31T05:21:38.865 INFO:tasks.workunit.client.0.smithi067.stdout:7/714: write d14/d16/d28/f29 [1013734,15232] 0 2024-08-31T05:21:38.865 INFO:tasks.workunit.client.0.smithi067.stdout:9/822: chown dd/d4d/f60 14912 1 2024-08-31T05:21:38.867 INFO:tasks.workunit.client.0.smithi067.stdout:9/823: write dd/df/d5b/fee [290969,68803] 0 2024-08-31T05:21:38.872 INFO:tasks.workunit.client.0.smithi067.stdout:9/824: write dd/d63/d72/f110 [385550,6447] 0 2024-08-31T05:21:38.873 INFO:tasks.workunit.client.0.smithi067.stdout:9/825: fsync dd/df/d25/d59/f8c 0 2024-08-31T05:21:38.876 INFO:tasks.workunit.client.0.smithi067.stdout:9/826: symlink dd/da2/dd0/l112 0 2024-08-31T05:21:38.877 INFO:tasks.workunit.client.0.smithi067.stdout:9/827: write dd/d63/d72/f110 [1015686,40873] 0 2024-08-31T05:21:38.888 INFO:tasks.workunit.client.0.smithi067.stdout:9/828: dwrite dd/d63/da3/faa [4194304,4194304] 0 2024-08-31T05:21:38.893 INFO:tasks.workunit.client.0.smithi067.stdout:9/829: getdents dd/da2 0 2024-08-31T05:21:38.897 INFO:tasks.workunit.client.0.smithi067.stdout:9/830: symlink dd/d63/da3/l113 0 2024-08-31T05:21:38.904 INFO:tasks.workunit.client.0.smithi067.stdout:9/831: dwrite dd/df/d25/fa4 [0,4194304] 0 2024-08-31T05:21:38.905 INFO:tasks.workunit.client.0.smithi067.stdout:7/715: truncate d14/d16/fc6 2058115 0 2024-08-31T05:21:38.905 INFO:tasks.workunit.client.0.smithi067.stdout:6/925: dwrite d1b/d40/d70/dd0/d5c/faf [0,4194304] 0 2024-08-31T05:21:38.911 INFO:tasks.workunit.client.0.smithi067.stdout:7/716: dread d14/d16/f4e [0,4194304] 0 2024-08-31T05:21:38.912 INFO:tasks.workunit.client.0.smithi067.stdout:7/717: chown d14/d16/d28 260603552 1 2024-08-31T05:21:38.914 INFO:tasks.workunit.client.0.smithi067.stdout:7/718: mkdir d14/d16/d5b/d8c/dc7 0 2024-08-31T05:21:38.920 INFO:tasks.workunit.client.0.smithi067.stdout:7/719: link d14/d4a/f97 d14/d16/fc8 0 2024-08-31T05:21:38.923 INFO:tasks.workunit.client.0.smithi067.stdout:7/720: creat d14/d54/d5e/d8f/fc9 x:0 0 0 2024-08-31T05:21:38.924 INFO:tasks.workunit.client.0.smithi067.stdout:7/721: chown d14/d16/d5b/d94/l71 462026173 1 2024-08-31T05:21:38.928 INFO:tasks.workunit.client.0.smithi067.stdout:7/722: rename d14/d4a/f97 to d14/d16/d5b/d8c/fca 0 2024-08-31T05:21:38.928 INFO:tasks.workunit.client.0.smithi067.stdout:7/723: readlink d14/d16/d28/l43 0 2024-08-31T05:21:38.929 INFO:tasks.workunit.client.0.smithi067.stdout:7/724: write d14/d54/d5e/d67/fc2 [147692,65767] 0 2024-08-31T05:21:38.939 INFO:tasks.workunit.client.0.smithi067.stdout:6/926: write d1b/d23/f9c [736510,77274] 0 2024-08-31T05:21:38.942 INFO:tasks.workunit.client.0.smithi067.stdout:6/927: creat d1b/d40/d70/dd0/d5c/f131 x:0 0 0 2024-08-31T05:21:38.943 INFO:tasks.workunit.client.0.smithi067.stdout:7/725: dread d14/d3e/f55 [0,4194304] 0 2024-08-31T05:21:38.945 INFO:tasks.workunit.client.0.smithi067.stdout:7/726: symlink d14/d16/d28/d78/lcb 0 2024-08-31T05:21:38.948 INFO:tasks.workunit.client.0.smithi067.stdout:7/727: mkdir d14/d54/d5e/d67/dcc 0 2024-08-31T05:21:38.950 INFO:tasks.workunit.client.0.smithi067.stdout:6/928: dwrite d1b/d40/d70/dd0/d5c/f131 [0,4194304] 0 2024-08-31T05:21:38.951 INFO:tasks.workunit.client.0.smithi067.stdout:7/728: creat d14/d16/d28/d2e/fcd x:0 0 0 2024-08-31T05:21:38.959 INFO:tasks.workunit.client.0.smithi067.stdout:7/729: dwrite d14/d16/d28/f35 [0,4194304] 0 2024-08-31T05:21:39.012 INFO:tasks.workunit.client.0.smithi067.stdout:7/730: dwrite d14/d54/d5e/f82 [0,4194304] 0 2024-08-31T05:21:39.016 INFO:tasks.workunit.client.0.smithi067.stdout:7/731: dread d14/d16/d28/f35 [0,4194304] 0 2024-08-31T05:21:39.027 INFO:tasks.workunit.client.0.smithi067.stdout:7/732: mknod d14/d16/d28/d78/cce 0 2024-08-31T05:21:39.027 INFO:tasks.workunit.client.0.smithi067.stdout:7/733: readlink d14/d16/d5b/d64/l56 0 2024-08-31T05:21:39.035 INFO:tasks.workunit.client.0.smithi067.stdout:7/734: dwrite d14/f18 [0,4194304] 0 2024-08-31T05:21:39.109 INFO:tasks.workunit.client.0.smithi067.stdout:7/735: truncate d14/d16/d5b/f5c 909523 0 2024-08-31T05:21:39.110 INFO:tasks.workunit.client.0.smithi067.stdout:7/736: fdatasync d14/d16/d28/f29 0 2024-08-31T05:21:39.110 INFO:tasks.workunit.client.0.smithi067.stdout:7/737: fdatasync d14/d4a/d85/da4/fbb 0 2024-08-31T05:21:39.114 INFO:tasks.workunit.client.0.smithi067.stdout:7/738: truncate d14/f95 2885082 0 2024-08-31T05:21:39.115 INFO:tasks.workunit.client.0.smithi067.stdout:7/739: chown d14/d16/d28/d2e/d53 7 1 2024-08-31T05:21:39.129 INFO:tasks.workunit.client.0.smithi067.stdout:7/740: dread d14/d16/d28/d2e/f37 [0,4194304] 0 2024-08-31T05:21:39.130 INFO:tasks.workunit.client.0.smithi067.stdout:7/741: write d14/d16/d28/f9f [1367675,68642] 0 2024-08-31T05:21:39.130 INFO:tasks.workunit.client.0.smithi067.stdout:7/742: dread - d14/d16/fc8 zero size 2024-08-31T05:21:39.133 INFO:tasks.workunit.client.0.smithi067.stdout:7/743: rmdir d14/d16/d5b/d68/d80 39 2024-08-31T05:21:39.134 INFO:tasks.workunit.client.0.smithi067.stdout:7/744: dread - d14/d16/d28/d78/fb2 zero size 2024-08-31T05:21:39.134 INFO:tasks.workunit.client.0.smithi067.stdout:7/745: dread - d14/d16/d28/d78/fb2 zero size 2024-08-31T05:21:39.145 INFO:tasks.workunit.client.0.smithi067.stdout:7/746: dwrite f6 [0,4194304] 0 2024-08-31T05:21:39.148 INFO:tasks.workunit.client.0.smithi067.stdout:7/747: truncate d14/d16/d5b/d64/f8b 1634297 0 2024-08-31T05:21:39.150 INFO:tasks.workunit.client.0.smithi067.stdout:7/748: mkdir d14/d16/d5b/d8c/dc7/dcf 0 2024-08-31T05:21:39.151 INFO:tasks.workunit.client.0.smithi067.stdout:7/749: stat d14/d16/d5b/d94/d8d/caf 0 2024-08-31T05:21:39.155 INFO:tasks.workunit.client.0.smithi067.stdout:7/750: getdents d14/d16/d28 0 2024-08-31T05:21:39.160 INFO:tasks.workunit.client.0.smithi067.stdout:7/751: link d14/d3e/f9e d14/d16/d5b/d68/fd0 0 2024-08-31T05:21:39.162 INFO:tasks.workunit.client.0.smithi067.stdout:7/752: creat d14/d3e/fd1 x:0 0 0 2024-08-31T05:21:39.164 INFO:tasks.workunit.client.0.smithi067.stdout:7/753: mknod d14/d16/d5b/d68/d6e/dc0/cd2 0 2024-08-31T05:21:39.168 INFO:tasks.workunit.client.0.smithi067.stdout:7/754: rename d14/d3e/f55 to d14/d54/d91/fd3 0 2024-08-31T05:21:39.173 INFO:tasks.workunit.client.0.smithi067.stdout:7/755: dwrite d14/d16/d28/d2e/f5a [0,4194304] 0 2024-08-31T05:21:39.178 INFO:tasks.workunit.client.0.smithi067.stdout:7/756: getdents d14/d16/d5b/d64 0 2024-08-31T05:21:39.181 INFO:tasks.workunit.client.0.smithi067.stdout:7/757: rename d14/d4a/c9b to d14/d4a/d85/da4/dbf/cd4 0 2024-08-31T05:21:39.183 INFO:tasks.workunit.client.0.smithi067.stdout:7/758: rmdir d14/d54/d5e/d8f 39 2024-08-31T05:21:39.195 INFO:tasks.workunit.client.0.smithi067.stdout:7/759: dread d14/d16/d5b/f5c [0,4194304] 0 2024-08-31T05:21:39.198 INFO:tasks.workunit.client.0.smithi067.stdout:7/760: dread d14/d16/f2b [0,4194304] 0 2024-08-31T05:21:39.210 INFO:tasks.workunit.client.0.smithi067.stdout:7/761: write d14/d54/d5e/d67/fa5 [559707,29616] 0 2024-08-31T05:21:39.212 INFO:tasks.workunit.client.0.smithi067.stdout:7/762: truncate d14/d16/d5b/f5c 963913 0 2024-08-31T05:21:39.213 INFO:tasks.workunit.client.0.smithi067.stdout:7/763: write d14/d4a/d85/f96 [827097,86447] 0 2024-08-31T05:21:39.217 INFO:tasks.workunit.client.0.smithi067.stdout:7/764: dread d14/d4a/d85/f96 [0,4194304] 0 2024-08-31T05:21:39.218 INFO:tasks.workunit.client.0.smithi067.stdout:7/765: readlink la 0 2024-08-31T05:21:39.220 INFO:tasks.workunit.client.0.smithi067.stdout:7/766: unlink d14/d16/d5b/d64/l65 0 2024-08-31T05:21:39.222 INFO:tasks.workunit.client.0.smithi067.stdout:7/767: write d14/d16/d28/d2e/f37 [3029160,42118] 0 2024-08-31T05:21:39.228 INFO:tasks.workunit.client.0.smithi067.stdout:7/768: write d14/d3e/f70 [1930076,129104] 0 2024-08-31T05:21:39.230 INFO:tasks.workunit.client.0.smithi067.stdout:7/769: symlink d14/d16/ld5 0 2024-08-31T05:21:39.241 INFO:tasks.workunit.client.0.smithi067.stdout:7/770: dwrite d14/d16/f6b [0,4194304] 0 2024-08-31T05:21:39.246 INFO:tasks.workunit.client.0.smithi067.stdout:7/771: symlink d14/d16/ld6 0 2024-08-31T05:21:39.252 INFO:tasks.workunit.client.0.smithi067.stdout:7/772: dwrite d14/d16/d28/fa0 [4194304,4194304] 0 2024-08-31T05:21:39.254 INFO:tasks.workunit.client.0.smithi067.stdout:7/773: creat d14/d4a/fd7 x:0 0 0 2024-08-31T05:21:39.256 INFO:tasks.workunit.client.0.smithi067.stdout:7/774: mkdir d14/d4a/d85/da4/dbf/dd8 0 2024-08-31T05:21:39.257 INFO:tasks.workunit.client.0.smithi067.stdout:7/775: chown d14/d4a/fd7 2197 1 2024-08-31T05:21:39.258 INFO:tasks.workunit.client.0.smithi067.stdout:7/776: chown d14/d16/d28/d2e/f7f 18215 1 2024-08-31T05:21:39.261 INFO:tasks.workunit.client.0.smithi067.stdout:7/777: mkdir d14/d4a/dd9 0 2024-08-31T05:21:39.268 INFO:tasks.workunit.client.0.smithi067.stdout:7/778: dwrite d14/d16/d28/f35 [0,4194304] 0 2024-08-31T05:21:39.272 INFO:tasks.workunit.client.0.smithi067.stdout:7/779: unlink d14/d54/f62 0 2024-08-31T05:21:39.275 INFO:tasks.workunit.client.0.smithi067.stdout:7/780: dread d14/d54/d5e/d67/fc2 [0,4194304] 0 2024-08-31T05:21:39.277 INFO:tasks.workunit.client.0.smithi067.stdout:7/781: mknod d14/d16/d5b/d68/d6e/cda 0 2024-08-31T05:21:39.280 INFO:tasks.workunit.client.0.smithi067.stdout:7/782: rename d14/d54/d5e/d67/fa5 to d14/d16/d5b/d94/d8d/fdb 0 2024-08-31T05:21:39.283 INFO:tasks.workunit.client.0.smithi067.stdout:7/783: symlink d14/d4a/d85/ldc 0 2024-08-31T05:21:39.289 INFO:tasks.workunit.client.0.smithi067.stdout:7/784: link d14/d16/d5b/c7a d14/d16/d28/d2e/cdd 0 2024-08-31T05:21:39.301 INFO:tasks.workunit.client.0.smithi067.stdout:7/785: dread d14/d16/f60 [0,4194304] 0 2024-08-31T05:21:39.304 INFO:tasks.workunit.client.0.smithi067.stdout:7/786: creat d14/d54/d5e/d8f/fde x:0 0 0 2024-08-31T05:21:39.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:38 smithi067 ceph-mon[17432]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:39.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:38 smithi067 ceph-mon[17432]: pgmap v40: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 39 MiB/s rd, 96 MiB/s wr, 275 op/s 2024-08-31T05:21:39.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:38 smithi073 ceph-mon[24726]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:39.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:38 smithi073 ceph-mon[24726]: pgmap v40: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 39 MiB/s rd, 96 MiB/s wr, 275 op/s 2024-08-31T05:21:39.889 INFO:tasks.workunit.client.0.smithi067.stdout:2/873: sync 2024-08-31T05:21:39.892 INFO:tasks.workunit.client.0.smithi067.stdout:2/874: fsync db/d8c/fe9 0 2024-08-31T05:21:39.901 INFO:tasks.workunit.client.0.smithi067.stdout:2/875: write db/d8c/dcd/df4/d62/f79 [1985332,127861] 0 2024-08-31T05:21:39.903 INFO:tasks.workunit.client.0.smithi067.stdout:2/876: readlink db/d8c/dcd/dac/l10c 0 2024-08-31T05:21:39.909 INFO:tasks.workunit.client.0.smithi067.stdout:2/877: rename db/dd/d13/f14 to db/f11a 0 2024-08-31T05:21:39.914 INFO:tasks.workunit.client.0.smithi067.stdout:2/878: dwrite db/d12/d1a/d2b/d3d/d69/dec/f100 [4194304,4194304] 0 2024-08-31T05:21:39.931 INFO:tasks.workunit.client.0.smithi067.stdout:2/879: dwrite db/d12/d1a/d2b/d87/fe6 [0,4194304] 0 2024-08-31T05:21:39.935 INFO:tasks.workunit.client.0.smithi067.stdout:2/880: symlink db/d12/d1a/d2b/d3d/d4f/d6d/l11b 0 2024-08-31T05:21:39.939 INFO:tasks.workunit.client.0.smithi067.stdout:2/881: mknod db/dd/d13/c11c 0 2024-08-31T05:21:39.941 INFO:tasks.workunit.client.0.smithi067.stdout:2/882: mknod db/d12/d1a/d2b/d3d/d69/dec/c11d 0 2024-08-31T05:21:39.942 INFO:tasks.workunit.client.0.smithi067.stdout:2/883: chown db/d12/d1a/f36 1697 1 2024-08-31T05:21:39.959 INFO:tasks.workunit.client.0.smithi067.stdout:2/884: dwrite db/dd/d2d/f5d [0,4194304] 0 2024-08-31T05:21:39.964 INFO:tasks.workunit.client.0.smithi067.stdout:2/885: truncate db/dd/faf 355261 0 2024-08-31T05:21:39.973 INFO:tasks.workunit.client.0.smithi067.stdout:2/886: write db/d12/d1a/d1e/f6b [2611839,97443] 0 2024-08-31T05:21:39.978 INFO:tasks.workunit.client.0.smithi067.stdout:2/887: rename db/d12/d1a/d2b/d3d/d69/d3b/f78 to db/d8c/dcd/df4/da0/dc4/f11e 0 2024-08-31T05:21:39.979 INFO:tasks.workunit.client.0.smithi067.stdout:1/819: sync 2024-08-31T05:21:39.979 INFO:tasks.workunit.client.0.smithi067.stdout:4/966: sync 2024-08-31T05:21:39.980 INFO:tasks.workunit.client.0.smithi067.stdout:2/888: mknod db/d8c/dcd/df4/da0/dc4/c11f 0 2024-08-31T05:21:39.980 INFO:tasks.workunit.client.0.smithi067.stdout:4/967: fdatasync d4/d32/d4c/fe9 0 2024-08-31T05:21:39.983 INFO:tasks.workunit.client.0.smithi067.stdout:1/820: write d3/d8b/df4/f102 [4941983,51148] 0 2024-08-31T05:21:39.984 INFO:tasks.workunit.client.0.smithi067.stdout:1/821: readlink d3/d23/d2d/d2e/d34/d66/d72/ld1 0 2024-08-31T05:21:39.991 INFO:tasks.workunit.client.0.smithi067.stdout:1/822: dwrite d3/d23/d79/fa5 [0,4194304] 0 2024-08-31T05:21:40.000 INFO:tasks.workunit.client.0.smithi067.stdout:1/823: truncate d3/d23/d2d/d2e/d34/d66/d94/d9d/fae 24452 0 2024-08-31T05:21:40.000 INFO:tasks.workunit.client.0.smithi067.stdout:2/889: getdents db/d12/d1a/da3/ddc 0 2024-08-31T05:21:40.004 INFO:tasks.workunit.client.0.smithi067.stdout:4/968: dwrite d4/d1e/f26 [0,4194304] 0 2024-08-31T05:21:40.005 INFO:tasks.workunit.client.0.smithi067.stdout:2/890: creat db/d12/d1a/d2b/d3d/d69/dec/f120 x:0 0 0 2024-08-31T05:21:40.006 INFO:tasks.workunit.client.0.smithi067.stdout:2/891: readlink db/d12/d1a/da3/ddc/lf7 0 2024-08-31T05:21:40.009 INFO:tasks.workunit.client.0.smithi067.stdout:4/969: creat d4/f152 x:0 0 0 2024-08-31T05:21:40.017 INFO:tasks.workunit.client.0.smithi067.stdout:2/892: creat db/d12/d1a/d2b/d3d/d69/d3b/d82/de7/f121 x:0 0 0 2024-08-31T05:21:40.017 INFO:tasks.workunit.client.0.smithi067.stdout:4/970: creat d4/d32/d4c/f153 x:0 0 0 2024-08-31T05:21:40.017 INFO:tasks.workunit.client.0.smithi067.stdout:1/824: dwrite d3/d23/d2d/d2e/d34/d66/de8/f12 [0,4194304] 0 2024-08-31T05:21:40.023 INFO:tasks.workunit.client.0.smithi067.stdout:2/893: rmdir db/d12/d1a/d2b/d3d/d4f/d6d/dfc 0 2024-08-31T05:21:40.023 INFO:tasks.workunit.client.0.smithi067.stdout:4/971: dread d4/d32/d4c/db3/ffb [0,4194304] 0 2024-08-31T05:21:40.030 INFO:tasks.workunit.client.0.smithi067.stdout:4/972: creat d4/d42/f154 x:0 0 0 2024-08-31T05:21:40.030 INFO:tasks.workunit.client.0.smithi067.stdout:2/894: truncate db/f11a 1329392 0 2024-08-31T05:21:40.031 INFO:tasks.workunit.client.0.smithi067.stdout:4/973: read d4/d14/d48/f5f [415305,53802] 0 2024-08-31T05:21:40.038 INFO:tasks.workunit.client.0.smithi067.stdout:1/825: dwrite d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/fcd [0,4194304] 0 2024-08-31T05:21:40.053 INFO:tasks.workunit.client.0.smithi067.stdout:9/832: sync 2024-08-31T05:21:40.053 INFO:tasks.workunit.client.0.smithi067.stdout:6/929: sync 2024-08-31T05:21:40.054 INFO:tasks.workunit.client.0.smithi067.stdout:5/715: sync 2024-08-31T05:21:40.054 INFO:tasks.workunit.client.0.smithi067.stdout:7/787: sync 2024-08-31T05:21:40.091 INFO:tasks.workunit.client.0.smithi067.stdout:2/895: rmdir db/dd/d13/d9f 39 2024-08-31T05:21:40.092 INFO:tasks.workunit.client.0.smithi067.stdout:2/896: dread - db/d8c/fe9 zero size 2024-08-31T05:21:40.094 INFO:tasks.workunit.client.0.smithi067.stdout:1/826: symlink d3/dfc/l12c 0 2024-08-31T05:21:40.096 INFO:tasks.workunit.client.0.smithi067.stdout:5/716: rename db to db/d15/ddc 22 2024-08-31T05:21:40.100 INFO:tasks.workunit.client.0.smithi067.stdout:1/827: dwrite d3/f5 [4194304,4194304] 0 2024-08-31T05:21:40.101 INFO:tasks.workunit.client.0.smithi067.stdout:2/897: mknod db/d8c/dcd/df4/da0/dc4/c122 0 2024-08-31T05:21:40.105 INFO:tasks.workunit.client.0.smithi067.stdout:5/717: rmdir db/d26/d4c 39 2024-08-31T05:21:40.108 INFO:tasks.workunit.client.0.smithi067.stdout:2/898: chown db/l1b 0 1 2024-08-31T05:21:40.109 INFO:tasks.workunit.client.0.smithi067.stdout:2/899: chown db/d12/d1a/d2b/d40/d9b/da8/cb9 138786 1 2024-08-31T05:21:40.112 INFO:tasks.workunit.client.0.smithi067.stdout:7/788: rename d14/d16/d28/d78/fb2 to d14/d16/fdf 0 2024-08-31T05:21:40.114 INFO:tasks.workunit.client.0.smithi067.stdout:5/718: rename db/d15/d53 to db/d15/d59/dad/dcf/ddd 0 2024-08-31T05:21:40.114 INFO:tasks.workunit.client.0.smithi067.stdout:7/789: rmdir d14/d16/d5b/d94 39 2024-08-31T05:21:40.115 INFO:tasks.workunit.client.0.smithi067.stdout:7/790: write d14/d4a/fd7 [698629,22476] 0 2024-08-31T05:21:40.123 INFO:tasks.workunit.client.0.smithi067.stdout:7/791: link d14/d16/d5b/d68/d6e/f9a d14/d16/d5b/d8c/dc7/dcf/fe0 0 2024-08-31T05:21:40.124 INFO:tasks.workunit.client.0.smithi067.stdout:7/792: truncate d14/d16/f5d 59076 0 2024-08-31T05:21:40.125 INFO:tasks.workunit.client.0.smithi067.stdout:7/793: rmdir d14/d54/d5e/d67 39 2024-08-31T05:21:40.127 INFO:tasks.workunit.client.0.smithi067.stdout:2/900: dread db/d12/d1a/d2b/d3d/d69/d3b/f105 [0,4194304] 0 2024-08-31T05:21:40.128 INFO:tasks.workunit.client.0.smithi067.stdout:7/794: symlink d14/d3e/le1 0 2024-08-31T05:21:40.130 INFO:tasks.workunit.client.0.smithi067.stdout:7/795: rmdir d14/d16/d5b/d68/d6e/dc0 39 2024-08-31T05:21:40.133 INFO:tasks.workunit.client.0.smithi067.stdout:2/901: mknod db/dd/c123 0 2024-08-31T05:21:40.141 INFO:tasks.workunit.client.0.smithi067.stdout:2/902: creat db/d12/d1a/d1e/f124 x:0 0 0 2024-08-31T05:21:40.142 INFO:tasks.workunit.client.0.smithi067.stdout:7/796: dread d14/d16/d28/f9f [0,4194304] 0 2024-08-31T05:21:40.145 INFO:tasks.workunit.client.0.smithi067.stdout:2/903: creat db/d12/d1a/d2b/d3d/d69/dec/f125 x:0 0 0 2024-08-31T05:21:40.147 INFO:tasks.workunit.client.0.smithi067.stdout:6/930: write d1b/f43 [2969274,130065] 0 2024-08-31T05:21:40.151 INFO:tasks.workunit.client.0.smithi067.stdout:4/974: truncate d4/d9/db4/d83/da9/f100 76686 0 2024-08-31T05:21:40.155 INFO:tasks.workunit.client.0.smithi067.stdout:1/828: write d3/d23/f3c [1053223,115777] 0 2024-08-31T05:21:40.156 INFO:tasks.workunit.client.0.smithi067.stdout:6/931: fdatasync d1b/d40/f98 0 2024-08-31T05:21:40.157 INFO:tasks.workunit.client.0.smithi067.stdout:1/829: write d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/f113 [456031,114865] 0 2024-08-31T05:21:40.160 INFO:tasks.workunit.client.0.smithi067.stdout:4/975: rmdir d4/d1e/d92/db0 39 2024-08-31T05:21:40.164 INFO:tasks.workunit.client.0.smithi067.stdout:1/830: mkdir d3/d23/d2d/d2e/d12d 0 2024-08-31T05:21:40.166 INFO:tasks.workunit.client.0.smithi067.stdout:4/976: creat d4/d1f/db9/f155 x:0 0 0 2024-08-31T05:21:40.167 INFO:tasks.workunit.client.0.smithi067.stdout:1/831: chown d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/cd0 43027 1 2024-08-31T05:21:40.170 INFO:tasks.workunit.client.0.smithi067.stdout:1/832: read d3/d36/f53 [833462,972] 0 2024-08-31T05:21:40.171 INFO:tasks.workunit.client.0.smithi067.stdout:1/833: fsync d3/d23/d2d/d2e/d34/d66/d72/f77 0 2024-08-31T05:21:40.177 INFO:tasks.workunit.client.0.smithi067.stdout:7/797: truncate d14/d16/d28/d2e/f37 706580 0 2024-08-31T05:21:40.179 INFO:tasks.workunit.client.0.smithi067.stdout:7/798: chown d14/d16/f4e 2093951416 1 2024-08-31T05:21:40.180 INFO:tasks.workunit.client.0.smithi067.stdout:2/904: dwrite db/d12/d1a/d1e/d4d/ff5 [0,4194304] 0 2024-08-31T05:21:40.182 INFO:tasks.workunit.client.0.smithi067.stdout:6/932: dread d1b/fbc [0,4194304] 0 2024-08-31T05:21:40.183 INFO:tasks.workunit.client.0.smithi067.stdout:7/799: chown d14/d4a/d85/da4/dbf/cd4 23876 1 2024-08-31T05:21:40.189 INFO:tasks.workunit.client.0.smithi067.stdout:1/834: write d3/d23/d5d/f6f [4868060,99729] 0 2024-08-31T05:21:40.190 INFO:tasks.workunit.client.0.smithi067.stdout:7/800: creat d14/d54/d5e/d8f/fe2 x:0 0 0 2024-08-31T05:21:40.192 INFO:tasks.workunit.client.0.smithi067.stdout:4/977: dwrite d4/d1e/d92/f128 [0,4194304] 0 2024-08-31T05:21:40.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:39 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:21:40.196 INFO:tasks.workunit.client.0.smithi067.stdout:6/933: unlink d1b/d40/d70/dd0/d5e/l11f 0 2024-08-31T05:21:40.197 INFO:tasks.workunit.client.0.smithi067.stdout:6/934: read d1b/d40/d70/dd0/d8d/dc6/ff0 [798190,68552] 0 2024-08-31T05:21:40.197 INFO:tasks.workunit.client.0.smithi067.stdout:6/935: chown d1b/d30/f73 9189792 1 2024-08-31T05:21:40.198 INFO:tasks.workunit.client.0.smithi067.stdout:2/905: rename db/d12/d1a/d2b/d3d/d69/d3b/l97 to db/dd/l126 0 2024-08-31T05:21:40.200 INFO:tasks.workunit.client.0.smithi067.stdout:7/801: unlink d14/d16/fc8 0 2024-08-31T05:21:40.201 INFO:tasks.workunit.client.0.smithi067.stdout:7/802: readlink d14/d16/d5b/d68/l77 0 2024-08-31T05:21:40.203 INFO:tasks.workunit.client.0.smithi067.stdout:1/835: mkdir d3/d23/d2d/d2e/d34/d66/de8/d50/db5/dc2/d12e 0 2024-08-31T05:21:40.204 INFO:tasks.workunit.client.0.smithi067.stdout:4/978: mkdir d4/d14/d48/d66/de7/d156 0 2024-08-31T05:21:40.207 INFO:tasks.workunit.client.0.smithi067.stdout:2/906: truncate db/d8c/dcd/dac/fbe 163295 0 2024-08-31T05:21:40.209 INFO:tasks.workunit.client.0.smithi067.stdout:6/936: dread d1b/d40/d96/f10d [0,4194304] 0 2024-08-31T05:21:40.210 INFO:tasks.workunit.client.0.smithi067.stdout:6/937: stat d1b/d30/l35 0 2024-08-31T05:21:40.211 INFO:tasks.workunit.client.0.smithi067.stdout:6/938: readlink d1b/d8e/d62/lac 0 2024-08-31T05:21:40.211 INFO:tasks.workunit.client.0.smithi067.stdout:6/939: chown d1b/d23/df1/cfe 3674 1 2024-08-31T05:21:40.212 INFO:tasks.workunit.client.0.smithi067.stdout:6/940: chown d1b/d8e/d62 3764 1 2024-08-31T05:21:40.213 INFO:tasks.workunit.client.0.smithi067.stdout:6/941: chown d1b/d40/d70/d71/f12d 18555 1 2024-08-31T05:21:40.214 INFO:tasks.workunit.client.0.smithi067.stdout:6/942: chown d1b/d40/d70/dd0/da4/l128 25992791 1 2024-08-31T05:21:40.214 INFO:tasks.workunit.client.0.smithi067.stdout:6/943: stat d1b/f43 0 2024-08-31T05:21:40.216 INFO:tasks.workunit.client.0.smithi067.stdout:6/944: write d1b/d40/d70/d71/d114/f11c [33688,57776] 0 2024-08-31T05:21:40.217 INFO:tasks.workunit.client.0.smithi067.stdout:6/945: dread - d1b/d40/f98 zero size 2024-08-31T05:21:40.219 INFO:tasks.workunit.client.0.smithi067.stdout:6/946: chown d1b/d40/d70/dd0/d8d/dc6 3206 1 2024-08-31T05:21:40.219 INFO:tasks.workunit.client.0.smithi067.stdout:2/907: mkdir db/d12/d1a/d2b/d3d/d69/d127 0 2024-08-31T05:21:40.221 INFO:tasks.workunit.client.0.smithi067.stdout:7/803: dread d14/f1a [0,4194304] 0 2024-08-31T05:21:40.222 INFO:tasks.workunit.client.0.smithi067.stdout:7/804: write d14/d4a/fd7 [68860,104725] 0 2024-08-31T05:21:40.224 INFO:tasks.workunit.client.0.smithi067.stdout:7/805: write d14/f18 [3837923,41402] 0 2024-08-31T05:21:40.228 INFO:tasks.workunit.client.0.smithi067.stdout:6/947: unlink d1b/d23/d28/fa3 0 2024-08-31T05:21:40.229 INFO:tasks.workunit.client.0.smithi067.stdout:1/836: dwrite d3/d23/d2d/d2e/d34/d66/de8/f20 [0,4194304] 0 2024-08-31T05:21:40.234 INFO:tasks.workunit.client.0.smithi067.stdout:4/979: dread d4/d42/f57 [0,4194304] 0 2024-08-31T05:21:40.238 INFO:tasks.workunit.client.0.smithi067.stdout:7/806: chown d14/d16/d5b/d94/l71 7 1 2024-08-31T05:21:40.241 INFO:tasks.workunit.client.0.smithi067.stdout:1/837: creat d3/df8/f12f x:0 0 0 2024-08-31T05:21:40.243 INFO:tasks.workunit.client.0.smithi067.stdout:1/838: chown d3/la2 54 1 2024-08-31T05:21:40.245 INFO:tasks.workunit.client.0.smithi067.stdout:7/807: mkdir d14/d54/de3 0 2024-08-31T05:21:40.247 INFO:tasks.workunit.client.0.smithi067.stdout:2/908: dwrite db/d12/d1a/d2b/d40/d9b/fbb [0,4194304] 0 2024-08-31T05:21:40.247 INFO:tasks.workunit.client.0.smithi067.stdout:6/948: link d1b/d40/d96/db3/c105 d1b/d23/d2e/d3b/c132 0 2024-08-31T05:21:40.252 INFO:tasks.workunit.client.0.smithi067.stdout:4/980: dread d4/d9/f7e [0,4194304] 0 2024-08-31T05:21:40.253 INFO:tasks.workunit.client.0.smithi067.stdout:6/949: dread - d1b/d40/d70/dd0/f10b zero size 2024-08-31T05:21:40.254 INFO:tasks.workunit.client.0.smithi067.stdout:4/981: chown d4/d1e/d92/c94 11615019 1 2024-08-31T05:21:40.254 INFO:tasks.workunit.client.0.smithi067.stdout:1/839: dwrite d3/d23/db1/dd4/de4/f127 [0,4194304] 0 2024-08-31T05:21:40.293 INFO:tasks.workunit.client.0.smithi067.stdout:4/982: write d4/d1e/f137 [286530,126268] 0 2024-08-31T05:21:40.294 INFO:tasks.workunit.client.0.smithi067.stdout:1/840: chown d3/d23/d2d/d2e/d34 2512 1 2024-08-31T05:21:40.294 INFO:tasks.workunit.client.0.smithi067.stdout:2/909: fdatasync db/dd/d13/f88 0 2024-08-31T05:21:40.294 INFO:tasks.workunit.client.0.smithi067.stdout:6/950: mknod d1b/d40/d70/dd0/d5e/d7b/c133 0 2024-08-31T05:21:40.297 INFO:tasks.workunit.client.0.smithi067.stdout:7/808: write d14/f20 [4344643,82248] 0 2024-08-31T05:21:40.298 INFO:tasks.workunit.client.0.smithi067.stdout:1/841: creat d3/d23/d79/f130 x:0 0 0 2024-08-31T05:21:40.299 INFO:tasks.workunit.client.0.smithi067.stdout:7/809: dread - d14/d54/d5e/d8f/fc9 zero size 2024-08-31T05:21:40.299 INFO:tasks.workunit.client.0.smithi067.stdout:1/842: stat d3/d23/d79/fd5 0 2024-08-31T05:21:40.300 INFO:tasks.workunit.client.0.smithi067.stdout:2/910: mkdir db/d12/d1a/d2b/d3d/d69/d128 0 2024-08-31T05:21:40.301 INFO:tasks.workunit.client.0.smithi067.stdout:6/951: rmdir d1b/d40/d70/dd0/d5e/d7b 39 2024-08-31T05:21:40.304 INFO:tasks.workunit.client.0.smithi067.stdout:2/911: rmdir db/d12/d1a/d2b/d40 39 2024-08-31T05:21:40.305 INFO:tasks.workunit.client.0.smithi067.stdout:1/843: creat d3/d23/d2d/d2e/d34/d66/d9a/f131 x:0 0 0 2024-08-31T05:21:40.310 INFO:tasks.workunit.client.0.smithi067.stdout:7/810: write d14/d16/d28/d2e/f7f [29350,70148] 0 2024-08-31T05:21:40.311 INFO:tasks.workunit.client.0.smithi067.stdout:2/912: dwrite db/d8c/dcd/df4/d62/f80 [0,4194304] 0 2024-08-31T05:21:40.312 INFO:tasks.workunit.client.0.smithi067.stdout:4/983: dread d4/d32/d43/fdb [0,4194304] 0 2024-08-31T05:21:40.312 INFO:tasks.workunit.client.0.smithi067.stdout:1/844: creat d3/df8/f132 x:0 0 0 2024-08-31T05:21:40.313 INFO:tasks.workunit.client.0.smithi067.stdout:7/811: truncate d14/d3e/fd1 66086 0 2024-08-31T05:21:40.316 INFO:tasks.workunit.client.0.smithi067.stdout:2/913: chown db/d12/d1a/d2b/d3d/d69/d3b/d82/de7/c115 64701 1 2024-08-31T05:21:40.316 INFO:tasks.workunit.client.0.smithi067.stdout:6/952: rename d1b/d40/d96/db3/fb5 to d1b/d7a/f134 0 2024-08-31T05:21:40.317 INFO:tasks.workunit.client.0.smithi067.stdout:2/914: fsync db/d12/d1a/d2b/d3d/d4f/d6d/def/f102 0 2024-08-31T05:21:40.321 INFO:tasks.workunit.client.0.smithi067.stdout:7/812: symlink d14/d16/d5b/d8c/le4 0 2024-08-31T05:21:40.323 INFO:tasks.workunit.client.0.smithi067.stdout:1/845: unlink d3/d23/d2d/d2e/d34/l5c 0 2024-08-31T05:21:40.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:39 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:21:40.329 INFO:tasks.workunit.client.0.smithi067.stdout:7/813: chown d14/d16/d5b/c7a 1 1 2024-08-31T05:21:40.332 INFO:tasks.workunit.client.0.smithi067.stdout:2/915: rename db/dd/cc6 to db/d12/d1a/d2b/d87/c129 0 2024-08-31T05:21:40.334 INFO:tasks.workunit.client.0.smithi067.stdout:6/953: dwrite d1b/d40/d70/dd0/d5e/de6/fc5 [0,4194304] 0 2024-08-31T05:21:40.343 INFO:tasks.workunit.client.0.smithi067.stdout:6/954: fsync d1b/d40/d70/dd0/f5b 0 2024-08-31T05:21:40.344 INFO:tasks.workunit.client.0.smithi067.stdout:4/984: dwrite d4/d9/db4/d83/da9/f100 [0,4194304] 0 2024-08-31T05:21:40.345 INFO:tasks.workunit.client.0.smithi067.stdout:7/814: rename d14/d16/d5b/d68/d6e/dc0/fc4 to d14/d16/d5b/d94/fe5 0 2024-08-31T05:21:40.346 INFO:tasks.workunit.client.0.smithi067.stdout:1/846: link d3/d23/d2d/d2e/d34/d66/d9a/c9e d3/d23/d2d/d2e/df9/c133 0 2024-08-31T05:21:40.347 INFO:tasks.workunit.client.0.smithi067.stdout:2/916: mkdir db/d12a 0 2024-08-31T05:21:40.350 INFO:tasks.workunit.client.0.smithi067.stdout:6/955: chown d1b/d40/d70/d71/d78/c9b 26 1 2024-08-31T05:21:40.352 INFO:tasks.workunit.client.0.smithi067.stdout:4/985: creat d4/d9/db4/d83/da9/d60/f157 x:0 0 0 2024-08-31T05:21:40.355 INFO:tasks.workunit.client.0.smithi067.stdout:2/917: truncate db/d12/d1a/d1e/f21 2348411 0 2024-08-31T05:21:40.358 INFO:tasks.workunit.client.0.smithi067.stdout:7/815: dread d14/d16/d5b/d64/f8b [0,4194304] 0 2024-08-31T05:21:40.366 INFO:tasks.workunit.client.0.smithi067.stdout:1/847: write d3/f27 [306829,130877] 0 2024-08-31T05:21:40.369 INFO:tasks.workunit.client.0.smithi067.stdout:2/918: write db/d12/d1a/d2b/d87/dbd/fda [524998,119712] 0 2024-08-31T05:21:40.370 INFO:tasks.workunit.client.0.smithi067.stdout:7/816: truncate d14/d4a/f76 534956 0 2024-08-31T05:21:40.370 INFO:tasks.workunit.client.0.smithi067.stdout:6/956: truncate f19 846602 0 2024-08-31T05:21:40.377 INFO:tasks.workunit.client.0.smithi067.stdout:6/957: rename d1b/d40/d70/dd0/d5c/d125 to d1b/d23/d61/d135 0 2024-08-31T05:21:40.378 INFO:tasks.workunit.client.0.smithi067.stdout:4/986: dwrite d4/d1e/f41 [0,4194304] 0 2024-08-31T05:21:40.383 INFO:tasks.workunit.client.0.smithi067.stdout:7/817: unlink d14/d16/d28/d2e/f37 0 2024-08-31T05:21:40.387 INFO:tasks.workunit.client.0.smithi067.stdout:2/919: dwrite db/d12/d1a/d2b/d3d/d4f/d6d/f7f [0,4194304] 0 2024-08-31T05:21:40.388 INFO:tasks.workunit.client.0.smithi067.stdout:6/958: unlink d1b/d23/d2e/l57 0 2024-08-31T05:21:40.391 INFO:tasks.workunit.client.0.smithi067.stdout:4/987: rename d4/d9/db4/d83/da9/fb6 to d4/d32/dc7/f158 0 2024-08-31T05:21:40.395 INFO:tasks.workunit.client.0.smithi067.stdout:7/818: fdatasync d14/d16/f22 0 2024-08-31T05:21:40.396 INFO:tasks.workunit.client.0.smithi067.stdout:7/819: write d14/d54/d5e/d8f/faa [810685,40037] 0 2024-08-31T05:21:40.399 INFO:tasks.workunit.client.0.smithi067.stdout:1/848: getdents d3/d23/d2d/d2e/d34/d66/d9a 0 2024-08-31T05:21:40.401 INFO:tasks.workunit.client.0.smithi067.stdout:1/849: dread d3/dfc/ff7 [0,4194304] 0 2024-08-31T05:21:40.403 INFO:tasks.workunit.client.0.smithi067.stdout:2/920: mkdir db/d12/d1a/da3/d12b 0 2024-08-31T05:21:40.405 INFO:tasks.workunit.client.0.smithi067.stdout:4/988: truncate d4/d9/db4/d83/da9/f12a 257701 0 2024-08-31T05:21:40.406 INFO:tasks.workunit.client.0.smithi067.stdout:4/989: chown d4/d1e/dea/lfd 22585997 1 2024-08-31T05:21:40.410 INFO:tasks.workunit.client.0.smithi067.stdout:4/990: fsync d4/d1e/f3f 0 2024-08-31T05:21:40.411 INFO:tasks.workunit.client.0.smithi067.stdout:4/991: readlink d4/d1e/d53/l67 0 2024-08-31T05:21:40.412 INFO:tasks.workunit.client.0.smithi067.stdout:4/992: fdatasync d4/d32/d4c/db3/f12e 0 2024-08-31T05:21:40.412 INFO:tasks.workunit.client.0.smithi067.stdout:7/820: symlink d14/d54/de3/le6 0 2024-08-31T05:21:40.413 INFO:tasks.workunit.client.0.smithi067.stdout:4/993: chown d4/d1f/d34/f3c 949 1 2024-08-31T05:21:40.414 INFO:tasks.workunit.client.0.smithi067.stdout:4/994: dread - d4/d9/db4/d83/da9/d60/f157 zero size 2024-08-31T05:21:40.416 INFO:tasks.workunit.client.0.smithi067.stdout:1/850: chown d3/d23/d2d/d2e/d34/da3/ddf/cfa 2729439 1 2024-08-31T05:21:40.422 INFO:tasks.workunit.client.0.smithi067.stdout:7/821: dread d14/d54/d5e/d67/fc2 [0,4194304] 0 2024-08-31T05:21:40.423 INFO:tasks.workunit.client.0.smithi067.stdout:2/921: rename db/l1b to db/d12/l12c 0 2024-08-31T05:21:40.425 INFO:tasks.workunit.client.0.smithi067.stdout:6/959: link d1b/d40/d96/db3/cd4 d1b/d40/d70/d71/c136 0 2024-08-31T05:21:40.426 INFO:tasks.workunit.client.0.smithi067.stdout:6/960: chown d1b/d23/d61/c88 5853636 1 2024-08-31T05:21:40.426 INFO:tasks.workunit.client.0.smithi067.stdout:4/995: rename d4/d32/d43/ff1 to d4/da5/f159 0 2024-08-31T05:21:40.427 INFO:tasks.workunit.client.0.smithi067.stdout:4/996: write d4/f150 [442164,33609] 0 2024-08-31T05:21:40.430 INFO:tasks.workunit.client.0.smithi067.stdout:6/961: read - d1b/d7a/fd7 zero size 2024-08-31T05:21:40.434 INFO:tasks.workunit.client.0.smithi067.stdout:7/822: rename d14/d16/d28/f29 to d14/d16/d5b/d8c/fe7 0 2024-08-31T05:21:40.436 INFO:tasks.workunit.client.0.smithi067.stdout:1/851: link d3/d23/l25 d3/d23/d2d/d2e/d34/d66/d72/d82/l134 0 2024-08-31T05:21:40.439 INFO:tasks.workunit.client.0.smithi067.stdout:6/962: read d1b/d23/f69 [620860,31477] 0 2024-08-31T05:21:40.440 INFO:tasks.workunit.client.0.smithi067.stdout:6/963: write d1b/d40/d70/dd0/d5c/f131 [2834929,74669] 0 2024-08-31T05:21:40.441 INFO:tasks.workunit.client.0.smithi067.stdout:7/823: creat d14/d16/d28/d2e/d53/fe8 x:0 0 0 2024-08-31T05:21:40.446 INFO:tasks.workunit.client.0.smithi067.stdout:2/922: link db/d12/d1a/d1e/d4d/le0 db/d8c/dcd/df4/da0/dc4/dc3/l12d 0 2024-08-31T05:21:40.452 INFO:tasks.workunit.client.0.smithi067.stdout:6/964: rename d1b/d23/d2e to d1b/d23/d120/d137 0 2024-08-31T05:21:40.452 INFO:tasks.workunit.client.0.smithi067.stdout:4/997: dwrite d4/d32/d4c/db3/fce [0,4194304] 0 2024-08-31T05:21:40.453 INFO:tasks.workunit.client.0.smithi067.stdout:7/824: mkdir d14/d16/d5b/d68/d87/de9 0 2024-08-31T05:21:40.456 INFO:tasks.workunit.client.0.smithi067.stdout:1/852: dwrite d3/d23/d2d/d2e/d34/d66/d94/fb9 [0,4194304] 0 2024-08-31T05:21:40.467 INFO:tasks.workunit.client.0.smithi067.stdout:1/853: dread d3/f14 [4194304,4194304] 0 2024-08-31T05:21:40.467 INFO:tasks.workunit.client.0.smithi067.stdout:9/833: sync 2024-08-31T05:21:40.467 INFO:tasks.workunit.client.0.smithi067.stdout:7/825: rename d14/d4a/fd7 to d14/d54/d5e/d8f/fea 0 2024-08-31T05:21:40.469 INFO:tasks.workunit.client.0.smithi067.stdout:4/998: write d4/d1e/d53/f6c [1432377,31547] 0 2024-08-31T05:21:40.471 INFO:tasks.workunit.client.0.smithi067.stdout:6/965: mkdir d1b/d40/d96/d138 0 2024-08-31T05:21:40.482 INFO:tasks.workunit.client.0.smithi067.stdout:9/834: mknod dd/df/d25/d59/c114 0 2024-08-31T05:21:40.483 INFO:tasks.workunit.client.0.smithi067.stdout:2/923: rename db/d12/d1a/d2b/d3d/d69/d128 to db/d12/d1a/d2b/d40/d12e 0 2024-08-31T05:21:40.485 INFO:tasks.workunit.client.0.smithi067.stdout:7/826: mkdir d14/d16/d5b/d68/d87/deb 0 2024-08-31T05:21:40.492 INFO:tasks.workunit.client.0.smithi067.stdout:6/966: rename d1b/d23/d61/f97 to d1b/d40/d96/db6/f139 0 2024-08-31T05:21:40.494 INFO:tasks.workunit.client.0.smithi067.stdout:2/924: unlink db/d12/f6e 0 2024-08-31T05:21:40.495 INFO:tasks.workunit.client.0.smithi067.stdout:7/827: creat d14/d54/d5e/d8f/fec x:0 0 0 2024-08-31T05:21:40.496 INFO:tasks.workunit.client.0.smithi067.stdout:1/854: link d3/d36/f53 d3/d23/d79/d93/f135 0 2024-08-31T05:21:40.497 INFO:tasks.workunit.client.0.smithi067.stdout:1/855: chown d3/d23/d5d/f6f 71 1 2024-08-31T05:21:40.502 INFO:tasks.workunit.client.0.smithi067.stdout:2/925: symlink db/d12/d1a/d2b/d3d/d69/dec/l12f 0 2024-08-31T05:21:40.503 INFO:tasks.workunit.client.0.smithi067.stdout:7/828: creat d14/d16/d28/d2e/d53/fed x:0 0 0 2024-08-31T05:21:40.504 INFO:tasks.workunit.client.0.smithi067.stdout:2/926: write db/d12/d1a/d2b/d3d/d69/dec/f100 [66832,84102] 0 2024-08-31T05:21:40.504 INFO:tasks.workunit.client.0.smithi067.stdout:1/856: chown d3/d23/d2d/d2e/l49 28186 1 2024-08-31T05:21:40.505 INFO:tasks.workunit.client.0.smithi067.stdout:7/829: write d14/d3e/fd1 [541549,50322] 0 2024-08-31T05:21:40.512 INFO:tasks.workunit.client.0.smithi067.stdout:4/999: dwrite d4/d9/f7e [0,4194304] 0 2024-08-31T05:21:40.512 INFO:tasks.workunit.client.0.smithi067.stdout:2/927: read db/d12/d1a/d2b/d3d/d4f/d6d/fd9 [2320990,47019] 0 2024-08-31T05:21:40.514 INFO:tasks.workunit.client.0.smithi067.stdout:9/835: dwrite dd/df/d25/d3b/d50/fe9 [0,4194304] 0 2024-08-31T05:21:40.514 INFO:tasks.workunit.client.0.smithi067.stdout:1/857: creat d3/d23/db1/dd4/de4/f136 x:0 0 0 2024-08-31T05:21:40.520 INFO:tasks.workunit.client.0.smithi067.stdout:7/830: mkdir d14/d54/dee 0 2024-08-31T05:21:40.520 INFO:tasks.workunit.client.0.smithi067.stdout:1/858: chown d3/d23/d79/fa6 2 1 2024-08-31T05:21:40.524 INFO:tasks.workunit.client.0.smithi067.stdout:6/967: dwrite d1b/d40/d70/dd0/f10b [0,4194304] 0 2024-08-31T05:21:40.524 INFO:tasks.workunit.client.0.smithi067.stdout:2/928: dread db/d8c/dcd/dac/fbe [0,4194304] 0 2024-08-31T05:21:40.531 INFO:tasks.workunit.client.0.smithi067.stdout:1/859: creat d3/d23/d2d/f137 x:0 0 0 2024-08-31T05:21:40.534 INFO:tasks.workunit.client.0.smithi067.stdout:9/836: dwrite dd/df/d3c/dbe/dd4/de0/f10f [0,4194304] 0 2024-08-31T05:21:40.534 INFO:tasks.workunit.client.0.smithi067.stdout:6/968: read d1b/d23/d28/db9/fbf [971812,25207] 0 2024-08-31T05:21:40.535 INFO:tasks.workunit.client.0.smithi067.stdout:1/860: dread - d3/d23/d79/f130 zero size 2024-08-31T05:21:40.535 INFO:tasks.workunit.client.0.smithi067.stdout:2/929: rename db/dd/f33 to db/d12/d1a/d2b/d3d/d4f/de1/f130 0 2024-08-31T05:21:40.538 INFO:tasks.workunit.client.0.smithi067.stdout:7/831: dwrite d14/f18 [0,4194304] 0 2024-08-31T05:21:40.539 INFO:tasks.workunit.client.0.smithi067.stdout:2/930: chown db/d12/d1a/d2b/d40 6194 1 2024-08-31T05:21:40.543 INFO:tasks.workunit.client.0.smithi067.stdout:9/837: creat dd/df/d25/d3b/d50/dfd/f115 x:0 0 0 2024-08-31T05:21:40.549 INFO:tasks.workunit.client.0.smithi067.stdout:7/832: mkdir d14/d4a/def 0 2024-08-31T05:21:40.552 INFO:tasks.workunit.client.0.smithi067.stdout:2/931: mknod db/d12/d1a/d2b/d3d/d4f/de1/c131 0 2024-08-31T05:21:40.552 INFO:tasks.workunit.client.0.smithi067.stdout:9/838: mknod dd/df/d3c/dbe/c116 0 2024-08-31T05:21:40.554 INFO:tasks.workunit.client.0.smithi067.stdout:7/833: rename d14/d54/d5e/d67/dcc to d14/d16/d5b/d64/d90/df0 0 2024-08-31T05:21:40.555 INFO:tasks.workunit.client.0.smithi067.stdout:9/839: mknod dd/d63/da3/c117 0 2024-08-31T05:21:40.556 INFO:tasks.workunit.client.0.smithi067.stdout:1/861: rmdir d3/d23/db1/db6/d12a 0 2024-08-31T05:21:40.557 INFO:tasks.workunit.client.0.smithi067.stdout:9/840: write dd/df/d25/f109 [805600,85301] 0 2024-08-31T05:21:40.557 INFO:tasks.workunit.client.0.smithi067.stdout:1/862: stat d3/d23/d2d/d2e/d34/da3 0 2024-08-31T05:21:40.561 INFO:tasks.workunit.client.0.smithi067.stdout:9/841: rmdir dd/df/d3c 39 2024-08-31T05:21:40.597 INFO:tasks.workunit.client.0.smithi067.stdout:9/842: unlink dd/df/l71 0 2024-08-31T05:21:40.598 INFO:tasks.workunit.client.0.smithi067.stdout:7/834: write d14/d54/d5e/d67/f6d [386421,90696] 0 2024-08-31T05:21:40.600 INFO:tasks.workunit.client.0.smithi067.stdout:6/969: dread d1b/d40/d70/dd0/d5e/de6/fc7 [0,4194304] 0 2024-08-31T05:21:40.601 INFO:tasks.workunit.client.0.smithi067.stdout:9/843: mknod dd/d63/d72/c118 0 2024-08-31T05:21:40.602 INFO:tasks.workunit.client.0.smithi067.stdout:7/835: dread d14/d16/d28/d2e/f7f [0,4194304] 0 2024-08-31T05:21:40.604 INFO:tasks.workunit.client.0.smithi067.stdout:1/863: dread d3/d23/d2d/d2e/d34/d66/d72/d82/fbb [0,4194304] 0 2024-08-31T05:21:40.604 INFO:tasks.workunit.client.0.smithi067.stdout:7/836: write d14/d54/d5e/d67/f6d [2003601,50439] 0 2024-08-31T05:21:40.605 INFO:tasks.workunit.client.0.smithi067.stdout:6/970: dread d1b/d40/d70/dd0/d8d/f101 [0,4194304] 0 2024-08-31T05:21:40.606 INFO:tasks.workunit.client.0.smithi067.stdout:6/971: chown fd 19909801 1 2024-08-31T05:21:40.608 INFO:tasks.workunit.client.0.smithi067.stdout:5/719: sync 2024-08-31T05:21:40.609 INFO:tasks.workunit.client.0.smithi067.stdout:5/720: chown db/d26/d29/d31/c55 1626 1 2024-08-31T05:21:40.612 INFO:tasks.workunit.client.0.smithi067.stdout:9/844: write dd/df/f69 [844738,31453] 0 2024-08-31T05:21:40.616 INFO:tasks.workunit.client.0.smithi067.stdout:6/972: creat d1b/d40/d70/dd0/d5c/d107/f13a x:0 0 0 2024-08-31T05:21:40.617 INFO:tasks.workunit.client.0.smithi067.stdout:1/864: rename d3/d23/d2d/d2e/d34/d66/de8/d50/cc3 to d3/d23/d2d/d2e/d34/d66/de8/d50/db5/dc2/d12e/c138 0 2024-08-31T05:21:40.619 INFO:tasks.workunit.client.0.smithi067.stdout:1/865: chown d3/f52 452 1 2024-08-31T05:21:40.620 INFO:tasks.workunit.client.0.smithi067.stdout:5/721: creat db/d1d/d4f/fde x:0 0 0 2024-08-31T05:21:40.620 INFO:tasks.workunit.client.0.smithi067.stdout:7/837: dwrite d14/d16/d28/d2e/f7f [0,4194304] 0 2024-08-31T05:21:40.621 INFO:tasks.workunit.client.0.smithi067.stdout:9/845: creat dd/d63/da3/f119 x:0 0 0 2024-08-31T05:21:40.622 INFO:tasks.workunit.client.0.smithi067.stdout:1/866: readlink d3/d23/d2d/d2e/d34/d66/l92 0 2024-08-31T05:21:40.625 INFO:tasks.workunit.client.0.smithi067.stdout:7/838: chown d14/l27 11945 1 2024-08-31T05:21:40.626 INFO:tasks.workunit.client.0.smithi067.stdout:5/722: mknod db/d1d/d4f/cdf 0 2024-08-31T05:21:40.633 INFO:tasks.workunit.client.0.smithi067.stdout:9/846: creat dd/d4d/dca/df0/f11a x:0 0 0 2024-08-31T05:21:40.634 INFO:tasks.workunit.client.0.smithi067.stdout:1/867: fsync d3/d23/d2d/d2e/d34/d66/f67 0 2024-08-31T05:21:40.635 INFO:tasks.workunit.client.0.smithi067.stdout:5/723: dwrite db/d1d/d4f/fde [0,4194304] 0 2024-08-31T05:21:40.637 INFO:tasks.workunit.client.0.smithi067.stdout:7/839: fsync d14/f95 0 2024-08-31T05:21:40.641 INFO:tasks.workunit.client.0.smithi067.stdout:6/973: dread d1b/d30/fa2 [0,4194304] 0 2024-08-31T05:21:40.646 INFO:tasks.workunit.client.0.smithi067.stdout:7/840: creat d14/d3e/ff1 x:0 0 0 2024-08-31T05:21:40.650 INFO:tasks.workunit.client.0.smithi067.stdout:9/847: mkdir dd/d63/d11b 0 2024-08-31T05:21:40.652 INFO:tasks.workunit.client.0.smithi067.stdout:6/974: rename d1b/d23/d61/d135 to d1b/d40/d70/dd0/d8d/dc6/d100/d13b 0 2024-08-31T05:21:40.656 INFO:tasks.workunit.client.0.smithi067.stdout:5/724: link db/d15/d59/dad/dcf/ddd/fd4 db/d26/d29/d31/d54/d66/d96/fe0 0 2024-08-31T05:21:40.657 INFO:tasks.workunit.client.0.smithi067.stdout:5/725: chown f7 215 1 2024-08-31T05:21:40.658 INFO:tasks.workunit.client.0.smithi067.stdout:9/848: symlink dd/d63/da3/l11c 0 2024-08-31T05:21:40.658 INFO:tasks.workunit.client.0.smithi067.stdout:1/868: dwrite d3/d23/d2d/d2e/d34/d66/d9a/fd9 [0,4194304] 0 2024-08-31T05:21:40.659 INFO:tasks.workunit.client.0.smithi067.stdout:7/841: rename d14/d16/d5b/d94/l58 to d14/d16/d5b/d94/d8d/dae/lf2 0 2024-08-31T05:21:40.663 INFO:tasks.workunit.client.0.smithi067.stdout:9/849: unlink dd/d63/da3/l113 0 2024-08-31T05:21:40.668 INFO:tasks.workunit.client.0.smithi067.stdout:1/869: rename d3/d23/db1/lf0 to d3/d23/d2d/d10d/l139 0 2024-08-31T05:21:40.669 INFO:tasks.workunit.client.0.smithi067.stdout:1/870: write d3/d23/d79/f130 [746496,15251] 0 2024-08-31T05:21:40.670 INFO:tasks.workunit.client.0.smithi067.stdout:1/871: readlink d3/d23/d2d/d2e/d34/d66/d72/d82/lad 0 2024-08-31T05:21:40.673 INFO:tasks.workunit.client.0.smithi067.stdout:5/726: symlink db/d26/d60/da7/le1 0 2024-08-31T05:21:40.677 INFO:tasks.workunit.client.0.smithi067.stdout:9/850: rename dd/df/d25/d3b/d50/fd7 to dd/df/d5b/f11d 0 2024-08-31T05:21:40.678 INFO:tasks.workunit.client.0.smithi067.stdout:1/872: creat d3/d8b/f13a x:0 0 0 2024-08-31T05:21:40.680 INFO:tasks.workunit.client.0.smithi067.stdout:1/873: stat d3/d23/d2d/d2e/d34/d66/de8/c4c 0 2024-08-31T05:21:40.683 INFO:tasks.workunit.client.0.smithi067.stdout:9/851: dwrite dd/d63/d72/ff9 [0,4194304] 0 2024-08-31T05:21:40.689 INFO:tasks.workunit.client.0.smithi067.stdout:7/842: dwrite d14/d16/f42 [0,4194304] 0 2024-08-31T05:21:40.690 INFO:tasks.workunit.client.0.smithi067.stdout:7/843: truncate d14/d16/f4e 840647 0 2024-08-31T05:21:40.700 INFO:tasks.workunit.client.0.smithi067.stdout:7/844: creat d14/d16/d5b/d68/d87/ff3 x:0 0 0 2024-08-31T05:21:40.700 INFO:tasks.workunit.client.0.smithi067.stdout:7/845: dread - d14/d54/d5e/d8f/fe2 zero size 2024-08-31T05:21:40.701 INFO:tasks.workunit.client.0.smithi067.stdout:5/727: truncate db/d15/d42/d36/d73/daf/fbb 320380 0 2024-08-31T05:21:40.709 INFO:tasks.workunit.client.0.smithi067.stdout:7/846: dwrite d14/f20 [0,4194304] 0 2024-08-31T05:21:40.716 INFO:tasks.workunit.client.0.smithi067.stdout:7/847: dread d14/d16/d28/d2e/f38 [0,4194304] 0 2024-08-31T05:21:40.716 INFO:tasks.workunit.client.0.smithi067.stdout:5/728: write db/d26/d4c/f65 [354279,63745] 0 2024-08-31T05:21:40.719 INFO:tasks.workunit.client.0.smithi067.stdout:1/874: dread d3/d23/d2d/d2e/d34/f107 [0,4194304] 0 2024-08-31T05:21:40.721 INFO:tasks.workunit.client.0.smithi067.stdout:9/852: dread dd/d4d/dca/ff7 [0,4194304] 0 2024-08-31T05:21:40.721 INFO:tasks.workunit.client.0.smithi067.stdout:5/729: mknod db/d15/d59/dad/dcf/ddd/ce2 0 2024-08-31T05:21:40.723 INFO:tasks.workunit.client.0.smithi067.stdout:7/848: symlink d14/d16/d5b/d64/d90/df0/lf4 0 2024-08-31T05:21:40.723 INFO:tasks.workunit.client.0.smithi067.stdout:7/849: write d14/d3e/f70 [2839676,10517] 0 2024-08-31T05:21:40.726 INFO:tasks.workunit.client.0.smithi067.stdout:1/875: mkdir d3/d23/d2d/d2e/d34/d66/d72/d82/d13b 0 2024-08-31T05:21:40.728 INFO:tasks.workunit.client.0.smithi067.stdout:1/876: write d3/d23/db1/db6/f124 [5414865,66650] 0 2024-08-31T05:21:40.729 INFO:tasks.workunit.client.0.smithi067.stdout:7/850: rename d14/d16/d5b/d94 to d14/d16/d5b/d68/d87/deb/df5 0 2024-08-31T05:21:40.732 INFO:tasks.workunit.client.0.smithi067.stdout:5/730: mknod db/d15/d42/d36/d73/ce3 0 2024-08-31T05:21:40.733 INFO:tasks.workunit.client.0.smithi067.stdout:5/731: fsync db/d26/d29/d31/fce 0 2024-08-31T05:21:40.735 INFO:tasks.workunit.client.0.smithi067.stdout:7/851: write d14/d16/d28/d2e/f38 [2661615,48280] 0 2024-08-31T05:21:40.735 INFO:tasks.workunit.client.0.smithi067.stdout:1/877: truncate d3/d36/f53 4436275 0 2024-08-31T05:21:40.738 INFO:tasks.workunit.client.0.smithi067.stdout:7/852: mkdir d14/d16/d28/d78/df6 0 2024-08-31T05:21:40.741 INFO:tasks.workunit.client.0.smithi067.stdout:5/732: rmdir db/d15/d42/d36/dc7 0 2024-08-31T05:21:40.742 INFO:tasks.workunit.client.0.smithi067.stdout:7/853: mknod d14/d16/d5b/d64/d90/df0/cf7 0 2024-08-31T05:21:40.743 INFO:tasks.workunit.client.0.smithi067.stdout:9/853: dread dd/df/d25/d59/fdb [0,4194304] 0 2024-08-31T05:21:40.747 INFO:tasks.workunit.client.0.smithi067.stdout:9/854: rename dd/f42 to dd/da2/f11e 0 2024-08-31T05:21:40.748 INFO:tasks.workunit.client.0.smithi067.stdout:5/733: creat db/d26/fe4 x:0 0 0 2024-08-31T05:21:40.750 INFO:tasks.workunit.client.0.smithi067.stdout:9/855: mknod dd/d4d/dca/c11f 0 2024-08-31T05:21:40.751 INFO:tasks.workunit.client.0.smithi067.stdout:9/856: stat dd/df/d25/d59 0 2024-08-31T05:21:40.753 INFO:tasks.workunit.client.0.smithi067.stdout:9/857: mkdir dd/df/d25/d3b/d120 0 2024-08-31T05:21:40.755 INFO:tasks.workunit.client.0.smithi067.stdout:9/858: mkdir dd/df/d25/d3b/d120/d121 0 2024-08-31T05:21:40.758 INFO:tasks.workunit.client.0.smithi067.stdout:9/859: fdatasync dd/f1a 0 2024-08-31T05:21:40.762 INFO:tasks.workunit.client.0.smithi067.stdout:1/878: dwrite d3/d23/d2d/d2e/d34/d66/de8/f54 [0,4194304] 0 2024-08-31T05:21:40.763 INFO:tasks.workunit.client.0.smithi067.stdout:9/860: symlink dd/da2/l122 0 2024-08-31T05:21:40.767 INFO:tasks.workunit.client.0.smithi067.stdout:5/734: dread db/d26/d29/d31/f41 [4194304,4194304] 0 2024-08-31T05:21:40.770 INFO:tasks.workunit.client.0.smithi067.stdout:9/861: truncate dd/df/d5b/d5d/dea/ff5 730475 0 2024-08-31T05:21:40.770 INFO:tasks.workunit.client.0.smithi067.stdout:7/854: dwrite fd [4194304,4194304] 0 2024-08-31T05:21:40.772 INFO:tasks.workunit.client.0.smithi067.stdout:9/862: dread - dd/df/d5b/ffa zero size 2024-08-31T05:21:40.772 INFO:tasks.workunit.client.0.smithi067.stdout:7/855: stat d14/d16/d5b/d64/f8b 0 2024-08-31T05:21:40.774 INFO:tasks.workunit.client.0.smithi067.stdout:9/863: mkdir dd/df/d8e/d123 0 2024-08-31T05:21:40.775 INFO:tasks.workunit.client.0.smithi067.stdout:9/864: fsync dd/df/d25/d3b/d50/fe9 0 2024-08-31T05:21:40.777 INFO:tasks.workunit.client.0.smithi067.stdout:9/865: write dd/d63/d72/fab [5391437,120835] 0 2024-08-31T05:21:40.783 INFO:tasks.workunit.client.0.smithi067.stdout:5/735: dwrite db/d1d/d3a/f43 [0,4194304] 0 2024-08-31T05:21:40.788 INFO:tasks.workunit.client.0.smithi067.stdout:9/866: rename dd/df/d25/fa4 to dd/da2/dd0/f124 0 2024-08-31T05:21:40.789 INFO:tasks.workunit.client.0.smithi067.stdout:7/856: dwrite d14/d4a/d85/f96 [0,4194304] 0 2024-08-31T05:21:40.794 INFO:tasks.workunit.client.0.smithi067.stdout:1/879: link d3/d23/d2d/d2e/d34/d66/de8/d50/l9c d3/d23/d2d/d2e/d34/d66/l13c 0 2024-08-31T05:21:40.796 INFO:tasks.workunit.client.0.smithi067.stdout:9/867: dread dd/df/d25/d3b/d50/d73/fb2 [0,4194304] 0 2024-08-31T05:21:40.800 INFO:tasks.workunit.client.0.smithi067.stdout:7/857: dread d14/d16/d28/d78/f7d [0,4194304] 0 2024-08-31T05:21:40.803 INFO:tasks.workunit.client.0.smithi067.stdout:1/880: dwrite d3/d23/d2d/d2e/d34/d66/d9a/fd9 [0,4194304] 0 2024-08-31T05:21:40.804 INFO:tasks.workunit.client.0.smithi067.stdout:1/881: read - d3/d8b/f13a zero size 2024-08-31T05:21:40.805 INFO:tasks.workunit.client.0.smithi067.stdout:7/858: read d14/d3e/f9e [774796,47509] 0 2024-08-31T05:21:40.813 INFO:tasks.workunit.client.0.smithi067.stdout:5/736: getdents db/d15/d42/d36/d73 0 2024-08-31T05:21:40.814 INFO:tasks.workunit.client.0.smithi067.stdout:1/882: dwrite d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/f122 [0,4194304] 0 2024-08-31T05:21:40.818 INFO:tasks.workunit.client.0.smithi067.stdout:5/737: dread db/d26/d29/f57 [0,4194304] 0 2024-08-31T05:21:40.819 INFO:tasks.workunit.client.0.smithi067.stdout:5/738: readlink db/d26/d29/d31/d8d/d9f/lba 0 2024-08-31T05:21:40.826 INFO:tasks.workunit.client.0.smithi067.stdout:5/739: dread db/f49 [0,4194304] 0 2024-08-31T05:21:40.832 INFO:tasks.workunit.client.0.smithi067.stdout:9/868: dread dd/d4d/dca/f108 [4194304,4194304] 0 2024-08-31T05:21:40.833 INFO:tasks.workunit.client.0.smithi067.stdout:9/869: fsync dd/d4d/dca/df0/f11a 0 2024-08-31T05:21:40.843 INFO:tasks.workunit.client.0.smithi067.stdout:9/870: read dd/df/d25/f6c [7176847,105808] 0 2024-08-31T05:21:40.844 INFO:tasks.workunit.client.0.smithi067.stdout:9/871: fsync dd/df/d25/ff1 0 2024-08-31T05:21:40.844 INFO:tasks.workunit.client.0.smithi067.stdout:1/883: dread d3/d23/d2d/d2e/f39 [0,4194304] 0 2024-08-31T05:21:40.848 INFO:tasks.workunit.client.0.smithi067.stdout:7/859: link d14/d3e/lb4 d14/d16/d5b/lf8 0 2024-08-31T05:21:40.849 INFO:tasks.workunit.client.0.smithi067.stdout:1/884: symlink d3/d23/d2d/d2e/l13d 0 2024-08-31T05:21:40.850 INFO:tasks.workunit.client.0.smithi067.stdout:7/860: truncate d14/d16/d28/d2e/fcd 344999 0 2024-08-31T05:21:40.852 INFO:tasks.workunit.client.0.smithi067.stdout:9/872: rename dd/d20/f104 to dd/d63/d72/f125 0 2024-08-31T05:21:40.856 INFO:tasks.workunit.client.0.smithi067.stdout:1/885: dwrite d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/fec [0,4194304] 0 2024-08-31T05:21:40.859 INFO:tasks.workunit.client.0.smithi067.stdout:7/861: rename d14/d16/d28/d2e/cdd to d14/d4a/d85/da4/dbf/cf9 0 2024-08-31T05:21:40.872 INFO:tasks.workunit.client.0.smithi067.stdout:7/862: dread fb [0,4194304] 0 2024-08-31T05:21:40.877 INFO:tasks.workunit.client.0.smithi067.stdout:1/886: write d3/d23/d2d/d2e/d34/d66/d72/d82/fbb [967274,128642] 0 2024-08-31T05:21:40.879 INFO:tasks.workunit.client.0.smithi067.stdout:1/887: mknod d3/df8/c13e 0 2024-08-31T05:21:40.881 INFO:tasks.workunit.client.0.smithi067.stdout:1/888: creat d3/d23/d2d/d2e/f13f x:0 0 0 2024-08-31T05:21:40.883 INFO:tasks.workunit.client.0.smithi067.stdout:1/889: mknod d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/c140 0 2024-08-31T05:21:40.885 INFO:tasks.workunit.client.0.smithi067.stdout:1/890: rmdir d3/d23/d2d 39 2024-08-31T05:21:40.887 INFO:tasks.workunit.client.0.smithi067.stdout:1/891: readlink d3/d23/d2d/d2e/d34/d66/d72/l83 0 2024-08-31T05:21:40.893 INFO:tasks.workunit.client.0.smithi067.stdout:1/892: dwrite d3/d23/d2d/d2e/d34/d66/de8/d50/f11b [0,4194304] 0 2024-08-31T05:21:40.900 INFO:tasks.workunit.client.0.smithi067.stdout:7/863: write d14/d16/d5b/d8c/dc7/dcf/fe0 [79851,3179] 0 2024-08-31T05:21:40.905 INFO:tasks.workunit.client.0.smithi067.stdout:7/864: fdatasync d14/d4a/fb8 0 2024-08-31T05:21:40.923 INFO:tasks.workunit.client.0.smithi067.stdout:7/865: dread d14/d16/f32 [0,4194304] 0 2024-08-31T05:21:40.926 INFO:tasks.workunit.client.0.smithi067.stdout:1/893: dwrite d3/d23/d2d/d2e/d34/f64 [0,4194304] 0 2024-08-31T05:21:40.927 INFO:tasks.workunit.client.0.smithi067.stdout:7/866: write d14/d16/f2b [2607869,123986] 0 2024-08-31T05:21:40.927 INFO:tasks.workunit.client.0.smithi067.stdout:1/894: dread - d3/df8/f132 zero size 2024-08-31T05:21:40.931 INFO:tasks.workunit.client.0.smithi067.stdout:7/867: mkdir d14/d16/d5b/dfa 0 2024-08-31T05:21:40.933 INFO:tasks.workunit.client.0.smithi067.stdout:7/868: write d14/d16/d28/d2e/f5a [1554750,112989] 0 2024-08-31T05:21:40.934 INFO:tasks.workunit.client.0.smithi067.stdout:7/869: chown d14/d16/d5b/d68/f7b 2 1 2024-08-31T05:21:40.934 INFO:tasks.workunit.client.0.smithi067.stdout:1/895: getdents d3/d23/d2d/d2e/d34/da3 0 2024-08-31T05:21:40.938 INFO:tasks.workunit.client.0.smithi067.stdout:7/870: readlink d14/d16/d5b/d68/d87/deb/df5/d8d/dae/lf2 0 2024-08-31T05:21:40.939 INFO:tasks.workunit.client.0.smithi067.stdout:1/896: mknod d3/d23/d2d/d2e/d34/d66/de8/d50/db5/dc2/d12e/c141 0 2024-08-31T05:21:40.952 INFO:tasks.workunit.client.0.smithi067.stdout:7/871: dread d14/d16/d28/fa0 [0,4194304] 0 2024-08-31T05:21:41.020 INFO:tasks.workunit.client.0.smithi067.stdout:7/872: symlink d14/d54/lfb 0 2024-08-31T05:21:41.021 INFO:tasks.workunit.client.0.smithi067.stdout:7/873: chown d14/d16/d5b/d68/d6e 4453556 1 2024-08-31T05:21:41.021 INFO:tasks.workunit.client.0.smithi067.stdout:7/874: readlink d14/d4a/la1 0 2024-08-31T05:21:41.022 INFO:tasks.workunit.client.0.smithi067.stdout:7/875: truncate d14/d3e/ff1 954630 0 2024-08-31T05:21:41.023 INFO:tasks.workunit.client.0.smithi067.stdout:7/876: fsync d14/d16/d5b/d68/d87/deb/df5/fbe 0 2024-08-31T05:21:41.178 INFO:tasks.workunit.client.0.smithi067.stdout:1/897: dwrite d3/d23/db1/db6/dc4/fe3 [0,4194304] 0 2024-08-31T05:21:41.223 INFO:tasks.workunit.client.0.smithi067.stdout:7/877: rename d14/c4c to d14/d4a/d85/cfc 0 2024-08-31T05:21:41.224 INFO:tasks.workunit.client.0.smithi067.stdout:1/898: creat d3/d23/d2d/d2e/d34/d66/de8/f142 x:0 0 0 2024-08-31T05:21:41.226 INFO:tasks.workunit.client.0.smithi067.stdout:7/878: fsync d14/d16/d5b/f5c 0 2024-08-31T05:21:41.228 INFO:tasks.workunit.client.0.smithi067.stdout:1/899: mkdir d3/d23/d2d/d2e/d34/d66/d72/d143 0 2024-08-31T05:21:41.232 INFO:tasks.workunit.client.0.smithi067.stdout:7/879: creat d14/d4a/dd9/ffd x:0 0 0 2024-08-31T05:21:41.233 INFO:tasks.workunit.client.0.smithi067.stdout:7/880: fdatasync d14/d16/d28/d2e/fcd 0 2024-08-31T05:21:41.235 INFO:tasks.workunit.client.0.smithi067.stdout:1/900: creat d3/d23/d2d/d2e/d34/d66/f144 x:0 0 0 2024-08-31T05:21:41.238 INFO:tasks.workunit.client.0.smithi067.stdout:7/881: unlink d14/d16/d5b/d68/d87/deb/df5/fe5 0 2024-08-31T05:21:41.239 INFO:tasks.workunit.client.0.smithi067.stdout:1/901: dread d3/d23/d2d/d2e/d34/da3/fb8 [0,4194304] 0 2024-08-31T05:21:41.240 INFO:tasks.workunit.client.0.smithi067.stdout:7/882: stat d14/d16/d5b/d68/d87/deb/df5/d8d/caf 0 2024-08-31T05:21:41.242 INFO:tasks.workunit.client.0.smithi067.stdout:7/883: truncate d14/d16/d5b/d68/d87/ff3 272183 0 2024-08-31T05:21:41.243 INFO:tasks.workunit.client.0.smithi067.stdout:1/902: mkdir d3/d23/d2d/d2e/d34/d66/de8/d50/db5/d145 0 2024-08-31T05:21:41.245 INFO:tasks.workunit.client.0.smithi067.stdout:7/884: rename d14/d16/f42 to d14/d4a/ffe 0 2024-08-31T05:21:41.250 INFO:tasks.workunit.client.0.smithi067.stdout:1/903: rename d3/d36/f53 to d3/d23/db1/dd4/dfd/f146 0 2024-08-31T05:21:41.251 INFO:tasks.workunit.client.0.smithi067.stdout:1/904: chown d3/d23/d2d/d2e/d34/l128 77 1 2024-08-31T05:21:41.251 INFO:tasks.workunit.client.0.smithi067.stdout:1/905: readlink d3/d23/d2d/d2e/d34/d66/la0 0 2024-08-31T05:21:41.258 INFO:tasks.workunit.client.0.smithi067.stdout:1/906: dwrite d3/df8/f132 [0,4194304] 0 2024-08-31T05:21:41.261 INFO:tasks.workunit.client.0.smithi067.stdout:1/907: mknod d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/c147 0 2024-08-31T05:21:41.269 INFO:tasks.workunit.client.0.smithi067.stdout:1/908: dwrite d3/d23/d2d/d2e/d34/f107 [0,4194304] 0 2024-08-31T05:21:41.274 INFO:tasks.workunit.client.0.smithi067.stdout:1/909: rename d3/d23/d2d/d2e/d34/d66/d72/f11d to d3/d23/d2d/d2e/d34/da3/f148 0 2024-08-31T05:21:41.278 INFO:tasks.workunit.client.0.smithi067.stdout:7/885: dwrite d14/d16/d28/d2e/f3a [0,4194304] 0 2024-08-31T05:21:41.281 INFO:tasks.workunit.client.0.smithi067.stdout:1/910: rename d3/f129 to d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/f149 0 2024-08-31T05:21:41.282 INFO:tasks.workunit.client.0.smithi067.stdout:2/932: sync 2024-08-31T05:21:41.283 INFO:tasks.workunit.client.0.smithi067.stdout:2/933: write db/d12/d1a/f36 [4300588,117710] 0 2024-08-31T05:21:41.287 INFO:tasks.workunit.client.0.smithi067.stdout:1/911: symlink d3/dfc/df6/d101/d116/l14a 0 2024-08-31T05:21:41.288 INFO:tasks.workunit.client.0.smithi067.stdout:2/934: truncate db/d12/d1a/d2b/d3d/d4f/fe8 624249 0 2024-08-31T05:21:41.289 INFO:tasks.workunit.client.0.smithi067.stdout:1/912: stat d3/d23/d2d/d2e/d34/d66/de8/d50/c71 0 2024-08-31T05:21:41.292 INFO:tasks.workunit.client.0.smithi067.stdout:1/913: symlink d3/d23/d2d/d2e/d34/d66/d94/d9d/l14b 0 2024-08-31T05:21:41.293 INFO:tasks.workunit.client.0.smithi067.stdout:7/886: getdents d14/d4a/d85/da4 0 2024-08-31T05:21:41.294 INFO:tasks.workunit.client.0.smithi067.stdout:2/935: symlink db/dd/d2d/da7/d10b/l132 0 2024-08-31T05:21:41.298 INFO:tasks.workunit.client.0.smithi067.stdout:7/887: rename d14/d16/d28/d78/lcb to d14/d16/lff 0 2024-08-31T05:21:41.299 INFO:tasks.workunit.client.0.smithi067.stdout:7/888: chown d14/d54/d5e/d67/f6d 3400183 1 2024-08-31T05:21:41.301 INFO:tasks.workunit.client.0.smithi067.stdout:7/889: write d14/d54/d5e/d8f/fc9 [723474,31431] 0 2024-08-31T05:21:41.302 INFO:tasks.workunit.client.0.smithi067.stdout:7/890: chown d14/d16/d28/l43 10 1 2024-08-31T05:21:41.303 INFO:tasks.workunit.client.0.smithi067.stdout:2/936: rename db/d12/d1a/d2b/d3d/d4f/d6d/fcc to db/d12/d1a/d2b/f133 0 2024-08-31T05:21:41.305 INFO:tasks.workunit.client.0.smithi067.stdout:7/891: rename d14/d54/lfb to d14/d16/d5b/dfa/l100 0 2024-08-31T05:21:41.308 INFO:tasks.workunit.client.0.smithi067.stdout:7/892: read d14/d54/d91/fd3 [354742,63734] 0 2024-08-31T05:21:41.308 INFO:tasks.workunit.client.0.smithi067.stdout:2/937: mknod db/d8c/dcd/df4/d62/c134 0 2024-08-31T05:21:41.313 INFO:tasks.workunit.client.0.smithi067.stdout:1/914: write d3/d23/d2d/d2e/d34/d66/f67 [1556230,37842] 0 2024-08-31T05:21:41.317 INFO:tasks.workunit.client.0.smithi067.stdout:1/915: mkdir d3/d23/d2d/d2e/df9/d14c 0 2024-08-31T05:21:41.321 INFO:tasks.workunit.client.0.smithi067.stdout:1/916: creat d3/d23/d2d/d2e/df9/d14c/f14d x:0 0 0 2024-08-31T05:21:41.323 INFO:tasks.workunit.client.0.smithi067.stdout:2/938: dwrite db/d8c/dcd/df4/da0/fb8 [0,4194304] 0 2024-08-31T05:21:41.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:40 smithi067 ceph-mon[17432]: pgmap v41: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 54 MiB/s rd, 140 MiB/s wr, 391 op/s 2024-08-31T05:21:41.330 INFO:tasks.workunit.client.0.smithi067.stdout:1/917: creat d3/d23/d2d/d2e/d34/d66/de8/d50/db5/d145/f14e x:0 0 0 2024-08-31T05:21:41.331 INFO:tasks.workunit.client.0.smithi067.stdout:1/918: stat d3/d23/d2d/d2e/d34/d66/d94/d9d/ca9 0 2024-08-31T05:21:41.331 INFO:tasks.workunit.client.0.smithi067.stdout:1/919: chown d3/dfc/df6 481044 1 2024-08-31T05:21:41.333 INFO:tasks.workunit.client.0.smithi067.stdout:1/920: dread d3/f24 [0,4194304] 0 2024-08-31T05:21:41.333 INFO:tasks.workunit.client.0.smithi067.stdout:1/921: stat d3/d23/d79/fa5 0 2024-08-31T05:21:41.336 INFO:tasks.workunit.client.0.smithi067.stdout:2/939: write db/d12/d1a/d2b/d3d/d4f/de1/f130 [1153195,127713] 0 2024-08-31T05:21:41.337 INFO:tasks.workunit.client.0.smithi067.stdout:2/940: fsync db/d12/d1a/d2b/d87/fe6 0 2024-08-31T05:21:41.338 INFO:tasks.workunit.client.0.smithi067.stdout:1/922: rename d3/d23/d2d/d2e/d34/d66/d9a/fd9 to d3/d23/db1/f14f 0 2024-08-31T05:21:41.339 INFO:tasks.workunit.client.0.smithi067.stdout:1/923: fdatasync d3/f5 0 2024-08-31T05:21:41.344 INFO:tasks.workunit.client.0.smithi067.stdout:2/941: mknod db/d12/d1a/da3/ddc/c135 0 2024-08-31T05:21:41.345 INFO:tasks.workunit.client.0.smithi067.stdout:1/924: mkdir d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/d150 0 2024-08-31T05:21:41.348 INFO:tasks.workunit.client.0.smithi067.stdout:2/942: rmdir db/dd/d2d/da7 39 2024-08-31T05:21:41.349 INFO:tasks.workunit.client.0.smithi067.stdout:2/943: stat db/d12/d1a/d1e/f93 0 2024-08-31T05:21:41.351 INFO:tasks.workunit.client.0.smithi067.stdout:1/925: dwrite d3/d23/d2d/d2e/d34/d66/d72/f4f [0,4194304] 0 2024-08-31T05:21:41.353 INFO:tasks.workunit.client.0.smithi067.stdout:2/944: mkdir db/d8c/dcd/d136 0 2024-08-31T05:21:41.356 INFO:tasks.workunit.client.0.smithi067.stdout:1/926: mkdir d3/dfc/df6/d101/d151 0 2024-08-31T05:21:41.359 INFO:tasks.workunit.client.0.smithi067.stdout:2/945: dwrite db/d12/d1a/f36 [0,4194304] 0 2024-08-31T05:21:41.361 INFO:tasks.workunit.client.0.smithi067.stdout:2/946: mknod db/d12/d1a/da3/c137 0 2024-08-31T05:21:41.369 INFO:tasks.workunit.client.0.smithi067.stdout:2/947: link db/d8c/dcd/df4/d62/cc1 db/d12/d1a/d2b/d3d/d69/d3b/c138 0 2024-08-31T05:21:41.372 INFO:tasks.workunit.client.0.smithi067.stdout:2/948: write db/d8c/dcd/df4/d62/f79 [2707587,102001] 0 2024-08-31T05:21:41.388 INFO:tasks.workunit.client.0.smithi067.stdout:2/949: dread db/d12/d1a/d2b/d3d/d69/d3b/dfe/f75 [0,4194304] 0 2024-08-31T05:21:41.390 INFO:tasks.workunit.client.0.smithi067.stdout:2/950: symlink db/dd/d13/l139 0 2024-08-31T05:21:41.416 INFO:tasks.workunit.client.0.smithi067.stdout:2/951: dwrite db/fe2 [0,4194304] 0 2024-08-31T05:21:41.420 INFO:tasks.workunit.client.0.smithi067.stdout:2/952: creat db/dd/d13/f13a x:0 0 0 2024-08-31T05:21:41.422 INFO:tasks.workunit.client.0.smithi067.stdout:2/953: truncate db/d8c/dcd/df4/da0/dc4/f108 655694 0 2024-08-31T05:21:41.424 INFO:tasks.workunit.client.0.smithi067.stdout:2/954: unlink db/d12/d1a/d1e/f54 0 2024-08-31T05:21:41.440 INFO:tasks.workunit.client.0.smithi067.stdout:2/955: dwrite db/dd/d13/f29 [4194304,4194304] 0 2024-08-31T05:21:41.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:40 smithi073 ceph-mon[24726]: pgmap v41: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 54 MiB/s rd, 140 MiB/s wr, 391 op/s 2024-08-31T05:21:41.446 INFO:tasks.workunit.client.0.smithi067.stdout:2/956: dread db/d8c/dcd/df4/ff6 [0,4194304] 0 2024-08-31T05:21:41.448 INFO:tasks.workunit.client.0.smithi067.stdout:2/957: rmdir db/d8c 39 2024-08-31T05:21:41.462 INFO:tasks.workunit.client.0.smithi067.stdout:2/958: dwrite db/d12/d1a/d2b/d3d/d69/d3b/d99/fb6 [0,4194304] 0 2024-08-31T05:21:41.465 INFO:tasks.workunit.client.0.smithi067.stdout:2/959: unlink db/dd/cd6 0 2024-08-31T05:21:41.481 INFO:tasks.workunit.client.0.smithi067.stdout:2/960: truncate db/dd/d2d/f35 7035260 0 2024-08-31T05:21:41.482 INFO:tasks.workunit.client.0.smithi067.stdout:2/961: write db/d12/d1a/d2b/d3d/d4f/d6d/def/f102 [399782,74327] 0 2024-08-31T05:21:41.489 INFO:tasks.workunit.client.0.smithi067.stdout:2/962: rename db/ff to db/d12/d1a/d2b/d3d/f13b 0 2024-08-31T05:21:41.490 INFO:tasks.workunit.client.0.smithi067.stdout:2/963: stat db/d12/d1a/d2b/d3d/d69/d3b/d99 0 2024-08-31T05:21:41.493 INFO:tasks.workunit.client.0.smithi067.stdout:2/964: truncate db/f5b 3956810 0 2024-08-31T05:21:41.495 INFO:tasks.workunit.client.0.smithi067.stdout:2/965: fsync f4 0 2024-08-31T05:21:41.497 INFO:tasks.workunit.client.0.smithi067.stdout:2/966: fdatasync db/d12/d1a/d2b/d40/d9b/fbb 0 2024-08-31T05:21:41.500 INFO:tasks.workunit.client.0.smithi067.stdout:2/967: fsync db/d8c/dcd/df4/da0/dc4/f108 0 2024-08-31T05:21:41.510 INFO:tasks.workunit.client.0.smithi067.stdout:2/968: write db/d8c/dcd/df4/fca [2973426,119968] 0 2024-08-31T05:21:41.512 INFO:tasks.workunit.client.0.smithi067.stdout:2/969: creat db/d12/d1a/d2b/d3d/d69/d3b/f13c x:0 0 0 2024-08-31T05:21:41.514 INFO:tasks.workunit.client.0.smithi067.stdout:2/970: mknod db/d8c/dcd/df4/da0/dc4/c13d 0 2024-08-31T05:21:41.515 INFO:tasks.workunit.client.0.smithi067.stdout:2/971: write db/dd/d13/f29 [6148812,27631] 0 2024-08-31T05:21:41.539 INFO:tasks.workunit.client.0.smithi067.stdout:2/972: dwrite db/f5b [0,4194304] 0 2024-08-31T05:21:41.540 INFO:tasks.workunit.client.0.smithi067.stdout:2/973: fdatasync db/d12/d1a/d2b/d3d/d69/d3b/f109 0 2024-08-31T05:21:41.542 INFO:tasks.workunit.client.0.smithi067.stdout:2/974: write db/d8c/dcd/df4/d62/f79 [1573288,4058] 0 2024-08-31T05:21:41.553 INFO:tasks.workunit.client.0.smithi067.stdout:2/975: dread db/d8c/dcd/df4/f53 [0,4194304] 0 2024-08-31T05:21:41.554 INFO:tasks.workunit.client.0.smithi067.stdout:2/976: stat db/d12/d1a/d2b/d3d/d69/d3b/l57 0 2024-08-31T05:21:41.556 INFO:tasks.workunit.client.0.smithi067.stdout:2/977: stat db/dd/l8a 0 2024-08-31T05:21:41.560 INFO:tasks.workunit.client.0.smithi067.stdout:2/978: rmdir db/d12/d1a/d1e/d4d/dd5/dff 0 2024-08-31T05:21:41.593 INFO:tasks.workunit.client.0.smithi067.stdout:6/975: sync 2024-08-31T05:21:41.593 INFO:tasks.workunit.client.0.smithi067.stdout:5/740: sync 2024-08-31T05:21:41.595 INFO:tasks.workunit.client.0.smithi067.stdout:6/976: creat d1b/d23/d61/f13c x:0 0 0 2024-08-31T05:21:41.598 INFO:tasks.workunit.client.0.smithi067.stdout:5/741: creat db/d26/d29/d31/d7a/fe5 x:0 0 0 2024-08-31T05:21:41.602 INFO:tasks.workunit.client.0.smithi067.stdout:6/977: dwrite d1b/d40/d70/dd0/f10b [0,4194304] 0 2024-08-31T05:21:41.607 INFO:tasks.workunit.client.0.smithi067.stdout:5/742: dwrite db/d26/d29/d81/fd1 [0,4194304] 0 2024-08-31T05:21:41.611 INFO:tasks.workunit.client.0.smithi067.stdout:5/743: mknod db/d26/d60/da7/ce6 0 2024-08-31T05:21:41.618 INFO:tasks.workunit.client.0.smithi067.stdout:6/978: write d1b/d23/d120/d137/fe3 [701175,71239] 0 2024-08-31T05:21:41.630 INFO:tasks.workunit.client.0.smithi067.stdout:6/979: truncate d1b/f43 8151790 0 2024-08-31T05:21:41.636 INFO:tasks.workunit.client.0.smithi067.stdout:6/980: write d1b/d23/d61/fc4 [383913,101673] 0 2024-08-31T05:21:41.729 INFO:tasks.workunit.client.0.smithi067.stdout:9/873: sync 2024-08-31T05:21:41.729 INFO:tasks.workunit.client.0.smithi067.stdout:6/981: dread - d1b/d40/d70/dd0/daa/f104 zero size 2024-08-31T05:21:41.733 INFO:tasks.workunit.client.0.smithi067.stdout:9/874: mkdir dd/d63/d126 0 2024-08-31T05:21:41.735 INFO:tasks.workunit.client.0.smithi067.stdout:6/982: creat d1b/d40/f13d x:0 0 0 2024-08-31T05:21:41.792 INFO:tasks.workunit.client.0.smithi067.stdout:6/983: write f19 [1343379,68660] 0 2024-08-31T05:21:41.793 INFO:tasks.workunit.client.0.smithi067.stdout:9/875: dwrite dd/df/d8e/dcc/fdc [0,4194304] 0 2024-08-31T05:21:41.793 INFO:tasks.workunit.client.0.smithi067.stdout:9/876: readlink dd/lb7 0 2024-08-31T05:21:41.798 INFO:tasks.workunit.client.0.smithi067.stdout:6/984: creat d1b/d40/d70/dd0/d5c/d86/f13e x:0 0 0 2024-08-31T05:21:41.848 INFO:tasks.workunit.client.0.smithi067.stdout:6/985: dwrite d1b/d23/d120/d137/d3b/fcd [0,4194304] 0 2024-08-31T05:21:41.852 INFO:tasks.workunit.client.0.smithi067.stdout:6/986: getdents d1b/d40/d70/dd0/d5e/d7b/d12e 0 2024-08-31T05:21:41.855 INFO:tasks.workunit.client.0.smithi067.stdout:6/987: mkdir d1b/d23/d61/d13f 0 2024-08-31T05:21:41.859 INFO:tasks.workunit.client.0.smithi067.stdout:6/988: rename d1b/d40/de8/ff5 to d1b/d23/d120/d137/f140 0 2024-08-31T05:21:41.877 INFO:tasks.workunit.client.0.smithi067.stdout:6/989: dwrite f18 [0,4194304] 0 2024-08-31T05:21:41.878 INFO:tasks.workunit.client.0.smithi067.stdout:6/990: dread - d1b/d40/d70/dd0/d5c/d86/f122 zero size 2024-08-31T05:21:41.881 INFO:tasks.workunit.client.0.smithi067.stdout:6/991: chown d1b/d40/d96/db3/cd4 29 1 2024-08-31T05:21:41.883 INFO:tasks.workunit.client.0.smithi067.stdout:6/992: truncate d1b/d40/d70/dd0/daa/fd3 955185 0 2024-08-31T05:21:41.886 INFO:tasks.workunit.client.0.smithi067.stdout:6/993: mknod d1b/d40/d70/dd0/da4/c141 0 2024-08-31T05:21:41.911 INFO:tasks.workunit.client.0.smithi067.stdout:6/994: write d1b/d40/d70/dd0/daa/fed [466283,74690] 0 2024-08-31T05:21:41.913 INFO:tasks.workunit.client.0.smithi067.stdout:6/995: write d1b/d40/d70/dd0/d5e/de6/fc5 [28117,87363] 0 2024-08-31T05:21:41.916 INFO:tasks.workunit.client.0.smithi067.stdout:6/996: read d1b/d23/d61/f4e [236747,4070] 0 2024-08-31T05:21:41.928 INFO:tasks.workunit.client.0.smithi067.stdout:6/997: link d1b/fbc d1b/d40/d70/dd0/f142 0 2024-08-31T05:21:41.934 INFO:tasks.workunit.client.0.smithi067.stdout:6/998: rename d1b/d23/d61/f13c to d1b/d23/d61/d13f/f143 0 2024-08-31T05:21:41.946 INFO:tasks.workunit.client.0.smithi067.stdout:6/999: getdents d1b/d40/d70/dd0/da4 0 2024-08-31T05:21:41.983 INFO:tasks.workunit.client.0.smithi067.stdout:7/893: sync 2024-08-31T05:21:41.983 INFO:tasks.workunit.client.0.smithi067.stdout:7/894: chown d14/d4a/d85/f96 23936 1 2024-08-31T05:21:41.983 INFO:tasks.workunit.client.0.smithi067.stdout:7/895: chown d14/d16/d5b/dfa 7137228 1 2024-08-31T05:21:41.986 INFO:tasks.workunit.client.0.smithi067.stdout:7/896: creat d14/d16/d5b/d64/d90/f101 x:0 0 0 2024-08-31T05:21:41.991 INFO:tasks.workunit.client.0.smithi067.stdout:7/897: dread d14/d54/d5e/d8f/faa [0,4194304] 0 2024-08-31T05:21:41.991 INFO:tasks.workunit.client.0.smithi067.stdout:7/898: chown d14/d3e/f9e 1604246 1 2024-08-31T05:21:42.003 INFO:tasks.workunit.client.0.smithi067.stdout:7/899: dread d14/d3e/f70 [0,4194304] 0 2024-08-31T05:21:42.014 INFO:tasks.workunit.client.0.smithi067.stdout:7/900: truncate d14/d16/d5b/d68/f7b 596994 0 2024-08-31T05:21:42.015 INFO:tasks.workunit.client.0.smithi067.stdout:7/901: symlink d14/d54/d5e/l102 0 2024-08-31T05:21:42.017 INFO:tasks.workunit.client.0.smithi067.stdout:7/902: symlink d14/d54/d91/l103 0 2024-08-31T05:21:42.017 INFO:tasks.workunit.client.0.smithi067.stdout:7/903: dread - d14/d54/d91/fa2 zero size 2024-08-31T05:21:42.025 INFO:tasks.workunit.client.0.smithi067.stdout:7/904: dwrite d14/d54/d5e/d67/fc2 [0,4194304] 0 2024-08-31T05:21:42.029 INFO:tasks.workunit.client.0.smithi067.stdout:7/905: creat d14/d16/d5b/dfa/f104 x:0 0 0 2024-08-31T05:21:42.029 INFO:tasks.workunit.client.0.smithi067.stdout:7/906: dread - d14/d54/d91/fa2 zero size 2024-08-31T05:21:42.032 INFO:tasks.workunit.client.0.smithi067.stdout:7/907: creat d14/d16/d28/d78/f105 x:0 0 0 2024-08-31T05:21:42.033 INFO:tasks.workunit.client.0.smithi067.stdout:9/877: sync 2024-08-31T05:21:42.033 INFO:tasks.workunit.client.0.smithi067.stdout:1/927: sync 2024-08-31T05:21:42.034 INFO:tasks.workunit.client.0.smithi067.stdout:2/979: sync 2024-08-31T05:21:42.034 INFO:tasks.workunit.client.0.smithi067.stdout:5/744: sync 2024-08-31T05:21:42.062 INFO:tasks.workunit.client.0.smithi067.stdout:9/878: mkdir dd/df/d8e/d94/d127 0 2024-08-31T05:21:42.065 INFO:tasks.workunit.client.0.smithi067.stdout:7/908: rename d14/d16/d5b/d68/d87/deb to d14/d16/d5b/d68/d87/de9/d106 0 2024-08-31T05:21:42.066 INFO:tasks.workunit.client.0.smithi067.stdout:2/980: rmdir db/d12/d1a/d2b/d3d/d4f/d6d 39 2024-08-31T05:21:42.071 INFO:tasks.workunit.client.0.smithi067.stdout:9/879: mkdir dd/d63/d126/d128 0 2024-08-31T05:21:42.075 INFO:tasks.workunit.client.0.smithi067.stdout:9/880: chown dd/f9b 2 1 2024-08-31T05:21:42.086 INFO:tasks.workunit.client.0.smithi067.stdout:7/909: truncate d14/d54/d5e/d8f/faa 839568 0 2024-08-31T05:21:42.090 INFO:tasks.workunit.client.0.smithi067.stdout:1/928: dwrite d3/d23/d5d/f61 [0,4194304] 0 2024-08-31T05:21:42.092 INFO:tasks.workunit.client.0.smithi067.stdout:5/745: dwrite db/d26/d29/f99 [0,4194304] 0 2024-08-31T05:21:42.093 INFO:tasks.workunit.client.0.smithi067.stdout:7/910: creat d14/d16/d5b/d68/d87/de9/d106/f107 x:0 0 0 2024-08-31T05:21:42.095 INFO:tasks.workunit.client.0.smithi067.stdout:2/981: dwrite db/d12/d1a/d2b/d3d/d4f/fcb [0,4194304] 0 2024-08-31T05:21:42.104 INFO:tasks.workunit.client.0.smithi067.stdout:7/911: getdents d14/d16/d5b/d68/d87/de9/d106/df5 0 2024-08-31T05:21:42.106 INFO:tasks.workunit.client.0.smithi067.stdout:2/982: creat db/d8c/dcd/df4/da0/dc4/dc3/f13e x:0 0 0 2024-08-31T05:21:42.108 INFO:tasks.workunit.client.0.smithi067.stdout:5/746: dwrite db/d26/fe4 [0,4194304] 0 2024-08-31T05:21:42.109 INFO:tasks.workunit.client.0.smithi067.stdout:7/912: mknod d14/d4a/c108 0 2024-08-31T05:21:42.110 INFO:tasks.workunit.client.0.smithi067.stdout:2/983: write db/d12/d1a/d2b/d3d/d4f/d6d/f7f [4623336,86644] 0 2024-08-31T05:21:42.114 INFO:tasks.workunit.client.0.smithi067.stdout:5/747: fdatasync db/d15/d59/dad/dcf/ddd/f63 0 2024-08-31T05:21:42.117 INFO:tasks.workunit.client.0.smithi067.stdout:7/913: symlink d14/d3e/l109 0 2024-08-31T05:21:42.130 INFO:tasks.workunit.client.0.smithi067.stdout:1/929: dwrite d3/d23/d2d/d2e/d34/d66/d72/f48 [0,4194304] 0 2024-08-31T05:21:42.130 INFO:tasks.workunit.client.0.smithi067.stdout:2/984: dwrite db/f3a [0,4194304] 0 2024-08-31T05:21:42.131 INFO:tasks.workunit.client.0.smithi067.stdout:7/914: creat d14/d54/de3/f10a x:0 0 0 2024-08-31T05:21:42.138 INFO:tasks.workunit.client.0.smithi067.stdout:2/985: dread db/d12/d1a/d2b/d3d/d4f/d6d/def/f102 [0,4194304] 0 2024-08-31T05:21:42.144 INFO:tasks.workunit.client.0.smithi067.stdout:7/915: truncate d14/d4a/f76 489817 0 2024-08-31T05:21:42.145 INFO:tasks.workunit.client.0.smithi067.stdout:2/986: mkdir db/d8c/dcd/d136/d13f 0 2024-08-31T05:21:42.147 INFO:tasks.workunit.client.0.smithi067.stdout:2/987: symlink db/dd/d2d/db7/l140 0 2024-08-31T05:21:42.149 INFO:tasks.workunit.client.0.smithi067.stdout:2/988: mknod db/d12/d1a/c141 0 2024-08-31T05:21:42.149 INFO:tasks.workunit.client.0.smithi067.stdout:2/989: stat db/d12/d1a/d2b/d87 0 2024-08-31T05:21:42.160 INFO:tasks.workunit.client.0.smithi067.stdout:1/930: write d3/d36/f47 [688082,71471] 0 2024-08-31T05:21:42.160 INFO:tasks.workunit.client.0.smithi067.stdout:5/748: dwrite db/d26/d60/f6a [4194304,4194304] 0 2024-08-31T05:21:42.164 INFO:tasks.workunit.client.0.smithi067.stdout:1/931: fsync d3/d23/d2d/d2e/d34/da3/fb8 0 2024-08-31T05:21:42.165 INFO:tasks.workunit.client.0.smithi067.stdout:7/916: dread d14/d54/d5e/d67/f6d [0,4194304] 0 2024-08-31T05:21:42.166 INFO:tasks.workunit.client.0.smithi067.stdout:5/749: read db/f1e [1537982,67294] 0 2024-08-31T05:21:42.170 INFO:tasks.workunit.client.0.smithi067.stdout:7/917: mknod d14/d54/de3/c10b 0 2024-08-31T05:21:42.170 INFO:tasks.workunit.client.0.smithi067.stdout:2/990: dwrite db/d8c/dcd/feb [0,4194304] 0 2024-08-31T05:21:42.174 INFO:tasks.workunit.client.0.smithi067.stdout:5/750: creat db/d26/d29/d31/d54/fe7 x:0 0 0 2024-08-31T05:21:42.175 INFO:tasks.workunit.client.0.smithi067.stdout:5/751: fdatasync db/d1d/f78 0 2024-08-31T05:21:42.180 INFO:tasks.workunit.client.0.smithi067.stdout:2/991: mkdir db/d12/d1a/d2b/d3d/d69/d3b/d99/d142 0 2024-08-31T05:21:42.182 INFO:tasks.workunit.client.0.smithi067.stdout:1/932: dwrite d3/d23/d2d/d2e/fb2 [0,4194304] 0 2024-08-31T05:21:42.184 INFO:tasks.workunit.client.0.smithi067.stdout:5/752: mkdir db/d26/d29/d31/d54/d8c/dd7/de8 0 2024-08-31T05:21:42.189 INFO:tasks.workunit.client.0.smithi067.stdout:5/753: dread db/d26/d29/f99 [0,4194304] 0 2024-08-31T05:21:42.191 INFO:tasks.workunit.client.0.smithi067.stdout:1/933: mknod d3/d23/d2d/d2e/c152 0 2024-08-31T05:21:42.196 INFO:tasks.workunit.client.0.smithi067.stdout:7/918: dread d14/d16/d5b/d8c/fe7 [4194304,4194304] 0 2024-08-31T05:21:42.196 INFO:tasks.workunit.client.0.smithi067.stdout:2/992: rename db/l2e to db/d12/d1a/da3/ddc/l143 0 2024-08-31T05:21:42.199 INFO:tasks.workunit.client.0.smithi067.stdout:1/934: dread d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/f113 [0,4194304] 0 2024-08-31T05:21:42.201 INFO:tasks.workunit.client.0.smithi067.stdout:7/919: mkdir d14/d16/d5b/d64/d90/d10c 0 2024-08-31T05:21:42.202 INFO:tasks.workunit.client.0.smithi067.stdout:7/920: chown d14/d16/f6b 162838713 1 2024-08-31T05:21:42.203 INFO:tasks.workunit.client.0.smithi067.stdout:5/754: getdents db/d58 0 2024-08-31T05:21:42.204 INFO:tasks.workunit.client.0.smithi067.stdout:7/921: creat d14/d54/d5e/d8f/f10d x:0 0 0 2024-08-31T05:21:42.209 INFO:tasks.workunit.client.0.smithi067.stdout:7/922: mknod d14/d54/d91/c10e 0 2024-08-31T05:21:42.212 INFO:tasks.workunit.client.0.smithi067.stdout:5/755: link db/d26/d60/f6a db/d26/d29/d31/d54/d66/fe9 0 2024-08-31T05:21:42.213 INFO:tasks.workunit.client.0.smithi067.stdout:5/756: chown db/d15/d42/d36 218 1 2024-08-31T05:21:42.215 INFO:tasks.workunit.client.0.smithi067.stdout:7/923: getdents d14/d4a/d85 0 2024-08-31T05:21:42.218 INFO:tasks.workunit.client.0.smithi067.stdout:1/935: dwrite d3/d23/d79/fa6 [0,4194304] 0 2024-08-31T05:21:42.222 INFO:tasks.workunit.client.0.smithi067.stdout:5/757: dwrite db/d26/d29/d81/fd1 [0,4194304] 0 2024-08-31T05:21:42.223 INFO:tasks.workunit.client.0.smithi067.stdout:1/936: rmdir d3/d23/d2d/d2e/d34/d66/de8/d50/db5/dc2 39 2024-08-31T05:21:42.230 INFO:tasks.workunit.client.0.smithi067.stdout:1/937: rename f1 to d3/d36/f153 0 2024-08-31T05:21:42.230 INFO:tasks.workunit.client.0.smithi067.stdout:7/924: write d14/f95 [1375528,50092] 0 2024-08-31T05:21:42.231 INFO:tasks.workunit.client.0.smithi067.stdout:1/938: readlink d3/l9 0 2024-08-31T05:21:42.233 INFO:tasks.workunit.client.0.smithi067.stdout:7/925: creat d14/d16/d28/f10f x:0 0 0 2024-08-31T05:21:42.233 INFO:tasks.workunit.client.0.smithi067.stdout:5/758: write db/d26/d29/d31/fbe [425454,87669] 0 2024-08-31T05:21:42.236 INFO:tasks.workunit.client.0.smithi067.stdout:7/926: write d14/d54/d5e/d8f/fea [1690162,3098] 0 2024-08-31T05:21:42.238 INFO:tasks.workunit.client.0.smithi067.stdout:7/927: write d14/d16/d5b/d68/d87/de9/d106/f107 [149203,30598] 0 2024-08-31T05:21:42.283 INFO:tasks.workunit.client.0.smithi067.stdout:5/759: creat db/d15/d42/d36/d73/d77/fea x:0 0 0 2024-08-31T05:21:42.284 INFO:tasks.workunit.client.0.smithi067.stdout:5/760: stat db/d26/d29/d31/d54/d66 0 2024-08-31T05:21:42.287 INFO:tasks.workunit.client.0.smithi067.stdout:7/928: mkdir d14/d16/d5b/d64/d110 0 2024-08-31T05:21:42.288 INFO:tasks.workunit.client.0.smithi067.stdout:1/939: dwrite d3/d23/d2d/d2e/d34/d66/d94/d9d/fcb [0,4194304] 0 2024-08-31T05:21:42.290 INFO:tasks.workunit.client.0.smithi067.stdout:5/761: mknod db/d15/d42/d36/d73/d77/ceb 0 2024-08-31T05:21:42.291 INFO:tasks.workunit.client.0.smithi067.stdout:5/762: dread - db/d15/d42/d36/d73/d77/fea zero size 2024-08-31T05:21:42.292 INFO:tasks.workunit.client.0.smithi067.stdout:5/763: write f7 [3529514,19654] 0 2024-08-31T05:21:42.299 INFO:tasks.workunit.client.0.smithi067.stdout:5/764: dwrite db/d26/fe4 [0,4194304] 0 2024-08-31T05:21:42.303 INFO:tasks.workunit.client.0.smithi067.stdout:1/940: rename d3/d23/db1/dd4/dfd/f146 to d3/d23/d5d/f154 0 2024-08-31T05:21:42.308 INFO:tasks.workunit.client.0.smithi067.stdout:5/765: dread db/d26/d29/d31/fbe [0,4194304] 0 2024-08-31T05:21:42.309 INFO:tasks.workunit.client.0.smithi067.stdout:5/766: fsync db/d26/d4c/f65 0 2024-08-31T05:21:42.309 INFO:tasks.workunit.client.0.smithi067.stdout:7/929: getdents d14/d16/d5b/d68/d6e 0 2024-08-31T05:21:42.312 INFO:tasks.workunit.client.0.smithi067.stdout:5/767: read db/d26/f9b [1051305,50539] 0 2024-08-31T05:21:42.313 INFO:tasks.workunit.client.0.smithi067.stdout:7/930: mknod d14/d54/de3/c111 0 2024-08-31T05:21:42.315 INFO:tasks.workunit.client.0.smithi067.stdout:1/941: write d3/d23/f90 [414170,112923] 0 2024-08-31T05:21:42.316 INFO:tasks.workunit.client.0.smithi067.stdout:1/942: chown d3/d23/d2d/d2e/c152 28328 1 2024-08-31T05:21:42.317 INFO:tasks.workunit.client.0.smithi067.stdout:7/931: rename d14/d54/d5e/d67 to d14/d4a/d85/da4/d112 0 2024-08-31T05:21:42.324 INFO:tasks.workunit.client.0.smithi067.stdout:1/943: dwrite d3/d23/d2d/d2e/df9/d14c/f14d [0,4194304] 0 2024-08-31T05:21:42.332 INFO:tasks.workunit.client.0.smithi067.stdout:5/768: dread db/f46 [0,4194304] 0 2024-08-31T05:21:42.333 INFO:tasks.workunit.client.0.smithi067.stdout:1/944: getdents d3/d23/d2d/d2e/d34/d66/d72/d143 0 2024-08-31T05:21:42.335 INFO:tasks.workunit.client.0.smithi067.stdout:7/932: dwrite d14/d16/d5b/d64/d90/fc1 [0,4194304] 0 2024-08-31T05:21:42.336 INFO:tasks.workunit.client.0.smithi067.stdout:1/945: read d3/d23/f3c [276054,100649] 0 2024-08-31T05:21:42.338 INFO:tasks.workunit.client.0.smithi067.stdout:5/769: rmdir db/d26/d29/d31/d8d 39 2024-08-31T05:21:42.340 INFO:tasks.workunit.client.0.smithi067.stdout:7/933: symlink d14/d16/d5b/d68/d6e/dc0/l113 0 2024-08-31T05:21:42.340 INFO:tasks.workunit.client.0.smithi067.stdout:1/946: truncate d3/dfc/ff7 1669304 0 2024-08-31T05:21:42.341 INFO:tasks.workunit.client.0.smithi067.stdout:7/934: write d14/d16/d28/d2e/f5a [3884640,108065] 0 2024-08-31T05:21:42.348 INFO:tasks.workunit.client.0.smithi067.stdout:1/947: mkdir d3/dfc/df6/d101/d155 0 2024-08-31T05:21:42.352 INFO:tasks.workunit.client.0.smithi067.stdout:5/770: creat db/d26/d29/d31/fec x:0 0 0 2024-08-31T05:21:42.354 INFO:tasks.workunit.client.0.smithi067.stdout:1/948: dread d3/d23/d2d/d2e/f39 [0,4194304] 0 2024-08-31T05:21:42.354 INFO:tasks.workunit.client.0.smithi067.stdout:7/935: dwrite d14/d4a/d85/da4/d112/f6d [0,4194304] 0 2024-08-31T05:21:42.358 INFO:tasks.workunit.client.0.smithi067.stdout:7/936: truncate d14/d54/d5e/d8f/fe2 742926 0 2024-08-31T05:21:42.360 INFO:tasks.workunit.client.0.smithi067.stdout:1/949: rename d3/d8b/df4/c100 to d3/d23/db1/dd4/dfd/c156 0 2024-08-31T05:21:42.364 INFO:tasks.workunit.client.0.smithi067.stdout:7/937: unlink d14/d54/l84 0 2024-08-31T05:21:42.364 INFO:tasks.workunit.client.0.smithi067.stdout:7/938: write d14/d54/d5e/d8f/fde [82621,94366] 0 2024-08-31T05:21:42.364 INFO:tasks.workunit.client.0.smithi067.stdout:1/950: dread - d3/d23/d79/d93/dee/f106 zero size 2024-08-31T05:21:42.365 INFO:tasks.workunit.client.0.smithi067.stdout:7/939: fsync d14/d16/f6b 0 2024-08-31T05:21:42.374 INFO:tasks.workunit.client.0.smithi067.stdout:5/771: dwrite db/f49 [0,4194304] 0 2024-08-31T05:21:42.375 INFO:tasks.workunit.client.0.smithi067.stdout:7/940: dread d14/d54/f66 [0,4194304] 0 2024-08-31T05:21:42.376 INFO:tasks.workunit.client.0.smithi067.stdout:7/941: chown d14/d16/d5b/dfa 3 1 2024-08-31T05:21:42.377 INFO:tasks.workunit.client.0.smithi067.stdout:5/772: stat db/d26/l6c 0 2024-08-31T05:21:42.395 INFO:tasks.workunit.client.0.smithi067.stdout:7/942: truncate d14/d4a/d85/da4/d112/fc2 823789 0 2024-08-31T05:21:42.398 INFO:tasks.workunit.client.0.smithi067.stdout:5/773: dwrite db/d26/f62 [0,4194304] 0 2024-08-31T05:21:42.399 INFO:tasks.workunit.client.0.smithi067.stdout:5/774: fsync db/d1d/d4f/fde 0 2024-08-31T05:21:42.400 INFO:tasks.workunit.client.0.smithi067.stdout:7/943: symlink d14/d54/d91/l114 0 2024-08-31T05:21:42.401 INFO:tasks.workunit.client.0.smithi067.stdout:5/775: write db/d15/d42/fa2 [220211,92363] 0 2024-08-31T05:21:42.408 INFO:tasks.workunit.client.0.smithi067.stdout:7/944: mkdir d14/d16/d5b/d8c/d115 0 2024-08-31T05:21:42.413 INFO:tasks.workunit.client.0.smithi067.stdout:5/776: fdatasync db/d26/d29/d31/f6e 0 2024-08-31T05:21:42.414 INFO:tasks.workunit.client.0.smithi067.stdout:7/945: dwrite d14/d16/d28/f35 [0,4194304] 0 2024-08-31T05:21:42.415 INFO:tasks.workunit.client.0.smithi067.stdout:5/777: write db/d26/d29/d31/d7a/fe5 [395971,23407] 0 2024-08-31T05:21:42.419 INFO:tasks.workunit.client.0.smithi067.stdout:7/946: creat d14/d16/d5b/d8c/f116 x:0 0 0 2024-08-31T05:21:42.427 INFO:tasks.workunit.client.0.smithi067.stdout:7/947: mkdir d14/d16/d5b/d68/d87/de9/d106/df5/db0/d117 0 2024-08-31T05:21:42.430 INFO:tasks.workunit.client.0.smithi067.stdout:7/948: read d14/d16/d5b/d68/f74 [4982278,68257] 0 2024-08-31T05:21:42.431 INFO:tasks.workunit.client.0.smithi067.stdout:7/949: chown d14/d16/d5b/d64/d90/d10c 3865874 1 2024-08-31T05:21:42.432 INFO:tasks.workunit.client.0.smithi067.stdout:7/950: write d14/d54/d5e/d8f/fec [108473,63018] 0 2024-08-31T05:21:42.435 INFO:tasks.workunit.client.0.smithi067.stdout:7/951: symlink d14/d16/d5b/d68/d6e/l118 0 2024-08-31T05:21:42.437 INFO:tasks.workunit.client.0.smithi067.stdout:7/952: dread d14/d16/d5b/d8c/dc7/dcf/fe0 [0,4194304] 0 2024-08-31T05:21:42.438 INFO:tasks.workunit.client.0.smithi067.stdout:5/778: dread db/f2e [0,4194304] 0 2024-08-31T05:21:42.441 INFO:tasks.workunit.client.0.smithi067.stdout:7/953: mknod d14/d16/d5b/d68/d87/de9/d106/df5/db0/d117/c119 0 2024-08-31T05:21:42.443 INFO:tasks.workunit.client.0.smithi067.stdout:7/954: write d14/d16/d5b/d68/d87/de9/d106/df5/d8d/dae/fba [916023,94565] 0 2024-08-31T05:21:42.445 INFO:tasks.workunit.client.0.smithi067.stdout:7/955: mknod d14/d16/d28/d2e/d53/c11a 0 2024-08-31T05:21:42.450 INFO:tasks.workunit.client.0.smithi067.stdout:7/956: dwrite d14/f20 [0,4194304] 0 2024-08-31T05:21:42.453 INFO:tasks.workunit.client.0.smithi067.stdout:7/957: creat d14/d4a/d85/da4/dbf/f11b x:0 0 0 2024-08-31T05:21:42.455 INFO:tasks.workunit.client.0.smithi067.stdout:7/958: chown d14/d16/d28/d2e/c30 492910529 1 2024-08-31T05:21:42.459 INFO:tasks.workunit.client.0.smithi067.stdout:7/959: dread d14/d3e/fd1 [0,4194304] 0 2024-08-31T05:21:42.459 INFO:tasks.workunit.client.0.smithi067.stdout:7/960: fsync d14/d3e/fa9 0 2024-08-31T05:21:42.462 INFO:tasks.workunit.client.0.smithi067.stdout:7/961: mkdir d14/d16/d5b/d68/d87/d11c 0 2024-08-31T05:21:42.465 INFO:tasks.workunit.client.0.smithi067.stdout:7/962: creat d14/f11d x:0 0 0 2024-08-31T05:21:42.469 INFO:tasks.workunit.client.0.smithi067.stdout:7/963: dread d14/d54/d5e/d8f/faa [0,4194304] 0 2024-08-31T05:21:42.474 INFO:tasks.workunit.client.0.smithi067.stdout:7/964: link d14/d16/d28/d2e/c30 d14/d3e/c11e 0 2024-08-31T05:21:42.478 INFO:tasks.workunit.client.0.smithi067.stdout:7/965: write d14/d4a/f81 [180,117586] 0 2024-08-31T05:21:42.479 INFO:tasks.workunit.client.0.smithi067.stdout:7/966: fsync d14/d16/d28/f10f 0 2024-08-31T05:21:42.480 INFO:tasks.workunit.client.0.smithi067.stdout:7/967: creat d14/d16/d5b/d8c/f11f x:0 0 0 2024-08-31T05:21:42.482 INFO:tasks.workunit.client.0.smithi067.stdout:7/968: truncate d14/d54/d5e/fa6 570678 0 2024-08-31T05:21:42.484 INFO:tasks.workunit.client.0.smithi067.stdout:7/969: truncate d14/d16/d5b/d64/f8b 1837687 0 2024-08-31T05:21:42.484 INFO:tasks.workunit.client.0.smithi067.stdout:7/970: chown d14/d54/d5e/d8f/fec 11187455 1 2024-08-31T05:21:42.490 INFO:tasks.workunit.client.0.smithi067.stdout:7/971: dwrite d14/d16/d28/f10f [0,4194304] 0 2024-08-31T05:21:42.493 INFO:tasks.workunit.client.0.smithi067.stdout:7/972: symlink d14/d16/d5b/d68/d87/de9/l120 0 2024-08-31T05:21:42.497 INFO:tasks.workunit.client.0.smithi067.stdout:7/973: unlink d14/d16/d28/d2e/d53/c11a 0 2024-08-31T05:21:42.505 INFO:tasks.workunit.client.0.smithi067.stdout:7/974: creat d14/d16/d5b/f121 x:0 0 0 2024-08-31T05:21:42.508 INFO:tasks.workunit.client.0.smithi067.stdout:7/975: rmdir d14/d16/d5b/d68/d87/de9/d106/df5 39 2024-08-31T05:21:42.512 INFO:tasks.workunit.client.0.smithi067.stdout:7/976: rmdir d14/d16/d5b/d68/d87/d11c 0 2024-08-31T05:21:42.885 INFO:tasks.workunit.client.0.smithi067.stdout:9/881: sync 2024-08-31T05:21:42.889 INFO:tasks.workunit.client.0.smithi067.stdout:9/882: write dd/d63/fc9 [2756744,66372] 0 2024-08-31T05:21:42.910 INFO:tasks.workunit.client.0.smithi067.stdout:9/883: dwrite dd/df/d5b/d5d/f89 [0,4194304] 0 2024-08-31T05:21:42.912 INFO:tasks.workunit.client.0.smithi067.stdout:9/884: symlink dd/df/d8e/l129 0 2024-08-31T05:21:42.915 INFO:tasks.workunit.client.0.smithi067.stdout:9/885: read - dd/d63/d72/fbd zero size 2024-08-31T05:21:42.918 INFO:tasks.workunit.client.0.smithi067.stdout:9/886: mkdir dd/d20/d12a 0 2024-08-31T05:21:42.944 INFO:tasks.workunit.client.0.smithi067.stdout:9/887: write dd/df/d5b/d5d/f10a [786960,42992] 0 2024-08-31T05:21:42.949 INFO:tasks.workunit.client.0.smithi067.stdout:9/888: dread dd/df/d25/d3b/d50/d73/fb2 [0,4194304] 0 2024-08-31T05:21:43.008 INFO:tasks.workunit.client.0.smithi067.stdout:9/889: getdents dd/df/d3c 0 2024-08-31T05:21:43.008 INFO:tasks.workunit.client.0.smithi067.stdout:9/890: creat dd/d20/d12a/f12b x:0 0 0 2024-08-31T05:21:43.008 INFO:tasks.workunit.client.0.smithi067.stdout:9/891: creat dd/df/d25/d3b/d50/d73/dff/f12c x:0 0 0 2024-08-31T05:21:43.063 INFO:tasks.workunit.client.0.smithi067.stdout:9/892: rename dd/df/d8e/fa9 to dd/df/d25/d3b/d50/f12d 0 2024-08-31T05:21:43.064 INFO:tasks.workunit.client.0.smithi067.stdout:9/893: symlink dd/da2/l12e 0 2024-08-31T05:21:43.067 INFO:tasks.workunit.client.0.smithi067.stdout:9/894: unlink dd/d4d/l58 0 2024-08-31T05:21:43.068 INFO:tasks.workunit.client.0.smithi067.stdout:9/895: write dd/d63/fc9 [1721304,69592] 0 2024-08-31T05:21:43.070 INFO:tasks.workunit.client.0.smithi067.stdout:2/993: sync 2024-08-31T05:21:43.070 INFO:tasks.workunit.client.0.smithi067.stdout:5/779: sync 2024-08-31T05:21:43.070 INFO:tasks.workunit.client.0.smithi067.stdout:7/977: sync 2024-08-31T05:21:43.070 INFO:tasks.workunit.client.0.smithi067.stdout:1/951: sync 2024-08-31T05:21:43.071 INFO:tasks.workunit.client.0.smithi067.stdout:9/896: symlink dd/df/d8e/d94/d127/l12f 0 2024-08-31T05:21:43.071 INFO:tasks.workunit.client.0.smithi067.stdout:2/994: chown db/d8c/dcd/df4/fca 300 1 2024-08-31T05:21:43.072 INFO:tasks.workunit.client.0.smithi067.stdout:5/780: chown db/l10 172204893 1 2024-08-31T05:21:43.073 INFO:tasks.workunit.client.0.smithi067.stdout:2/995: write db/d8c/dcd/feb [182319,44751] 0 2024-08-31T05:21:43.074 INFO:tasks.workunit.client.0.smithi067.stdout:7/978: stat d14/d4a/f76 0 2024-08-31T05:21:43.076 INFO:tasks.workunit.client.0.smithi067.stdout:9/897: write dd/da2/ff3 [1145779,26903] 0 2024-08-31T05:21:43.081 INFO:tasks.workunit.client.0.smithi067.stdout:5/781: dwrite db/d26/f62 [0,4194304] 0 2024-08-31T05:21:43.083 INFO:tasks.workunit.client.0.smithi067.stdout:7/979: stat d14/d16/d5b/d68/d87/de9/d106/df5/d8d/caf 0 2024-08-31T05:21:43.085 INFO:tasks.workunit.client.0.smithi067.stdout:9/898: rmdir dd/d4d 39 2024-08-31T05:21:43.091 INFO:tasks.workunit.client.0.smithi067.stdout:1/952: dread d3/d23/d2d/d2e/d34/d66/de8/f20 [0,4194304] 0 2024-08-31T05:21:43.091 INFO:tasks.workunit.client.0.smithi067.stdout:5/782: dwrite db/d26/d29/d31/fcb [0,4194304] 0 2024-08-31T05:21:43.092 INFO:tasks.workunit.client.0.smithi067.stdout:7/980: dread d14/d4a/d85/da4/d112/f6d [0,4194304] 0 2024-08-31T05:21:43.094 INFO:tasks.workunit.client.0.smithi067.stdout:9/899: creat dd/df/d5b/d5d/d7a/f130 x:0 0 0 2024-08-31T05:21:43.098 INFO:tasks.workunit.client.0.smithi067.stdout:5/783: mknod db/d26/d29/d31/d54/d8c/dd7/ced 0 2024-08-31T05:21:43.108 INFO:tasks.workunit.client.0.smithi067.stdout:7/981: dwrite f6 [4194304,4194304] 0 2024-08-31T05:21:43.108 INFO:tasks.workunit.client.0.smithi067.stdout:9/900: dwrite dd/d63/f88 [0,4194304] 0 2024-08-31T05:21:43.112 INFO:tasks.workunit.client.0.smithi067.stdout:5/784: rename db/d15/d42/d36/d73/da9/l8f to db/d26/d29/d31/d54/lee 0 2024-08-31T05:21:43.117 INFO:tasks.workunit.client.0.smithi067.stdout:7/982: fsync d14/d16/d5b/d8c/dc7/dcf/fe0 0 2024-08-31T05:21:43.129 INFO:tasks.workunit.client.0.smithi067.stdout:1/953: dread d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/fcd [0,4194304] 0 2024-08-31T05:21:43.135 INFO:tasks.workunit.client.0.smithi067.stdout:1/954: rename d3/d23/d79/laf to d3/d23/d2d/d2e/d34/d66/d72/d82/d13b/l157 0 2024-08-31T05:21:43.137 INFO:tasks.workunit.client.0.smithi067.stdout:7/983: getdents d14/d16 0 2024-08-31T05:21:43.138 INFO:tasks.workunit.client.0.smithi067.stdout:7/984: write d14/d54/de3/f10a [468234,74695] 0 2024-08-31T05:21:43.140 INFO:tasks.workunit.client.0.smithi067.stdout:7/985: write d14/d16/f2b [3007452,58547] 0 2024-08-31T05:21:43.145 INFO:tasks.workunit.client.0.smithi067.stdout:1/955: mknod d3/d23/d2d/d2e/d34/d66/de8/d50/db5/dc2/d12e/c158 0 2024-08-31T05:21:43.146 INFO:tasks.workunit.client.0.smithi067.stdout:7/986: symlink d14/d54/d91/da7/l122 0 2024-08-31T05:21:43.152 INFO:tasks.workunit.client.0.smithi067.stdout:7/987: dread d14/d16/f89 [0,4194304] 0 2024-08-31T05:21:43.159 INFO:tasks.workunit.client.0.smithi067.stdout:2/996: write db/d12/d1a/d2b/d40/d9b/da8/fea [525065,70305] 0 2024-08-31T05:21:43.160 INFO:tasks.workunit.client.0.smithi067.stdout:2/997: readlink db/dd/l8a 0 2024-08-31T05:21:43.162 INFO:tasks.workunit.client.0.smithi067.stdout:2/998: write db/d12/d1a/d2b/d3d/d4f/fcb [5773792,41975] 0 2024-08-31T05:21:43.163 INFO:tasks.workunit.client.0.smithi067.stdout:2/999: write db/d12/d1a/d2b/d3d/d69/f26 [326657,130121] 0 2024-08-31T05:21:43.167 INFO:tasks.workunit.client.0.smithi067.stdout:9/901: write dd/d20/fd8 [706344,39061] 0 2024-08-31T05:21:43.170 INFO:tasks.workunit.client.0.smithi067.stdout:9/902: mkdir dd/df/d25/d3b/d50/d73/d131 0 2024-08-31T05:21:43.171 INFO:tasks.workunit.client.0.smithi067.stdout:9/903: chown dd/d20/c4c 3489 1 2024-08-31T05:21:43.174 INFO:tasks.workunit.client.0.smithi067.stdout:5/785: dwrite db/d15/d42/d36/d73/daf/fbb [0,4194304] 0 2024-08-31T05:21:43.180 INFO:tasks.workunit.client.0.smithi067.stdout:5/786: dread db/d15/d59/f84 [0,4194304] 0 2024-08-31T05:21:43.182 INFO:tasks.workunit.client.0.smithi067.stdout:5/787: unlink db/d15/d59/dad/dcf/cd9 0 2024-08-31T05:21:43.188 INFO:tasks.workunit.client.0.smithi067.stdout:1/956: dwrite d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/fc9 [0,4194304] 0 2024-08-31T05:21:43.195 INFO:tasks.workunit.client.0.smithi067.stdout:1/957: getdents d3/dfc 0 2024-08-31T05:21:43.195 INFO:tasks.workunit.client.0.smithi067.stdout:1/958: chown d3/d23/d2d/f137 3811 1 2024-08-31T05:21:43.198 INFO:tasks.workunit.client.0.smithi067.stdout:1/959: chown d3/d23/le7 88218 1 2024-08-31T05:21:43.199 INFO:tasks.workunit.client.0.smithi067.stdout:1/960: chown d3/d23/d2d/d2e/d34/c69 19954651 1 2024-08-31T05:21:43.201 INFO:tasks.workunit.client.0.smithi067.stdout:1/961: truncate d3/d23/d2d/d2e/d34/da3/f148 642812 0 2024-08-31T05:21:43.212 INFO:tasks.workunit.client.0.smithi067.stdout:1/962: getdents d3/d23/d2d/d2e/d34/d66/d94 0 2024-08-31T05:21:43.218 INFO:tasks.workunit.client.0.smithi067.stdout:1/963: creat d3/d23/d2d/d2e/d34/f159 x:0 0 0 2024-08-31T05:21:43.221 INFO:tasks.workunit.client.0.smithi067.stdout:1/964: read d3/d8b/df4/f102 [2767602,80724] 0 2024-08-31T05:21:43.223 INFO:tasks.workunit.client.0.smithi067.stdout:1/965: fdatasync d3/d23/d5d/f10a 0 2024-08-31T05:21:43.226 INFO:tasks.workunit.client.0.smithi067.stdout:1/966: symlink d3/l15a 0 2024-08-31T05:21:43.227 INFO:tasks.workunit.client.0.smithi067.stdout:1/967: stat d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/d150 0 2024-08-31T05:21:43.232 INFO:tasks.workunit.client.0.smithi067.stdout:1/968: rename d3/d23/db1/db6/dc4 to d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/d15b 0 2024-08-31T05:21:43.235 INFO:tasks.workunit.client.0.smithi067.stdout:1/969: getdents d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/d150 0 2024-08-31T05:21:43.236 INFO:tasks.workunit.client.0.smithi067.stdout:1/970: write d3/d23/d2d/f137 [986787,39401] 0 2024-08-31T05:21:43.238 INFO:tasks.workunit.client.0.smithi067.stdout:1/971: chown d3/d23/d2d/d2e/d34/d66/d9a/caa 57 1 2024-08-31T05:21:43.254 INFO:tasks.workunit.client.0.smithi067.stdout:1/972: dwrite d3/d8b/df4/f102 [4194304,4194304] 0 2024-08-31T05:21:43.259 INFO:tasks.workunit.client.0.smithi067.stdout:1/973: fdatasync d3/d23/d5d/f154 0 2024-08-31T05:21:43.261 INFO:tasks.workunit.client.0.smithi067.stdout:1/974: read d3/d36/f47 [174317,93338] 0 2024-08-31T05:21:43.263 INFO:tasks.workunit.client.0.smithi067.stdout:1/975: mknod d3/d23/db1/dd4/de4/c15c 0 2024-08-31T05:21:43.271 INFO:tasks.workunit.client.0.smithi067.stdout:1/976: dwrite d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/d15b/fe3 [4194304,4194304] 0 2024-08-31T05:21:43.278 INFO:tasks.workunit.client.0.smithi067.stdout:1/977: symlink d3/d23/d2d/d2e/d34/l15d 0 2024-08-31T05:21:43.281 INFO:tasks.workunit.client.0.smithi067.stdout:1/978: rename d3/d23/d2d/d2e/d34/d66/de8/d50/db5/dc2/d12e to d3/d8b/d15e 0 2024-08-31T05:21:43.281 INFO:tasks.workunit.client.0.smithi067.stdout:1/979: chown d3/dd3 0 1 2024-08-31T05:21:43.283 INFO:tasks.workunit.client.0.smithi067.stdout:1/980: creat d3/d23/d2d/d2e/d34/d66/d9a/f15f x:0 0 0 2024-08-31T05:21:43.284 INFO:tasks.workunit.client.0.smithi067.stdout:1/981: readlink d3/l6a 0 2024-08-31T05:21:43.286 INFO:tasks.workunit.client.0.smithi067.stdout:1/982: mkdir d3/d23/d2d/d2e/d34/d66/d72/d143/d160 0 2024-08-31T05:21:43.288 INFO:tasks.workunit.client.0.smithi067.stdout:1/983: creat d3/d23/d2d/d2e/d34/d66/d72/d10b/f161 x:0 0 0 2024-08-31T05:21:43.289 INFO:tasks.workunit.client.0.smithi067.stdout:1/984: write d3/d23/d2d/d2e/d34/d66/d9a/f15f [39818,46994] 0 2024-08-31T05:21:43.290 INFO:tasks.workunit.client.0.smithi067.stdout:1/985: dread - d3/d23/d2d/d2e/d34/f159 zero size 2024-08-31T05:21:43.293 INFO:tasks.workunit.client.0.smithi067.stdout:1/986: creat d3/d23/d2d/d2e/df9/d14c/f162 x:0 0 0 2024-08-31T05:21:43.294 INFO:tasks.workunit.client.0.smithi067.stdout:1/987: write d3/d23/d2d/d2e/d34/d66/d72/f77 [3780029,61249] 0 2024-08-31T05:21:43.301 INFO:tasks.workunit.client.0.smithi067.stdout:1/988: dwrite d3/d23/d2d/d2e/f39 [0,4194304] 0 2024-08-31T05:21:43.302 INFO:tasks.workunit.client.0.smithi067.stdout:1/989: stat d3/d23/d2d/d2e/d34/da3/lc0 0 2024-08-31T05:21:43.305 INFO:tasks.workunit.client.0.smithi067.stdout:1/990: mknod d3/d23/d2d/d2e/d34/d66/d72/d82/dc5/dce/d150/c163 0 2024-08-31T05:21:43.306 INFO:tasks.workunit.client.0.smithi067.stdout:1/991: dread - d3/dd3/f10e zero size 2024-08-31T05:21:43.306 INFO:tasks.workunit.client.0.smithi067.stdout:1/992: chown d3/d23/fb0 15121546 1 2024-08-31T05:21:43.324 INFO:tasks.workunit.client.0.smithi067.stdout:1/993: dread d3/d23/d2d/d2e/d34/d66/de8/f2c [0,4194304] 0 2024-08-31T05:21:43.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:42 smithi067 ceph-mon[17432]: pgmap v42: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 40 MiB/s rd, 111 MiB/s wr, 297 op/s 2024-08-31T05:21:43.326 INFO:tasks.workunit.client.0.smithi067.stdout:1/994: chown d3/d36/f153 356 1 2024-08-31T05:21:43.328 INFO:tasks.workunit.client.0.smithi067.stdout:1/995: truncate d3/d23/d2d/d2e/d34/d66/de8/d50/f11b 4551763 0 2024-08-31T05:21:43.331 INFO:tasks.workunit.client.0.smithi067.stdout:1/996: creat d3/d23/d2d/d2e/d34/d66/d72/d143/d160/f164 x:0 0 0 2024-08-31T05:21:43.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:42 smithi073 ceph-mon[24726]: pgmap v42: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 40 MiB/s rd, 111 MiB/s wr, 297 op/s 2024-08-31T05:21:43.846 INFO:tasks.workunit.client.0.smithi067.stdout:7/988: sync 2024-08-31T05:21:43.854 INFO:tasks.workunit.client.0.smithi067.stdout:7/989: dread d14/d16/d5b/d64/f8b [0,4194304] 0 2024-08-31T05:21:43.856 INFO:tasks.workunit.client.0.smithi067.stdout:7/990: symlink d14/d4a/d85/da4/d112/l123 0 2024-08-31T05:21:43.857 INFO:tasks.workunit.client.0.smithi067.stdout:7/991: write d14/f11d [163792,35138] 0 2024-08-31T05:21:43.864 INFO:tasks.workunit.client.0.smithi067.stdout:7/992: dwrite d14/d16/d28/f10f [0,4194304] 0 2024-08-31T05:21:43.867 INFO:tasks.workunit.client.0.smithi067.stdout:7/993: fdatasync d14/d16/d5b/d64/f8b 0 2024-08-31T05:21:43.868 INFO:tasks.workunit.client.0.smithi067.stdout:7/994: write f6 [4992206,125588] 0 2024-08-31T05:21:43.874 INFO:tasks.workunit.client.0.smithi067.stdout:7/995: creat d14/d16/d28/d78/f124 x:0 0 0 2024-08-31T05:21:43.875 INFO:tasks.workunit.client.0.smithi067.stdout:7/996: chown d14/d16/ld5 14560 1 2024-08-31T05:21:43.877 INFO:tasks.workunit.client.0.smithi067.stdout:7/997: rmdir d14/d54/d5e/d8f 39 2024-08-31T05:21:43.894 INFO:tasks.workunit.client.0.smithi067.stdout:7/998: dread d14/d16/f6b [0,4194304] 0 2024-08-31T05:21:43.895 INFO:tasks.workunit.client.0.smithi067.stdout:7/999: fsync d14/d16/d5b/dfa/f104 0 2024-08-31T05:21:43.921 INFO:tasks.workunit.client.0.smithi067.stdout:5/788: sync 2024-08-31T05:21:43.921 INFO:tasks.workunit.client.0.smithi067.stdout:1/997: sync 2024-08-31T05:21:43.921 INFO:tasks.workunit.client.0.smithi067.stdout:9/904: sync 2024-08-31T05:21:43.925 INFO:tasks.workunit.client.0.smithi067.stdout:1/998: dread - d3/f103 zero size 2024-08-31T05:21:43.929 INFO:tasks.workunit.client.0.smithi067.stdout:5/789: symlink db/d26/d29/d31/d8d/d9f/lef 0 2024-08-31T05:21:43.933 INFO:tasks.workunit.client.0.smithi067.stdout:5/790: creat db/d26/d29/d31/d54/d8c/ff0 x:0 0 0 2024-08-31T05:21:43.935 INFO:tasks.workunit.client.0.smithi067.stdout:9/905: getdents dd/df/d25/d3b/d120 0 2024-08-31T05:21:43.936 INFO:tasks.workunit.client.0.smithi067.stdout:1/999: creat d3/d23/d2d/d2e/d34/d66/f165 x:0 0 0 2024-08-31T05:21:43.936 INFO:tasks.workunit.client.0.smithi067.stdout:9/906: dread - dd/df/d5b/d5d/d7a/f130 zero size 2024-08-31T05:21:43.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/791: truncate db/f1e 6878931 0 2024-08-31T05:21:43.939 INFO:tasks.workunit.client.0.smithi067.stdout:5/792: stat db/d1d/d3a 0 2024-08-31T05:21:43.940 INFO:tasks.workunit.client.0.smithi067.stdout:9/907: write dd/da2/dd0/f124 [807188,87970] 0 2024-08-31T05:21:43.942 INFO:tasks.workunit.client.0.smithi067.stdout:5/793: unlink db/d1d/c6b 0 2024-08-31T05:21:43.946 INFO:tasks.workunit.client.0.smithi067.stdout:5/794: fsync db/d26/d29/d31/d54/d66/d96/fe0 0 2024-08-31T05:21:43.955 INFO:tasks.workunit.client.0.smithi067.stdout:5/795: rmdir db/d15/d42/d36/d73/d77 39 2024-08-31T05:21:43.960 INFO:tasks.workunit.client.0.smithi067.stdout:5/796: mknod db/d15/d42/d36/d73/daf/cf1 0 2024-08-31T05:21:43.962 INFO:tasks.workunit.client.0.smithi067.stdout:9/908: dread dd/df/d25/d3b/d50/d73/f86 [0,4194304] 0 2024-08-31T05:21:43.967 INFO:tasks.workunit.client.0.smithi067.stdout:5/797: dwrite db/d15/fc1 [0,4194304] 0 2024-08-31T05:21:43.968 INFO:tasks.workunit.client.0.smithi067.stdout:5/798: readlink db/d26/d60/l7f 0 2024-08-31T05:21:43.972 INFO:tasks.workunit.client.0.smithi067.stdout:5/799: truncate db/d26/d29/d31/d54/d8c/f9e 1876030 0 2024-08-31T05:21:43.975 INFO:tasks.workunit.client.0.smithi067.stdout:5/800: dread db/f19 [0,4194304] 0 2024-08-31T05:21:43.982 INFO:tasks.workunit.client.0.smithi067.stdout:9/909: dread dd/df/d25/d3b/d50/d73/ff4 [0,4194304] 0 2024-08-31T05:21:43.985 INFO:tasks.workunit.client.0.smithi067.stdout:5/801: dwrite db/d15/d42/d36/d73/d77/fea [0,4194304] 0 2024-08-31T05:21:43.987 INFO:tasks.workunit.client.0.smithi067.stdout:9/910: mkdir dd/d63/da3/d132 0 2024-08-31T05:21:43.988 INFO:tasks.workunit.client.0.smithi067.stdout:5/802: read db/d1d/d4f/f72 [2819398,71102] 0 2024-08-31T05:21:43.992 INFO:tasks.workunit.client.0.smithi067.stdout:5/803: symlink db/d26/d29/d31/d7a/lf2 0 2024-08-31T05:21:43.993 INFO:tasks.workunit.client.0.smithi067.stdout:9/911: fsync dd/d4d/dca/feb 0 2024-08-31T05:21:43.995 INFO:tasks.workunit.client.0.smithi067.stdout:9/912: truncate dd/df/d8e/f10d 11522 0 2024-08-31T05:21:43.997 INFO:tasks.workunit.client.0.smithi067.stdout:5/804: chown db/d26/d4c/db5/cb6 11 1 2024-08-31T05:21:44.004 INFO:tasks.workunit.client.0.smithi067.stdout:5/805: rename db/d1d/d4f/cdf to db/d26/d29/d81/cf3 0 2024-08-31T05:21:44.005 INFO:tasks.workunit.client.0.smithi067.stdout:9/913: symlink dd/d63/l133 0 2024-08-31T05:21:44.006 INFO:tasks.workunit.client.0.smithi067.stdout:9/914: chown dd/df/d8e/d94 24293315 1 2024-08-31T05:21:44.008 INFO:tasks.workunit.client.0.smithi067.stdout:9/915: symlink dd/df/d3c/l134 0 2024-08-31T05:21:44.009 INFO:tasks.workunit.client.0.smithi067.stdout:9/916: dread - dd/d20/d12a/f12b zero size 2024-08-31T05:21:44.011 INFO:tasks.workunit.client.0.smithi067.stdout:5/806: dwrite db/d26/d4c/db5/fda [0,4194304] 0 2024-08-31T05:21:44.013 INFO:tasks.workunit.client.0.smithi067.stdout:9/917: mknod dd/da2/c135 0 2024-08-31T05:21:44.015 INFO:tasks.workunit.client.0.smithi067.stdout:5/807: fdatasync db/d26/d29/d31/d54/d66/d96/fe0 0 2024-08-31T05:21:44.021 INFO:tasks.workunit.client.0.smithi067.stdout:9/918: dwrite dd/da2/ff3 [0,4194304] 0 2024-08-31T05:21:44.023 INFO:tasks.workunit.client.0.smithi067.stdout:5/808: unlink db/d15/d59/dad/dcf/ddd/f82 0 2024-08-31T05:21:44.032 INFO:tasks.workunit.client.0.smithi067.stdout:9/919: creat dd/d63/d126/d128/f136 x:0 0 0 2024-08-31T05:21:44.038 INFO:tasks.workunit.client.0.smithi067.stdout:5/809: getdents db/d26/d29 0 2024-08-31T05:21:44.039 INFO:tasks.workunit.client.0.smithi067.stdout:9/920: creat dd/df/d25/d3b/d50/d73/d131/f137 x:0 0 0 2024-08-31T05:21:44.089 INFO:tasks.workunit.client.0.smithi067.stdout:9/921: truncate dd/df/f27 2514198 0 2024-08-31T05:21:44.090 INFO:tasks.workunit.client.0.smithi067.stdout:5/810: creat db/d1d/d4f/dd0/ff4 x:0 0 0 2024-08-31T05:21:44.092 INFO:tasks.workunit.client.0.smithi067.stdout:5/811: fdatasync db/d1d/f9d 0 2024-08-31T05:21:44.095 INFO:tasks.workunit.client.0.smithi067.stdout:5/812: read db/d1d/f2d [868659,43197] 0 2024-08-31T05:21:44.096 INFO:tasks.workunit.client.0.smithi067.stdout:5/813: truncate db/f19 5018917 0 2024-08-31T05:21:44.097 INFO:tasks.workunit.client.0.smithi067.stdout:5/814: read db/d26/d29/f57 [253003,16067] 0 2024-08-31T05:21:44.133 INFO:tasks.workunit.client.0.smithi067.stdout:9/922: dwrite dd/d63/da3/fdd [0,4194304] 0 2024-08-31T05:21:44.138 INFO:tasks.workunit.client.0.smithi067.stdout:9/923: dread dd/df/d25/d3b/f52 [0,4194304] 0 2024-08-31T05:21:44.141 INFO:tasks.workunit.client.0.smithi067.stdout:9/924: creat dd/df/d25/d3b/d120/d121/f138 x:0 0 0 2024-08-31T05:21:44.157 INFO:tasks.workunit.client.0.smithi067.stdout:9/925: truncate dd/df/f69 544421 0 2024-08-31T05:21:44.159 INFO:tasks.workunit.client.0.smithi067.stdout:9/926: symlink dd/df/d25/d59/l139 0 2024-08-31T05:21:44.167 INFO:tasks.workunit.client.0.smithi067.stdout:9/927: write dd/df/f27 [2663565,851] 0 2024-08-31T05:21:44.170 INFO:tasks.workunit.client.0.smithi067.stdout:9/928: dread - dd/df/d3c/dbe/fda zero size 2024-08-31T05:21:44.172 INFO:tasks.workunit.client.0.smithi067.stdout:9/929: truncate dd/df/d25/d3b/d50/d73/dff/f12c 127283 0 2024-08-31T05:21:44.172 INFO:tasks.workunit.client.0.smithi067.stdout:9/930: chown dd/df/d5b/l92 919716717 1 2024-08-31T05:21:44.184 INFO:tasks.workunit.client.0.smithi067.stdout:9/931: dwrite dd/df/d25/d3b/f52 [0,4194304] 0 2024-08-31T05:21:44.191 INFO:tasks.workunit.client.0.smithi067.stdout:9/932: mknod dd/df/d25/d3b/c13a 0 2024-08-31T05:21:44.211 INFO:tasks.workunit.client.0.smithi067.stdout:9/933: dread dd/df/d3c/dbe/dd4/de0/f10f [0,4194304] 0 2024-08-31T05:21:44.218 INFO:tasks.workunit.client.0.smithi067.stdout:9/934: write dd/df/d5b/f11d [872593,27942] 0 2024-08-31T05:21:44.223 INFO:tasks.workunit.client.0.smithi067.stdout:9/935: dread dd/df/d25/f109 [0,4194304] 0 2024-08-31T05:21:44.235 INFO:tasks.workunit.client.0.smithi067.stdout:9/936: dwrite dd/df/d25/d3b/d50/f65 [0,4194304] 0 2024-08-31T05:21:44.249 INFO:tasks.workunit.client.0.smithi067.stdout:9/937: dwrite dd/df/d25/d3b/d50/d73/f86 [4194304,4194304] 0 2024-08-31T05:21:44.253 INFO:tasks.workunit.client.0.smithi067.stdout:9/938: rename dd/df/d25/d3b/d50/d73/d131 to dd/d63/da3/d13b 0 2024-08-31T05:21:44.849 INFO:tasks.workunit.client.0.smithi067.stdout:5/815: sync 2024-08-31T05:21:44.850 INFO:tasks.workunit.client.0.smithi067.stdout:9/939: sync 2024-08-31T05:21:44.860 INFO:tasks.workunit.client.0.smithi067.stdout:5/816: dread - db/d26/d29/d81/fc6 zero size 2024-08-31T05:21:44.862 INFO:tasks.workunit.client.0.smithi067.stdout:9/940: mkdir dd/df/d8e/d13c 0 2024-08-31T05:21:44.863 INFO:tasks.workunit.client.0.smithi067.stdout:5/817: mknod db/d26/d29/d31/d54/cf5 0 2024-08-31T05:21:44.868 INFO:tasks.workunit.client.0.smithi067.stdout:9/941: rename dd/df/c67 to dd/df/d25/d3b/c13d 0 2024-08-31T05:21:44.869 INFO:tasks.workunit.client.0.smithi067.stdout:5/818: creat db/d15/d42/d36/d73/ff6 x:0 0 0 2024-08-31T05:21:44.883 INFO:tasks.workunit.client.0.smithi067.stdout:5/819: write db/d1d/f9d [589272,14958] 0 2024-08-31T05:21:44.900 INFO:tasks.workunit.client.0.smithi067.stdout:5/820: dwrite db/f46 [0,4194304] 0 2024-08-31T05:21:44.903 INFO:tasks.workunit.client.0.smithi067.stdout:5/821: creat db/d15/d42/d36/d73/da9/ff7 x:0 0 0 2024-08-31T05:21:44.906 INFO:tasks.workunit.client.0.smithi067.stdout:5/822: symlink db/d26/d29/d31/d8d/d9f/lf8 0 2024-08-31T05:21:44.948 INFO:tasks.workunit.client.0.smithi067.stdout:5/823: dwrite db/d26/d29/d31/f97 [0,4194304] 0 2024-08-31T05:21:44.955 INFO:tasks.workunit.client.0.smithi067.stdout:5/824: dwrite db/d1d/d4f/fde [0,4194304] 0 2024-08-31T05:21:44.961 INFO:tasks.workunit.client.0.smithi067.stdout:5/825: dread - db/d26/d29/d31/d54/d8c/fc3 zero size 2024-08-31T05:21:44.968 INFO:tasks.workunit.client.0.smithi067.stdout:5/826: symlink db/d1d/d3a/d7c/lf9 0 2024-08-31T05:21:44.972 INFO:tasks.workunit.client.0.smithi067.stdout:5/827: fsync db/d15/d42/f44 0 2024-08-31T05:21:44.992 INFO:tasks.workunit.client.0.smithi067.stdout:5/828: write db/d26/d29/f38 [7712947,77523] 0 2024-08-31T05:21:44.995 INFO:tasks.workunit.client.0.smithi067.stdout:5/829: mknod db/d15/d59/dad/dcf/cfa 0 2024-08-31T05:21:45.017 INFO:tasks.workunit.client.0.smithi067.stdout:5/830: dwrite db/d26/f74 [0,4194304] 0 2024-08-31T05:21:45.020 INFO:tasks.workunit.client.0.smithi067.stdout:5/831: mknod db/d15/d42/d36/cfb 0 2024-08-31T05:21:45.024 INFO:tasks.workunit.client.0.smithi067.stdout:5/832: creat db/d15/d59/dad/ffc x:0 0 0 2024-08-31T05:21:45.028 INFO:tasks.workunit.client.0.smithi067.stdout:5/833: read db/d15/f12 [6752040,108911] 0 2024-08-31T05:21:45.033 INFO:tasks.workunit.client.0.smithi067.stdout:5/834: mknod db/d26/d29/cfd 0 2024-08-31T05:21:45.034 INFO:tasks.workunit.client.0.smithi067.stdout:5/835: stat db/d15/d42/d36/d73/d77/f94 0 2024-08-31T05:21:45.037 INFO:tasks.workunit.client.0.smithi067.stdout:5/836: symlink db/d1d/d4f/lfe 0 2024-08-31T05:21:45.046 INFO:tasks.workunit.client.0.smithi067.stdout:9/942: sync 2024-08-31T05:21:45.053 INFO:tasks.workunit.client.0.smithi067.stdout:5/837: write db/d26/d60/da6/fb4 [2429332,17953] 0 2024-08-31T05:21:45.063 INFO:tasks.workunit.client.0.smithi067.stdout:5/838: fdatasync db/d1d/d3a/f4a 0 2024-08-31T05:21:45.067 INFO:tasks.workunit.client.0.smithi067.stdout:5/839: truncate db/d26/d29/d31/d54/d8c/fc3 486618 0 2024-08-31T05:21:45.067 INFO:tasks.workunit.client.0.smithi067.stdout:5/840: write db/d1d/f9d [1210322,2032] 0 2024-08-31T05:21:45.071 INFO:tasks.workunit.client.0.smithi067.stdout:5/841: truncate db/d26/d29/d31/d54/d66/fe9 1988270 0 2024-08-31T05:21:45.077 INFO:tasks.workunit.client.0.smithi067.stdout:9/943: write dd/df/f54 [1290485,29018] 0 2024-08-31T05:21:45.080 INFO:tasks.workunit.client.0.smithi067.stdout:9/944: mkdir dd/d4d/d13e 0 2024-08-31T05:21:45.081 INFO:tasks.workunit.client.0.smithi067.stdout:9/945: readlink dd/d20/lba 0 2024-08-31T05:21:45.081 INFO:tasks.workunit.client.0.smithi067.stdout:9/946: stat dd/d63/d72/c118 0 2024-08-31T05:21:45.084 INFO:tasks.workunit.client.0.smithi067.stdout:9/947: creat dd/d63/f13f x:0 0 0 2024-08-31T05:21:45.085 INFO:tasks.workunit.client.0.smithi067.stdout:5/842: dread db/d15/d42/fa2 [0,4194304] 0 2024-08-31T05:21:45.091 INFO:tasks.workunit.client.0.smithi067.stdout:5/843: mkdir db/dff 0 2024-08-31T05:21:45.097 INFO:tasks.workunit.client.0.smithi067.stdout:5/844: chown db/d15/d42/d36/d73/f83 0 1 2024-08-31T05:21:45.107 INFO:tasks.workunit.client.0.smithi067.stdout:9/948: dwrite dd/df/d25/d59/f81 [0,4194304] 0 2024-08-31T05:21:45.112 INFO:tasks.workunit.client.0.smithi067.stdout:9/949: creat dd/df/d25/d3b/d120/f140 x:0 0 0 2024-08-31T05:21:45.112 INFO:tasks.workunit.client.0.smithi067.stdout:9/950: write dd/d63/f13f [336795,4464] 0 2024-08-31T05:21:45.113 INFO:tasks.workunit.client.0.smithi067.stdout:5/845: write db/d1d/d3a/f4a [352771,50870] 0 2024-08-31T05:21:45.118 INFO:tasks.workunit.client.0.smithi067.stdout:9/951: mknod dd/df/d25/d3b/d120/d121/c141 0 2024-08-31T05:21:45.131 INFO:tasks.workunit.client.0.smithi067.stdout:5/846: dwrite db/d15/f80 [0,4194304] 0 2024-08-31T05:21:45.133 INFO:tasks.workunit.client.0.smithi067.stdout:5/847: chown db/d26/d29/d31/f6e 95241 1 2024-08-31T05:21:45.135 INFO:tasks.workunit.client.0.smithi067.stdout:9/952: dread dd/df/d25/d59/f9d [0,4194304] 0 2024-08-31T05:21:45.136 INFO:tasks.workunit.client.0.smithi067.stdout:5/848: mknod db/d26/d29/d31/d54/d8c/dd7/c100 0 2024-08-31T05:21:45.136 INFO:tasks.workunit.client.0.smithi067.stdout:9/953: readlink dd/df/l18 0 2024-08-31T05:21:45.138 INFO:tasks.workunit.client.0.smithi067.stdout:9/954: write dd/df/f12 [1950343,117308] 0 2024-08-31T05:21:45.142 INFO:tasks.workunit.client.0.smithi067.stdout:5/849: dread db/f2e [0,4194304] 0 2024-08-31T05:21:45.142 INFO:tasks.workunit.client.0.smithi067.stdout:9/955: mkdir dd/df/d3c/dbe/dd4/de0/d142 0 2024-08-31T05:21:45.145 INFO:tasks.workunit.client.0.smithi067.stdout:9/956: symlink dd/df/d25/d3b/d120/d121/l143 0 2024-08-31T05:21:45.148 INFO:tasks.workunit.client.0.smithi067.stdout:9/957: truncate dd/da2/fc2 352155 0 2024-08-31T05:21:45.149 INFO:tasks.workunit.client.0.smithi067.stdout:5/850: creat db/d26/f101 x:0 0 0 2024-08-31T05:21:45.159 INFO:tasks.workunit.client.0.smithi067.stdout:5/851: unlink db/f25 0 2024-08-31T05:21:45.166 INFO:tasks.workunit.client.0.smithi067.stdout:5/852: symlink db/d26/d29/d31/d54/d66/l102 0 2024-08-31T05:21:45.168 INFO:tasks.workunit.client.0.smithi067.stdout:5/853: symlink db/d26/d4c/db5/l103 0 2024-08-31T05:21:45.172 INFO:tasks.workunit.client.0.smithi067.stdout:5/854: getdents db/d58 0 2024-08-31T05:21:45.178 INFO:tasks.workunit.client.0.smithi067.stdout:9/958: dread dd/df/f1f [0,4194304] 0 2024-08-31T05:21:45.180 INFO:tasks.workunit.client.0.smithi067.stdout:9/959: creat dd/df/d25/d3b/d50/f144 x:0 0 0 2024-08-31T05:21:45.185 INFO:tasks.workunit.client.0.smithi067.stdout:9/960: getdents dd/df/d25/d3b/d50/dfd 0 2024-08-31T05:21:45.186 INFO:tasks.workunit.client.0.smithi067.stdout:5/855: dread db/f32 [0,4194304] 0 2024-08-31T05:21:45.187 INFO:tasks.workunit.client.0.smithi067.stdout:9/961: mknod dd/d63/d126/d128/c145 0 2024-08-31T05:21:45.188 INFO:tasks.workunit.client.0.smithi067.stdout:5/856: creat db/d26/d29/d81/f104 x:0 0 0 2024-08-31T05:21:45.192 INFO:tasks.workunit.client.0.smithi067.stdout:5/857: stat db/d26/d29/d81/cf3 0 2024-08-31T05:21:45.193 INFO:tasks.workunit.client.0.smithi067.stdout:5/858: truncate db/d15/d59/dad/ffc 84141 0 2024-08-31T05:21:45.197 INFO:tasks.workunit.client.0.smithi067.stdout:5/859: truncate db/d15/d42/d36/d73/f83 2053639 0 2024-08-31T05:21:45.199 INFO:tasks.workunit.client.0.smithi067.stdout:5/860: stat db/d26/d29/d31/d54/lee 0 2024-08-31T05:21:45.201 INFO:tasks.workunit.client.0.smithi067.stdout:9/962: dwrite dd/df/d25/f5f [0,4194304] 0 2024-08-31T05:21:45.202 INFO:tasks.workunit.client.0.smithi067.stdout:9/963: write dd/df/d25/d3b/d50/d73/dff/f12c [692328,81496] 0 2024-08-31T05:21:45.213 INFO:tasks.workunit.client.0.smithi067.stdout:9/964: write dd/df/d25/f6c [8448284,47359] 0 2024-08-31T05:21:45.215 INFO:tasks.workunit.client.0.smithi067.stdout:9/965: write dd/df/d5b/d5d/f10a [646460,97107] 0 2024-08-31T05:21:45.216 INFO:tasks.workunit.client.0.smithi067.stdout:5/861: write db/f32 [500091,8124] 0 2024-08-31T05:21:45.220 INFO:tasks.workunit.client.0.smithi067.stdout:5/862: mknod db/d15/d59/dad/c105 0 2024-08-31T05:21:45.222 INFO:tasks.workunit.client.0.smithi067.stdout:5/863: symlink db/d58/l106 0 2024-08-31T05:21:45.228 INFO:tasks.workunit.client.0.smithi067.stdout:5/864: dread db/d15/fc1 [0,4194304] 0 2024-08-31T05:21:45.228 INFO:tasks.workunit.client.0.smithi067.stdout:5/865: write db/d1d/d3a/f43 [2023731,46957] 0 2024-08-31T05:21:45.234 INFO:tasks.workunit.client.0.smithi067.stdout:9/966: write dd/df/d3c/dbe/fda [90268,40621] 0 2024-08-31T05:21:45.239 INFO:tasks.workunit.client.0.smithi067.stdout:9/967: dread dd/da2/fa8 [0,4194304] 0 2024-08-31T05:21:45.242 INFO:tasks.workunit.client.0.smithi067.stdout:9/968: rename dd/d63/d126/d128/c145 to dd/df/d3c/dbe/c146 0 2024-08-31T05:21:45.244 INFO:tasks.workunit.client.0.smithi067.stdout:5/866: dwrite db/d26/f45 [4194304,4194304] 0 2024-08-31T05:21:45.245 INFO:tasks.workunit.client.0.smithi067.stdout:5/867: fdatasync db/d1d/d3a/f43 0 2024-08-31T05:21:45.248 INFO:tasks.workunit.client.0.smithi067.stdout:5/868: chown db/d15/d42/d36/d73/ce3 21722 1 2024-08-31T05:21:45.249 INFO:tasks.workunit.client.0.smithi067.stdout:5/869: chown db/d15/f75 0 1 2024-08-31T05:21:45.252 INFO:tasks.workunit.client.0.smithi067.stdout:5/870: mknod db/d26/d29/d31/d54/d66/d96/c107 0 2024-08-31T05:21:45.253 INFO:tasks.workunit.client.0.smithi067.stdout:9/969: getdents dd/df/d3c/dbe 0 2024-08-31T05:21:45.254 INFO:tasks.workunit.client.0.smithi067.stdout:5/871: chown db/d26/d29/d31/d54/d66/d96/c107 107926494 1 2024-08-31T05:21:45.258 INFO:tasks.workunit.client.0.smithi067.stdout:5/872: dread db/d26/f45 [4194304,4194304] 0 2024-08-31T05:21:45.259 INFO:tasks.workunit.client.0.smithi067.stdout:5/873: chown db/d26/d29 48767713 1 2024-08-31T05:21:45.260 INFO:tasks.workunit.client.0.smithi067.stdout:5/874: chown db/d26/d4c/db5 419 1 2024-08-31T05:21:45.266 INFO:tasks.workunit.client.0.smithi067.stdout:5/875: fsync db/d26/d60/f6a 0 2024-08-31T05:21:45.268 INFO:tasks.workunit.client.0.smithi067.stdout:9/970: dwrite dd/df/d25/d3b/d50/f61 [0,4194304] 0 2024-08-31T05:21:45.272 INFO:tasks.workunit.client.0.smithi067.stdout:9/971: unlink dd/df/f12 0 2024-08-31T05:21:45.274 INFO:tasks.workunit.client.0.smithi067.stdout:5/876: rename db/d15/d42/d36/c5e to db/d1d/d3a/c108 0 2024-08-31T05:21:45.277 INFO:tasks.workunit.client.0.smithi067.stdout:9/972: rename dd/d63/d126/d128 to dd/d63/da3/d147 0 2024-08-31T05:21:45.278 INFO:tasks.workunit.client.0.smithi067.stdout:5/877: truncate db/d26/d60/fab 696311 0 2024-08-31T05:21:45.283 INFO:tasks.workunit.client.0.smithi067.stdout:5/878: link f6 db/d26/d29/d31/d54/d8c/dd7/de8/f109 0 2024-08-31T05:21:45.283 INFO:tasks.workunit.client.0.smithi067.stdout:5/879: chown db/d26/d29/d31 39 1 2024-08-31T05:21:45.286 INFO:tasks.workunit.client.0.smithi067.stdout:5/880: rmdir db/d1d/d3a 39 2024-08-31T05:21:45.292 INFO:tasks.workunit.client.0.smithi067.stdout:5/881: dwrite db/f32 [0,4194304] 0 2024-08-31T05:21:45.304 INFO:tasks.workunit.client.0.smithi067.stdout:9/973: dread dd/df/d25/ff1 [0,4194304] 0 2024-08-31T05:21:45.305 INFO:tasks.workunit.client.0.smithi067.stdout:9/974: stat dd/df/d8e/fe7 0 2024-08-31T05:21:45.306 INFO:tasks.workunit.client.0.smithi067.stdout:5/882: write db/d15/d42/d36/d73/da9/fa4 [197774,15456] 0 2024-08-31T05:21:45.311 INFO:tasks.workunit.client.0.smithi067.stdout:5/883: creat db/d1d/d3a/f10a x:0 0 0 2024-08-31T05:21:45.313 INFO:tasks.workunit.client.0.smithi067.stdout:9/975: dwrite dd/df/d5b/d5d/dea/ff5 [0,4194304] 0 2024-08-31T05:21:45.317 INFO:tasks.workunit.client.0.smithi067.stdout:5/884: rename db/d26/d4c/db5/l103 to db/d15/d42/l10b 0 2024-08-31T05:21:45.318 INFO:tasks.workunit.client.0.smithi067.stdout:5/885: chown db/d15/d42/f39 4 1 2024-08-31T05:21:45.320 INFO:tasks.workunit.client.0.smithi067.stdout:9/976: mknod dd/d4d/d13e/c148 0 2024-08-31T05:21:45.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:44 smithi067 ceph-mon[17432]: pgmap v43: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 33 MiB/s rd, 94 MiB/s wr, 258 op/s 2024-08-31T05:21:45.326 INFO:tasks.workunit.client.0.smithi067.stdout:5/886: link db/d15/d42/d36/d73/da9/ff7 db/d1d/d3a/f10c 0 2024-08-31T05:21:45.334 INFO:tasks.workunit.client.0.smithi067.stdout:9/977: write dd/da2/fa8 [424567,113097] 0 2024-08-31T05:21:45.340 INFO:tasks.workunit.client.0.smithi067.stdout:5/887: write db/d15/f12 [3210945,98579] 0 2024-08-31T05:21:45.341 INFO:tasks.workunit.client.0.smithi067.stdout:9/978: write dd/df/d25/ffc [2011656,23512] 0 2024-08-31T05:21:45.345 INFO:tasks.workunit.client.0.smithi067.stdout:5/888: dread db/d26/f62 [0,4194304] 0 2024-08-31T05:21:45.345 INFO:tasks.workunit.client.0.smithi067.stdout:9/979: unlink dd/df/d3c/dbe/c116 0 2024-08-31T05:21:45.345 INFO:tasks.workunit.client.0.smithi067.stdout:5/889: chown db/d15/cca 385 1 2024-08-31T05:21:45.368 INFO:tasks.workunit.client.0.smithi067.stdout:9/980: write dd/df/d25/d3b/d50/f12d [2510832,51675] 0 2024-08-31T05:21:45.369 INFO:tasks.workunit.client.0.smithi067.stdout:9/981: write dd/d63/da3/d13b/f137 [592410,15009] 0 2024-08-31T05:21:45.370 INFO:tasks.workunit.client.0.smithi067.stdout:9/982: stat dd/df/d25/d3b/d50/d73/dff 0 2024-08-31T05:21:45.373 INFO:tasks.workunit.client.0.smithi067.stdout:9/983: symlink dd/df/d25/d3b/d50/d73/dff/l149 0 2024-08-31T05:21:45.378 INFO:tasks.workunit.client.0.smithi067.stdout:9/984: unlink dd/df/d25/fe3 0 2024-08-31T05:21:45.378 INFO:tasks.workunit.client.0.smithi067.stdout:9/985: truncate dd/d20/fd8 1636975 0 2024-08-31T05:21:45.381 INFO:tasks.workunit.client.0.smithi067.stdout:9/986: mkdir dd/df/d14a 0 2024-08-31T05:21:45.383 INFO:tasks.workunit.client.0.smithi067.stdout:9/987: mknod dd/d4d/dca/c14b 0 2024-08-31T05:21:45.387 INFO:tasks.workunit.client.0.smithi067.stdout:9/988: rename dd/df/d25/d3b/d50/cd3 to dd/df/d25/d59/d100/c14c 0 2024-08-31T05:21:45.388 INFO:tasks.workunit.client.0.smithi067.stdout:9/989: stat dd/df/d25/d3b/d120/d121/l143 0 2024-08-31T05:21:45.395 INFO:tasks.workunit.client.0.smithi067.stdout:9/990: dwrite dd/df/d25/d3b/d120/d121/f138 [0,4194304] 0 2024-08-31T05:21:45.400 INFO:tasks.workunit.client.0.smithi067.stdout:9/991: creat dd/df/d25/d3b/d50/d73/dff/f14d x:0 0 0 2024-08-31T05:21:45.400 INFO:tasks.workunit.client.0.smithi067.stdout:9/992: readlink dd/d63/lb6 0 2024-08-31T05:21:45.428 INFO:tasks.workunit.client.0.smithi067.stdout:9/993: dwrite dd/df/d5b/f6e [4194304,4194304] 0 2024-08-31T05:21:45.436 INFO:tasks.workunit.client.0.smithi067.stdout:9/994: creat dd/df/d8e/d94/d127/f14e x:0 0 0 2024-08-31T05:21:45.443 INFO:tasks.workunit.client.0.smithi067.stdout:9/995: creat dd/df/d25/d3b/d50/d73/f14f x:0 0 0 2024-08-31T05:21:45.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:44 smithi073 ceph-mon[24726]: pgmap v43: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 33 MiB/s rd, 94 MiB/s wr, 258 op/s 2024-08-31T05:21:45.446 INFO:tasks.workunit.client.0.smithi067.stdout:9/996: symlink dd/d4d/dca/l150 0 2024-08-31T05:21:45.450 INFO:tasks.workunit.client.0.smithi067.stdout:9/997: dread dd/df/d25/d59/f9d [0,4194304] 0 2024-08-31T05:21:45.453 INFO:tasks.workunit.client.0.smithi067.stdout:9/998: creat dd/da2/dd0/f151 x:0 0 0 2024-08-31T05:21:45.468 INFO:tasks.workunit.client.0.smithi067.stdout:9/999: dwrite dd/d4d/dca/f10e [0,4194304] 0 2024-08-31T05:21:45.907 INFO:tasks.workunit.client.0.smithi067.stdout:5/890: sync 2024-08-31T05:21:45.915 INFO:tasks.workunit.client.0.smithi067.stdout:5/891: dwrite db/d1d/f9d [0,4194304] 0 2024-08-31T05:21:45.919 INFO:tasks.workunit.client.0.smithi067.stdout:5/892: symlink db/d26/d29/d31/d8d/d9f/l10d 0 2024-08-31T05:21:45.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/893: truncate db/d26/d4c/db5/fda 3994136 0 2024-08-31T05:21:45.941 INFO:tasks.workunit.client.0.smithi067.stdout:5/894: chown db/d15/d42/d36/d73/fbf 146 1 2024-08-31T05:21:45.943 INFO:tasks.workunit.client.0.smithi067.stdout:5/895: chown db/d26/d29/d31/d8d/d9f/lf8 1276875 1 2024-08-31T05:21:45.944 INFO:tasks.workunit.client.0.smithi067.stdout:5/896: fdatasync db/d26/d29/d31/f97 0 2024-08-31T05:21:45.948 INFO:tasks.workunit.client.0.smithi067.stdout:5/897: dread db/f2e [0,4194304] 0 2024-08-31T05:21:46.237 INFO:tasks.workunit.client.0.smithi067.stdout:5/898: sync 2024-08-31T05:21:46.240 INFO:tasks.workunit.client.0.smithi067.stdout:5/899: truncate db/d15/d42/d36/d73/d77/f94 1922222 0 2024-08-31T05:21:46.256 INFO:tasks.workunit.client.0.smithi067.stdout:5/900: dread db/f21 [0,4194304] 0 2024-08-31T05:21:46.258 INFO:tasks.workunit.client.0.smithi067.stdout:5/901: dread db/f21 [0,4194304] 0 2024-08-31T05:21:46.281 INFO:tasks.workunit.client.0.smithi067.stdout:5/902: dwrite db/d26/d29/d31/d54/d8c/fc3 [0,4194304] 0 2024-08-31T05:21:46.294 INFO:tasks.workunit.client.0.smithi067.stdout:5/903: dread db/d1d/d3a/f4a [0,4194304] 0 2024-08-31T05:21:46.303 INFO:tasks.workunit.client.0.smithi067.stdout:5/904: write db/d26/f9b [1050581,122609] 0 2024-08-31T05:21:46.305 INFO:tasks.workunit.client.0.smithi067.stdout:5/905: write db/d26/d29/d81/fd1 [493619,21344] 0 2024-08-31T05:21:46.306 INFO:tasks.workunit.client.0.smithi067.stdout:5/906: write db/d26/d29/f57 [412692,29069] 0 2024-08-31T05:21:46.308 INFO:tasks.workunit.client.0.smithi067.stdout:5/907: write db/d15/d59/dad/ffc [858348,52533] 0 2024-08-31T05:21:46.309 INFO:tasks.workunit.client.0.smithi067.stdout:5/908: write db/d1d/d3a/f43 [3928093,63267] 0 2024-08-31T05:21:46.318 INFO:tasks.workunit.client.0.smithi067.stdout:5/909: truncate db/d15/d59/dad/ffc 91491 0 2024-08-31T05:21:46.321 INFO:tasks.workunit.client.0.smithi067.stdout:5/910: creat db/d26/db9/f10e x:0 0 0 2024-08-31T05:21:46.323 INFO:tasks.workunit.client.0.smithi067.stdout:5/911: mkdir db/d15/d59/dad/d10f 0 2024-08-31T05:21:46.337 INFO:tasks.workunit.client.0.smithi067.stdout:5/912: dread db/d26/f45 [0,4194304] 0 2024-08-31T05:21:46.340 INFO:tasks.workunit.client.0.smithi067.stdout:5/913: rename db/d1d/f9d to db/d26/d29/d31/d54/d8c/dd7/de8/f110 0 2024-08-31T05:21:46.345 INFO:tasks.workunit.client.0.smithi067.stdout:5/914: mknod db/d26/c111 0 2024-08-31T05:21:46.345 INFO:tasks.workunit.client.0.smithi067.stdout:5/915: read db/f19 [3839129,45180] 0 2024-08-31T05:21:46.346 INFO:tasks.workunit.client.0.smithi067.stdout:5/916: readlink db/d26/d29/l47 0 2024-08-31T05:21:46.352 INFO:tasks.workunit.client.0.smithi067.stdout:5/917: dread db/d26/d29/d31/d54/d66/fa3 [0,4194304] 0 2024-08-31T05:21:46.364 INFO:tasks.workunit.client.0.smithi067.stdout:5/918: dwrite db/f32 [4194304,4194304] 0 2024-08-31T05:21:46.368 INFO:tasks.workunit.client.0.smithi067.stdout:5/919: chown db/d1d/d3a/fc2 1547 1 2024-08-31T05:21:46.371 INFO:tasks.workunit.client.0.smithi067.stdout:5/920: dread db/d26/f62 [0,4194304] 0 2024-08-31T05:21:46.375 INFO:tasks.workunit.client.0.smithi067.stdout:5/921: mknod db/d26/d60/da7/c112 0 2024-08-31T05:21:46.377 INFO:tasks.workunit.client.0.smithi067.stdout:5/922: mkdir db/d26/d29/d31/d54/d113 0 2024-08-31T05:21:46.379 INFO:tasks.workunit.client.0.smithi067.stdout:5/923: mknod db/d1d/d3a/d7c/c114 0 2024-08-31T05:21:46.380 INFO:tasks.workunit.client.0.smithi067.stdout:5/924: chown db/d26/c70 22733359 1 2024-08-31T05:21:46.384 INFO:tasks.workunit.client.0.smithi067.stdout:5/925: rmdir db/d26/dd3 0 2024-08-31T05:21:46.805 INFO:tasks.workunit.client.0.smithi067.stdout:5/926: sync 2024-08-31T05:21:46.806 INFO:tasks.workunit.client.0.smithi067.stdout:5/927: write db/d26/d4c/f65 [1130773,74716] 0 2024-08-31T05:21:46.808 INFO:tasks.workunit.client.0.smithi067.stdout:5/928: symlink db/d26/d60/l115 0 2024-08-31T05:21:46.810 INFO:tasks.workunit.client.0.smithi067.stdout:5/929: mkdir db/d26/d29/d31/d54/d66/d96/d116 0 2024-08-31T05:21:46.812 INFO:tasks.workunit.client.0.smithi067.stdout:5/930: creat db/d26/d29/d31/d54/d66/f117 x:0 0 0 2024-08-31T05:21:46.817 INFO:tasks.workunit.client.0.smithi067.stdout:5/931: dread db/f19 [0,4194304] 0 2024-08-31T05:21:46.819 INFO:tasks.workunit.client.0.smithi067.stdout:5/932: mknod db/d26/d29/d31/d54/d113/c118 0 2024-08-31T05:21:46.821 INFO:tasks.workunit.client.0.smithi067.stdout:5/933: creat db/d26/d29/d31/d7a/f119 x:0 0 0 2024-08-31T05:21:46.827 INFO:tasks.workunit.client.0.smithi067.stdout:5/934: dwrite db/d15/f18 [0,4194304] 0 2024-08-31T05:21:46.831 INFO:tasks.workunit.client.0.smithi067.stdout:5/935: symlink db/d26/d29/d31/d54/d8c/dd7/l11a 0 2024-08-31T05:21:46.833 INFO:tasks.workunit.client.0.smithi067.stdout:5/936: mknod db/d1d/d4f/c11b 0 2024-08-31T05:21:46.835 INFO:tasks.workunit.client.0.smithi067.stdout:5/937: mknod db/d26/d29/d81/c11c 0 2024-08-31T05:21:47.135 INFO:tasks.workunit.client.0.smithi067.stdout:5/938: sync 2024-08-31T05:21:47.135 INFO:tasks.workunit.client.0.smithi067.stdout:5/939: stat db/d26/d29/d31/d54/d66 0 2024-08-31T05:21:47.137 INFO:tasks.workunit.client.0.smithi067.stdout:5/940: chown db/d26/d29/d31/d54/d8c/ca5 1304615 1 2024-08-31T05:21:47.138 INFO:tasks.workunit.client.0.smithi067.stdout:5/941: chown db/d26/d29/d31/d54/d8c/dd7/l11a 28568 1 2024-08-31T05:21:47.139 INFO:tasks.workunit.client.0.smithi067.stdout:5/942: readlink db/d26/d29/d31/d8d/d9f/lf8 0 2024-08-31T05:21:47.141 INFO:tasks.workunit.client.0.smithi067.stdout:5/943: fsync db/d15/d42/f44 0 2024-08-31T05:21:47.142 INFO:tasks.workunit.client.0.smithi067.stdout:5/944: chown db/d1d/d4f/cb2 17728 1 2024-08-31T05:21:47.150 INFO:tasks.workunit.client.0.smithi067.stdout:5/945: dread db/d26/d29/d31/d54/d66/fe9 [0,4194304] 0 2024-08-31T05:21:47.151 INFO:tasks.workunit.client.0.smithi067.stdout:5/946: fdatasync db/d26/f74 0 2024-08-31T05:21:47.151 INFO:tasks.workunit.client.0.smithi067.stdout:5/947: chown db/d26/d60/l7f 14683676 1 2024-08-31T05:21:47.152 INFO:tasks.workunit.client.0.smithi067.stdout:5/948: chown db/f2e 1003550 1 2024-08-31T05:21:47.256 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:46 smithi067 ceph-mon[17432]: pgmap v44: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 46 MiB/s rd, 127 MiB/s wr, 353 op/s 2024-08-31T05:21:47.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:46 smithi073 ceph-mon[24726]: pgmap v44: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 46 MiB/s rd, 127 MiB/s wr, 353 op/s 2024-08-31T05:21:47.667 INFO:tasks.workunit.client.0.smithi067.stdout:5/949: dwrite db/f19 [0,4194304] 0 2024-08-31T05:21:47.669 INFO:tasks.workunit.client.0.smithi067.stdout:5/950: creat db/d26/d60/f11d x:0 0 0 2024-08-31T05:21:47.670 INFO:tasks.workunit.client.0.smithi067.stdout:5/951: write db/d1d/d4f/fde [4196723,32637] 0 2024-08-31T05:21:47.679 INFO:tasks.workunit.client.0.smithi067.stdout:5/952: getdents db/d58 0 2024-08-31T05:21:47.699 INFO:tasks.workunit.client.0.smithi067.stdout:5/953: dread db/d26/d29/d31/fa0 [0,4194304] 0 2024-08-31T05:21:47.706 INFO:tasks.workunit.client.0.smithi067.stdout:5/954: link db/d26/db9/f10e db/d26/d29/d31/d8d/f11e 0 2024-08-31T05:21:47.709 INFO:tasks.workunit.client.0.smithi067.stdout:5/955: read db/d15/d59/dad/ffc [9427,121079] 0 2024-08-31T05:21:47.712 INFO:tasks.workunit.client.0.smithi067.stdout:5/956: mkdir db/d26/d29/d31/d8d/d11f 0 2024-08-31T05:21:47.719 INFO:tasks.workunit.client.0.smithi067.stdout:5/957: creat db/d15/d42/d36/d73/f120 x:0 0 0 2024-08-31T05:21:47.720 INFO:tasks.workunit.client.0.smithi067.stdout:5/958: write db/d15/d42/d36/d73/ff6 [104940,79645] 0 2024-08-31T05:21:47.724 INFO:tasks.workunit.client.0.smithi067.stdout:5/959: dread db/d15/fc1 [0,4194304] 0 2024-08-31T05:21:47.724 INFO:tasks.workunit.client.0.smithi067.stdout:5/960: chown db/d26/d4c/c5a 0 1 2024-08-31T05:21:47.940 INFO:tasks.workunit.client.0.smithi067.stdout:5/961: dwrite db/d26/d29/d31/d54/d8c/f9e [0,4194304] 0 2024-08-31T05:21:47.942 INFO:tasks.workunit.client.0.smithi067.stdout:5/962: readlink db/d26/l3f 0 2024-08-31T05:21:47.950 INFO:tasks.workunit.client.0.smithi067.stdout:5/963: dwrite db/d26/d29/d31/d54/fe7 [0,4194304] 0 2024-08-31T05:21:48.166 INFO:tasks.workunit.client.0.smithi067.stdout:5/964: mkdir db/d26/d29/d31/d54/d121 0 2024-08-31T05:21:48.193 INFO:tasks.workunit.client.0.smithi067.stdout:5/965: write db/d15/f75 [696168,87508] 0 2024-08-31T05:21:48.199 INFO:tasks.workunit.client.0.smithi067.stdout:5/966: rename db/d26/d29/d31/d7a to db/d15/d59/dad/dcf/ddd/d122 0 2024-08-31T05:21:48.202 INFO:tasks.workunit.client.0.smithi067.stdout:5/967: rename db/d15/l89 to db/d26/d60/da7/l123 0 2024-08-31T05:21:48.203 INFO:tasks.workunit.client.0.smithi067.stdout:5/968: fsync db/d15/d42/d36/d73/f83 0 2024-08-31T05:21:48.205 INFO:tasks.workunit.client.0.smithi067.stdout:5/969: mknod db/d1d/c124 0 2024-08-31T05:21:48.208 INFO:tasks.workunit.client.0.smithi067.stdout:5/970: truncate db/f21 3141937 0 2024-08-31T05:21:49.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:49 smithi067 ceph-mon[17432]: pgmap v45: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 27 MiB/s rd, 77 MiB/s wr, 211 op/s 2024-08-31T05:21:49.374 INFO:tasks.workunit.client.0.smithi067.stdout:5/971: sync 2024-08-31T05:21:49.377 INFO:tasks.workunit.client.0.smithi067.stdout:5/972: symlink db/d15/d59/dad/d10f/l125 0 2024-08-31T05:21:49.380 INFO:tasks.workunit.client.0.smithi067.stdout:5/973: truncate db/f21 2613554 0 2024-08-31T05:21:49.386 INFO:tasks.workunit.client.0.smithi067.stdout:5/974: write db/d26/d29/d31/fa0 [4992072,45576] 0 2024-08-31T05:21:49.391 INFO:tasks.workunit.client.0.smithi067.stdout:5/975: write db/d15/d59/dad/dcf/ddd/fd4 [885099,66821] 0 2024-08-31T05:21:49.393 INFO:tasks.workunit.client.0.smithi067.stdout:5/976: write db/d1d/f78 [3272150,52701] 0 2024-08-31T05:21:49.398 INFO:tasks.workunit.client.0.smithi067.stdout:5/977: write db/d15/d59/dad/dcf/ddd/d122/fe5 [1229686,52141] 0 2024-08-31T05:21:49.407 INFO:tasks.workunit.client.0.smithi067.stdout:5/978: dwrite db/d26/d29/d31/d8d/f11e [0,4194304] 0 2024-08-31T05:21:49.411 INFO:tasks.workunit.client.0.smithi067.stdout:5/979: mknod db/d26/d29/d31/c126 0 2024-08-31T05:21:49.414 INFO:tasks.workunit.client.0.smithi067.stdout:5/980: rename db/d26/d29/d31/f41 to db/d26/d29/d31/d54/d8c/f127 0 2024-08-31T05:21:49.415 INFO:tasks.workunit.client.0.smithi067.stdout:5/981: chown db/d15/d42/d36/d73/da9/lc8 1722 1 2024-08-31T05:21:49.416 INFO:tasks.workunit.client.0.smithi067.stdout:5/982: dread - db/d26/d29/d81/f104 zero size 2024-08-31T05:21:49.434 INFO:tasks.workunit.client.0.smithi067.stdout:5/983: dwrite db/d1d/d3a/f10c [0,4194304] 0 2024-08-31T05:21:49.437 INFO:tasks.workunit.client.0.smithi067.stdout:5/984: rename db/d1d/d4f/da8 to db/d26/d29/d31/d54/d113/d128 0 2024-08-31T05:21:49.442 INFO:tasks.workunit.client.0.smithi067.stdout:5/985: creat db/d26/d29/d31/d54/d113/d128/f129 x:0 0 0 2024-08-31T05:21:49.445 INFO:tasks.workunit.client.0.smithi067.stdout:5/986: creat db/d1d/d3a/d7c/f12a x:0 0 0 2024-08-31T05:21:49.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:49 smithi073 ceph-mon[24726]: pgmap v45: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 27 MiB/s rd, 77 MiB/s wr, 211 op/s 2024-08-31T05:21:49.448 INFO:tasks.workunit.client.0.smithi067.stdout:5/987: dread db/d26/d29/d31/d54/d8c/dd7/de8/f110 [0,4194304] 0 2024-08-31T05:21:49.449 INFO:tasks.workunit.client.0.smithi067.stdout:5/988: chown f6 642 1 2024-08-31T05:21:49.451 INFO:tasks.workunit.client.0.smithi067.stdout:5/989: truncate db/d26/d29/d31/d54/d66/fa3 377271 0 2024-08-31T05:21:49.452 INFO:tasks.workunit.client.0.smithi067.stdout:5/990: truncate db/d15/f80 4605742 0 2024-08-31T05:21:49.455 INFO:tasks.workunit.client.0.smithi067.stdout:5/991: symlink db/d26/l12b 0 2024-08-31T05:21:49.456 INFO:tasks.workunit.client.0.smithi067.stdout:5/992: truncate db/d26/f101 410420 0 2024-08-31T05:21:49.459 INFO:tasks.workunit.client.0.smithi067.stdout:5/993: dread db/d15/d42/d36/fc4 [0,4194304] 0 2024-08-31T05:21:49.461 INFO:tasks.workunit.client.0.smithi067.stdout:5/994: creat db/d15/d42/d36/f12c x:0 0 0 2024-08-31T05:21:49.462 INFO:tasks.workunit.client.0.smithi067.stdout:5/995: rmdir db 39 2024-08-31T05:21:49.463 INFO:tasks.workunit.client.0.smithi067.stdout:5/996: chown db/d1d/d3a/d7c/cb3 123301 1 2024-08-31T05:21:49.464 INFO:tasks.workunit.client.0.smithi067.stdout:5/997: write db/d26/f62 [4905883,31391] 0 2024-08-31T05:21:49.477 INFO:tasks.workunit.client.0.smithi067.stdout:5/998: dwrite db/d26/d29/d31/d54/d8c/dd7/de8/f109 [0,4194304] 0 2024-08-31T05:21:49.481 INFO:tasks.workunit.client.0.smithi067.stdout:5/999: write db/d1d/d3a/f4a [2096936,29634] 0 2024-08-31T05:21:49.486 INFO:tasks.workunit.client.0.smithi067.stderr:+ rm -rf -- ./tmp.RVPAQwVJYp 2024-08-31T05:21:50.935 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:50 smithi067 ceph-mon[17432]: pgmap v46: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 31 MiB/s rd, 86 MiB/s wr, 269 op/s 2024-08-31T05:21:50.935 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:50 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:50.935 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:50 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:50.935 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:50 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:21:51.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:50 smithi073 ceph-mon[24726]: pgmap v46: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 31 MiB/s rd, 86 MiB/s wr, 269 op/s 2024-08-31T05:21:51.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:50 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:51.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:50 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:51.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:50 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:21:52.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:52 smithi073 ceph-mon[24726]: pgmap v47: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 17 MiB/s rd, 42 MiB/s wr, 153 op/s 2024-08-31T05:21:52.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:52 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:52.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:52 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:53.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:52 smithi067 ceph-mon[17432]: pgmap v47: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 17 MiB/s rd, 42 MiB/s wr, 153 op/s 2024-08-31T05:21:53.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:52 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:53.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:52 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:21:55.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:54 smithi073 ceph-mon[24726]: pgmap v48: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 17 MiB/s rd, 42 MiB/s wr, 153 op/s 2024-08-31T05:21:55.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:54 smithi067 ceph-mon[17432]: pgmap v48: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 17 MiB/s rd, 42 MiB/s wr, 153 op/s 2024-08-31T05:21:56.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:55 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:21:56.225 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:55 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:21:57.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:56 smithi067 ceph-mon[17432]: pgmap v49: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 17 MiB/s rd, 43 MiB/s wr, 206 op/s 2024-08-31T05:21:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:56 smithi067 ceph-mon[17432]: Standby manager daemon smithi067.hftacj restarted 2024-08-31T05:21:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:56 smithi067 ceph-mon[17432]: Standby manager daemon smithi067.hftacj started 2024-08-31T05:21:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:56 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.hftacj/crt"}]: dispatch 2024-08-31T05:21:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:56 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T05:21:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:56 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.hftacj/key"}]: dispatch 2024-08-31T05:21:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:56 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T05:21:57.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:56 smithi073 ceph-mon[24726]: pgmap v49: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 17 MiB/s rd, 43 MiB/s wr, 206 op/s 2024-08-31T05:21:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:56 smithi073 ceph-mon[24726]: Standby manager daemon smithi067.hftacj restarted 2024-08-31T05:21:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:56 smithi073 ceph-mon[24726]: Standby manager daemon smithi067.hftacj started 2024-08-31T05:21:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:56 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.hftacj/crt"}]: dispatch 2024-08-31T05:21:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:56 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T05:21:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:56 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.hftacj/key"}]: dispatch 2024-08-31T05:21:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:56 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T05:21:58.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:57 smithi067 ceph-mon[17432]: mgrmap e26: smithi073.zfoyxd(active, since 93s), standbys: smithi067.hftacj 2024-08-31T05:21:58.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:57 smithi073 ceph-mon[24726]: mgrmap e26: smithi073.zfoyxd(active, since 93s), standbys: smithi067.hftacj 2024-08-31T05:21:59.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:58 smithi073 ceph-mon[24726]: pgmap v50: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 4.4 MiB/s rd, 9.5 MiB/s wr, 110 op/s 2024-08-31T05:21:59.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:58 smithi067 ceph-mon[17432]: pgmap v50: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 4.4 MiB/s rd, 9.5 MiB/s wr, 110 op/s 2024-08-31T05:22:00.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:59 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:22:00.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:59 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:22:00.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:59 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:22:00.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:21:59 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:22:00.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:59 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:22:00.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:59 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:22:00.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:59 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:22:00.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:21:59 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:22:01.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:00 smithi067 ceph-mon[17432]: pgmap v51: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 5.1 MiB/s rd, 10 MiB/s wr, 171 op/s 2024-08-31T05:22:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:00 smithi073 ceph-mon[24726]: pgmap v51: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 5.1 MiB/s rd, 10 MiB/s wr, 171 op/s 2024-08-31T05:22:03.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:02 smithi067 ceph-mon[17432]: pgmap v52: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 113 op/s 2024-08-31T05:22:03.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:02 smithi073 ceph-mon[24726]: pgmap v52: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 113 op/s 2024-08-31T05:22:04.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:22:04.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:22:04.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:22:04.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:22:04.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:22:04.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:22:04.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mgr fail", "who": "smithi073.zfoyxd"}]: dispatch 2024-08-31T05:22:04.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mgr fail", "who": "smithi073.zfoyxd"}]: dispatch 2024-08-31T05:22:04.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: Activating manager daemon smithi067.hftacj 2024-08-31T05:22:04.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd='[{"prefix": "mgr fail", "who": "smithi073.zfoyxd"}]': finished 2024-08-31T05:22:04.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: osdmap e47: 6 total, 6 up, 6 in 2024-08-31T05:22:04.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: mgrmap e27: smithi067.hftacj(active, starting, since 0.00826885s) 2024-08-31T05:22:04.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:22:04.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:22:04.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.tskvpt"}]: dispatch 2024-08-31T05:22:04.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.beqeql"}]: dispatch 2024-08-31T05:22:04.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.kfbmeo"}]: dispatch 2024-08-31T05:22:04.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.gsnhxi"}]: dispatch 2024-08-31T05:22:04.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr metadata", "who": "smithi067.hftacj", "id": "smithi067.hftacj"}]: dispatch 2024-08-31T05:22:04.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:22:04.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:22:04.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:22:04.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:22:04.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-31T05:22:04.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:22:04.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T05:22:04.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T05:22:04.765 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T05:22:04.765 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:04 smithi067 ceph-mon[17432]: Manager daemon smithi067.hftacj is now available 2024-08-31T05:22:04.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:22:04.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:22:04.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:22:04.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:22:04.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' 2024-08-31T05:22:04.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:22:04.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24383 172.21.15.73:0/209300929' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mgr fail", "who": "smithi073.zfoyxd"}]: dispatch 2024-08-31T05:22:04.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "mgr fail", "who": "smithi073.zfoyxd"}]: dispatch 2024-08-31T05:22:04.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: Activating manager daemon smithi067.hftacj 2024-08-31T05:22:04.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24383 ' entity='mgr.smithi073.zfoyxd' cmd='[{"prefix": "mgr fail", "who": "smithi073.zfoyxd"}]': finished 2024-08-31T05:22:04.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: osdmap e47: 6 total, 6 up, 6 in 2024-08-31T05:22:04.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: mgrmap e27: smithi067.hftacj(active, starting, since 0.00826885s) 2024-08-31T05:22:04.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:22:04.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:22:04.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.tskvpt"}]: dispatch 2024-08-31T05:22:04.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.beqeql"}]: dispatch 2024-08-31T05:22:04.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.kfbmeo"}]: dispatch 2024-08-31T05:22:04.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi073.gsnhxi"}]: dispatch 2024-08-31T05:22:04.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr metadata", "who": "smithi067.hftacj", "id": "smithi067.hftacj"}]: dispatch 2024-08-31T05:22:04.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T05:22:04.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T05:22:04.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T05:22:04.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-31T05:22:04.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-31T05:22:04.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-31T05:22:04.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T05:22:04.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T05:22:04.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T05:22:04.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:04 smithi073 ceph-mon[24726]: Manager daemon smithi067.hftacj is now available 2024-08-31T05:22:05.844 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:05 smithi073 ceph-mon[24726]: mgrmap e28: smithi067.hftacj(active, since 1.01167s) 2024-08-31T05:22:05.844 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:22:05.844 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:05 smithi073 ceph-mon[24726]: pgmap v3: 65 pgs: 65 active+clean; 1.2 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail 2024-08-31T05:22:05.844 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:22:05.844 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:22:05.844 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:05 smithi073 ceph-mon[24726]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:22:05.844 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.hftacj/mirror_snapshot_schedule"}]: dispatch 2024-08-31T05:22:05.844 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.hftacj/trash_purge_schedule"}]: dispatch 2024-08-31T05:22:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:05 smithi067 ceph-mon[17432]: mgrmap e28: smithi067.hftacj(active, since 1.01167s) 2024-08-31T05:22:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:22:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:05 smithi067 ceph-mon[17432]: pgmap v3: 65 pgs: 65 active+clean; 1.2 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail 2024-08-31T05:22:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:22:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:22:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:05 smithi067 ceph-mon[17432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:22:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.hftacj/mirror_snapshot_schedule"}]: dispatch 2024-08-31T05:22:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.hftacj/trash_purge_schedule"}]: dispatch 2024-08-31T05:22:06.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:06 smithi067 ceph-mon[17432]: mgrmap e29: smithi067.hftacj(active, since 2s) 2024-08-31T05:22:06.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:06 smithi067 ceph-mon[17432]: pgmap v4: 65 pgs: 65 active+clean; 1.2 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail 2024-08-31T05:22:06.918 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:06 smithi073 ceph-mon[24726]: mgrmap e29: smithi067.hftacj(active, since 2s) 2024-08-31T05:22:06.918 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:06 smithi073 ceph-mon[24726]: pgmap v4: 65 pgs: 65 active+clean; 1.2 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail 2024-08-31T05:22:07.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.179+0000 7f9a55c45640 1 -- 172.21.15.67:0/1986254872 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a501036c0 msgr2=0x7f9a500ff770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:07.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.179+0000 7f9a55c45640 1 --2- 172.21.15.67:0/1986254872 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a501036c0 0x7f9a500ff770 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9a44009880 tx=0x7f9a4402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.179+0000 7f9a55c45640 1 -- 172.21.15.67:0/1986254872 shutdown_connections 2024-08-31T05:22:07.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.179+0000 7f9a55c45640 1 --2- 172.21.15.67:0/1986254872 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a501036c0 0x7f9a500ff770 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.179+0000 7f9a55c45640 1 --2- 172.21.15.67:0/1986254872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a50102cf0 0x7f9a501030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.179+0000 7f9a55c45640 1 -- 172.21.15.67:0/1986254872 >> 172.21.15.67:0/1986254872 conn(0x7f9a500fb500 msgr2=0x7f9a500fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:07.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.180+0000 7f9a55c45640 1 -- 172.21.15.67:0/1986254872 shutdown_connections 2024-08-31T05:22:07.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.180+0000 7f9a55c45640 1 -- 172.21.15.67:0/1986254872 wait complete. 2024-08-31T05:22:07.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.181+0000 7f9a55c45640 1 Processor -- start 2024-08-31T05:22:07.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.181+0000 7f9a55c45640 1 -- start start 2024-08-31T05:22:07.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.181+0000 7f9a55c45640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a50102cf0 0x7f9a50199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:07.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.181+0000 7f9a55c45640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a501036c0 0x7f9a501999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:07.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.181+0000 7f9a55c45640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9a50101ef0 con 0x7f9a501036c0 2024-08-31T05:22:07.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.181+0000 7f9a55c45640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9a50101d70 con 0x7f9a50102cf0 2024-08-31T05:22:07.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.181+0000 7f9a4effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a501036c0 0x7f9a501999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:07.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.181+0000 7f9a4effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a501036c0 0x7f9a501999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60428/0 (socket says 172.21.15.67:60428) 2024-08-31T05:22:07.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.181+0000 7f9a4effd640 1 -- 172.21.15.67:0/2067943561 learned_addr learned my addr 172.21.15.67:0/2067943561 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:22:07.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.181+0000 7f9a4f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a50102cf0 0x7f9a50199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:07.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.182+0000 7f9a4f7fe640 1 -- 172.21.15.67:0/2067943561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a501036c0 msgr2=0x7f9a501999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:07.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.182+0000 7f9a4f7fe640 1 --2- 172.21.15.67:0/2067943561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a501036c0 0x7f9a501999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.182+0000 7f9a4f7fe640 1 -- 172.21.15.67:0/2067943561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5019a040 con 0x7f9a50102cf0 2024-08-31T05:22:07.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.182+0000 7f9a4f7fe640 1 --2- 172.21.15.67:0/2067943561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a50102cf0 0x7f9a50199480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000e940 tx=0x7f9a4000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:07.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.182+0000 7f9a4cff9640 1 -- 172.21.15.67:0/2067943561 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a4000cac0 con 0x7f9a50102cf0 2024-08-31T05:22:07.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.182+0000 7f9a4cff9640 1 -- 172.21.15.67:0/2067943561 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a4000cc60 con 0x7f9a50102cf0 2024-08-31T05:22:07.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.182+0000 7f9a55c45640 1 -- 172.21.15.67:0/2067943561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5019ea80 con 0x7f9a50102cf0 2024-08-31T05:22:07.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.182+0000 7f9a4cff9640 1 -- 172.21.15.67:0/2067943561 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a40003e10 con 0x7f9a50102cf0 2024-08-31T05:22:07.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.182+0000 7f9a55c45640 1 -- 172.21.15.67:0/2067943561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a5019f010 con 0x7f9a50102cf0 2024-08-31T05:22:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.184+0000 7f9a55c45640 1 -- 172.21.15.67:0/2067943561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a3c0052c0 con 0x7f9a50102cf0 2024-08-31T05:22:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.184+0000 7f9a4cff9640 1 -- 172.21.15.67:0/2067943561 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 29) ==== 51427+0+0 (secure 0 0 0) 0x7f9a40010480 con 0x7f9a50102cf0 2024-08-31T05:22:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.184+0000 7f9a4cff9640 1 --2- 172.21.15.67:0/2067943561 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9a3803f270 0x7f9a38041730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.184+0000 7f9a4cff9640 1 -- 172.21.15.67:0/2067943561 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f9a40013dc0 con 0x7f9a50102cf0 2024-08-31T05:22:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.184+0000 7f9a4effd640 1 --2- 172.21.15.67:0/2067943561 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9a3803f270 0x7f9a38041730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.185+0000 7f9a4effd640 1 --2- 172.21.15.67:0/2067943561 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9a3803f270 0x7f9a38041730 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9a5019a930 tx=0x7f9a440058d0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:07.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.191+0000 7f9a4cff9640 1 -- 172.21.15.67:0/2067943561 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f9a400173d0 con 0x7f9a50102cf0 2024-08-31T05:22:07.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.528+0000 7f9a55c45640 1 -- 172.21.15.67:0/2067943561 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9a3c000bf0 con 0x7f9a3803f270 2024-08-31T05:22:07.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.530+0000 7f9a4cff9640 1 -- 172.21.15.67:0/2067943561 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f9a3c000bf0 con 0x7f9a3803f270 2024-08-31T05:22:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.533+0000 7f9a55c45640 1 -- 172.21.15.67:0/2067943561 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9a3803f270 msgr2=0x7f9a38041730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.533+0000 7f9a55c45640 1 --2- 172.21.15.67:0/2067943561 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9a3803f270 0x7f9a38041730 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9a5019a930 tx=0x7f9a440058d0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.533+0000 7f9a55c45640 1 -- 172.21.15.67:0/2067943561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a50102cf0 msgr2=0x7f9a50199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:07.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.533+0000 7f9a55c45640 1 --2- 172.21.15.67:0/2067943561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a50102cf0 0x7f9a50199480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000e940 tx=0x7f9a4000ee00 comp rx=0 tx=0).stop 2024-08-31T05:22:07.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.533+0000 7f9a55c45640 1 -- 172.21.15.67:0/2067943561 shutdown_connections 2024-08-31T05:22:07.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.533+0000 7f9a55c45640 1 --2- 172.21.15.67:0/2067943561 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9a3803f270 0x7f9a38041730 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.533+0000 7f9a55c45640 1 --2- 172.21.15.67:0/2067943561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a501036c0 0x7f9a501999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.533+0000 7f9a55c45640 1 --2- 172.21.15.67:0/2067943561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a50102cf0 0x7f9a50199480 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.533+0000 7f9a55c45640 1 -- 172.21.15.67:0/2067943561 >> 172.21.15.67:0/2067943561 conn(0x7f9a500fb500 msgr2=0x7f9a50105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:07.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.533+0000 7f9a55c45640 1 -- 172.21.15.67:0/2067943561 shutdown_connections 2024-08-31T05:22:07.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.533+0000 7f9a55c45640 1 -- 172.21.15.67:0/2067943561 wait complete. 2024-08-31T05:22:07.547 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:22:07.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.648+0000 7f0c53307640 1 -- 172.21.15.67:0/3874973535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c4c100600 msgr2=0x7f0c4c100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:07.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.648+0000 7f0c53307640 1 --2- 172.21.15.67:0/3874973535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c4c100600 0x7f0c4c100a00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009880 tx=0x7f0c4802a4b0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.648+0000 7f0c53307640 1 -- 172.21.15.67:0/3874973535 shutdown_connections 2024-08-31T05:22:07.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.648+0000 7f0c53307640 1 --2- 172.21.15.67:0/3874973535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c4c101800 0x7f0c4c101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.648+0000 7f0c53307640 1 --2- 172.21.15.67:0/3874973535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c4c100600 0x7f0c4c100a00 secure :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009880 tx=0x7f0c4802a4b0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.648+0000 7f0c53307640 1 -- 172.21.15.67:0/3874973535 >> 172.21.15.67:0/3874973535 conn(0x7f0c4c0fbdb0 msgr2=0x7f0c4c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:07.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.649+0000 7f0c53307640 1 -- 172.21.15.67:0/3874973535 shutdown_connections 2024-08-31T05:22:07.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.649+0000 7f0c53307640 1 -- 172.21.15.67:0/3874973535 wait complete. 2024-08-31T05:22:07.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.650+0000 7f0c53307640 1 Processor -- start 2024-08-31T05:22:07.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.650+0000 7f0c53307640 1 -- start start 2024-08-31T05:22:07.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.650+0000 7f0c53307640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c4c101800 0x7f0c4c199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:07.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.650+0000 7f0c53307640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c4c199b80 0x7f0c4c19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:07.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.650+0000 7f0c53307640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c10a520 con 0x7f0c4c199b80 2024-08-31T05:22:07.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.650+0000 7f0c53307640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c10a3a0 con 0x7f0c4c101800 2024-08-31T05:22:07.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.651+0000 7f0c510a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c4c101800 0x7f0c4c199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:07.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.651+0000 7f0c510a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c4c101800 0x7f0c4c199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:53978/0 (socket says 172.21.15.67:53978) 2024-08-31T05:22:07.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.651+0000 7f0c510a3640 1 -- 172.21.15.67:0/737956990 learned_addr learned my addr 172.21.15.67:0/737956990 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:22:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.651+0000 7f0c510a3640 1 -- 172.21.15.67:0/737956990 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c4c199b80 msgr2=0x7f0c4c19eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.651+0000 7f0c510a3640 1 --2- 172.21.15.67:0/737956990 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c4c199b80 0x7f0c4c19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.651+0000 7f0c510a3640 1 -- 172.21.15.67:0/737956990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4c19a0b0 con 0x7f0c4c101800 2024-08-31T05:22:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.651+0000 7f0c510a3640 1 --2- 172.21.15.67:0/737956990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c4c101800 0x7f0c4c199640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009230 tx=0x7f0c480045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.652+0000 7f0c427fc640 1 -- 172.21.15.67:0/737956990 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c48035030 con 0x7f0c4c101800 2024-08-31T05:22:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.652+0000 7f0c53307640 1 -- 172.21.15.67:0/737956990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c4c19f0c0 con 0x7f0c4c101800 2024-08-31T05:22:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.652+0000 7f0c427fc640 1 -- 172.21.15.67:0/737956990 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0c48004b80 con 0x7f0c4c101800 2024-08-31T05:22:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.652+0000 7f0c53307640 1 -- 172.21.15.67:0/737956990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c4c19f510 con 0x7f0c4c101800 2024-08-31T05:22:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.652+0000 7f0c427fc640 1 -- 172.21.15.67:0/737956990 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c48031740 con 0x7f0c4c101800 2024-08-31T05:22:07.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.653+0000 7f0c53307640 1 -- 172.21.15.67:0/737956990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c300052c0 con 0x7f0c4c101800 2024-08-31T05:22:07.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.653+0000 7f0c427fc640 1 -- 172.21.15.67:0/737956990 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 30) ==== 51483+0+0 (secure 0 0 0) 0x7f0c48003aa0 con 0x7f0c4c101800 2024-08-31T05:22:07.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.654+0000 7f0c427fc640 1 --2- 172.21.15.67:0/737956990 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0c3803f340 0x7f0c38041800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:07.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.654+0000 7f0c427fc640 1 -- 172.21.15.67:0/737956990 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f0c48075990 con 0x7f0c4c101800 2024-08-31T05:22:07.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.654+0000 7f0c508a2640 1 --2- 172.21.15.67:0/737956990 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0c3803f340 0x7f0c38041800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:07.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.655+0000 7f0c508a2640 1 --2- 172.21.15.67:0/737956990 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0c3803f340 0x7f0c38041800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c005fd0 tx=0x7f0c3c005850 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:07.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.658+0000 7f0c427fc640 1 -- 172.21.15.67:0/737956990 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f0c48041020 con 0x7f0c4c101800 2024-08-31T05:22:07.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.983+0000 7f0c53307640 1 -- 172.21.15.67:0/737956990 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0c30000bf0 con 0x7f0c3803f340 2024-08-31T05:22:07.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.984+0000 7f0c427fc640 1 -- 172.21.15.67:0/737956990 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f0c30000bf0 con 0x7f0c3803f340 2024-08-31T05:22:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.986+0000 7f0c53307640 1 -- 172.21.15.67:0/737956990 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0c3803f340 msgr2=0x7f0c38041800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.986+0000 7f0c53307640 1 --2- 172.21.15.67:0/737956990 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0c3803f340 0x7f0c38041800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c005fd0 tx=0x7f0c3c005850 comp rx=0 tx=0).stop 2024-08-31T05:22:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.986+0000 7f0c53307640 1 -- 172.21.15.67:0/737956990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c4c101800 msgr2=0x7f0c4c199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.986+0000 7f0c53307640 1 --2- 172.21.15.67:0/737956990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c4c101800 0x7f0c4c199640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009230 tx=0x7f0c480045e0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.986+0000 7f0c53307640 1 -- 172.21.15.67:0/737956990 shutdown_connections 2024-08-31T05:22:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.986+0000 7f0c53307640 1 --2- 172.21.15.67:0/737956990 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0c3803f340 0x7f0c38041800 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.986+0000 7f0c53307640 1 --2- 172.21.15.67:0/737956990 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c4c199b80 0x7f0c4c19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.986+0000 7f0c53307640 1 --2- 172.21.15.67:0/737956990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c4c101800 0x7f0c4c199640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.986+0000 7f0c53307640 1 -- 172.21.15.67:0/737956990 >> 172.21.15.67:0/737956990 conn(0x7f0c4c0fbdb0 msgr2=0x7f0c4c104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.986+0000 7f0c53307640 1 -- 172.21.15.67:0/737956990 shutdown_connections 2024-08-31T05:22:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:07.987+0000 7f0c53307640 1 -- 172.21.15.67:0/737956990 wait complete. 2024-08-31T05:22:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.101+0000 7f9982255640 1 -- 172.21.15.67:0/2093255029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f997409cbd0 msgr2=0x7f997409d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.101+0000 7f9982255640 1 --2- 172.21.15.67:0/2093255029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f997409cbd0 0x7f997409d050 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f996c009880 tx=0x7f996c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:22:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.101+0000 7f9982255640 1 -- 172.21.15.67:0/2093255029 shutdown_connections 2024-08-31T05:22:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.101+0000 7f9982255640 1 --2- 172.21.15.67:0/2093255029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f997409cbd0 0x7f997409d050 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.101+0000 7f9982255640 1 --2- 172.21.15.67:0/2093255029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f997409b9d0 0x7f997409bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:08.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.101+0000 7f9982255640 1 -- 172.21.15.67:0/2093255029 >> 172.21.15.67:0/2093255029 conn(0x7f997400acd0 msgr2=0x7f9974099870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:08.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.102+0000 7f9982255640 1 -- 172.21.15.67:0/2093255029 shutdown_connections 2024-08-31T05:22:08.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.102+0000 7f9982255640 1 -- 172.21.15.67:0/2093255029 wait complete. 2024-08-31T05:22:08.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.103+0000 7f9982255640 1 Processor -- start 2024-08-31T05:22:08.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.103+0000 7f9982255640 1 -- start start 2024-08-31T05:22:08.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.104+0000 7f9982255640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f997409b9d0 0x7f99741314b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:08.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.104+0000 7f9982255640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f997409cbd0 0x7f99741319f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:08.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.104+0000 7f9982255640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f99740a47f0 con 0x7f997409cbd0 2024-08-31T05:22:08.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.104+0000 7f9982255640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f99740a4670 con 0x7f997409b9d0 2024-08-31T05:22:08.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.104+0000 7f9981253640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f997409b9d0 0x7f99741314b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:08.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.104+0000 7f9981253640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f997409b9d0 0x7f99741314b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:53994/0 (socket says 172.21.15.67:53994) 2024-08-31T05:22:08.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.104+0000 7f9981253640 1 -- 172.21.15.67:0/766872114 learned_addr learned my addr 172.21.15.67:0/766872114 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:22:08.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.104+0000 7f9980a52640 1 --2- 172.21.15.67:0/766872114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f997409cbd0 0x7f99741319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:08.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.104+0000 7f9981253640 1 -- 172.21.15.67:0/766872114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f997409cbd0 msgr2=0x7f99741319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:08.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.104+0000 7f9981253640 1 --2- 172.21.15.67:0/766872114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f997409cbd0 0x7f99741319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:08.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.105+0000 7f9981253640 1 -- 172.21.15.67:0/766872114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9974132070 con 0x7f997409b9d0 2024-08-31T05:22:08.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.105+0000 7f9980a52640 1 --2- 172.21.15.67:0/766872114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f997409cbd0 0x7f99741319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:22:08.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.105+0000 7f9981253640 1 --2- 172.21.15.67:0/766872114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f997409b9d0 0x7f99741314b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f997800e940 tx=0x7f997800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:08.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.105+0000 7f99727fc640 1 -- 172.21.15.67:0/766872114 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f997800cac0 con 0x7f997409b9d0 2024-08-31T05:22:08.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.105+0000 7f9982255640 1 -- 172.21.15.67:0/766872114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f997400d360 con 0x7f997409b9d0 2024-08-31T05:22:08.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.105+0000 7f9982255640 1 -- 172.21.15.67:0/766872114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f997400d8f0 con 0x7f997409b9d0 2024-08-31T05:22:08.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.105+0000 7f99727fc640 1 -- 172.21.15.67:0/766872114 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f997800cc60 con 0x7f997409b9d0 2024-08-31T05:22:08.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.106+0000 7f99727fc640 1 -- 172.21.15.67:0/766872114 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9978003de0 con 0x7f997409b9d0 2024-08-31T05:22:08.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.107+0000 7f99727fc640 1 -- 172.21.15.67:0/766872114 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 30) ==== 51483+0+0 (secure 0 0 0) 0x7f9978010540 con 0x7f997409b9d0 2024-08-31T05:22:08.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.107+0000 7f9982255640 1 -- 172.21.15.67:0/766872114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99600052c0 con 0x7f997409b9d0 2024-08-31T05:22:08.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.107+0000 7f99727fc640 1 --2- 172.21.15.67:0/766872114 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f996803f130 0x7f99680415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:08.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.107+0000 7f99727fc640 1 -- 172.21.15.67:0/766872114 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f99780555b0 con 0x7f997409b9d0 2024-08-31T05:22:08.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.107+0000 7f9980a52640 1 --2- 172.21.15.67:0/766872114 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f996803f130 0x7f99680415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:08.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.108+0000 7f9980a52640 1 --2- 172.21.15.67:0/766872114 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f996803f130 0x7f99680415f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9974132960 tx=0x7f996c009640 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:08.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.113+0000 7f99727fc640 1 -- 172.21.15.67:0/766872114 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f997800ce10 con 0x7f997409b9d0 2024-08-31T05:22:08.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.437+0000 7f9982255640 1 -- 172.21.15.67:0/766872114 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9960000bf0 con 0x7f996803f130 2024-08-31T05:22:08.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.450+0000 7f99727fc640 1 -- 172.21.15.67:0/766872114 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f9960000bf0 con 0x7f996803f130 2024-08-31T05:22:08.452 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:22:08.453 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (7m) 9s ago 8m 24.5M - 0.25.0 c8568f914cd2 cad2b6757f0e 2024-08-31T05:22:08.453 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (87s) 9s ago 9m 8456k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:22:08.453 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (46s) 0s ago 8m 8010k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:22:08.453 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (9m) 9s ago 9m 6895k - 19.1.1-242-g244a32d3 395b9209a980 a47c71179c57 2024-08-31T05:22:08.453 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (8m) 0s ago 8m 6895k - 19.1.1-242-g244a32d3 395b9209a980 5f2ce08c4451 2024-08-31T05:22:08.453 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (7m) 9s ago 8m 78.4M - 9.4.12 2bacad6d85d8 ac51e53c0deb 2024-08-31T05:22:08.453 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (3m) 9s ago 3m 273M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:22:08.453 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (3m) 9s ago 3m 243M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:22:08.453 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (3m) 0s ago 3m 14.1M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:22:08.453 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (3m) 0s ago 3m 15.8M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:22:08.453 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (20s) 9s ago 10m 131M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:22:08.453 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (2m) 0s ago 8m 218M - 19.3.0-4560-gd19e6118 79f4cde5e369 d18b213f9418 2024-08-31T05:22:08.453 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (10m) 9s ago 10m 50.8M 2048M 19.1.1-242-g244a32d3 395b9209a980 7082a38c8108 2024-08-31T05:22:08.454 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (8m) 0s ago 8m 45.2M 2048M 19.1.1-242-g244a32d3 395b9209a980 30ccf0ed274b 2024-08-31T05:22:08.454 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (9m) 9s ago 9m 17.0M - 1.5.0 0da6a335fe13 d7c795c5bd95 2024-08-31T05:22:08.454 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (8m) 0s ago 8m 16.2M - 1.5.0 0da6a335fe13 f718603a0e92 2024-08-31T05:22:08.454 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (6m) 9s ago 6m 170M 1216M 19.1.1-242-g244a32d3 395b9209a980 b9f3f60b65f9 2024-08-31T05:22:08.454 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (6m) 9s ago 6m 193M 1216M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:22:08.454 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (6m) 9s ago 6m 155M 1216M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:22:08.454 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (5m) 0s ago 5m 216M 2240M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:22:08.454 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (5m) 0s ago 5m 190M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:22:08.454 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (4m) 0s ago 4m 170M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:22:08.454 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (54s) 9s ago 8m 47.2M - 2.43.0 a07b618ecd1d 93b2e86bc92e 2024-08-31T05:22:08.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.454+0000 7f9982255640 1 -- 172.21.15.67:0/766872114 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f996803f130 msgr2=0x7f99680415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:08.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.454+0000 7f9982255640 1 --2- 172.21.15.67:0/766872114 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f996803f130 0x7f99680415f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9974132960 tx=0x7f996c009640 comp rx=0 tx=0).stop 2024-08-31T05:22:08.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.454+0000 7f9982255640 1 -- 172.21.15.67:0/766872114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f997409b9d0 msgr2=0x7f99741314b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:08.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.454+0000 7f9982255640 1 --2- 172.21.15.67:0/766872114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f997409b9d0 0x7f99741314b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f997800e940 tx=0x7f997800ee00 comp rx=0 tx=0).stop 2024-08-31T05:22:08.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.454+0000 7f9982255640 1 -- 172.21.15.67:0/766872114 shutdown_connections 2024-08-31T05:22:08.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.454+0000 7f9982255640 1 --2- 172.21.15.67:0/766872114 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f996803f130 0x7f99680415f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:08.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.454+0000 7f9982255640 1 --2- 172.21.15.67:0/766872114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f997409cbd0 0x7f99741319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:08.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.454+0000 7f9982255640 1 --2- 172.21.15.67:0/766872114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f997409b9d0 0x7f99741314b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:08.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.454+0000 7f9982255640 1 -- 172.21.15.67:0/766872114 >> 172.21.15.67:0/766872114 conn(0x7f997400acd0 msgr2=0x7f99740a0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:08.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.454+0000 7f9982255640 1 -- 172.21.15.67:0/766872114 shutdown_connections 2024-08-31T05:22:08.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.454+0000 7f9982255640 1 -- 172.21.15.67:0/766872114 wait complete. 2024-08-31T05:22:08.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.558+0000 7fd263c1e640 1 -- 172.21.15.67:0/3388018507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd25c100600 msgr2=0x7fd25c100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:08.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.558+0000 7fd263c1e640 1 --2- 172.21.15.67:0/3388018507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd25c100600 0x7fd25c100a00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd258009880 tx=0x7fd25802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:22:08.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.558+0000 7fd263c1e640 1 -- 172.21.15.67:0/3388018507 shutdown_connections 2024-08-31T05:22:08.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.558+0000 7fd263c1e640 1 --2- 172.21.15.67:0/3388018507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c101800 0x7fd25c101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:08.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.558+0000 7fd263c1e640 1 --2- 172.21.15.67:0/3388018507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd25c100600 0x7fd25c100a00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:08.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.558+0000 7fd263c1e640 1 -- 172.21.15.67:0/3388018507 >> 172.21.15.67:0/3388018507 conn(0x7fd25c0fbdb0 msgr2=0x7fd25c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:08.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.559+0000 7fd263c1e640 1 -- 172.21.15.67:0/3388018507 shutdown_connections 2024-08-31T05:22:08.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.559+0000 7fd263c1e640 1 -- 172.21.15.67:0/3388018507 wait complete. 2024-08-31T05:22:08.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.559+0000 7fd263c1e640 1 Processor -- start 2024-08-31T05:22:08.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.560+0000 7fd263c1e640 1 -- start start 2024-08-31T05:22:08.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.560+0000 7fd263c1e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c100600 0x7fd25c06a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:08.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.560+0000 7fd263c1e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd25c101800 0x7fd25c19e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:08.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.560+0000 7fd263c1e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd25c109420 con 0x7fd25c101800 2024-08-31T05:22:08.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.560+0000 7fd2611b9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd25c101800 0x7fd25c19e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:08.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.560+0000 7fd2611b9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd25c101800 0x7fd25c19e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47158/0 (socket says 172.21.15.67:47158) 2024-08-31T05:22:08.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.560+0000 7fd2611b9640 1 -- 172.21.15.67:0/537709733 learned_addr learned my addr 172.21.15.67:0/537709733 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:22:08.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.560+0000 7fd2619ba640 1 --2- 172.21.15.67:0/537709733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c100600 0x7fd25c06a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:08.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.560+0000 7fd263c1e640 1 -- 172.21.15.67:0/537709733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd25c1092a0 con 0x7fd25c100600 2024-08-31T05:22:08.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.561+0000 7fd2611b9640 1 -- 172.21.15.67:0/537709733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c100600 msgr2=0x7fd25c06a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:08.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.561+0000 7fd2611b9640 1 --2- 172.21.15.67:0/537709733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c100600 0x7fd25c06a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:08.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.561+0000 7fd2611b9640 1 -- 172.21.15.67:0/537709733 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25c19e8e0 con 0x7fd25c101800 2024-08-31T05:22:08.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.561+0000 7fd2611b9640 1 --2- 172.21.15.67:0/537709733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd25c101800 0x7fd25c19e3a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd24c00d8d0 tx=0x7fd24c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:08.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.561+0000 7fd252ffd640 1 -- 172.21.15.67:0/537709733 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd24c017030 con 0x7fd25c101800 2024-08-31T05:22:08.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.561+0000 7fd252ffd640 1 -- 172.21.15.67:0/537709733 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd24c004020 con 0x7fd25c101800 2024-08-31T05:22:08.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.561+0000 7fd263c1e640 1 -- 172.21.15.67:0/537709733 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd25c19eab0 con 0x7fd25c101800 2024-08-31T05:22:08.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.561+0000 7fd252ffd640 1 -- 172.21.15.67:0/537709733 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd24c0047a0 con 0x7fd25c101800 2024-08-31T05:22:08.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.561+0000 7fd263c1e640 1 -- 172.21.15.67:0/537709733 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd25c19efe0 con 0x7fd25c101800 2024-08-31T05:22:08.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.562+0000 7fd252ffd640 1 -- 172.21.15.67:0/537709733 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 30) ==== 51483+0+0 (secure 0 0 0) 0x7fd24c004a10 con 0x7fd25c101800 2024-08-31T05:22:08.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.562+0000 7fd263c1e640 1 -- 172.21.15.67:0/537709733 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd25c100a00 con 0x7fd25c101800 2024-08-31T05:22:08.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.563+0000 7fd252ffd640 1 --2- 172.21.15.67:0/537709733 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd24803f340 0x7fd248041800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:08.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.563+0000 7fd252ffd640 1 -- 172.21.15.67:0/537709733 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fd24c018070 con 0x7fd25c101800 2024-08-31T05:22:08.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.563+0000 7fd2619ba640 1 --2- 172.21.15.67:0/537709733 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd24803f340 0x7fd248041800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:08.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.564+0000 7fd2619ba640 1 --2- 172.21.15.67:0/537709733 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd24803f340 0x7fd248041800 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd258009230 tx=0x7fd2580058d0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:08.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:08.569+0000 7fd252ffd640 1 -- 172.21.15.67:0/537709733 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fd24c018d30 con 0x7fd25c101800 2024-08-31T05:22:08.798 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:08 smithi067 ceph-mon[17432]: from='client.24495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:08.799 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:08 smithi067 ceph-mon[17432]: pgmap v5: 65 pgs: 65 active+clean; 1.2 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail 2024-08-31T05:22:08.799 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:08 smithi067 ceph-mon[17432]: mgrmap e30: smithi067.hftacj(active, since 4s) 2024-08-31T05:22:08.799 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:08 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:08.799 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:08 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:08.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:08 smithi073 ceph-mon[24726]: from='client.24495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:08.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:08 smithi073 ceph-mon[24726]: pgmap v5: 65 pgs: 65 active+clean; 1.2 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail 2024-08-31T05:22:08.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:08 smithi073 ceph-mon[24726]: mgrmap e30: smithi067.hftacj(active, since 4s) 2024-08-31T05:22:08.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:08 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:08.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:08 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.020+0000 7fd263c1e640 1 -- 172.21.15.67:0/537709733 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd25c19f4c0 con 0x7fd25c101800 2024-08-31T05:22:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.021+0000 7fd252ffd640 1 -- 172.21.15.67:0/537709733 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fd24c01a360 con 0x7fd25c101800 2024-08-31T05:22:09.023 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:22:09.023 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:22:09.023 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2 2024-08-31T05:22:09.023 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:22:09.023 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:22:09.023 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 1 2024-08-31T05:22:09.023 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:22:09.023 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:22:09.023 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 6 2024-08-31T05:22:09.023 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:22:09.023 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:22:09.023 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:22:09.024 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:22:09.024 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:22:09.024 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 12, 2024-08-31T05:22:09.024 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 1 2024-08-31T05:22:09.024 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:22:09.024 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:22:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.023+0000 7fd263c1e640 1 -- 172.21.15.67:0/537709733 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd24803f340 msgr2=0x7fd248041800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.023+0000 7fd263c1e640 1 --2- 172.21.15.67:0/537709733 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd24803f340 0x7fd248041800 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd258009230 tx=0x7fd2580058d0 comp rx=0 tx=0).stop 2024-08-31T05:22:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.023+0000 7fd263c1e640 1 -- 172.21.15.67:0/537709733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd25c101800 msgr2=0x7fd25c19e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.023+0000 7fd263c1e640 1 --2- 172.21.15.67:0/537709733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd25c101800 0x7fd25c19e3a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd24c00d8d0 tx=0x7fd24c00dd90 comp rx=0 tx=0).stop 2024-08-31T05:22:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.023+0000 7fd263c1e640 1 -- 172.21.15.67:0/537709733 shutdown_connections 2024-08-31T05:22:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.023+0000 7fd263c1e640 1 --2- 172.21.15.67:0/537709733 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd24803f340 0x7fd248041800 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.023+0000 7fd263c1e640 1 --2- 172.21.15.67:0/537709733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd25c101800 0x7fd25c19e3a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:09.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.023+0000 7fd263c1e640 1 --2- 172.21.15.67:0/537709733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c100600 0x7fd25c06a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:09.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.023+0000 7fd263c1e640 1 -- 172.21.15.67:0/537709733 >> 172.21.15.67:0/537709733 conn(0x7fd25c0fbdb0 msgr2=0x7fd25c0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:09.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.024+0000 7fd263c1e640 1 -- 172.21.15.67:0/537709733 shutdown_connections 2024-08-31T05:22:09.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.024+0000 7fd263c1e640 1 -- 172.21.15.67:0/537709733 wait complete. 2024-08-31T05:22:09.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.123+0000 7fb499861640 1 -- 172.21.15.67:0/3440656807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb494101800 msgr2=0x7fb494101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:09.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.123+0000 7fb499861640 1 --2- 172.21.15.67:0/3440656807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb494101800 0x7fb494101c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0097e0 tx=0x7fb47c02a3f0 comp rx=0 tx=0).stop 2024-08-31T05:22:09.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.123+0000 7fb499861640 1 -- 172.21.15.67:0/3440656807 shutdown_connections 2024-08-31T05:22:09.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.123+0000 7fb499861640 1 --2- 172.21.15.67:0/3440656807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb494101800 0x7fb494101c80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:09.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.123+0000 7fb499861640 1 --2- 172.21.15.67:0/3440656807 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb494100600 0x7fb494100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:09.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.123+0000 7fb499861640 1 -- 172.21.15.67:0/3440656807 >> 172.21.15.67:0/3440656807 conn(0x7fb4940fbdb0 msgr2=0x7fb4940fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:09.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.123+0000 7fb499861640 1 -- 172.21.15.67:0/3440656807 shutdown_connections 2024-08-31T05:22:09.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.123+0000 7fb499861640 1 -- 172.21.15.67:0/3440656807 wait complete. 2024-08-31T05:22:09.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.124+0000 7fb499861640 1 Processor -- start 2024-08-31T05:22:09.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.124+0000 7fb499861640 1 -- start start 2024-08-31T05:22:09.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.125+0000 7fb499861640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb494100600 0x7fb494197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:09.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.125+0000 7fb499861640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb494101800 0x7fb494197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:09.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.125+0000 7fb492ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb494100600 0x7fb494197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:09.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.125+0000 7fb492ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb494100600 0x7fb494197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:48812/0 (socket says 172.21.15.67:48812) 2024-08-31T05:22:09.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.125+0000 7fb492ffd640 1 -- 172.21.15.67:0/415211597 learned_addr learned my addr 172.21.15.67:0/415211597 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:22:09.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.125+0000 7fb48bfff640 1 --2- 172.21.15.67:0/415211597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb494101800 0x7fb494197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:09.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.125+0000 7fb499861640 1 -- 172.21.15.67:0/415211597 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb49410a520 con 0x7fb494101800 2024-08-31T05:22:09.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.125+0000 7fb499861640 1 -- 172.21.15.67:0/415211597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb49410a3a0 con 0x7fb494100600 2024-08-31T05:22:09.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.125+0000 7fb492ffd640 1 -- 172.21.15.67:0/415211597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb494101800 msgr2=0x7fb494197780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:09.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.125+0000 7fb492ffd640 1 --2- 172.21.15.67:0/415211597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb494101800 0x7fb494197780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:09.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.125+0000 7fb492ffd640 1 -- 172.21.15.67:0/415211597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb494197e00 con 0x7fb494100600 2024-08-31T05:22:09.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.126+0000 7fb492ffd640 1 --2- 172.21.15.67:0/415211597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb494100600 0x7fb494197240 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb484009f90 tx=0x7fb48400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:09.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.126+0000 7fb49885f640 1 -- 172.21.15.67:0/415211597 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb48401b070 con 0x7fb494100600 2024-08-31T05:22:09.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.126+0000 7fb49885f640 1 -- 172.21.15.67:0/415211597 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb48400baf0 con 0x7fb494100600 2024-08-31T05:22:09.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.126+0000 7fb49885f640 1 -- 172.21.15.67:0/415211597 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb484016c70 con 0x7fb494100600 2024-08-31T05:22:09.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.127+0000 7fb499861640 1 -- 172.21.15.67:0/415211597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb49419c840 con 0x7fb494100600 2024-08-31T05:22:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.127+0000 7fb499861640 1 -- 172.21.15.67:0/415211597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb49419cda0 con 0x7fb494100600 2024-08-31T05:22:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.128+0000 7fb49885f640 1 -- 172.21.15.67:0/415211597 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 30) ==== 51483+0+0 (secure 0 0 0) 0x7fb48400b630 con 0x7fb494100600 2024-08-31T05:22:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.128+0000 7fb49885f640 1 --2- 172.21.15.67:0/415211597 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb48003f390 0x7fb480041850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.129+0000 7fb49885f640 1 -- 172.21.15.67:0/415211597 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fb484013070 con 0x7fb494100600 2024-08-31T05:22:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.129+0000 7fb499861640 1 -- 172.21.15.67:0/415211597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb494100a00 con 0x7fb494100600 2024-08-31T05:22:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.129+0000 7fb48bfff640 1 --2- 172.21.15.67:0/415211597 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb48003f390 0x7fb480041850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:09.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.130+0000 7fb48bfff640 1 --2- 172.21.15.67:0/415211597 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb48003f390 0x7fb480041850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0095f0 tx=0x7fb47c030890 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.134+0000 7fb49885f640 1 -- 172.21.15.67:0/415211597 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fb48401c270 con 0x7fb494100600 2024-08-31T05:22:09.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.476+0000 7fb499861640 1 -- 172.21.15.67:0/415211597 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb494105db0 con 0x7fb48003f390 2024-08-31T05:22:09.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.478+0000 7fb49885f640 1 -- 172.21.15.67:0/415211597 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7fb494105db0 con 0x7fb48003f390 2024-08-31T05:22:09.480 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:22:09.480 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:22:09.480 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:22:09.480 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-31T05:22:09.480 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:22:09.480 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr" 2024-08-31T05:22:09.480 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:22:09.480 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "2/2 daemons upgraded", 2024-08-31T05:22:09.480 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-08-31T05:22:09.480 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:22:09.480 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:22:09.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.481+0000 7fb499861640 1 -- 172.21.15.67:0/415211597 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb48003f390 msgr2=0x7fb480041850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:09.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.481+0000 7fb499861640 1 --2- 172.21.15.67:0/415211597 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb48003f390 0x7fb480041850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0095f0 tx=0x7fb47c030890 comp rx=0 tx=0).stop 2024-08-31T05:22:09.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.481+0000 7fb499861640 1 -- 172.21.15.67:0/415211597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb494100600 msgr2=0x7fb494197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:09.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.481+0000 7fb499861640 1 --2- 172.21.15.67:0/415211597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb494100600 0x7fb494197240 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb484009f90 tx=0x7fb48400c800 comp rx=0 tx=0).stop 2024-08-31T05:22:09.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.481+0000 7fb499861640 1 -- 172.21.15.67:0/415211597 shutdown_connections 2024-08-31T05:22:09.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.481+0000 7fb499861640 1 --2- 172.21.15.67:0/415211597 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb48003f390 0x7fb480041850 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:09.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.481+0000 7fb499861640 1 --2- 172.21.15.67:0/415211597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb494101800 0x7fb494197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:09.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.481+0000 7fb499861640 1 --2- 172.21.15.67:0/415211597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb494100600 0x7fb494197240 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:09.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.481+0000 7fb499861640 1 -- 172.21.15.67:0/415211597 >> 172.21.15.67:0/415211597 conn(0x7fb4940fbdb0 msgr2=0x7fb4940fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:09.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.481+0000 7fb499861640 1 -- 172.21.15.67:0/415211597 shutdown_connections 2024-08-31T05:22:09.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:09.481+0000 7fb499861640 1 -- 172.21.15.67:0/415211597 wait complete. 2024-08-31T05:22:09.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:09 smithi067 ceph-mon[17432]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:09.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:09 smithi067 ceph-mon[17432]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:09.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:09 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:09.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:09 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:09.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:09 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/537709733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:09.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:09 smithi067 ceph-mon[17432]: Standby manager daemon smithi073.zfoyxd started 2024-08-31T05:22:09.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:09 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.73:0/1803040492' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.zfoyxd/crt"}]: dispatch 2024-08-31T05:22:09.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:09 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.73:0/1803040492' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T05:22:09.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:09 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.73:0/1803040492' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.zfoyxd/key"}]: dispatch 2024-08-31T05:22:09.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:09 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.73:0/1803040492' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T05:22:09.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:09 smithi073 ceph-mon[24726]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:09 smithi073 ceph-mon[24726]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:09 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:09 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:09 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/537709733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:09 smithi073 ceph-mon[24726]: Standby manager daemon smithi073.zfoyxd started 2024-08-31T05:22:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:09 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.73:0/1803040492' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.zfoyxd/crt"}]: dispatch 2024-08-31T05:22:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:09 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.73:0/1803040492' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T05:22:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:09 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.73:0/1803040492' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.zfoyxd/key"}]: dispatch 2024-08-31T05:22:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:09 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.73:0/1803040492' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T05:22:10.893 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:10 smithi067 ceph-mon[17432]: [31/Aug/2024:05:22:08] ENGINE Bus STARTING 2024-08-31T05:22:10.893 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:10 smithi067 ceph-mon[17432]: [31/Aug/2024:05:22:09] ENGINE Serving on http://172.21.15.67:8765 2024-08-31T05:22:10.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:10 smithi067 ceph-mon[17432]: [31/Aug/2024:05:22:09] ENGINE Serving on https://172.21.15.67:7150 2024-08-31T05:22:10.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:10 smithi067 ceph-mon[17432]: [31/Aug/2024:05:22:09] ENGINE Bus STARTED 2024-08-31T05:22:10.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:10 smithi067 ceph-mon[17432]: [31/Aug/2024:05:22:09] ENGINE Error in HTTPServer.serve 2024-08-31T05:22:10.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Traceback (most recent call last): 2024-08-31T05:22:10.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:22:10.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:22:10.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:22:10.895 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._run(expiration_interval) 2024-08-31T05:22:10.895 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:22:10.895 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:22:10.895 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:22:10.895 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:22:10.895 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:22:10.895 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: s = self.context.wrap_socket( 2024-08-31T05:22:10.896 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:22:10.896 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: return self.sslsocket_class._create( 2024-08-31T05:22:10.896 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:22:10.896 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self.do_handshake() 2024-08-31T05:22:10.896 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:22:10.896 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: self._sslobj.do_handshake() 2024-08-31T05:22:10.897 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:22:10.897 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:10 smithi067 ceph-mon[17432]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:10.897 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:10 smithi067 ceph-mon[17432]: pgmap v6: 65 pgs: 65 active+clean; 654 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-08-31T05:22:10.897 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:10 smithi067 ceph-mon[17432]: mgrmap e31: smithi067.hftacj(active, since 6s), standbys: smithi073.zfoyxd 2024-08-31T05:22:10.897 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:10 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr metadata", "who": "smithi073.zfoyxd", "id": "smithi073.zfoyxd"}]: dispatch 2024-08-31T05:22:10.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:10 smithi073 ceph-mon[24726]: [31/Aug/2024:05:22:08] ENGINE Bus STARTING 2024-08-31T05:22:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:10 smithi073 ceph-mon[24726]: [31/Aug/2024:05:22:09] ENGINE Serving on http://172.21.15.67:8765 2024-08-31T05:22:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:10 smithi073 ceph-mon[24726]: [31/Aug/2024:05:22:09] ENGINE Serving on https://172.21.15.67:7150 2024-08-31T05:22:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:10 smithi073 ceph-mon[24726]: [31/Aug/2024:05:22:09] ENGINE Bus STARTED 2024-08-31T05:22:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:10 smithi073 ceph-mon[24726]: [31/Aug/2024:05:22:09] ENGINE Error in HTTPServer.serve 2024-08-31T05:22:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Traceback (most recent call last): 2024-08-31T05:22:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:22:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:22:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:22:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: self._run(expiration_interval) 2024-08-31T05:22:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:22:10.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:22:10.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:22:10.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:22:10.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:22:10.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: s = self.context.wrap_socket( 2024-08-31T05:22:10.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:22:10.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: return self.sslsocket_class._create( 2024-08-31T05:22:10.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:22:10.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: self.do_handshake() 2024-08-31T05:22:10.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:22:10.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: self._sslobj.do_handshake() 2024-08-31T05:22:10.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:22:10.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:10 smithi073 ceph-mon[24726]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:10.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:10 smithi073 ceph-mon[24726]: pgmap v6: 65 pgs: 65 active+clean; 654 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-08-31T05:22:10.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:10 smithi073 ceph-mon[24726]: mgrmap e31: smithi067.hftacj(active, since 6s), standbys: smithi073.zfoyxd 2024-08-31T05:22:10.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:10 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr metadata", "who": "smithi073.zfoyxd", "id": "smithi073.zfoyxd"}]: dispatch 2024-08-31T05:22:10.991 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T05:22:10.991 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T05:22:12.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:12 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:12.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:12 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:12.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:12 smithi067 ceph-mon[17432]: pgmap v7: 65 pgs: 65 active+clean; 654 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-08-31T05:22:12.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:12 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:12.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:12 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:12.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:12 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:12.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:12 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:12.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:12 smithi073 ceph-mon[24726]: pgmap v7: 65 pgs: 65 active+clean; 654 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-08-31T05:22:12.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:12 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:12.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:12 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:14.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:14 smithi073 ceph-mon[24726]: pgmap v8: 65 pgs: 65 active+clean; 654 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 908 KiB/s rd, 815 KiB/s wr, 88 op/s 2024-08-31T05:22:15.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:14 smithi067 ceph-mon[17432]: pgmap v8: 65 pgs: 65 active+clean; 654 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 908 KiB/s rd, 815 KiB/s wr, 88 op/s 2024-08-31T05:22:16.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:16 smithi073 ceph-mon[24726]: pgmap v9: 65 pgs: 65 active+clean; 293 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 134 op/s 2024-08-31T05:22:17.049 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:16 smithi067 ceph-mon[17432]: pgmap v9: 65 pgs: 65 active+clean; 293 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 134 op/s 2024-08-31T05:22:18.919 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:18 smithi067 ceph-mon[17432]: pgmap v10: 65 pgs: 65 active+clean; 293 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 122 op/s 2024-08-31T05:22:18.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:18 smithi073 ceph-mon[24726]: pgmap v10: 65 pgs: 65 active+clean; 293 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 122 op/s 2024-08-31T05:22:19.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:19 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:22:20.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:19 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:22:20.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:20 smithi073 ceph-mon[24726]: pgmap v11: 65 pgs: 65 active+clean; 298 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 164 op/s 2024-08-31T05:22:21.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:20 smithi067 ceph-mon[17432]: pgmap v11: 65 pgs: 65 active+clean; 298 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 164 op/s 2024-08-31T05:22:22.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:22 smithi073 ceph-mon[24726]: pgmap v12: 65 pgs: 65 active+clean; 298 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 104 op/s 2024-08-31T05:22:23.035 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:22 smithi067 ceph-mon[17432]: pgmap v12: 65 pgs: 65 active+clean; 298 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 104 op/s 2024-08-31T05:22:24.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:24 smithi073 ceph-mon[24726]: pgmap v13: 65 pgs: 65 active+clean; 298 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 104 op/s 2024-08-31T05:22:25.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:24 smithi067 ceph-mon[17432]: pgmap v13: 65 pgs: 65 active+clean; 298 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 104 op/s 2024-08-31T05:22:26.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:26 smithi067 ceph-mon[17432]: pgmap v14: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 148 op/s 2024-08-31T05:22:26.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:26 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:26.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:26 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:26.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:26 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:22:26.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:26 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:22:26.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:26 smithi073 ceph-mon[24726]: pgmap v14: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 148 op/s 2024-08-31T05:22:26.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:26 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:26.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:26 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:26.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:26 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:22:26.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:26 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:22:27.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:27 smithi067 ceph-mon[17432]: Updating smithi067:/etc/ceph/ceph.conf 2024-08-31T05:22:27.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:27 smithi067 ceph-mon[17432]: Updating smithi073:/etc/ceph/ceph.conf 2024-08-31T05:22:27.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:27 smithi073 ceph-mon[24726]: Updating smithi067:/etc/ceph/ceph.conf 2024-08-31T05:22:27.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:27 smithi073 ceph-mon[24726]: Updating smithi073:/etc/ceph/ceph.conf 2024-08-31T05:22:28.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:28 smithi067 ceph-mon[17432]: Updating smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:22:28.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:28 smithi067 ceph-mon[17432]: Updating smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:22:28.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:28 smithi067 ceph-mon[17432]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:22:28.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:28 smithi067 ceph-mon[17432]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:22:28.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:28 smithi067 ceph-mon[17432]: Updating smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:22:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:28 smithi067 ceph-mon[17432]: pgmap v15: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 92 op/s 2024-08-31T05:22:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:28.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:28 smithi073 ceph-mon[24726]: Updating smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:22:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:28 smithi073 ceph-mon[24726]: Updating smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:22:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:28 smithi073 ceph-mon[24726]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:22:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:28 smithi073 ceph-mon[24726]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:22:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:28 smithi073 ceph-mon[24726]: Updating smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:22:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:28 smithi073 ceph-mon[24726]: pgmap v15: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 92 op/s 2024-08-31T05:22:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:29.934 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:29 smithi067 ceph-mon[17432]: Updating smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:22:29.934 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:29 smithi067 ceph-mon[17432]: Reconfiguring prometheus.smithi067 (dependencies changed)... 2024-08-31T05:22:29.934 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:29 smithi067 ceph-mon[17432]: Reconfiguring daemon prometheus.smithi067 on smithi067 2024-08-31T05:22:29.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:29 smithi073 ceph-mon[24726]: Updating smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:22:29.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:29 smithi073 ceph-mon[24726]: Reconfiguring prometheus.smithi067 (dependencies changed)... 2024-08-31T05:22:29.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:29 smithi073 ceph-mon[24726]: Reconfiguring daemon prometheus.smithi067 on smithi067 2024-08-31T05:22:30.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:30 smithi073 ceph-mon[24726]: pgmap v16: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 240 op/s 2024-08-31T05:22:31.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:30 smithi067 ceph-mon[17432]: pgmap v16: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 240 op/s 2024-08-31T05:22:32.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:32 smithi073 ceph-mon[24726]: pgmap v17: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 222 op/s 2024-08-31T05:22:33.002 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:32 smithi067 ceph-mon[17432]: pgmap v17: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 222 op/s 2024-08-31T05:22:34.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:34 smithi067 ceph-mon[17432]: pgmap v18: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 215 op/s 2024-08-31T05:22:34.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:34 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:22:34.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:34 smithi073 ceph-mon[24726]: pgmap v18: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 215 op/s 2024-08-31T05:22:34.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:34 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:22:36.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:36 smithi073 ceph-mon[24726]: pgmap v19: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 556 op/s 2024-08-31T05:22:36.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:36 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:36.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:36 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:36.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:36 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:22:36.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:36 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:22:37.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:36 smithi067 ceph-mon[17432]: pgmap v19: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 556 op/s 2024-08-31T05:22:37.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:36 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:37.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:36 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:37.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:36 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:22:37.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:36 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:22:37.819 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:37 smithi073 ceph-mon[24726]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:22:38.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:37 smithi067 ceph-mon[17432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:22:38.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:38 smithi073 ceph-mon[24726]: pgmap v20: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 512 op/s 2024-08-31T05:22:38.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:38 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.zfoyxd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T05:22:38.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:38 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T05:22:38.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:38 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:22:39.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:38 smithi067 ceph-mon[17432]: pgmap v20: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 512 op/s 2024-08-31T05:22:39.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:38 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi073.zfoyxd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T05:22:39.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:38 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T05:22:39.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:38 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:22:39.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.585+0000 7f53ca59f640 1 -- 172.21.15.67:0/2714028917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c4100600 msgr2=0x7f53c4100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:39.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.585+0000 7f53ca59f640 1 --2- 172.21.15.67:0/2714028917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c4100600 0x7f53c4100a00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009880 tx=0x7f53b402a4b0 comp rx=0 tx=0).stop 2024-08-31T05:22:39.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.585+0000 7f53ca59f640 1 -- 172.21.15.67:0/2714028917 shutdown_connections 2024-08-31T05:22:39.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.585+0000 7f53ca59f640 1 --2- 172.21.15.67:0/2714028917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53c4101800 0x7f53c4101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:39.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.585+0000 7f53ca59f640 1 --2- 172.21.15.67:0/2714028917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c4100600 0x7f53c4100a00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:39.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.585+0000 7f53ca59f640 1 -- 172.21.15.67:0/2714028917 >> 172.21.15.67:0/2714028917 conn(0x7f53c40fbdb0 msgr2=0x7f53c40fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:39.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.585+0000 7f53ca59f640 1 -- 172.21.15.67:0/2714028917 shutdown_connections 2024-08-31T05:22:39.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.585+0000 7f53ca59f640 1 -- 172.21.15.67:0/2714028917 wait complete. 2024-08-31T05:22:39.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.585+0000 7f53ca59f640 1 Processor -- start 2024-08-31T05:22:39.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.586+0000 7f53ca59f640 1 -- start start 2024-08-31T05:22:39.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.586+0000 7f53ca59f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c4100600 0x7f53c4196140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:39.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.586+0000 7f53ca59f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53c4101800 0x7f53c4196680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:39.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.586+0000 7f53ca59f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f53c4109420 con 0x7f53c4100600 2024-08-31T05:22:39.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.586+0000 7f53ca59f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f53c41092a0 con 0x7f53c4101800 2024-08-31T05:22:39.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.586+0000 7f53c3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c4100600 0x7f53c4196140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:39.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.586+0000 7f53c3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c4100600 0x7f53c4196140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49438/0 (socket says 172.21.15.67:49438) 2024-08-31T05:22:39.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.586+0000 7f53c3fff640 1 -- 172.21.15.67:0/3646314680 learned_addr learned my addr 172.21.15.67:0/3646314680 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:22:39.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.586+0000 7f53c37fe640 1 --2- 172.21.15.67:0/3646314680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53c4101800 0x7f53c4196680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:39.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.586+0000 7f53c3fff640 1 -- 172.21.15.67:0/3646314680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53c4101800 msgr2=0x7f53c4196680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:39.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.586+0000 7f53c3fff640 1 --2- 172.21.15.67:0/3646314680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53c4101800 0x7f53c4196680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:39.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.586+0000 7f53c3fff640 1 -- 172.21.15.67:0/3646314680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c4196d00 con 0x7f53c4100600 2024-08-31T05:22:39.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.587+0000 7f53c37fe640 1 --2- 172.21.15.67:0/3646314680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53c4101800 0x7f53c4196680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:22:39.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.587+0000 7f53c3fff640 1 --2- 172.21.15.67:0/3646314680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c4100600 0x7f53c4196140 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f53b4006010 tx=0x7f53b40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:39.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.587+0000 7f53c17fa640 1 -- 172.21.15.67:0/3646314680 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53b4035070 con 0x7f53c4100600 2024-08-31T05:22:39.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.587+0000 7f53c17fa640 1 -- 172.21.15.67:0/3646314680 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53b40035f0 con 0x7f53c4100600 2024-08-31T05:22:39.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.587+0000 7f53ca59f640 1 -- 172.21.15.67:0/3646314680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c4069a40 con 0x7f53c4100600 2024-08-31T05:22:39.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.587+0000 7f53c17fa640 1 -- 172.21.15.67:0/3646314680 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53b4031830 con 0x7f53c4100600 2024-08-31T05:22:39.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.587+0000 7f53ca59f640 1 -- 172.21.15.67:0/3646314680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c4069fd0 con 0x7f53c4100600 2024-08-31T05:22:39.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.589+0000 7f53ca59f640 1 -- 172.21.15.67:0/3646314680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c4100a00 con 0x7f53c4100600 2024-08-31T05:22:39.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.589+0000 7f53c17fa640 1 -- 172.21.15.67:0/3646314680 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 31) ==== 102132+0+0 (secure 0 0 0) 0x7f53b40037a0 con 0x7f53c4100600 2024-08-31T05:22:39.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.590+0000 7f53c17fa640 1 --2- 172.21.15.67:0/3646314680 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f53ac079f20 0x7f53ac07c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:39.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.590+0000 7f53c17fa640 1 -- 172.21.15.67:0/3646314680 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f53b403e070 con 0x7f53c4100600 2024-08-31T05:22:39.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.590+0000 7f53c37fe640 1 --2- 172.21.15.67:0/3646314680 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f53ac079f20 0x7f53ac07c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:39.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.591+0000 7f53c37fe640 1 --2- 172.21.15.67:0/3646314680 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f53ac079f20 0x7f53ac07c3e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f53c41975f0 tx=0x7f53b8005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:39.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.595+0000 7f53c17fa640 1 -- 172.21.15.67:0/3646314680 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f53b4086980 con 0x7f53c4100600 2024-08-31T05:22:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.883+0000 7f53ca59f640 1 -- 172.21.15.67:0/3646314680 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f53c4105db0 con 0x7f53ac079f20 2024-08-31T05:22:39.885 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:39 smithi067 ceph-mon[17432]: Upgrade: Updating mgr.smithi073.zfoyxd 2024-08-31T05:22:39.885 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:39 smithi067 ceph-mon[17432]: Deploying daemon mgr.smithi073.zfoyxd on smithi073 2024-08-31T05:22:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.885+0000 7f53c17fa640 1 -- 172.21.15.67:0/3646314680 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f53c4105db0 con 0x7f53ac079f20 2024-08-31T05:22:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.888+0000 7f53ca59f640 1 -- 172.21.15.67:0/3646314680 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f53ac079f20 msgr2=0x7f53ac07c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.888+0000 7f53ca59f640 1 --2- 172.21.15.67:0/3646314680 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f53ac079f20 0x7f53ac07c3e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f53c41975f0 tx=0x7f53b8005f90 comp rx=0 tx=0).stop 2024-08-31T05:22:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.888+0000 7f53ca59f640 1 -- 172.21.15.67:0/3646314680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c4100600 msgr2=0x7f53c4196140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.888+0000 7f53ca59f640 1 --2- 172.21.15.67:0/3646314680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c4100600 0x7f53c4196140 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f53b4006010 tx=0x7f53b40045e0 comp rx=0 tx=0).stop 2024-08-31T05:22:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.888+0000 7f53ca59f640 1 -- 172.21.15.67:0/3646314680 shutdown_connections 2024-08-31T05:22:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.888+0000 7f53ca59f640 1 --2- 172.21.15.67:0/3646314680 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f53ac079f20 0x7f53ac07c3e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.888+0000 7f53ca59f640 1 --2- 172.21.15.67:0/3646314680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53c4101800 0x7f53c4196680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.888+0000 7f53ca59f640 1 --2- 172.21.15.67:0/3646314680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53c4100600 0x7f53c4196140 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.888+0000 7f53ca59f640 1 -- 172.21.15.67:0/3646314680 >> 172.21.15.67:0/3646314680 conn(0x7f53c40fbdb0 msgr2=0x7f53c40fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.888+0000 7f53ca59f640 1 -- 172.21.15.67:0/3646314680 shutdown_connections 2024-08-31T05:22:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:39.888+0000 7f53ca59f640 1 -- 172.21.15.67:0/3646314680 wait complete. 2024-08-31T05:22:39.903 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:22:39.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:39 smithi073 ceph-mon[24726]: Upgrade: Updating mgr.smithi073.zfoyxd 2024-08-31T05:22:39.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:39 smithi073 ceph-mon[24726]: Deploying daemon mgr.smithi073.zfoyxd on smithi073 2024-08-31T05:22:40.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.040+0000 7f99c51de640 1 -- 172.21.15.67:0/21082352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99c00ff940 msgr2=0x7f99c00ffd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:40.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.040+0000 7f99c51de640 1 --2- 172.21.15.67:0/21082352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99c00ff940 0x7f99c00ffd40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f99b8005fd0 tx=0x7f99b802b510 comp rx=0 tx=0).stop 2024-08-31T05:22:40.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.040+0000 7f99c51de640 1 -- 172.21.15.67:0/21082352 shutdown_connections 2024-08-31T05:22:40.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.040+0000 7f99c51de640 1 --2- 172.21.15.67:0/21082352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99c0100b40 0x7f99c0100fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.040+0000 7f99c51de640 1 --2- 172.21.15.67:0/21082352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99c00ff940 0x7f99c00ffd40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.040+0000 7f99c51de640 1 -- 172.21.15.67:0/21082352 >> 172.21.15.67:0/21082352 conn(0x7f99c00fb0f0 msgr2=0x7f99c00fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:40.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.043+0000 7f99c51de640 1 -- 172.21.15.67:0/21082352 shutdown_connections 2024-08-31T05:22:40.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.043+0000 7f99c51de640 1 -- 172.21.15.67:0/21082352 wait complete. 2024-08-31T05:22:40.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.044+0000 7f99c51de640 1 Processor -- start 2024-08-31T05:22:40.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.044+0000 7f99c51de640 1 -- start start 2024-08-31T05:22:40.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.045+0000 7f99c51de640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99c00ff940 0x7f99c01a60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:40.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.045+0000 7f99c51de640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99c0100b40 0x7f99c01a6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:40.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.045+0000 7f99c51de640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0106fb0 con 0x7f99c0100b40 2024-08-31T05:22:40.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.045+0000 7f99c51de640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0106e30 con 0x7f99c00ff940 2024-08-31T05:22:40.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.045+0000 7f99be59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99c0100b40 0x7f99c01a6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:40.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.045+0000 7f99be59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99c0100b40 0x7f99c01a6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49454/0 (socket says 172.21.15.67:49454) 2024-08-31T05:22:40.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.045+0000 7f99be59c640 1 -- 172.21.15.67:0/3334440641 learned_addr learned my addr 172.21.15.67:0/3334440641 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:22:40.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.046+0000 7f99bed9d640 1 --2- 172.21.15.67:0/3334440641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99c00ff940 0x7f99c01a60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:40.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.046+0000 7f99be59c640 1 -- 172.21.15.67:0/3334440641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99c00ff940 msgr2=0x7f99c01a60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:40.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.046+0000 7f99be59c640 1 --2- 172.21.15.67:0/3334440641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99c00ff940 0x7f99c01a60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.046+0000 7f99be59c640 1 -- 172.21.15.67:0/3334440641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c01a6ca0 con 0x7f99c0100b40 2024-08-31T05:22:40.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.046+0000 7f99be59c640 1 --2- 172.21.15.67:0/3334440641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99c0100b40 0x7f99c01a6620 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f99a800d8d0 tx=0x7f99a800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:40.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.047+0000 7f99b7fff640 1 -- 172.21.15.67:0/3334440641 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f99a8017070 con 0x7f99c0100b40 2024-08-31T05:22:40.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.047+0000 7f99b7fff640 1 -- 172.21.15.67:0/3334440641 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f99a8010460 con 0x7f99c0100b40 2024-08-31T05:22:40.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.047+0000 7f99c51de640 1 -- 172.21.15.67:0/3334440641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c006ba70 con 0x7f99c0100b40 2024-08-31T05:22:40.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.047+0000 7f99c51de640 1 -- 172.21.15.67:0/3334440641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c006c020 con 0x7f99c0100b40 2024-08-31T05:22:40.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.047+0000 7f99b7fff640 1 -- 172.21.15.67:0/3334440641 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f99a800f5f0 con 0x7f99c0100b40 2024-08-31T05:22:40.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.049+0000 7f99c51de640 1 -- 172.21.15.67:0/3334440641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c0108ea0 con 0x7f99c0100b40 2024-08-31T05:22:40.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.053+0000 7f99b7fff640 1 -- 172.21.15.67:0/3334440641 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 31) ==== 102132+0+0 (secure 0 0 0) 0x7f99a800f790 con 0x7f99c0100b40 2024-08-31T05:22:40.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.054+0000 7f99b7fff640 1 --2- 172.21.15.67:0/3334440641 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f99ac07a0e0 0x7f99ac07c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:40.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.055+0000 7f99b7fff640 1 -- 172.21.15.67:0/3334440641 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f99a809c8d0 con 0x7f99c0100b40 2024-08-31T05:22:40.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.061+0000 7f99bed9d640 1 --2- 172.21.15.67:0/3334440641 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f99ac07a0e0 0x7f99ac07c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:40.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.061+0000 7f99b7fff640 1 -- 172.21.15.67:0/3334440641 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f99a80693f0 con 0x7f99c0100b40 2024-08-31T05:22:40.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.062+0000 7f99bed9d640 1 --2- 172.21.15.67:0/3334440641 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f99ac07a0e0 0x7f99ac07c5a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f99b8007780 tx=0x7f99b8000f40 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:40.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.318+0000 7f99c51de640 1 -- 172.21.15.67:0/3334440641 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f99c00623d0 con 0x7f99ac07a0e0 2024-08-31T05:22:40.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.319+0000 7f99b7fff640 1 -- 172.21.15.67:0/3334440641 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f99c00623d0 con 0x7f99ac07a0e0 2024-08-31T05:22:40.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.321+0000 7f99c51de640 1 -- 172.21.15.67:0/3334440641 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f99ac07a0e0 msgr2=0x7f99ac07c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:40.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.321+0000 7f99c51de640 1 --2- 172.21.15.67:0/3334440641 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f99ac07a0e0 0x7f99ac07c5a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f99b8007780 tx=0x7f99b8000f40 comp rx=0 tx=0).stop 2024-08-31T05:22:40.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.321+0000 7f99c51de640 1 -- 172.21.15.67:0/3334440641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99c0100b40 msgr2=0x7f99c01a6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:40.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.321+0000 7f99c51de640 1 --2- 172.21.15.67:0/3334440641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99c0100b40 0x7f99c01a6620 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f99a800d8d0 tx=0x7f99a800dd90 comp rx=0 tx=0).stop 2024-08-31T05:22:40.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.321+0000 7f99c51de640 1 -- 172.21.15.67:0/3334440641 shutdown_connections 2024-08-31T05:22:40.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.321+0000 7f99c51de640 1 --2- 172.21.15.67:0/3334440641 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f99ac07a0e0 0x7f99ac07c5a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.321+0000 7f99c51de640 1 --2- 172.21.15.67:0/3334440641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99c0100b40 0x7f99c01a6620 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.321+0000 7f99c51de640 1 --2- 172.21.15.67:0/3334440641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99c00ff940 0x7f99c01a60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.321+0000 7f99c51de640 1 -- 172.21.15.67:0/3334440641 >> 172.21.15.67:0/3334440641 conn(0x7f99c00fb0f0 msgr2=0x7f99c01040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:40.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.321+0000 7f99c51de640 1 -- 172.21.15.67:0/3334440641 shutdown_connections 2024-08-31T05:22:40.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.321+0000 7f99c51de640 1 -- 172.21.15.67:0/3334440641 wait complete. 2024-08-31T05:22:40.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.416+0000 7fc5e6342640 1 -- 172.21.15.67:0/3335808112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5e0104ac0 msgr2=0x7fc5e0106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:40.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.416+0000 7fc5e6342640 1 --2- 172.21.15.67:0/3335808112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5e0104ac0 0x7fc5e0106eb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc5d40098b0 tx=0x7fc5d402a4d0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.416+0000 7fc5e6342640 1 -- 172.21.15.67:0/3335808112 shutdown_connections 2024-08-31T05:22:40.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.416+0000 7fc5e6342640 1 --2- 172.21.15.67:0/3335808112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5e0104ac0 0x7fc5e0106eb0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.416+0000 7fc5e6342640 1 --2- 172.21.15.67:0/3335808112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e0102190 0x7fc5e0104580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.416+0000 7fc5e6342640 1 -- 172.21.15.67:0/3335808112 >> 172.21.15.67:0/3335808112 conn(0x7fc5e00fbdb0 msgr2=0x7fc5e00fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:40.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.416+0000 7fc5e6342640 1 -- 172.21.15.67:0/3335808112 shutdown_connections 2024-08-31T05:22:40.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.416+0000 7fc5e6342640 1 -- 172.21.15.67:0/3335808112 wait complete. 2024-08-31T05:22:40.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.417+0000 7fc5e6342640 1 Processor -- start 2024-08-31T05:22:40.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.417+0000 7fc5e6342640 1 -- start start 2024-08-31T05:22:40.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.417+0000 7fc5e6342640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e0102190 0x7fc5e01994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:40.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.417+0000 7fc5e6342640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5e0104ac0 0x7fc5e0199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:40.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.417+0000 7fc5e6342640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e010a550 con 0x7fc5e0104ac0 2024-08-31T05:22:40.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.417+0000 7fc5e6342640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e010a3d0 con 0x7fc5e0102190 2024-08-31T05:22:40.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.417+0000 7fc5dffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e0102190 0x7fc5e01994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:40.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.417+0000 7fc5dffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e0102190 0x7fc5e01994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:52404/0 (socket says 172.21.15.67:52404) 2024-08-31T05:22:40.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.417+0000 7fc5dffff640 1 -- 172.21.15.67:0/2011992350 learned_addr learned my addr 172.21.15.67:0/2011992350 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:22:40.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.418+0000 7fc5dffff640 1 -- 172.21.15.67:0/2011992350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5e0104ac0 msgr2=0x7fc5e0199a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T05:22:40.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.418+0000 7fc5dffff640 1 --2- 172.21.15.67:0/2011992350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5e0104ac0 0x7fc5e0199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.418+0000 7fc5dffff640 1 -- 172.21.15.67:0/2011992350 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e019a090 con 0x7fc5e0102190 2024-08-31T05:22:40.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.418+0000 7fc5dffff640 1 --2- 172.21.15.67:0/2011992350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e0102190 0x7fc5e01994d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000e970 tx=0x7fc5d000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:40.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.418+0000 7fc5dd7fa640 1 -- 172.21.15.67:0/2011992350 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc5d000cac0 con 0x7fc5e0102190 2024-08-31T05:22:40.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.418+0000 7fc5e6342640 1 -- 172.21.15.67:0/2011992350 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e019ead0 con 0x7fc5e0102190 2024-08-31T05:22:40.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.418+0000 7fc5dd7fa640 1 -- 172.21.15.67:0/2011992350 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc5d00054e0 con 0x7fc5e0102190 2024-08-31T05:22:40.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.418+0000 7fc5dd7fa640 1 -- 172.21.15.67:0/2011992350 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc5d0010430 con 0x7fc5e0102190 2024-08-31T05:22:40.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.419+0000 7fc5e6342640 1 -- 172.21.15.67:0/2011992350 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e019f060 con 0x7fc5e0102190 2024-08-31T05:22:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.420+0000 7fc5e6342640 1 -- 172.21.15.67:0/2011992350 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e0102570 con 0x7fc5e0102190 2024-08-31T05:22:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.421+0000 7fc5dd7fa640 1 -- 172.21.15.67:0/2011992350 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 31) ==== 102132+0+0 (secure 0 0 0) 0x7fc5d0004e80 con 0x7fc5e0102190 2024-08-31T05:22:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.421+0000 7fc5dd7fa640 1 --2- 172.21.15.67:0/2011992350 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc5c8079f20 0x7fc5c807c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.421+0000 7fc5dd7fa640 1 -- 172.21.15.67:0/2011992350 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fc5d009d2b0 con 0x7fc5e0102190 2024-08-31T05:22:40.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.421+0000 7fc5df7fe640 1 --2- 172.21.15.67:0/2011992350 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc5c8079f20 0x7fc5c807c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:40.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.422+0000 7fc5df7fe640 1 --2- 172.21.15.67:0/2011992350 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc5c8079f20 0x7fc5c807c3e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc5d40096c0 tx=0x7fc5d4000bc0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:40.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.427+0000 7fc5dd7fa640 1 -- 172.21.15.67:0/2011992350 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fc5d0064c00 con 0x7fc5e0102190 2024-08-31T05:22:40.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.661+0000 7fc5e6342640 1 -- 172.21.15.67:0/2011992350 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc5e00623d0 con 0x7fc5c8079f20 2024-08-31T05:22:40.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.676+0000 7fc5dd7fa640 1 -- 172.21.15.67:0/2011992350 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fc5e00623d0 con 0x7fc5c8079f20 2024-08-31T05:22:40.678 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:22:40.678 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (7m) 29s ago 9m 24.5M - 0.25.0 c8568f914cd2 cad2b6757f0e 2024-08-31T05:22:40.678 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (119s) 29s ago 9m 8598k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:22:40.678 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (78s) 32s ago 8m 8010k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:22:40.678 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (9m) 29s ago 9m 6895k - 19.1.1-242-g244a32d3 395b9209a980 a47c71179c57 2024-08-31T05:22:40.678 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (8m) 32s ago 8m 6895k - 19.1.1-242-g244a32d3 395b9209a980 5f2ce08c4451 2024-08-31T05:22:40.679 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (7m) 29s ago 9m 78.5M - 9.4.12 2bacad6d85d8 ac51e53c0deb 2024-08-31T05:22:40.679 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (4m) 29s ago 4m 274M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:22:40.679 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (4m) 29s ago 4m 238M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:22:40.679 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (4m) 32s ago 4m 14.1M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:22:40.679 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (4m) 32s ago 4m 15.8M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:22:40.679 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (52s) 29s ago 10m 556M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:22:40.679 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (2m) 32s ago 8m 218M - 19.3.0-4560-gd19e6118 79f4cde5e369 d18b213f9418 2024-08-31T05:22:40.679 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (10m) 29s ago 10m 53.5M 2048M 19.1.1-242-g244a32d3 395b9209a980 7082a38c8108 2024-08-31T05:22:40.679 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (8m) 32s ago 8m 45.2M 2048M 19.1.1-242-g244a32d3 395b9209a980 30ccf0ed274b 2024-08-31T05:22:40.679 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (9m) 29s ago 9m 16.9M - 1.5.0 0da6a335fe13 d7c795c5bd95 2024-08-31T05:22:40.679 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (8m) 32s ago 8m 16.2M - 1.5.0 0da6a335fe13 f718603a0e92 2024-08-31T05:22:40.679 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (7m) 29s ago 7m 174M 1216M 19.1.1-242-g244a32d3 395b9209a980 b9f3f60b65f9 2024-08-31T05:22:40.679 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (7m) 29s ago 7m 196M 1216M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:22:40.680 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (6m) 29s ago 6m 164M 1216M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:22:40.680 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (6m) 32s ago 6m 216M 2240M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:22:40.680 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (5m) 32s ago 5m 190M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:22:40.680 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (5m) 32s ago 5m 170M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:22:40.680 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 starting - - - - 2024-08-31T05:22:40.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.679+0000 7fc5e6342640 1 -- 172.21.15.67:0/2011992350 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc5c8079f20 msgr2=0x7fc5c807c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:40.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.679+0000 7fc5e6342640 1 --2- 172.21.15.67:0/2011992350 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc5c8079f20 0x7fc5c807c3e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc5d40096c0 tx=0x7fc5d4000bc0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.679+0000 7fc5e6342640 1 -- 172.21.15.67:0/2011992350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e0102190 msgr2=0x7fc5e01994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:40.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.679+0000 7fc5e6342640 1 --2- 172.21.15.67:0/2011992350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e0102190 0x7fc5e01994d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000e970 tx=0x7fc5d000ed70 comp rx=0 tx=0).stop 2024-08-31T05:22:40.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.679+0000 7fc5e6342640 1 -- 172.21.15.67:0/2011992350 shutdown_connections 2024-08-31T05:22:40.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.679+0000 7fc5e6342640 1 --2- 172.21.15.67:0/2011992350 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc5c8079f20 0x7fc5c807c3e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.679+0000 7fc5e6342640 1 --2- 172.21.15.67:0/2011992350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5e0104ac0 0x7fc5e0199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.679+0000 7fc5e6342640 1 --2- 172.21.15.67:0/2011992350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e0102190 0x7fc5e01994d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.679+0000 7fc5e6342640 1 -- 172.21.15.67:0/2011992350 >> 172.21.15.67:0/2011992350 conn(0x7fc5e00fbdb0 msgr2=0x7fc5e0101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:40.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.679+0000 7fc5e6342640 1 -- 172.21.15.67:0/2011992350 shutdown_connections 2024-08-31T05:22:40.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.679+0000 7fc5e6342640 1 -- 172.21.15.67:0/2011992350 wait complete. 2024-08-31T05:22:40.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.803+0000 7f7854ca6640 1 -- 172.21.15.67:0/1492666781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7850101700 msgr2=0x7f7850101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:40.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.803+0000 7f7854ca6640 1 --2- 172.21.15.67:0/1492666781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7850101700 0x7f7850101b00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7840009880 tx=0x7f784002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.803+0000 7f7854ca6640 1 -- 172.21.15.67:0/1492666781 shutdown_connections 2024-08-31T05:22:40.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.803+0000 7f7854ca6640 1 --2- 172.21.15.67:0/1492666781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7850102900 0x7f7850102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.803+0000 7f7854ca6640 1 --2- 172.21.15.67:0/1492666781 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7850101700 0x7f7850101b00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.803+0000 7f7854ca6640 1 -- 172.21.15.67:0/1492666781 >> 172.21.15.67:0/1492666781 conn(0x7f78500fce70 msgr2=0x7f78500ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:40.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.803+0000 7f7854ca6640 1 -- 172.21.15.67:0/1492666781 shutdown_connections 2024-08-31T05:22:40.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.804+0000 7f7854ca6640 1 -- 172.21.15.67:0/1492666781 wait complete. 2024-08-31T05:22:40.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.804+0000 7f7854ca6640 1 Processor -- start 2024-08-31T05:22:40.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.804+0000 7f7854ca6640 1 -- start start 2024-08-31T05:22:40.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.805+0000 7f7854ca6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7850101700 0x7f7850199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:40.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.805+0000 7f7854ca6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7850102900 0x7f78501999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:40.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.805+0000 7f7854ca6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f785010a520 con 0x7f7850102900 2024-08-31T05:22:40.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.805+0000 7f7854ca6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f785010a3a0 con 0x7f7850101700 2024-08-31T05:22:40.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.805+0000 7f784e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7850101700 0x7f7850199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:40.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.805+0000 7f7847fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7850102900 0x7f78501999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:40.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.805+0000 7f784e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7850101700 0x7f7850199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:52418/0 (socket says 172.21.15.67:52418) 2024-08-31T05:22:40.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.805+0000 7f784e59c640 1 -- 172.21.15.67:0/878006409 learned_addr learned my addr 172.21.15.67:0/878006409 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:22:40.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.805+0000 7f784e59c640 1 -- 172.21.15.67:0/878006409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7850102900 msgr2=0x7f78501999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:40.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.805+0000 7f784e59c640 1 --2- 172.21.15.67:0/878006409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7850102900 0x7f78501999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:40.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.805+0000 7f784e59c640 1 -- 172.21.15.67:0/878006409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785019a050 con 0x7f7850101700 2024-08-31T05:22:40.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.805+0000 7f784e59c640 1 --2- 172.21.15.67:0/878006409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7850101700 0x7f7850199490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7840009230 tx=0x7f78400045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:40.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.806+0000 7f78477fe640 1 -- 172.21.15.67:0/878006409 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f784003f070 con 0x7f7850101700 2024-08-31T05:22:40.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.806+0000 7f7854ca6640 1 -- 172.21.15.67:0/878006409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785019ea30 con 0x7f7850101700 2024-08-31T05:22:40.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.806+0000 7f78477fe640 1 -- 172.21.15.67:0/878006409 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f78400049d0 con 0x7f7850101700 2024-08-31T05:22:40.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.806+0000 7f7854ca6640 1 -- 172.21.15.67:0/878006409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f785019efc0 con 0x7f7850101700 2024-08-31T05:22:40.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.806+0000 7f78477fe640 1 -- 172.21.15.67:0/878006409 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7840035030 con 0x7f7850101700 2024-08-31T05:22:40.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.807+0000 7f7854ca6640 1 -- 172.21.15.67:0/878006409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7850101b00 con 0x7f7850101700 2024-08-31T05:22:40.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.808+0000 7f78477fe640 1 -- 172.21.15.67:0/878006409 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 31) ==== 102132+0+0 (secure 0 0 0) 0x7f7840042070 con 0x7f7850101700 2024-08-31T05:22:40.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.809+0000 7f78477fe640 1 --2- 172.21.15.67:0/878006409 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f783c079f20 0x7f783c07c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:40.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.809+0000 7f78477fe640 1 -- 172.21.15.67:0/878006409 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f78400bd5e0 con 0x7f7850101700 2024-08-31T05:22:40.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.809+0000 7f7847fff640 1 --2- 172.21.15.67:0/878006409 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f783c079f20 0x7f783c07c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:40.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.809+0000 7f7847fff640 1 --2- 172.21.15.67:0/878006409 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f783c079f20 0x7f783c07c3e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f785019a940 tx=0x7f7838005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:40.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:40.815+0000 7f78477fe640 1 -- 172.21.15.67:0/878006409 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f78400890a0 con 0x7f7850101700 2024-08-31T05:22:41.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:40 smithi067 ceph-mon[17432]: pgmap v21: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 657 op/s 2024-08-31T05:22:41.119 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:40 smithi073 ceph-mon[24726]: pgmap v21: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 657 op/s 2024-08-31T05:22:41.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.186+0000 7f7854ca6640 1 -- 172.21.15.67:0/878006409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f785019f8c0 con 0x7f7850101700 2024-08-31T05:22:41.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.186+0000 7f78477fe640 1 -- 172.21.15.67:0/878006409 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f784008d3e0 con 0x7f7850101700 2024-08-31T05:22:41.188 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:22:41.188 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:22:41.188 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2 2024-08-31T05:22:41.188 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:22:41.188 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:22:41.188 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:22:41.188 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:22:41.189 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:22:41.189 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 6 2024-08-31T05:22:41.189 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:22:41.189 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:22:41.189 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:22:41.189 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:22:41.189 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:22:41.189 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 12, 2024-08-31T05:22:41.189 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:22:41.189 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:22:41.189 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:22:41.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.189+0000 7f7854ca6640 1 -- 172.21.15.67:0/878006409 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f783c079f20 msgr2=0x7f783c07c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:41.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.189+0000 7f7854ca6640 1 --2- 172.21.15.67:0/878006409 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f783c079f20 0x7f783c07c3e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f785019a940 tx=0x7f7838005f90 comp rx=0 tx=0).stop 2024-08-31T05:22:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.189+0000 7f7854ca6640 1 -- 172.21.15.67:0/878006409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7850101700 msgr2=0x7f7850199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.189+0000 7f7854ca6640 1 --2- 172.21.15.67:0/878006409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7850101700 0x7f7850199490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7840009230 tx=0x7f78400045e0 comp rx=0 tx=0).stop 2024-08-31T05:22:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.190+0000 7f7854ca6640 1 -- 172.21.15.67:0/878006409 shutdown_connections 2024-08-31T05:22:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.190+0000 7f7854ca6640 1 --2- 172.21.15.67:0/878006409 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f783c079f20 0x7f783c07c3e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.190+0000 7f7854ca6640 1 --2- 172.21.15.67:0/878006409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7850102900 0x7f78501999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.190+0000 7f7854ca6640 1 --2- 172.21.15.67:0/878006409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7850101700 0x7f7850199490 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.190+0000 7f7854ca6640 1 -- 172.21.15.67:0/878006409 >> 172.21.15.67:0/878006409 conn(0x7f78500fce70 msgr2=0x7f7850074400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.190+0000 7f7854ca6640 1 -- 172.21.15.67:0/878006409 shutdown_connections 2024-08-31T05:22:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.190+0000 7f7854ca6640 1 -- 172.21.15.67:0/878006409 wait complete. 2024-08-31T05:22:41.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.283+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/769538806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaa0101700 msgr2=0x7fcaa0101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:41.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.283+0000 7fcaa6dbd640 1 --2- 172.21.15.67:0/769538806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaa0101700 0x7fcaa0101b00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fca94009880 tx=0x7fca9402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:22:41.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.283+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/769538806 shutdown_connections 2024-08-31T05:22:41.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.283+0000 7fcaa6dbd640 1 --2- 172.21.15.67:0/769538806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaa0102900 0x7fcaa0102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:41.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.283+0000 7fcaa6dbd640 1 --2- 172.21.15.67:0/769538806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaa0101700 0x7fcaa0101b00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:41.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.283+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/769538806 >> 172.21.15.67:0/769538806 conn(0x7fcaa00fceb0 msgr2=0x7fcaa00ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:41.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.283+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/769538806 shutdown_connections 2024-08-31T05:22:41.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.283+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/769538806 wait complete. 2024-08-31T05:22:41.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.283+0000 7fcaa6dbd640 1 Processor -- start 2024-08-31T05:22:41.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.284+0000 7fcaa6dbd640 1 -- start start 2024-08-31T05:22:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.284+0000 7fcaa6dbd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaa0101700 0x7fcaa0197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.284+0000 7fcaa6dbd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaa0102900 0x7fcaa01977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.284+0000 7fcaa6dbd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa010a540 con 0x7fcaa0102900 2024-08-31T05:22:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.284+0000 7fcaa6dbd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa010a3c0 con 0x7fcaa0101700 2024-08-31T05:22:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.284+0000 7fca9ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaa0102900 0x7fcaa01977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.284+0000 7fcaa4b59640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaa0101700 0x7fcaa0197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.284+0000 7fca9ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaa0102900 0x7fcaa01977b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49500/0 (socket says 172.21.15.67:49500) 2024-08-31T05:22:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.284+0000 7fca9ffff640 1 -- 172.21.15.67:0/4161824442 learned_addr learned my addr 172.21.15.67:0/4161824442 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:22:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.284+0000 7fcaa4b59640 1 -- 172.21.15.67:0/4161824442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaa0102900 msgr2=0x7fcaa01977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:41.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.284+0000 7fcaa4b59640 1 --2- 172.21.15.67:0/4161824442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaa0102900 0x7fcaa01977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:41.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.284+0000 7fcaa4b59640 1 -- 172.21.15.67:0/4161824442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa0197e30 con 0x7fcaa0101700 2024-08-31T05:22:41.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.284+0000 7fcaa4b59640 1 --2- 172.21.15.67:0/4161824442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaa0101700 0x7fcaa0197270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fca9402a9c0 tx=0x7fca940045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:41.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.285+0000 7fca9dffb640 1 -- 172.21.15.67:0/4161824442 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca9403f070 con 0x7fcaa0101700 2024-08-31T05:22:41.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.285+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/4161824442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa019c810 con 0x7fcaa0101700 2024-08-31T05:22:41.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.285+0000 7fca9dffb640 1 -- 172.21.15.67:0/4161824442 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca94004950 con 0x7fcaa0101700 2024-08-31T05:22:41.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.285+0000 7fca9dffb640 1 -- 172.21.15.67:0/4161824442 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca94035030 con 0x7fcaa0101700 2024-08-31T05:22:41.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.285+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/4161824442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa019cda0 con 0x7fcaa0101700 2024-08-31T05:22:41.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.286+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/4161824442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa0101b00 con 0x7fcaa0101700 2024-08-31T05:22:41.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.287+0000 7fca9dffb640 1 -- 172.21.15.67:0/4161824442 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 31) ==== 102132+0+0 (secure 0 0 0) 0x7fca94042070 con 0x7fcaa0101700 2024-08-31T05:22:41.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.287+0000 7fca9dffb640 1 --2- 172.21.15.67:0/4161824442 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fca90079f70 0x7fca9007c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:41.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.287+0000 7fca9dffb640 1 -- 172.21.15.67:0/4161824442 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fca940bd4f0 con 0x7fcaa0101700 2024-08-31T05:22:41.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.287+0000 7fca9ffff640 1 --2- 172.21.15.67:0/4161824442 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fca90079f70 0x7fca9007c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:41.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.288+0000 7fca9ffff640 1 --2- 172.21.15.67:0/4161824442 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fca90079f70 0x7fca9007c430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0198720 tx=0x7fca8c005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:41.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.293+0000 7fca9dffb640 1 -- 172.21.15.67:0/4161824442 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fca94088fb0 con 0x7fcaa0101700 2024-08-31T05:22:41.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.555+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/4161824442 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcaa0106ed0 con 0x7fca90079f70 2024-08-31T05:22:41.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.556+0000 7fca9dffb640 1 -- 172.21.15.67:0/4161824442 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7fcaa0106ed0 con 0x7fca90079f70 2024-08-31T05:22:41.558 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:22:41.558 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:22:41.558 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:22:41.558 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-31T05:22:41.558 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:22:41.558 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr" 2024-08-31T05:22:41.558 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:22:41.559 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "2/2 daemons upgraded", 2024-08-31T05:22:41.559 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading mgr daemons", 2024-08-31T05:22:41.559 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:22:41.559 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:22:41.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.559+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/4161824442 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fca90079f70 msgr2=0x7fca9007c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:41.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.559+0000 7fcaa6dbd640 1 --2- 172.21.15.67:0/4161824442 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fca90079f70 0x7fca9007c430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0198720 tx=0x7fca8c005f90 comp rx=0 tx=0).stop 2024-08-31T05:22:41.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.559+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/4161824442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaa0101700 msgr2=0x7fcaa0197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:41.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.559+0000 7fcaa6dbd640 1 --2- 172.21.15.67:0/4161824442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaa0101700 0x7fcaa0197270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fca9402a9c0 tx=0x7fca940045e0 comp rx=0 tx=0).stop 2024-08-31T05:22:41.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.560+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/4161824442 shutdown_connections 2024-08-31T05:22:41.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.560+0000 7fcaa6dbd640 1 --2- 172.21.15.67:0/4161824442 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fca90079f70 0x7fca9007c430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:41.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.560+0000 7fcaa6dbd640 1 --2- 172.21.15.67:0/4161824442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaa0102900 0x7fcaa01977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:41.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.560+0000 7fcaa6dbd640 1 --2- 172.21.15.67:0/4161824442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaa0101700 0x7fcaa0197270 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:41.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.560+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/4161824442 >> 172.21.15.67:0/4161824442 conn(0x7fcaa00fceb0 msgr2=0x7fcaa00ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:41.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.560+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/4161824442 shutdown_connections 2024-08-31T05:22:41.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:22:41.560+0000 7fcaa6dbd640 1 -- 172.21.15.67:0/4161824442 wait complete. 2024-08-31T05:22:41.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:41 smithi067 ceph-mon[17432]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:41.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:41 smithi067 ceph-mon[17432]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:41.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:41 smithi067 ceph-mon[17432]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:41.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:41 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/878006409' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:41.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:41 smithi073 ceph-mon[24726]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:41.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:41 smithi073 ceph-mon[24726]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:41.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:41 smithi073 ceph-mon[24726]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:41.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:41 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/878006409' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:42.178 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-08-31T05:22:42.178 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-08-31T05:22:42.485 DEBUG:teuthology.parallel:result is None 2024-08-31T05:22:42.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:42 smithi073 ceph-mon[24726]: from='client.24531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:42.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:42 smithi073 ceph-mon[24726]: pgmap v22: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 509 op/s 2024-08-31T05:22:42.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:42 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:42.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:42 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:42.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:42 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:22:43.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:42 smithi067 ceph-mon[17432]: from='client.24531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:43.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:42 smithi067 ceph-mon[17432]: pgmap v22: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 509 op/s 2024-08-31T05:22:43.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:42 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:43.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:42 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:43.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:42 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:22:43.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:43 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:43.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:43 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:43.768 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:43 smithi073 ceph-mon[24726]: pgmap v23: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 485 op/s 2024-08-31T05:22:44.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:43 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:44.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:43 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:44.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:43 smithi067 ceph-mon[17432]: pgmap v23: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 485 op/s 2024-08-31T05:22:46.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:46 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:46.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:46 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:46.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:46 smithi067 ceph-mon[17432]: pgmap v24: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 592 op/s 2024-08-31T05:22:46.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:46 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:46.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:46 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:46.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:46 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:46.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:46 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:46.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:46 smithi073 ceph-mon[24726]: pgmap v24: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 592 op/s 2024-08-31T05:22:46.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:46 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:46.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:46 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:48 smithi073 ceph-mon[24726]: pgmap v25: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 251 op/s 2024-08-31T05:22:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:48 smithi073 ceph-mon[24726]: Standby manager daemon smithi073.zfoyxd restarted 2024-08-31T05:22:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:48 smithi073 ceph-mon[24726]: Standby manager daemon smithi073.zfoyxd started 2024-08-31T05:22:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:48 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.73:0/3190389093' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.zfoyxd/crt"}]: dispatch 2024-08-31T05:22:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:48 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.73:0/3190389093' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T05:22:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:48 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.73:0/3190389093' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.zfoyxd/key"}]: dispatch 2024-08-31T05:22:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:48 smithi073 ceph-mon[24726]: from='mgr.? 172.21.15.73:0/3190389093' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T05:22:49.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:48 smithi067 ceph-mon[17432]: pgmap v25: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 251 op/s 2024-08-31T05:22:49.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:48 smithi067 ceph-mon[17432]: Standby manager daemon smithi073.zfoyxd restarted 2024-08-31T05:22:49.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:48 smithi067 ceph-mon[17432]: Standby manager daemon smithi073.zfoyxd started 2024-08-31T05:22:49.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:48 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.73:0/3190389093' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.zfoyxd/crt"}]: dispatch 2024-08-31T05:22:49.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:48 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.73:0/3190389093' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T05:22:49.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:48 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.73:0/3190389093' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi073.zfoyxd/key"}]: dispatch 2024-08-31T05:22:49.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:48 smithi067 ceph-mon[17432]: from='mgr.? 172.21.15.73:0/3190389093' entity='mgr.smithi073.zfoyxd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T05:22:49.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:49 smithi073 ceph-mon[24726]: mgrmap e32: smithi067.hftacj(active, since 45s), standbys: smithi073.zfoyxd 2024-08-31T05:22:49.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:49 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:22:49.921 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:49 smithi067 ceph-mon[17432]: mgrmap e32: smithi067.hftacj(active, since 45s), standbys: smithi073.zfoyxd 2024-08-31T05:22:49.921 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:49 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:22:50.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: pgmap v26: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 381 op/s 2024-08-31T05:22:50.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:50.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:50.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:50.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:50.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:22:50.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:22:50.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:50.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:22:50.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:50.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:50.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi067.hftacj"}]: dispatch 2024-08-31T05:22:50.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi067.hftacj"}]': finished 2024-08-31T05:22:50.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi073.zfoyxd"}]: dispatch 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi073.zfoyxd"}]': finished 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:50.949 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:50 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: pgmap v26: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 381 op/s 2024-08-31T05:22:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:22:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:22:51.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:51.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:22:51.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:51.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:51.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi067.hftacj"}]: dispatch 2024-08-31T05:22:51.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi067.hftacj"}]': finished 2024-08-31T05:22:51.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi073.zfoyxd"}]: dispatch 2024-08-31T05:22:51.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi073.zfoyxd"}]': finished 2024-08-31T05:22:51.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:51.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:51.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:51.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:51.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:51.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:51.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:51.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:51.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:51.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:51.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:22:51.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:50 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:22:51.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:51 smithi073 ceph-mon[24726]: Upgrade: Setting container_image for all mgr 2024-08-31T05:22:51.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:51 smithi073 ceph-mon[24726]: Upgrade: Setting container_image for all rgw 2024-08-31T05:22:51.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:51 smithi073 ceph-mon[24726]: Upgrade: Setting container_image for all rbd-mirror 2024-08-31T05:22:51.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:51 smithi073 ceph-mon[24726]: Upgrade: Setting container_image for all cephfs-mirror 2024-08-31T05:22:51.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:51 smithi073 ceph-mon[24726]: Upgrade: Setting container_image for all iscsi 2024-08-31T05:22:51.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:51 smithi073 ceph-mon[24726]: Upgrade: Setting container_image for all nfs 2024-08-31T05:22:51.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:51 smithi073 ceph-mon[24726]: Upgrade: Setting container_image for all nvmeof 2024-08-31T05:22:52.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:51 smithi067 ceph-mon[17432]: Upgrade: Setting container_image for all mgr 2024-08-31T05:22:52.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:51 smithi067 ceph-mon[17432]: Upgrade: Setting container_image for all rgw 2024-08-31T05:22:52.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:51 smithi067 ceph-mon[17432]: Upgrade: Setting container_image for all rbd-mirror 2024-08-31T05:22:52.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:51 smithi067 ceph-mon[17432]: Upgrade: Setting container_image for all cephfs-mirror 2024-08-31T05:22:52.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:51 smithi067 ceph-mon[17432]: Upgrade: Setting container_image for all iscsi 2024-08-31T05:22:52.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:51 smithi067 ceph-mon[17432]: Upgrade: Setting container_image for all nfs 2024-08-31T05:22:52.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:51 smithi067 ceph-mon[17432]: Upgrade: Setting container_image for all nvmeof 2024-08-31T05:22:52.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:52 smithi073 ceph-mon[24726]: pgmap v27: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 236 op/s 2024-08-31T05:22:53.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:52 smithi067 ceph-mon[17432]: pgmap v27: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 236 op/s 2024-08-31T05:22:54.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:54 smithi067 ceph-mon[17432]: pgmap v28: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 236 op/s 2024-08-31T05:22:54.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:54 smithi073 ceph-mon[24726]: pgmap v28: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 236 op/s 2024-08-31T05:22:55.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:55 smithi073 ceph-mon[24726]: Upgrade: Updating node-exporter.smithi067 (1/2) 2024-08-31T05:22:55.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:55 smithi073 ceph-mon[24726]: Deploying daemon node-exporter.smithi067 on smithi067 2024-08-31T05:22:56.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:55 smithi067 ceph-mon[17432]: Upgrade: Updating node-exporter.smithi067 (1/2) 2024-08-31T05:22:56.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:55 smithi067 ceph-mon[17432]: Deploying daemon node-exporter.smithi067 on smithi067 2024-08-31T05:22:56.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:56 smithi073 ceph-mon[24726]: pgmap v29: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 285 op/s 2024-08-31T05:22:57.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:56 smithi067 ceph-mon[17432]: pgmap v29: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 285 op/s 2024-08-31T05:22:58.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:22:58 smithi067 ceph-mon[17432]: pgmap v30: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 178 op/s 2024-08-31T05:22:58.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:22:58 smithi073 ceph-mon[24726]: pgmap v30: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 178 op/s 2024-08-31T05:23:00.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:00 smithi073 ceph-mon[24726]: pgmap v31: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 259 op/s 2024-08-31T05:23:01.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:00 smithi067 ceph-mon[17432]: pgmap v31: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 259 op/s 2024-08-31T05:23:02.597 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-08-31T05:23:02.597 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-31T05:23:02.890 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:02 smithi067 ceph-mon[17432]: pgmap v32: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1016 KiB/s wr, 129 op/s 2024-08-31T05:23:02.891 DEBUG:teuthology.parallel:result is None 2024-08-31T05:23:02.891 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-31T05:23:02.924 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-31T05:23:02.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-08-31T05:23:02.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:02 smithi073 ceph-mon[24726]: pgmap v32: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1016 KiB/s wr, 129 op/s 2024-08-31T05:23:03.000 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-08-31T05:23:03.000 DEBUG:teuthology.parallel:result is None 2024-08-31T05:23:04.931 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:04 smithi067 ceph-mon[17432]: pgmap v33: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1016 KiB/s wr, 129 op/s 2024-08-31T05:23:04.931 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:23:05.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:04 smithi073 ceph-mon[24726]: pgmap v33: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1016 KiB/s wr, 129 op/s 2024-08-31T05:23:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:23:06.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:06 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:06.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:06 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:06.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:06 smithi073 ceph-mon[24726]: pgmap v34: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 185 op/s 2024-08-31T05:23:06.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:06 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:06.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:06 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:06.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:06 smithi067 ceph-mon[17432]: pgmap v34: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 185 op/s 2024-08-31T05:23:07.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:07 smithi073 ceph-mon[24726]: Upgrade: Updating node-exporter.smithi073 (2/2) 2024-08-31T05:23:07.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:07 smithi073 ceph-mon[24726]: Deploying daemon node-exporter.smithi073 on smithi073 2024-08-31T05:23:07.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:07 smithi067 ceph-mon[17432]: Upgrade: Updating node-exporter.smithi073 (2/2) 2024-08-31T05:23:07.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:07 smithi067 ceph-mon[17432]: Deploying daemon node-exporter.smithi073 on smithi073 2024-08-31T05:23:08.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:08 smithi073 ceph-mon[24726]: pgmap v35: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 KiB/s rd, 745 KiB/s wr, 135 op/s 2024-08-31T05:23:08.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:08 smithi067 ceph-mon[17432]: pgmap v35: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 KiB/s rd, 745 KiB/s wr, 135 op/s 2024-08-31T05:23:10.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:10 smithi073 ceph-mon[24726]: pgmap v36: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 783 KiB/s rd, 761 KiB/s wr, 140 op/s 2024-08-31T05:23:10.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:10 smithi067 ceph-mon[17432]: pgmap v36: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 783 KiB/s rd, 761 KiB/s wr, 140 op/s 2024-08-31T05:23:11.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.653+0000 7f84b32b8640 1 -- 172.21.15.67:0/991056366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84ac101800 msgr2=0x7f84ac101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:11.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.653+0000 7f84b32b8640 1 --2- 172.21.15.67:0/991056366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84ac101800 0x7f84ac101c80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f849c009880 tx=0x7f849c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:23:11.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.653+0000 7f84b32b8640 1 -- 172.21.15.67:0/991056366 shutdown_connections 2024-08-31T05:23:11.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.653+0000 7f84b32b8640 1 --2- 172.21.15.67:0/991056366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84ac101800 0x7f84ac101c80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:11.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.653+0000 7f84b32b8640 1 --2- 172.21.15.67:0/991056366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84ac100600 0x7f84ac100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:11.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.653+0000 7f84b32b8640 1 -- 172.21.15.67:0/991056366 >> 172.21.15.67:0/991056366 conn(0x7f84ac0fbdb0 msgr2=0x7f84ac0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:11.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.653+0000 7f84b32b8640 1 -- 172.21.15.67:0/991056366 shutdown_connections 2024-08-31T05:23:11.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.653+0000 7f84b32b8640 1 -- 172.21.15.67:0/991056366 wait complete. 2024-08-31T05:23:11.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.653+0000 7f84b32b8640 1 Processor -- start 2024-08-31T05:23:11.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.653+0000 7f84b32b8640 1 -- start start 2024-08-31T05:23:11.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.654+0000 7f84b32b8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84ac100600 0x7f84ac197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:11.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.654+0000 7f84b32b8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84ac101800 0x7f84ac1977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:11.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.654+0000 7f84b32b8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac109420 con 0x7f84ac100600 2024-08-31T05:23:11.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.654+0000 7f84b32b8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac1092a0 con 0x7f84ac101800 2024-08-31T05:23:11.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.654+0000 7f84b1054640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84ac100600 0x7f84ac197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:11.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.654+0000 7f84b1054640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84ac100600 0x7f84ac197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33846/0 (socket says 172.21.15.67:33846) 2024-08-31T05:23:11.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.654+0000 7f84b1054640 1 -- 172.21.15.67:0/4175612040 learned_addr learned my addr 172.21.15.67:0/4175612040 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:23:11.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.654+0000 7f84b0853640 1 --2- 172.21.15.67:0/4175612040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84ac101800 0x7f84ac1977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:11.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.654+0000 7f84b1054640 1 -- 172.21.15.67:0/4175612040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84ac101800 msgr2=0x7f84ac1977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:11.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.654+0000 7f84b1054640 1 --2- 172.21.15.67:0/4175612040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84ac101800 0x7f84ac1977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:11.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.654+0000 7f84b1054640 1 -- 172.21.15.67:0/4175612040 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac197e30 con 0x7f84ac100600 2024-08-31T05:23:11.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.654+0000 7f84b1054640 1 --2- 172.21.15.67:0/4175612040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84ac100600 0x7f84ac197270 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f84a800e940 tx=0x7f84a800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:11.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.655+0000 7f84a27fc640 1 -- 172.21.15.67:0/4175612040 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84a800cac0 con 0x7f84ac100600 2024-08-31T05:23:11.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.655+0000 7f84b32b8640 1 -- 172.21.15.67:0/4175612040 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ac19c870 con 0x7f84ac100600 2024-08-31T05:23:11.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.655+0000 7f84a27fc640 1 -- 172.21.15.67:0/4175612040 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84a800cc60 con 0x7f84ac100600 2024-08-31T05:23:11.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.655+0000 7f84a27fc640 1 -- 172.21.15.67:0/4175612040 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84a8003de0 con 0x7f84ac100600 2024-08-31T05:23:11.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.655+0000 7f84b32b8640 1 -- 172.21.15.67:0/4175612040 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ac19cdd0 con 0x7f84ac100600 2024-08-31T05:23:11.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.656+0000 7f84b32b8640 1 -- 172.21.15.67:0/4175612040 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84ac109c00 con 0x7f84ac100600 2024-08-31T05:23:11.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.657+0000 7f84a27fc640 1 -- 172.21.15.67:0/4175612040 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 32) ==== 102132+0+0 (secure 0 0 0) 0x7f84a8003fa0 con 0x7f84ac100600 2024-08-31T05:23:11.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.657+0000 7f84a27fc640 1 --2- 172.21.15.67:0/4175612040 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8498079f20 0x7f849807c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:11.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.657+0000 7f84a27fc640 1 -- 172.21.15.67:0/4175612040 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f84a809d220 con 0x7f84ac100600 2024-08-31T05:23:11.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.657+0000 7f84b0853640 1 --2- 172.21.15.67:0/4175612040 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8498079f20 0x7f849807c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:11.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.658+0000 7f84b0853640 1 --2- 172.21.15.67:0/4175612040 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8498079f20 0x7f849807c3e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f849c000c00 tx=0x7f849c0058d0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:11.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.663+0000 7f84a27fc640 1 -- 172.21.15.67:0/4175612040 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f84a8064b70 con 0x7f84ac100600 2024-08-31T05:23:11.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.880+0000 7f84b32b8640 1 -- 172.21.15.67:0/4175612040 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f84ac06aa20 con 0x7f8498079f20 2024-08-31T05:23:11.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.881+0000 7f84a27fc640 1 -- 172.21.15.67:0/4175612040 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f84ac06aa20 con 0x7f8498079f20 2024-08-31T05:23:11.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.883+0000 7f84b32b8640 1 -- 172.21.15.67:0/4175612040 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8498079f20 msgr2=0x7f849807c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:11.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.883+0000 7f84b32b8640 1 --2- 172.21.15.67:0/4175612040 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8498079f20 0x7f849807c3e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f849c000c00 tx=0x7f849c0058d0 comp rx=0 tx=0).stop 2024-08-31T05:23:11.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.883+0000 7f84b32b8640 1 -- 172.21.15.67:0/4175612040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84ac100600 msgr2=0x7f84ac197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:11.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.883+0000 7f84b32b8640 1 --2- 172.21.15.67:0/4175612040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84ac100600 0x7f84ac197270 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f84a800e940 tx=0x7f84a800ee00 comp rx=0 tx=0).stop 2024-08-31T05:23:11.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.883+0000 7f84b32b8640 1 -- 172.21.15.67:0/4175612040 shutdown_connections 2024-08-31T05:23:11.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.883+0000 7f84b32b8640 1 --2- 172.21.15.67:0/4175612040 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8498079f20 0x7f849807c3e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:11.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.883+0000 7f84b32b8640 1 --2- 172.21.15.67:0/4175612040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84ac101800 0x7f84ac1977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:11.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.883+0000 7f84b32b8640 1 --2- 172.21.15.67:0/4175612040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84ac100600 0x7f84ac197270 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:11.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.883+0000 7f84b32b8640 1 -- 172.21.15.67:0/4175612040 >> 172.21.15.67:0/4175612040 conn(0x7f84ac0fbdb0 msgr2=0x7f84ac06a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:11.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.883+0000 7f84b32b8640 1 -- 172.21.15.67:0/4175612040 shutdown_connections 2024-08-31T05:23:11.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.883+0000 7f84b32b8640 1 -- 172.21.15.67:0/4175612040 wait complete. 2024-08-31T05:23:11.895 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:23:11.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.968+0000 7f132dac1640 1 -- 172.21.15.67:0/871562120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1328102900 msgr2=0x7f1328102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:11.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.968+0000 7f132dac1640 1 --2- 172.21.15.67:0/871562120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1328102900 0x7f1328102d80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1310009880 tx=0x7f131002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:23:11.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.968+0000 7f132dac1640 1 -- 172.21.15.67:0/871562120 shutdown_connections 2024-08-31T05:23:11.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.968+0000 7f132dac1640 1 --2- 172.21.15.67:0/871562120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1328102900 0x7f1328102d80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:11.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.968+0000 7f132dac1640 1 --2- 172.21.15.67:0/871562120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1328101700 0x7f1328101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:11.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.968+0000 7f132dac1640 1 -- 172.21.15.67:0/871562120 >> 172.21.15.67:0/871562120 conn(0x7f13280fce90 msgr2=0x7f13280ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:11.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.968+0000 7f132dac1640 1 -- 172.21.15.67:0/871562120 shutdown_connections 2024-08-31T05:23:11.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.968+0000 7f132dac1640 1 -- 172.21.15.67:0/871562120 wait complete. 2024-08-31T05:23:11.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.969+0000 7f132dac1640 1 Processor -- start 2024-08-31T05:23:11.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.969+0000 7f132dac1640 1 -- start start 2024-08-31T05:23:11.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.969+0000 7f132dac1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1328101700 0x7f1328197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:11.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.969+0000 7f132dac1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1328102900 0x7f1328197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:11.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.969+0000 7f132dac1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f132810a540 con 0x7f1328102900 2024-08-31T05:23:11.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.969+0000 7f132dac1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f132810a3c0 con 0x7f1328101700 2024-08-31T05:23:11.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.969+0000 7f131effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1328102900 0x7f1328197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:11.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.970+0000 7f131effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1328102900 0x7f1328197770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33860/0 (socket says 172.21.15.67:33860) 2024-08-31T05:23:11.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.970+0000 7f131effd640 1 -- 172.21.15.67:0/518955171 learned_addr learned my addr 172.21.15.67:0/518955171 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:23:11.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.970+0000 7f13277fe640 1 --2- 172.21.15.67:0/518955171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1328101700 0x7f1328197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:11.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.970+0000 7f131effd640 1 -- 172.21.15.67:0/518955171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1328101700 msgr2=0x7f1328197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:11.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.970+0000 7f131effd640 1 --2- 172.21.15.67:0/518955171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1328101700 0x7f1328197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:11.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.970+0000 7f131effd640 1 -- 172.21.15.67:0/518955171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1328197df0 con 0x7f1328102900 2024-08-31T05:23:11.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.970+0000 7f131effd640 1 --2- 172.21.15.67:0/518955171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1328102900 0x7f1328197770 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1310006010 tx=0x7f1310004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:11.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.970+0000 7f13257fa640 1 -- 172.21.15.67:0/518955171 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f131003f070 con 0x7f1328102900 2024-08-31T05:23:11.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.970+0000 7f13257fa640 1 -- 172.21.15.67:0/518955171 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13100049d0 con 0x7f1328102900 2024-08-31T05:23:11.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.970+0000 7f132dac1640 1 -- 172.21.15.67:0/518955171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132819c7d0 con 0x7f1328102900 2024-08-31T05:23:11.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.970+0000 7f13257fa640 1 -- 172.21.15.67:0/518955171 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1310035030 con 0x7f1328102900 2024-08-31T05:23:11.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.970+0000 7f132dac1640 1 -- 172.21.15.67:0/518955171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f132819cd60 con 0x7f1328102900 2024-08-31T05:23:11.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.971+0000 7f132dac1640 1 -- 172.21.15.67:0/518955171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1328101b00 con 0x7f1328102900 2024-08-31T05:23:11.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.972+0000 7f13257fa640 1 -- 172.21.15.67:0/518955171 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 32) ==== 102132+0+0 (secure 0 0 0) 0x7f1310042070 con 0x7f1328102900 2024-08-31T05:23:11.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.973+0000 7f13257fa640 1 --2- 172.21.15.67:0/518955171 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1314079f70 0x7f131407c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:11.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.973+0000 7f13257fa640 1 -- 172.21.15.67:0/518955171 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f13100bd5f0 con 0x7f1328102900 2024-08-31T05:23:11.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.973+0000 7f13277fe640 1 --2- 172.21.15.67:0/518955171 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1314079f70 0x7f131407c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:11.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.973+0000 7f13277fe640 1 --2- 172.21.15.67:0/518955171 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1314079f70 0x7f131407c430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1328102760 tx=0x7f1318005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:11.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:11.977+0000 7f13257fa640 1 -- 172.21.15.67:0/518955171 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f1310089130 con 0x7f1328102900 2024-08-31T05:23:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.189+0000 7f132dac1640 1 -- 172.21.15.67:0/518955171 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f13280624e0 con 0x7f1314079f70 2024-08-31T05:23:12.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.190+0000 7f13257fa640 1 -- 172.21.15.67:0/518955171 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f13280624e0 con 0x7f1314079f70 2024-08-31T05:23:12.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.193+0000 7f132dac1640 1 -- 172.21.15.67:0/518955171 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1314079f70 msgr2=0x7f131407c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.193+0000 7f132dac1640 1 --2- 172.21.15.67:0/518955171 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1314079f70 0x7f131407c430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1328102760 tx=0x7f1318005f90 comp rx=0 tx=0).stop 2024-08-31T05:23:12.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.193+0000 7f132dac1640 1 -- 172.21.15.67:0/518955171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1328102900 msgr2=0x7f1328197770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.193+0000 7f132dac1640 1 --2- 172.21.15.67:0/518955171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1328102900 0x7f1328197770 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1310006010 tx=0x7f1310004570 comp rx=0 tx=0).stop 2024-08-31T05:23:12.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.193+0000 7f132dac1640 1 -- 172.21.15.67:0/518955171 shutdown_connections 2024-08-31T05:23:12.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.193+0000 7f132dac1640 1 --2- 172.21.15.67:0/518955171 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1314079f70 0x7f131407c430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.193+0000 7f132dac1640 1 --2- 172.21.15.67:0/518955171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1328102900 0x7f1328197770 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.193+0000 7f132dac1640 1 --2- 172.21.15.67:0/518955171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1328101700 0x7f1328197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.193+0000 7f132dac1640 1 -- 172.21.15.67:0/518955171 >> 172.21.15.67:0/518955171 conn(0x7f13280fce90 msgr2=0x7f1328105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:12.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.193+0000 7f132dac1640 1 -- 172.21.15.67:0/518955171 shutdown_connections 2024-08-31T05:23:12.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.193+0000 7f132dac1640 1 -- 172.21.15.67:0/518955171 wait complete. 2024-08-31T05:23:12.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.276+0000 7ff2b94d4640 1 -- 172.21.15.67:0/1285608327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b4100600 msgr2=0x7ff2b4100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.276+0000 7ff2b94d4640 1 --2- 172.21.15.67:0/1285608327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b4100600 0x7ff2b4100a00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac009880 tx=0x7ff2ac02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.276+0000 7ff2b94d4640 1 -- 172.21.15.67:0/1285608327 shutdown_connections 2024-08-31T05:23:12.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.276+0000 7ff2b94d4640 1 --2- 172.21.15.67:0/1285608327 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2b4101800 0x7ff2b4101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.276+0000 7ff2b94d4640 1 --2- 172.21.15.67:0/1285608327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b4100600 0x7ff2b4100a00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.276+0000 7ff2b94d4640 1 -- 172.21.15.67:0/1285608327 >> 172.21.15.67:0/1285608327 conn(0x7ff2b40fbdb0 msgr2=0x7ff2b40fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:12.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.276+0000 7ff2b94d4640 1 -- 172.21.15.67:0/1285608327 shutdown_connections 2024-08-31T05:23:12.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.276+0000 7ff2b94d4640 1 -- 172.21.15.67:0/1285608327 wait complete. 2024-08-31T05:23:12.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.277+0000 7ff2b94d4640 1 Processor -- start 2024-08-31T05:23:12.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.277+0000 7ff2b94d4640 1 -- start start 2024-08-31T05:23:12.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2b94d4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2b4100600 0x7ff2b406a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:12.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2b94d4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b4101800 0x7ff2b419bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:12.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2b94d4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b4109440 con 0x7ff2b4101800 2024-08-31T05:23:12.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2b94d4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b41092c0 con 0x7ff2b4100600 2024-08-31T05:23:12.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2b27fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b4101800 0x7ff2b419bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:12.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2b27fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b4101800 0x7ff2b419bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33890/0 (socket says 172.21.15.67:33890) 2024-08-31T05:23:12.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2b27fc640 1 -- 172.21.15.67:0/3925157928 learned_addr learned my addr 172.21.15.67:0/3925157928 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:23:12.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2b2ffd640 1 --2- 172.21.15.67:0/3925157928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2b4100600 0x7ff2b406a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:12.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2b27fc640 1 -- 172.21.15.67:0/3925157928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2b4100600 msgr2=0x7ff2b406a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2b27fc640 1 --2- 172.21.15.67:0/3925157928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2b4100600 0x7ff2b406a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2b27fc640 1 -- 172.21.15.67:0/3925157928 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b419c590 con 0x7ff2b4101800 2024-08-31T05:23:12.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2b27fc640 1 --2- 172.21.15.67:0/3925157928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b4101800 0x7ff2b419bfd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00d6f0 tx=0x7ff29c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:12.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2abfff640 1 -- 172.21.15.67:0/3925157928 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff29c017070 con 0x7ff2b4101800 2024-08-31T05:23:12.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2abfff640 1 -- 172.21.15.67:0/3925157928 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff29c00de00 con 0x7ff2b4101800 2024-08-31T05:23:12.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2b94d4640 1 -- 172.21.15.67:0/3925157928 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b419c880 con 0x7ff2b4101800 2024-08-31T05:23:12.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2abfff640 1 -- 172.21.15.67:0/3925157928 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff29c004bb0 con 0x7ff2b4101800 2024-08-31T05:23:12.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.278+0000 7ff2b94d4640 1 -- 172.21.15.67:0/3925157928 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b419ce10 con 0x7ff2b4101800 2024-08-31T05:23:12.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.279+0000 7ff2b94d4640 1 -- 172.21.15.67:0/3925157928 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b4100a00 con 0x7ff2b4101800 2024-08-31T05:23:12.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.280+0000 7ff2abfff640 1 -- 172.21.15.67:0/3925157928 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 32) ==== 102132+0+0 (secure 0 0 0) 0x7ff29c009a30 con 0x7ff2b4101800 2024-08-31T05:23:12.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.281+0000 7ff2abfff640 1 --2- 172.21.15.67:0/3925157928 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7ff2a0079f70 0x7ff2a007c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:12.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.281+0000 7ff2abfff640 1 -- 172.21.15.67:0/3925157928 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7ff29c09c700 con 0x7ff2b4101800 2024-08-31T05:23:12.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.281+0000 7ff2b2ffd640 1 --2- 172.21.15.67:0/3925157928 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7ff2a0079f70 0x7ff2a007c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:12.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.281+0000 7ff2b2ffd640 1 --2- 172.21.15.67:0/3925157928 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7ff2a0079f70 0x7ff2a007c430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac009230 tx=0x7ff2ac0058d0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:12.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.285+0000 7ff2abfff640 1 -- 172.21.15.67:0/3925157928 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7ff29c068130 con 0x7ff2b4101800 2024-08-31T05:23:12.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.483+0000 7ff2b94d4640 1 -- 172.21.15.67:0/3925157928 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff2b4062490 con 0x7ff2a0079f70 2024-08-31T05:23:12.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.493+0000 7ff2abfff640 1 -- 172.21.15.67:0/3925157928 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7ff2b4062490 con 0x7ff2a0079f70 2024-08-31T05:23:12.496 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:23:12.496 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (8m) 22s ago 9m 24.5M - 0.25.0 c8568f914cd2 cad2b6757f0e 2024-08-31T05:23:12.496 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (2m) 22s ago 10m 8644k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:23:12.496 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (110s) 26s ago 9m 8090k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:23:12.496 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (10m) 22s ago 10m 6895k - 19.1.1-242-g244a32d3 395b9209a980 a47c71179c57 2024-08-31T05:23:12.496 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (9m) 26s ago 9m 6895k - 19.1.1-242-g244a32d3 395b9209a980 5f2ce08c4451 2024-08-31T05:23:12.496 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (8m) 22s ago 9m 78.7M - 9.4.12 2bacad6d85d8 ac51e53c0deb 2024-08-31T05:23:12.496 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (4m) 22s ago 4m 217M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:23:12.496 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (4m) 22s ago 4m 215M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:23:12.496 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (4m) 26s ago 4m 14.5M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:23:12.497 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (4m) 26s ago 4m 16.2M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:23:12.497 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (84s) 22s ago 11m 573M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:23:12.497 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (30s) 26s ago 9m 139M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:23:12.497 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (11m) 22s ago 11m 55.5M 2048M 19.1.1-242-g244a32d3 395b9209a980 7082a38c8108 2024-08-31T05:23:12.497 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (9m) 26s ago 9m 46.7M 2048M 19.1.1-242-g244a32d3 395b9209a980 30ccf0ed274b 2024-08-31T05:23:12.497 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 starting - - - - 2024-08-31T05:23:12.497 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 starting - - - - 2024-08-31T05:23:12.497 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (8m) 22s ago 8m 194M 1216M 19.1.1-242-g244a32d3 395b9209a980 b9f3f60b65f9 2024-08-31T05:23:12.497 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (7m) 22s ago 7m 212M 1216M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:23:12.497 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (7m) 22s ago 7m 183M 1216M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:23:12.497 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (6m) 26s ago 6m 249M 2240M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:23:12.497 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (6m) 26s ago 6m 207M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:23:12.497 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (5m) 26s ago 5m 181M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:23:12.497 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (36s) 22s ago 9m 40.6M - 2.43.0 a07b618ecd1d 67c52844971d 2024-08-31T05:23:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.496+0000 7ff2b94d4640 1 -- 172.21.15.67:0/3925157928 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7ff2a0079f70 msgr2=0x7ff2a007c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.496+0000 7ff2b94d4640 1 --2- 172.21.15.67:0/3925157928 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7ff2a0079f70 0x7ff2a007c430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac009230 tx=0x7ff2ac0058d0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.496+0000 7ff2b94d4640 1 -- 172.21.15.67:0/3925157928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b4101800 msgr2=0x7ff2b419bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.496+0000 7ff2b94d4640 1 --2- 172.21.15.67:0/3925157928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b4101800 0x7ff2b419bfd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00d6f0 tx=0x7ff29c00dbb0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.496+0000 7ff2b94d4640 1 -- 172.21.15.67:0/3925157928 shutdown_connections 2024-08-31T05:23:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.496+0000 7ff2b94d4640 1 --2- 172.21.15.67:0/3925157928 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7ff2a0079f70 0x7ff2a007c430 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.496+0000 7ff2b94d4640 1 --2- 172.21.15.67:0/3925157928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2b4101800 0x7ff2b419bfd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.496+0000 7ff2b94d4640 1 --2- 172.21.15.67:0/3925157928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2b4100600 0x7ff2b406a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.496+0000 7ff2b94d4640 1 -- 172.21.15.67:0/3925157928 >> 172.21.15.67:0/3925157928 conn(0x7ff2b40fbdb0 msgr2=0x7ff2b4104d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:12.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.496+0000 7ff2b94d4640 1 -- 172.21.15.67:0/3925157928 shutdown_connections 2024-08-31T05:23:12.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.496+0000 7ff2b94d4640 1 -- 172.21.15.67:0/3925157928 wait complete. 2024-08-31T05:23:12.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:12 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:12.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:12 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:12.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:12 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:23:12.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:12 smithi067 ceph-mon[17432]: pgmap v37: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 292 KiB/s rd, 289 KiB/s wr, 59 op/s 2024-08-31T05:23:12.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.581+0000 7fc2219e1640 1 -- 172.21.15.67:0/1351314248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc21c102910 msgr2=0x7fc21c102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.581+0000 7fc2219e1640 1 --2- 172.21.15.67:0/1351314248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc21c102910 0x7fc21c102d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc204009880 tx=0x7fc20402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.581+0000 7fc2219e1640 1 -- 172.21.15.67:0/1351314248 shutdown_connections 2024-08-31T05:23:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.581+0000 7fc2219e1640 1 --2- 172.21.15.67:0/1351314248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc21c102910 0x7fc21c102d90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.581+0000 7fc2219e1640 1 --2- 172.21.15.67:0/1351314248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc21c101710 0x7fc21c101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.581+0000 7fc2219e1640 1 -- 172.21.15.67:0/1351314248 >> 172.21.15.67:0/1351314248 conn(0x7fc21c0fcee0 msgr2=0x7fc21c0ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.581+0000 7fc2219e1640 1 -- 172.21.15.67:0/1351314248 shutdown_connections 2024-08-31T05:23:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.581+0000 7fc2219e1640 1 -- 172.21.15.67:0/1351314248 wait complete. 2024-08-31T05:23:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.581+0000 7fc2219e1640 1 Processor -- start 2024-08-31T05:23:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.581+0000 7fc2219e1640 1 -- start start 2024-08-31T05:23:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc2219e1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc21c101710 0x7fc21c075cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc2219e1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc21c102910 0x7fc21c074380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:12.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc2219e1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c10a530 con 0x7fc21c101710 2024-08-31T05:23:12.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc2219e1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c10a3b0 con 0x7fc21c102910 2024-08-31T05:23:12.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc21affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc21c101710 0x7fc21c075cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:12.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc21affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc21c101710 0x7fc21c075cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33912/0 (socket says 172.21.15.67:33912) 2024-08-31T05:23:12.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc21affd640 1 -- 172.21.15.67:0/4179714300 learned_addr learned my addr 172.21.15.67:0/4179714300 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:23:12.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc213fff640 1 --2- 172.21.15.67:0/4179714300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc21c102910 0x7fc21c074380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:12.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc21affd640 1 -- 172.21.15.67:0/4179714300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc21c102910 msgr2=0x7fc21c074380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc21affd640 1 --2- 172.21.15.67:0/4179714300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc21c102910 0x7fc21c074380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc21affd640 1 -- 172.21.15.67:0/4179714300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21c0748c0 con 0x7fc21c101710 2024-08-31T05:23:12.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc213fff640 1 --2- 172.21.15.67:0/4179714300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc21c102910 0x7fc21c074380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:23:12.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc21affd640 1 --2- 172.21.15.67:0/4179714300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc21c101710 0x7fc21c075cc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00d6f0 tx=0x7fc20c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:12.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc2209df640 1 -- 172.21.15.67:0/4179714300 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc20c017070 con 0x7fc21c101710 2024-08-31T05:23:12.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc2209df640 1 -- 172.21.15.67:0/4179714300 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc20c00de00 con 0x7fc21c101710 2024-08-31T05:23:12.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc2219e1640 1 -- 172.21.15.67:0/4179714300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21c074bb0 con 0x7fc21c101710 2024-08-31T05:23:12.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc2209df640 1 -- 172.21.15.67:0/4179714300 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc20c003bc0 con 0x7fc21c101710 2024-08-31T05:23:12.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.582+0000 7fc2219e1640 1 -- 172.21.15.67:0/4179714300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21c075140 con 0x7fc21c101710 2024-08-31T05:23:12.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.583+0000 7fc2219e1640 1 -- 172.21.15.67:0/4179714300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc21c101b10 con 0x7fc21c101710 2024-08-31T05:23:12.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.584+0000 7fc2209df640 1 -- 172.21.15.67:0/4179714300 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 32) ==== 102132+0+0 (secure 0 0 0) 0x7fc20c009a30 con 0x7fc21c101710 2024-08-31T05:23:12.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.585+0000 7fc2209df640 1 --2- 172.21.15.67:0/4179714300 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc208079f70 0x7fc20807c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:12.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.585+0000 7fc213fff640 1 --2- 172.21.15.67:0/4179714300 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc208079f70 0x7fc20807c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:12.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.585+0000 7fc2209df640 1 -- 172.21.15.67:0/4179714300 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fc20c09c610 con 0x7fc21c101710 2024-08-31T05:23:12.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.585+0000 7fc213fff640 1 --2- 172.21.15.67:0/4179714300 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc208079f70 0x7fc20807c430 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc204006010 tx=0x7fc204000bc0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:12.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.589+0000 7fc2209df640 1 -- 172.21.15.67:0/4179714300 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fc20c063fe0 con 0x7fc21c101710 2024-08-31T05:23:12.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:12 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:12.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:12 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:12.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:12 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:23:12.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:12 smithi073 ceph-mon[24726]: pgmap v37: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 292 KiB/s rd, 289 KiB/s wr, 59 op/s 2024-08-31T05:23:12.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.849+0000 7fc2219e1640 1 -- 172.21.15.67:0/4179714300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc21c062b90 con 0x7fc21c101710 2024-08-31T05:23:12.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.849+0000 7fc2209df640 1 -- 172.21.15.67:0/4179714300 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fc20c068150 con 0x7fc21c101710 2024-08-31T05:23:12.852 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:23:12.852 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:23:12.852 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2 2024-08-31T05:23:12.853 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:23:12.853 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:23:12.853 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:23:12.853 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:23:12.853 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:23:12.853 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 6 2024-08-31T05:23:12.853 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:23:12.853 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:23:12.853 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:23:12.853 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:23:12.853 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:23:12.853 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 12, 2024-08-31T05:23:12.853 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:23:12.853 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:23:12.854 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:23:12.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.851+0000 7fc2219e1640 1 -- 172.21.15.67:0/4179714300 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc208079f70 msgr2=0x7fc20807c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.851+0000 7fc2219e1640 1 --2- 172.21.15.67:0/4179714300 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc208079f70 0x7fc20807c430 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc204006010 tx=0x7fc204000bc0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.851+0000 7fc2219e1640 1 -- 172.21.15.67:0/4179714300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc21c101710 msgr2=0x7fc21c075cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.851+0000 7fc2219e1640 1 --2- 172.21.15.67:0/4179714300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc21c101710 0x7fc21c075cc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00d6f0 tx=0x7fc20c00dbb0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.851+0000 7fc2219e1640 1 -- 172.21.15.67:0/4179714300 shutdown_connections 2024-08-31T05:23:12.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.851+0000 7fc2219e1640 1 --2- 172.21.15.67:0/4179714300 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc208079f70 0x7fc20807c430 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.851+0000 7fc2219e1640 1 --2- 172.21.15.67:0/4179714300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc21c102910 0x7fc21c074380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.851+0000 7fc2219e1640 1 --2- 172.21.15.67:0/4179714300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc21c101710 0x7fc21c075cc0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.851+0000 7fc2219e1640 1 -- 172.21.15.67:0/4179714300 >> 172.21.15.67:0/4179714300 conn(0x7fc21c0fcee0 msgr2=0x7fc21c105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:12.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.851+0000 7fc2219e1640 1 -- 172.21.15.67:0/4179714300 shutdown_connections 2024-08-31T05:23:12.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.851+0000 7fc2219e1640 1 -- 172.21.15.67:0/4179714300 wait complete. 2024-08-31T05:23:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.937+0000 7f1d9dd03640 1 -- 172.21.15.67:0/1986492663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d98102900 msgr2=0x7f1d98102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.937+0000 7f1d9dd03640 1 --2- 172.21.15.67:0/1986492663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d98102900 0x7f1d98102d80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009880 tx=0x7f1d8002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.937+0000 7f1d9dd03640 1 -- 172.21.15.67:0/1986492663 shutdown_connections 2024-08-31T05:23:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.937+0000 7f1d9dd03640 1 --2- 172.21.15.67:0/1986492663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d98102900 0x7f1d98102d80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.937+0000 7f1d9dd03640 1 --2- 172.21.15.67:0/1986492663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d98101700 0x7f1d98101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.937+0000 7f1d9dd03640 1 -- 172.21.15.67:0/1986492663 >> 172.21.15.67:0/1986492663 conn(0x7f1d980fce90 msgr2=0x7f1d980ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:12.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.937+0000 7f1d9dd03640 1 -- 172.21.15.67:0/1986492663 shutdown_connections 2024-08-31T05:23:12.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.937+0000 7f1d9dd03640 1 -- 172.21.15.67:0/1986492663 wait complete. 2024-08-31T05:23:12.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.937+0000 7f1d9dd03640 1 Processor -- start 2024-08-31T05:23:12.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.937+0000 7f1d9dd03640 1 -- start start 2024-08-31T05:23:12.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.938+0000 7f1d9dd03640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d98101700 0x7f1d981972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.938+0000 7f1d9dd03640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d98102900 0x7f1d981977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.938+0000 7f1d9dd03640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9810a5c0 con 0x7f1d98102900 2024-08-31T05:23:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.938+0000 7f1d9dd03640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9810a440 con 0x7f1d98101700 2024-08-31T05:23:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.938+0000 7f1d8effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d98102900 0x7f1d981977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.938+0000 7f1d8effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d98102900 0x7f1d981977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33918/0 (socket says 172.21.15.67:33918) 2024-08-31T05:23:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.938+0000 7f1d8effd640 1 -- 172.21.15.67:0/757043866 learned_addr learned my addr 172.21.15.67:0/757043866 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:23:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.938+0000 7f1d977fe640 1 --2- 172.21.15.67:0/757043866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d98101700 0x7f1d981972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.938+0000 7f1d8effd640 1 -- 172.21.15.67:0/757043866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d98101700 msgr2=0x7f1d981972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.938+0000 7f1d8effd640 1 --2- 172.21.15.67:0/757043866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d98101700 0x7f1d981972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.938+0000 7f1d8effd640 1 -- 172.21.15.67:0/757043866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d98197e70 con 0x7f1d98102900 2024-08-31T05:23:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.938+0000 7f1d977fe640 1 --2- 172.21.15.67:0/757043866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d98101700 0x7f1d981972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:23:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.938+0000 7f1d8effd640 1 --2- 172.21.15.67:0/757043866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d98102900 0x7f1d981977f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1d80006010 tx=0x7f1d800048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.939+0000 7f1d957fa640 1 -- 172.21.15.67:0/757043866 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d8003f070 con 0x7f1d98102900 2024-08-31T05:23:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.939+0000 7f1d957fa640 1 -- 172.21.15.67:0/757043866 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d800044d0 con 0x7f1d98102900 2024-08-31T05:23:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.939+0000 7f1d9dd03640 1 -- 172.21.15.67:0/757043866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d9819c850 con 0x7f1d98102900 2024-08-31T05:23:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.939+0000 7f1d957fa640 1 -- 172.21.15.67:0/757043866 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d80035030 con 0x7f1d98102900 2024-08-31T05:23:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.939+0000 7f1d9dd03640 1 -- 172.21.15.67:0/757043866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d9819ce60 con 0x7f1d98102900 2024-08-31T05:23:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.940+0000 7f1d9dd03640 1 -- 172.21.15.67:0/757043866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d98101ae0 con 0x7f1d98102900 2024-08-31T05:23:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.940+0000 7f1d957fa640 1 -- 172.21.15.67:0/757043866 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 32) ==== 102132+0+0 (secure 0 0 0) 0x7f1d80042070 con 0x7f1d98102900 2024-08-31T05:23:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.941+0000 7f1d957fa640 1 --2- 172.21.15.67:0/757043866 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1d84079f70 0x7f1d8407c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.941+0000 7f1d957fa640 1 -- 172.21.15.67:0/757043866 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f1d800bd800 con 0x7f1d98102900 2024-08-31T05:23:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.941+0000 7f1d977fe640 1 --2- 172.21.15.67:0/757043866 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1d84079f70 0x7f1d8407c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:12.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.942+0000 7f1d977fe640 1 --2- 172.21.15.67:0/757043866 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1d84079f70 0x7f1d8407c430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1d98102760 tx=0x7f1d88008040 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:12.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:12.946+0000 7f1d957fa640 1 -- 172.21.15.67:0/757043866 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f1d800851d0 con 0x7f1d98102900 2024-08-31T05:23:13.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:13.152+0000 7f1d9dd03640 1 -- 172.21.15.67:0/757043866 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1d980623d0 con 0x7f1d84079f70 2024-08-31T05:23:13.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:13.154+0000 7f1d957fa640 1 -- 172.21.15.67:0/757043866 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f1d980623d0 con 0x7f1d84079f70 2024-08-31T05:23:13.157 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:23:13.157 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:23:13.157 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:23:13.157 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-31T05:23:13.157 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:23:13.157 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr" 2024-08-31T05:23:13.157 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:23:13.157 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "2/2 daemons upgraded", 2024-08-31T05:23:13.157 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading node-exporter daemons", 2024-08-31T05:23:13.157 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:23:13.157 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:23:13.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:13.156+0000 7f1d9dd03640 1 -- 172.21.15.67:0/757043866 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1d84079f70 msgr2=0x7f1d8407c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:13.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:13.156+0000 7f1d9dd03640 1 --2- 172.21.15.67:0/757043866 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1d84079f70 0x7f1d8407c430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1d98102760 tx=0x7f1d88008040 comp rx=0 tx=0).stop 2024-08-31T05:23:13.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:13.156+0000 7f1d9dd03640 1 -- 172.21.15.67:0/757043866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d98102900 msgr2=0x7f1d981977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:13.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:13.156+0000 7f1d9dd03640 1 --2- 172.21.15.67:0/757043866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d98102900 0x7f1d981977f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1d80006010 tx=0x7f1d800048f0 comp rx=0 tx=0).stop 2024-08-31T05:23:13.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:13.156+0000 7f1d9dd03640 1 -- 172.21.15.67:0/757043866 shutdown_connections 2024-08-31T05:23:13.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:13.156+0000 7f1d9dd03640 1 --2- 172.21.15.67:0/757043866 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1d84079f70 0x7f1d8407c430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:13.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:13.156+0000 7f1d9dd03640 1 --2- 172.21.15.67:0/757043866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d98102900 0x7f1d981977f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:13.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:13.156+0000 7f1d9dd03640 1 --2- 172.21.15.67:0/757043866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d98101700 0x7f1d981972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:13.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:13.156+0000 7f1d9dd03640 1 -- 172.21.15.67:0/757043866 >> 172.21.15.67:0/757043866 conn(0x7f1d980fce90 msgr2=0x7f1d98105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:13.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:13.157+0000 7f1d9dd03640 1 -- 172.21.15.67:0/757043866 shutdown_connections 2024-08-31T05:23:13.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:13.157+0000 7f1d9dd03640 1 -- 172.21.15.67:0/757043866 wait complete. 2024-08-31T05:23:13.511 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:13 smithi067 ceph-mon[17432]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:13.511 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:13 smithi067 ceph-mon[17432]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:13.511 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:13 smithi067 ceph-mon[17432]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:13.511 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:13 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/4179714300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:13.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:13 smithi073 ceph-mon[24726]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:13.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:13 smithi073 ceph-mon[24726]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:13.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:13 smithi073 ceph-mon[24726]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:13.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:13 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/4179714300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:14.518 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:14 smithi067 ceph-mon[17432]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:14.518 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:14 smithi067 ceph-mon[17432]: pgmap v38: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 292 KiB/s rd, 289 KiB/s wr, 59 op/s 2024-08-31T05:23:14.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:14 smithi073 ceph-mon[24726]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:14.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:14 smithi073 ceph-mon[24726]: pgmap v38: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 292 KiB/s rd, 289 KiB/s wr, 59 op/s 2024-08-31T05:23:15.797 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:15 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:15.797 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:15 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:15.797 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:15 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:15.797 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:15 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:15.979 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:15 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:15.979 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:15 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:15.979 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:15 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:15.979 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:15 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:17.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:16 smithi067 ceph-mon[17432]: pgmap v39: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 293 KiB/s rd, 289 KiB/s wr, 61 op/s 2024-08-31T05:23:17.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:16 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:17.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:16 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:17.089 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:16 smithi073 ceph-mon[24726]: pgmap v39: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 293 KiB/s rd, 289 KiB/s wr, 61 op/s 2024-08-31T05:23:17.089 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:16 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:17.089 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:16 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:18.266 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:17 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:18.266 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:17 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:18.266 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:17 smithi073 ceph-mon[24726]: pgmap v40: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-08-31T05:23:18.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:17 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:18.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:17 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:18.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:17 smithi067 ceph-mon[17432]: pgmap v40: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-08-31T05:23:19.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:19 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:19.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:19 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:19.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:19 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:23:19.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:19 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:19.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:19 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:19.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:19 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:23:20.900 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: pgmap v41: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 16 KiB/s wr, 7 op/s 2024-08-31T05:23:20.900 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:20.900 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:20.901 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:23:20.901 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:23:20.901 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:20.901 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:23:20.901 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.901 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.901 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.901 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.901 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.901 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.901 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.901 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:20 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: pgmap v41: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 16 KiB/s wr, 7 op/s 2024-08-31T05:23:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:23:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:23:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:23:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:20.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:20 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:22.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:22 smithi073 ceph-mon[24726]: pgmap v42: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:23:23.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:22 smithi067 ceph-mon[17432]: pgmap v42: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:23:23.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:23 smithi073 ceph-mon[24726]: Upgrade: Updating prometheus.smithi067 2024-08-31T05:23:23.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:23 smithi073 ceph-mon[24726]: Deploying daemon prometheus.smithi067 on smithi067 2024-08-31T05:23:24.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:23 smithi067 ceph-mon[17432]: Upgrade: Updating prometheus.smithi067 2024-08-31T05:23:24.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:23 smithi067 ceph-mon[17432]: Deploying daemon prometheus.smithi067 on smithi067 2024-08-31T05:23:24.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:24 smithi073 ceph-mon[24726]: pgmap v43: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:23:25.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:24 smithi067 ceph-mon[17432]: pgmap v43: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:23:26.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:26 smithi073 ceph-mon[24726]: pgmap v44: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T05:23:26.976 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:26 smithi067 ceph-mon[17432]: pgmap v44: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T05:23:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:28 smithi073 ceph-mon[24726]: pgmap v45: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-08-31T05:23:29.040 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:28 smithi067 ceph-mon[17432]: pgmap v45: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-08-31T05:23:30.808 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:30 smithi067 ceph-mon[17432]: pgmap v46: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-08-31T05:23:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:30 smithi073 ceph-mon[24726]: pgmap v46: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-08-31T05:23:32.643 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:32 smithi067 ceph-mon[17432]: pgmap v47: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-08-31T05:23:32.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:32 smithi073 ceph-mon[24726]: pgmap v47: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-08-31T05:23:34.945 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:34 smithi067 ceph-mon[17432]: pgmap v48: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-08-31T05:23:34.945 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:34 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:34.945 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:34 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:34.945 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:34 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:23:34.945 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:34 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:23:34.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:34 smithi073 ceph-mon[24726]: pgmap v48: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-08-31T05:23:34.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:34 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:34.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:34 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:34.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:34 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:23:34.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:34 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:23:36.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:36 smithi067 ceph-mon[17432]: pgmap v49: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-08-31T05:23:36.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:36 smithi067 ceph-mon[17432]: mgrmap e33: smithi067.hftacj(active, since 92s), standbys: smithi073.zfoyxd 2024-08-31T05:23:36.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:36 smithi073 ceph-mon[24726]: pgmap v49: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-08-31T05:23:36.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:36 smithi073 ceph-mon[24726]: mgrmap e33: smithi067.hftacj(active, since 92s), standbys: smithi073.zfoyxd 2024-08-31T05:23:38.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:38 smithi067 ceph-mon[17432]: pgmap v50: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-08-31T05:23:38.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:38 smithi073 ceph-mon[24726]: pgmap v50: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-08-31T05:23:40.557 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:40 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:40.557 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:40 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:40.557 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:40 smithi067 ceph-mon[17432]: pgmap v51: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:23:40.557 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:40 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:40.557 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:40 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:40.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:40 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:40.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:40 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:40.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:40 smithi073 ceph-mon[24726]: pgmap v51: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:23:40.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:40 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:40.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:40 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:42.752 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:42 smithi067 ceph-mon[17432]: pgmap v52: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-08-31T05:23:42.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:42 smithi073 ceph-mon[24726]: pgmap v52: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-08-31T05:23:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.246+0000 7fb754c0f640 1 -- 172.21.15.67:0/32219979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb750100600 msgr2=0x7fb750100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.246+0000 7fb754c0f640 1 --2- 172.21.15.67:0/32219979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb750100600 0x7fb750100a00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb740009880 tx=0x7fb74002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.246+0000 7fb754c0f640 1 -- 172.21.15.67:0/32219979 shutdown_connections 2024-08-31T05:23:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.246+0000 7fb754c0f640 1 --2- 172.21.15.67:0/32219979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb750101800 0x7fb750101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.246+0000 7fb754c0f640 1 --2- 172.21.15.67:0/32219979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb750100600 0x7fb750100a00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.246+0000 7fb754c0f640 1 -- 172.21.15.67:0/32219979 >> 172.21.15.67:0/32219979 conn(0x7fb7500fbdb0 msgr2=0x7fb7500fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.246+0000 7fb754c0f640 1 -- 172.21.15.67:0/32219979 shutdown_connections 2024-08-31T05:23:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.246+0000 7fb754c0f640 1 -- 172.21.15.67:0/32219979 wait complete. 2024-08-31T05:23:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.247+0000 7fb754c0f640 1 Processor -- start 2024-08-31T05:23:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.247+0000 7fb754c0f640 1 -- start start 2024-08-31T05:23:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.247+0000 7fb754c0f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb750100600 0x7fb750197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.247+0000 7fb754c0f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb750101800 0x7fb7501977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.247+0000 7fb754c0f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb750109420 con 0x7fb750100600 2024-08-31T05:23:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.247+0000 7fb754c0f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb7501092a0 con 0x7fb750101800 2024-08-31T05:23:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.247+0000 7fb74e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb750100600 0x7fb750197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.247+0000 7fb74e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb750100600 0x7fb750197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41480/0 (socket says 172.21.15.67:41480) 2024-08-31T05:23:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.247+0000 7fb74e59c640 1 -- 172.21.15.67:0/1745827553 learned_addr learned my addr 172.21.15.67:0/1745827553 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:23:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.247+0000 7fb747fff640 1 --2- 172.21.15.67:0/1745827553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb750101800 0x7fb7501977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.247+0000 7fb74e59c640 1 -- 172.21.15.67:0/1745827553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb750101800 msgr2=0x7fb7501977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.247+0000 7fb74e59c640 1 --2- 172.21.15.67:0/1745827553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb750101800 0x7fb7501977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.247+0000 7fb74e59c640 1 -- 172.21.15.67:0/1745827553 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb750197dc0 con 0x7fb750100600 2024-08-31T05:23:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.248+0000 7fb74e59c640 1 --2- 172.21.15.67:0/1745827553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb750100600 0x7fb750197290 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb740006010 tx=0x7fb7400048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.248+0000 7fb7477fe640 1 -- 172.21.15.67:0/1745827553 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb74003f070 con 0x7fb750100600 2024-08-31T05:23:43.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.248+0000 7fb754c0f640 1 -- 172.21.15.67:0/1745827553 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb75019c7d0 con 0x7fb750100600 2024-08-31T05:23:43.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.248+0000 7fb7477fe640 1 -- 172.21.15.67:0/1745827553 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7400044d0 con 0x7fb750100600 2024-08-31T05:23:43.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.248+0000 7fb7477fe640 1 -- 172.21.15.67:0/1745827553 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb740035030 con 0x7fb750100600 2024-08-31T05:23:43.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.248+0000 7fb754c0f640 1 -- 172.21.15.67:0/1745827553 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb75019ccd0 con 0x7fb750100600 2024-08-31T05:23:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.249+0000 7fb754c0f640 1 -- 172.21.15.67:0/1745827553 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb750100a00 con 0x7fb750100600 2024-08-31T05:23:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.250+0000 7fb7477fe640 1 -- 172.21.15.67:0/1745827553 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fb740042070 con 0x7fb750100600 2024-08-31T05:23:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.250+0000 7fb7477fe640 1 --2- 172.21.15.67:0/1745827553 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb73c079e00 0x7fb73c07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.251+0000 7fb7477fe640 1 -- 172.21.15.67:0/1745827553 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fb7400bd4b0 con 0x7fb750100600 2024-08-31T05:23:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.251+0000 7fb747fff640 1 --2- 172.21.15.67:0/1745827553 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb73c079e00 0x7fb73c07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.251+0000 7fb747fff640 1 --2- 172.21.15.67:0/1745827553 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb73c079e00 0x7fb73c07c2c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb750198740 tx=0x7fb73800a2d0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:43.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.255+0000 7fb7477fe640 1 -- 172.21.15.67:0/1745827553 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fb740085020 con 0x7fb750100600 2024-08-31T05:23:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.460+0000 7fb754c0f640 1 -- 172.21.15.67:0/1745827553 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb75006a1a0 con 0x7fb73c079e00 2024-08-31T05:23:43.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.461+0000 7fb7477fe640 1 -- 172.21.15.67:0/1745827553 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7fb75006a1a0 con 0x7fb73c079e00 2024-08-31T05:23:43.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.463+0000 7fb754c0f640 1 -- 172.21.15.67:0/1745827553 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb73c079e00 msgr2=0x7fb73c07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.463+0000 7fb754c0f640 1 --2- 172.21.15.67:0/1745827553 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb73c079e00 0x7fb73c07c2c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb750198740 tx=0x7fb73800a2d0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.463+0000 7fb754c0f640 1 -- 172.21.15.67:0/1745827553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb750100600 msgr2=0x7fb750197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.463+0000 7fb754c0f640 1 --2- 172.21.15.67:0/1745827553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb750100600 0x7fb750197290 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb740006010 tx=0x7fb7400048f0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.463+0000 7fb754c0f640 1 -- 172.21.15.67:0/1745827553 shutdown_connections 2024-08-31T05:23:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.463+0000 7fb754c0f640 1 --2- 172.21.15.67:0/1745827553 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb73c079e00 0x7fb73c07c2c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.463+0000 7fb754c0f640 1 --2- 172.21.15.67:0/1745827553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb750101800 0x7fb7501977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.463+0000 7fb754c0f640 1 --2- 172.21.15.67:0/1745827553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb750100600 0x7fb750197290 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.463+0000 7fb754c0f640 1 -- 172.21.15.67:0/1745827553 >> 172.21.15.67:0/1745827553 conn(0x7fb7500fbdb0 msgr2=0x7fb750069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.464+0000 7fb754c0f640 1 -- 172.21.15.67:0/1745827553 shutdown_connections 2024-08-31T05:23:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.464+0000 7fb754c0f640 1 -- 172.21.15.67:0/1745827553 wait complete. 2024-08-31T05:23:43.475 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:23:43.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.553+0000 7f72ed10c640 1 -- 172.21.15.67:0/3998305172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e8101710 msgr2=0x7f72e8101b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:43.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.553+0000 7f72ed10c640 1 --2- 172.21.15.67:0/3998305172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e8101710 0x7f72e8101b10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009c20 tx=0x7f72d802a970 comp rx=0 tx=0).stop 2024-08-31T05:23:43.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.553+0000 7f72ed10c640 1 -- 172.21.15.67:0/3998305172 shutdown_connections 2024-08-31T05:23:43.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.553+0000 7f72ed10c640 1 --2- 172.21.15.67:0/3998305172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72e8102910 0x7f72e8102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.553+0000 7f72ed10c640 1 --2- 172.21.15.67:0/3998305172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e8101710 0x7f72e8101b10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.553+0000 7f72ed10c640 1 -- 172.21.15.67:0/3998305172 >> 172.21.15.67:0/3998305172 conn(0x7f72e80fcee0 msgr2=0x7f72e80ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:43.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.553+0000 7f72ed10c640 1 -- 172.21.15.67:0/3998305172 shutdown_connections 2024-08-31T05:23:43.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.554+0000 7f72ed10c640 1 -- 172.21.15.67:0/3998305172 wait complete. 2024-08-31T05:23:43.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.554+0000 7f72ed10c640 1 Processor -- start 2024-08-31T05:23:43.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.554+0000 7f72ed10c640 1 -- start start 2024-08-31T05:23:43.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.554+0000 7f72ed10c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72e8101710 0x7f72e8197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:43.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72ed10c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e8102910 0x7f72e8197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:43.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72ed10c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f72e810a530 con 0x7f72e8102910 2024-08-31T05:23:43.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72ed10c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f72e810a3b0 con 0x7f72e8101710 2024-08-31T05:23:43.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72e659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e8102910 0x7f72e8197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:43.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72e659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e8102910 0x7f72e8197780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41496/0 (socket says 172.21.15.67:41496) 2024-08-31T05:23:43.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72e659c640 1 -- 172.21.15.67:0/1360307605 learned_addr learned my addr 172.21.15.67:0/1360307605 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:23:43.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72e6d9d640 1 --2- 172.21.15.67:0/1360307605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72e8101710 0x7f72e8197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:43.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72e659c640 1 -- 172.21.15.67:0/1360307605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72e8101710 msgr2=0x7f72e8197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:43.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72e659c640 1 --2- 172.21.15.67:0/1360307605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72e8101710 0x7f72e8197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72e659c640 1 -- 172.21.15.67:0/1360307605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e8197e00 con 0x7f72e8102910 2024-08-31T05:23:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72e659c640 1 --2- 172.21.15.67:0/1360307605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e8102910 0x7f72e8197780 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f72d000d8d0 tx=0x7f72d000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72dffff640 1 -- 172.21.15.67:0/1360307605 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72d0017070 con 0x7f72e8102910 2024-08-31T05:23:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72dffff640 1 -- 172.21.15.67:0/1360307605 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72d0010460 con 0x7f72e8102910 2024-08-31T05:23:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72ed10c640 1 -- 172.21.15.67:0/1360307605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e819c840 con 0x7f72e8102910 2024-08-31T05:23:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72dffff640 1 -- 172.21.15.67:0/1360307605 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72d000f5f0 con 0x7f72e8102910 2024-08-31T05:23:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.555+0000 7f72ed10c640 1 -- 172.21.15.67:0/1360307605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e819ce50 con 0x7f72e8102910 2024-08-31T05:23:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.557+0000 7f72ed10c640 1 -- 172.21.15.67:0/1360307605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e8101b10 con 0x7f72e8102910 2024-08-31T05:23:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.557+0000 7f72dffff640 1 -- 172.21.15.67:0/1360307605 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f72d0009a30 con 0x7f72e8102910 2024-08-31T05:23:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.558+0000 7f72dffff640 1 --2- 172.21.15.67:0/1360307605 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f72d4079e00 0x7f72d407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.558+0000 7f72dffff640 1 -- 172.21.15.67:0/1360307605 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f72d009c710 con 0x7f72e8102910 2024-08-31T05:23:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.558+0000 7f72e6d9d640 1 --2- 172.21.15.67:0/1360307605 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f72d4079e00 0x7f72d407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:43.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.558+0000 7f72e6d9d640 1 --2- 172.21.15.67:0/1360307605 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f72d4079e00 0x7f72d407c2c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f72d8000f80 tx=0x7f72d803c040 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:43.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.562+0000 7f72dffff640 1 -- 172.21.15.67:0/1360307605 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f72d00683f0 con 0x7f72e8102910 2024-08-31T05:23:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.766+0000 7f72ed10c640 1 -- 172.21.15.67:0/1360307605 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f72e80623d0 con 0x7f72d4079e00 2024-08-31T05:23:43.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.767+0000 7f72dffff640 1 -- 172.21.15.67:0/1360307605 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7f72e80623d0 con 0x7f72d4079e00 2024-08-31T05:23:43.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.769+0000 7f72ed10c640 1 -- 172.21.15.67:0/1360307605 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f72d4079e00 msgr2=0x7f72d407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:43.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.769+0000 7f72ed10c640 1 --2- 172.21.15.67:0/1360307605 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f72d4079e00 0x7f72d407c2c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f72d8000f80 tx=0x7f72d803c040 comp rx=0 tx=0).stop 2024-08-31T05:23:43.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.769+0000 7f72ed10c640 1 -- 172.21.15.67:0/1360307605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e8102910 msgr2=0x7f72e8197780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:43.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.769+0000 7f72ed10c640 1 --2- 172.21.15.67:0/1360307605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e8102910 0x7f72e8197780 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f72d000d8d0 tx=0x7f72d000dd90 comp rx=0 tx=0).stop 2024-08-31T05:23:43.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.769+0000 7f72ed10c640 1 -- 172.21.15.67:0/1360307605 shutdown_connections 2024-08-31T05:23:43.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.769+0000 7f72ed10c640 1 --2- 172.21.15.67:0/1360307605 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f72d4079e00 0x7f72d407c2c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.769+0000 7f72ed10c640 1 --2- 172.21.15.67:0/1360307605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72e8102910 0x7f72e8197780 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.769+0000 7f72ed10c640 1 --2- 172.21.15.67:0/1360307605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72e8101710 0x7f72e8197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.769+0000 7f72ed10c640 1 -- 172.21.15.67:0/1360307605 >> 172.21.15.67:0/1360307605 conn(0x7f72e80fcee0 msgr2=0x7f72e8105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:43.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.769+0000 7f72ed10c640 1 -- 172.21.15.67:0/1360307605 shutdown_connections 2024-08-31T05:23:43.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.769+0000 7f72ed10c640 1 -- 172.21.15.67:0/1360307605 wait complete. 2024-08-31T05:23:43.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.854+0000 7fbeee15f640 1 -- 172.21.15.67:0/1027149256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee8101800 msgr2=0x7fbee8101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:43.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.854+0000 7fbeee15f640 1 --2- 172.21.15.67:0/1027149256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee8101800 0x7fbee8101c80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009880 tx=0x7fbedc02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.854+0000 7fbeee15f640 1 -- 172.21.15.67:0/1027149256 shutdown_connections 2024-08-31T05:23:43.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.854+0000 7fbeee15f640 1 --2- 172.21.15.67:0/1027149256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee8101800 0x7fbee8101c80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.854+0000 7fbeee15f640 1 --2- 172.21.15.67:0/1027149256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbee8100600 0x7fbee8100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.854+0000 7fbeee15f640 1 -- 172.21.15.67:0/1027149256 >> 172.21.15.67:0/1027149256 conn(0x7fbee80fbdb0 msgr2=0x7fbee80fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:43.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.854+0000 7fbeee15f640 1 -- 172.21.15.67:0/1027149256 shutdown_connections 2024-08-31T05:23:43.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.854+0000 7fbeee15f640 1 -- 172.21.15.67:0/1027149256 wait complete. 2024-08-31T05:23:43.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.854+0000 7fbeee15f640 1 Processor -- start 2024-08-31T05:23:43.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.854+0000 7fbeee15f640 1 -- start start 2024-08-31T05:23:43.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.855+0000 7fbeee15f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbee8100600 0x7fbee81973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:43.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.855+0000 7fbeee15f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee8101800 0x7fbee81978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:43.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.855+0000 7fbeee15f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbee81094c0 con 0x7fbee8101800 2024-08-31T05:23:43.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.855+0000 7fbeee15f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbee8109340 con 0x7fbee8100600 2024-08-31T05:23:43.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.855+0000 7fbee6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee8101800 0x7fbee81978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:43.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.855+0000 7fbee6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee8101800 0x7fbee81978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41506/0 (socket says 172.21.15.67:41506) 2024-08-31T05:23:43.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.855+0000 7fbee6ffd640 1 -- 172.21.15.67:0/452281798 learned_addr learned my addr 172.21.15.67:0/452281798 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:23:43.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.855+0000 7fbee77fe640 1 --2- 172.21.15.67:0/452281798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbee8100600 0x7fbee81973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:43.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.855+0000 7fbee6ffd640 1 -- 172.21.15.67:0/452281798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbee8100600 msgr2=0x7fbee81973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:43.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.855+0000 7fbee6ffd640 1 --2- 172.21.15.67:0/452281798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbee8100600 0x7fbee81973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:43.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.855+0000 7fbee6ffd640 1 -- 172.21.15.67:0/452281798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee8197f70 con 0x7fbee8101800 2024-08-31T05:23:43.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.855+0000 7fbee6ffd640 1 --2- 172.21.15.67:0/452281798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee8101800 0x7fbee81978f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbedc006010 tx=0x7fbedc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:43.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.855+0000 7fbee4ff9640 1 -- 172.21.15.67:0/452281798 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbedc03f070 con 0x7fbee8101800 2024-08-31T05:23:43.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.856+0000 7fbee4ff9640 1 -- 172.21.15.67:0/452281798 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbedc0044d0 con 0x7fbee8101800 2024-08-31T05:23:43.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.856+0000 7fbeee15f640 1 -- 172.21.15.67:0/452281798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee819c950 con 0x7fbee8101800 2024-08-31T05:23:43.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.856+0000 7fbee4ff9640 1 -- 172.21.15.67:0/452281798 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbedc035030 con 0x7fbee8101800 2024-08-31T05:23:43.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.856+0000 7fbeee15f640 1 -- 172.21.15.67:0/452281798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee819cf60 con 0x7fbee8101800 2024-08-31T05:23:43.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.857+0000 7fbeee15f640 1 -- 172.21.15.67:0/452281798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee81009e0 con 0x7fbee8101800 2024-08-31T05:23:43.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.858+0000 7fbee4ff9640 1 -- 172.21.15.67:0/452281798 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fbedc042070 con 0x7fbee8101800 2024-08-31T05:23:43.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.858+0000 7fbee4ff9640 1 --2- 172.21.15.67:0/452281798 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fbed0079e40 0x7fbed007c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:43.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.858+0000 7fbee4ff9640 1 -- 172.21.15.67:0/452281798 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fbedc0bd3c0 con 0x7fbee8101800 2024-08-31T05:23:43.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.858+0000 7fbee77fe640 1 --2- 172.21.15.67:0/452281798 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fbed0079e40 0x7fbed007c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:43.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.859+0000 7fbee77fe640 1 --2- 172.21.15.67:0/452281798 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fbed0079e40 0x7fbed007c300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbee8101660 tx=0x7fbed8009110 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:43.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:43.863+0000 7fbee4ff9640 1 -- 172.21.15.67:0/452281798 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fbedc084fb0 con 0x7fbee8101800 2024-08-31T05:23:44.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.064+0000 7fbeee15f640 1 -- 172.21.15.67:0/452281798 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbee806a1e0 con 0x7fbed0079e40 2024-08-31T05:23:44.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.073+0000 7fbee4ff9640 1 -- 172.21.15.67:0/452281798 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fbee806a1e0 con 0x7fbed0079e40 2024-08-31T05:23:44.075 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:23:44.075 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (8m) 4s ago 10m 24.6M - 0.25.0 c8568f914cd2 cad2b6757f0e 2024-08-31T05:23:44.075 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (3m) 4s ago 10m 8711k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:23:44.076 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (2m) 29s ago 9m 8128k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:23:44.076 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (10m) 4s ago 10m 6895k - 19.1.1-242-g244a32d3 395b9209a980 a47c71179c57 2024-08-31T05:23:44.076 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (9m) 29s ago 9m 6895k - 19.1.1-242-g244a32d3 395b9209a980 5f2ce08c4451 2024-08-31T05:23:44.076 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (8m) 4s ago 10m 76.7M - 9.4.12 2bacad6d85d8 ac51e53c0deb 2024-08-31T05:23:44.076 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (5m) 4s ago 5m 91.8M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:23:44.076 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (5m) 4s ago 5m 156M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:23:44.076 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (5m) 29s ago 5m 14.8M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:23:44.076 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (5m) 29s ago 5m 16.5M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:23:44.076 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (115s) 4s ago 11m 579M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:23:44.076 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (62s) 29s ago 9m 522M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:23:44.076 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (11m) 4s ago 11m 54.1M 2048M 19.1.1-242-g244a32d3 395b9209a980 7082a38c8108 2024-08-31T05:23:44.076 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (9m) 29s ago 9m 48.0M 2048M 19.1.1-242-g244a32d3 395b9209a980 30ccf0ed274b 2024-08-31T05:23:44.076 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (39s) 4s ago 10m 9.93M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:23:44.076 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (33s) 29s ago 9m 3384k - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:23:44.077 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (8m) 4s ago 8m 202M 1216M 19.1.1-242-g244a32d3 395b9209a980 b9f3f60b65f9 2024-08-31T05:23:44.077 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (8m) 4s ago 8m 223M 1216M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:23:44.077 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (7m) 4s ago 7m 187M 1216M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:23:44.077 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (7m) 29s ago 7m 249M 2240M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:23:44.077 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (6m) 29s ago 6m 211M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:23:44.077 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (6m) 29s ago 6m 186M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:23:44.077 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (10s) 4s ago 10m 40.7M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:23:44.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.075+0000 7fbeee15f640 1 -- 172.21.15.67:0/452281798 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fbed0079e40 msgr2=0x7fbed007c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:44.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.075+0000 7fbeee15f640 1 --2- 172.21.15.67:0/452281798 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fbed0079e40 0x7fbed007c300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbee8101660 tx=0x7fbed8009110 comp rx=0 tx=0).stop 2024-08-31T05:23:44.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.075+0000 7fbeee15f640 1 -- 172.21.15.67:0/452281798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee8101800 msgr2=0x7fbee81978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:44.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.075+0000 7fbeee15f640 1 --2- 172.21.15.67:0/452281798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee8101800 0x7fbee81978f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbedc006010 tx=0x7fbedc0048f0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.075+0000 7fbeee15f640 1 -- 172.21.15.67:0/452281798 shutdown_connections 2024-08-31T05:23:44.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.075+0000 7fbeee15f640 1 --2- 172.21.15.67:0/452281798 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fbed0079e40 0x7fbed007c300 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.075+0000 7fbeee15f640 1 --2- 172.21.15.67:0/452281798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbee8101800 0x7fbee81978f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.075+0000 7fbeee15f640 1 --2- 172.21.15.67:0/452281798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbee8100600 0x7fbee81973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.075+0000 7fbeee15f640 1 -- 172.21.15.67:0/452281798 >> 172.21.15.67:0/452281798 conn(0x7fbee80fbdb0 msgr2=0x7fbee8069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:44.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.076+0000 7fbeee15f640 1 -- 172.21.15.67:0/452281798 shutdown_connections 2024-08-31T05:23:44.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.076+0000 7fbeee15f640 1 -- 172.21.15.67:0/452281798 wait complete. 2024-08-31T05:23:44.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.158+0000 7f7882208640 1 -- 172.21.15.67:0/2127799436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f787c1008b0 msgr2=0x7f787c100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:44.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.158+0000 7f7882208640 1 --2- 172.21.15.67:0/2127799436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f787c1008b0 0x7f787c100d30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7864009880 tx=0x7f786402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.159+0000 7f7882208640 1 -- 172.21.15.67:0/2127799436 shutdown_connections 2024-08-31T05:23:44.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.159+0000 7f7882208640 1 --2- 172.21.15.67:0/2127799436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f787c1008b0 0x7f787c100d30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.159+0000 7f7882208640 1 --2- 172.21.15.67:0/2127799436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f787c101c00 0x7f787c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.159+0000 7f7882208640 1 -- 172.21.15.67:0/2127799436 >> 172.21.15.67:0/2127799436 conn(0x7f787c0fb510 msgr2=0x7f787c0fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:44.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.159+0000 7f7882208640 1 -- 172.21.15.67:0/2127799436 shutdown_connections 2024-08-31T05:23:44.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.159+0000 7f7882208640 1 -- 172.21.15.67:0/2127799436 wait complete. 2024-08-31T05:23:44.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.159+0000 7f7882208640 1 Processor -- start 2024-08-31T05:23:44.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.159+0000 7f7882208640 1 -- start start 2024-08-31T05:23:44.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f7882208640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f787c1008b0 0x7f787c1972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:44.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f7882208640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f787c101c00 0x7f787c197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:44.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f7882208640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f787c1094d0 con 0x7f787c101c00 2024-08-31T05:23:44.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f7882208640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f787c109350 con 0x7f787c1008b0 2024-08-31T05:23:44.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f787affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f787c101c00 0x7f787c197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:44.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f787affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f787c101c00 0x7f787c197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41522/0 (socket says 172.21.15.67:41522) 2024-08-31T05:23:44.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f787affd640 1 -- 172.21.15.67:0/3922841620 learned_addr learned my addr 172.21.15.67:0/3922841620 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:23:44.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f787b7fe640 1 --2- 172.21.15.67:0/3922841620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f787c1008b0 0x7f787c1972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:44.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f787affd640 1 -- 172.21.15.67:0/3922841620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f787c1008b0 msgr2=0x7f787c1972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:44.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f787affd640 1 --2- 172.21.15.67:0/3922841620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f787c1008b0 0x7f787c1972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f787affd640 1 -- 172.21.15.67:0/3922841620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c197eb0 con 0x7f787c101c00 2024-08-31T05:23:44.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f787affd640 1 --2- 172.21.15.67:0/3922841620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f787c101c00 0x7f787c197830 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7864006010 tx=0x7f78640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:44.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f7878ff9640 1 -- 172.21.15.67:0/3922841620 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f786403f070 con 0x7f787c101c00 2024-08-31T05:23:44.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f7882208640 1 -- 172.21.15.67:0/3922841620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787c19c890 con 0x7f787c101c00 2024-08-31T05:23:44.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.160+0000 7f7878ff9640 1 -- 172.21.15.67:0/3922841620 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f78640044d0 con 0x7f787c101c00 2024-08-31T05:23:44.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.161+0000 7f7878ff9640 1 -- 172.21.15.67:0/3922841620 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7864035030 con 0x7f787c101c00 2024-08-31T05:23:44.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.161+0000 7f7882208640 1 -- 172.21.15.67:0/3922841620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787c19cea0 con 0x7f787c101c00 2024-08-31T05:23:44.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.162+0000 7f7882208640 1 -- 172.21.15.67:0/3922841620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787c100d30 con 0x7f787c101c00 2024-08-31T05:23:44.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.162+0000 7f7878ff9640 1 -- 172.21.15.67:0/3922841620 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f7864042070 con 0x7f787c101c00 2024-08-31T05:23:44.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.163+0000 7f7878ff9640 1 --2- 172.21.15.67:0/3922841620 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7868079e00 0x7f786807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:44.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.163+0000 7f7878ff9640 1 -- 172.21.15.67:0/3922841620 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f78640bd5a0 con 0x7f787c101c00 2024-08-31T05:23:44.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.163+0000 7f787b7fe640 1 --2- 172.21.15.67:0/3922841620 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7868079e00 0x7f786807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:44.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.163+0000 7f787b7fe640 1 --2- 172.21.15.67:0/3922841620 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7868079e00 0x7f786807c2c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f787c069cf0 tx=0x7f786c009110 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:44.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.167+0000 7f7878ff9640 1 -- 172.21.15.67:0/3922841620 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f7864085110 con 0x7f787c101c00 2024-08-31T05:23:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:23:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:23:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:23:44.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:23:44.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:23:44.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:44.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:44 smithi067 ceph-mon[17432]: pgmap v53: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-08-31T05:23:44.414 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:44.414 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:44.414 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:23:44.414 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:23:44.414 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:44.414 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:23:44.414 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-31T05:23:44.414 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:23:44.414 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.414 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.415 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.415 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.415 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.415 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.415 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.415 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.415 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:44.415 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:44.415 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:44 smithi073 ceph-mon[24726]: pgmap v53: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-08-31T05:23:44.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.427+0000 7f7882208640 1 -- 172.21.15.67:0/3922841620 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f787c1066d0 con 0x7f787c101c00 2024-08-31T05:23:44.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.428+0000 7f7878ff9640 1 -- 172.21.15.67:0/3922841620 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f7864089280 con 0x7f787c101c00 2024-08-31T05:23:44.430 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:23:44.430 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:23:44.430 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2 2024-08-31T05:23:44.430 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:23:44.430 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:23:44.430 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:23:44.430 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:23:44.430 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:23:44.430 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 6 2024-08-31T05:23:44.431 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:23:44.431 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:23:44.431 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:23:44.431 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:23:44.431 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:23:44.431 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 12, 2024-08-31T05:23:44.431 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:23:44.431 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:23:44.431 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:23:44.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.430+0000 7f7882208640 1 -- 172.21.15.67:0/3922841620 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7868079e00 msgr2=0x7f786807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:44.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.430+0000 7f7882208640 1 --2- 172.21.15.67:0/3922841620 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7868079e00 0x7f786807c2c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f787c069cf0 tx=0x7f786c009110 comp rx=0 tx=0).stop 2024-08-31T05:23:44.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.430+0000 7f7882208640 1 -- 172.21.15.67:0/3922841620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f787c101c00 msgr2=0x7f787c197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:44.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.430+0000 7f7882208640 1 --2- 172.21.15.67:0/3922841620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f787c101c00 0x7f787c197830 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7864006010 tx=0x7f78640048f0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.430+0000 7f7882208640 1 -- 172.21.15.67:0/3922841620 shutdown_connections 2024-08-31T05:23:44.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.430+0000 7f7882208640 1 --2- 172.21.15.67:0/3922841620 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7868079e00 0x7f786807c2c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.430+0000 7f7882208640 1 --2- 172.21.15.67:0/3922841620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f787c101c00 0x7f787c197830 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.430+0000 7f7882208640 1 --2- 172.21.15.67:0/3922841620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f787c1008b0 0x7f787c1972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.431+0000 7f7882208640 1 -- 172.21.15.67:0/3922841620 >> 172.21.15.67:0/3922841620 conn(0x7f787c0fb510 msgr2=0x7f787c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:44.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.431+0000 7f7882208640 1 -- 172.21.15.67:0/3922841620 shutdown_connections 2024-08-31T05:23:44.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.431+0000 7f7882208640 1 -- 172.21.15.67:0/3922841620 wait complete. 2024-08-31T05:23:44.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.516+0000 7f16edb75640 1 -- 172.21.15.67:0/1903097928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e8102900 msgr2=0x7f16e8102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:44.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.516+0000 7f16edb75640 1 --2- 172.21.15.67:0/1903097928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e8102900 0x7f16e8102d80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f16d0009880 tx=0x7f16d002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.516+0000 7f16edb75640 1 -- 172.21.15.67:0/1903097928 shutdown_connections 2024-08-31T05:23:44.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.516+0000 7f16edb75640 1 --2- 172.21.15.67:0/1903097928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e8102900 0x7f16e8102d80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.516+0000 7f16edb75640 1 --2- 172.21.15.67:0/1903097928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e8101700 0x7f16e8101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.516+0000 7f16edb75640 1 -- 172.21.15.67:0/1903097928 >> 172.21.15.67:0/1903097928 conn(0x7f16e80fce90 msgr2=0x7f16e80ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:44.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.516+0000 7f16edb75640 1 -- 172.21.15.67:0/1903097928 shutdown_connections 2024-08-31T05:23:44.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.516+0000 7f16edb75640 1 -- 172.21.15.67:0/1903097928 wait complete. 2024-08-31T05:23:44.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.517+0000 7f16edb75640 1 Processor -- start 2024-08-31T05:23:44.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.517+0000 7f16edb75640 1 -- start start 2024-08-31T05:23:44.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.517+0000 7f16edb75640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e8101700 0x7f16e81972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:44.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.517+0000 7f16edb75640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e8102900 0x7f16e81977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:44.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.517+0000 7f16edb75640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f16e810a5c0 con 0x7f16e8101700 2024-08-31T05:23:44.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.517+0000 7f16edb75640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f16e810a440 con 0x7f16e8102900 2024-08-31T05:23:44.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.517+0000 7f16e77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e8101700 0x7f16e81972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:44.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.517+0000 7f16e77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e8101700 0x7f16e81972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41554/0 (socket says 172.21.15.67:41554) 2024-08-31T05:23:44.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.517+0000 7f16e77fe640 1 -- 172.21.15.67:0/3792247596 learned_addr learned my addr 172.21.15.67:0/3792247596 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:23:44.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.517+0000 7f16deffd640 1 --2- 172.21.15.67:0/3792247596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e8102900 0x7f16e81977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:44.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.517+0000 7f16e77fe640 1 -- 172.21.15.67:0/3792247596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e8102900 msgr2=0x7f16e81977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:44.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.517+0000 7f16e77fe640 1 --2- 172.21.15.67:0/3792247596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e8102900 0x7f16e81977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.518+0000 7f16e77fe640 1 -- 172.21.15.67:0/3792247596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e8197e70 con 0x7f16e8101700 2024-08-31T05:23:44.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.518+0000 7f16e77fe640 1 --2- 172.21.15.67:0/3792247596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e8101700 0x7f16e81972b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f16d800b3d0 tx=0x7f16d800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:44.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.518+0000 7f16e57fa640 1 -- 172.21.15.67:0/3792247596 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16d8015020 con 0x7f16e8101700 2024-08-31T05:23:44.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.518+0000 7f16e57fa640 1 -- 172.21.15.67:0/3792247596 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f16d8011af0 con 0x7f16e8101700 2024-08-31T05:23:44.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.518+0000 7f16edb75640 1 -- 172.21.15.67:0/3792247596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e819c8b0 con 0x7f16e8101700 2024-08-31T05:23:44.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.518+0000 7f16e57fa640 1 -- 172.21.15.67:0/3792247596 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16d8010da0 con 0x7f16e8101700 2024-08-31T05:23:44.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.518+0000 7f16edb75640 1 -- 172.21.15.67:0/3792247596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e819cec0 con 0x7f16e8101700 2024-08-31T05:23:44.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.519+0000 7f16edb75640 1 -- 172.21.15.67:0/3792247596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e8101b00 con 0x7f16e8101700 2024-08-31T05:23:44.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.520+0000 7f16e57fa640 1 -- 172.21.15.67:0/3792247596 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f16d8018020 con 0x7f16e8101700 2024-08-31T05:23:44.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.521+0000 7f16e57fa640 1 --2- 172.21.15.67:0/3792247596 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f16d4079e00 0x7f16d407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:44.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.521+0000 7f16e57fa640 1 -- 172.21.15.67:0/3792247596 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f16d809c350 con 0x7f16e8101700 2024-08-31T05:23:44.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.521+0000 7f16deffd640 1 --2- 172.21.15.67:0/3792247596 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f16d4079e00 0x7f16d407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:44.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.522+0000 7f16deffd640 1 --2- 172.21.15.67:0/3792247596 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f16d4079e00 0x7f16d407c2c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f16e8198760 tx=0x7f16d0005a20 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:44.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.525+0000 7f16e57fa640 1 -- 172.21.15.67:0/3792247596 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f16d801f020 con 0x7f16e8101700 2024-08-31T05:23:44.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.727+0000 7f16edb75640 1 -- 172.21.15.67:0/3792247596 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f16e80624e0 con 0x7f16d4079e00 2024-08-31T05:23:44.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.728+0000 7f16e57fa640 1 -- 172.21.15.67:0/3792247596 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7f16e80624e0 con 0x7f16d4079e00 2024-08-31T05:23:44.730 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:23:44.730 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:23:44.730 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:23:44.730 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-31T05:23:44.730 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:23:44.730 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr" 2024-08-31T05:23:44.730 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:23:44.730 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "2/2 daemons upgraded", 2024-08-31T05:23:44.731 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading alertmanager daemons", 2024-08-31T05:23:44.731 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:23:44.731 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:23:44.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.730+0000 7f16edb75640 1 -- 172.21.15.67:0/3792247596 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f16d4079e00 msgr2=0x7f16d407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:44.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.730+0000 7f16edb75640 1 --2- 172.21.15.67:0/3792247596 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f16d4079e00 0x7f16d407c2c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f16e8198760 tx=0x7f16d0005a20 comp rx=0 tx=0).stop 2024-08-31T05:23:44.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.730+0000 7f16edb75640 1 -- 172.21.15.67:0/3792247596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e8101700 msgr2=0x7f16e81972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:44.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.730+0000 7f16edb75640 1 --2- 172.21.15.67:0/3792247596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e8101700 0x7f16e81972b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f16d800b3d0 tx=0x7f16d800b890 comp rx=0 tx=0).stop 2024-08-31T05:23:44.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.730+0000 7f16edb75640 1 -- 172.21.15.67:0/3792247596 shutdown_connections 2024-08-31T05:23:44.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.730+0000 7f16edb75640 1 --2- 172.21.15.67:0/3792247596 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f16d4079e00 0x7f16d407c2c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.730+0000 7f16edb75640 1 --2- 172.21.15.67:0/3792247596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e8102900 0x7f16e81977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.730+0000 7f16edb75640 1 --2- 172.21.15.67:0/3792247596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16e8101700 0x7f16e81972b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:44.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.730+0000 7f16edb75640 1 -- 172.21.15.67:0/3792247596 >> 172.21.15.67:0/3792247596 conn(0x7f16e80fce90 msgr2=0x7f16e8105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:44.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.731+0000 7f16edb75640 1 -- 172.21.15.67:0/3792247596 shutdown_connections 2024-08-31T05:23:44.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:23:44.731+0000 7f16edb75640 1 -- 172.21.15.67:0/3792247596 wait complete. 2024-08-31T05:23:45.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:45 smithi073 ceph-mon[24726]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:45.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:45 smithi073 ceph-mon[24726]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:45.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:45 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3922841620' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:45.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:45 smithi073 ceph-mon[24726]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:45.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:45 smithi067 ceph-mon[17432]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:45.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:45 smithi067 ceph-mon[17432]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:45.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:45 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3922841620' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:23:45.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:45 smithi067 ceph-mon[17432]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:46.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:46 smithi073 ceph-mon[24726]: Upgrade: Updating alertmanager.smithi067 2024-08-31T05:23:46.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:46 smithi073 ceph-mon[24726]: Deploying daemon alertmanager.smithi067 on smithi067 2024-08-31T05:23:46.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:46 smithi073 ceph-mon[24726]: pgmap v54: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:23:46.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:46 smithi067 ceph-mon[17432]: Upgrade: Updating alertmanager.smithi067 2024-08-31T05:23:46.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:46 smithi067 ceph-mon[17432]: Deploying daemon alertmanager.smithi067 on smithi067 2024-08-31T05:23:46.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:46 smithi067 ceph-mon[17432]: pgmap v54: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:23:48.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:48 smithi067 ceph-mon[17432]: pgmap v55: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-08-31T05:23:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:48 smithi073 ceph-mon[24726]: pgmap v55: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-08-31T05:23:49.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:49 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:23:50.031 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:49 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:23:50.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:50 smithi073 ceph-mon[24726]: pgmap v56: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-08-31T05:23:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:50 smithi067 ceph-mon[17432]: pgmap v56: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-08-31T05:23:52.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:52 smithi073 ceph-mon[24726]: pgmap v57: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:23:52.970 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:52 smithi067 ceph-mon[17432]: pgmap v57: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:23:54.736 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:54 smithi067 ceph-mon[17432]: pgmap v58: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:23:54.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:54 smithi073 ceph-mon[24726]: pgmap v58: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:23:56.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:56 smithi073 ceph-mon[24726]: pgmap v59: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:23:56.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:56 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:56.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:56 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:56.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:56 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:23:56.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:56 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:56.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:56 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:56 smithi067 ceph-mon[17432]: pgmap v59: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:23:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:56 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:56 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:56 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:23:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:56 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:56 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:23:58.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:23:58 smithi073 ceph-mon[24726]: pgmap v60: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:23:59.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:23:58 smithi067 ceph-mon[17432]: pgmap v60: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:01.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:00 smithi067 ceph-mon[17432]: pgmap v61: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:00 smithi073 ceph-mon[24726]: pgmap v61: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:02.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:01 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:02.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:01 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:02.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:01 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:02.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:01 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:02.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:01 smithi067 ceph-mon[17432]: pgmap v62: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:01 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:01 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:01 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:01 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:01 smithi073 ceph-mon[24726]: pgmap v62: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:04.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:04 smithi073 ceph-mon[24726]: pgmap v63: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:04.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:24:05.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:04 smithi067 ceph-mon[17432]: pgmap v63: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:24:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:24:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:24:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-31T05:24:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:05.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:05.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:05.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:05.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:05.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:05.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:05.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:05.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:05.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:24:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:24:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-31T05:24:06.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:06.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:06.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:06.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:06.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:06.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:06.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:06.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:06.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:06.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:06.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:07.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:06 smithi067 ceph-mon[17432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-31T05:24:07.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:06 smithi067 ceph-mon[17432]: pgmap v64: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:07.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:06 smithi073 ceph-mon[24726]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-31T05:24:07.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:06 smithi073 ceph-mon[24726]: pgmap v64: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:07.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:07 smithi067 ceph-mon[17432]: Upgrade: Updating grafana.smithi067 2024-08-31T05:24:07.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:07 smithi067 ceph-mon[17432]: Deploying daemon grafana.smithi067 on smithi067 2024-08-31T05:24:08.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:07 smithi073 ceph-mon[24726]: Upgrade: Updating grafana.smithi067 2024-08-31T05:24:08.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:07 smithi073 ceph-mon[24726]: Deploying daemon grafana.smithi067 on smithi067 2024-08-31T05:24:09.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:08 smithi067 ceph-mon[17432]: pgmap v65: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:09.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:08 smithi073 ceph-mon[24726]: pgmap v65: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:10.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:09 smithi067 ceph-mon[17432]: pgmap v66: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:10.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:09 smithi073 ceph-mon[24726]: pgmap v66: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:12.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:12 smithi073 ceph-mon[24726]: pgmap v67: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:13.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:12 smithi067 ceph-mon[17432]: pgmap v67: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:14.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:14 smithi067 ceph-mon[17432]: pgmap v68: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:14.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.821+0000 7f5114d33640 1 -- 172.21.15.67:0/382524812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5110102190 msgr2=0x7f5110104580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:14.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.821+0000 7f5114d33640 1 --2- 172.21.15.67:0/382524812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5110102190 0x7f5110104580 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f51000098b0 tx=0x7f510002a4d0 comp rx=0 tx=0).stop 2024-08-31T05:24:14.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.821+0000 7f5114d33640 1 -- 172.21.15.67:0/382524812 shutdown_connections 2024-08-31T05:24:14.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.821+0000 7f5114d33640 1 --2- 172.21.15.67:0/382524812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5110104ac0 0x7f5110106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:14.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.821+0000 7f5114d33640 1 --2- 172.21.15.67:0/382524812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5110102190 0x7f5110104580 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:14.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.821+0000 7f5114d33640 1 -- 172.21.15.67:0/382524812 >> 172.21.15.67:0/382524812 conn(0x7f51100fbdb0 msgr2=0x7f51100fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:14.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.821+0000 7f5114d33640 1 -- 172.21.15.67:0/382524812 shutdown_connections 2024-08-31T05:24:14.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.821+0000 7f5114d33640 1 -- 172.21.15.67:0/382524812 wait complete. 2024-08-31T05:24:14.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.822+0000 7f5114d33640 1 Processor -- start 2024-08-31T05:24:14.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.822+0000 7f5114d33640 1 -- start start 2024-08-31T05:24:14.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.822+0000 7f5114d33640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5110102190 0x7f5110199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:14.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.822+0000 7f5114d33640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5110104ac0 0x7f5110199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:14.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.822+0000 7f5114d33640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f511010a580 con 0x7f5110104ac0 2024-08-31T05:24:14.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.822+0000 7f5114d33640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f511010a400 con 0x7f5110102190 2024-08-31T05:24:14.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.823+0000 7f510dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5110104ac0 0x7f5110199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:14.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.823+0000 7f510dd9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5110104ac0 0x7f5110199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39464/0 (socket says 172.21.15.67:39464) 2024-08-31T05:24:14.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.823+0000 7f510dd9b640 1 -- 172.21.15.67:0/39527914 learned_addr learned my addr 172.21.15.67:0/39527914 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:24:14.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.823+0000 7f510e59c640 1 --2- 172.21.15.67:0/39527914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5110102190 0x7f5110199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:14.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.823+0000 7f510dd9b640 1 -- 172.21.15.67:0/39527914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5110102190 msgr2=0x7f5110199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:14.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.823+0000 7f510dd9b640 1 --2- 172.21.15.67:0/39527914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5110102190 0x7f5110199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:14.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.823+0000 7f510dd9b640 1 -- 172.21.15.67:0/39527914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511019a120 con 0x7f5110104ac0 2024-08-31T05:24:14.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.823+0000 7f510dd9b640 1 --2- 172.21.15.67:0/39527914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5110104ac0 0x7f5110199aa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f510400d6c0 tx=0x7f510400db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:14.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.823+0000 7f50ff7fe640 1 -- 172.21.15.67:0/39527914 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5104017070 con 0x7f5110104ac0 2024-08-31T05:24:14.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.823+0000 7f50ff7fe640 1 -- 172.21.15.67:0/39527914 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51040054e0 con 0x7f5110104ac0 2024-08-31T05:24:14.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.823+0000 7f5114d33640 1 -- 172.21.15.67:0/39527914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511019eb60 con 0x7f5110104ac0 2024-08-31T05:24:14.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.823+0000 7f50ff7fe640 1 -- 172.21.15.67:0/39527914 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5104004b70 con 0x7f5110104ac0 2024-08-31T05:24:14.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.823+0000 7f5114d33640 1 -- 172.21.15.67:0/39527914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f511019f0f0 con 0x7f5110104ac0 2024-08-31T05:24:14.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.825+0000 7f5114d33640 1 -- 172.21.15.67:0/39527914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5110102570 con 0x7f5110104ac0 2024-08-31T05:24:14.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.825+0000 7f50ff7fe640 1 -- 172.21.15.67:0/39527914 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f5104009820 con 0x7f5110104ac0 2024-08-31T05:24:14.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.826+0000 7f50ff7fe640 1 --2- 172.21.15.67:0/39527914 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f50f8079e00 0x7f50f807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:14.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.826+0000 7f50ff7fe640 1 -- 172.21.15.67:0/39527914 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f510409c430 con 0x7f5110104ac0 2024-08-31T05:24:14.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.826+0000 7f510e59c640 1 --2- 172.21.15.67:0/39527914 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f50f8079e00 0x7f50f807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:14.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.826+0000 7f510e59c640 1 --2- 172.21.15.67:0/39527914 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f50f8079e00 0x7f50f807c2c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5100006010 tx=0x7f51000058d0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:14.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:14.831+0000 7f50ff7fe640 1 -- 172.21.15.67:0/39527914 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f5104068110 con 0x7f5110104ac0 2024-08-31T05:24:14.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:14 smithi073 ceph-mon[24726]: pgmap v68: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:15.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.043+0000 7f5114d33640 1 -- 172.21.15.67:0/39527914 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f51100623d0 con 0x7f50f8079e00 2024-08-31T05:24:15.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.045+0000 7f50ff7fe640 1 -- 172.21.15.67:0/39527914 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f51100623d0 con 0x7f50f8079e00 2024-08-31T05:24:15.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.047+0000 7f5114d33640 1 -- 172.21.15.67:0/39527914 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f50f8079e00 msgr2=0x7f50f807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:15.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.047+0000 7f5114d33640 1 --2- 172.21.15.67:0/39527914 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f50f8079e00 0x7f50f807c2c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5100006010 tx=0x7f51000058d0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.047+0000 7f5114d33640 1 -- 172.21.15.67:0/39527914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5110104ac0 msgr2=0x7f5110199aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.047+0000 7f5114d33640 1 --2- 172.21.15.67:0/39527914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5110104ac0 0x7f5110199aa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f510400d6c0 tx=0x7f510400db80 comp rx=0 tx=0).stop 2024-08-31T05:24:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.047+0000 7f5114d33640 1 -- 172.21.15.67:0/39527914 shutdown_connections 2024-08-31T05:24:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.047+0000 7f5114d33640 1 --2- 172.21.15.67:0/39527914 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f50f8079e00 0x7f50f807c2c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.047+0000 7f5114d33640 1 --2- 172.21.15.67:0/39527914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5110104ac0 0x7f5110199aa0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.047+0000 7f5114d33640 1 --2- 172.21.15.67:0/39527914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5110102190 0x7f5110199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.047+0000 7f5114d33640 1 -- 172.21.15.67:0/39527914 >> 172.21.15.67:0/39527914 conn(0x7f51100fbdb0 msgr2=0x7f51101018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.047+0000 7f5114d33640 1 -- 172.21.15.67:0/39527914 shutdown_connections 2024-08-31T05:24:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.047+0000 7f5114d33640 1 -- 172.21.15.67:0/39527914 wait complete. 2024-08-31T05:24:15.057 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:24:15.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.136+0000 7efdd18a7640 1 -- 172.21.15.67:0/3480030069 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdcc102900 msgr2=0x7efdcc102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:15.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.136+0000 7efdd18a7640 1 --2- 172.21.15.67:0/3480030069 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdcc102900 0x7efdcc102d80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009880 tx=0x7efdb402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.136+0000 7efdd18a7640 1 -- 172.21.15.67:0/3480030069 shutdown_connections 2024-08-31T05:24:15.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.137+0000 7efdd18a7640 1 --2- 172.21.15.67:0/3480030069 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdcc102900 0x7efdcc102d80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.137+0000 7efdd18a7640 1 --2- 172.21.15.67:0/3480030069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdcc101700 0x7efdcc101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.137+0000 7efdd18a7640 1 -- 172.21.15.67:0/3480030069 >> 172.21.15.67:0/3480030069 conn(0x7efdcc0fce90 msgr2=0x7efdcc0ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:15.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.137+0000 7efdd18a7640 1 -- 172.21.15.67:0/3480030069 shutdown_connections 2024-08-31T05:24:15.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.137+0000 7efdd18a7640 1 -- 172.21.15.67:0/3480030069 wait complete. 2024-08-31T05:24:15.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.137+0000 7efdd18a7640 1 Processor -- start 2024-08-31T05:24:15.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.137+0000 7efdd18a7640 1 -- start start 2024-08-31T05:24:15.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdd18a7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdcc101700 0x7efdcc197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:15.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdd18a7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdcc102900 0x7efdcc197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:15.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdd18a7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc10a520 con 0x7efdcc102900 2024-08-31T05:24:15.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdd18a7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc10a3a0 con 0x7efdcc101700 2024-08-31T05:24:15.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdca7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdcc102900 0x7efdcc197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:15.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdca7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdcc102900 0x7efdcc197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39496/0 (socket says 172.21.15.67:39496) 2024-08-31T05:24:15.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdca7fc640 1 -- 172.21.15.67:0/528090845 learned_addr learned my addr 172.21.15.67:0/528090845 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:24:15.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdcaffd640 1 --2- 172.21.15.67:0/528090845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdcc101700 0x7efdcc197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:15.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdca7fc640 1 -- 172.21.15.67:0/528090845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdcc101700 msgr2=0x7efdcc197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:15.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdca7fc640 1 --2- 172.21.15.67:0/528090845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdcc101700 0x7efdcc197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdca7fc640 1 -- 172.21.15.67:0/528090845 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdcc197dd0 con 0x7efdcc102900 2024-08-31T05:24:15.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdca7fc640 1 --2- 172.21.15.67:0/528090845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdcc102900 0x7efdcc197750 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efdb4006010 tx=0x7efdb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:15.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdd08a5640 1 -- 172.21.15.67:0/528090845 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efdb403f070 con 0x7efdcc102900 2024-08-31T05:24:15.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdd08a5640 1 -- 172.21.15.67:0/528090845 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efdb4004ac0 con 0x7efdcc102900 2024-08-31T05:24:15.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdd18a7640 1 -- 172.21.15.67:0/528090845 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdcc19c7b0 con 0x7efdcc102900 2024-08-31T05:24:15.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.138+0000 7efdd08a5640 1 -- 172.21.15.67:0/528090845 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efdb4035030 con 0x7efdcc102900 2024-08-31T05:24:15.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.139+0000 7efdd18a7640 1 -- 172.21.15.67:0/528090845 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdcc19cd40 con 0x7efdcc102900 2024-08-31T05:24:15.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.140+0000 7efdd18a7640 1 -- 172.21.15.67:0/528090845 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdcc101b00 con 0x7efdcc102900 2024-08-31T05:24:15.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.140+0000 7efdd08a5640 1 -- 172.21.15.67:0/528090845 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7efdb4042070 con 0x7efdcc102900 2024-08-31T05:24:15.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.141+0000 7efdd08a5640 1 --2- 172.21.15.67:0/528090845 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efdb8079e00 0x7efdb807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:15.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.141+0000 7efdd08a5640 1 -- 172.21.15.67:0/528090845 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7efdb40bd480 con 0x7efdcc102900 2024-08-31T05:24:15.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.141+0000 7efdcaffd640 1 --2- 172.21.15.67:0/528090845 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efdb8079e00 0x7efdb807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:15.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.141+0000 7efdcaffd640 1 --2- 172.21.15.67:0/528090845 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efdb8079e00 0x7efdb807c2c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efdcc102760 tx=0x7efdbc009670 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:15.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.145+0000 7efdd08a5640 1 -- 172.21.15.67:0/528090845 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7efdb4089160 con 0x7efdcc102900 2024-08-31T05:24:15.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.353+0000 7efdd18a7640 1 -- 172.21.15.67:0/528090845 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efdcc0623d0 con 0x7efdb8079e00 2024-08-31T05:24:15.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.354+0000 7efdd08a5640 1 -- 172.21.15.67:0/528090845 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7efdcc0623d0 con 0x7efdb8079e00 2024-08-31T05:24:15.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.356+0000 7efdd18a7640 1 -- 172.21.15.67:0/528090845 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efdb8079e00 msgr2=0x7efdb807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:15.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.356+0000 7efdd18a7640 1 --2- 172.21.15.67:0/528090845 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efdb8079e00 0x7efdb807c2c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efdcc102760 tx=0x7efdbc009670 comp rx=0 tx=0).stop 2024-08-31T05:24:15.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.356+0000 7efdd18a7640 1 -- 172.21.15.67:0/528090845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdcc102900 msgr2=0x7efdcc197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:15.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.356+0000 7efdd18a7640 1 --2- 172.21.15.67:0/528090845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdcc102900 0x7efdcc197750 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efdb4006010 tx=0x7efdb40046c0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.356+0000 7efdd18a7640 1 -- 172.21.15.67:0/528090845 shutdown_connections 2024-08-31T05:24:15.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.356+0000 7efdd18a7640 1 --2- 172.21.15.67:0/528090845 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efdb8079e00 0x7efdb807c2c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.356+0000 7efdd18a7640 1 --2- 172.21.15.67:0/528090845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdcc102900 0x7efdcc197750 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.356+0000 7efdd18a7640 1 --2- 172.21.15.67:0/528090845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdcc101700 0x7efdcc197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.356+0000 7efdd18a7640 1 -- 172.21.15.67:0/528090845 >> 172.21.15.67:0/528090845 conn(0x7efdcc0fce90 msgr2=0x7efdcc105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.356+0000 7efdd18a7640 1 -- 172.21.15.67:0/528090845 shutdown_connections 2024-08-31T05:24:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.356+0000 7efdd18a7640 1 -- 172.21.15.67:0/528090845 wait complete. 2024-08-31T05:24:15.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.439+0000 7f1901c5b640 1 -- 172.21.15.67:0/405721588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc102920 msgr2=0x7f18fc102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.439+0000 7f1901c5b640 1 --2- 172.21.15.67:0/405721588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc102920 0x7f18fc102da0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009880 tx=0x7f18f002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.439+0000 7f1901c5b640 1 -- 172.21.15.67:0/405721588 shutdown_connections 2024-08-31T05:24:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.439+0000 7f1901c5b640 1 --2- 172.21.15.67:0/405721588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc102920 0x7f18fc102da0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.439+0000 7f1901c5b640 1 --2- 172.21.15.67:0/405721588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18fc101720 0x7f18fc101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.439+0000 7f1901c5b640 1 -- 172.21.15.67:0/405721588 >> 172.21.15.67:0/405721588 conn(0x7f18fc0fceb0 msgr2=0x7f18fc0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.439+0000 7f1901c5b640 1 -- 172.21.15.67:0/405721588 shutdown_connections 2024-08-31T05:24:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.439+0000 7f1901c5b640 1 -- 172.21.15.67:0/405721588 wait complete. 2024-08-31T05:24:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.440+0000 7f1901c5b640 1 Processor -- start 2024-08-31T05:24:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.440+0000 7f1901c5b640 1 -- start start 2024-08-31T05:24:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.440+0000 7f1901c5b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc101720 0x7f18fc197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:15.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.440+0000 7f1901c5b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18fc102920 0x7f18fc197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.440+0000 7f1901c5b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc10a560 con 0x7f18fc101720 2024-08-31T05:24:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.440+0000 7f1901c5b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc10a3e0 con 0x7f18fc102920 2024-08-31T05:24:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.440+0000 7f18fb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc101720 0x7f18fc197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.440+0000 7f18fb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc101720 0x7f18fc197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39514/0 (socket says 172.21.15.67:39514) 2024-08-31T05:24:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.440+0000 7f18fb7fe640 1 -- 172.21.15.67:0/4054751279 learned_addr learned my addr 172.21.15.67:0/4054751279 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:24:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.440+0000 7f18faffd640 1 --2- 172.21.15.67:0/4054751279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18fc102920 0x7f18fc197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.440+0000 7f18fb7fe640 1 -- 172.21.15.67:0/4054751279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18fc102920 msgr2=0x7f18fc197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.440+0000 7f18fb7fe640 1 --2- 172.21.15.67:0/4054751279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18fc102920 0x7f18fc197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.440+0000 7f18fb7fe640 1 -- 172.21.15.67:0/4054751279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18fc197e10 con 0x7f18fc101720 2024-08-31T05:24:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.440+0000 7f18faffd640 1 --2- 172.21.15.67:0/4054751279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18fc102920 0x7f18fc197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:24:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.441+0000 7f18fb7fe640 1 --2- 172.21.15.67:0/4054751279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc101720 0x7f18fc197250 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00d8d0 tx=0x7f18ec00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.441+0000 7f18f8ff9640 1 -- 172.21.15.67:0/4054751279 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18ec017070 con 0x7f18fc101720 2024-08-31T05:24:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.441+0000 7f18f8ff9640 1 -- 172.21.15.67:0/4054751279 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f18ec00be10 con 0x7f18fc101720 2024-08-31T05:24:15.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.441+0000 7f1901c5b640 1 -- 172.21.15.67:0/4054751279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18fc19c850 con 0x7f18fc101720 2024-08-31T05:24:15.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.441+0000 7f18f8ff9640 1 -- 172.21.15.67:0/4054751279 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18ec00f3c0 con 0x7f18fc101720 2024-08-31T05:24:15.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.441+0000 7f1901c5b640 1 -- 172.21.15.67:0/4054751279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18fc19cde0 con 0x7f18fc101720 2024-08-31T05:24:15.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.442+0000 7f1901c5b640 1 -- 172.21.15.67:0/4054751279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18fc101b20 con 0x7f18fc101720 2024-08-31T05:24:15.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.442+0000 7f18f8ff9640 1 -- 172.21.15.67:0/4054751279 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f18ec01a070 con 0x7f18fc101720 2024-08-31T05:24:15.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.443+0000 7f18f8ff9640 1 --2- 172.21.15.67:0/4054751279 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f18e4079e40 0x7f18e407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:15.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.443+0000 7f18faffd640 1 --2- 172.21.15.67:0/4054751279 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f18e4079e40 0x7f18e407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:15.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.443+0000 7f18f8ff9640 1 -- 172.21.15.67:0/4054751279 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f18ec09c460 con 0x7f18fc101720 2024-08-31T05:24:15.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.443+0000 7f18faffd640 1 --2- 172.21.15.67:0/4054751279 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f18e4079e40 0x7f18e407c300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f18f00096c0 tx=0x7f18f0009650 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:15.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.448+0000 7f18f8ff9640 1 -- 172.21.15.67:0/4054751279 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f18ec064050 con 0x7f18fc101720 2024-08-31T05:24:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.643+0000 7f1901c5b640 1 -- 172.21.15.67:0/4054751279 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f18fc062490 con 0x7f18e4079e40 2024-08-31T05:24:15.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.653+0000 7f18f8ff9640 1 -- 172.21.15.67:0/4054751279 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f18fc062490 con 0x7f18e4079e40 2024-08-31T05:24:15.655 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:24:15.655 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (20s) 14s ago 11m 17.6M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:24:15.655 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (3m) 14s ago 11m 8736k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:24:15.655 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (2m) 60s ago 10m 8128k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:24:15.655 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (11m) 14s ago 11m 6895k - 19.1.1-242-g244a32d3 395b9209a980 a47c71179c57 2024-08-31T05:24:15.655 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (10m) 60s ago 10m 6895k - 19.1.1-242-g244a32d3 395b9209a980 5f2ce08c4451 2024-08-31T05:24:15.655 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (9m) 14s ago 10m 78.0M - 9.4.12 2bacad6d85d8 ac51e53c0deb 2024-08-31T05:24:15.655 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (5m) 14s ago 5m 91.9M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:24:15.656 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (5m) 14s ago 5m 156M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:24:15.656 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (5m) 60s ago 5m 14.8M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:24:15.656 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (5m) 60s ago 5m 16.5M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:24:15.656 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (2m) 14s ago 12m 580M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:24:15.656 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (93s) 60s ago 10m 522M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:24:15.656 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (12m) 14s ago 12m 54.5M 2048M 19.1.1-242-g244a32d3 395b9209a980 7082a38c8108 2024-08-31T05:24:15.656 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (10m) 60s ago 10m 48.0M 2048M 19.1.1-242-g244a32d3 395b9209a980 30ccf0ed274b 2024-08-31T05:24:15.656 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (71s) 14s ago 11m 9.83M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:24:15.656 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (64s) 60s ago 10m 3384k - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:24:15.656 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (9m) 14s ago 9m 203M 1216M 19.1.1-242-g244a32d3 395b9209a980 b9f3f60b65f9 2024-08-31T05:24:15.656 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (8m) 14s ago 8m 224M 1216M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:24:15.656 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (8m) 14s ago 8m 187M 1216M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:24:15.656 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (7m) 60s ago 7m 249M 2240M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:24:15.657 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (7m) 60s ago 7m 211M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:24:15.657 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (6m) 60s ago 6m 186M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:24:15.657 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (42s) 14s ago 10m 41.6M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:24:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.655+0000 7f1901c5b640 1 -- 172.21.15.67:0/4054751279 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f18e4079e40 msgr2=0x7f18e407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.655+0000 7f1901c5b640 1 --2- 172.21.15.67:0/4054751279 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f18e4079e40 0x7f18e407c300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f18f00096c0 tx=0x7f18f0009650 comp rx=0 tx=0).stop 2024-08-31T05:24:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.655+0000 7f1901c5b640 1 -- 172.21.15.67:0/4054751279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc101720 msgr2=0x7f18fc197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.655+0000 7f1901c5b640 1 --2- 172.21.15.67:0/4054751279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc101720 0x7f18fc197250 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00d8d0 tx=0x7f18ec00dd90 comp rx=0 tx=0).stop 2024-08-31T05:24:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.655+0000 7f1901c5b640 1 -- 172.21.15.67:0/4054751279 shutdown_connections 2024-08-31T05:24:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.655+0000 7f1901c5b640 1 --2- 172.21.15.67:0/4054751279 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f18e4079e40 0x7f18e407c300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.655+0000 7f1901c5b640 1 --2- 172.21.15.67:0/4054751279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18fc102920 0x7f18fc197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.655+0000 7f1901c5b640 1 --2- 172.21.15.67:0/4054751279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc101720 0x7f18fc197250 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.655+0000 7f1901c5b640 1 -- 172.21.15.67:0/4054751279 >> 172.21.15.67:0/4054751279 conn(0x7f18fc0fceb0 msgr2=0x7f18fc105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.655+0000 7f1901c5b640 1 -- 172.21.15.67:0/4054751279 shutdown_connections 2024-08-31T05:24:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.655+0000 7f1901c5b640 1 -- 172.21.15.67:0/4054751279 wait complete. 2024-08-31T05:24:15.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.739+0000 7f64ee33d640 1 -- 172.21.15.67:0/399226564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e8102900 msgr2=0x7f64e8102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:15.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.739+0000 7f64ee33d640 1 --2- 172.21.15.67:0/399226564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e8102900 0x7f64e8102d80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009880 tx=0x7f64dc02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.739+0000 7f64ee33d640 1 -- 172.21.15.67:0/399226564 shutdown_connections 2024-08-31T05:24:15.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.739+0000 7f64ee33d640 1 --2- 172.21.15.67:0/399226564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e8102900 0x7f64e8102d80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.739+0000 7f64ee33d640 1 --2- 172.21.15.67:0/399226564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64e8101700 0x7f64e8101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.739+0000 7f64ee33d640 1 -- 172.21.15.67:0/399226564 >> 172.21.15.67:0/399226564 conn(0x7f64e80fce90 msgr2=0x7f64e80ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:15.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.739+0000 7f64ee33d640 1 -- 172.21.15.67:0/399226564 shutdown_connections 2024-08-31T05:24:15.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.739+0000 7f64ee33d640 1 -- 172.21.15.67:0/399226564 wait complete. 2024-08-31T05:24:15.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.740+0000 7f64ee33d640 1 Processor -- start 2024-08-31T05:24:15.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.740+0000 7f64ee33d640 1 -- start start 2024-08-31T05:24:15.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.740+0000 7f64ee33d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e8101700 0x7f64e8197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:15.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.740+0000 7f64ee33d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64e8102900 0x7f64e8197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:15.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.740+0000 7f64ee33d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f64e810a520 con 0x7f64e8101700 2024-08-31T05:24:15.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.740+0000 7f64ee33d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f64e810a3a0 con 0x7f64e8102900 2024-08-31T05:24:15.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.740+0000 7f64e7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e8101700 0x7f64e8197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:15.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.740+0000 7f64e7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e8101700 0x7f64e8197220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39540/0 (socket says 172.21.15.67:39540) 2024-08-31T05:24:15.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.740+0000 7f64e7fff640 1 -- 172.21.15.67:0/2166436079 learned_addr learned my addr 172.21.15.67:0/2166436079 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:24:15.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.740+0000 7f64e77fe640 1 --2- 172.21.15.67:0/2166436079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64e8102900 0x7f64e8197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:15.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.741+0000 7f64e7fff640 1 -- 172.21.15.67:0/2166436079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64e8102900 msgr2=0x7f64e8197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:15.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.741+0000 7f64e7fff640 1 --2- 172.21.15.67:0/2166436079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64e8102900 0x7f64e8197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:15.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.741+0000 7f64e7fff640 1 -- 172.21.15.67:0/2166436079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e8197d50 con 0x7f64e8101700 2024-08-31T05:24:15.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.741+0000 7f64e7fff640 1 --2- 172.21.15.67:0/2166436079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e8101700 0x7f64e8197220 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f64d800c8f0 tx=0x7f64d800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:15.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.741+0000 7f64e57fa640 1 -- 172.21.15.67:0/2166436079 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64d8004020 con 0x7f64e8101700 2024-08-31T05:24:15.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.741+0000 7f64e57fa640 1 -- 172.21.15.67:0/2166436079 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64d8007e10 con 0x7f64e8101700 2024-08-31T05:24:15.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.741+0000 7f64ee33d640 1 -- 172.21.15.67:0/2166436079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e819c7c0 con 0x7f64e8101700 2024-08-31T05:24:15.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.741+0000 7f64e57fa640 1 -- 172.21.15.67:0/2166436079 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64d8003e10 con 0x7f64e8101700 2024-08-31T05:24:15.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.741+0000 7f64ee33d640 1 -- 172.21.15.67:0/2166436079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e819cd20 con 0x7f64e8101700 2024-08-31T05:24:15.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.742+0000 7f64ee33d640 1 -- 172.21.15.67:0/2166436079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e8101b00 con 0x7f64e8101700 2024-08-31T05:24:15.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.743+0000 7f64e57fa640 1 -- 172.21.15.67:0/2166436079 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f64d80041c0 con 0x7f64e8101700 2024-08-31T05:24:15.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.743+0000 7f64e57fa640 1 --2- 172.21.15.67:0/2166436079 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f64d0079e00 0x7f64d007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:15.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.743+0000 7f64e57fa640 1 -- 172.21.15.67:0/2166436079 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f64d809c9a0 con 0x7f64e8101700 2024-08-31T05:24:15.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.743+0000 7f64e77fe640 1 --2- 172.21.15.67:0/2166436079 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f64d0079e00 0x7f64d007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:15.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.744+0000 7f64e77fe640 1 --2- 172.21.15.67:0/2166436079 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f64d0079e00 0x7f64d007c2c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64e81986d0 tx=0x7f64dc005a20 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:15.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:15.748+0000 7f64e57fa640 1 -- 172.21.15.67:0/2166436079 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f64d8064590 con 0x7f64e8101700 2024-08-31T05:24:16.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.006+0000 7f64ee33d640 1 -- 172.21.15.67:0/2166436079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f64e8062b90 con 0x7f64e8101700 2024-08-31T05:24:16.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.007+0000 7f64e57fa640 1 -- 172.21.15.67:0/2166436079 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f64d8068700 con 0x7f64e8101700 2024-08-31T05:24:16.009 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:24:16.009 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:24:16.009 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2 2024-08-31T05:24:16.009 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:24:16.009 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:24:16.009 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:24:16.009 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:24:16.009 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:24:16.010 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 6 2024-08-31T05:24:16.010 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:24:16.010 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:24:16.010 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:24:16.010 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:24:16.010 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:24:16.010 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 12, 2024-08-31T05:24:16.010 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:24:16.010 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:24:16.010 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:24:16.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.009+0000 7f64ee33d640 1 -- 172.21.15.67:0/2166436079 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f64d0079e00 msgr2=0x7f64d007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:16.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.009+0000 7f64ee33d640 1 --2- 172.21.15.67:0/2166436079 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f64d0079e00 0x7f64d007c2c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64e81986d0 tx=0x7f64dc005a20 comp rx=0 tx=0).stop 2024-08-31T05:24:16.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.009+0000 7f64ee33d640 1 -- 172.21.15.67:0/2166436079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e8101700 msgr2=0x7f64e8197220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:16.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.009+0000 7f64ee33d640 1 --2- 172.21.15.67:0/2166436079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e8101700 0x7f64e8197220 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f64d800c8f0 tx=0x7f64d800cdb0 comp rx=0 tx=0).stop 2024-08-31T05:24:16.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.009+0000 7f64ee33d640 1 -- 172.21.15.67:0/2166436079 shutdown_connections 2024-08-31T05:24:16.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.009+0000 7f64ee33d640 1 --2- 172.21.15.67:0/2166436079 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f64d0079e00 0x7f64d007c2c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:16.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.009+0000 7f64ee33d640 1 --2- 172.21.15.67:0/2166436079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64e8102900 0x7f64e8197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:16.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.009+0000 7f64ee33d640 1 --2- 172.21.15.67:0/2166436079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64e8101700 0x7f64e8197220 secure :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f64d800c8f0 tx=0x7f64d800cdb0 comp rx=0 tx=0).stop 2024-08-31T05:24:16.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.009+0000 7f64ee33d640 1 -- 172.21.15.67:0/2166436079 >> 172.21.15.67:0/2166436079 conn(0x7f64e80fce90 msgr2=0x7f64e8105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:16.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.009+0000 7f64ee33d640 1 -- 172.21.15.67:0/2166436079 shutdown_connections 2024-08-31T05:24:16.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.009+0000 7f64ee33d640 1 -- 172.21.15.67:0/2166436079 wait complete. 2024-08-31T05:24:16.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.093+0000 7fccc0185640 1 -- 172.21.15.67:0/4027330621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccb8104ac0 msgr2=0x7fccb8106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:16.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.093+0000 7fccc0185640 1 --2- 172.21.15.67:0/4027330621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccb8104ac0 0x7fccb8106eb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fccac0098b0 tx=0x7fccac02a4d0 comp rx=0 tx=0).stop 2024-08-31T05:24:16.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.093+0000 7fccc0185640 1 -- 172.21.15.67:0/4027330621 shutdown_connections 2024-08-31T05:24:16.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.093+0000 7fccc0185640 1 --2- 172.21.15.67:0/4027330621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccb8104ac0 0x7fccb8106eb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:16.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.093+0000 7fccc0185640 1 --2- 172.21.15.67:0/4027330621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb8102190 0x7fccb8104580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:16.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.093+0000 7fccc0185640 1 -- 172.21.15.67:0/4027330621 >> 172.21.15.67:0/4027330621 conn(0x7fccb80fbdb0 msgr2=0x7fccb80fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:16.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.093+0000 7fccc0185640 1 -- 172.21.15.67:0/4027330621 shutdown_connections 2024-08-31T05:24:16.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.093+0000 7fccc0185640 1 -- 172.21.15.67:0/4027330621 wait complete. 2024-08-31T05:24:16.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.094+0000 7fccc0185640 1 Processor -- start 2024-08-31T05:24:16.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.094+0000 7fccc0185640 1 -- start start 2024-08-31T05:24:16.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.094+0000 7fccc0185640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb8102190 0x7fccb8101a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:16.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.094+0000 7fccc0185640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccb8104ac0 0x7fccb8100140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:16.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.094+0000 7fccc0185640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fccb810a5b0 con 0x7fccb8104ac0 2024-08-31T05:24:16.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.094+0000 7fccc0185640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fccb810a430 con 0x7fccb8102190 2024-08-31T05:24:16.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.094+0000 7fccbd720640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccb8104ac0 0x7fccb8100140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:16.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.094+0000 7fccbd720640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccb8104ac0 0x7fccb8100140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39560/0 (socket says 172.21.15.67:39560) 2024-08-31T05:24:16.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.094+0000 7fccbd720640 1 -- 172.21.15.67:0/284645564 learned_addr learned my addr 172.21.15.67:0/284645564 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:24:16.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.095+0000 7fccbd720640 1 -- 172.21.15.67:0/284645564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb8102190 msgr2=0x7fccb8101a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:16.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.095+0000 7fccbd720640 1 --2- 172.21.15.67:0/284645564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb8102190 0x7fccb8101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:16.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.095+0000 7fccbd720640 1 -- 172.21.15.67:0/284645564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb8100680 con 0x7fccb8104ac0 2024-08-31T05:24:16.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.095+0000 7fccbd720640 1 --2- 172.21.15.67:0/284645564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccb8104ac0 0x7fccb8100140 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fccac009230 tx=0x7fccac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:16.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.095+0000 7fccb6ffd640 1 -- 172.21.15.67:0/284645564 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fccac03f070 con 0x7fccb8104ac0 2024-08-31T05:24:16.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.095+0000 7fccc0185640 1 -- 172.21.15.67:0/284645564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb8100910 con 0x7fccb8104ac0 2024-08-31T05:24:16.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.095+0000 7fccb6ffd640 1 -- 172.21.15.67:0/284645564 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fccac0044d0 con 0x7fccb8104ac0 2024-08-31T05:24:16.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.095+0000 7fccb6ffd640 1 -- 172.21.15.67:0/284645564 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fccac035030 con 0x7fccb8104ac0 2024-08-31T05:24:16.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.095+0000 7fccc0185640 1 -- 172.21.15.67:0/284645564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb8100ec0 con 0x7fccb8104ac0 2024-08-31T05:24:16.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.096+0000 7fccc0185640 1 -- 172.21.15.67:0/284645564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb8102570 con 0x7fccb8104ac0 2024-08-31T05:24:16.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.097+0000 7fccb6ffd640 1 -- 172.21.15.67:0/284645564 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fccac042070 con 0x7fccb8104ac0 2024-08-31T05:24:16.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.097+0000 7fccb6ffd640 1 --2- 172.21.15.67:0/284645564 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcca0079e00 0x7fcca007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:16.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.097+0000 7fccb6ffd640 1 -- 172.21.15.67:0/284645564 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fccac0bd5b0 con 0x7fccb8104ac0 2024-08-31T05:24:16.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.098+0000 7fccbdf21640 1 --2- 172.21.15.67:0/284645564 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcca0079e00 0x7fcca007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:16.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.098+0000 7fccbdf21640 1 --2- 172.21.15.67:0/284645564 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcca0079e00 0x7fcca007c2c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009710 tx=0x7fccb0006c90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:16.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.102+0000 7fccb6ffd640 1 -- 172.21.15.67:0/284645564 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fccac0850a0 con 0x7fccb8104ac0 2024-08-31T05:24:16.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.312+0000 7fccc0185640 1 -- 172.21.15.67:0/284645564 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fccb8105520 con 0x7fcca0079e00 2024-08-31T05:24:16.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.314+0000 7fccb6ffd640 1 -- 172.21.15.67:0/284645564 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7fccb8105520 con 0x7fcca0079e00 2024-08-31T05:24:16.316 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:24:16.316 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:24:16.316 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:24:16.316 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-31T05:24:16.316 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:24:16.316 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr" 2024-08-31T05:24:16.316 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:24:16.316 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "2/2 daemons upgraded", 2024-08-31T05:24:16.316 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading grafana daemons", 2024-08-31T05:24:16.316 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:24:16.316 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:24:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.316+0000 7fccc0185640 1 -- 172.21.15.67:0/284645564 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcca0079e00 msgr2=0x7fcca007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.316+0000 7fccc0185640 1 --2- 172.21.15.67:0/284645564 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcca0079e00 0x7fcca007c2c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009710 tx=0x7fccb0006c90 comp rx=0 tx=0).stop 2024-08-31T05:24:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.316+0000 7fccc0185640 1 -- 172.21.15.67:0/284645564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccb8104ac0 msgr2=0x7fccb8100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.316+0000 7fccc0185640 1 --2- 172.21.15.67:0/284645564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccb8104ac0 0x7fccb8100140 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fccac009230 tx=0x7fccac0048f0 comp rx=0 tx=0).stop 2024-08-31T05:24:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.316+0000 7fccc0185640 1 -- 172.21.15.67:0/284645564 shutdown_connections 2024-08-31T05:24:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.316+0000 7fccc0185640 1 --2- 172.21.15.67:0/284645564 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcca0079e00 0x7fcca007c2c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.316+0000 7fccc0185640 1 --2- 172.21.15.67:0/284645564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccb8104ac0 0x7fccb8100140 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.316+0000 7fccc0185640 1 --2- 172.21.15.67:0/284645564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb8102190 0x7fccb8101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:16.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.316+0000 7fccc0185640 1 -- 172.21.15.67:0/284645564 >> 172.21.15.67:0/284645564 conn(0x7fccb80fbdb0 msgr2=0x7fccb80fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:16.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.316+0000 7fccc0185640 1 -- 172.21.15.67:0/284645564 shutdown_connections 2024-08-31T05:24:16.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:16.316+0000 7fccc0185640 1 -- 172.21.15.67:0/284645564 wait complete. 2024-08-31T05:24:16.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:16 smithi067 ceph-mon[17432]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:16.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:16 smithi067 ceph-mon[17432]: from='client.14878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:16.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:16 smithi067 ceph-mon[17432]: pgmap v69: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:16.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:16 smithi067 ceph-mon[17432]: from='client.14882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:16.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:16 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2166436079' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:16.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:16 smithi073 ceph-mon[24726]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:16.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:16 smithi073 ceph-mon[24726]: from='client.14878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:16.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:16 smithi073 ceph-mon[24726]: pgmap v69: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:16.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:16 smithi073 ceph-mon[24726]: from='client.14882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:16.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:16 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2166436079' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:17.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:17 smithi067 ceph-mon[17432]: from='client.14890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:17.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:17 smithi073 ceph-mon[24726]: from='client.14890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:18.798 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:18 smithi067 ceph-mon[17432]: pgmap v70: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:18.798 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:18 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:18.798 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:18 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:18.798 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:18 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:18.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:18 smithi073 ceph-mon[24726]: pgmap v70: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:18.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:18 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:18.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:18 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:18.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:18 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:19.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:19 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:24:19.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:19 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:24:21.046 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:20 smithi067 ceph-mon[17432]: pgmap v71: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:21.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:20 smithi073 ceph-mon[24726]: pgmap v71: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:23.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:22 smithi067 ceph-mon[17432]: pgmap v72: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:23.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:22 smithi073 ceph-mon[24726]: pgmap v72: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:25.036 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:24 smithi067 ceph-mon[17432]: pgmap v73: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:25.036 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:24 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:25.037 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:24 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:25.037 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:24 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:25.037 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:24 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:25.039 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:24 smithi073 ceph-mon[24726]: pgmap v73: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:25.039 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:24 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:25.039 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:24 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:25.040 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:24 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:25.040 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:24 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:27.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:26 smithi067 ceph-mon[17432]: pgmap v74: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:27.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:26 smithi073 ceph-mon[24726]: pgmap v74: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: pgmap v75: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:24:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:24:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-31T05:24:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:28.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:28.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:28.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:28.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:28.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:28.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:28.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:28.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:28.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:28.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:28.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:28.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:28.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:28.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-08-31T05:24:28.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-08-31T05:24:28.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:28.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-08-31T05:24:28.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-08-31T05:24:28.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-08-31T05:24:28.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-08-31T05:24:28.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-08-31T05:24:28.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-08-31T05:24:28.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-08-31T05:24:28.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-08-31T05:24:28.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:28.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-08-31T05:24:28.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-08-31T05:24:28.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-08-31T05:24:28.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-08-31T05:24:28.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-08-31T05:24:28.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-08-31T05:24:28.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-08-31T05:24:28.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:28.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:28.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:28.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:28.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:28.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:28.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-08-31T05:24:28.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-08-31T05:24:28.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:28.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:24:28.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:24:28.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:28.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:28.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:24:28.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:24:28.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:28 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:29.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: pgmap v75: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:29.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:29.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:29.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:24:29.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:24:29.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:29.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-31T05:24:29.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:29.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:29.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:29.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:29.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:29.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:29.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:29.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:29.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:29.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:29.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:29.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:29.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:29.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:29.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:29.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-08-31T05:24:29.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-08-31T05:24:29.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:29.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-08-31T05:24:29.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-08-31T05:24:29.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-08-31T05:24:29.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-08-31T05:24:29.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-08-31T05:24:29.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-08-31T05:24:29.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-08-31T05:24:29.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-08-31T05:24:29.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:29.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-08-31T05:24:29.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-08-31T05:24:29.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-08-31T05:24:29.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-08-31T05:24:29.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-08-31T05:24:29.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-08-31T05:24:29.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-08-31T05:24:29.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:29.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:29.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:29.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:29.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:29.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-31T05:24:29.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-08-31T05:24:29.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-08-31T05:24:29.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:29.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:24:29.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:24:29.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:29.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:29.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:24:29.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:24:29.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:28 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:30.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:29 smithi067 ceph-mon[17432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-31T05:24:30.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:29 smithi067 ceph-mon[17432]: Upgrade: Finalizing container_image settings 2024-08-31T05:24:30.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:29 smithi067 ceph-mon[17432]: Upgrade: Complete! 2024-08-31T05:24:30.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:29 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:30.117 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:29 smithi073 ceph-mon[24726]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-31T05:24:30.117 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:29 smithi073 ceph-mon[24726]: Upgrade: Finalizing container_image settings 2024-08-31T05:24:30.117 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:29 smithi073 ceph-mon[24726]: Upgrade: Complete! 2024-08-31T05:24:30.118 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:29 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:31.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:30 smithi067 ceph-mon[17432]: pgmap v76: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:31.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:30 smithi073 ceph-mon[24726]: pgmap v76: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:33.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:32 smithi067 ceph-mon[17432]: pgmap v77: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:32 smithi073 ceph-mon[24726]: pgmap v77: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:34 smithi067 ceph-mon[17432]: pgmap v78: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:34 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:24:35.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:34 smithi073 ceph-mon[24726]: pgmap v78: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:35.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:34 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:24:37.061 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:36 smithi067 ceph-mon[17432]: pgmap v79: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:36 smithi073 ceph-mon[24726]: pgmap v79: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:38.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:38 smithi067 ceph-mon[17432]: pgmap v80: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:39.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:38 smithi073 ceph-mon[24726]: pgmap v80: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:41.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:40 smithi067 ceph-mon[17432]: pgmap v81: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:41.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:40 smithi073 ceph-mon[24726]: pgmap v81: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:43.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:42 smithi067 ceph-mon[17432]: pgmap v82: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:43.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:42 smithi073 ceph-mon[24726]: pgmap v82: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:45.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:44 smithi067 ceph-mon[17432]: pgmap v83: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:45.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:44 smithi073 ceph-mon[24726]: pgmap v83: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:46.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.413+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/1737873326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbdc104ac0 msgr2=0x7fcbdc106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:46.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.413+0000 7fcbe0cf3640 1 --2- 172.21.15.67:0/1737873326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbdc104ac0 0x7fcbdc106eb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0098b0 tx=0x7fcbcc02a4d0 comp rx=0 tx=0).stop 2024-08-31T05:24:46.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.413+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/1737873326 shutdown_connections 2024-08-31T05:24:46.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.413+0000 7fcbe0cf3640 1 --2- 172.21.15.67:0/1737873326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbdc104ac0 0x7fcbdc106eb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:46.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.413+0000 7fcbe0cf3640 1 --2- 172.21.15.67:0/1737873326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbdc102190 0x7fcbdc104580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:46.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.413+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/1737873326 >> 172.21.15.67:0/1737873326 conn(0x7fcbdc0fbdb0 msgr2=0x7fcbdc0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:46.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.413+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/1737873326 shutdown_connections 2024-08-31T05:24:46.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.413+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/1737873326 wait complete. 2024-08-31T05:24:46.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.414+0000 7fcbe0cf3640 1 Processor -- start 2024-08-31T05:24:46.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.414+0000 7fcbe0cf3640 1 -- start start 2024-08-31T05:24:46.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.414+0000 7fcbe0cf3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbdc102190 0x7fcbdc1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:46.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.414+0000 7fcbe0cf3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbdc104ac0 0x7fcbdc1977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:46.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.414+0000 7fcbe0cf3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc10a530 con 0x7fcbdc104ac0 2024-08-31T05:24:46.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.414+0000 7fcbe0cf3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc10a3b0 con 0x7fcbdc102190 2024-08-31T05:24:46.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.414+0000 7fcbd9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbdc104ac0 0x7fcbdc1977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:46.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.414+0000 7fcbd9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbdc104ac0 0x7fcbdc1977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48900/0 (socket says 172.21.15.67:48900) 2024-08-31T05:24:46.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.414+0000 7fcbd9d9b640 1 -- 172.21.15.67:0/2345705384 learned_addr learned my addr 172.21.15.67:0/2345705384 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:24:46.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.415+0000 7fcbda59c640 1 --2- 172.21.15.67:0/2345705384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbdc102190 0x7fcbdc1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:46.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.415+0000 7fcbd9d9b640 1 -- 172.21.15.67:0/2345705384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbdc102190 msgr2=0x7fcbdc1972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:46.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.415+0000 7fcbd9d9b640 1 --2- 172.21.15.67:0/2345705384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbdc102190 0x7fcbdc1972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:46.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.415+0000 7fcbd9d9b640 1 -- 172.21.15.67:0/2345705384 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbdc197e70 con 0x7fcbdc104ac0 2024-08-31T05:24:46.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.415+0000 7fcbd9d9b640 1 --2- 172.21.15.67:0/2345705384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbdc104ac0 0x7fcbdc1977f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009230 tx=0x7fcbcc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:46.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.415+0000 7fcbd37fe640 1 -- 172.21.15.67:0/2345705384 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbcc03f070 con 0x7fcbdc104ac0 2024-08-31T05:24:46.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.415+0000 7fcbd37fe640 1 -- 172.21.15.67:0/2345705384 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcbcc004a50 con 0x7fcbdc104ac0 2024-08-31T05:24:46.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.415+0000 7fcbd37fe640 1 -- 172.21.15.67:0/2345705384 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbcc035030 con 0x7fcbdc104ac0 2024-08-31T05:24:46.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.415+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/2345705384 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbdc19c850 con 0x7fcbdc104ac0 2024-08-31T05:24:46.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.415+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/2345705384 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbdc19cde0 con 0x7fcbdc104ac0 2024-08-31T05:24:46.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.416+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/2345705384 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbdc102570 con 0x7fcbdc104ac0 2024-08-31T05:24:46.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.417+0000 7fcbd37fe640 1 -- 172.21.15.67:0/2345705384 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fcbcc042070 con 0x7fcbdc104ac0 2024-08-31T05:24:46.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.418+0000 7fcbd37fe640 1 --2- 172.21.15.67:0/2345705384 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcbc8079e40 0x7fcbc807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:46.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.418+0000 7fcbd37fe640 1 -- 172.21.15.67:0/2345705384 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fcbcc0bd340 con 0x7fcbdc104ac0 2024-08-31T05:24:46.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.418+0000 7fcbda59c640 1 --2- 172.21.15.67:0/2345705384 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcbc8079e40 0x7fcbc807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:46.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.418+0000 7fcbda59c640 1 --2- 172.21.15.67:0/2345705384 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcbc8079e40 0x7fcbc807c300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400bbe0 tx=0x7fcbc400b390 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:46.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.422+0000 7fcbd37fe640 1 -- 172.21.15.67:0/2345705384 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fcbcc0890a0 con 0x7fcbdc104ac0 2024-08-31T05:24:46.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.623+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/2345705384 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcbdc105520 con 0x7fcbc8079e40 2024-08-31T05:24:46.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.624+0000 7fcbd37fe640 1 -- 172.21.15.67:0/2345705384 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7fcbdc105520 con 0x7fcbc8079e40 2024-08-31T05:24:46.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.626+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/2345705384 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcbc8079e40 msgr2=0x7fcbc807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:46.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.626+0000 7fcbe0cf3640 1 --2- 172.21.15.67:0/2345705384 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcbc8079e40 0x7fcbc807c300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400bbe0 tx=0x7fcbc400b390 comp rx=0 tx=0).stop 2024-08-31T05:24:46.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.626+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/2345705384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbdc104ac0 msgr2=0x7fcbdc1977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:46.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.626+0000 7fcbe0cf3640 1 --2- 172.21.15.67:0/2345705384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbdc104ac0 0x7fcbdc1977f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009230 tx=0x7fcbcc0045e0 comp rx=0 tx=0).stop 2024-08-31T05:24:46.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.626+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/2345705384 shutdown_connections 2024-08-31T05:24:46.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.626+0000 7fcbe0cf3640 1 --2- 172.21.15.67:0/2345705384 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcbc8079e40 0x7fcbc807c300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:46.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.626+0000 7fcbe0cf3640 1 --2- 172.21.15.67:0/2345705384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbdc104ac0 0x7fcbdc1977f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:46.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.626+0000 7fcbe0cf3640 1 --2- 172.21.15.67:0/2345705384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbdc102190 0x7fcbdc1972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:46.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.626+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/2345705384 >> 172.21.15.67:0/2345705384 conn(0x7fcbdc0fbdb0 msgr2=0x7fcbdc0fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:46.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.626+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/2345705384 shutdown_connections 2024-08-31T05:24:46.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:46.626+0000 7fcbe0cf3640 1 -- 172.21.15.67:0/2345705384 wait complete. 2024-08-31T05:24:47.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:46 smithi067 ceph-mon[17432]: pgmap v84: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:47.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:46 smithi073 ceph-mon[24726]: pgmap v84: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:47.266 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-08-31T05:24:47.566 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:24:47.965 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:47 smithi067 ceph-mon[17432]: from='client.14894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:48.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47dae8f640 1 -- 172.21.15.67:0/1938786866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d41016a0 msgr2=0x7f47d4101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:48.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47dae8f640 1 --2- 172.21.15.67:0/1938786866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d41016a0 0x7f47d4101b00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009880 tx=0x7f47c002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:24:48.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47dae8f640 1 -- 172.21.15.67:0/1938786866 shutdown_connections 2024-08-31T05:24:48.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47dae8f640 1 --2- 172.21.15.67:0/1938786866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d41016a0 0x7f47d4101b00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47dae8f640 1 --2- 172.21.15.67:0/1938786866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47d41076a0 0x7f47d4107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47dae8f640 1 -- 172.21.15.67:0/1938786866 >> 172.21.15.67:0/1938786866 conn(0x7f47d40fd3a0 msgr2=0x7f47d40ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47dae8f640 1 -- 172.21.15.67:0/1938786866 shutdown_connections 2024-08-31T05:24:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47dae8f640 1 -- 172.21.15.67:0/1938786866 wait complete. 2024-08-31T05:24:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47dae8f640 1 Processor -- start 2024-08-31T05:24:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47dae8f640 1 -- start start 2024-08-31T05:24:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47dae8f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d41016a0 0x7f47d419d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47dae8f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47d41076a0 0x7f47d419d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47dae8f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f47d410eb50 con 0x7f47d41016a0 2024-08-31T05:24:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47dae8f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f47d410e9d0 con 0x7f47d41076a0 2024-08-31T05:24:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47d8c2b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d41016a0 0x7f47d419d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47d8c2b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d41016a0 0x7f47d419d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48928/0 (socket says 172.21.15.67:48928) 2024-08-31T05:24:48.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47d8c2b640 1 -- 172.21.15.67:0/86367654 learned_addr learned my addr 172.21.15.67:0/86367654 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:24:48.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47d8c2b640 1 -- 172.21.15.67:0/86367654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47d41076a0 msgr2=0x7f47d419d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:48.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47d8c2b640 1 --2- 172.21.15.67:0/86367654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47d41076a0 0x7f47d419d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:48.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.044+0000 7f47d8c2b640 1 -- 172.21.15.67:0/86367654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d41975a0 con 0x7f47d41016a0 2024-08-31T05:24:48.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.045+0000 7f47d8c2b640 1 --2- 172.21.15.67:0/86367654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d41016a0 0x7f47d419d3e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f47c800d8d0 tx=0x7f47c800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:48.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.045+0000 7f47d1ffb640 1 -- 172.21.15.67:0/86367654 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47c8017070 con 0x7f47d41016a0 2024-08-31T05:24:48.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.045+0000 7f47dae8f640 1 -- 172.21.15.67:0/86367654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d4197890 con 0x7f47d41016a0 2024-08-31T05:24:48.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.045+0000 7f47d1ffb640 1 -- 172.21.15.67:0/86367654 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47c8010460 con 0x7f47d41016a0 2024-08-31T05:24:48.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.045+0000 7f47d1ffb640 1 -- 172.21.15.67:0/86367654 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47c800f5f0 con 0x7f47d41016a0 2024-08-31T05:24:48.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.045+0000 7f47dae8f640 1 -- 172.21.15.67:0/86367654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d4197e20 con 0x7f47d41016a0 2024-08-31T05:24:48.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.046+0000 7f47dae8f640 1 -- 172.21.15.67:0/86367654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d4102de0 con 0x7f47d41016a0 2024-08-31T05:24:48.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.047+0000 7f47d1ffb640 1 -- 172.21.15.67:0/86367654 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f47c8009a30 con 0x7f47d41016a0 2024-08-31T05:24:48.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.047+0000 7f47d1ffb640 1 --2- 172.21.15.67:0/86367654 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f47c4079e00 0x7f47c407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:48.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.047+0000 7f47d1ffb640 1 -- 172.21.15.67:0/86367654 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f47c809c7c0 con 0x7f47d41016a0 2024-08-31T05:24:48.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.047+0000 7f47d3fff640 1 --2- 172.21.15.67:0/86367654 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f47c4079e00 0x7f47c407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:48.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.048+0000 7f47d3fff640 1 --2- 172.21.15.67:0/86367654 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f47c4079e00 0x7f47c407c2c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f47c00096c0 tx=0x7f47c0000bc0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:48.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.052+0000 7f47d1ffb640 1 -- 172.21.15.67:0/86367654 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f47c8064330 con 0x7f47d41016a0 2024-08-31T05:24:48.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:47 smithi073 ceph-mon[24726]: from='client.14894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:48.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.310+0000 7f47dae8f640 1 -- 172.21.15.67:0/86367654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f47d4109c30 con 0x7f47d41016a0 2024-08-31T05:24:48.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.310+0000 7f47d1ffb640 1 -- 172.21.15.67:0/86367654 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f47c80684a0 con 0x7f47d41016a0 2024-08-31T05:24:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.314+0000 7f47dae8f640 1 -- 172.21.15.67:0/86367654 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f47c4079e00 msgr2=0x7f47c407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.314+0000 7f47dae8f640 1 --2- 172.21.15.67:0/86367654 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f47c4079e00 0x7f47c407c2c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f47c00096c0 tx=0x7f47c0000bc0 comp rx=0 tx=0).stop 2024-08-31T05:24:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.314+0000 7f47dae8f640 1 -- 172.21.15.67:0/86367654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d41016a0 msgr2=0x7f47d419d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.314+0000 7f47dae8f640 1 --2- 172.21.15.67:0/86367654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d41016a0 0x7f47d419d3e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f47c800d8d0 tx=0x7f47c800dd90 comp rx=0 tx=0).stop 2024-08-31T05:24:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.314+0000 7f47dae8f640 1 -- 172.21.15.67:0/86367654 shutdown_connections 2024-08-31T05:24:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.314+0000 7f47dae8f640 1 --2- 172.21.15.67:0/86367654 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f47c4079e00 0x7f47c407c2c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:48.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.314+0000 7f47dae8f640 1 --2- 172.21.15.67:0/86367654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47d41076a0 0x7f47d419d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:48.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.314+0000 7f47dae8f640 1 --2- 172.21.15.67:0/86367654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47d41016a0 0x7f47d419d3e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:48.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.314+0000 7f47dae8f640 1 -- 172.21.15.67:0/86367654 >> 172.21.15.67:0/86367654 conn(0x7f47d40fd3a0 msgr2=0x7f47d40fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:48.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.314+0000 7f47dae8f640 1 -- 172.21.15.67:0/86367654 shutdown_connections 2024-08-31T05:24:48.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:48.314+0000 7f47dae8f640 1 -- 172.21.15.67:0/86367654 wait complete. 2024-08-31T05:24:48.325 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:24:48.982 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:48 smithi067 ceph-mon[17432]: pgmap v85: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:49.051 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:48 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/86367654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:49.053 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-08-31T05:24:49.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:48 smithi073 ceph-mon[24726]: pgmap v85: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:49.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:48 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/86367654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:49.322 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:24:49.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.770+0000 7f46398b3640 1 -- 172.21.15.67:0/1215466225 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4634103180 msgr2=0x7f463410b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:49.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.770+0000 7f46398b3640 1 --2- 172.21.15.67:0/1215466225 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4634103180 0x7f463410b670 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4624009880 tx=0x7f462402a530 comp rx=0 tx=0).stop 2024-08-31T05:24:49.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.770+0000 7f46398b3640 1 -- 172.21.15.67:0/1215466225 shutdown_connections 2024-08-31T05:24:49.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.770+0000 7f46398b3640 1 --2- 172.21.15.67:0/1215466225 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4634103180 0x7f463410b670 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.770+0000 7f46398b3640 1 --2- 172.21.15.67:0/1215466225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4634102860 0x7f4634102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.770+0000 7f46398b3640 1 -- 172.21.15.67:0/1215466225 >> 172.21.15.67:0/1215466225 conn(0x7f46340fc2c0 msgr2=0x7f46340fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.770+0000 7f46398b3640 1 -- 172.21.15.67:0/1215466225 shutdown_connections 2024-08-31T05:24:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.770+0000 7f46398b3640 1 -- 172.21.15.67:0/1215466225 wait complete. 2024-08-31T05:24:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.770+0000 7f46398b3640 1 Processor -- start 2024-08-31T05:24:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.770+0000 7f46398b3640 1 -- start start 2024-08-31T05:24:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f46398b3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4634102860 0x7f46341004c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f46398b3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4634103180 0x7f4634100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f46398b3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f463410eb90 con 0x7f4634103180 2024-08-31T05:24:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f46398b3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f463410ea10 con 0x7f4634102860 2024-08-31T05:24:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f46327fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4634103180 0x7f4634100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:49.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f46327fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4634103180 0x7f4634100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45942/0 (socket says 172.21.15.67:45942) 2024-08-31T05:24:49.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f46327fc640 1 -- 172.21.15.67:0/2677154492 learned_addr learned my addr 172.21.15.67:0/2677154492 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:24:49.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f4632ffd640 1 --2- 172.21.15.67:0/2677154492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4634102860 0x7f46341004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:49.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f46327fc640 1 -- 172.21.15.67:0/2677154492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4634102860 msgr2=0x7f46341004c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:49.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f46327fc640 1 --2- 172.21.15.67:0/2677154492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4634102860 0x7f46341004c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:49.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f46327fc640 1 -- 172.21.15.67:0/2677154492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4634100f40 con 0x7f4634103180 2024-08-31T05:24:49.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f4632ffd640 1 --2- 172.21.15.67:0/2677154492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4634102860 0x7f46341004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:24:49.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f46327fc640 1 --2- 172.21.15.67:0/2677154492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4634103180 0x7f4634100a00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4624031460 tx=0x7f4624004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:49.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f46388b1640 1 -- 172.21.15.67:0/2677154492 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f462403f070 con 0x7f4634103180 2024-08-31T05:24:49.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.771+0000 7f46388b1640 1 -- 172.21.15.67:0/2677154492 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4624004a90 con 0x7f4634103180 2024-08-31T05:24:49.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.772+0000 7f46398b3640 1 -- 172.21.15.67:0/2677154492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46341011d0 con 0x7f4634103180 2024-08-31T05:24:49.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.772+0000 7f46388b1640 1 -- 172.21.15.67:0/2677154492 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4624035030 con 0x7f4634103180 2024-08-31T05:24:49.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.772+0000 7f46398b3640 1 -- 172.21.15.67:0/2677154492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46341a3b60 con 0x7f4634103180 2024-08-31T05:24:49.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.772+0000 7f46398b3640 1 -- 172.21.15.67:0/2677154492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f463406a830 con 0x7f4634103180 2024-08-31T05:24:49.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.773+0000 7f46388b1640 1 -- 172.21.15.67:0/2677154492 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f4624042070 con 0x7f4634103180 2024-08-31T05:24:49.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.774+0000 7f46388b1640 1 --2- 172.21.15.67:0/2677154492 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4620079e00 0x7f462007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:49.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.774+0000 7f46388b1640 1 -- 172.21.15.67:0/2677154492 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f46240bd470 con 0x7f4634103180 2024-08-31T05:24:49.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.774+0000 7f4632ffd640 1 --2- 172.21.15.67:0/2677154492 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4620079e00 0x7f462007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:49.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.774+0000 7f4632ffd640 1 --2- 172.21.15.67:0/2677154492 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4620079e00 0x7f462007c2c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f461c009b40 tx=0x7f461c005e50 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:49.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:49.778+0000 7f46388b1640 1 -- 172.21.15.67:0/2677154492 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f4624084f60 con 0x7f4634103180 2024-08-31T05:24:50.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:50.034+0000 7f46398b3640 1 -- 172.21.15.67:0/2677154492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4634105d00 con 0x7f4634103180 2024-08-31T05:24:50.036 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:49 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:24:50.036 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:49 smithi067 ceph-mon[17432]: pgmap v86: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:50.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:50.034+0000 7f46388b1640 1 -- 172.21.15.67:0/2677154492 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f46240890d0 con 0x7f4634103180 2024-08-31T05:24:50.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:50.036+0000 7f46398b3640 1 -- 172.21.15.67:0/2677154492 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4620079e00 msgr2=0x7f462007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:50.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:50.036+0000 7f46398b3640 1 --2- 172.21.15.67:0/2677154492 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4620079e00 0x7f462007c2c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f461c009b40 tx=0x7f461c005e50 comp rx=0 tx=0).stop 2024-08-31T05:24:50.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:50.036+0000 7f46398b3640 1 -- 172.21.15.67:0/2677154492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4634103180 msgr2=0x7f4634100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:50.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:50.036+0000 7f46398b3640 1 --2- 172.21.15.67:0/2677154492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4634103180 0x7f4634100a00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4624031460 tx=0x7f4624004530 comp rx=0 tx=0).stop 2024-08-31T05:24:50.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:50.036+0000 7f46398b3640 1 -- 172.21.15.67:0/2677154492 shutdown_connections 2024-08-31T05:24:50.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:50.036+0000 7f46398b3640 1 --2- 172.21.15.67:0/2677154492 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4620079e00 0x7f462007c2c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:50.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:50.036+0000 7f46398b3640 1 --2- 172.21.15.67:0/2677154492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4634103180 0x7f4634100a00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:50.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:50.036+0000 7f46398b3640 1 --2- 172.21.15.67:0/2677154492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4634102860 0x7f46341004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:50.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:50.036+0000 7f46398b3640 1 -- 172.21.15.67:0/2677154492 >> 172.21.15.67:0/2677154492 conn(0x7f46340fc2c0 msgr2=0x7f4634108cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:50.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:50.037+0000 7f46398b3640 1 -- 172.21.15.67:0/2677154492 shutdown_connections 2024-08-31T05:24:50.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:50.037+0000 7f46398b3640 1 -- 172.21.15.67:0/2677154492 wait complete. 2024-08-31T05:24:50.047 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)" 2024-08-31T05:24:50.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:49 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:24:50.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:49 smithi073 ceph-mon[24726]: pgmap v86: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:50.674 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-08-31T05:24:50.928 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:24:51.048 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:50 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/2677154492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:51.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:50 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/2677154492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.368+0000 7efce527c640 1 -- 172.21.15.67:0/3027891032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efce01028c0 msgr2=0x7efce0102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.368+0000 7efce527c640 1 --2- 172.21.15.67:0/3027891032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efce01028c0 0x7efce0102ca0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efcd00098b0 tx=0x7efcd002a560 comp rx=0 tx=0).stop 2024-08-31T05:24:51.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.368+0000 7efce527c640 1 -- 172.21.15.67:0/3027891032 shutdown_connections 2024-08-31T05:24:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.368+0000 7efce527c640 1 --2- 172.21.15.67:0/3027891032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efce01031e0 0x7efce010b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.368+0000 7efce527c640 1 --2- 172.21.15.67:0/3027891032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efce01028c0 0x7efce0102ca0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.368+0000 7efce527c640 1 -- 172.21.15.67:0/3027891032 >> 172.21.15.67:0/3027891032 conn(0x7efce00fc2c0 msgr2=0x7efce00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.368+0000 7efce527c640 1 -- 172.21.15.67:0/3027891032 shutdown_connections 2024-08-31T05:24:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.368+0000 7efce527c640 1 -- 172.21.15.67:0/3027891032 wait complete. 2024-08-31T05:24:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.369+0000 7efce527c640 1 Processor -- start 2024-08-31T05:24:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.369+0000 7efce527c640 1 -- start start 2024-08-31T05:24:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.369+0000 7efce527c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efce01028c0 0x7efce0100520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.369+0000 7efce527c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efce01031e0 0x7efce0100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.369+0000 7efce527c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efce010ebf0 con 0x7efce01028c0 2024-08-31T05:24:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.369+0000 7efce527c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efce010ea70 con 0x7efce01031e0 2024-08-31T05:24:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.369+0000 7efcdeffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efce01028c0 0x7efce0100520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.369+0000 7efcdeffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efce01028c0 0x7efce0100520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45946/0 (socket says 172.21.15.67:45946) 2024-08-31T05:24:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.369+0000 7efcdeffd640 1 -- 172.21.15.67:0/1109335104 learned_addr learned my addr 172.21.15.67:0/1109335104 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:24:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.369+0000 7efcd7fff640 1 --2- 172.21.15.67:0/1109335104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efce01031e0 0x7efce0100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.369+0000 7efcdeffd640 1 -- 172.21.15.67:0/1109335104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efce01031e0 msgr2=0x7efce0100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.369+0000 7efcdeffd640 1 --2- 172.21.15.67:0/1109335104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efce01031e0 0x7efce0100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.369+0000 7efcdeffd640 1 -- 172.21.15.67:0/1109335104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce0100fa0 con 0x7efce01028c0 2024-08-31T05:24:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.370+0000 7efcdeffd640 1 --2- 172.21.15.67:0/1109335104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efce01028c0 0x7efce0100520 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efcd0031460 tx=0x7efcd00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.370+0000 7efcdcff9640 1 -- 172.21.15.67:0/1109335104 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcd003f070 con 0x7efce01028c0 2024-08-31T05:24:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.370+0000 7efcdcff9640 1 -- 172.21.15.67:0/1109335104 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efcd00044d0 con 0x7efce01028c0 2024-08-31T05:24:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.370+0000 7efce527c640 1 -- 172.21.15.67:0/1109335104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce0101230 con 0x7efce01028c0 2024-08-31T05:24:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.370+0000 7efcdcff9640 1 -- 172.21.15.67:0/1109335104 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcd0035030 con 0x7efce01028c0 2024-08-31T05:24:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.370+0000 7efce527c640 1 -- 172.21.15.67:0/1109335104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce01a3c00 con 0x7efce01028c0 2024-08-31T05:24:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.371+0000 7efce527c640 1 -- 172.21.15.67:0/1109335104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce006a7d0 con 0x7efce01028c0 2024-08-31T05:24:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.371+0000 7efcdcff9640 1 -- 172.21.15.67:0/1109335104 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7efcd0042070 con 0x7efce01028c0 2024-08-31T05:24:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.372+0000 7efcdcff9640 1 --2- 172.21.15.67:0/1109335104 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efccc079e00 0x7efccc07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.372+0000 7efcdcff9640 1 -- 172.21.15.67:0/1109335104 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7efcd00bd380 con 0x7efce01028c0 2024-08-31T05:24:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.372+0000 7efcd7fff640 1 --2- 172.21.15.67:0/1109335104 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efccc079e00 0x7efccc07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.372+0000 7efcd7fff640 1 --2- 172.21.15.67:0/1109335104 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efccc079e00 0x7efccc07c2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efce0101fb0 tx=0x7efcc8008040 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.377+0000 7efcdcff9640 1 -- 172.21.15.67:0/1109335104 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7efcd0084ef0 con 0x7efce01028c0 2024-08-31T05:24:51.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.641+0000 7efce527c640 1 -- 172.21.15.67:0/1109335104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7efce0105d20 con 0x7efce01028c0 2024-08-31T05:24:51.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.642+0000 7efcdcff9640 1 -- 172.21.15.67:0/1109335104 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7efcd0004cf0 con 0x7efce01028c0 2024-08-31T05:24:51.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.644+0000 7efce527c640 1 -- 172.21.15.67:0/1109335104 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efccc079e00 msgr2=0x7efccc07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:51.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.644+0000 7efce527c640 1 --2- 172.21.15.67:0/1109335104 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efccc079e00 0x7efccc07c2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efce0101fb0 tx=0x7efcc8008040 comp rx=0 tx=0).stop 2024-08-31T05:24:51.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.644+0000 7efce527c640 1 -- 172.21.15.67:0/1109335104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efce01028c0 msgr2=0x7efce0100520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:51.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.644+0000 7efce527c640 1 --2- 172.21.15.67:0/1109335104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efce01028c0 0x7efce0100520 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efcd0031460 tx=0x7efcd00048f0 comp rx=0 tx=0).stop 2024-08-31T05:24:51.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.644+0000 7efce527c640 1 -- 172.21.15.67:0/1109335104 shutdown_connections 2024-08-31T05:24:51.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.644+0000 7efce527c640 1 --2- 172.21.15.67:0/1109335104 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efccc079e00 0x7efccc07c2c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:51.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.644+0000 7efce527c640 1 --2- 172.21.15.67:0/1109335104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efce01031e0 0x7efce0100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:51.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.644+0000 7efce527c640 1 --2- 172.21.15.67:0/1109335104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efce01028c0 0x7efce0100520 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:51.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.644+0000 7efce527c640 1 -- 172.21.15.67:0/1109335104 >> 172.21.15.67:0/1109335104 conn(0x7efce00fc2c0 msgr2=0x7efce0108cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:51.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.644+0000 7efce527c640 1 -- 172.21.15.67:0/1109335104 shutdown_connections 2024-08-31T05:24:51.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:51.644+0000 7efce527c640 1 -- 172.21.15.67:0/1109335104 wait complete. 2024-08-31T05:24:51.654 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:24:52.044 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:51 smithi067 ceph-mon[17432]: pgmap v87: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:52.045 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:51 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/1109335104' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:52.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:51 smithi073 ceph-mon[24726]: pgmap v87: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:52.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:51 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/1109335104' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:24:52.339 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-08-31T05:24:52.606 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:24:53.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.046+0000 7fe61f8e9640 1 -- 172.21.15.67:0/268183295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6181016a0 msgr2=0x7fe618101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:53.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.046+0000 7fe61f8e9640 1 --2- 172.21.15.67:0/268183295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6181016a0 0x7fe618101b00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe608009880 tx=0x7fe60802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:24:53.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.047+0000 7fe61f8e9640 1 -- 172.21.15.67:0/268183295 shutdown_connections 2024-08-31T05:24:53.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.047+0000 7fe61f8e9640 1 --2- 172.21.15.67:0/268183295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6181016a0 0x7fe618101b00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:53.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.047+0000 7fe61f8e9640 1 --2- 172.21.15.67:0/268183295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6181076a0 0x7fe618107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:53.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.047+0000 7fe61f8e9640 1 -- 172.21.15.67:0/268183295 >> 172.21.15.67:0/268183295 conn(0x7fe6180fd3c0 msgr2=0x7fe6180ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:53.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.047+0000 7fe61f8e9640 1 -- 172.21.15.67:0/268183295 shutdown_connections 2024-08-31T05:24:53.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.047+0000 7fe61f8e9640 1 -- 172.21.15.67:0/268183295 wait complete. 2024-08-31T05:24:53.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.047+0000 7fe61f8e9640 1 Processor -- start 2024-08-31T05:24:53.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.047+0000 7fe61f8e9640 1 -- start start 2024-08-31T05:24:53.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.047+0000 7fe61f8e9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6181016a0 0x7fe618074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:53.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.047+0000 7fe61f8e9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6181076a0 0x7fe6180747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:53.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.047+0000 7fe61f8e9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe61810ebd0 con 0x7fe6181076a0 2024-08-31T05:24:53.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.047+0000 7fe61f8e9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe61810ea50 con 0x7fe6181016a0 2024-08-31T05:24:53.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.048+0000 7fe61ce84640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6181076a0 0x7fe6180747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:53.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.048+0000 7fe61ce84640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6181076a0 0x7fe6180747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45960/0 (socket says 172.21.15.67:45960) 2024-08-31T05:24:53.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.048+0000 7fe61ce84640 1 -- 172.21.15.67:0/2727723688 learned_addr learned my addr 172.21.15.67:0/2727723688 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:24:53.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.048+0000 7fe61d685640 1 --2- 172.21.15.67:0/2727723688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6181016a0 0x7fe618074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:53.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.048+0000 7fe61ce84640 1 -- 172.21.15.67:0/2727723688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6181016a0 msgr2=0x7fe618074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:53.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.048+0000 7fe61ce84640 1 --2- 172.21.15.67:0/2727723688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6181016a0 0x7fe618074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:53.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.048+0000 7fe61ce84640 1 -- 172.21.15.67:0/2727723688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe618074d10 con 0x7fe6181076a0 2024-08-31T05:24:53.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.048+0000 7fe61ce84640 1 --2- 172.21.15.67:0/2727723688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6181076a0 0x7fe6180747d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe608031460 tx=0x7fe6080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:53.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.048+0000 7fe60e7fc640 1 -- 172.21.15.67:0/2727723688 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe60803f070 con 0x7fe6181076a0 2024-08-31T05:24:53.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.048+0000 7fe60e7fc640 1 -- 172.21.15.67:0/2727723688 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe608004cf0 con 0x7fe6181076a0 2024-08-31T05:24:53.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.048+0000 7fe61f8e9640 1 -- 172.21.15.67:0/2727723688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe618074fa0 con 0x7fe6181076a0 2024-08-31T05:24:53.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.048+0000 7fe60e7fc640 1 -- 172.21.15.67:0/2727723688 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe608035030 con 0x7fe6181076a0 2024-08-31T05:24:53.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.048+0000 7fe61f8e9640 1 -- 172.21.15.67:0/2727723688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6181a3b80 con 0x7fe6181076a0 2024-08-31T05:24:53.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.049+0000 7fe61f8e9640 1 -- 172.21.15.67:0/2727723688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe618102de0 con 0x7fe6181076a0 2024-08-31T05:24:53.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.050+0000 7fe60e7fc640 1 -- 172.21.15.67:0/2727723688 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fe608042070 con 0x7fe6181076a0 2024-08-31T05:24:53.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.050+0000 7fe60e7fc640 1 --2- 172.21.15.67:0/2727723688 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe604079e40 0x7fe60407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:53.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.051+0000 7fe60e7fc640 1 -- 172.21.15.67:0/2727723688 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fe6080bd250 con 0x7fe6181076a0 2024-08-31T05:24:53.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.051+0000 7fe61d685640 1 --2- 172.21.15.67:0/2727723688 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe604079e40 0x7fe60407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:53.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.051+0000 7fe61d685640 1 --2- 172.21.15.67:0/2727723688 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe604079e40 0x7fe60407c300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe614009990 tx=0x7fe614009110 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:53.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.055+0000 7fe60e7fc640 1 -- 172.21.15.67:0/2727723688 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fe608084e40 con 0x7fe6181076a0 2024-08-31T05:24:53.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:53.258+0000 7fe61f8e9640 1 -- 172.21.15.67:0/2727723688 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6", "target": ["mon-mgr", ""]}) -- 0x7fe6180623d0 con 0x7fe604079e40 2024-08-31T05:24:54.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:54 smithi073 ceph-mon[24726]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:54.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:54 smithi073 ceph-mon[24726]: pgmap v88: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:55.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:54 smithi067 ceph-mon[17432]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:54 smithi067 ceph-mon[17432]: pgmap v88: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:55.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:55.239+0000 7fe60e7fc640 1 -- 172.21.15.67:0/2727723688 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5741 (secure 0 0 0) 0x7fe6180623d0 con 0x7fe604079e40 2024-08-31T05:24:55.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:55.241+0000 7fe61f8e9640 1 -- 172.21.15.67:0/2727723688 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe604079e40 msgr2=0x7fe60407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:55.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:55.241+0000 7fe61f8e9640 1 --2- 172.21.15.67:0/2727723688 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe604079e40 0x7fe60407c300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe614009990 tx=0x7fe614009110 comp rx=0 tx=0).stop 2024-08-31T05:24:55.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:55.241+0000 7fe61f8e9640 1 -- 172.21.15.67:0/2727723688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6181076a0 msgr2=0x7fe6180747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:55.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:55.241+0000 7fe61f8e9640 1 --2- 172.21.15.67:0/2727723688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6181076a0 0x7fe6180747d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe608031460 tx=0x7fe6080048f0 comp rx=0 tx=0).stop 2024-08-31T05:24:55.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:55.241+0000 7fe61f8e9640 1 -- 172.21.15.67:0/2727723688 shutdown_connections 2024-08-31T05:24:55.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:55.241+0000 7fe61f8e9640 1 --2- 172.21.15.67:0/2727723688 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe604079e40 0x7fe60407c300 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:55.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:55.241+0000 7fe61f8e9640 1 --2- 172.21.15.67:0/2727723688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6181076a0 0x7fe6180747d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:55.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:55.241+0000 7fe61f8e9640 1 --2- 172.21.15.67:0/2727723688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6181016a0 0x7fe618074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:55.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:55.241+0000 7fe61f8e9640 1 -- 172.21.15.67:0/2727723688 >> 172.21.15.67:0/2727723688 conn(0x7fe6180fd3c0 msgr2=0x7fe6180fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:55.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:55.241+0000 7fe61f8e9640 1 -- 172.21.15.67:0/2727723688 shutdown_connections 2024-08-31T05:24:55.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:55.241+0000 7fe61f8e9640 1 -- 172.21.15.67:0/2727723688 wait complete. 2024-08-31T05:24:55.253 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:24:55.878 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph orch ps' 2024-08-31T05:24:56.136 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:24:56.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.646+0000 7f03ea8d0640 1 -- 172.21.15.67:0/3747990473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e4103180 msgr2=0x7f03e410b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:56.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.646+0000 7f03ea8d0640 1 --2- 172.21.15.67:0/3747990473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e4103180 0x7f03e410b670 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009880 tx=0x7f03d802a530 comp rx=0 tx=0).stop 2024-08-31T05:24:56.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.646+0000 7f03ea8d0640 1 -- 172.21.15.67:0/3747990473 shutdown_connections 2024-08-31T05:24:56.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.646+0000 7f03ea8d0640 1 --2- 172.21.15.67:0/3747990473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e4103180 0x7f03e410b670 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:56.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.646+0000 7f03ea8d0640 1 --2- 172.21.15.67:0/3747990473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03e4102860 0x7f03e4102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.646+0000 7f03ea8d0640 1 -- 172.21.15.67:0/3747990473 >> 172.21.15.67:0/3747990473 conn(0x7f03e40fc2c0 msgr2=0x7f03e40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.646+0000 7f03ea8d0640 1 -- 172.21.15.67:0/3747990473 shutdown_connections 2024-08-31T05:24:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.646+0000 7f03ea8d0640 1 -- 172.21.15.67:0/3747990473 wait complete. 2024-08-31T05:24:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.647+0000 7f03ea8d0640 1 Processor -- start 2024-08-31T05:24:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.647+0000 7f03ea8d0640 1 -- start start 2024-08-31T05:24:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.647+0000 7f03ea8d0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e4102860 0x7f03e419d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.647+0000 7f03ea8d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03e4103180 0x7f03e419d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:56.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.647+0000 7f03ea8d0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f03e410ebf0 con 0x7f03e4102860 2024-08-31T05:24:56.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.647+0000 7f03ea8d0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f03e410ea70 con 0x7f03e4103180 2024-08-31T05:24:56.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.647+0000 7f03e3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e4102860 0x7f03e419d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:56.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.647+0000 7f03e3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e4102860 0x7f03e419d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45978/0 (socket says 172.21.15.67:45978) 2024-08-31T05:24:56.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.647+0000 7f03e3fff640 1 -- 172.21.15.67:0/4059253932 learned_addr learned my addr 172.21.15.67:0/4059253932 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:24:56.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.648+0000 7f03e3fff640 1 -- 172.21.15.67:0/4059253932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03e4103180 msgr2=0x7f03e419d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:56.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.648+0000 7f03e3fff640 1 --2- 172.21.15.67:0/4059253932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03e4103180 0x7f03e419d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:56.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.648+0000 7f03e3fff640 1 -- 172.21.15.67:0/4059253932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e4197600 con 0x7f03e4102860 2024-08-31T05:24:56.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.648+0000 7f03e3fff640 1 --2- 172.21.15.67:0/4059253932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e4102860 0x7f03e419d440 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f03d400b420 tx=0x7f03d400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:56.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.648+0000 7f03e17fa640 1 -- 172.21.15.67:0/4059253932 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03d4011630 con 0x7f03e4102860 2024-08-31T05:24:56.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.648+0000 7f03e17fa640 1 -- 172.21.15.67:0/4059253932 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03d4016070 con 0x7f03e4102860 2024-08-31T05:24:56.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.648+0000 7f03ea8d0640 1 -- 172.21.15.67:0/4059253932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e41978f0 con 0x7f03e4102860 2024-08-31T05:24:56.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.648+0000 7f03e17fa640 1 -- 172.21.15.67:0/4059253932 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03d4010d40 con 0x7f03e4102860 2024-08-31T05:24:56.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.648+0000 7f03ea8d0640 1 -- 172.21.15.67:0/4059253932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e4197e80 con 0x7f03e4102860 2024-08-31T05:24:56.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.649+0000 7f03ea8d0640 1 -- 172.21.15.67:0/4059253932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03e406a830 con 0x7f03e4102860 2024-08-31T05:24:56.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.650+0000 7f03e17fa640 1 -- 172.21.15.67:0/4059253932 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f03d401b460 con 0x7f03e4102860 2024-08-31T05:24:56.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.650+0000 7f03e17fa640 1 --2- 172.21.15.67:0/4059253932 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f03cc079e00 0x7f03cc07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:56.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.650+0000 7f03e17fa640 1 -- 172.21.15.67:0/4059253932 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f03d409c060 con 0x7f03e4102860 2024-08-31T05:24:56.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.650+0000 7f03e37fe640 1 --2- 172.21.15.67:0/4059253932 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f03cc079e00 0x7f03cc07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:56.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.651+0000 7f03e37fe640 1 --2- 172.21.15.67:0/4059253932 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f03cc079e00 0x7f03cc07c2c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f03d80096c0 tx=0x7f03d8000bc0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:56.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.655+0000 7f03e17fa640 1 -- 172.21.15.67:0/4059253932 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f03d4021250 con 0x7f03e4102860 2024-08-31T05:24:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:56 smithi067 ceph-mon[17432]: pgmap v89: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:56.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.848+0000 7f03ea8d0640 1 -- 172.21.15.67:0/4059253932 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f03e4198190 con 0x7f03cc079e00 2024-08-31T05:24:56.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.858+0000 7f03e17fa640 1 -- 172.21.15.67:0/4059253932 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f03e4198190 con 0x7f03cc079e00 2024-08-31T05:24:56.860 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:24:56.860 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (61s) 32s ago 11m 19.2M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:24:56.860 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (4m) 32s ago 11m 8770k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:24:56.860 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (3m) 102s ago 11m 8128k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:24:56.860 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (11m) 32s ago 11m 6895k - 19.1.1-242-g244a32d3 395b9209a980 a47c71179c57 2024-08-31T05:24:56.860 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (11m) 102s ago 11m 6895k - 19.1.1-242-g244a32d3 395b9209a980 5f2ce08c4451 2024-08-31T05:24:56.860 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (39s) 32s ago 11m 44.5M - c8b91775d855 3a9a0f88928d 2024-08-31T05:24:56.860 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (6m) 32s ago 6m 91.9M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:24:56.860 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (6m) 32s ago 6m 156M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:24:56.860 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (6m) 102s ago 6m 14.8M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:24:56.860 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (6m) 102s ago 6m 16.5M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:24:56.861 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (3m) 32s ago 13m 588M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:24:56.861 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (2m) 102s ago 10m 522M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:24:56.861 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (13m) 32s ago 13m 55.8M 2048M 19.1.1-242-g244a32d3 395b9209a980 7082a38c8108 2024-08-31T05:24:56.861 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (10m) 102s ago 10m 48.0M 2048M 19.1.1-242-g244a32d3 395b9209a980 30ccf0ed274b 2024-08-31T05:24:56.861 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (112s) 32s ago 11m 9.94M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:24:56.861 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (106s) 102s ago 10m 3384k - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:24:56.861 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (9m) 32s ago 9m 203M 1216M 19.1.1-242-g244a32d3 395b9209a980 b9f3f60b65f9 2024-08-31T05:24:56.861 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (9m) 32s ago 9m 224M 1216M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:24:56.861 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (8m) 32s ago 8m 187M 1216M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:24:56.861 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (8m) 102s ago 8m 249M 2240M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:24:56.861 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (8m) 102s ago 7m 211M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:24:56.862 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (7m) 102s ago 7m 186M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:24:56.862 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (83s) 32s ago 11m 42.5M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:24:56.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.860+0000 7f03ea8d0640 1 -- 172.21.15.67:0/4059253932 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f03cc079e00 msgr2=0x7f03cc07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:56.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.860+0000 7f03ea8d0640 1 --2- 172.21.15.67:0/4059253932 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f03cc079e00 0x7f03cc07c2c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f03d80096c0 tx=0x7f03d8000bc0 comp rx=0 tx=0).stop 2024-08-31T05:24:56.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.860+0000 7f03ea8d0640 1 -- 172.21.15.67:0/4059253932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e4102860 msgr2=0x7f03e419d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:56.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.860+0000 7f03ea8d0640 1 --2- 172.21.15.67:0/4059253932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e4102860 0x7f03e419d440 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f03d400b420 tx=0x7f03d400b8e0 comp rx=0 tx=0).stop 2024-08-31T05:24:56.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.860+0000 7f03ea8d0640 1 -- 172.21.15.67:0/4059253932 shutdown_connections 2024-08-31T05:24:56.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.860+0000 7f03ea8d0640 1 --2- 172.21.15.67:0/4059253932 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f03cc079e00 0x7f03cc07c2c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:56.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.860+0000 7f03ea8d0640 1 --2- 172.21.15.67:0/4059253932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03e4103180 0x7f03e419d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:56.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.860+0000 7f03ea8d0640 1 --2- 172.21.15.67:0/4059253932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03e4102860 0x7f03e419d440 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:56.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.860+0000 7f03ea8d0640 1 -- 172.21.15.67:0/4059253932 >> 172.21.15.67:0/4059253932 conn(0x7f03e40fc2c0 msgr2=0x7f03e4108c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:56.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.860+0000 7f03ea8d0640 1 -- 172.21.15.67:0/4059253932 shutdown_connections 2024-08-31T05:24:56.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:56.860+0000 7f03ea8d0640 1 -- 172.21.15.67:0/4059253932 wait complete. 2024-08-31T05:24:56.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:56 smithi073 ceph-mon[24726]: pgmap v89: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:24:57.486 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-08-31T05:24:57.487 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2024-08-31T05:24:57.487 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-08-31T05:24:57.760 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:24:58.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.269+0000 7f9a9ceda640 1 -- 172.21.15.67:0/1987667805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a981031d0 msgr2=0x7f9a9810b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:58.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.269+0000 7f9a9ceda640 1 --2- 172.21.15.67:0/1987667805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a981031d0 0x7f9a9810b6c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0098b0 tx=0x7f9a8c02a560 comp rx=0 tx=0).stop 2024-08-31T05:24:58.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.269+0000 7f9a9ceda640 1 -- 172.21.15.67:0/1987667805 shutdown_connections 2024-08-31T05:24:58.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.269+0000 7f9a9ceda640 1 --2- 172.21.15.67:0/1987667805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a981031d0 0x7f9a9810b6c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:58.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.269+0000 7f9a9ceda640 1 --2- 172.21.15.67:0/1987667805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a981028b0 0x7f9a98102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:58.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.269+0000 7f9a9ceda640 1 -- 172.21.15.67:0/1987667805 >> 172.21.15.67:0/1987667805 conn(0x7f9a980fc270 msgr2=0x7f9a980fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:58.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.269+0000 7f9a9ceda640 1 -- 172.21.15.67:0/1987667805 shutdown_connections 2024-08-31T05:24:58.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.269+0000 7f9a9ceda640 1 -- 172.21.15.67:0/1987667805 wait complete. 2024-08-31T05:24:58.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.270+0000 7f9a9ceda640 1 Processor -- start 2024-08-31T05:24:58.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.270+0000 7f9a9ceda640 1 -- start start 2024-08-31T05:24:58.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.270+0000 7f9a9ceda640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a981028b0 0x7f9a9819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:58.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.270+0000 7f9a9ceda640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a981031d0 0x7f9a9819db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:58.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.270+0000 7f9a9ceda640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9810eb60 con 0x7f9a981031d0 2024-08-31T05:24:58.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.270+0000 7f9a9ceda640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9810e9e0 con 0x7f9a981028b0 2024-08-31T05:24:58.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.271+0000 7f9a95d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a981031d0 0x7f9a9819db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.271+0000 7f9a95d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a981031d0 0x7f9a9819db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55010/0 (socket says 172.21.15.67:55010) 2024-08-31T05:24:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.271+0000 7f9a95d9b640 1 -- 172.21.15.67:0/4036495404 learned_addr learned my addr 172.21.15.67:0/4036495404 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:24:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.271+0000 7f9a9659c640 1 --2- 172.21.15.67:0/4036495404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a981028b0 0x7f9a9819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.271+0000 7f9a95d9b640 1 -- 172.21.15.67:0/4036495404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a981028b0 msgr2=0x7f9a9819d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.271+0000 7f9a95d9b640 1 --2- 172.21.15.67:0/4036495404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a981028b0 0x7f9a9819d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.271+0000 7f9a95d9b640 1 -- 172.21.15.67:0/4036495404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a981976d0 con 0x7f9a981031d0 2024-08-31T05:24:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.271+0000 7f9a95d9b640 1 --2- 172.21.15.67:0/4036495404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a981031d0 0x7f9a9819db40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c031460 tx=0x7f9a8c0045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.271+0000 7f9a877fe640 1 -- 172.21.15.67:0/4036495404 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a8c03f070 con 0x7f9a981031d0 2024-08-31T05:24:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.271+0000 7f9a9ceda640 1 -- 172.21.15.67:0/4036495404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a98197960 con 0x7f9a981031d0 2024-08-31T05:24:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.271+0000 7f9a877fe640 1 -- 172.21.15.67:0/4036495404 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a8c0035f0 con 0x7f9a981031d0 2024-08-31T05:24:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.271+0000 7f9a877fe640 1 -- 172.21.15.67:0/4036495404 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a8c035030 con 0x7f9a981031d0 2024-08-31T05:24:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.271+0000 7f9a9ceda640 1 -- 172.21.15.67:0/4036495404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a98197e60 con 0x7f9a981031d0 2024-08-31T05:24:58.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.272+0000 7f9a9ceda640 1 -- 172.21.15.67:0/4036495404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a9806aae0 con 0x7f9a981031d0 2024-08-31T05:24:58.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.273+0000 7f9a877fe640 1 -- 172.21.15.67:0/4036495404 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f9a8c042070 con 0x7f9a981031d0 2024-08-31T05:24:58.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.274+0000 7f9a877fe640 1 --2- 172.21.15.67:0/4036495404 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9a80079e00 0x7f9a8007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:58.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.274+0000 7f9a877fe640 1 -- 172.21.15.67:0/4036495404 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f9a8c0bd200 con 0x7f9a981031d0 2024-08-31T05:24:58.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.274+0000 7f9a9659c640 1 --2- 172.21.15.67:0/4036495404 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9a80079e00 0x7f9a8007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:58.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.274+0000 7f9a9659c640 1 --2- 172.21.15.67:0/4036495404 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9a80079e00 0x7f9a8007c2c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800bbe0 tx=0x7f9a8800b390 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:58.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.278+0000 7f9a877fe640 1 -- 172.21.15.67:0/4036495404 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f9a8c088ea0 con 0x7f9a981031d0 2024-08-31T05:24:58.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.463+0000 7f9a9ceda640 1 -- 172.21.15.67:0/4036495404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) -- 0x7f9a98198c00 con 0x7f9a981031d0 2024-08-31T05:24:58.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.466+0000 7f9a877fe640 1 -- 172.21.15.67:0/4036495404 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v66)=0 v66) ==== 125+0+0 (secure 0 0 0) 0x7f9a8c08d8c0 con 0x7f9a981031d0 2024-08-31T05:24:58.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.469+0000 7f9a9ceda640 1 -- 172.21.15.67:0/4036495404 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9a80079e00 msgr2=0x7f9a8007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:58.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.469+0000 7f9a9ceda640 1 --2- 172.21.15.67:0/4036495404 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9a80079e00 0x7f9a8007c2c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800bbe0 tx=0x7f9a8800b390 comp rx=0 tx=0).stop 2024-08-31T05:24:58.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.469+0000 7f9a9ceda640 1 -- 172.21.15.67:0/4036495404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a981031d0 msgr2=0x7f9a9819db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:58.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.469+0000 7f9a9ceda640 1 --2- 172.21.15.67:0/4036495404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a981031d0 0x7f9a9819db40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c031460 tx=0x7f9a8c0045c0 comp rx=0 tx=0).stop 2024-08-31T05:24:58.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.469+0000 7f9a9ceda640 1 -- 172.21.15.67:0/4036495404 shutdown_connections 2024-08-31T05:24:58.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.469+0000 7f9a9ceda640 1 --2- 172.21.15.67:0/4036495404 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9a80079e00 0x7f9a8007c2c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:58.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.469+0000 7f9a9ceda640 1 --2- 172.21.15.67:0/4036495404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a981031d0 0x7f9a9819db40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:58.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.469+0000 7f9a9ceda640 1 --2- 172.21.15.67:0/4036495404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a981028b0 0x7f9a9819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:58.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.469+0000 7f9a9ceda640 1 -- 172.21.15.67:0/4036495404 >> 172.21.15.67:0/4036495404 conn(0x7f9a980fc270 msgr2=0x7f9a98103af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:58.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.470+0000 7f9a9ceda640 1 -- 172.21.15.67:0/4036495404 shutdown_connections 2024-08-31T05:24:58.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:58.470+0000 7f9a9ceda640 1 -- 172.21.15.67:0/4036495404 wait complete. 2024-08-31T05:24:58.797 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:58 smithi067 ceph-mon[17432]: from='client.14914 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:58.798 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:58 smithi067 ceph-mon[17432]: pgmap v90: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:58.798 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:58 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/4036495404' entity='client.admin' 2024-08-31T05:24:58.798 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:58 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:58.798 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:58 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:24:58.798 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:58 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:24:58.798 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:58 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:58.798 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:58 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:24:59.132 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-08-31T05:24:59.133 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2024-08-31T05:24:59.133 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-08-31T05:24:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:58 smithi073 ceph-mon[24726]: from='client.14914 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:58 smithi073 ceph-mon[24726]: pgmap v90: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:24:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:58 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/4036495404' entity='client.admin' 2024-08-31T05:24:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:58 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:58 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:24:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:58 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:24:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:58 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:24:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:58 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:24:59.389 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:24:59.784 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:24:59 smithi067 ceph-mon[17432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:24:59.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.868+0000 7fd8d7aff640 1 -- 172.21.15.67:0/945567443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8d01031d0 msgr2=0x7fd8d010b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:59.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.868+0000 7fd8d7aff640 1 --2- 172.21.15.67:0/945567443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8d01031d0 0x7fd8d010b6c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40098b0 tx=0x7fd8c402a560 comp rx=0 tx=0).stop 2024-08-31T05:24:59.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.869+0000 7fd8d7aff640 1 -- 172.21.15.67:0/945567443 shutdown_connections 2024-08-31T05:24:59.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.869+0000 7fd8d7aff640 1 --2- 172.21.15.67:0/945567443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8d01031d0 0x7fd8d010b6c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:59.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.869+0000 7fd8d7aff640 1 --2- 172.21.15.67:0/945567443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8d01028b0 0x7fd8d0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:59.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.869+0000 7fd8d7aff640 1 -- 172.21.15.67:0/945567443 >> 172.21.15.67:0/945567443 conn(0x7fd8d00fc2f0 msgr2=0x7fd8d00fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:59.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.869+0000 7fd8d7aff640 1 -- 172.21.15.67:0/945567443 shutdown_connections 2024-08-31T05:24:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.869+0000 7fd8d7aff640 1 -- 172.21.15.67:0/945567443 wait complete. 2024-08-31T05:24:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.869+0000 7fd8d7aff640 1 Processor -- start 2024-08-31T05:24:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.869+0000 7fd8d7aff640 1 -- start start 2024-08-31T05:24:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.869+0000 7fd8d7aff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8d01028b0 0x7fd8d0100510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.869+0000 7fd8d7aff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8d01031d0 0x7fd8d0100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.869+0000 7fd8d7aff640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d010eb60 con 0x7fd8d01028b0 2024-08-31T05:24:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.869+0000 7fd8d7aff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d010e9e0 con 0x7fd8d01031d0 2024-08-31T05:24:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.870+0000 7fd8d589b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8d01028b0 0x7fd8d0100510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.870+0000 7fd8d589b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8d01028b0 0x7fd8d0100510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55030/0 (socket says 172.21.15.67:55030) 2024-08-31T05:24:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.870+0000 7fd8d589b640 1 -- 172.21.15.67:0/1866368374 learned_addr learned my addr 172.21.15.67:0/1866368374 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:24:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.870+0000 7fd8d509a640 1 --2- 172.21.15.67:0/1866368374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8d01031d0 0x7fd8d0100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:59.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.870+0000 7fd8d589b640 1 -- 172.21.15.67:0/1866368374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8d01031d0 msgr2=0x7fd8d0100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:59.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.870+0000 7fd8d589b640 1 --2- 172.21.15.67:0/1866368374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8d01031d0 0x7fd8d0100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:59.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.870+0000 7fd8d589b640 1 -- 172.21.15.67:0/1866368374 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d0100f90 con 0x7fd8d01028b0 2024-08-31T05:24:59.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.870+0000 7fd8d589b640 1 --2- 172.21.15.67:0/1866368374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8d01028b0 0x7fd8d0100510 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000cc60 tx=0x7fd8c000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:59.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.870+0000 7fd8ceffd640 1 -- 172.21.15.67:0/1866368374 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd8c000ad30 con 0x7fd8d01028b0 2024-08-31T05:24:59.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.870+0000 7fd8ceffd640 1 -- 172.21.15.67:0/1866368374 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd8c0005020 con 0x7fd8d01028b0 2024-08-31T05:24:59.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.870+0000 7fd8d7aff640 1 -- 172.21.15.67:0/1866368374 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d0101280 con 0x7fd8d01028b0 2024-08-31T05:24:59.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.870+0000 7fd8ceffd640 1 -- 172.21.15.67:0/1866368374 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd8c000f660 con 0x7fd8d01028b0 2024-08-31T05:24:59.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.870+0000 7fd8d7aff640 1 -- 172.21.15.67:0/1866368374 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d01a3c30 con 0x7fd8d01028b0 2024-08-31T05:24:59.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.871+0000 7fd8d7aff640 1 -- 172.21.15.67:0/1866368374 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d006a2c0 con 0x7fd8d01028b0 2024-08-31T05:24:59.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.872+0000 7fd8ceffd640 1 -- 172.21.15.67:0/1866368374 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fd8c00051d0 con 0x7fd8d01028b0 2024-08-31T05:24:59.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.872+0000 7fd8ceffd640 1 --2- 172.21.15.67:0/1866368374 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd8b8079e40 0x7fd8b807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:59.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.873+0000 7fd8ceffd640 1 -- 172.21.15.67:0/1866368374 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fd8c009cda0 con 0x7fd8d01028b0 2024-08-31T05:24:59.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.873+0000 7fd8d509a640 1 --2- 172.21.15.67:0/1866368374 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd8b8079e40 0x7fd8b807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:59.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.873+0000 7fd8d509a640 1 --2- 172.21.15.67:0/1866368374 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd8b8079e40 0x7fd8b807c300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4000c00 tx=0x7fd8c4031420 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:59.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:24:59.877+0000 7fd8ceffd640 1 -- 172.21.15.67:0/1866368374 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fd8c0014030 con 0x7fd8d01028b0 2024-08-31T05:25:00.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:00.062+0000 7fd8d7aff640 1 -- 172.21.15.67:0/1866368374 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7fd8d0105db0 con 0x7fd8d01028b0 2024-08-31T05:25:00.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:00.062+0000 7fd8ceffd640 1 -- 172.21.15.67:0/1866368374 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v66)=0 v66) ==== 155+0+0 (secure 0 0 0) 0x7fd8c0064990 con 0x7fd8d01028b0 2024-08-31T05:25:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:00.065+0000 7fd8d7aff640 1 -- 172.21.15.67:0/1866368374 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd8b8079e40 msgr2=0x7fd8b807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:00.065+0000 7fd8d7aff640 1 --2- 172.21.15.67:0/1866368374 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd8b8079e40 0x7fd8b807c300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4000c00 tx=0x7fd8c4031420 comp rx=0 tx=0).stop 2024-08-31T05:25:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:00.065+0000 7fd8d7aff640 1 -- 172.21.15.67:0/1866368374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8d01028b0 msgr2=0x7fd8d0100510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:00.065+0000 7fd8d7aff640 1 --2- 172.21.15.67:0/1866368374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8d01028b0 0x7fd8d0100510 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000cc60 tx=0x7fd8c000a620 comp rx=0 tx=0).stop 2024-08-31T05:25:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:00.065+0000 7fd8d7aff640 1 -- 172.21.15.67:0/1866368374 shutdown_connections 2024-08-31T05:25:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:00.065+0000 7fd8d7aff640 1 --2- 172.21.15.67:0/1866368374 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd8b8079e40 0x7fd8b807c300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:00.065+0000 7fd8d7aff640 1 --2- 172.21.15.67:0/1866368374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8d01031d0 0x7fd8d0100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:00.065+0000 7fd8d7aff640 1 --2- 172.21.15.67:0/1866368374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8d01028b0 0x7fd8d0100510 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:00.065+0000 7fd8d7aff640 1 -- 172.21.15.67:0/1866368374 >> 172.21.15.67:0/1866368374 conn(0x7fd8d00fc2f0 msgr2=0x7fd8d0103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:00.065+0000 7fd8d7aff640 1 -- 172.21.15.67:0/1866368374 shutdown_connections 2024-08-31T05:25:00.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:00.065+0000 7fd8d7aff640 1 -- 172.21.15.67:0/1866368374 wait complete. 2024-08-31T05:25:00.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:24:59 smithi073 ceph-mon[24726]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:25:00.674 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-08-31T05:25:00.929 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:25:00.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:00 smithi073 ceph-mon[24726]: pgmap v91: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:01.050 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:00 smithi067 ceph-mon[17432]: pgmap v91: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.443+0000 7f9134fd3640 1 -- 172.21.15.67:0/671457219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9130106660 msgr2=0x7f9130106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.443+0000 7f9134fd3640 1 --2- 172.21.15.67:0/671457219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9130106660 0x7f9130106a40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9120009880 tx=0x7f912002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:25:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.443+0000 7f9134fd3640 1 -- 172.21.15.67:0/671457219 shutdown_connections 2024-08-31T05:25:01.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.443+0000 7f9134fd3640 1 --2- 172.21.15.67:0/671457219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91301005b0 0x7f9130100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:01.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.443+0000 7f9134fd3640 1 --2- 172.21.15.67:0/671457219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9130106660 0x7f9130106a40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:01.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.443+0000 7f9134fd3640 1 -- 172.21.15.67:0/671457219 >> 172.21.15.67:0/671457219 conn(0x7f91300fc2f0 msgr2=0x7f91300fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:01.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.443+0000 7f9134fd3640 1 -- 172.21.15.67:0/671457219 shutdown_connections 2024-08-31T05:25:01.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.443+0000 7f9134fd3640 1 -- 172.21.15.67:0/671457219 wait complete. 2024-08-31T05:25:01.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.444+0000 7f9134fd3640 1 Processor -- start 2024-08-31T05:25:01.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.444+0000 7f9134fd3640 1 -- start start 2024-08-31T05:25:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.444+0000 7f9134fd3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91301005b0 0x7f9130197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.444+0000 7f9134fd3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9130106660 0x7f9130197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.444+0000 7f9134fd3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f913010dad0 con 0x7f91301005b0 2024-08-31T05:25:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.444+0000 7f9134fd3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f913010d950 con 0x7f9130106660 2024-08-31T05:25:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.444+0000 7f912e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91301005b0 0x7f9130197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.444+0000 7f912e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91301005b0 0x7f9130197720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55060/0 (socket says 172.21.15.67:55060) 2024-08-31T05:25:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.444+0000 7f912e59c640 1 -- 172.21.15.67:0/1555210841 learned_addr learned my addr 172.21.15.67:0/1555210841 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.445+0000 7f912dd9b640 1 --2- 172.21.15.67:0/1555210841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9130106660 0x7f9130197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.445+0000 7f912e59c640 1 -- 172.21.15.67:0/1555210841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9130106660 msgr2=0x7f9130197c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.445+0000 7f912e59c640 1 --2- 172.21.15.67:0/1555210841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9130106660 0x7f9130197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.445+0000 7f912e59c640 1 -- 172.21.15.67:0/1555210841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913019bff0 con 0x7f91301005b0 2024-08-31T05:25:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.445+0000 7f912e59c640 1 --2- 172.21.15.67:0/1555210841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91301005b0 0x7f9130197720 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9120004f90 tx=0x7f91200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.445+0000 7f91277fe640 1 -- 172.21.15.67:0/1555210841 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f912003f070 con 0x7f91301005b0 2024-08-31T05:25:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.445+0000 7f9134fd3640 1 -- 172.21.15.67:0/1555210841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913019c280 con 0x7f91301005b0 2024-08-31T05:25:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.445+0000 7f91277fe640 1 -- 172.21.15.67:0/1555210841 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9120004cf0 con 0x7f91301005b0 2024-08-31T05:25:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.445+0000 7f91277fe640 1 -- 172.21.15.67:0/1555210841 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9120035030 con 0x7f91301005b0 2024-08-31T05:25:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.445+0000 7f9134fd3640 1 -- 172.21.15.67:0/1555210841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f913019c830 con 0x7f91301005b0 2024-08-31T05:25:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.446+0000 7f9134fd3640 1 -- 172.21.15.67:0/1555210841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9130101cd0 con 0x7f91301005b0 2024-08-31T05:25:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.447+0000 7f91277fe640 1 -- 172.21.15.67:0/1555210841 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f9120042070 con 0x7f91301005b0 2024-08-31T05:25:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.447+0000 7f91277fe640 1 --2- 172.21.15.67:0/1555210841 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f911c079e40 0x7f911c07c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.447+0000 7f91277fe640 1 -- 172.21.15.67:0/1555210841 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f91200bd3a0 con 0x7f91301005b0 2024-08-31T05:25:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.447+0000 7f912dd9b640 1 --2- 172.21.15.67:0/1555210841 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f911c079e40 0x7f911c07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.448+0000 7f912dd9b640 1 --2- 172.21.15.67:0/1555210841 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f911c079e40 0x7f911c07c300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f91300ff890 tx=0x7f9118008040 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:01.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.452+0000 7f91277fe640 1 -- 172.21.15.67:0/1555210841 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f9120084f90 con 0x7f91301005b0 2024-08-31T05:25:01.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.635+0000 7f9134fd3640 1 -- 172.21.15.67:0/1555210841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7f913019cae0 con 0x7f91301005b0 2024-08-31T05:25:01.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.636+0000 7f91277fe640 1 -- 172.21.15.67:0/1555210841 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v66)=0 v66) ==== 163+0+0 (secure 0 0 0) 0x7f9120089100 con 0x7f91301005b0 2024-08-31T05:25:01.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.638+0000 7f9134fd3640 1 -- 172.21.15.67:0/1555210841 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f911c079e40 msgr2=0x7f911c07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:01.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.638+0000 7f9134fd3640 1 --2- 172.21.15.67:0/1555210841 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f911c079e40 0x7f911c07c300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f91300ff890 tx=0x7f9118008040 comp rx=0 tx=0).stop 2024-08-31T05:25:01.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.638+0000 7f9134fd3640 1 -- 172.21.15.67:0/1555210841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91301005b0 msgr2=0x7f9130197720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:01.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.638+0000 7f9134fd3640 1 --2- 172.21.15.67:0/1555210841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91301005b0 0x7f9130197720 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9120004f90 tx=0x7f91200048f0 comp rx=0 tx=0).stop 2024-08-31T05:25:01.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.638+0000 7f9134fd3640 1 -- 172.21.15.67:0/1555210841 shutdown_connections 2024-08-31T05:25:01.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.638+0000 7f9134fd3640 1 --2- 172.21.15.67:0/1555210841 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f911c079e40 0x7f911c07c300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:01.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.638+0000 7f9134fd3640 1 --2- 172.21.15.67:0/1555210841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9130106660 0x7f9130197c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:01.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.638+0000 7f9134fd3640 1 --2- 172.21.15.67:0/1555210841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91301005b0 0x7f9130197720 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:01.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.638+0000 7f9134fd3640 1 -- 172.21.15.67:0/1555210841 >> 172.21.15.67:0/1555210841 conn(0x7f91300fc2f0 msgr2=0x7f9130069b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:01.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.638+0000 7f9134fd3640 1 -- 172.21.15.67:0/1555210841 shutdown_connections 2024-08-31T05:25:01.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:01.638+0000 7f9134fd3640 1 -- 172.21.15.67:0/1555210841 wait complete. 2024-08-31T05:25:02.241 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph config set global log_to_journald false --force' 2024-08-31T05:25:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:25:02.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:02 smithi067 ceph-mon[17432]: pgmap v92: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:03.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.009+0000 7f8e4af99640 1 -- 172.21.15.67:0/1170472471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e441098b0 msgr2=0x7f8e44114310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:03.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.009+0000 7f8e4af99640 1 --2- 172.21.15.67:0/1170472471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e441098b0 0x7f8e44114310 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009880 tx=0x7f8e3402a530 comp rx=0 tx=0).stop 2024-08-31T05:25:03.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.010+0000 7f8e4af99640 1 -- 172.21.15.67:0/1170472471 shutdown_connections 2024-08-31T05:25:03.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.010+0000 7f8e4af99640 1 --2- 172.21.15.67:0/1170472471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e441098b0 0x7f8e44114310 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:03.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.010+0000 7f8e4af99640 1 --2- 172.21.15.67:0/1170472471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e44108f90 0x7f8e44109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:03.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.010+0000 7f8e4af99640 1 -- 172.21.15.67:0/1170472471 >> 172.21.15.67:0/1170472471 conn(0x7f8e4406c9b0 msgr2=0x7f8e4406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:03.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.010+0000 7f8e4af99640 1 -- 172.21.15.67:0/1170472471 shutdown_connections 2024-08-31T05:25:03.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.010+0000 7f8e4af99640 1 -- 172.21.15.67:0/1170472471 wait complete. 2024-08-31T05:25:03.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.010+0000 7f8e4af99640 1 Processor -- start 2024-08-31T05:25:03.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.010+0000 7f8e4af99640 1 -- start start 2024-08-31T05:25:03.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e4af99640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e44108f90 0x7f8e4410a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:03.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e4af99640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e441098b0 0x7f8e4410a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:03.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e4af99640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8e44117370 con 0x7f8e441098b0 2024-08-31T05:25:03.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e4af99640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8e441171f0 con 0x7f8e44108f90 2024-08-31T05:25:03.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e441098b0 0x7f8e4410a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:03.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e441098b0 0x7f8e4410a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55076/0 (socket says 172.21.15.67:55076) 2024-08-31T05:25:03.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e43fff640 1 -- 172.21.15.67:0/78898026 learned_addr learned my addr 172.21.15.67:0/78898026 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:03.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e48d35640 1 --2- 172.21.15.67:0/78898026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e44108f90 0x7f8e4410a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:03.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e43fff640 1 -- 172.21.15.67:0/78898026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e44108f90 msgr2=0x7f8e4410a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:03.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e43fff640 1 --2- 172.21.15.67:0/78898026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e44108f90 0x7f8e4410a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:03.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e43fff640 1 -- 172.21.15.67:0/78898026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4410abf0 con 0x7f8e441098b0 2024-08-31T05:25:03.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e48d35640 1 --2- 172.21.15.67:0/78898026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e44108f90 0x7f8e4410a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:25:03.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e43fff640 1 --2- 172.21.15.67:0/78898026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e441098b0 0x7f8e4410a6b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8e34031460 tx=0x7f8e340048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:03.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e41ffb640 1 -- 172.21.15.67:0/78898026 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e3403f070 con 0x7f8e441098b0 2024-08-31T05:25:03.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e41ffb640 1 -- 172.21.15.67:0/78898026 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e34004cf0 con 0x7f8e441098b0 2024-08-31T05:25:03.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e4af99640 1 -- 172.21.15.67:0/78898026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4410ae80 con 0x7f8e441098b0 2024-08-31T05:25:03.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.011+0000 7f8e41ffb640 1 -- 172.21.15.67:0/78898026 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e34035030 con 0x7f8e441098b0 2024-08-31T05:25:03.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.012+0000 7f8e4af99640 1 -- 172.21.15.67:0/78898026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e441ac360 con 0x7f8e441098b0 2024-08-31T05:25:03.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.013+0000 7f8e4af99640 1 -- 172.21.15.67:0/78898026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e440734e0 con 0x7f8e441098b0 2024-08-31T05:25:03.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.013+0000 7f8e41ffb640 1 -- 172.21.15.67:0/78898026 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f8e34042070 con 0x7f8e441098b0 2024-08-31T05:25:03.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.014+0000 7f8e41ffb640 1 --2- 172.21.15.67:0/78898026 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e30079e00 0x7f8e3007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:03.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.014+0000 7f8e41ffb640 1 -- 172.21.15.67:0/78898026 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f8e340bd350 con 0x7f8e441098b0 2024-08-31T05:25:03.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.014+0000 7f8e48d35640 1 --2- 172.21.15.67:0/78898026 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e30079e00 0x7f8e3007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:03.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.014+0000 7f8e48d35640 1 --2- 172.21.15.67:0/78898026 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e30079e00 0x7f8e3007c2c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c005fd0 tx=0x7f8e2c005ea0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:03.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.018+0000 7f8e41ffb640 1 -- 172.21.15.67:0/78898026 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f8e34084ec0 con 0x7f8e441098b0 2024-08-31T05:25:03.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:02 smithi073 ceph-mon[24726]: pgmap v92: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:03.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.203+0000 7f8e4af99640 1 -- 172.21.15.67:0/78898026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f8e4410e9d0 con 0x7f8e441098b0 2024-08-31T05:25:03.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.203+0000 7f8e41ffb640 1 -- 172.21.15.67:0/78898026 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v66)=0 v66) ==== 135+0+0 (secure 0 0 0) 0x7f8e3408d370 con 0x7f8e441098b0 2024-08-31T05:25:03.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.206+0000 7f8e4af99640 1 -- 172.21.15.67:0/78898026 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e30079e00 msgr2=0x7f8e3007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:03.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.206+0000 7f8e4af99640 1 --2- 172.21.15.67:0/78898026 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e30079e00 0x7f8e3007c2c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c005fd0 tx=0x7f8e2c005ea0 comp rx=0 tx=0).stop 2024-08-31T05:25:03.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.206+0000 7f8e4af99640 1 -- 172.21.15.67:0/78898026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e441098b0 msgr2=0x7f8e4410a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:03.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.206+0000 7f8e4af99640 1 --2- 172.21.15.67:0/78898026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e441098b0 0x7f8e4410a6b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8e34031460 tx=0x7f8e340048f0 comp rx=0 tx=0).stop 2024-08-31T05:25:03.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.206+0000 7f8e4af99640 1 -- 172.21.15.67:0/78898026 shutdown_connections 2024-08-31T05:25:03.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.206+0000 7f8e4af99640 1 --2- 172.21.15.67:0/78898026 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e30079e00 0x7f8e3007c2c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:03.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.206+0000 7f8e4af99640 1 --2- 172.21.15.67:0/78898026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e441098b0 0x7f8e4410a6b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:03.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.206+0000 7f8e4af99640 1 --2- 172.21.15.67:0/78898026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e44108f90 0x7f8e4410a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:03.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.206+0000 7f8e4af99640 1 -- 172.21.15.67:0/78898026 >> 172.21.15.67:0/78898026 conn(0x7f8e4406c9b0 msgr2=0x7f8e44111980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:03.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.206+0000 7f8e4af99640 1 -- 172.21.15.67:0/78898026 shutdown_connections 2024-08-31T05:25:03.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:03.206+0000 7f8e4af99640 1 -- 172.21.15.67:0/78898026 wait complete. 2024-08-31T05:25:03.857 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-08-31T05:25:04.114 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:25:04.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.601+0000 7f6a7679c640 1 -- 172.21.15.67:0/508304766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a701016a0 msgr2=0x7f6a70101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:04.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.601+0000 7f6a7679c640 1 --2- 172.21.15.67:0/508304766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a701016a0 0x7f6a70101b00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009880 tx=0x7f6a5802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:25:04.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.601+0000 7f6a7679c640 1 -- 172.21.15.67:0/508304766 shutdown_connections 2024-08-31T05:25:04.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.601+0000 7f6a7679c640 1 --2- 172.21.15.67:0/508304766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a701016a0 0x7f6a70101b00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:04.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.601+0000 7f6a7679c640 1 --2- 172.21.15.67:0/508304766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a701076a0 0x7f6a70107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:04.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.601+0000 7f6a7679c640 1 -- 172.21.15.67:0/508304766 >> 172.21.15.67:0/508304766 conn(0x7f6a700fd3a0 msgr2=0x7f6a700ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:04.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.601+0000 7f6a7679c640 1 -- 172.21.15.67:0/508304766 shutdown_connections 2024-08-31T05:25:04.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.601+0000 7f6a7679c640 1 -- 172.21.15.67:0/508304766 wait complete. 2024-08-31T05:25:04.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.602+0000 7f6a7679c640 1 Processor -- start 2024-08-31T05:25:04.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.602+0000 7f6a7679c640 1 -- start start 2024-08-31T05:25:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.602+0000 7f6a7679c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a701016a0 0x7f6a70074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.602+0000 7f6a7679c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a701076a0 0x7f6a700747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.602+0000 7f6a7679c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7010ebd0 con 0x7f6a701076a0 2024-08-31T05:25:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.602+0000 7f6a7679c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7010ea50 con 0x7f6a701016a0 2024-08-31T05:25:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.602+0000 7f6a6f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a701076a0 0x7f6a700747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.602+0000 7f6a6f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a701076a0 0x7f6a700747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55086/0 (socket says 172.21.15.67:55086) 2024-08-31T05:25:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.602+0000 7f6a6f7fe640 1 -- 172.21.15.67:0/1473717250 learned_addr learned my addr 172.21.15.67:0/1473717250 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.603+0000 7f6a6ffff640 1 --2- 172.21.15.67:0/1473717250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a701016a0 0x7f6a70074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.603+0000 7f6a6f7fe640 1 -- 172.21.15.67:0/1473717250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a701016a0 msgr2=0x7f6a70074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.603+0000 7f6a6f7fe640 1 --2- 172.21.15.67:0/1473717250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a701016a0 0x7f6a70074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.603+0000 7f6a6f7fe640 1 -- 172.21.15.67:0/1473717250 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a70074d10 con 0x7f6a701076a0 2024-08-31T05:25:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.603+0000 7f6a6ffff640 1 --2- 172.21.15.67:0/1473717250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a701016a0 0x7f6a70074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:25:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.603+0000 7f6a6f7fe640 1 --2- 172.21.15.67:0/1473717250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a701076a0 0x7f6a700747d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6a58031460 tx=0x7f6a580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.603+0000 7f6a6d7fa640 1 -- 172.21.15.67:0/1473717250 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a5803f070 con 0x7f6a701076a0 2024-08-31T05:25:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.603+0000 7f6a6d7fa640 1 -- 172.21.15.67:0/1473717250 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a58004cf0 con 0x7f6a701076a0 2024-08-31T05:25:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.603+0000 7f6a7679c640 1 -- 172.21.15.67:0/1473717250 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a70074fa0 con 0x7f6a701076a0 2024-08-31T05:25:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.603+0000 7f6a6d7fa640 1 -- 172.21.15.67:0/1473717250 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a58035030 con 0x7f6a701076a0 2024-08-31T05:25:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.603+0000 7f6a7679c640 1 -- 172.21.15.67:0/1473717250 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a701a3ba0 con 0x7f6a701076a0 2024-08-31T05:25:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.604+0000 7f6a7679c640 1 -- 172.21.15.67:0/1473717250 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a70102de0 con 0x7f6a701076a0 2024-08-31T05:25:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.605+0000 7f6a6d7fa640 1 -- 172.21.15.67:0/1473717250 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f6a58042070 con 0x7f6a701076a0 2024-08-31T05:25:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.605+0000 7f6a6d7fa640 1 --2- 172.21.15.67:0/1473717250 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a5c079e00 0x7f6a5c07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.605+0000 7f6a6ffff640 1 --2- 172.21.15.67:0/1473717250 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a5c079e00 0x7f6a5c07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.605+0000 7f6a6d7fa640 1 -- 172.21.15.67:0/1473717250 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f6a580bd3b0 con 0x7f6a701076a0 2024-08-31T05:25:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.606+0000 7f6a6ffff640 1 --2- 172.21.15.67:0/1473717250 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a5c079e00 0x7f6a5c07c2c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6a60006fd0 tx=0x7f6a60008040 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.610+0000 7f6a6d7fa640 1 -- 172.21.15.67:0/1473717250 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f6a58084f20 con 0x7f6a701076a0 2024-08-31T05:25:04.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.813+0000 7f6a7679c640 1 -- 172.21.15.67:0/1473717250 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6", "target": ["mon-mgr", ""]}) -- 0x7f6a700623d0 con 0x7f6a5c079e00 2024-08-31T05:25:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:04 smithi067 ceph-mon[17432]: pgmap v93: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:04 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:25:04.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.819+0000 7f6a6d7fa640 1 -- 172.21.15.67:0/1473717250 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f6a700623d0 con 0x7f6a5c079e00 2024-08-31T05:25:04.821 INFO:teuthology.orchestra.run.smithi067.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:25:04.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.821+0000 7f6a7679c640 1 -- 172.21.15.67:0/1473717250 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a5c079e00 msgr2=0x7f6a5c07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:04.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.821+0000 7f6a7679c640 1 --2- 172.21.15.67:0/1473717250 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a5c079e00 0x7f6a5c07c2c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6a60006fd0 tx=0x7f6a60008040 comp rx=0 tx=0).stop 2024-08-31T05:25:04.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.821+0000 7f6a7679c640 1 -- 172.21.15.67:0/1473717250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a701076a0 msgr2=0x7f6a700747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:04.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.821+0000 7f6a7679c640 1 --2- 172.21.15.67:0/1473717250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a701076a0 0x7f6a700747d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6a58031460 tx=0x7f6a580048f0 comp rx=0 tx=0).stop 2024-08-31T05:25:04.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.822+0000 7f6a7679c640 1 -- 172.21.15.67:0/1473717250 shutdown_connections 2024-08-31T05:25:04.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.822+0000 7f6a7679c640 1 --2- 172.21.15.67:0/1473717250 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a5c079e00 0x7f6a5c07c2c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:04.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.822+0000 7f6a7679c640 1 --2- 172.21.15.67:0/1473717250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a701076a0 0x7f6a700747d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:04.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.822+0000 7f6a7679c640 1 --2- 172.21.15.67:0/1473717250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a701016a0 0x7f6a70074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:04.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.822+0000 7f6a7679c640 1 -- 172.21.15.67:0/1473717250 >> 172.21.15.67:0/1473717250 conn(0x7f6a700fd3a0 msgr2=0x7f6a700fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:04.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.822+0000 7f6a7679c640 1 -- 172.21.15.67:0/1473717250 shutdown_connections 2024-08-31T05:25:04.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:04.822+0000 7f6a7679c640 1 -- 172.21.15.67:0/1473717250 wait complete. 2024-08-31T05:25:05.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:04 smithi073 ceph-mon[24726]: pgmap v93: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:04 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:25:05.474 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-08-31T05:25:05.474 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2024-08-31T05:25:05.474 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-08-31T05:25:05.740 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:25:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:05 smithi073 ceph-mon[24726]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:05 smithi073 ceph-mon[24726]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:25:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:25:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:25:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:25:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:05 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:05 smithi073 ceph-mon[24726]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:25:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:05 smithi073 ceph-mon[24726]: pgmap v94: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:05 smithi067 ceph-mon[17432]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:05 smithi067 ceph-mon[17432]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:25:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:25:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:25:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:25:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:05 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:06.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:05 smithi067 ceph-mon[17432]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:25:06.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:05 smithi067 ceph-mon[17432]: pgmap v94: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:06.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.377+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2669618982 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ef41016a0 msgr2=0x7f3ef4101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:06.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.377+0000 7f3ef8cd1640 1 --2- 172.21.15.67:0/2669618982 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ef41016a0 0x7f3ef4101b00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009880 tx=0x7f3edc02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.377+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2669618982 shutdown_connections 2024-08-31T05:25:06.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.377+0000 7f3ef8cd1640 1 --2- 172.21.15.67:0/2669618982 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ef41016a0 0x7f3ef4101b00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.377+0000 7f3ef8cd1640 1 --2- 172.21.15.67:0/2669618982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef41076a0 0x7f3ef4107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.377+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2669618982 >> 172.21.15.67:0/2669618982 conn(0x7f3ef40fd3a0 msgr2=0x7f3ef40ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:06.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.377+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2669618982 shutdown_connections 2024-08-31T05:25:06.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.377+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2669618982 wait complete. 2024-08-31T05:25:06.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.378+0000 7f3ef8cd1640 1 Processor -- start 2024-08-31T05:25:06.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.378+0000 7f3ef8cd1640 1 -- start start 2024-08-31T05:25:06.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.378+0000 7f3ef8cd1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ef41016a0 0x7f3ef419d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:06.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.378+0000 7f3ef8cd1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef41076a0 0x7f3ef419d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:06.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.378+0000 7f3ef8cd1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef410ebd0 con 0x7f3ef41016a0 2024-08-31T05:25:06.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.378+0000 7f3ef8cd1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef410ea50 con 0x7f3ef41076a0 2024-08-31T05:25:06.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.378+0000 7f3ef259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ef41016a0 0x7f3ef419d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:06.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.378+0000 7f3ef259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ef41016a0 0x7f3ef419d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55100/0 (socket says 172.21.15.67:55100) 2024-08-31T05:25:06.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.378+0000 7f3ef259c640 1 -- 172.21.15.67:0/2980505956 learned_addr learned my addr 172.21.15.67:0/2980505956 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:06.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.378+0000 7f3ef1d9b640 1 --2- 172.21.15.67:0/2980505956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef41076a0 0x7f3ef419d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:06.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.378+0000 7f3ef259c640 1 -- 172.21.15.67:0/2980505956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef41076a0 msgr2=0x7f3ef419d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:06.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.378+0000 7f3ef259c640 1 --2- 172.21.15.67:0/2980505956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef41076a0 0x7f3ef419d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.378+0000 7f3ef259c640 1 -- 172.21.15.67:0/2980505956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef41975e0 con 0x7f3ef41016a0 2024-08-31T05:25:06.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.378+0000 7f3ef259c640 1 --2- 172.21.15.67:0/2980505956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ef41016a0 0x7f3ef419d420 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3ee400b420 tx=0x7f3ee400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:06.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.379+0000 7f3eeb7fe640 1 -- 172.21.15.67:0/2980505956 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ee4011630 con 0x7f3ef41016a0 2024-08-31T05:25:06.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.379+0000 7f3eeb7fe640 1 -- 172.21.15.67:0/2980505956 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ee4016070 con 0x7f3ef41016a0 2024-08-31T05:25:06.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.379+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2980505956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef41978d0 con 0x7f3ef41016a0 2024-08-31T05:25:06.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.379+0000 7f3eeb7fe640 1 -- 172.21.15.67:0/2980505956 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ee4010d40 con 0x7f3ef41016a0 2024-08-31T05:25:06.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.379+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2980505956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef4197e30 con 0x7f3ef41016a0 2024-08-31T05:25:06.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.380+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2980505956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef4102de0 con 0x7f3ef41016a0 2024-08-31T05:25:06.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.380+0000 7f3eeb7fe640 1 -- 172.21.15.67:0/2980505956 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f3ee401b460 con 0x7f3ef41016a0 2024-08-31T05:25:06.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.381+0000 7f3eeb7fe640 1 --2- 172.21.15.67:0/2980505956 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3ee0079e00 0x7f3ee007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:06.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.381+0000 7f3eeb7fe640 1 -- 172.21.15.67:0/2980505956 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f3ee409c060 con 0x7f3ef41016a0 2024-08-31T05:25:06.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.381+0000 7f3ef1d9b640 1 --2- 172.21.15.67:0/2980505956 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3ee0079e00 0x7f3ee007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:06.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.382+0000 7f3ef1d9b640 1 --2- 172.21.15.67:0/2980505956 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3ee0079e00 0x7f3ee007c2c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4198720 tx=0x7f3edc031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:06.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.386+0000 7f3eeb7fe640 1 -- 172.21.15.67:0/2980505956 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f3ee4021250 con 0x7f3ef41016a0 2024-08-31T05:25:06.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.596+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2980505956 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3ef4198140 con 0x7f3ee0079e00 2024-08-31T05:25:06.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.598+0000 7f3eeb7fe640 1 -- 172.21.15.67:0/2980505956 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f3ef4198140 con 0x7f3ee0079e00 2024-08-31T05:25:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.600+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2980505956 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3ee0079e00 msgr2=0x7f3ee007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.600+0000 7f3ef8cd1640 1 --2- 172.21.15.67:0/2980505956 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3ee0079e00 0x7f3ee007c2c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4198720 tx=0x7f3edc031400 comp rx=0 tx=0).stop 2024-08-31T05:25:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.600+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2980505956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ef41016a0 msgr2=0x7f3ef419d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.600+0000 7f3ef8cd1640 1 --2- 172.21.15.67:0/2980505956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ef41016a0 0x7f3ef419d420 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3ee400b420 tx=0x7f3ee400b8e0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.600+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2980505956 shutdown_connections 2024-08-31T05:25:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.600+0000 7f3ef8cd1640 1 --2- 172.21.15.67:0/2980505956 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3ee0079e00 0x7f3ee007c2c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.600+0000 7f3ef8cd1640 1 --2- 172.21.15.67:0/2980505956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef41076a0 0x7f3ef419d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.600+0000 7f3ef8cd1640 1 --2- 172.21.15.67:0/2980505956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ef41016a0 0x7f3ef419d420 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.600+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2980505956 >> 172.21.15.67:0/2980505956 conn(0x7f3ef40fd3a0 msgr2=0x7f3ef40fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:06.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.600+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2980505956 shutdown_connections 2024-08-31T05:25:06.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.600+0000 7f3ef8cd1640 1 -- 172.21.15.67:0/2980505956 wait complete. 2024-08-31T05:25:06.610 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:25:06.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.685+0000 7f3a1634a640 1 -- 172.21.15.67:0/1854302162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100743c0 msgr2=0x7f3a100747a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:06.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.685+0000 7f3a1634a640 1 --2- 172.21.15.67:0/1854302162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100743c0 0x7f3a100747a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009880 tx=0x7f3a0002a530 comp rx=0 tx=0).stop 2024-08-31T05:25:06.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.685+0000 7f3a1634a640 1 -- 172.21.15.67:0/1854302162 shutdown_connections 2024-08-31T05:25:06.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.685+0000 7f3a1634a640 1 --2- 172.21.15.67:0/1854302162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a10074ce0 0x7f3a1010d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.685+0000 7f3a1634a640 1 --2- 172.21.15.67:0/1854302162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100743c0 0x7f3a100747a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.685+0000 7f3a1634a640 1 -- 172.21.15.67:0/1854302162 >> 172.21.15.67:0/1854302162 conn(0x7f3a100fd3c0 msgr2=0x7f3a100ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:06.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.685+0000 7f3a1634a640 1 -- 172.21.15.67:0/1854302162 shutdown_connections 2024-08-31T05:25:06.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.686+0000 7f3a1634a640 1 -- 172.21.15.67:0/1854302162 wait complete. 2024-08-31T05:25:06.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.686+0000 7f3a1634a640 1 Processor -- start 2024-08-31T05:25:06.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.686+0000 7f3a1634a640 1 -- start start 2024-08-31T05:25:06.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.687+0000 7f3a1634a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100743c0 0x7f3a1019f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:06.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.687+0000 7f3a1634a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a10074ce0 0x7f3a1019fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:06.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.687+0000 7f3a1634a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3a10110df0 con 0x7f3a100743c0 2024-08-31T05:25:06.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.687+0000 7f3a1634a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3a10110c70 con 0x7f3a10074ce0 2024-08-31T05:25:06.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.687+0000 7f3a0ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100743c0 0x7f3a1019f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:06.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.687+0000 7f3a0ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100743c0 0x7f3a1019f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55110/0 (socket says 172.21.15.67:55110) 2024-08-31T05:25:06.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.687+0000 7f3a0ffff640 1 -- 172.21.15.67:0/2739586657 learned_addr learned my addr 172.21.15.67:0/2739586657 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:06.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.687+0000 7f3a0f7fe640 1 --2- 172.21.15.67:0/2739586657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a10074ce0 0x7f3a1019fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:06.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.687+0000 7f3a0ffff640 1 -- 172.21.15.67:0/2739586657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a10074ce0 msgr2=0x7f3a1019fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:06.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.687+0000 7f3a0ffff640 1 --2- 172.21.15.67:0/2739586657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a10074ce0 0x7f3a1019fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.687+0000 7f3a0ffff640 1 -- 172.21.15.67:0/2739586657 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a101997e0 con 0x7f3a100743c0 2024-08-31T05:25:06.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.687+0000 7f3a0f7fe640 1 --2- 172.21.15.67:0/2739586657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a10074ce0 0x7f3a1019fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:25:06.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.688+0000 7f3a0ffff640 1 --2- 172.21.15.67:0/2739586657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100743c0 0x7f3a1019f660 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3a00031460 tx=0x7f3a000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:06.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.688+0000 7f3a0d7fa640 1 -- 172.21.15.67:0/2739586657 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a0003f070 con 0x7f3a100743c0 2024-08-31T05:25:06.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.688+0000 7f3a0d7fa640 1 -- 172.21.15.67:0/2739586657 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a00004cf0 con 0x7f3a100743c0 2024-08-31T05:25:06.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.688+0000 7f3a1634a640 1 -- 172.21.15.67:0/2739586657 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a10199a70 con 0x7f3a100743c0 2024-08-31T05:25:06.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.688+0000 7f3a0d7fa640 1 -- 172.21.15.67:0/2739586657 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a00035030 con 0x7f3a100743c0 2024-08-31T05:25:06.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.688+0000 7f3a1634a640 1 -- 172.21.15.67:0/2739586657 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a10199fa0 con 0x7f3a100743c0 2024-08-31T05:25:06.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.689+0000 7f3a1634a640 1 -- 172.21.15.67:0/2739586657 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a10075a70 con 0x7f3a100743c0 2024-08-31T05:25:06.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.690+0000 7f3a0d7fa640 1 -- 172.21.15.67:0/2739586657 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f3a00042070 con 0x7f3a100743c0 2024-08-31T05:25:06.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.690+0000 7f3a0d7fa640 1 --2- 172.21.15.67:0/2739586657 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39f8079e00 0x7f39f807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:06.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.690+0000 7f3a0d7fa640 1 -- 172.21.15.67:0/2739586657 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f3a000bd3b0 con 0x7f3a100743c0 2024-08-31T05:25:06.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.691+0000 7f3a0f7fe640 1 --2- 172.21.15.67:0/2739586657 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39f8079e00 0x7f39f807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:06.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.691+0000 7f3a0f7fe640 1 --2- 172.21.15.67:0/2739586657 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39f8079e00 0x7f39f807c2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3a04006fd0 tx=0x7f3a04008040 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:06.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.695+0000 7f3a0d7fa640 1 -- 172.21.15.67:0/2739586657 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f3a00084f20 con 0x7f3a100743c0 2024-08-31T05:25:06.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.897+0000 7f3a1634a640 1 -- 172.21.15.67:0/2739586657 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3a1019a310 con 0x7f39f8079e00 2024-08-31T05:25:06.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.898+0000 7f3a0d7fa640 1 -- 172.21.15.67:0/2739586657 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f3a1019a310 con 0x7f39f8079e00 2024-08-31T05:25:06.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.900+0000 7f3a1634a640 1 -- 172.21.15.67:0/2739586657 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39f8079e00 msgr2=0x7f39f807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.900+0000 7f3a1634a640 1 --2- 172.21.15.67:0/2739586657 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39f8079e00 0x7f39f807c2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3a04006fd0 tx=0x7f3a04008040 comp rx=0 tx=0).stop 2024-08-31T05:25:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.900+0000 7f3a1634a640 1 -- 172.21.15.67:0/2739586657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100743c0 msgr2=0x7f3a1019f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.900+0000 7f3a1634a640 1 --2- 172.21.15.67:0/2739586657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100743c0 0x7f3a1019f660 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3a00031460 tx=0x7f3a000048f0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.900+0000 7f3a1634a640 1 -- 172.21.15.67:0/2739586657 shutdown_connections 2024-08-31T05:25:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.900+0000 7f3a1634a640 1 --2- 172.21.15.67:0/2739586657 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39f8079e00 0x7f39f807c2c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.900+0000 7f3a1634a640 1 --2- 172.21.15.67:0/2739586657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a10074ce0 0x7f3a1019fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.900+0000 7f3a1634a640 1 --2- 172.21.15.67:0/2739586657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a100743c0 0x7f3a1019f660 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.900+0000 7f3a1634a640 1 -- 172.21.15.67:0/2739586657 >> 172.21.15.67:0/2739586657 conn(0x7f3a100fd3c0 msgr2=0x7f3a1010afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.900+0000 7f3a1634a640 1 -- 172.21.15.67:0/2739586657 shutdown_connections 2024-08-31T05:25:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.900+0000 7f3a1634a640 1 -- 172.21.15.67:0/2739586657 wait complete. 2024-08-31T05:25:06.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.988+0000 7fdd6da52640 1 -- 172.21.15.67:0/1228763559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd68103220 msgr2=0x7fdd6810b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:06.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.988+0000 7fdd6da52640 1 --2- 172.21.15.67:0/1228763559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd68103220 0x7fdd6810b710 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009880 tx=0x7fdd5c02a530 comp rx=0 tx=0).stop 2024-08-31T05:25:06.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.988+0000 7fdd6da52640 1 -- 172.21.15.67:0/1228763559 shutdown_connections 2024-08-31T05:25:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.988+0000 7fdd6da52640 1 --2- 172.21.15.67:0/1228763559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd68103220 0x7fdd6810b710 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.988+0000 7fdd6da52640 1 --2- 172.21.15.67:0/1228763559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd68102900 0x7fdd68102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.988+0000 7fdd6da52640 1 -- 172.21.15.67:0/1228763559 >> 172.21.15.67:0/1228763559 conn(0x7fdd680fc2c0 msgr2=0x7fdd680fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.988+0000 7fdd6da52640 1 -- 172.21.15.67:0/1228763559 shutdown_connections 2024-08-31T05:25:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.988+0000 7fdd6da52640 1 -- 172.21.15.67:0/1228763559 wait complete. 2024-08-31T05:25:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.989+0000 7fdd6da52640 1 Processor -- start 2024-08-31T05:25:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.989+0000 7fdd6da52640 1 -- start start 2024-08-31T05:25:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.989+0000 7fdd6da52640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd68102900 0x7fdd6819d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.989+0000 7fdd6da52640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd68103220 0x7fdd6819d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.989+0000 7fdd6da52640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6810ebf0 con 0x7fdd68102900 2024-08-31T05:25:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.989+0000 7fdd6da52640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6810ea70 con 0x7fdd68103220 2024-08-31T05:25:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.989+0000 7fdd66ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd68102900 0x7fdd6819d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.989+0000 7fdd66ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd68102900 0x7fdd6819d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55126/0 (socket says 172.21.15.67:55126) 2024-08-31T05:25:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.989+0000 7fdd66ffd640 1 -- 172.21.15.67:0/2981781210 learned_addr learned my addr 172.21.15.67:0/2981781210 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.989+0000 7fdd667fc640 1 --2- 172.21.15.67:0/2981781210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd68103220 0x7fdd6819d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.989+0000 7fdd66ffd640 1 -- 172.21.15.67:0/2981781210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd68103220 msgr2=0x7fdd6819d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.990+0000 7fdd66ffd640 1 --2- 172.21.15.67:0/2981781210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd68103220 0x7fdd6819d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.990+0000 7fdd66ffd640 1 -- 172.21.15.67:0/2981781210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd681975c0 con 0x7fdd68102900 2024-08-31T05:25:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.990+0000 7fdd66ffd640 1 --2- 172.21.15.67:0/2981781210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd68102900 0x7fdd6819d400 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800ba50 tx=0x7fdd5800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.990+0000 7fdd6ca50640 1 -- 172.21.15.67:0/2981781210 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd58019070 con 0x7fdd68102900 2024-08-31T05:25:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.990+0000 7fdd6ca50640 1 -- 172.21.15.67:0/2981781210 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdd5800ce20 con 0x7fdd68102900 2024-08-31T05:25:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.990+0000 7fdd6da52640 1 -- 172.21.15.67:0/2981781210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd681978b0 con 0x7fdd68102900 2024-08-31T05:25:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.990+0000 7fdd6ca50640 1 -- 172.21.15.67:0/2981781210 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd580075a0 con 0x7fdd68102900 2024-08-31T05:25:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.990+0000 7fdd6da52640 1 -- 172.21.15.67:0/2981781210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd68197e10 con 0x7fdd68102900 2024-08-31T05:25:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.991+0000 7fdd6da52640 1 -- 172.21.15.67:0/2981781210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd6806a790 con 0x7fdd68102900 2024-08-31T05:25:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.992+0000 7fdd6ca50640 1 -- 172.21.15.67:0/2981781210 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fdd5801c070 con 0x7fdd68102900 2024-08-31T05:25:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.992+0000 7fdd6ca50640 1 --2- 172.21.15.67:0/2981781210 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fdd50079e00 0x7fdd5007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:06.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.992+0000 7fdd6ca50640 1 -- 172.21.15.67:0/2981781210 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fdd5809c190 con 0x7fdd68102900 2024-08-31T05:25:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.992+0000 7fdd667fc640 1 --2- 172.21.15.67:0/2981781210 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fdd50079e00 0x7fdd5007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.993+0000 7fdd667fc640 1 --2- 172.21.15.67:0/2981781210 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fdd50079e00 0x7fdd5007c2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdd68198700 tx=0x7fdd5c004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:06.997+0000 7fdd6ca50640 1 -- 172.21.15.67:0/2981781210 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fdd58063d00 con 0x7fdd68102900 2024-08-31T05:25:07.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:06 smithi067 ceph-mon[17432]: from='client.14938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:07.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.189+0000 7fdd6da52640 1 -- 172.21.15.67:0/2981781210 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdd68198af0 con 0x7fdd50079e00 2024-08-31T05:25:07.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:06 smithi073 ceph-mon[24726]: from='client.14938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:07.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.199+0000 7fdd6ca50640 1 -- 172.21.15.67:0/2981781210 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fdd68198af0 con 0x7fdd50079e00 2024-08-31T05:25:07.201 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:25:07.201 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (72s) 43s ago 11m 19.2M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:25:07.201 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (4m) 43s ago 12m 8770k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:25:07.201 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (3m) 112s ago 11m 8128k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:25:07.201 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (12m) 43s ago 12m 6895k - 19.1.1-242-g244a32d3 395b9209a980 a47c71179c57 2024-08-31T05:25:07.201 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (11m) 112s ago 11m 6895k - 19.1.1-242-g244a32d3 395b9209a980 5f2ce08c4451 2024-08-31T05:25:07.202 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (49s) 43s ago 11m 44.5M - c8b91775d855 3a9a0f88928d 2024-08-31T05:25:07.202 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (6m) 43s ago 6m 91.9M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:25:07.202 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (6m) 43s ago 6m 156M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:25:07.202 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (6m) 112s ago 6m 14.8M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:25:07.202 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (6m) 112s ago 6m 16.5M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:25:07.202 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (3m) 43s ago 13m 588M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:25:07.202 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (2m) 112s ago 11m 522M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:25:07.202 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (13m) 43s ago 13m 55.8M 2048M 19.1.1-242-g244a32d3 395b9209a980 7082a38c8108 2024-08-31T05:25:07.202 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (11m) 112s ago 11m 48.0M 2048M 19.1.1-242-g244a32d3 395b9209a980 30ccf0ed274b 2024-08-31T05:25:07.202 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (2m) 43s ago 12m 9.94M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:25:07.202 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (116s) 112s ago 11m 3384k - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:25:07.202 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (9m) 43s ago 9m 203M 1216M 19.1.1-242-g244a32d3 395b9209a980 b9f3f60b65f9 2024-08-31T05:25:07.202 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (9m) 43s ago 9m 224M 1216M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:25:07.203 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (9m) 43s ago 9m 187M 1216M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:25:07.203 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (8m) 112s ago 8m 249M 2240M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:25:07.203 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (8m) 112s ago 8m 211M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:25:07.203 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (7m) 112s ago 7m 186M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:25:07.203 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (93s) 43s ago 11m 42.5M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:25:07.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.201+0000 7fdd6da52640 1 -- 172.21.15.67:0/2981781210 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fdd50079e00 msgr2=0x7fdd5007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.201+0000 7fdd6da52640 1 --2- 172.21.15.67:0/2981781210 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fdd50079e00 0x7fdd5007c2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdd68198700 tx=0x7fdd5c004f30 comp rx=0 tx=0).stop 2024-08-31T05:25:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.201+0000 7fdd6da52640 1 -- 172.21.15.67:0/2981781210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd68102900 msgr2=0x7fdd6819d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.201+0000 7fdd6da52640 1 --2- 172.21.15.67:0/2981781210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd68102900 0x7fdd6819d400 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800ba50 tx=0x7fdd5800bf10 comp rx=0 tx=0).stop 2024-08-31T05:25:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.201+0000 7fdd6da52640 1 -- 172.21.15.67:0/2981781210 shutdown_connections 2024-08-31T05:25:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.201+0000 7fdd6da52640 1 --2- 172.21.15.67:0/2981781210 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fdd50079e00 0x7fdd5007c2c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.201+0000 7fdd6da52640 1 --2- 172.21.15.67:0/2981781210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd68103220 0x7fdd6819d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.201+0000 7fdd6da52640 1 --2- 172.21.15.67:0/2981781210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd68102900 0x7fdd6819d400 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.201+0000 7fdd6da52640 1 -- 172.21.15.67:0/2981781210 >> 172.21.15.67:0/2981781210 conn(0x7fdd680fc2c0 msgr2=0x7fdd68103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.201+0000 7fdd6da52640 1 -- 172.21.15.67:0/2981781210 shutdown_connections 2024-08-31T05:25:07.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.201+0000 7fdd6da52640 1 -- 172.21.15.67:0/2981781210 wait complete. 2024-08-31T05:25:07.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.283+0000 7f40fd739640 1 -- 172.21.15.67:0/48843174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f8103210 msgr2=0x7f40f810b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:07.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.283+0000 7f40fd739640 1 --2- 172.21.15.67:0/48843174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f8103210 0x7f40f810b700 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009880 tx=0x7f40ec02a540 comp rx=0 tx=0).stop 2024-08-31T05:25:07.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.283+0000 7f40fd739640 1 -- 172.21.15.67:0/48843174 shutdown_connections 2024-08-31T05:25:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.283+0000 7f40fd739640 1 --2- 172.21.15.67:0/48843174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f8103210 0x7f40f810b700 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.283+0000 7f40fd739640 1 --2- 172.21.15.67:0/48843174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40f81028f0 0x7f40f8102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.283+0000 7f40fd739640 1 -- 172.21.15.67:0/48843174 >> 172.21.15.67:0/48843174 conn(0x7f40f80fc2f0 msgr2=0x7f40f80fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.283+0000 7f40fd739640 1 -- 172.21.15.67:0/48843174 shutdown_connections 2024-08-31T05:25:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.283+0000 7f40fd739640 1 -- 172.21.15.67:0/48843174 wait complete. 2024-08-31T05:25:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.284+0000 7f40fd739640 1 Processor -- start 2024-08-31T05:25:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.284+0000 7f40fd739640 1 -- start start 2024-08-31T05:25:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.284+0000 7f40fd739640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40f81028f0 0x7f40f8197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.284+0000 7f40fd739640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f8103210 0x7f40f8197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.284+0000 7f40fd739640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f40f810eb60 con 0x7f40f8103210 2024-08-31T05:25:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.284+0000 7f40fd739640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f40f810e9e0 con 0x7f40f81028f0 2024-08-31T05:25:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.284+0000 7f40f67fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f8103210 0x7f40f8197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.284+0000 7f40f67fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f8103210 0x7f40f8197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55154/0 (socket says 172.21.15.67:55154) 2024-08-31T05:25:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.284+0000 7f40f67fc640 1 -- 172.21.15.67:0/3637120347 learned_addr learned my addr 172.21.15.67:0/3637120347 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.285+0000 7f40f6ffd640 1 --2- 172.21.15.67:0/3637120347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40f81028f0 0x7f40f8197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.285+0000 7f40f67fc640 1 -- 172.21.15.67:0/3637120347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40f81028f0 msgr2=0x7f40f8197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.285+0000 7f40f67fc640 1 --2- 172.21.15.67:0/3637120347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40f81028f0 0x7f40f8197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.285+0000 7f40f67fc640 1 -- 172.21.15.67:0/3637120347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f81982f0 con 0x7f40f8103210 2024-08-31T05:25:07.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.285+0000 7f40f67fc640 1 --2- 172.21.15.67:0/3637120347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f8103210 0x7f40f8197c40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f40ec004f90 tx=0x7f40ec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:07.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.285+0000 7f40dffff640 1 -- 172.21.15.67:0/3637120347 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40ec03f070 con 0x7f40f8103210 2024-08-31T05:25:07.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.285+0000 7f40dffff640 1 -- 172.21.15.67:0/3637120347 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40ec004cf0 con 0x7f40f8103210 2024-08-31T05:25:07.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.285+0000 7f40fd739640 1 -- 172.21.15.67:0/3637120347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f819c030 con 0x7f40f8103210 2024-08-31T05:25:07.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.285+0000 7f40dffff640 1 -- 172.21.15.67:0/3637120347 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40ec035030 con 0x7f40f8103210 2024-08-31T05:25:07.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.285+0000 7f40fd739640 1 -- 172.21.15.67:0/3637120347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f819c560 con 0x7f40f8103210 2024-08-31T05:25:07.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.286+0000 7f40fd739640 1 -- 172.21.15.67:0/3637120347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f806a280 con 0x7f40f8103210 2024-08-31T05:25:07.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.287+0000 7f40dffff640 1 -- 172.21.15.67:0/3637120347 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f40ec042070 con 0x7f40f8103210 2024-08-31T05:25:07.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.288+0000 7f40dffff640 1 --2- 172.21.15.67:0/3637120347 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f40e0079e00 0x7f40e007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:07.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.288+0000 7f40dffff640 1 -- 172.21.15.67:0/3637120347 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f40ec0bd3c0 con 0x7f40f8103210 2024-08-31T05:25:07.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.288+0000 7f40f6ffd640 1 --2- 172.21.15.67:0/3637120347 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f40e0079e00 0x7f40e007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:07.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.288+0000 7f40f6ffd640 1 --2- 172.21.15.67:0/3637120347 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f40e0079e00 0x7f40e007c2c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40e8007ec0 tx=0x7f40e80075b0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.292+0000 7f40dffff640 1 -- 172.21.15.67:0/3637120347 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f40ec089060 con 0x7f40f8103210 2024-08-31T05:25:07.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.560+0000 7f40fd739640 1 -- 172.21.15.67:0/3637120347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f40f8105d40 con 0x7f40f8103210 2024-08-31T05:25:07.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.560+0000 7f40dffff640 1 -- 172.21.15.67:0/3637120347 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f40ec08da80 con 0x7f40f8103210 2024-08-31T05:25:07.562 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 6 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 12, 2024-08-31T05:25:07.563 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:25:07.564 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:25:07.564 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:25:07.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.563+0000 7f40fd739640 1 -- 172.21.15.67:0/3637120347 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f40e0079e00 msgr2=0x7f40e007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:07.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.563+0000 7f40fd739640 1 --2- 172.21.15.67:0/3637120347 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f40e0079e00 0x7f40e007c2c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40e8007ec0 tx=0x7f40e80075b0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.563+0000 7f40fd739640 1 -- 172.21.15.67:0/3637120347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f8103210 msgr2=0x7f40f8197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:07.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.563+0000 7f40fd739640 1 --2- 172.21.15.67:0/3637120347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f8103210 0x7f40f8197c40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f40ec004f90 tx=0x7f40ec0048f0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.563+0000 7f40fd739640 1 -- 172.21.15.67:0/3637120347 shutdown_connections 2024-08-31T05:25:07.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.563+0000 7f40fd739640 1 --2- 172.21.15.67:0/3637120347 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f40e0079e00 0x7f40e007c2c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.563+0000 7f40fd739640 1 --2- 172.21.15.67:0/3637120347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f8103210 0x7f40f8197c40 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.563+0000 7f40fd739640 1 --2- 172.21.15.67:0/3637120347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40f81028f0 0x7f40f8197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.563+0000 7f40fd739640 1 -- 172.21.15.67:0/3637120347 >> 172.21.15.67:0/3637120347 conn(0x7f40f80fc2f0 msgr2=0x7f40f8108ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:07.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.564+0000 7f40fd739640 1 -- 172.21.15.67:0/3637120347 shutdown_connections 2024-08-31T05:25:07.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.564+0000 7f40fd739640 1 -- 172.21.15.67:0/3637120347 wait complete. 2024-08-31T05:25:07.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.649+0000 7f096ece7640 1 -- 172.21.15.67:0/880961140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09681076a0 msgr2=0x7f0968107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:07.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.649+0000 7f096ece7640 1 --2- 172.21.15.67:0/880961140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09681076a0 0x7f0968107a80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f095c009880 tx=0x7f095c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.649+0000 7f096ece7640 1 -- 172.21.15.67:0/880961140 shutdown_connections 2024-08-31T05:25:07.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.649+0000 7f096ece7640 1 --2- 172.21.15.67:0/880961140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09681016a0 0x7f0968101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.649+0000 7f096ece7640 1 --2- 172.21.15.67:0/880961140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09681076a0 0x7f0968107a80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.649+0000 7f096ece7640 1 -- 172.21.15.67:0/880961140 >> 172.21.15.67:0/880961140 conn(0x7f09680fd3c0 msgr2=0x7f09680ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:07.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.649+0000 7f096ece7640 1 -- 172.21.15.67:0/880961140 shutdown_connections 2024-08-31T05:25:07.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.649+0000 7f096ece7640 1 -- 172.21.15.67:0/880961140 wait complete. 2024-08-31T05:25:07.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.649+0000 7f096ece7640 1 Processor -- start 2024-08-31T05:25:07.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.650+0000 7f096ece7640 1 -- start start 2024-08-31T05:25:07.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.650+0000 7f096ece7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09681016a0 0x7f0968074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:07.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.650+0000 7f096ece7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09681076a0 0x7f09680747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:07.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.650+0000 7f096ece7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f096810eb70 con 0x7f09681076a0 2024-08-31T05:25:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.650+0000 7f096ece7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f096810e9f0 con 0x7f09681016a0 2024-08-31T05:25:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.650+0000 7f0967fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09681076a0 0x7f09680747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.650+0000 7f0967fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09681076a0 0x7f09680747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55178/0 (socket says 172.21.15.67:55178) 2024-08-31T05:25:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.650+0000 7f0967fff640 1 -- 172.21.15.67:0/3740415128 learned_addr learned my addr 172.21.15.67:0/3740415128 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.650+0000 7f096ca83640 1 --2- 172.21.15.67:0/3740415128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09681016a0 0x7f0968074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.650+0000 7f0967fff640 1 -- 172.21.15.67:0/3740415128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09681016a0 msgr2=0x7f0968074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.650+0000 7f0967fff640 1 --2- 172.21.15.67:0/3740415128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09681016a0 0x7f0968074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.650+0000 7f0967fff640 1 -- 172.21.15.67:0/3740415128 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0968074d10 con 0x7f09681076a0 2024-08-31T05:25:07.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.651+0000 7f0967fff640 1 --2- 172.21.15.67:0/3740415128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09681076a0 0x7f09680747d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f095400d6f0 tx=0x7f095400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:07.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.651+0000 7f0965ffb640 1 -- 172.21.15.67:0/3740415128 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0954017070 con 0x7f09681076a0 2024-08-31T05:25:07.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.651+0000 7f096ece7640 1 -- 172.21.15.67:0/3740415128 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0968075000 con 0x7f09681076a0 2024-08-31T05:25:07.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.651+0000 7f0965ffb640 1 -- 172.21.15.67:0/3740415128 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f095400de00 con 0x7f09681076a0 2024-08-31T05:25:07.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.651+0000 7f0965ffb640 1 -- 172.21.15.67:0/3740415128 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0954004bb0 con 0x7f09681076a0 2024-08-31T05:25:07.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.651+0000 7f096ece7640 1 -- 172.21.15.67:0/3740415128 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09681a3bc0 con 0x7f09681076a0 2024-08-31T05:25:07.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.652+0000 7f096ece7640 1 -- 172.21.15.67:0/3740415128 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0968102de0 con 0x7f09681076a0 2024-08-31T05:25:07.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.653+0000 7f0965ffb640 1 -- 172.21.15.67:0/3740415128 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f0954010460 con 0x7f09681076a0 2024-08-31T05:25:07.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.653+0000 7f0965ffb640 1 --2- 172.21.15.67:0/3740415128 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0958079e40 0x7f095807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:07.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.654+0000 7f0965ffb640 1 -- 172.21.15.67:0/3740415128 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f095409c3b0 con 0x7f09681076a0 2024-08-31T05:25:07.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.654+0000 7f096ca83640 1 --2- 172.21.15.67:0/3740415128 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0958079e40 0x7f095807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:07.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.654+0000 7f096ca83640 1 --2- 172.21.15.67:0/3740415128 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0958079e40 0x7f095807c300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f095c0096c0 tx=0x7f095c031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:07.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.662+0000 7f0965ffb640 1 -- 172.21.15.67:0/3740415128 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f095406cb30 con 0x7f09681076a0 2024-08-31T05:25:07.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.924+0000 7f096ece7640 1 -- 172.21.15.67:0/3740415128 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f0968109c10 con 0x7f09681076a0 2024-08-31T05:25:07.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.925+0000 7f0965ffb640 1 -- 172.21.15.67:0/3740415128 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2042 (secure 0 0 0) 0x7f0954060090 con 0x7f09681076a0 2024-08-31T05:25:07.927 INFO:teuthology.orchestra.run.smithi067.stdout:e15 2024-08-31T05:25:07.927 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-08-31T05:18:35:124059+0000 2024-08-31T05:25:07.927 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:25:07.927 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:25:07.927 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-08-31T05:25:07.927 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:25:07.927 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:25:07.927 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-08-31T05:25:07.927 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 13 2024-08-31T05:25:07.927 INFO:teuthology.orchestra.run.smithi067.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T05:25:07.927 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:25:07.928 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-08-31T05:18:33.086400+0000 2024-08-31T05:25:07.928 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-08-31T05:25:07.928 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-08-31T05:25:07.928 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2024-08-31T05:25:07.928 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-08-31T05:25:07.928 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-08-31T05:25:07.928 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-08-31T05:25:07.928 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-08-31T05:25:07.928 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-08-31T05:25:07.928 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 0 2024-08-31T05:25:07.928 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:25:07.928 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2024-08-31T05:25:07.928 INFO:teuthology.orchestra.run.smithi067.stdout:in 0 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14554} 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data enabled 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 14554 members: 14554 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.tskvpt{0:14554} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.beqeql{0:14566} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:25:07.929 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:25:07.930 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2024-08-31T05:25:07.930 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:25:07.930 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.kfbmeo{-1:24299} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:07.930 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.gsnhxi{-1:24307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6824/2383176383,v1:172.21.15.73:6825/2383176383] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:07.930 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-08-31T05:25:07.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.927+0000 7f096ece7640 1 -- 172.21.15.67:0/3740415128 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0958079e40 msgr2=0x7f095807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:07.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.927+0000 7f096ece7640 1 --2- 172.21.15.67:0/3740415128 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0958079e40 0x7f095807c300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f095c0096c0 tx=0x7f095c031400 comp rx=0 tx=0).stop 2024-08-31T05:25:07.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.927+0000 7f096ece7640 1 -- 172.21.15.67:0/3740415128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09681076a0 msgr2=0x7f09680747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:07.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.927+0000 7f096ece7640 1 --2- 172.21.15.67:0/3740415128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09681076a0 0x7f09680747d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f095400d6f0 tx=0x7f095400dbb0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.927+0000 7f096ece7640 1 -- 172.21.15.67:0/3740415128 shutdown_connections 2024-08-31T05:25:07.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.927+0000 7f096ece7640 1 --2- 172.21.15.67:0/3740415128 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0958079e40 0x7f095807c300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.927+0000 7f096ece7640 1 --2- 172.21.15.67:0/3740415128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09681076a0 0x7f09680747d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.927+0000 7f096ece7640 1 --2- 172.21.15.67:0/3740415128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09681016a0 0x7f0968074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:07.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.927+0000 7f096ece7640 1 -- 172.21.15.67:0/3740415128 >> 172.21.15.67:0/3740415128 conn(0x7f09680fd3c0 msgr2=0x7f09680fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:07.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.927+0000 7f096ece7640 1 -- 172.21.15.67:0/3740415128 shutdown_connections 2024-08-31T05:25:07.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:07.927+0000 7f096ece7640 1 -- 172.21.15.67:0/3740415128 wait complete. 2024-08-31T05:25:08.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.011+0000 7f02f26b3640 1 -- 172.21.15.67:0/1890490755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ec106670 msgr2=0x7f02ec106a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:08.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.011+0000 7f02f26b3640 1 --2- 172.21.15.67:0/1890490755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ec106670 0x7f02ec106a50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009880 tx=0x7f02dc02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.011+0000 7f02f26b3640 1 -- 172.21.15.67:0/1890490755 shutdown_connections 2024-08-31T05:25:08.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.011+0000 7f02f26b3640 1 --2- 172.21.15.67:0/1890490755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02ec1005c0 0x7f02ec100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.011+0000 7f02f26b3640 1 --2- 172.21.15.67:0/1890490755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ec106670 0x7f02ec106a50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.011+0000 7f02f26b3640 1 -- 172.21.15.67:0/1890490755 >> 172.21.15.67:0/1890490755 conn(0x7f02ec0fc2c0 msgr2=0x7f02ec0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:08.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.011+0000 7f02f26b3640 1 -- 172.21.15.67:0/1890490755 shutdown_connections 2024-08-31T05:25:08.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.011+0000 7f02f26b3640 1 -- 172.21.15.67:0/1890490755 wait complete. 2024-08-31T05:25:08.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.012+0000 7f02f26b3640 1 Processor -- start 2024-08-31T05:25:08.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.012+0000 7f02f26b3640 1 -- start start 2024-08-31T05:25:08.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.012+0000 7f02f26b3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02ec1005c0 0x7f02ec1976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:08.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.012+0000 7f02f26b3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ec106670 0x7f02ec197c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:08.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.012+0000 7f02f26b3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec10da80 con 0x7f02ec106670 2024-08-31T05:25:08.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.012+0000 7f02f26b3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec10d900 con 0x7f02ec1005c0 2024-08-31T05:25:08.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.012+0000 7f02eb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ec106670 0x7f02ec197c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:08.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.012+0000 7f02eb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ec106670 0x7f02ec197c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55192/0 (socket says 172.21.15.67:55192) 2024-08-31T05:25:08.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.012+0000 7f02eb7fe640 1 -- 172.21.15.67:0/3279843148 learned_addr learned my addr 172.21.15.67:0/3279843148 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:08.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.012+0000 7f02ebfff640 1 --2- 172.21.15.67:0/3279843148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02ec1005c0 0x7f02ec1976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:08.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.013+0000 7f02eb7fe640 1 -- 172.21.15.67:0/3279843148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02ec1005c0 msgr2=0x7f02ec1976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:08.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.013+0000 7f02eb7fe640 1 --2- 172.21.15.67:0/3279843148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02ec1005c0 0x7f02ec1976c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.013+0000 7f02eb7fe640 1 -- 172.21.15.67:0/3279843148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ec19bf90 con 0x7f02ec106670 2024-08-31T05:25:08.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.013+0000 7f02eb7fe640 1 --2- 172.21.15.67:0/3279843148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ec106670 0x7f02ec197c00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f02d400d6f0 tx=0x7f02d400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:08.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.013+0000 7f02e97fa640 1 -- 172.21.15.67:0/3279843148 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f02d4017070 con 0x7f02ec106670 2024-08-31T05:25:08.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.013+0000 7f02e97fa640 1 -- 172.21.15.67:0/3279843148 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02d400de00 con 0x7f02ec106670 2024-08-31T05:25:08.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.013+0000 7f02f26b3640 1 -- 172.21.15.67:0/3279843148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02ec19c280 con 0x7f02ec106670 2024-08-31T05:25:08.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.013+0000 7f02e97fa640 1 -- 172.21.15.67:0/3279843148 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f02d4004bb0 con 0x7f02ec106670 2024-08-31T05:25:08.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.013+0000 7f02f26b3640 1 -- 172.21.15.67:0/3279843148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02ec19c810 con 0x7f02ec106670 2024-08-31T05:25:08.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.014+0000 7f02f26b3640 1 -- 172.21.15.67:0/3279843148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02ec101ce0 con 0x7f02ec106670 2024-08-31T05:25:08.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.015+0000 7f02e97fa640 1 -- 172.21.15.67:0/3279843148 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f02d4004e60 con 0x7f02ec106670 2024-08-31T05:25:08.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.015+0000 7f02e97fa640 1 --2- 172.21.15.67:0/3279843148 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f02d8079e00 0x7f02d807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:08.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.016+0000 7f02ebfff640 1 --2- 172.21.15.67:0/3279843148 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f02d8079e00 0x7f02d807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:08.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.016+0000 7f02e97fa640 1 -- 172.21.15.67:0/3279843148 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f02d409c410 con 0x7f02ec106670 2024-08-31T05:25:08.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.016+0000 7f02ebfff640 1 --2- 172.21.15.67:0/3279843148 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f02d8079e00 0x7f02d807c2c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0096c0 tx=0x7f02dc004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:08.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.020+0000 7f02e97fa640 1 -- 172.21.15.67:0/3279843148 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f02d40680f0 con 0x7f02ec106670 2024-08-31T05:25:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.223+0000 7f02f26b3640 1 -- 172.21.15.67:0/3279843148 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f02ec19cac0 con 0x7f02d8079e00 2024-08-31T05:25:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.224+0000 7f02e97fa640 1 -- 172.21.15.67:0/3279843148 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f02ec19cac0 con 0x7f02d8079e00 2024-08-31T05:25:08.226 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:25:08.226 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:25:08.226 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:25:08.226 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-31T05:25:08.227 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:25:08.227 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr" 2024-08-31T05:25:08.227 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:25:08.227 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "2/23 daemons upgraded", 2024-08-31T05:25:08.227 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading mon daemons", 2024-08-31T05:25:08.227 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:25:08.227 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:25:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.227+0000 7f02f26b3640 1 -- 172.21.15.67:0/3279843148 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f02d8079e00 msgr2=0x7f02d807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.227+0000 7f02f26b3640 1 --2- 172.21.15.67:0/3279843148 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f02d8079e00 0x7f02d807c2c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0096c0 tx=0x7f02dc004f30 comp rx=0 tx=0).stop 2024-08-31T05:25:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.227+0000 7f02f26b3640 1 -- 172.21.15.67:0/3279843148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ec106670 msgr2=0x7f02ec197c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.227+0000 7f02f26b3640 1 --2- 172.21.15.67:0/3279843148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ec106670 0x7f02ec197c00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f02d400d6f0 tx=0x7f02d400dbb0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.227+0000 7f02f26b3640 1 -- 172.21.15.67:0/3279843148 shutdown_connections 2024-08-31T05:25:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.227+0000 7f02f26b3640 1 --2- 172.21.15.67:0/3279843148 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f02d8079e00 0x7f02d807c2c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.227+0000 7f02f26b3640 1 --2- 172.21.15.67:0/3279843148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02ec106670 0x7f02ec197c00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.227+0000 7f02f26b3640 1 --2- 172.21.15.67:0/3279843148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02ec1005c0 0x7f02ec1976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.227+0000 7f02f26b3640 1 -- 172.21.15.67:0/3279843148 >> 172.21.15.67:0/3279843148 conn(0x7f02ec0fc2c0 msgr2=0x7f02ec069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.227+0000 7f02f26b3640 1 -- 172.21.15.67:0/3279843148 shutdown_connections 2024-08-31T05:25:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.227+0000 7f02f26b3640 1 -- 172.21.15.67:0/3279843148 wait complete. 2024-08-31T05:25:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.313+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3081231554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a14102850 msgr2=0x7f3a14102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.313+0000 7f3a1c5a4640 1 --2- 172.21.15.67:0/3081231554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a14102850 0x7f3a14102c30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009880 tx=0x7f3a0402a530 comp rx=0 tx=0).stop 2024-08-31T05:25:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.314+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3081231554 shutdown_connections 2024-08-31T05:25:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.314+0000 7f3a1c5a4640 1 --2- 172.21.15.67:0/3081231554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a14103170 0x7f3a1410b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.314+0000 7f3a1c5a4640 1 --2- 172.21.15.67:0/3081231554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a14102850 0x7f3a14102c30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.314+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3081231554 >> 172.21.15.67:0/3081231554 conn(0x7f3a140fc2f0 msgr2=0x7f3a140fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.314+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3081231554 shutdown_connections 2024-08-31T05:25:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.314+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3081231554 wait complete. 2024-08-31T05:25:08.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.314+0000 7f3a1c5a4640 1 Processor -- start 2024-08-31T05:25:08.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.314+0000 7f3a1c5a4640 1 -- start start 2024-08-31T05:25:08.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a1c5a4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a14102850 0x7f3a14197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:08.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a1c5a4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a14103170 0x7f3a14197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a1c5a4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1410eb80 con 0x7f3a14103170 2024-08-31T05:25:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a1c5a4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1410ea00 con 0x7f3a14102850 2024-08-31T05:25:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a19b3f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a14103170 0x7f3a14197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a19b3f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a14103170 0x7f3a14197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54554/0 (socket says 172.21.15.67:54554) 2024-08-31T05:25:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a19b3f640 1 -- 172.21.15.67:0/3878386349 learned_addr learned my addr 172.21.15.67:0/3878386349 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a1a340640 1 --2- 172.21.15.67:0/3878386349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a14102850 0x7f3a14197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a19b3f640 1 -- 172.21.15.67:0/3878386349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a14102850 msgr2=0x7f3a14197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a19b3f640 1 --2- 172.21.15.67:0/3878386349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a14102850 0x7f3a14197720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a19b3f640 1 -- 172.21.15.67:0/3878386349 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1419bff0 con 0x7f3a14103170 2024-08-31T05:25:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a19b3f640 1 --2- 172.21.15.67:0/3878386349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a14103170 0x7f3a14197c60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000d6d0 tx=0x7f3a1000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a0b7fe640 1 -- 172.21.15.67:0/3878386349 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a10017070 con 0x7f3a14103170 2024-08-31T05:25:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a0b7fe640 1 -- 172.21.15.67:0/3878386349 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a100054e0 con 0x7f3a14103170 2024-08-31T05:25:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3878386349 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1419c2e0 con 0x7f3a14103170 2024-08-31T05:25:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a0b7fe640 1 -- 172.21.15.67:0/3878386349 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a10004ae0 con 0x7f3a14103170 2024-08-31T05:25:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.315+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3878386349 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a1419c870 con 0x7f3a14103170 2024-08-31T05:25:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.317+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3878386349 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a1406a320 con 0x7f3a14103170 2024-08-31T05:25:08.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.317+0000 7f3a0b7fe640 1 -- 172.21.15.67:0/3878386349 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f3a10004de0 con 0x7f3a14103170 2024-08-31T05:25:08.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.318+0000 7f3a0b7fe640 1 --2- 172.21.15.67:0/3878386349 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3a00079e00 0x7f3a0007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:08.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.318+0000 7f3a0b7fe640 1 -- 172.21.15.67:0/3878386349 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f3a1009c4c0 con 0x7f3a14103170 2024-08-31T05:25:08.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.318+0000 7f3a1a340640 1 --2- 172.21.15.67:0/3878386349 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3a00079e00 0x7f3a0007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:08.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.319+0000 7f3a1a340640 1 --2- 172.21.15.67:0/3878386349 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3a00079e00 0x7f3a0007c2c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3a04031460 tx=0x7f3a040095c0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:08.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.323+0000 7f3a0b7fe640 1 -- 172.21.15.67:0/3878386349 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f3a10064030 con 0x7f3a14103170 2024-08-31T05:25:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.585+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3878386349 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f3a1419cb20 con 0x7f3a14103170 2024-08-31T05:25:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.585+0000 7f3a0b7fe640 1 -- 172.21.15.67:0/3878386349 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f3a100681a0 con 0x7f3a14103170 2024-08-31T05:25:08.587 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-31T05:25:08.587 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:25:08.587 INFO:teuthology.orchestra.run.smithi067.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:25:08.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.587+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3878386349 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3a00079e00 msgr2=0x7f3a0007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:08.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.587+0000 7f3a1c5a4640 1 --2- 172.21.15.67:0/3878386349 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3a00079e00 0x7f3a0007c2c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3a04031460 tx=0x7f3a040095c0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.587+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3878386349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a14103170 msgr2=0x7f3a14197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.587+0000 7f3a1c5a4640 1 --2- 172.21.15.67:0/3878386349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a14103170 0x7f3a14197c60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000d6d0 tx=0x7f3a1000db90 comp rx=0 tx=0).stop 2024-08-31T05:25:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.587+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3878386349 shutdown_connections 2024-08-31T05:25:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.587+0000 7f3a1c5a4640 1 --2- 172.21.15.67:0/3878386349 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3a00079e00 0x7f3a0007c2c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.587+0000 7f3a1c5a4640 1 --2- 172.21.15.67:0/3878386349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a14103170 0x7f3a14197c60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.587+0000 7f3a1c5a4640 1 --2- 172.21.15.67:0/3878386349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a14102850 0x7f3a14197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.587+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3878386349 >> 172.21.15.67:0/3878386349 conn(0x7f3a140fc2f0 msgr2=0x7f3a1410ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.588+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3878386349 shutdown_connections 2024-08-31T05:25:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:08.588+0000 7f3a1c5a4640 1 -- 172.21.15.67:0/3878386349 wait complete. 2024-08-31T05:25:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:08 smithi067 ceph-mon[17432]: from='client.14942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:08 smithi067 ceph-mon[17432]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:08 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:08 smithi067 ceph-mon[17432]: Upgrade: Target is version 19.3.0-4560-gd19e6118 (squid) 2024-08-31T05:25:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:08 smithi067 ceph-mon[17432]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, digests ['quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61'] 2024-08-31T05:25:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:08 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:25:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:08 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:25:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:08 smithi067 ceph-mon[17432]: Upgrade: Setting container_image for all mgr 2024-08-31T05:25:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:08 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:08.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:08 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3637120347' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:25:08.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:08 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-31T05:25:08.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:08 smithi067 ceph-mon[17432]: pgmap v95: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:08.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:08 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3740415128' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-31T05:25:08.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:08 smithi073 ceph-mon[24726]: from='client.14942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:08.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:08 smithi073 ceph-mon[24726]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:08.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:08 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:08.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:08 smithi073 ceph-mon[24726]: Upgrade: Target is version 19.3.0-4560-gd19e6118 (squid) 2024-08-31T05:25:08.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:08 smithi073 ceph-mon[24726]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, digests ['quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61'] 2024-08-31T05:25:08.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:08 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:25:08.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:08 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:25:08.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:08 smithi073 ceph-mon[24726]: Upgrade: Setting container_image for all mgr 2024-08-31T05:25:08.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:08 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:08.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:08 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3637120347' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:25:08.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:08 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-31T05:25:08.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:08 smithi073 ceph-mon[24726]: pgmap v95: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:08.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:08 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3740415128' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-31T05:25:09.682 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:09 smithi067 ceph-mon[17432]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:09.682 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:09 smithi067 ceph-mon[17432]: from='client.? 172.21.15.67:0/3878386349' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-31T05:25:09.682 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:09 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:09.682 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:09 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T05:25:09.682 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:09 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T05:25:09.682 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:09 smithi067 ceph-mon[17432]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:25:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:09 smithi073 ceph-mon[24726]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:09 smithi073 ceph-mon[24726]: from='client.? 172.21.15.67:0/3878386349' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-31T05:25:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:09 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:09 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T05:25:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:09 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T05:25:09.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:09 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:25:10.693 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:10 smithi067 ceph-mon[17432]: Upgrade: Updating mon.smithi067 2024-08-31T05:25:10.693 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:10 smithi067 ceph-mon[17432]: Deploying daemon mon.smithi067 on smithi067 2024-08-31T05:25:10.693 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:10 smithi067 ceph-mon[17432]: pgmap v96: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:10 smithi073 ceph-mon[24726]: Upgrade: Updating mon.smithi067 2024-08-31T05:25:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:10 smithi073 ceph-mon[24726]: Deploying daemon mon.smithi067 on smithi067 2024-08-31T05:25:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:10 smithi073 ceph-mon[24726]: pgmap v96: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:10.983 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:10 smithi067 systemd[1]: Stopping Ceph mon.smithi067 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:25:11.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:10 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067[17428]: 2024-08-31T05:25:10.981+0000 7fc74e41b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi067 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:25:11.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:10 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067[17428]: 2024-08-31T05:25:10.981+0000 7fc74e41b640 -1 mon.smithi067@0(leader) e2 *** Got Signal Terminated *** 2024-08-31T05:25:11.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:11 smithi067 podman[99771]: 2024-08-31 05:25:11.103849102 +0000 UTC m=+0.263657846 container died 7082a38c8108d2401e6933da8417866d80fee34e8d7876cbcf80a0c6224ae8a0 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-244a32d, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:25:11.759 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:11 smithi067 podman[99771]: 2024-08-31 05:25:11.489989036 +0000 UTC m=+0.649797781 container cleanup 7082a38c8108d2401e6933da8417866d80fee34e8d7876cbcf80a0c6224ae8a0 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-244a32d) 2024-08-31T05:25:11.759 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:11 smithi067 bash[99771]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067 2024-08-31T05:25:12.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:11 smithi067 podman[99794]: 2024-08-31 05:25:11.758293805 +0000 UTC m=+0.648965544 container remove 7082a38c8108d2401e6933da8417866d80fee34e8d7876cbcf80a0c6224ae8a0 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-244a32d) 2024-08-31T05:25:12.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:11 smithi067 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi067.service: Deactivated successfully. 2024-08-31T05:25:12.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:11 smithi067 systemd[1]: Stopped Ceph mon.smithi067 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:25:12.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:11 smithi067 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi067.service: Consumed 13.267s CPU time. 2024-08-31T05:25:12.466 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 systemd[1]: Starting Ceph mon.smithi067 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:25:12.467 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 podman[99923]: 2024-08-31 05:25:12.237058937 +0000 UTC m=+0.016470503 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:25:12.467 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 podman[99923]: 2024-08-31 05:25:12.368151135 +0000 UTC m=+0.147562684 container create 25a28efbbd379664dba0dd56466a59918d1a2103c1aa3a2ba10ac69bbbb77e20 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T05:25:12.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 podman[99923]: 2024-08-31 05:25:12.57111361 +0000 UTC m=+0.350525164 container init 25a28efbbd379664dba0dd56466a59918d1a2103c1aa3a2ba10ac69bbbb77e20 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-08-31T05:25:12.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 podman[99923]: 2024-08-31 05:25:12.574874214 +0000 UTC m=+0.354285769 container start 25a28efbbd379664dba0dd56466a59918d1a2103c1aa3a2ba10ac69bbbb77e20 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-31T05:25:12.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T05:25:12.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-31T05:25:12.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: pidfile_write: ignore empty --pid-file 2024-08-31T05:25:12.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: load: jerasure load: lrc 2024-08-31T05:25:12.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: RocksDB version: 7.9.2 2024-08-31T05:25:12.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Git sha 0 2024-08-31T05:25:12.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T05:25:12.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: DB SUMMARY 2024-08-31T05:25:12.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: DB Session ID: FUMCWAGQ1BU0F0P1ODH2 2024-08-31T05:25:12.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: CURRENT file: CURRENT 2024-08-31T05:25:12.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T05:25:12.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1519 Bytes 2024-08-31T05:25:12.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi067/store.db dir, Total Num: 1, files: 000032.sst 2024-08-31T05:25:12.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi067/store.db: 000030.log size: 2129185 ; 2024-08-31T05:25:12.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.error_if_exists: 0 2024-08-31T05:25:12.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.create_if_missing: 0 2024-08-31T05:25:12.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.paranoid_checks: 1 2024-08-31T05:25:12.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T05:25:12.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T05:25:12.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T05:25:12.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.env: 0x55ca2f4c65a0 2024-08-31T05:25:12.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T05:25:12.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.info_log: 0x55ca33edb6e0 2024-08-31T05:25:12.827 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T05:25:12.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.statistics: (nil) 2024-08-31T05:25:12.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.use_fsync: 0 2024-08-31T05:25:12.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_log_file_size: 0 2024-08-31T05:25:12.828 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T05:25:12.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T05:25:12.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T05:25:12.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T05:25:12.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.allow_fallocate: 1 2024-08-31T05:25:12.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T05:25:12.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T05:25:12.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.use_direct_reads: 0 2024-08-31T05:25:12.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T05:25:12.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T05:25:12.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.db_log_dir: 2024-08-31T05:25:12.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.wal_dir: 2024-08-31T05:25:12.829 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T05:25:12.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T05:25:12.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T05:25:12.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T05:25:12.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T05:25:12.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T05:25:12.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T05:25:12.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T05:25:12.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.write_buffer_manager: 0x55ca33edf5e0 2024-08-31T05:25:12.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T05:25:12.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T05:25:12.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T05:25:12.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T05:25:12.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T05:25:12.830 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T05:25:12.831 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T05:25:12.831 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T05:25:12.831 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.unordered_write: 0 2024-08-31T05:25:12.831 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T05:25:12.831 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T05:25:12.831 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T05:25:12.831 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T05:25:12.831 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.row_cache: None 2024-08-31T05:25:12.831 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.wal_filter: None 2024-08-31T05:25:12.831 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T05:25:12.831 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T05:25:12.831 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.two_write_queues: 0 2024-08-31T05:25:12.831 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T05:25:12.832 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.wal_compression: 0 2024-08-31T05:25:12.832 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.atomic_flush: 0 2024-08-31T05:25:12.832 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T05:25:12.832 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T05:25:12.832 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T05:25:12.832 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.log_readahead_size: 0 2024-08-31T05:25:12.832 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T05:25:12.832 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T05:25:12.832 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T05:25:12.832 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T05:25:12.832 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T05:25:12.832 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T05:25:12.833 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T05:25:12.833 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_background_jobs: 2 2024-08-31T05:25:12.833 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_background_compactions: -1 2024-08-31T05:25:12.833 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_subcompactions: 1 2024-08-31T05:25:12.833 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T05:25:12.833 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T05:25:12.833 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T05:25:12.833 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T05:25:12.833 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T05:25:12.833 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T05:25:12.833 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T05:25:12.833 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T05:25:12.833 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_open_files: -1 2024-08-31T05:25:12.833 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T05:25:12.834 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T05:25:12.834 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T05:25:12.834 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T05:25:12.834 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_background_flushes: -1 2024-08-31T05:25:12.834 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Compression algorithms supported: 2024-08-31T05:25:12.834 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: kZSTD supported: 0 2024-08-31T05:25:12.834 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: kXpressCompression supported: 0 2024-08-31T05:25:12.834 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: kBZip2Compression supported: 0 2024-08-31T05:25:12.834 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T05:25:12.834 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: kLZ4Compression supported: 1 2024-08-31T05:25:12.834 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: kZlibCompression supported: 1 2024-08-31T05:25:12.834 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T05:25:12.834 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: kSnappyCompression supported: 1 2024-08-31T05:25:12.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T05:25:12.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T05:25:12.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi067/store.db/MANIFEST-000015 2024-08-31T05:25:12.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T05:25:12.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T05:25:12.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.merge_operator: 2024-08-31T05:25:12.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compaction_filter: None 2024-08-31T05:25:12.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T05:25:12.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T05:25:12.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T05:25:12.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T05:25:12.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ca33edb300) 2024-08-31T05:25:12.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: cache_index_and_filter_blocks: 1 2024-08-31T05:25:12.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T05:25:12.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T05:25:12.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: pin_top_level_index_and_filter: 1 2024-08-31T05:25:12.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: index_type: 0 2024-08-31T05:25:12.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: data_block_index_type: 0 2024-08-31T05:25:12.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: index_shortening: 1 2024-08-31T05:25:12.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T05:25:12.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: checksum: 4 2024-08-31T05:25:12.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: no_block_cache: 0 2024-08-31T05:25:12.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache: 0x55ca2fe9e850 2024-08-31T05:25:12.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache_name: BinnedLRUCache 2024-08-31T05:25:12.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache_options: 2024-08-31T05:25:12.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: capacity : 536870912 2024-08-31T05:25:12.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: num_shard_bits : 4 2024-08-31T05:25:12.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: strict_capacity_limit : 0 2024-08-31T05:25:12.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: high_pri_pool_ratio: 0.000 2024-08-31T05:25:12.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache_compressed: (nil) 2024-08-31T05:25:12.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: persistent_cache: (nil) 2024-08-31T05:25:12.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_size: 4096 2024-08-31T05:25:12.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_size_deviation: 10 2024-08-31T05:25:12.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_restart_interval: 16 2024-08-31T05:25:12.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: index_block_restart_interval: 1 2024-08-31T05:25:12.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: metadata_block_size: 4096 2024-08-31T05:25:12.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: partition_filters: 0 2024-08-31T05:25:12.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: use_delta_encoding: 1 2024-08-31T05:25:12.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: filter_policy: bloomfilter 2024-08-31T05:25:12.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: whole_key_filtering: 1 2024-08-31T05:25:12.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: verify_compression: 0 2024-08-31T05:25:12.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: read_amp_bytes_per_bit: 0 2024-08-31T05:25:12.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: format_version: 5 2024-08-31T05:25:12.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: enable_index_compression: 1 2024-08-31T05:25:12.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_align: 0 2024-08-31T05:25:12.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: max_auto_readahead_size: 262144 2024-08-31T05:25:12.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: prepopulate_block_cache: 0 2024-08-31T05:25:12.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: initial_auto_readahead_size: 8192 2024-08-31T05:25:12.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T05:25:12.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T05:25:12.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T05:25:12.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compression: NoCompression 2024-08-31T05:25:12.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T05:25:12.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T05:25:12.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T05:25:12.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.num_levels: 7 2024-08-31T05:25:12.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T05:25:12.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T05:25:12.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T05:25:12.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T05:25:12.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T05:25:12.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T05:25:12.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T05:25:12.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:25:12.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T05:25:12.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T05:25:12.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:25:12.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:25:12.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T05:25:12.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T05:25:12.841 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T05:25:12.841 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T05:25:12.841 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T05:25:12.842 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T05:25:12.842 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T05:25:12.842 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T05:25:12.842 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T05:25:12.842 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T05:25:12.842 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T05:25:12.842 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T05:25:12.842 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T05:25:12.842 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T05:25:12.842 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T05:25:12.842 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T05:25:12.842 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T05:25:12.842 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T05:25:12.842 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.inplace_update_support: 0 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T05:25:12.843 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.bloom_locality: 0 2024-08-31T05:25:12.844 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.max_successive_merges: 0 2024-08-31T05:25:12.844 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T05:25:12.844 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T05:25:12.844 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T05:25:12.844 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T05:25:12.844 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.ttl: 2592000 2024-08-31T05:25:12.844 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T05:25:12.844 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T05:25:12.844 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T05:25:12.844 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.enable_blob_files: false 2024-08-31T05:25:12.844 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.min_blob_size: 0 2024-08-31T05:25:12.844 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T05:25:12.844 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T05:25:12.844 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T05:25:12.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T05:25:12.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T05:25:12.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T05:25:12.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T05:25:12.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T05:25:12.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-31T05:25:12.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi067/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12041, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-08-31T05:25:12.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-08-31T05:25:12.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5c78c4bf-e13b-45aa-b2e6-1d3b4e4e16e5 2024-08-31T05:25:12.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081912611258, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-08-31T05:25:12.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-08-31T05:25:12.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081912619260, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 1878113, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12042, "largest_seqno": 13605, "table_properties": {"data_size": 1870643, "index_size": 4637, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1797, "raw_key_size": 16342, "raw_average_key_size": 23, "raw_value_size": 1855709, "raw_average_value_size": 2658, "num_data_blocks": 212, "num_entries": 698, "num_filter_entries": 698, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725081912, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5c78c4bf-e13b-45aa-b2e6-1d3b4e4e16e5", "db_session_id": "FUMCWAGQ1BU0F0P1ODH2", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-08-31T05:25:12.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081912619374, "job": 1, "event": "recovery_finished"} 2024-08-31T05:25:12.846 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-08-31T05:25:12.846 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-31T05:25:12.846 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi067/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T05:25:12.846 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ca33efea80 2024-08-31T05:25:12.846 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: DB pointer 0x55ca34ca0000 2024-08-31T05:25:12.846 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T05:25:12.846 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T05:25:12.846 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** DB Stats ** 2024-08-31T05:25:12.846 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:25:12.846 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T05:25:12.846 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:25:12.846 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:25:12.846 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T05:25:12.847 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:25:12.847 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:25:12.847 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:25:12.847 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** Compaction Stats [default] ** 2024-08-31T05:25:12.847 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:25:12.847 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T05:25:12.847 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: L0 1/0 1.79 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 522.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-08-31T05:25:12.847 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: L6 1/0 7.24 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-08-31T05:25:12.847 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Sum 2/0 9.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 522.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-08-31T05:25:12.847 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 522.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-08-31T05:25:12.847 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:25:12.847 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** Compaction Stats [default] ** 2024-08-31T05:25:12.847 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:25:12.848 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T05:25:12.848 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 522.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-08-31T05:25:12.848 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:25:12.848 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T05:25:12.848 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:25:12.848 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:25:12.848 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-08-31T05:25:12.848 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T05:25:12.848 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T05:25:12.848 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T05:25:12.848 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T05:25:12.848 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative compaction: 0.00 GB write, 142.14 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:25:12.848 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval compaction: 0.00 GB write, 142.14 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:25:12.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T05:25:12.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Block cache BinnedLRUCache@0x55ca2fe9e850#2 capacity: 512.00 MB usage: 7.12 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-08-31T05:25:12.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.04 KB,0.00038892%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-08-31T05:25:12.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:25:12.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T05:25:12.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: starting mon.smithi067 rank 0 at public addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] at bind addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi067 fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:25:12.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: mon.smithi067@-1(???) e2 preinit fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:25:12.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: mon.smithi067@-1(???).mds e15 new map 2024-08-31T05:25:12.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: mon.smithi067@-1(???).mds e15 print_map 2024-08-31T05:25:12.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: e15 2024-08-31T05:25:12.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: btime 2024-08-31T05:18:35:124059+0000 2024-08-31T05:25:12.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:25:12.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:25:12.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: legacy client fscid: 1 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Filesystem 'cephfs' (1) 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: fs_name cephfs 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: epoch 13 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: modified 2024-08-31T05:18:33.086400+0000 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: tableserver 0 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: root 0 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: session_timeout 60 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: session_autoclose 300 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: max_file_size 1099511627776 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: max_xattr_size 65536 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: required_client_features {} 2024-08-31T05:25:12.850 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: last_failure 0 2024-08-31T05:25:12.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: last_failure_osd_epoch 0 2024-08-31T05:25:12.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:25:12.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: max_mds 1 2024-08-31T05:25:12.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: in 0 2024-08-31T05:25:12.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: up {0=14554} 2024-08-31T05:25:12.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: failed 2024-08-31T05:25:12.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: damaged 2024-08-31T05:25:12.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: stopped 2024-08-31T05:25:12.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: data_pools [3] 2024-08-31T05:25:12.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: metadata_pool 2 2024-08-31T05:25:12.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: inline_data enabled 2024-08-31T05:25:12.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: balancer 2024-08-31T05:25:12.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: bal_rank_mask -1 2024-08-31T05:25:12.852 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: standby_count_wanted 1 2024-08-31T05:25:12.852 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: qdb_cluster leader: 14554 members: 14554 2024-08-31T05:25:12.852 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: [mds.cephfs.smithi067.tskvpt{0:14554} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:12.852 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: [mds.cephfs.smithi067.beqeql{0:14566} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:12.852 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:25:12.852 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:25:12.852 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Standby daemons: 2024-08-31T05:25:12.852 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2024-08-31T05:25:12.852 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: [mds.cephfs.smithi073.kfbmeo{-1:24299} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:12.852 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: [mds.cephfs.smithi073.gsnhxi{-1:24307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6824/2383176383,v1:172.21.15.73:6825/2383176383] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:12.852 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: mon.smithi067@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-08-31T05:25:12.852 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: mon.smithi067@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-08-31T05:25:12.852 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: mon.smithi067@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-08-31T05:25:12.852 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: mon.smithi067@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-08-31T05:25:12.853 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 ceph-mon[99941]: mon.smithi067@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-08-31T05:25:12.853 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 bash[99923]: 25a28efbbd379664dba0dd56466a59918d1a2103c1aa3a2ba10ac69bbbb77e20 2024-08-31T05:25:12.853 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:12 smithi067 systemd[1]: Started Ceph mon.smithi067 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:25:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:25:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:25:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:25:14.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:25:14.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: pgmap v97: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:14.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: pgmap v98: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:14.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: mon.smithi067 calling monitor election 2024-08-31T05:25:14.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: mon.smithi067 is new leader, mons smithi067,smithi073 in quorum (ranks 0,1) 2024-08-31T05:25:14.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: monmap epoch 2 2024-08-31T05:25:14.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:25:14.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: last_changed 2024-08-31T05:14:06.043182+0000 2024-08-31T05:25:14.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: created 2024-08-31T05:11:42.194071+0000 2024-08-31T05:25:14.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: min_mon_release 19 (squid) 2024-08-31T05:25:14.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: election_strategy: 1 2024-08-31T05:25:14.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: 0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.smithi067 2024-08-31T05:25:14.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.smithi073 2024-08-31T05:25:14.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:25:14.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: osdmap e47: 6 total, 6 up, 6 in 2024-08-31T05:25:14.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: mgrmap e33: smithi067.hftacj(active, since 3m), standbys: smithi073.zfoyxd 2024-08-31T05:25:14.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-31T05:25:14.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:25:14.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:25:14.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: from='mgr.24465 ' entity='' 2024-08-31T05:25:14.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:14.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:14 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:25:14.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2024-08-31T05:25:14.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "mon metadata", "id": "smithi073"}]: dispatch 2024-08-31T05:25:14.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:25:14.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:25:14.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: pgmap v97: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:14.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: pgmap v98: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:14.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: mon.smithi067 calling monitor election 2024-08-31T05:25:14.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: mon.smithi067 is new leader, mons smithi067,smithi073 in quorum (ranks 0,1) 2024-08-31T05:25:14.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: monmap epoch 2 2024-08-31T05:25:14.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:25:14.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: last_changed 2024-08-31T05:14:06.043182+0000 2024-08-31T05:25:14.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: created 2024-08-31T05:11:42.194071+0000 2024-08-31T05:25:14.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: min_mon_release 19 (squid) 2024-08-31T05:25:14.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: election_strategy: 1 2024-08-31T05:25:14.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: 0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.smithi067 2024-08-31T05:25:14.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.smithi073 2024-08-31T05:25:14.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:25:14.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: osdmap e47: 6 total, 6 up, 6 in 2024-08-31T05:25:14.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: mgrmap e33: smithi067.hftacj(active, since 3m), standbys: smithi073.zfoyxd 2024-08-31T05:25:14.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-31T05:25:14.448 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:25:14.448 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:25:14.448 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: from='mgr.24465 ' entity='' 2024-08-31T05:25:14.448 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:14.448 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:14 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:25:17.008 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:16 smithi067 ceph-mon[99941]: pgmap v99: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:17.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:16 smithi073 ceph-mon[24726]: pgmap v99: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:19.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:18 smithi067 ceph-mon[99941]: pgmap v100: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:19.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:18 smithi073 ceph-mon[24726]: pgmap v100: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:20.290 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:19 smithi067 ceph-mon[99941]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:20.290 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:19 smithi067 ceph-mon[99941]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:20.290 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:19 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:25:20.290 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:19 smithi067 ceph-mon[99941]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:20.291 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:19 smithi067 ceph-mon[99941]: pgmap v101: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:20.291 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:19 smithi067 ceph-mon[99941]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:20.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:19 smithi073 ceph-mon[24726]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:20.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:19 smithi073 ceph-mon[24726]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:20.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:19 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-31T05:25:20.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:19 smithi073 ceph-mon[24726]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:20.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:19 smithi073 ceph-mon[24726]: pgmap v101: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:20.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:19 smithi073 ceph-mon[24726]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:22.968 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:22 smithi067 ceph-mon[99941]: pgmap v102: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:22.968 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:22 smithi067 ceph-mon[99941]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:22.968 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:22 smithi067 ceph-mon[99941]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:22.968 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:22 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:25:22.968 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:22 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:25:23.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:22 smithi073 ceph-mon[24726]: pgmap v102: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:23.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:22 smithi073 ceph-mon[24726]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:23.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:22 smithi073 ceph-mon[24726]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:23.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:22 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:25:23.190 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:22 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:25:23.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:23 smithi073 ceph-mon[24726]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:23.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:23 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:25:23.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:23 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:25:23.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:23 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-31T05:25:24.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:23 smithi067 ceph-mon[99941]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:24.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:23 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:25:24.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:23 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "versions"}]: dispatch 2024-08-31T05:25:24.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:23 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-31T05:25:24.807 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:24 smithi073 ceph-mon[24726]: pgmap v103: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:24.807 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:24 smithi073 ceph-mon[24726]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:24.807 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:24 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T05:25:24.807 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:24 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T05:25:24.807 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:24 smithi073 ceph-mon[24726]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:25:25.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:24 smithi067 ceph-mon[99941]: pgmap v103: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:25.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:24 smithi067 ceph-mon[99941]: from='mgr.24465 ' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:25.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:24 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T05:25:25.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:24 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T05:25:25.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:24 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:25:25.792 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:25 smithi073 ceph-mon[24726]: Upgrade: Updating mon.smithi073 2024-08-31T05:25:25.792 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:25 smithi073 ceph-mon[24726]: Deploying daemon mon.smithi073 on smithi073 2024-08-31T05:25:26.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:25 smithi067 ceph-mon[99941]: Upgrade: Updating mon.smithi073 2024-08-31T05:25:26.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:25 smithi067 ceph-mon[99941]: Deploying daemon mon.smithi073 on smithi073 2024-08-31T05:25:26.083 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:25 smithi073 systemd[1]: Stopping Ceph mon.smithi073 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:25:26.416 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:26 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073[24710]: 2024-08-31T05:25:26.080+0000 7f7867d44640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi073 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:25:26.416 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:26 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073[24710]: 2024-08-31T05:25:26.080+0000 7f7867d44640 -1 mon.smithi073@1(peon) e2 *** Got Signal Terminated *** 2024-08-31T05:25:26.416 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:26 smithi073 podman[71293]: 2024-08-31 05:25:26.153258309 +0000 UTC m=+0.218202066 container died 30ccf0ed274b17bc6e7b42d1a48fb0ade077ff0e9156cfc5a5698e9f20bdf2df (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-244a32d, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-31T05:25:26.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:26 smithi073 podman[71293]: 2024-08-31 05:25:26.514593138 +0000 UTC m=+0.579536894 container cleanup 30ccf0ed274b17bc6e7b42d1a48fb0ade077ff0e9156cfc5a5698e9f20bdf2df (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-244a32d, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-08-31T05:25:26.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:26 smithi073 bash[71293]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073 2024-08-31T05:25:27.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:26 smithi073 podman[71305]: 2024-08-31 05:25:26.816257965 +0000 UTC m=+0.657548632 container remove 30ccf0ed274b17bc6e7b42d1a48fb0ade077ff0e9156cfc5a5698e9f20bdf2df (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073, RELEASE=squid-244a32d, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-31T05:25:27.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:26 smithi073 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi073.service: Deactivated successfully. 2024-08-31T05:25:27.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:26 smithi073 systemd[1]: Stopped Ceph mon.smithi073 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:25:27.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:26 smithi073 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi073.service: Consumed 6.983s CPU time. 2024-08-31T05:25:27.535 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 systemd[1]: Starting Ceph mon.smithi073 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:25:27.535 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 podman[71434]: 2024-08-31 05:25:27.313404609 +0000 UTC m=+0.015752671 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:25:27.535 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 podman[71434]: 2024-08-31 05:25:27.425591256 +0000 UTC m=+0.127939350 container create 6be0f099986016cd654ee813dc12e1f9bc86197146a5699df1196bdac80d3cd0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-08-31T05:25:27.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 podman[71434]: 2024-08-31 05:25:27.678341726 +0000 UTC m=+0.380689786 container init 6be0f099986016cd654ee813dc12e1f9bc86197146a5699df1196bdac80d3cd0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-31T05:25:27.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 podman[71434]: 2024-08-31 05:25:27.681658534 +0000 UTC m=+0.384006584 container start 6be0f099986016cd654ee813dc12e1f9bc86197146a5699df1196bdac80d3cd0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:25:27.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T05:25:27.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-31T05:25:27.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: pidfile_write: ignore empty --pid-file 2024-08-31T05:25:27.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: load: jerasure load: lrc 2024-08-31T05:25:27.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: RocksDB version: 7.9.2 2024-08-31T05:25:27.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Git sha 0 2024-08-31T05:25:27.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T05:25:27.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: DB SUMMARY 2024-08-31T05:25:27.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: DB Session ID: KML9JUNNYMU7CXJ7F5WW 2024-08-31T05:25:27.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: CURRENT file: CURRENT 2024-08-31T05:25:27.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T05:25:27.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1412 Bytes 2024-08-31T05:25:27.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi073/store.db dir, Total Num: 1, files: 000027.sst 2024-08-31T05:25:27.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi073/store.db: 000025.log size: 3747250 ; 2024-08-31T05:25:27.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.error_if_exists: 0 2024-08-31T05:25:27.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.create_if_missing: 0 2024-08-31T05:25:27.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.paranoid_checks: 1 2024-08-31T05:25:27.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T05:25:27.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T05:25:27.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T05:25:27.949 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.env: 0x562256f675a0 2024-08-31T05:25:27.949 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T05:25:27.949 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.info_log: 0x56225ce9b6e0 2024-08-31T05:25:27.949 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T05:25:27.950 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.statistics: (nil) 2024-08-31T05:25:27.950 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.use_fsync: 0 2024-08-31T05:25:27.950 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_log_file_size: 0 2024-08-31T05:25:27.950 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T05:25:27.951 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T05:25:27.951 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T05:25:27.951 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T05:25:27.951 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.allow_fallocate: 1 2024-08-31T05:25:27.951 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T05:25:27.951 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T05:25:27.951 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.use_direct_reads: 0 2024-08-31T05:25:27.951 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T05:25:27.951 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T05:25:27.951 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.db_log_dir: 2024-08-31T05:25:27.951 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.wal_dir: 2024-08-31T05:25:27.951 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T05:25:27.951 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T05:25:27.952 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T05:25:27.952 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T05:25:27.952 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T05:25:27.952 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T05:25:27.952 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T05:25:27.952 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T05:25:27.952 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.write_buffer_manager: 0x56225ce9f5e0 2024-08-31T05:25:27.952 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T05:25:27.952 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T05:25:27.952 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T05:25:27.952 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T05:25:27.952 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T05:25:27.952 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T05:25:27.952 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.unordered_write: 0 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.row_cache: None 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.wal_filter: None 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.two_write_queues: 0 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.wal_compression: 0 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.atomic_flush: 0 2024-08-31T05:25:27.953 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.log_readahead_size: 0 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_background_jobs: 2 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_background_compactions: -1 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_subcompactions: 1 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T05:25:27.954 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_open_files: -1 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_background_flushes: -1 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Compression algorithms supported: 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: kZSTD supported: 0 2024-08-31T05:25:27.955 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: kXpressCompression supported: 0 2024-08-31T05:25:27.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: kBZip2Compression supported: 0 2024-08-31T05:25:27.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T05:25:27.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: kLZ4Compression supported: 1 2024-08-31T05:25:27.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: kZlibCompression supported: 1 2024-08-31T05:25:27.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T05:25:27.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: kSnappyCompression supported: 1 2024-08-31T05:25:27.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T05:25:27.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T05:25:27.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi073/store.db/MANIFEST-000010 2024-08-31T05:25:27.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T05:25:27.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T05:25:27.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.merge_operator: 2024-08-31T05:25:27.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compaction_filter: None 2024-08-31T05:25:27.956 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56225ce9b300) 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: cache_index_and_filter_blocks: 1 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: pin_top_level_index_and_filter: 1 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_type: 0 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: data_block_index_type: 0 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_shortening: 1 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: checksum: 4 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: no_block_cache: 0 2024-08-31T05:25:27.957 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache: 0x562258e5e850 2024-08-31T05:25:27.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_name: BinnedLRUCache 2024-08-31T05:25:27.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_options: 2024-08-31T05:25:27.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: capacity : 536870912 2024-08-31T05:25:27.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: num_shard_bits : 4 2024-08-31T05:25:27.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: strict_capacity_limit : 0 2024-08-31T05:25:27.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: high_pri_pool_ratio: 0.000 2024-08-31T05:25:27.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_cache_compressed: (nil) 2024-08-31T05:25:27.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: persistent_cache: (nil) 2024-08-31T05:25:27.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_size: 4096 2024-08-31T05:25:27.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_size_deviation: 10 2024-08-31T05:25:27.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_restart_interval: 16 2024-08-31T05:25:27.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: index_block_restart_interval: 1 2024-08-31T05:25:27.958 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: metadata_block_size: 4096 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: partition_filters: 0 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: use_delta_encoding: 1 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: filter_policy: bloomfilter 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: whole_key_filtering: 1 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: verify_compression: 0 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: read_amp_bytes_per_bit: 0 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: format_version: 5 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: enable_index_compression: 1 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: block_align: 0 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: max_auto_readahead_size: 262144 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: prepopulate_block_cache: 0 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: initial_auto_readahead_size: 8192 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T05:25:27.959 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compression: NoCompression 2024-08-31T05:25:27.960 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T05:25:27.960 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T05:25:27.960 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T05:25:27.960 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.num_levels: 7 2024-08-31T05:25:27.960 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T05:25:27.960 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T05:25:27.960 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T05:25:27.960 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T05:25:27.960 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T05:25:27.960 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T05:25:27.960 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T05:25:27.960 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:25:27.960 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T05:25:27.960 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T05:25:27.961 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:25:27.961 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:25:27.961 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T05:25:27.961 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T05:25:27.961 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T05:25:27.961 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T05:25:27.961 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:25:27.961 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:25:27.961 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T05:25:27.961 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T05:25:27.961 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:25:27.961 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T05:25:27.961 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T05:25:27.961 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T05:25:27.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T05:25:27.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T05:25:27.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T05:25:27.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T05:25:27.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T05:25:27.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T05:25:27.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T05:25:27.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T05:25:27.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T05:25:27.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T05:25:27.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T05:25:27.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T05:25:27.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T05:25:27.962 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T05:25:27.963 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.inplace_update_support: 0 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.bloom_locality: 0 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.max_successive_merges: 0 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.ttl: 2592000 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T05:25:27.964 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T05:25:27.965 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T05:25:27.965 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.enable_blob_files: false 2024-08-31T05:25:27.965 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.min_blob_size: 0 2024-08-31T05:25:27.965 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T05:25:27.965 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T05:25:27.965 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T05:25:27.965 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T05:25:27.965 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T05:25:27.965 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T05:25:27.965 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T05:25:27.965 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T05:25:27.965 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-31T05:25:27.965 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi073/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12223, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-08-31T05:25:27.966 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-08-31T05:25:27.966 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7db73db2-2f92-47fb-8b99-c1878f275414 2024-08-31T05:25:27.966 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081927718483, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-08-31T05:25:27.966 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-08-31T05:25:27.966 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081927729453, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2183451, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12228, "largest_seqno": 14236, "table_properties": {"data_size": 2175001, "index_size": 5356, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2053, "raw_key_size": 18860, "raw_average_key_size": 23, "raw_value_size": 2157737, "raw_average_value_size": 2680, "num_data_blocks": 245, "num_entries": 805, "num_filter_entries": 805, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725081927, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7db73db2-2f92-47fb-8b99-c1878f275414", "db_session_id": "KML9JUNNYMU7CXJ7F5WW", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-08-31T05:25:27.966 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081927729590, "job": 1, "event": "recovery_finished"} 2024-08-31T05:25:27.966 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-08-31T05:25:27.966 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-31T05:25:27.966 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi073/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T05:25:27.966 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56225cebea80 2024-08-31T05:25:27.966 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: DB pointer 0x56225dc60000 2024-08-31T05:25:27.966 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T05:25:27.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T05:25:27.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** DB Stats ** 2024-08-31T05:25:27.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:25:27.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T05:25:27.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:25:27.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:25:27.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T05:25:27.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:25:27.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:25:27.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:25:27.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** Compaction Stats [default] ** 2024-08-31T05:25:27.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:25:27.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T05:25:27.967 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: L0 1/0 2.08 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 553.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-08-31T05:25:27.968 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: L6 1/0 7.24 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-08-31T05:25:27.968 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Sum 2/0 9.32 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 553.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-08-31T05:25:27.968 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 553.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-08-31T05:25:27.968 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:25:27.968 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** Compaction Stats [default] ** 2024-08-31T05:25:27.968 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:25:27.968 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T05:25:27.968 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 553.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-08-31T05:25:27.968 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:25:27.968 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T05:25:27.968 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:25:27.968 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:25:27.968 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-08-31T05:25:27.968 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T05:25:27.969 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T05:25:27.969 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T05:25:27.969 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T05:25:27.969 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Cumulative compaction: 0.00 GB write, 146.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:25:27.969 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Interval compaction: 0.00 GB write, 146.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:25:27.969 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T05:25:27.969 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Block cache BinnedLRUCache@0x562258e5e850#2 capacity: 512.00 MB usage: 8.37 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-08-31T05:25:27.969 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.29 KB,0.000436604%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-08-31T05:25:27.969 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:25:27.969 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T05:25:27.969 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: starting mon.smithi073 rank 1 at public addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] at bind addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi073 fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:25:27.969 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: mon.smithi073@-1(???) e2 preinit fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:25:27.969 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: mon.smithi073@-1(???).mds e15 new map 2024-08-31T05:25:27.969 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: mon.smithi073@-1(???).mds e15 print_map 2024-08-31T05:25:27.970 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: e15 2024-08-31T05:25:27.970 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: btime 2024-08-31T05:18:35:124059+0000 2024-08-31T05:25:27.970 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:25:27.970 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:25:27.970 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: legacy client fscid: 1 2024-08-31T05:25:27.970 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:25:27.970 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Filesystem 'cephfs' (1) 2024-08-31T05:25:27.970 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: fs_name cephfs 2024-08-31T05:25:27.970 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: epoch 13 2024-08-31T05:25:27.970 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T05:25:27.970 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:25:27.970 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: modified 2024-08-31T05:18:33.086400+0000 2024-08-31T05:25:27.970 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: tableserver 0 2024-08-31T05:25:27.970 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: root 0 2024-08-31T05:25:27.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: session_timeout 60 2024-08-31T05:25:27.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: session_autoclose 300 2024-08-31T05:25:27.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: max_file_size 1099511627776 2024-08-31T05:25:27.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: max_xattr_size 65536 2024-08-31T05:25:27.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: required_client_features {} 2024-08-31T05:25:27.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: last_failure 0 2024-08-31T05:25:27.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: last_failure_osd_epoch 0 2024-08-31T05:25:27.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:25:27.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: max_mds 1 2024-08-31T05:25:27.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: in 0 2024-08-31T05:25:27.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: up {0=14554} 2024-08-31T05:25:27.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: failed 2024-08-31T05:25:27.971 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: damaged 2024-08-31T05:25:27.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: stopped 2024-08-31T05:25:27.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: data_pools [3] 2024-08-31T05:25:27.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: metadata_pool 2 2024-08-31T05:25:27.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: inline_data enabled 2024-08-31T05:25:27.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: balancer 2024-08-31T05:25:27.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: bal_rank_mask -1 2024-08-31T05:25:27.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: standby_count_wanted 1 2024-08-31T05:25:27.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: qdb_cluster leader: 14554 members: 14554 2024-08-31T05:25:27.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: [mds.cephfs.smithi067.tskvpt{0:14554} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:27.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: [mds.cephfs.smithi067.beqeql{0:14566} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:27.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:25:27.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:25:27.972 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: Standby daemons: 2024-08-31T05:25:27.973 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: 2024-08-31T05:25:27.973 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: [mds.cephfs.smithi073.kfbmeo{-1:24299} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:27.973 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout: [mds.cephfs.smithi073.gsnhxi{-1:24307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6824/2383176383,v1:172.21.15.73:6825/2383176383] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:27.973 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: mon.smithi073@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-08-31T05:25:27.973 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: mon.smithi073@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-08-31T05:25:27.973 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: mon.smithi073@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-08-31T05:25:27.973 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: mon.smithi073@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-08-31T05:25:27.973 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 ceph-mon[71452]: mon.smithi073@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-08-31T05:25:27.973 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 bash[71434]: 6be0f099986016cd654ee813dc12e1f9bc86197146a5699df1196bdac80d3cd0 2024-08-31T05:25:27.973 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:27 smithi073 systemd[1]: Started Ceph mon.smithi073 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:25:28.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:28 smithi067 ceph-mon[99941]: pgmap v104: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:28.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:28 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mon metadata", "id": "smithi067"} : dispatch 2024-08-31T05:25:28.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:28 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-08-31T05:25:28.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:28 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-08-31T05:25:28.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:28 smithi073 ceph-mon[71452]: pgmap v104: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:28.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:28 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mon metadata", "id": "smithi067"} : dispatch 2024-08-31T05:25:28.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:28 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mon metadata", "id": "smithi073"} : dispatch 2024-08-31T05:25:28.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:28 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-08-31T05:25:29.436 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:25:29.436 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: pgmap v105: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:29.436 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: mon.smithi073 calling monitor election 2024-08-31T05:25:29.437 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: mon.smithi067 calling monitor election 2024-08-31T05:25:29.437 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: mon.smithi067 is new leader, mons smithi067,smithi073 in quorum (ranks 0,1) 2024-08-31T05:25:29.437 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: monmap epoch 2 2024-08-31T05:25:29.437 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:25:29.437 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: last_changed 2024-08-31T05:14:06.043182+0000 2024-08-31T05:25:29.437 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: created 2024-08-31T05:11:42.194071+0000 2024-08-31T05:25:29.437 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: min_mon_release 19 (squid) 2024-08-31T05:25:29.437 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: election_strategy: 1 2024-08-31T05:25:29.437 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: 0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.smithi067 2024-08-31T05:25:29.437 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.smithi073 2024-08-31T05:25:29.437 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:25:29.437 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: osdmap e47: 6 total, 6 up, 6 in 2024-08-31T05:25:29.437 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: mgrmap e33: smithi067.hftacj(active, since 3m), standbys: smithi073.zfoyxd 2024-08-31T05:25:29.437 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-31T05:25:29.438 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:25:29.438 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:25:29.438 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:29.438 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:29.438 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:29 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:29.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-08-31T05:25:29.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: pgmap v105: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:29.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: mon.smithi073 calling monitor election 2024-08-31T05:25:29.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: mon.smithi067 calling monitor election 2024-08-31T05:25:29.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: mon.smithi067 is new leader, mons smithi067,smithi073 in quorum (ranks 0,1) 2024-08-31T05:25:29.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: monmap epoch 2 2024-08-31T05:25:29.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: fsid 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:25:29.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: last_changed 2024-08-31T05:14:06.043182+0000 2024-08-31T05:25:29.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: created 2024-08-31T05:11:42.194071+0000 2024-08-31T05:25:29.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: min_mon_release 19 (squid) 2024-08-31T05:25:29.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: election_strategy: 1 2024-08-31T05:25:29.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: 0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.smithi067 2024-08-31T05:25:29.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.smithi073 2024-08-31T05:25:29.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:25:29.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: osdmap e47: 6 total, 6 up, 6 in 2024-08-31T05:25:29.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: mgrmap e33: smithi067.hftacj(active, since 3m), standbys: smithi073.zfoyxd 2024-08-31T05:25:29.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-31T05:25:29.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:25:29.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:25:29.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:29.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:29.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:29 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:30.356 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:30 smithi073 ceph-mon[71452]: pgmap v106: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:30.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:30 smithi067 ceph-mon[99941]: pgmap v106: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:32.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:31 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:32.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:31 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:32.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:31 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:32.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:31 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:32.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:31 smithi067 ceph-mon[99941]: pgmap v107: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:32.171 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:31 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:32.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:31 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:32.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:31 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:32.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:31 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:32.172 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:31 smithi073 ceph-mon[71452]: pgmap v107: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:34.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:34 smithi073 ceph-mon[71452]: pgmap v108: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:34.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:25:34.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:34.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:34.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:34.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:34.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:35.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:34 smithi067 ceph-mon[99941]: pgmap v108: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:25:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:35.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:35.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:25:35.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:25:35.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:35.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi067"} : dispatch 2024-08-31T05:25:35.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi067"}]': finished 2024-08-31T05:25:35.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi073"} : dispatch 2024-08-31T05:25:35.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi073"}]': finished 2024-08-31T05:25:36.128 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:36.129 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:25:36.129 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:25:36.129 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:36.129 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi067"} : dispatch 2024-08-31T05:25:36.129 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi067"}]': finished 2024-08-31T05:25:36.129 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi073"} : dispatch 2024-08-31T05:25:36.129 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi073"}]': finished 2024-08-31T05:25:36.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:36 smithi067 ceph-mon[99941]: Upgrade: Setting container_image for all mon 2024-08-31T05:25:36.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:36 smithi067 ceph-mon[99941]: pgmap v109: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:36.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:36 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:36.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:36 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-08-31T05:25:36.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:36 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:36 smithi073 ceph-mon[71452]: Upgrade: Setting container_image for all mon 2024-08-31T05:25:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:36 smithi073 ceph-mon[71452]: pgmap v109: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:36 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:36 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-08-31T05:25:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:36 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:37.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:37 smithi067 ceph-mon[99941]: Upgrade: Updating crash.smithi067 (1/2) 2024-08-31T05:25:37.845 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:37 smithi067 ceph-mon[99941]: Deploying daemon crash.smithi067 on smithi067 2024-08-31T05:25:38.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:37 smithi073 ceph-mon[71452]: Upgrade: Updating crash.smithi067 (1/2) 2024-08-31T05:25:38.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:37 smithi073 ceph-mon[71452]: Deploying daemon crash.smithi067 on smithi067 2024-08-31T05:25:38.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.675+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/487425590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d04103180 msgr2=0x7f4d0410b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:38.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.675+0000 7f4d0b7d5640 1 --2- 172.21.15.67:0/487425590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d04103180 0x7f4d0410b670 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4009880 tx=0x7f4cf402a530 comp rx=0 tx=0).stop 2024-08-31T05:25:38.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.675+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/487425590 shutdown_connections 2024-08-31T05:25:38.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.675+0000 7f4d0b7d5640 1 --2- 172.21.15.67:0/487425590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d04103180 0x7f4d0410b670 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:38.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.675+0000 7f4d0b7d5640 1 --2- 172.21.15.67:0/487425590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d04102860 0x7f4d04102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:38.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.675+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/487425590 >> 172.21.15.67:0/487425590 conn(0x7f4d040fc2c0 msgr2=0x7f4d040fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:38.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.675+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/487425590 shutdown_connections 2024-08-31T05:25:38.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.675+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/487425590 wait complete. 2024-08-31T05:25:38.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.675+0000 7f4d0b7d5640 1 Processor -- start 2024-08-31T05:25:38.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.675+0000 7f4d0b7d5640 1 -- start start 2024-08-31T05:25:38.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.676+0000 7f4d0b7d5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d04102860 0x7f4d0419f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:38.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.676+0000 7f4d0b7d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d04103180 0x7f4d0419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:38.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.676+0000 7f4d0b7d5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0410eb90 con 0x7f4d04102860 2024-08-31T05:25:38.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.676+0000 7f4d0b7d5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0410ea10 con 0x7f4d04103180 2024-08-31T05:25:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.676+0000 7f4d09571640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d04102860 0x7f4d0419f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.676+0000 7f4d09571640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d04102860 0x7f4d0419f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60242/0 (socket says 172.21.15.67:60242) 2024-08-31T05:25:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.676+0000 7f4d09571640 1 -- 172.21.15.67:0/381406558 learned_addr learned my addr 172.21.15.67:0/381406558 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.676+0000 7f4d08d70640 1 --2- 172.21.15.67:0/381406558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d04103180 0x7f4d0419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.676+0000 7f4d09571640 1 -- 172.21.15.67:0/381406558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d04103180 msgr2=0x7f4d0419fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.676+0000 7f4d09571640 1 --2- 172.21.15.67:0/381406558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d04103180 0x7f4d0419fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.676+0000 7f4d09571640 1 -- 172.21.15.67:0/381406558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d041997a0 con 0x7f4d04102860 2024-08-31T05:25:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.676+0000 7f4d09571640 1 --2- 172.21.15.67:0/381406558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d04102860 0x7f4d0419f620 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000c8f0 tx=0x7f4d0000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.677+0000 7f4cfa7fc640 1 -- 172.21.15.67:0/381406558 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d000079b0 con 0x7f4d04102860 2024-08-31T05:25:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.677+0000 7f4cfa7fc640 1 -- 172.21.15.67:0/381406558 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4d000054e0 con 0x7f4d04102860 2024-08-31T05:25:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.677+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/381406558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d04199a90 con 0x7f4d04102860 2024-08-31T05:25:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.677+0000 7f4cfa7fc640 1 -- 172.21.15.67:0/381406558 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d00004dd0 con 0x7f4d04102860 2024-08-31T05:25:38.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.677+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/381406558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d04199ff0 con 0x7f4d04102860 2024-08-31T05:25:38.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.678+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/381406558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0406a830 con 0x7f4d04102860 2024-08-31T05:25:38.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.678+0000 7f4cfa7fc640 1 -- 172.21.15.67:0/381406558 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f4d00005020 con 0x7f4d04102860 2024-08-31T05:25:38.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.679+0000 7f4cfa7fc640 1 --2- 172.21.15.67:0/381406558 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4cf0079da0 0x7f4cf007c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:38.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.679+0000 7f4d08d70640 1 --2- 172.21.15.67:0/381406558 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4cf0079da0 0x7f4cf007c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:38.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.679+0000 7f4cfa7fc640 1 -- 172.21.15.67:0/381406558 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f4d0009c8d0 con 0x7f4d04102860 2024-08-31T05:25:38.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.679+0000 7f4d08d70640 1 --2- 172.21.15.67:0/381406558 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4cf0079da0 0x7f4cf007c260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4d0419aaf0 tx=0x7f4cf4031420 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:38.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.684+0000 7f4cfa7fc640 1 -- 172.21.15.67:0/381406558 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4d00014030 con 0x7f4d04102860 2024-08-31T05:25:38.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:38 smithi067 ceph-mon[99941]: pgmap v110: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:38.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.891+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/381406558 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4d0419a300 con 0x7f4cf0079da0 2024-08-31T05:25:38.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.892+0000 7f4cfa7fc640 1 -- 172.21.15.67:0/381406558 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f4d0419a300 con 0x7f4cf0079da0 2024-08-31T05:25:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.894+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/381406558 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4cf0079da0 msgr2=0x7f4cf007c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.894+0000 7f4d0b7d5640 1 --2- 172.21.15.67:0/381406558 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4cf0079da0 0x7f4cf007c260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4d0419aaf0 tx=0x7f4cf4031420 comp rx=0 tx=0).stop 2024-08-31T05:25:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.894+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/381406558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d04102860 msgr2=0x7f4d0419f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.894+0000 7f4d0b7d5640 1 --2- 172.21.15.67:0/381406558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d04102860 0x7f4d0419f620 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000c8f0 tx=0x7f4d0000cdb0 comp rx=0 tx=0).stop 2024-08-31T05:25:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.894+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/381406558 shutdown_connections 2024-08-31T05:25:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.894+0000 7f4d0b7d5640 1 --2- 172.21.15.67:0/381406558 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4cf0079da0 0x7f4cf007c260 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:38.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.894+0000 7f4d0b7d5640 1 --2- 172.21.15.67:0/381406558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d04103180 0x7f4d0419fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:38.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.894+0000 7f4d0b7d5640 1 --2- 172.21.15.67:0/381406558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d04102860 0x7f4d0419f620 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:38.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.894+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/381406558 >> 172.21.15.67:0/381406558 conn(0x7f4d040fc2c0 msgr2=0x7f4d04100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:38.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.894+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/381406558 shutdown_connections 2024-08-31T05:25:38.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.894+0000 7f4d0b7d5640 1 -- 172.21.15.67:0/381406558 wait complete. 2024-08-31T05:25:38.905 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:25:38.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.981+0000 7f3ccab05640 1 -- 172.21.15.67:0/1104825705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cc41005b0 msgr2=0x7f3cc4100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:38.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.981+0000 7f3ccab05640 1 --2- 172.21.15.67:0/1104825705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cc41005b0 0x7f3cc4100a10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009880 tx=0x7f3cb002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:25:38.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.981+0000 7f3ccab05640 1 -- 172.21.15.67:0/1104825705 shutdown_connections 2024-08-31T05:25:38.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.981+0000 7f3ccab05640 1 --2- 172.21.15.67:0/1104825705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cc41005b0 0x7f3cc4100a10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:38.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.981+0000 7f3ccab05640 1 --2- 172.21.15.67:0/1104825705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cc4106660 0x7f3cc4106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:38.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.981+0000 7f3ccab05640 1 -- 172.21.15.67:0/1104825705 >> 172.21.15.67:0/1104825705 conn(0x7f3cc40fc2f0 msgr2=0x7f3cc40fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:38.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.981+0000 7f3ccab05640 1 -- 172.21.15.67:0/1104825705 shutdown_connections 2024-08-31T05:25:38.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.981+0000 7f3ccab05640 1 -- 172.21.15.67:0/1104825705 wait complete. 2024-08-31T05:25:38.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.982+0000 7f3ccab05640 1 Processor -- start 2024-08-31T05:25:38.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.982+0000 7f3ccab05640 1 -- start start 2024-08-31T05:25:38.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.982+0000 7f3ccab05640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cc41005b0 0x7f3cc4102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:38.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.982+0000 7f3ccab05640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cc4106660 0x7f3cc4102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:38.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.982+0000 7f3ccab05640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc410da70 con 0x7f3cc41005b0 2024-08-31T05:25:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.982+0000 7f3ccab05640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc410d8f0 con 0x7f3cc4106660 2024-08-31T05:25:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.982+0000 7f3cc88a1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cc41005b0 0x7f3cc4102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.982+0000 7f3cc88a1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cc41005b0 0x7f3cc4102220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60264/0 (socket says 172.21.15.67:60264) 2024-08-31T05:25:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.982+0000 7f3cc88a1640 1 -- 172.21.15.67:0/611322214 learned_addr learned my addr 172.21.15.67:0/611322214 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.982+0000 7f3cc88a1640 1 -- 172.21.15.67:0/611322214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cc4106660 msgr2=0x7f3cc4102760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.982+0000 7f3cc3fff640 1 --2- 172.21.15.67:0/611322214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cc4106660 0x7f3cc4102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.982+0000 7f3cc88a1640 1 --2- 172.21.15.67:0/611322214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cc4106660 0x7f3cc4102760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.983+0000 7f3cc88a1640 1 -- 172.21.15.67:0/611322214 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc4102ca0 con 0x7f3cc41005b0 2024-08-31T05:25:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.983+0000 7f3cc88a1640 1 --2- 172.21.15.67:0/611322214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cc41005b0 0x7f3cc4102220 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800d6f0 tx=0x7f3cb800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.983+0000 7f3cc1ffb640 1 -- 172.21.15.67:0/611322214 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cb8017070 con 0x7f3cc41005b0 2024-08-31T05:25:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.983+0000 7f3cc1ffb640 1 -- 172.21.15.67:0/611322214 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3cb800de00 con 0x7f3cc41005b0 2024-08-31T05:25:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.983+0000 7f3ccab05640 1 -- 172.21.15.67:0/611322214 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc4102f90 con 0x7f3cc41005b0 2024-08-31T05:25:38.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.983+0000 7f3cc1ffb640 1 -- 172.21.15.67:0/611322214 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cb8004bb0 con 0x7f3cc41005b0 2024-08-31T05:25:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.983+0000 7f3ccab05640 1 -- 172.21.15.67:0/611322214 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc41a3bd0 con 0x7f3cc41005b0 2024-08-31T05:25:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.984+0000 7f3ccab05640 1 -- 172.21.15.67:0/611322214 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc4101cd0 con 0x7f3cc41005b0 2024-08-31T05:25:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.985+0000 7f3cc1ffb640 1 -- 172.21.15.67:0/611322214 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f3cb8009a30 con 0x7f3cc41005b0 2024-08-31T05:25:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.985+0000 7f3cc1ffb640 1 --2- 172.21.15.67:0/611322214 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3cb4079e40 0x7f3cb407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:38.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.986+0000 7f3cc1ffb640 1 -- 172.21.15.67:0/611322214 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f3cb809c430 con 0x7f3cc41005b0 2024-08-31T05:25:38.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.986+0000 7f3cc3fff640 1 --2- 172.21.15.67:0/611322214 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3cb4079e40 0x7f3cb407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:38.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.986+0000 7f3cc3fff640 1 --2- 172.21.15.67:0/611322214 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3cb4079e40 0x7f3cb407c300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0004f90 tx=0x7f3cb0009560 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:38.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:38.990+0000 7f3cc1ffb640 1 -- 172.21.15.67:0/611322214 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3cb8064020 con 0x7f3cc41005b0 2024-08-31T05:25:39.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:38 smithi073 ceph-mon[71452]: pgmap v110: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.226+0000 7f3ccab05640 1 -- 172.21.15.67:0/611322214 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3cc406a250 con 0x7f3cb4079e40 2024-08-31T05:25:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.227+0000 7f3cc1ffb640 1 -- 172.21.15.67:0/611322214 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f3cc406a250 con 0x7f3cb4079e40 2024-08-31T05:25:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.230+0000 7f3ccab05640 1 -- 172.21.15.67:0/611322214 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3cb4079e40 msgr2=0x7f3cb407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.230+0000 7f3ccab05640 1 --2- 172.21.15.67:0/611322214 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3cb4079e40 0x7f3cb407c300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0004f90 tx=0x7f3cb0009560 comp rx=0 tx=0).stop 2024-08-31T05:25:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.230+0000 7f3ccab05640 1 -- 172.21.15.67:0/611322214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cc41005b0 msgr2=0x7f3cc4102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.230+0000 7f3ccab05640 1 --2- 172.21.15.67:0/611322214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cc41005b0 0x7f3cc4102220 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800d6f0 tx=0x7f3cb800dbb0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.230+0000 7f3ccab05640 1 -- 172.21.15.67:0/611322214 shutdown_connections 2024-08-31T05:25:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.230+0000 7f3ccab05640 1 --2- 172.21.15.67:0/611322214 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3cb4079e40 0x7f3cb407c300 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.230+0000 7f3ccab05640 1 --2- 172.21.15.67:0/611322214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cc4106660 0x7f3cc4102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.230+0000 7f3ccab05640 1 --2- 172.21.15.67:0/611322214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cc41005b0 0x7f3cc4102220 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.230+0000 7f3ccab05640 1 -- 172.21.15.67:0/611322214 >> 172.21.15.67:0/611322214 conn(0x7f3cc40fc2f0 msgr2=0x7f3cc4069b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.230+0000 7f3ccab05640 1 -- 172.21.15.67:0/611322214 shutdown_connections 2024-08-31T05:25:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.230+0000 7f3ccab05640 1 -- 172.21.15.67:0/611322214 wait complete. 2024-08-31T05:25:39.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.319+0000 7f2f0dfba640 1 -- 172.21.15.67:0/3755634721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f081005b0 msgr2=0x7f2f08100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:39.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.319+0000 7f2f0dfba640 1 --2- 172.21.15.67:0/3755634721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f081005b0 0x7f2f08100a10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009880 tx=0x7f2ef002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.319+0000 7f2f0dfba640 1 -- 172.21.15.67:0/3755634721 shutdown_connections 2024-08-31T05:25:39.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.319+0000 7f2f0dfba640 1 --2- 172.21.15.67:0/3755634721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f081005b0 0x7f2f08100a10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.319+0000 7f2f0dfba640 1 --2- 172.21.15.67:0/3755634721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f08106660 0x7f2f08106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.319+0000 7f2f0dfba640 1 -- 172.21.15.67:0/3755634721 >> 172.21.15.67:0/3755634721 conn(0x7f2f080fc2f0 msgr2=0x7f2f080fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:39.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.319+0000 7f2f0dfba640 1 -- 172.21.15.67:0/3755634721 shutdown_connections 2024-08-31T05:25:39.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.319+0000 7f2f0dfba640 1 -- 172.21.15.67:0/3755634721 wait complete. 2024-08-31T05:25:39.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.319+0000 7f2f0dfba640 1 Processor -- start 2024-08-31T05:25:39.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.319+0000 7f2f0dfba640 1 -- start start 2024-08-31T05:25:39.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.320+0000 7f2f0dfba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f081005b0 0x7f2f08197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:39.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.320+0000 7f2f0dfba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f08106660 0x7f2f08197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:39.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.320+0000 7f2f0dfba640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0810da50 con 0x7f2f08106660 2024-08-31T05:25:39.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.320+0000 7f2f0dfba640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0810d8d0 con 0x7f2f081005b0 2024-08-31T05:25:39.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.320+0000 7f2efeffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f08106660 0x7f2f08197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:39.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.320+0000 7f2efeffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f08106660 0x7f2f08197bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60284/0 (socket says 172.21.15.67:60284) 2024-08-31T05:25:39.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.320+0000 7f2efeffd640 1 -- 172.21.15.67:0/303316513 learned_addr learned my addr 172.21.15.67:0/303316513 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:39.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.320+0000 7f2f077fe640 1 --2- 172.21.15.67:0/303316513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f081005b0 0x7f2f08197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:39.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.320+0000 7f2efeffd640 1 -- 172.21.15.67:0/303316513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f081005b0 msgr2=0x7f2f08197690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:39.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.320+0000 7f2efeffd640 1 --2- 172.21.15.67:0/303316513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f081005b0 0x7f2f08197690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.320+0000 7f2efeffd640 1 -- 172.21.15.67:0/303316513 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0819bf60 con 0x7f2f08106660 2024-08-31T05:25:39.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.321+0000 7f2efeffd640 1 --2- 172.21.15.67:0/303316513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f08106660 0x7f2f08197bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0004f90 tx=0x7f2ef00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:39.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.321+0000 7f2f057fa640 1 -- 172.21.15.67:0/303316513 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ef003f070 con 0x7f2f08106660 2024-08-31T05:25:39.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.321+0000 7f2f0dfba640 1 -- 172.21.15.67:0/303316513 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0819c1f0 con 0x7f2f08106660 2024-08-31T05:25:39.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.321+0000 7f2f057fa640 1 -- 172.21.15.67:0/303316513 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ef0004c70 con 0x7f2f08106660 2024-08-31T05:25:39.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.321+0000 7f2f057fa640 1 -- 172.21.15.67:0/303316513 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ef0035030 con 0x7f2f08106660 2024-08-31T05:25:39.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.321+0000 7f2f0dfba640 1 -- 172.21.15.67:0/303316513 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f0819c720 con 0x7f2f08106660 2024-08-31T05:25:39.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.322+0000 7f2f0dfba640 1 -- 172.21.15.67:0/303316513 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f08101cd0 con 0x7f2f08106660 2024-08-31T05:25:39.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.322+0000 7f2f057fa640 1 -- 172.21.15.67:0/303316513 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f2ef0042070 con 0x7f2f08106660 2024-08-31T05:25:39.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.323+0000 7f2f057fa640 1 --2- 172.21.15.67:0/303316513 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ef4079e00 0x7f2ef407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:39.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.323+0000 7f2f057fa640 1 -- 172.21.15.67:0/303316513 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f2ef00bd240 con 0x7f2f08106660 2024-08-31T05:25:39.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.323+0000 7f2f077fe640 1 --2- 172.21.15.67:0/303316513 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ef4079e00 0x7f2ef407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:39.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.324+0000 7f2f077fe640 1 --2- 172.21.15.67:0/303316513 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ef4079e00 0x7f2ef407c2c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8005d00 tx=0x7f2ef800b410 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:39.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.328+0000 7f2f057fa640 1 -- 172.21.15.67:0/303316513 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2ef0088f20 con 0x7f2f08106660 2024-08-31T05:25:39.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.535+0000 7f2f0dfba640 1 -- 172.21.15.67:0/303316513 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2f081989f0 con 0x7f2ef4079e00 2024-08-31T05:25:39.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.546+0000 7f2f057fa640 1 -- 172.21.15.67:0/303316513 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f2f081989f0 con 0x7f2ef4079e00 2024-08-31T05:25:39.548 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:25:39.548 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (104s) 20s ago 12m 21.3M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:25:39.548 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (4m) 20s ago 12m 8845k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:25:39.548 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (4m) 8s ago 11m 8346k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:25:39.548 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (12m) 20s ago 12m 6895k - 19.1.1-242-g244a32d3 395b9209a980 a47c71179c57 2024-08-31T05:25:39.548 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (11m) 8s ago 11m 6895k - 19.1.1-242-g244a32d3 395b9209a980 5f2ce08c4451 2024-08-31T05:25:39.548 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (81s) 20s ago 12m 74.9M - c8b91775d855 3a9a0f88928d 2024-08-31T05:25:39.548 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (7m) 20s ago 7m 92.2M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:25:39.548 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (7m) 20s ago 7m 156M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:25:39.549 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (7m) 8s ago 7m 16.0M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:25:39.549 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (7m) 8s ago 7m 18.0M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:25:39.549 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (3m) 20s ago 13m 588M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:25:39.549 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (2m) 8s ago 11m 524M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:25:39.549 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (27s) 20s ago 13m 90.4M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 25a28efbbd37 2024-08-31T05:25:39.549 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (12s) 8s ago 11m 87.6M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 6be0f0999860 2024-08-31T05:25:39.549 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (2m) 20s ago 12m 10.0M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:25:39.549 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (2m) 8s ago 11m 9697k - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:25:39.549 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (10m) 20s ago 10m 204M 1216M 19.1.1-242-g244a32d3 395b9209a980 b9f3f60b65f9 2024-08-31T05:25:39.549 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (10m) 20s ago 10m 224M 1216M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:25:39.549 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (9m) 20s ago 9m 188M 1216M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:25:39.549 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (9m) 8s ago 9m 251M 2240M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:25:39.549 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (8m) 8s ago 8m 213M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:25:39.550 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (8m) 8s ago 8m 188M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:25:39.550 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (2m) 20s ago 12m 49.1M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:25:39.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.548+0000 7f2f0dfba640 1 -- 172.21.15.67:0/303316513 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ef4079e00 msgr2=0x7f2ef407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:39.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.548+0000 7f2f0dfba640 1 --2- 172.21.15.67:0/303316513 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ef4079e00 0x7f2ef407c2c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8005d00 tx=0x7f2ef800b410 comp rx=0 tx=0).stop 2024-08-31T05:25:39.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.548+0000 7f2f0dfba640 1 -- 172.21.15.67:0/303316513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f08106660 msgr2=0x7f2f08197bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:39.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.548+0000 7f2f0dfba640 1 --2- 172.21.15.67:0/303316513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f08106660 0x7f2f08197bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0004f90 tx=0x7f2ef00048f0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.548+0000 7f2f0dfba640 1 -- 172.21.15.67:0/303316513 shutdown_connections 2024-08-31T05:25:39.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.548+0000 7f2f0dfba640 1 --2- 172.21.15.67:0/303316513 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ef4079e00 0x7f2ef407c2c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.548+0000 7f2f0dfba640 1 --2- 172.21.15.67:0/303316513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f08106660 0x7f2f08197bd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.548+0000 7f2f0dfba640 1 --2- 172.21.15.67:0/303316513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f081005b0 0x7f2f08197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.548+0000 7f2f0dfba640 1 -- 172.21.15.67:0/303316513 >> 172.21.15.67:0/303316513 conn(0x7f2f080fc2f0 msgr2=0x7f2f08069a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:39.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.548+0000 7f2f0dfba640 1 -- 172.21.15.67:0/303316513 shutdown_connections 2024-08-31T05:25:39.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.548+0000 7f2f0dfba640 1 -- 172.21.15.67:0/303316513 wait complete. 2024-08-31T05:25:39.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.641+0000 7fcfa784c640 1 -- 172.21.15.67:0/2812174562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0103180 msgr2=0x7fcfa010b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:39.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.641+0000 7fcfa784c640 1 --2- 172.21.15.67:0/2812174562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0103180 0x7fcfa010b670 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009880 tx=0x7fcf9c02a530 comp rx=0 tx=0).stop 2024-08-31T05:25:39.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.641+0000 7fcfa784c640 1 -- 172.21.15.67:0/2812174562 shutdown_connections 2024-08-31T05:25:39.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.641+0000 7fcfa784c640 1 --2- 172.21.15.67:0/2812174562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0103180 0x7fcfa010b670 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.641+0000 7fcfa784c640 1 --2- 172.21.15.67:0/2812174562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa0102860 0x7fcfa0102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.641+0000 7fcfa784c640 1 -- 172.21.15.67:0/2812174562 >> 172.21.15.67:0/2812174562 conn(0x7fcfa00fc2c0 msgr2=0x7fcfa00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:39.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.641+0000 7fcfa784c640 1 -- 172.21.15.67:0/2812174562 shutdown_connections 2024-08-31T05:25:39.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.641+0000 7fcfa784c640 1 -- 172.21.15.67:0/2812174562 wait complete. 2024-08-31T05:25:39.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.642+0000 7fcfa784c640 1 Processor -- start 2024-08-31T05:25:39.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.642+0000 7fcfa784c640 1 -- start start 2024-08-31T05:25:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.642+0000 7fcfa784c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa0102860 0x7fcfa01004c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.642+0000 7fcfa784c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0103180 0x7fcfa0100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.642+0000 7fcfa784c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa010eb90 con 0x7fcfa0103180 2024-08-31T05:25:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.642+0000 7fcfa784c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa010ea10 con 0x7fcfa0102860 2024-08-31T05:25:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.642+0000 7fcfa4de7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0103180 0x7fcfa0100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.642+0000 7fcfa4de7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0103180 0x7fcfa0100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60296/0 (socket says 172.21.15.67:60296) 2024-08-31T05:25:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.642+0000 7fcfa4de7640 1 -- 172.21.15.67:0/1453906358 learned_addr learned my addr 172.21.15.67:0/1453906358 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.643+0000 7fcfa55e8640 1 --2- 172.21.15.67:0/1453906358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa0102860 0x7fcfa01004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.643+0000 7fcfa4de7640 1 -- 172.21.15.67:0/1453906358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa0102860 msgr2=0x7fcfa01004c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.643+0000 7fcfa4de7640 1 --2- 172.21.15.67:0/1453906358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa0102860 0x7fcfa01004c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.643+0000 7fcfa4de7640 1 -- 172.21.15.67:0/1453906358 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa0100f40 con 0x7fcfa0103180 2024-08-31T05:25:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.643+0000 7fcfa4de7640 1 --2- 172.21.15.67:0/1453906358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0103180 0x7fcfa0100a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c031460 tx=0x7fcf9c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.643+0000 7fcf927fc640 1 -- 172.21.15.67:0/1453906358 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf9c03f070 con 0x7fcfa0103180 2024-08-31T05:25:39.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.643+0000 7fcf927fc640 1 -- 172.21.15.67:0/1453906358 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf9c0035f0 con 0x7fcfa0103180 2024-08-31T05:25:39.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.643+0000 7fcf927fc640 1 -- 172.21.15.67:0/1453906358 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf9c035030 con 0x7fcfa0103180 2024-08-31T05:25:39.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.643+0000 7fcfa784c640 1 -- 172.21.15.67:0/1453906358 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa01011d0 con 0x7fcfa0103180 2024-08-31T05:25:39.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.643+0000 7fcfa784c640 1 -- 172.21.15.67:0/1453906358 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa01a3b60 con 0x7fcfa0103180 2024-08-31T05:25:39.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.644+0000 7fcfa784c640 1 -- 172.21.15.67:0/1453906358 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa006a830 con 0x7fcfa0103180 2024-08-31T05:25:39.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.645+0000 7fcf927fc640 1 -- 172.21.15.67:0/1453906358 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fcf9c042070 con 0x7fcfa0103180 2024-08-31T05:25:39.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.645+0000 7fcf927fc640 1 --2- 172.21.15.67:0/1453906358 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcf8c079e40 0x7fcf8c07c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:39.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.645+0000 7fcf927fc640 1 -- 172.21.15.67:0/1453906358 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fcf9c0bd190 con 0x7fcfa0103180 2024-08-31T05:25:39.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.645+0000 7fcfa55e8640 1 --2- 172.21.15.67:0/1453906358 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcf8c079e40 0x7fcf8c07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:39.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.646+0000 7fcfa55e8640 1 --2- 172.21.15.67:0/1453906358 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcf8c079e40 0x7fcf8c07c300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf94005fd0 tx=0x7fcf94005850 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:39.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.650+0000 7fcf927fc640 1 -- 172.21.15.67:0/1453906358 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcf9c084d80 con 0x7fcfa0103180 2024-08-31T05:25:39.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.912+0000 7fcfa784c640 1 -- 172.21.15.67:0/1453906358 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcfa0105d00 con 0x7fcfa0103180 2024-08-31T05:25:39.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.912+0000 7fcf927fc640 1 -- 172.21.15.67:0/1453906358 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+733 (secure 0 0 0) 0x7fcf9c08d230 con 0x7fcfa0103180 2024-08-31T05:25:39.914 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:25:39.915 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:25:39.915 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:25:39.915 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:25:39.915 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:25:39.915 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:25:39.915 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:25:39.915 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:25:39.915 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 6 2024-08-31T05:25:39.915 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:25:39.915 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:25:39.915 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:25:39.915 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:25:39.915 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:25:39.916 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 10, 2024-08-31T05:25:39.916 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 4 2024-08-31T05:25:39.916 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:25:39.916 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:25:39.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.914+0000 7fcfa784c640 1 -- 172.21.15.67:0/1453906358 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcf8c079e40 msgr2=0x7fcf8c07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:39.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.914+0000 7fcfa784c640 1 --2- 172.21.15.67:0/1453906358 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcf8c079e40 0x7fcf8c07c300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf94005fd0 tx=0x7fcf94005850 comp rx=0 tx=0).stop 2024-08-31T05:25:39.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.914+0000 7fcfa784c640 1 -- 172.21.15.67:0/1453906358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0103180 msgr2=0x7fcfa0100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:39.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.914+0000 7fcfa784c640 1 --2- 172.21.15.67:0/1453906358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0103180 0x7fcfa0100a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c031460 tx=0x7fcf9c004530 comp rx=0 tx=0).stop 2024-08-31T05:25:39.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.915+0000 7fcfa784c640 1 -- 172.21.15.67:0/1453906358 shutdown_connections 2024-08-31T05:25:39.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.915+0000 7fcfa784c640 1 --2- 172.21.15.67:0/1453906358 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcf8c079e40 0x7fcf8c07c300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.915+0000 7fcfa784c640 1 --2- 172.21.15.67:0/1453906358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0103180 0x7fcfa0100a00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.915+0000 7fcfa784c640 1 --2- 172.21.15.67:0/1453906358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfa0102860 0x7fcfa01004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:39.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.915+0000 7fcfa784c640 1 -- 172.21.15.67:0/1453906358 >> 172.21.15.67:0/1453906358 conn(0x7fcfa00fc2c0 msgr2=0x7fcfa0108cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:39.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.915+0000 7fcfa784c640 1 -- 172.21.15.67:0/1453906358 shutdown_connections 2024-08-31T05:25:39.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:39.915+0000 7fcfa784c640 1 -- 172.21.15.67:0/1453906358 wait complete. 2024-08-31T05:25:40.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.000+0000 7fa58f43e640 1 -- 172.21.15.67:0/3185670394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa588106660 msgr2=0x7fa588106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:40.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.000+0000 7fa58f43e640 1 --2- 172.21.15.67:0/3185670394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa588106660 0x7fa588106a40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009880 tx=0x7fa57c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.000+0000 7fa58f43e640 1 -- 172.21.15.67:0/3185670394 shutdown_connections 2024-08-31T05:25:40.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.000+0000 7fa58f43e640 1 --2- 172.21.15.67:0/3185670394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5881005b0 0x7fa588100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.000+0000 7fa58f43e640 1 --2- 172.21.15.67:0/3185670394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa588106660 0x7fa588106a40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.000+0000 7fa58f43e640 1 -- 172.21.15.67:0/3185670394 >> 172.21.15.67:0/3185670394 conn(0x7fa5880fc2f0 msgr2=0x7fa5880fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:40.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.000+0000 7fa58f43e640 1 -- 172.21.15.67:0/3185670394 shutdown_connections 2024-08-31T05:25:40.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.000+0000 7fa58f43e640 1 -- 172.21.15.67:0/3185670394 wait complete. 2024-08-31T05:25:40.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.001+0000 7fa58f43e640 1 Processor -- start 2024-08-31T05:25:40.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.001+0000 7fa58f43e640 1 -- start start 2024-08-31T05:25:40.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.001+0000 7fa58f43e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5881005b0 0x7fa58819f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:40.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.001+0000 7fa58f43e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa588106660 0x7fa58819fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:40.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.001+0000 7fa58f43e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa58810da50 con 0x7fa588106660 2024-08-31T05:25:40.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.001+0000 7fa58f43e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa58810d8d0 con 0x7fa5881005b0 2024-08-31T05:25:40.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.001+0000 7fa58c9d9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa588106660 0x7fa58819fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:40.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.001+0000 7fa58c9d9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa588106660 0x7fa58819fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60322/0 (socket says 172.21.15.67:60322) 2024-08-31T05:25:40.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.001+0000 7fa58c9d9640 1 -- 172.21.15.67:0/1114146633 learned_addr learned my addr 172.21.15.67:0/1114146633 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:40.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.001+0000 7fa58d1da640 1 --2- 172.21.15.67:0/1114146633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5881005b0 0x7fa58819f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:40.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.002+0000 7fa58c9d9640 1 -- 172.21.15.67:0/1114146633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5881005b0 msgr2=0x7fa58819f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:40.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.002+0000 7fa58c9d9640 1 --2- 172.21.15.67:0/1114146633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5881005b0 0x7fa58819f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.002+0000 7fa58c9d9640 1 -- 172.21.15.67:0/1114146633 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5881996a0 con 0x7fa588106660 2024-08-31T05:25:40.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.002+0000 7fa58c9d9640 1 --2- 172.21.15.67:0/1114146633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa588106660 0x7fa58819fb10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa58400d8d0 tx=0x7fa58400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:40.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.002+0000 7fa57a7fc640 1 -- 172.21.15.67:0/1114146633 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa584017070 con 0x7fa588106660 2024-08-31T05:25:40.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.002+0000 7fa58f43e640 1 -- 172.21.15.67:0/1114146633 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa588199990 con 0x7fa588106660 2024-08-31T05:25:40.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.002+0000 7fa57a7fc640 1 -- 172.21.15.67:0/1114146633 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa584010460 con 0x7fa588106660 2024-08-31T05:25:40.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.002+0000 7fa58f43e640 1 -- 172.21.15.67:0/1114146633 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa588199ef0 con 0x7fa588106660 2024-08-31T05:25:40.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.002+0000 7fa57a7fc640 1 -- 172.21.15.67:0/1114146633 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa584020060 con 0x7fa588106660 2024-08-31T05:25:40.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.003+0000 7fa58f43e640 1 -- 172.21.15.67:0/1114146633 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa588101cd0 con 0x7fa588106660 2024-08-31T05:25:40.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.004+0000 7fa57a7fc640 1 -- 172.21.15.67:0/1114146633 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fa584009a30 con 0x7fa588106660 2024-08-31T05:25:40.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.004+0000 7fa57a7fc640 1 --2- 172.21.15.67:0/1114146633 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa574079e00 0x7fa57407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:40.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.004+0000 7fa57a7fc640 1 -- 172.21.15.67:0/1114146633 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fa58409c830 con 0x7fa588106660 2024-08-31T05:25:40.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.004+0000 7fa58d1da640 1 --2- 172.21.15.67:0/1114146633 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa574079e00 0x7fa57407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:40.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.005+0000 7fa58d1da640 1 --2- 172.21.15.67:0/1114146633 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa574079e00 0x7fa57407c2c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0096c0 tx=0x7fa57c004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:40.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.009+0000 7fa57a7fc640 1 -- 172.21.15.67:0/1114146633 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa584068510 con 0x7fa588106660 2024-08-31T05:25:40.058 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:39 smithi067 ceph-mon[99941]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:40.058 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:39 smithi067 ceph-mon[99941]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:40.058 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:39 smithi067 ceph-mon[99941]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:40.058 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:39 smithi067 ceph-mon[99941]: pgmap v111: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:40.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:39 smithi073 ceph-mon[71452]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:40.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:39 smithi073 ceph-mon[71452]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:40.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:39 smithi073 ceph-mon[71452]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:40.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:39 smithi073 ceph-mon[71452]: pgmap v111: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:40.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.249+0000 7fa58f43e640 1 -- 172.21.15.67:0/1114146633 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa58819a1a0 con 0x7fa588106660 2024-08-31T05:25:40.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.250+0000 7fa57a7fc640 1 -- 172.21.15.67:0/1114146633 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2042 (secure 0 0 0) 0x7fa58406cf30 con 0x7fa588106660 2024-08-31T05:25:40.252 INFO:teuthology.orchestra.run.smithi067.stdout:e15 2024-08-31T05:25:40.252 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-08-31T05:18:35:124059+0000 2024-08-31T05:25:40.252 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:25:40.252 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:25:40.252 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-08-31T05:25:40.252 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:25:40.252 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:25:40.252 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-08-31T05:25:40.252 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 13 2024-08-31T05:25:40.252 INFO:teuthology.orchestra.run.smithi067.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T05:25:40.252 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:25:40.253 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-08-31T05:18:33.086400+0000 2024-08-31T05:25:40.253 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-08-31T05:25:40.253 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-08-31T05:25:40.253 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2024-08-31T05:25:40.253 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-08-31T05:25:40.253 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-08-31T05:25:40.253 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-08-31T05:25:40.253 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-08-31T05:25:40.253 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-08-31T05:25:40.253 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 0 2024-08-31T05:25:40.253 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:25:40.253 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2024-08-31T05:25:40.253 INFO:teuthology.orchestra.run.smithi067.stdout:in 0 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14554} 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data enabled 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 14554 members: 14554 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.tskvpt{0:14554} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.beqeql{0:14566} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:25:40.254 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:25:40.255 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2024-08-31T05:25:40.255 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:25:40.255 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.kfbmeo{-1:24299} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:40.255 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.gsnhxi{-1:24307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6824/2383176383,v1:172.21.15.73:6825/2383176383] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:25:40.255 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-08-31T05:25:40.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.252+0000 7fa58f43e640 1 -- 172.21.15.67:0/1114146633 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa574079e00 msgr2=0x7fa57407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:40.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.252+0000 7fa58f43e640 1 --2- 172.21.15.67:0/1114146633 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa574079e00 0x7fa57407c2c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0096c0 tx=0x7fa57c004f30 comp rx=0 tx=0).stop 2024-08-31T05:25:40.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.252+0000 7fa58f43e640 1 -- 172.21.15.67:0/1114146633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa588106660 msgr2=0x7fa58819fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:40.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.252+0000 7fa58f43e640 1 --2- 172.21.15.67:0/1114146633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa588106660 0x7fa58819fb10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa58400d8d0 tx=0x7fa58400dd90 comp rx=0 tx=0).stop 2024-08-31T05:25:40.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.252+0000 7fa58f43e640 1 -- 172.21.15.67:0/1114146633 shutdown_connections 2024-08-31T05:25:40.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.252+0000 7fa58f43e640 1 --2- 172.21.15.67:0/1114146633 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa574079e00 0x7fa57407c2c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.252+0000 7fa58f43e640 1 --2- 172.21.15.67:0/1114146633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa588106660 0x7fa58819fb10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.252+0000 7fa58f43e640 1 --2- 172.21.15.67:0/1114146633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5881005b0 0x7fa58819f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.252+0000 7fa58f43e640 1 -- 172.21.15.67:0/1114146633 >> 172.21.15.67:0/1114146633 conn(0x7fa5880fc2f0 msgr2=0x7fa588109800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:40.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.252+0000 7fa58f43e640 1 -- 172.21.15.67:0/1114146633 shutdown_connections 2024-08-31T05:25:40.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.252+0000 7fa58f43e640 1 -- 172.21.15.67:0/1114146633 wait complete. 2024-08-31T05:25:40.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.336+0000 7fc1efad0640 1 -- 172.21.15.67:0/2373868653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e81005c0 msgr2=0x7fc1e8100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:40.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.336+0000 7fc1efad0640 1 --2- 172.21.15.67:0/2373868653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e81005c0 0x7fc1e8100a20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009880 tx=0x7fc1dc02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.336+0000 7fc1efad0640 1 -- 172.21.15.67:0/2373868653 shutdown_connections 2024-08-31T05:25:40.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.337+0000 7fc1efad0640 1 --2- 172.21.15.67:0/2373868653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e81005c0 0x7fc1e8100a20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.337+0000 7fc1efad0640 1 --2- 172.21.15.67:0/2373868653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e8106670 0x7fc1e8106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.337+0000 7fc1efad0640 1 -- 172.21.15.67:0/2373868653 >> 172.21.15.67:0/2373868653 conn(0x7fc1e80fc2c0 msgr2=0x7fc1e80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:40.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.337+0000 7fc1efad0640 1 -- 172.21.15.67:0/2373868653 shutdown_connections 2024-08-31T05:25:40.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.337+0000 7fc1efad0640 1 -- 172.21.15.67:0/2373868653 wait complete. 2024-08-31T05:25:40.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.337+0000 7fc1efad0640 1 Processor -- start 2024-08-31T05:25:40.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.337+0000 7fc1efad0640 1 -- start start 2024-08-31T05:25:40.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.337+0000 7fc1efad0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e81005c0 0x7fc1e81976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:40.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.337+0000 7fc1efad0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e8106670 0x7fc1e8197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:40.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.337+0000 7fc1efad0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e810da80 con 0x7fc1e8106670 2024-08-31T05:25:40.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.337+0000 7fc1efad0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e810d900 con 0x7fc1e81005c0 2024-08-31T05:25:40.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.338+0000 7fc1ed06b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e8106670 0x7fc1e8197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:40.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.338+0000 7fc1ed06b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e8106670 0x7fc1e8197be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60352/0 (socket says 172.21.15.67:60352) 2024-08-31T05:25:40.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.338+0000 7fc1ed06b640 1 -- 172.21.15.67:0/138887861 learned_addr learned my addr 172.21.15.67:0/138887861 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:40.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.338+0000 7fc1ed86c640 1 --2- 172.21.15.67:0/138887861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e81005c0 0x7fc1e81976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:40.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.338+0000 7fc1ed06b640 1 -- 172.21.15.67:0/138887861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e81005c0 msgr2=0x7fc1e81976a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:40.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.338+0000 7fc1ed06b640 1 --2- 172.21.15.67:0/138887861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e81005c0 0x7fc1e81976a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.338+0000 7fc1ed06b640 1 -- 172.21.15.67:0/138887861 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e819bf70 con 0x7fc1e8106670 2024-08-31T05:25:40.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.338+0000 7fc1ed06b640 1 --2- 172.21.15.67:0/138887861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e8106670 0x7fc1e8197be0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc004f90 tx=0x7fc1dc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:40.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.338+0000 7fc1e6ffd640 1 -- 172.21.15.67:0/138887861 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1dc03f070 con 0x7fc1e8106670 2024-08-31T05:25:40.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.338+0000 7fc1efad0640 1 -- 172.21.15.67:0/138887861 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e819c200 con 0x7fc1e8106670 2024-08-31T05:25:40.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.338+0000 7fc1e6ffd640 1 -- 172.21.15.67:0/138887861 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1dc004c70 con 0x7fc1e8106670 2024-08-31T05:25:40.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.338+0000 7fc1e6ffd640 1 -- 172.21.15.67:0/138887861 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1dc035030 con 0x7fc1e8106670 2024-08-31T05:25:40.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.338+0000 7fc1efad0640 1 -- 172.21.15.67:0/138887861 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e819c730 con 0x7fc1e8106670 2024-08-31T05:25:40.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.340+0000 7fc1efad0640 1 -- 172.21.15.67:0/138887861 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e8101ce0 con 0x7fc1e8106670 2024-08-31T05:25:40.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.340+0000 7fc1e6ffd640 1 -- 172.21.15.67:0/138887861 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fc1dc042070 con 0x7fc1e8106670 2024-08-31T05:25:40.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.341+0000 7fc1e6ffd640 1 --2- 172.21.15.67:0/138887861 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc1d0079e00 0x7fc1d007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:40.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.341+0000 7fc1e6ffd640 1 -- 172.21.15.67:0/138887861 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fc1dc0bd290 con 0x7fc1e8106670 2024-08-31T05:25:40.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.341+0000 7fc1ed86c640 1 --2- 172.21.15.67:0/138887861 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc1d0079e00 0x7fc1d007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:40.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.341+0000 7fc1ed86c640 1 --2- 172.21.15.67:0/138887861 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc1d0079e00 0x7fc1d007c2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8005fd0 tx=0x7fc1d8009680 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:40.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.345+0000 7fc1e6ffd640 1 -- 172.21.15.67:0/138887861 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc1dc088f70 con 0x7fc1e8106670 2024-08-31T05:25:40.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.551+0000 7fc1efad0640 1 -- 172.21.15.67:0/138887861 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc1e819c9e0 con 0x7fc1d0079e00 2024-08-31T05:25:40.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.553+0000 7fc1e6ffd640 1 -- 172.21.15.67:0/138887861 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7fc1e819c9e0 con 0x7fc1d0079e00 2024-08-31T05:25:40.555 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:25:40.555 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:25:40.555 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:25:40.555 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-31T05:25:40.555 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:25:40.555 INFO:teuthology.orchestra.run.smithi067.stdout: "mon", 2024-08-31T05:25:40.555 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr" 2024-08-31T05:25:40.555 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:25:40.555 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "4/23 daemons upgraded", 2024-08-31T05:25:40.555 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading crash daemons", 2024-08-31T05:25:40.555 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:25:40.555 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:25:40.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.555+0000 7fc1efad0640 1 -- 172.21.15.67:0/138887861 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc1d0079e00 msgr2=0x7fc1d007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:40.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.555+0000 7fc1efad0640 1 --2- 172.21.15.67:0/138887861 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc1d0079e00 0x7fc1d007c2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8005fd0 tx=0x7fc1d8009680 comp rx=0 tx=0).stop 2024-08-31T05:25:40.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.555+0000 7fc1efad0640 1 -- 172.21.15.67:0/138887861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e8106670 msgr2=0x7fc1e8197be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:40.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.555+0000 7fc1efad0640 1 --2- 172.21.15.67:0/138887861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e8106670 0x7fc1e8197be0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc004f90 tx=0x7fc1dc0048f0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.555+0000 7fc1efad0640 1 -- 172.21.15.67:0/138887861 shutdown_connections 2024-08-31T05:25:40.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.555+0000 7fc1efad0640 1 --2- 172.21.15.67:0/138887861 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc1d0079e00 0x7fc1d007c2c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.555+0000 7fc1efad0640 1 --2- 172.21.15.67:0/138887861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e8106670 0x7fc1e8197be0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.555+0000 7fc1efad0640 1 --2- 172.21.15.67:0/138887861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e81005c0 0x7fc1e81976a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.555+0000 7fc1efad0640 1 -- 172.21.15.67:0/138887861 >> 172.21.15.67:0/138887861 conn(0x7fc1e80fc2c0 msgr2=0x7fc1e8104820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:40.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.555+0000 7fc1efad0640 1 -- 172.21.15.67:0/138887861 shutdown_connections 2024-08-31T05:25:40.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.555+0000 7fc1efad0640 1 -- 172.21.15.67:0/138887861 wait complete. 2024-08-31T05:25:40.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.637+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2488108325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5941005c0 msgr2=0x7ff594100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:40.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.637+0000 7ff59bf2b640 1 --2- 172.21.15.67:0/2488108325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5941005c0 0x7ff594100a20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff590009880 tx=0x7ff59002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.637+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2488108325 shutdown_connections 2024-08-31T05:25:40.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.637+0000 7ff59bf2b640 1 --2- 172.21.15.67:0/2488108325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5941005c0 0x7ff594100a20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.637+0000 7ff59bf2b640 1 --2- 172.21.15.67:0/2488108325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff594106670 0x7ff594106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.637+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2488108325 >> 172.21.15.67:0/2488108325 conn(0x7ff5940fc2c0 msgr2=0x7ff5940fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:40.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.637+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2488108325 shutdown_connections 2024-08-31T05:25:40.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.637+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2488108325 wait complete. 2024-08-31T05:25:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.638+0000 7ff59bf2b640 1 Processor -- start 2024-08-31T05:25:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.638+0000 7ff59bf2b640 1 -- start start 2024-08-31T05:25:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.638+0000 7ff59bf2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5941005c0 0x7ff594197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.638+0000 7ff59bf2b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff594106670 0x7ff594197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.638+0000 7ff59bf2b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff59410eb90 con 0x7ff594106670 2024-08-31T05:25:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.638+0000 7ff59bf2b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff59410ea10 con 0x7ff5941005c0 2024-08-31T05:25:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.639+0000 7ff5994c6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff594106670 0x7ff594197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.639+0000 7ff5994c6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff594106670 0x7ff594197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60382/0 (socket says 172.21.15.67:60382) 2024-08-31T05:25:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.639+0000 7ff5994c6640 1 -- 172.21.15.67:0/2745626979 learned_addr learned my addr 172.21.15.67:0/2745626979 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:25:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.639+0000 7ff599cc7640 1 --2- 172.21.15.67:0/2745626979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5941005c0 0x7ff594197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.639+0000 7ff5994c6640 1 -- 172.21.15.67:0/2745626979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5941005c0 msgr2=0x7ff594197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.639+0000 7ff5994c6640 1 --2- 172.21.15.67:0/2745626979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5941005c0 0x7ff594197720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.639+0000 7ff5994c6640 1 -- 172.21.15.67:0/2745626979 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59419bff0 con 0x7ff594106670 2024-08-31T05:25:40.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.639+0000 7ff5994c6640 1 --2- 172.21.15.67:0/2745626979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff594106670 0x7ff594197c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff590004f90 tx=0x7ff5900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:40.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.639+0000 7ff58affd640 1 -- 172.21.15.67:0/2745626979 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff59003f070 con 0x7ff594106670 2024-08-31T05:25:40.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.639+0000 7ff58affd640 1 -- 172.21.15.67:0/2745626979 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff590004ac0 con 0x7ff594106670 2024-08-31T05:25:40.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.639+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2745626979 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59419c280 con 0x7ff594106670 2024-08-31T05:25:40.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.639+0000 7ff58affd640 1 -- 172.21.15.67:0/2745626979 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff590035030 con 0x7ff594106670 2024-08-31T05:25:40.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.639+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2745626979 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff59419c7b0 con 0x7ff594106670 2024-08-31T05:25:40.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.640+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2745626979 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff594101ce0 con 0x7ff594106670 2024-08-31T05:25:40.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.641+0000 7ff58affd640 1 -- 172.21.15.67:0/2745626979 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7ff590042070 con 0x7ff594106670 2024-08-31T05:25:40.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.642+0000 7ff58affd640 1 --2- 172.21.15.67:0/2745626979 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7ff580079e40 0x7ff58007c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:40.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.642+0000 7ff58affd640 1 -- 172.21.15.67:0/2745626979 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7ff5900bd780 con 0x7ff594106670 2024-08-31T05:25:40.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.642+0000 7ff599cc7640 1 --2- 172.21.15.67:0/2745626979 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7ff580079e40 0x7ff58007c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:40.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.643+0000 7ff599cc7640 1 --2- 172.21.15.67:0/2745626979 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7ff580079e40 0x7ff58007c300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff584009b60 tx=0x7ff584005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:40.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.646+0000 7ff58affd640 1 -- 172.21.15.67:0/2745626979 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff590085430 con 0x7ff594106670 2024-08-31T05:25:40.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.905+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2745626979 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff594198ab0 con 0x7ff594106670 2024-08-31T05:25:40.908 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:40 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/1453906358' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:25:40.908 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:40 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:40.908 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:40 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:40.908 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:40 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/1114146633' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:25:40.908 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:40 smithi067 ceph-mon[99941]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:40.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.905+0000 7ff58affd640 1 -- 172.21.15.67:0/2745626979 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7ff594198ab0 con 0x7ff594106670 2024-08-31T05:25:40.908 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-31T05:25:40.908 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:25:40.909 INFO:teuthology.orchestra.run.smithi067.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:25:40.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.908+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2745626979 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7ff580079e40 msgr2=0x7ff58007c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:40.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.908+0000 7ff59bf2b640 1 --2- 172.21.15.67:0/2745626979 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7ff580079e40 0x7ff58007c300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff584009b60 tx=0x7ff584005f90 comp rx=0 tx=0).stop 2024-08-31T05:25:40.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.908+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2745626979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff594106670 msgr2=0x7ff594197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:40.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.908+0000 7ff59bf2b640 1 --2- 172.21.15.67:0/2745626979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff594106670 0x7ff594197c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff590004f90 tx=0x7ff5900046c0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.908+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2745626979 shutdown_connections 2024-08-31T05:25:40.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.908+0000 7ff59bf2b640 1 --2- 172.21.15.67:0/2745626979 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7ff580079e40 0x7ff58007c300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.908+0000 7ff59bf2b640 1 --2- 172.21.15.67:0/2745626979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff594106670 0x7ff594197c60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.908+0000 7ff59bf2b640 1 --2- 172.21.15.67:0/2745626979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5941005c0 0x7ff594197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:40.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.908+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2745626979 >> 172.21.15.67:0/2745626979 conn(0x7ff5940fc2c0 msgr2=0x7ff5940fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:40.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.908+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2745626979 shutdown_connections 2024-08-31T05:25:40.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:25:40.908+0000 7ff59bf2b640 1 -- 172.21.15.67:0/2745626979 wait complete. 2024-08-31T05:25:41.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:40 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/1453906358' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:25:41.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:40 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:41.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:40 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:41.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:40 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/1114146633' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:25:41.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:40 smithi073 ceph-mon[71452]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:42.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:41 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2745626979' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:25:42.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:41 smithi067 ceph-mon[99941]: Upgrade: Updating crash.smithi073 (2/2) 2024-08-31T05:25:42.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:41 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:42.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:41 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-08-31T05:25:42.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:41 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:42.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:41 smithi067 ceph-mon[99941]: Deploying daemon crash.smithi073 on smithi073 2024-08-31T05:25:42.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:41 smithi067 ceph-mon[99941]: pgmap v112: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:42.145 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:41 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2745626979' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:25:42.145 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:41 smithi073 ceph-mon[71452]: Upgrade: Updating crash.smithi073 (2/2) 2024-08-31T05:25:42.145 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:41 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:42.145 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:41 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi073", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-08-31T05:25:42.145 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:41 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:42.145 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:41 smithi073 ceph-mon[71452]: Deploying daemon crash.smithi073 on smithi073 2024-08-31T05:25:42.145 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:41 smithi073 ceph-mon[71452]: pgmap v112: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:45.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:44 smithi067 ceph-mon[99941]: pgmap v113: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:45.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:44 smithi073 ceph-mon[71452]: pgmap v113: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:46.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:45 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:46.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:45 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:46.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:45 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:46.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:45 smithi073 ceph-mon[71452]: pgmap v114: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:46.211 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:45 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:46.211 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:45 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:46.212 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:45 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:46.212 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:45 smithi067 ceph-mon[99941]: pgmap v114: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:48.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:48 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:48.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:48 smithi067 ceph-mon[99941]: pgmap v115: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:48.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:48 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:48.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:48 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:48.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:48 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:48.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:48 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:48 smithi073 ceph-mon[71452]: pgmap v115: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:48 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:48 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:48 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:49.850 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:25:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:25:50.859 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:50 smithi073 ceph-mon[71452]: pgmap v116: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:50.859 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:50.859 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:50.859 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:50.859 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:51.007 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:50 smithi067 ceph-mon[99941]: pgmap v116: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:51.007 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:51.007 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:51.007 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:51.007 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:52.509 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:52 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:52.509 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:52 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:52.509 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:52 smithi067 ceph-mon[99941]: pgmap v117: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:52.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:52 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:52.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:52 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:52.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:52 smithi073 ceph-mon[71452]: pgmap v117: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: pgmap v118: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:55.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:55.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:55.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:25:55.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:25:55.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:25:55.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:55.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi067"} : dispatch 2024-08-31T05:25:55.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi067"}]': finished 2024-08-31T05:25:55.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi073"} : dispatch 2024-08-31T05:25:55.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi073"}]': finished 2024-08-31T05:25:55.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-08-31T05:25:55.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: pgmap v118: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:55.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:55.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:55.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:55.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:55.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:55.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:55.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:25:55.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:25:55.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:25:55.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:55.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi067"} : dispatch 2024-08-31T05:25:55.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi067"}]': finished 2024-08-31T05:25:55.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi073"} : dispatch 2024-08-31T05:25:55.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi073"}]': finished 2024-08-31T05:25:55.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-08-31T05:25:56.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:55 smithi067 ceph-mon[99941]: Upgrade: Setting container_image for all crash 2024-08-31T05:25:56.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:55 smithi067 ceph-mon[99941]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-08-31T05:25:56.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:55 smithi067 ceph-mon[99941]: Upgrade: osd.0 is safe to restart 2024-08-31T05:25:56.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:55 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:56.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:55 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T05:25:56.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:55 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:56.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:55 smithi073 ceph-mon[71452]: Upgrade: Setting container_image for all crash 2024-08-31T05:25:56.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:55 smithi073 ceph-mon[71452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-08-31T05:25:56.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:55 smithi073 ceph-mon[71452]: Upgrade: osd.0 is safe to restart 2024-08-31T05:25:56.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:55 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:25:56.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:55 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T05:25:56.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:55 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:56.914 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:56 smithi067 ceph-mon[99941]: Upgrade: Updating osd.0 2024-08-31T05:25:56.914 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:56 smithi067 ceph-mon[99941]: Deploying daemon osd.0 on smithi067 2024-08-31T05:25:56.914 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:56 smithi067 ceph-mon[99941]: pgmap v119: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:56 smithi073 ceph-mon[71452]: Upgrade: Updating osd.0 2024-08-31T05:25:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:56 smithi073 ceph-mon[71452]: Deploying daemon osd.0 on smithi067 2024-08-31T05:25:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:56 smithi073 ceph-mon[71452]: pgmap v119: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:25:58.860 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:58 smithi067 ceph-mon[99941]: pgmap v120: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:58.860 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:25:58 smithi067 systemd[1]: Stopping Ceph osd.0 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:25:58.998 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:58 smithi073 ceph-mon[71452]: pgmap v120: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:25:59.325 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:25:58 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0[37339]: 2024-08-31T05:25:58.857+0000 7fc991a02640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:25:59.325 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:25:58 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0[37339]: 2024-08-31T05:25:58.857+0000 7fc991a02640 -1 osd.0 47 *** Got signal Terminated *** 2024-08-31T05:25:59.325 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:25:58 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0[37339]: 2024-08-31T05:25:58.857+0000 7fc991a02640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:25:59.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:25:59 smithi067 ceph-mon[99941]: osd.0 marked itself down and dead 2024-08-31T05:26:00.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:25:59 smithi073 ceph-mon[71452]: osd.0 marked itself down and dead 2024-08-31T05:26:00.394 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:00 smithi067 podman[108733]: 2024-08-31 05:26:00.13453402 +0000 UTC m=+1.365190480 container died b9f3f60b65f9645058f35bca833d7bcb014e6985e8bdd28462adafb3b883ace3 (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-244a32d, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-31T05:26:00.702 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:00 smithi067 podman[108733]: 2024-08-31 05:26:00.474547722 +0000 UTC m=+1.705204180 container cleanup b9f3f60b65f9645058f35bca833d7bcb014e6985e8bdd28462adafb3b883ace3 (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-244a32d, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:26:00.703 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:00 smithi067 bash[108733]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0 2024-08-31T05:26:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:00 smithi067 ceph-mon[99941]: pgmap v121: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:26:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:00 smithi067 ceph-mon[99941]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-31T05:26:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:00 smithi067 ceph-mon[99941]: osdmap e48: 6 total, 5 up, 6 in 2024-08-31T05:26:01.075 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:00 smithi067 podman[108750]: 2024-08-31 05:26:00.701419997 +0000 UTC m=+0.561675465 container remove b9f3f60b65f9645058f35bca833d7bcb014e6985e8bdd28462adafb3b883ace3 (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0, RELEASE=squid-244a32d, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T05:26:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:00 smithi073 ceph-mon[71452]: pgmap v121: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:26:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:00 smithi073 ceph-mon[71452]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-31T05:26:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:00 smithi073 ceph-mon[71452]: osdmap e48: 6 total, 5 up, 6 in 2024-08-31T05:26:01.426 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:01 smithi067 podman[108834]: 2024-08-31 05:26:01.041021407 +0000 UTC m=+0.016751698 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:26:01.426 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:01 smithi067 podman[108834]: 2024-08-31 05:26:01.31107346 +0000 UTC m=+0.286803751 container create 4f62449b007a16d2c8797c35292e1cd0e93b178e5c97cf93e972bcb662396995 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:26:01.729 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:01 smithi067 podman[108834]: 2024-08-31 05:26:01.555431508 +0000 UTC m=+0.531161799 container init 4f62449b007a16d2c8797c35292e1cd0e93b178e5c97cf93e972bcb662396995 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-31T05:26:01.729 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:01 smithi067 podman[108834]: 2024-08-31 05:26:01.55874444 +0000 UTC m=+0.534474731 container start 4f62449b007a16d2c8797c35292e1cd0e93b178e5c97cf93e972bcb662396995 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:26:01.730 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:01 smithi067 podman[108834]: 2024-08-31 05:26:01.630250089 +0000 UTC m=+0.605980387 container attach 4f62449b007a16d2c8797c35292e1cd0e93b178e5c97cf93e972bcb662396995 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:26:01.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:01 smithi073 ceph-mon[71452]: osdmap e49: 6 total, 5 up, 6 in 2024-08-31T05:26:02.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:01 smithi067 ceph-mon[99941]: osdmap e49: 6 total, 5 up, 6 in 2024-08-31T05:26:02.075 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:01 smithi067 podman[108834]: 2024-08-31 05:26:01.755515159 +0000 UTC m=+0.731245460 container died 4f62449b007a16d2c8797c35292e1cd0e93b178e5c97cf93e972bcb662396995 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:26:02.575 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:02 smithi067 podman[108857]: 2024-08-31 05:26:02.376095216 +0000 UTC m=+0.615023595 container remove 4f62449b007a16d2c8797c35292e1cd0e93b178e5c97cf93e972bcb662396995 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:26:02.575 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:02 smithi067 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.0.service: Deactivated successfully. 2024-08-31T05:26:02.575 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:02 smithi067 systemd[1]: Stopped Ceph osd.0 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:26:02.575 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:02 smithi067 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.0.service: Consumed 51.526s CPU time. 2024-08-31T05:26:02.927 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:02 smithi067 ceph-mon[99941]: pgmap v124: 65 pgs: 9 stale+active+clean, 56 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:26:02.928 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:02 smithi067 systemd[1]: Starting Ceph osd.0 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:26:02.928 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:02 smithi067 podman[108957]: 2024-08-31 05:26:02.717525967 +0000 UTC m=+0.016094031 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:26:02.928 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:02 smithi067 podman[108957]: 2024-08-31 05:26:02.827731049 +0000 UTC m=+0.126299102 container create 09aff8a1e48ff285751289756f0bf5eefc5bd940e83e27bbb16b08f6e66eaf1d (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD) 2024-08-31T05:26:03.192 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 podman[108957]: 2024-08-31 05:26:03.055493242 +0000 UTC m=+0.354061304 container init 09aff8a1e48ff285751289756f0bf5eefc5bd940e83e27bbb16b08f6e66eaf1d (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-31T05:26:03.192 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 podman[108957]: 2024-08-31 05:26:03.059001287 +0000 UTC m=+0.357569342 container start 09aff8a1e48ff285751289756f0bf5eefc5bd940e83e27bbb16b08f6e66eaf1d (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-31T05:26:03.192 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 podman[108957]: 2024-08-31 05:26:03.130271964 +0000 UTC m=+0.428840017 container attach 09aff8a1e48ff285751289756f0bf5eefc5bd940e83e27bbb16b08f6e66eaf1d (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:26:03.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:02 smithi073 ceph-mon[71452]: pgmap v124: 65 pgs: 9 stale+active+clean, 56 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:26:03.575 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate[108971]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:03.575 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 bash[108957]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:03.575 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate[108971]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:03.575 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 bash[108957]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:03.575 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate[108971]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-31T05:26:03.575 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 bash[108957]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-31T05:26:03.575 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate[108971]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:03.575 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 bash[108957]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:03.576 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate[108971]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:03.576 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 bash[108957]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:03.576 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate[108971]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-31T05:26:03.576 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 bash[108957]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-31T05:26:03.576 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate[108971]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-08-31T05:26:03.576 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 bash[108957]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-08-31T05:26:04.004 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate[108971]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-08-31T05:26:04.004 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 bash[108957]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-08-31T05:26:04.004 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate[108971]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-08-31T05:26:04.005 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 bash[108957]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-08-31T05:26:04.005 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate[108971]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-31T05:26:04.005 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 bash[108957]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-31T05:26:04.005 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate[108971]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-31T05:26:04.005 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 bash[108957]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-31T05:26:04.005 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate[108971]: --> ceph-volume lvm activate successful for osd ID: 0 2024-08-31T05:26:04.005 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 bash[108957]: --> ceph-volume lvm activate successful for osd ID: 0 2024-08-31T05:26:04.005 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:03 smithi067 podman[108957]: 2024-08-31 05:26:03.655535678 +0000 UTC m=+0.954103736 container died 09aff8a1e48ff285751289756f0bf5eefc5bd940e83e27bbb16b08f6e66eaf1d (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:26:04.673 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:04 smithi067 podman[109084]: 2024-08-31 05:26:04.326676868 +0000 UTC m=+0.665200292 container remove 09aff8a1e48ff285751289756f0bf5eefc5bd940e83e27bbb16b08f6e66eaf1d (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:26:04.673 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:04 smithi067 podman[109142]: 2024-08-31 05:26:04.439793178 +0000 UTC m=+0.016403897 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:26:04.673 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:04 smithi067 podman[109142]: 2024-08-31 05:26:04.569334702 +0000 UTC m=+0.145945404 container create aab0516dcbfab12abe2b7c05eb1a4ec6290118f14afd436b27504b54ec9c24bd (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-31T05:26:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:04 smithi067 ceph-mon[99941]: pgmap v125: 65 pgs: 9 stale+active+clean, 56 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-08-31T05:26:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [3, 0]} : dispatch 2024-08-31T05:26:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [3, 0]} : dispatch 2024-08-31T05:26:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 0]} : dispatch 2024-08-31T05:26:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 5]} : dispatch 2024-08-31T05:26:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [1, 0]} : dispatch 2024-08-31T05:26:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]} : dispatch 2024-08-31T05:26:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 5]} : dispatch 2024-08-31T05:26:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 0]} : dispatch 2024-08-31T05:26:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [3, 0]} : dispatch 2024-08-31T05:26:05.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:05.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:26:05.076 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:04 smithi067 podman[109142]: 2024-08-31 05:26:04.772349361 +0000 UTC m=+0.348960073 container init aab0516dcbfab12abe2b7c05eb1a4ec6290118f14afd436b27504b54ec9c24bd (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:26:05.076 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:04 smithi067 podman[109142]: 2024-08-31 05:26:04.775807618 +0000 UTC m=+0.352418329 container start aab0516dcbfab12abe2b7c05eb1a4ec6290118f14afd436b27504b54ec9c24bd (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-31T05:26:05.076 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:04 smithi067 ceph-osd[109161]: -- 172.21.15.67:0/2249354914 <== mon.0 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b915dc01e0 con 0x55b91504b180 2024-08-31T05:26:05.076 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:04 smithi067 bash[109142]: aab0516dcbfab12abe2b7c05eb1a4ec6290118f14afd436b27504b54ec9c24bd 2024-08-31T05:26:05.076 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:04 smithi067 systemd[1]: Started Ceph osd.0 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:26:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:04 smithi073 ceph-mon[71452]: pgmap v125: 65 pgs: 9 stale+active+clean, 56 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-08-31T05:26:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [3, 0]} : dispatch 2024-08-31T05:26:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [3, 0]} : dispatch 2024-08-31T05:26:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 0]} : dispatch 2024-08-31T05:26:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 5]} : dispatch 2024-08-31T05:26:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [1, 0]} : dispatch 2024-08-31T05:26:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]} : dispatch 2024-08-31T05:26:05.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 5]} : dispatch 2024-08-31T05:26:05.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 0]} : dispatch 2024-08-31T05:26:05.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [3, 0]} : dispatch 2024-08-31T05:26:05.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:05.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:26:05.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [3, 0]}]': finished 2024-08-31T05:26:05.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [3, 0]}]': finished 2024-08-31T05:26:05.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 0]}]': finished 2024-08-31T05:26:05.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 5]}]': finished 2024-08-31T05:26:05.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [1, 0]}]': finished 2024-08-31T05:26:05.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]}]': finished 2024-08-31T05:26:05.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 5]}]': finished 2024-08-31T05:26:05.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 0]}]': finished 2024-08-31T05:26:05.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [3, 0]}]': finished 2024-08-31T05:26:05.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:05 smithi067 ceph-mon[99941]: osdmap e50: 6 total, 5 up, 6 in 2024-08-31T05:26:05.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:05.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:05.751 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [3, 0]}]': finished 2024-08-31T05:26:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [3, 0]}]': finished 2024-08-31T05:26:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 0]}]': finished 2024-08-31T05:26:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 5]}]': finished 2024-08-31T05:26:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [1, 0]}]': finished 2024-08-31T05:26:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]}]': finished 2024-08-31T05:26:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 5]}]': finished 2024-08-31T05:26:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 0]}]': finished 2024-08-31T05:26:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [3, 0]}]': finished 2024-08-31T05:26:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:05 smithi073 ceph-mon[71452]: osdmap e50: 6 total, 5 up, 6 in 2024-08-31T05:26:06.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:06.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:06.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:06.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:06 smithi073 ceph-mon[71452]: pgmap v127: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 0 op/s; 55/276 objects degraded (19.928%) 2024-08-31T05:26:06.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:06 smithi073 ceph-mon[71452]: osdmap e51: 6 total, 5 up, 6 in 2024-08-31T05:26:06.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:06 smithi073 ceph-mon[71452]: Health check failed: Degraded data redundancy: 55/276 objects degraded (19.928%), 19 pgs degraded (PG_DEGRADED) 2024-08-31T05:26:07.034 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:06 smithi067 ceph-mon[99941]: pgmap v127: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 0 op/s; 55/276 objects degraded (19.928%) 2024-08-31T05:26:07.034 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:06 smithi067 ceph-mon[99941]: osdmap e51: 6 total, 5 up, 6 in 2024-08-31T05:26:07.034 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:06 smithi067 ceph-mon[99941]: Health check failed: Degraded data redundancy: 55/276 objects degraded (19.928%), 19 pgs degraded (PG_DEGRADED) 2024-08-31T05:26:07.035 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:06 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0[109157]: 2024-08-31T05:26:06.675+0000 7ff1c24a7640 -1 Falling back to public interface 2024-08-31T05:26:08.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:07 smithi067 ceph-mon[99941]: osdmap e52: 6 total, 5 up, 6 in 2024-08-31T05:26:08.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:07 smithi067 ceph-mon[99941]: osdmap e53: 6 total, 5 up, 6 in 2024-08-31T05:26:08.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:07 smithi073 ceph-mon[71452]: osdmap e52: 6 total, 5 up, 6 in 2024-08-31T05:26:08.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:07 smithi073 ceph-mon[71452]: osdmap e53: 6 total, 5 up, 6 in 2024-08-31T05:26:09.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:08 smithi067 ceph-mon[99941]: pgmap v131: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s; 55/276 objects degraded (19.928%) 2024-08-31T05:26:09.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:08 smithi067 ceph-mon[99941]: osdmap e54: 6 total, 5 up, 6 in 2024-08-31T05:26:09.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:08 smithi073 ceph-mon[71452]: pgmap v131: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s; 55/276 objects degraded (19.928%) 2024-08-31T05:26:09.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:08 smithi073 ceph-mon[71452]: osdmap e54: 6 total, 5 up, 6 in 2024-08-31T05:26:10.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:09 smithi067 ceph-mon[99941]: pgmap v133: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 19 active+undersized+degraded, 24 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/276 objects degraded (19.928%); 15/276 objects misplaced (5.435%); 0 B/s, 135 objects/s recovering 2024-08-31T05:26:10.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:09 smithi073 ceph-mon[71452]: pgmap v133: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 19 active+undersized+degraded, 24 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/276 objects degraded (19.928%); 15/276 objects misplaced (5.435%); 0 B/s, 135 objects/s recovering 2024-08-31T05:26:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.997+0000 7fabc5f25640 1 -- 172.21.15.67:0/3203572082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc0103180 msgr2=0x7fabc010b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.997+0000 7fabc5f25640 1 --2- 172.21.15.67:0/3203572082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc0103180 0x7fabc010b670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faba8009880 tx=0x7faba802a530 comp rx=0 tx=0).stop 2024-08-31T05:26:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.997+0000 7fabc5f25640 1 -- 172.21.15.67:0/3203572082 shutdown_connections 2024-08-31T05:26:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.997+0000 7fabc5f25640 1 --2- 172.21.15.67:0/3203572082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc0103180 0x7fabc010b670 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.997+0000 7fabc5f25640 1 --2- 172.21.15.67:0/3203572082 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabc0102860 0x7fabc0102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.997+0000 7fabc5f25640 1 -- 172.21.15.67:0/3203572082 >> 172.21.15.67:0/3203572082 conn(0x7fabc00fc2c0 msgr2=0x7fabc00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.997+0000 7fabc5f25640 1 -- 172.21.15.67:0/3203572082 shutdown_connections 2024-08-31T05:26:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.997+0000 7fabc5f25640 1 -- 172.21.15.67:0/3203572082 wait complete. 2024-08-31T05:26:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.998+0000 7fabc5f25640 1 Processor -- start 2024-08-31T05:26:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.998+0000 7fabc5f25640 1 -- start start 2024-08-31T05:26:11.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.998+0000 7fabc5f25640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc0102860 0x7fabc019d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:11.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.998+0000 7fabc5f25640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabc0103180 0x7fabc019d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.998+0000 7fabc5f25640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fabc010eb70 con 0x7fabc0102860 2024-08-31T05:26:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.998+0000 7fabc5f25640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fabc010e9f0 con 0x7fabc0103180 2024-08-31T05:26:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.998+0000 7fabbf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc0102860 0x7fabc019d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.998+0000 7fabbf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc0102860 0x7fabc019d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33104/0 (socket says 172.21.15.67:33104) 2024-08-31T05:26:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.998+0000 7fabbf7fe640 1 -- 172.21.15.67:0/2420986190 learned_addr learned my addr 172.21.15.67:0/2420986190 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:26:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.998+0000 7fabbeffd640 1 --2- 172.21.15.67:0/2420986190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabc0103180 0x7fabc019d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.999+0000 7fabbf7fe640 1 -- 172.21.15.67:0/2420986190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabc0103180 msgr2=0x7fabc019d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.999+0000 7fabbf7fe640 1 --2- 172.21.15.67:0/2420986190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabc0103180 0x7fabc019d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.999+0000 7fabbf7fe640 1 -- 172.21.15.67:0/2420986190 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc01975e0 con 0x7fabc0102860 2024-08-31T05:26:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.999+0000 7fabbf7fe640 1 --2- 172.21.15.67:0/2420986190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc0102860 0x7fabc019d420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fabb000c810 tx=0x7fabb000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.999+0000 7fabbcff9640 1 -- 172.21.15.67:0/2420986190 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fabb0004020 con 0x7fabc0102860 2024-08-31T05:26:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.999+0000 7fabc5f25640 1 -- 172.21.15.67:0/2420986190 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc01978d0 con 0x7fabc0102860 2024-08-31T05:26:11.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.999+0000 7fabbcff9640 1 -- 172.21.15.67:0/2420986190 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fabb00041c0 con 0x7fabc0102860 2024-08-31T05:26:11.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.999+0000 7fabbcff9640 1 -- 172.21.15.67:0/2420986190 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fabb0003d50 con 0x7fabc0102860 2024-08-31T05:26:11.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:10.999+0000 7fabc5f25640 1 -- 172.21.15.67:0/2420986190 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc0197e30 con 0x7fabc0102860 2024-08-31T05:26:11.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.000+0000 7fabc5f25640 1 -- 172.21.15.67:0/2420986190 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc006a830 con 0x7fabc0102860 2024-08-31T05:26:11.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.001+0000 7fabbcff9640 1 -- 172.21.15.67:0/2420986190 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fabb00079b0 con 0x7fabc0102860 2024-08-31T05:26:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.002+0000 7fabbcff9640 1 --2- 172.21.15.67:0/2420986190 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fabac079e50 0x7fabac07c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.002+0000 7fabbeffd640 1 --2- 172.21.15.67:0/2420986190 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fabac079e50 0x7fabac07c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.002+0000 7fabbcff9640 1 -- 172.21.15.67:0/2420986190 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6509+0+0 (secure 0 0 0) 0x7fabb009c910 con 0x7fabc0102860 2024-08-31T05:26:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.002+0000 7fabbeffd640 1 --2- 172.21.15.67:0/2420986190 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fabac079e50 0x7fabac07c310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fabc0198720 tx=0x7faba8009560 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:11.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.007+0000 7fabbcff9640 1 -- 172.21.15.67:0/2420986190 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fabb0014030 con 0x7fabc0102860 2024-08-31T05:26:11.099 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:10 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:11.099 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:10 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:11.099 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:10 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:11.099 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:10 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:11.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:10 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:11.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:10 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:11.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:10 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:11.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:10 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:11.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.221+0000 7fabc5f25640 1 -- 172.21.15.67:0/2420986190 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fabc0198140 con 0x7fabac079e50 2024-08-31T05:26:11.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.222+0000 7fabbcff9640 1 -- 172.21.15.67:0/2420986190 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fabc0198140 con 0x7fabac079e50 2024-08-31T05:26:11.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.225+0000 7fabc5f25640 1 -- 172.21.15.67:0/2420986190 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fabac079e50 msgr2=0x7fabac07c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:11.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.225+0000 7fabc5f25640 1 --2- 172.21.15.67:0/2420986190 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fabac079e50 0x7fabac07c310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fabc0198720 tx=0x7faba8009560 comp rx=0 tx=0).stop 2024-08-31T05:26:11.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.226+0000 7fabc5f25640 1 -- 172.21.15.67:0/2420986190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc0102860 msgr2=0x7fabc019d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:11.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.226+0000 7fabc5f25640 1 --2- 172.21.15.67:0/2420986190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc0102860 0x7fabc019d420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fabb000c810 tx=0x7fabb000ccd0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.226+0000 7fabc5f25640 1 -- 172.21.15.67:0/2420986190 shutdown_connections 2024-08-31T05:26:11.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.226+0000 7fabc5f25640 1 --2- 172.21.15.67:0/2420986190 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fabac079e50 0x7fabac07c310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.226+0000 7fabc5f25640 1 --2- 172.21.15.67:0/2420986190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabc0103180 0x7fabc019d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.226+0000 7fabc5f25640 1 --2- 172.21.15.67:0/2420986190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc0102860 0x7fabc019d420 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.226+0000 7fabc5f25640 1 -- 172.21.15.67:0/2420986190 >> 172.21.15.67:0/2420986190 conn(0x7fabc00fc2c0 msgr2=0x7fabc0107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:11.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.226+0000 7fabc5f25640 1 -- 172.21.15.67:0/2420986190 shutdown_connections 2024-08-31T05:26:11.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.226+0000 7fabc5f25640 1 -- 172.21.15.67:0/2420986190 wait complete. 2024-08-31T05:26:11.241 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:26:11.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.317+0000 7fc869fbe640 1 -- 172.21.15.67:0/4003864790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8641076a0 msgr2=0x7fc864107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:11.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.317+0000 7fc869fbe640 1 --2- 172.21.15.67:0/4003864790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8641076a0 0x7fc864107a80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc854009880 tx=0x7fc85402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.317+0000 7fc869fbe640 1 -- 172.21.15.67:0/4003864790 shutdown_connections 2024-08-31T05:26:11.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.317+0000 7fc869fbe640 1 --2- 172.21.15.67:0/4003864790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8641016a0 0x7fc864101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.317+0000 7fc869fbe640 1 --2- 172.21.15.67:0/4003864790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8641076a0 0x7fc864107a80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.317+0000 7fc869fbe640 1 -- 172.21.15.67:0/4003864790 >> 172.21.15.67:0/4003864790 conn(0x7fc8640fd380 msgr2=0x7fc8640ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:11.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.317+0000 7fc869fbe640 1 -- 172.21.15.67:0/4003864790 shutdown_connections 2024-08-31T05:26:11.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.317+0000 7fc869fbe640 1 -- 172.21.15.67:0/4003864790 wait complete. 2024-08-31T05:26:11.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.318+0000 7fc869fbe640 1 Processor -- start 2024-08-31T05:26:11.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.318+0000 7fc869fbe640 1 -- start start 2024-08-31T05:26:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.319+0000 7fc869fbe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8641016a0 0x7fc86419d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.319+0000 7fc869fbe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8641076a0 0x7fc86419d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.319+0000 7fc869fbe640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc86410eb70 con 0x7fc8641076a0 2024-08-31T05:26:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.319+0000 7fc869fbe640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc86410e9f0 con 0x7fc8641016a0 2024-08-31T05:26:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.319+0000 7fc862ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8641076a0 0x7fc86419d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.319+0000 7fc862ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8641076a0 0x7fc86419d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33122/0 (socket says 172.21.15.67:33122) 2024-08-31T05:26:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.319+0000 7fc862ffd640 1 -- 172.21.15.67:0/2748168005 learned_addr learned my addr 172.21.15.67:0/2748168005 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:26:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.319+0000 7fc8637fe640 1 --2- 172.21.15.67:0/2748168005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8641016a0 0x7fc86419d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.319+0000 7fc862ffd640 1 -- 172.21.15.67:0/2748168005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8641016a0 msgr2=0x7fc86419d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.319+0000 7fc862ffd640 1 --2- 172.21.15.67:0/2748168005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8641016a0 0x7fc86419d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.319+0000 7fc862ffd640 1 -- 172.21.15.67:0/2748168005 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8641975a0 con 0x7fc8641076a0 2024-08-31T05:26:11.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.320+0000 7fc862ffd640 1 --2- 172.21.15.67:0/2748168005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8641076a0 0x7fc86419d920 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc85800c8f0 tx=0x7fc85800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:11.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.320+0000 7fc860ff9640 1 -- 172.21.15.67:0/2748168005 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8580079b0 con 0x7fc8641076a0 2024-08-31T05:26:11.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.320+0000 7fc869fbe640 1 -- 172.21.15.67:0/2748168005 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc864197890 con 0x7fc8641076a0 2024-08-31T05:26:11.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.320+0000 7fc860ff9640 1 -- 172.21.15.67:0/2748168005 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc8580054e0 con 0x7fc8641076a0 2024-08-31T05:26:11.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.320+0000 7fc860ff9640 1 -- 172.21.15.67:0/2748168005 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc858004dd0 con 0x7fc8641076a0 2024-08-31T05:26:11.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.320+0000 7fc869fbe640 1 -- 172.21.15.67:0/2748168005 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc864197e20 con 0x7fc8641076a0 2024-08-31T05:26:11.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.321+0000 7fc869fbe640 1 -- 172.21.15.67:0/2748168005 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc864102de0 con 0x7fc8641076a0 2024-08-31T05:26:11.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.322+0000 7fc860ff9640 1 -- 172.21.15.67:0/2748168005 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fc858005020 con 0x7fc8641076a0 2024-08-31T05:26:11.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.322+0000 7fc860ff9640 1 --2- 172.21.15.67:0/2748168005 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc84c079e00 0x7fc84c07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:11.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.322+0000 7fc860ff9640 1 -- 172.21.15.67:0/2748168005 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6509+0+0 (secure 0 0 0) 0x7fc85809c9f0 con 0x7fc8641076a0 2024-08-31T05:26:11.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.322+0000 7fc8637fe640 1 --2- 172.21.15.67:0/2748168005 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc84c079e00 0x7fc84c07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:11.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.323+0000 7fc8637fe640 1 --2- 172.21.15.67:0/2748168005 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc84c079e00 0x7fc84c07c2c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc854000c00 tx=0x7fc854031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:11.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.327+0000 7fc860ff9640 1 -- 172.21.15.67:0/2748168005 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc858014030 con 0x7fc8641076a0 2024-08-31T05:26:11.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.535+0000 7fc869fbe640 1 -- 172.21.15.67:0/2748168005 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc864198190 con 0x7fc84c079e00 2024-08-31T05:26:11.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.536+0000 7fc860ff9640 1 -- 172.21.15.67:0/2748168005 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fc864198190 con 0x7fc84c079e00 2024-08-31T05:26:11.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.538+0000 7fc869fbe640 1 -- 172.21.15.67:0/2748168005 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc84c079e00 msgr2=0x7fc84c07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:11.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.538+0000 7fc869fbe640 1 --2- 172.21.15.67:0/2748168005 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc84c079e00 0x7fc84c07c2c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc854000c00 tx=0x7fc854031400 comp rx=0 tx=0).stop 2024-08-31T05:26:11.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.538+0000 7fc869fbe640 1 -- 172.21.15.67:0/2748168005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8641076a0 msgr2=0x7fc86419d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:11.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.538+0000 7fc869fbe640 1 --2- 172.21.15.67:0/2748168005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8641076a0 0x7fc86419d920 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc85800c8f0 tx=0x7fc85800cdb0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.538+0000 7fc869fbe640 1 -- 172.21.15.67:0/2748168005 shutdown_connections 2024-08-31T05:26:11.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.538+0000 7fc869fbe640 1 --2- 172.21.15.67:0/2748168005 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc84c079e00 0x7fc84c07c2c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.538+0000 7fc869fbe640 1 --2- 172.21.15.67:0/2748168005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8641076a0 0x7fc86419d920 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.538+0000 7fc869fbe640 1 --2- 172.21.15.67:0/2748168005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8641016a0 0x7fc86419d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.538+0000 7fc869fbe640 1 -- 172.21.15.67:0/2748168005 >> 172.21.15.67:0/2748168005 conn(0x7fc8640fd380 msgr2=0x7fc8640fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:11.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.539+0000 7fc869fbe640 1 -- 172.21.15.67:0/2748168005 shutdown_connections 2024-08-31T05:26:11.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.539+0000 7fc869fbe640 1 -- 172.21.15.67:0/2748168005 wait complete. 2024-08-31T05:26:11.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.624+0000 7f1007970640 1 -- 172.21.15.67:0/1924916929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1000106660 msgr2=0x7f1000106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:11.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.624+0000 7f1007970640 1 --2- 172.21.15.67:0/1924916929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1000106660 0x7f1000106a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009880 tx=0x7f0ffc02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.624+0000 7f1007970640 1 -- 172.21.15.67:0/1924916929 shutdown_connections 2024-08-31T05:26:11.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.624+0000 7f1007970640 1 --2- 172.21.15.67:0/1924916929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10001005b0 0x7f1000100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.624+0000 7f1007970640 1 --2- 172.21.15.67:0/1924916929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1000106660 0x7f1000106a40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.624+0000 7f1007970640 1 -- 172.21.15.67:0/1924916929 >> 172.21.15.67:0/1924916929 conn(0x7f10000fc2f0 msgr2=0x7f10000fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:11.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.624+0000 7f1007970640 1 -- 172.21.15.67:0/1924916929 shutdown_connections 2024-08-31T05:26:11.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.624+0000 7f1007970640 1 -- 172.21.15.67:0/1924916929 wait complete. 2024-08-31T05:26:11.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.625+0000 7f1007970640 1 Processor -- start 2024-08-31T05:26:11.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.625+0000 7f1007970640 1 -- start start 2024-08-31T05:26:11.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.625+0000 7f1007970640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10001005b0 0x7f100019d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:11.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.625+0000 7f1007970640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1000106660 0x7f100019d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:11.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.625+0000 7f1007970640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f100010da50 con 0x7f1000106660 2024-08-31T05:26:11.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.625+0000 7f1007970640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f100010d8d0 con 0x7f10001005b0 2024-08-31T05:26:11.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.625+0000 7f1004f0b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1000106660 0x7f100019d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:11.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.625+0000 7f1004f0b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1000106660 0x7f100019d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33126/0 (socket says 172.21.15.67:33126) 2024-08-31T05:26:11.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.625+0000 7f1004f0b640 1 -- 172.21.15.67:0/51669231 learned_addr learned my addr 172.21.15.67:0/51669231 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:26:11.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.625+0000 7f100570c640 1 --2- 172.21.15.67:0/51669231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10001005b0 0x7f100019d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:11.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.625+0000 7f1004f0b640 1 -- 172.21.15.67:0/51669231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10001005b0 msgr2=0x7f100019d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:11.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.626+0000 7f1004f0b640 1 --2- 172.21.15.67:0/51669231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10001005b0 0x7f100019d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.626+0000 7f1004f0b640 1 -- 172.21.15.67:0/51669231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10001975a0 con 0x7f1000106660 2024-08-31T05:26:11.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.626+0000 7f100570c640 1 --2- 172.21.15.67:0/51669231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10001005b0 0x7f100019d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:26:11.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.626+0000 7f1004f0b640 1 --2- 172.21.15.67:0/51669231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1000106660 0x7f100019d920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000c810 tx=0x7f0ff000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:11.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.626+0000 7f0ff67fc640 1 -- 172.21.15.67:0/51669231 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ff0004020 con 0x7f1000106660 2024-08-31T05:26:11.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.626+0000 7f0ff67fc640 1 -- 172.21.15.67:0/51669231 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ff00041c0 con 0x7f1000106660 2024-08-31T05:26:11.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.626+0000 7f1007970640 1 -- 172.21.15.67:0/51669231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1000197890 con 0x7f1000106660 2024-08-31T05:26:11.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.626+0000 7f0ff67fc640 1 -- 172.21.15.67:0/51669231 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ff00047a0 con 0x7f1000106660 2024-08-31T05:26:11.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.626+0000 7f1007970640 1 -- 172.21.15.67:0/51669231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1000197e20 con 0x7f1000106660 2024-08-31T05:26:11.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.627+0000 7f1007970640 1 -- 172.21.15.67:0/51669231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1000101cd0 con 0x7f1000106660 2024-08-31T05:26:11.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.628+0000 7f0ff67fc640 1 -- 172.21.15.67:0/51669231 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f0ff00079b0 con 0x7f1000106660 2024-08-31T05:26:11.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.628+0000 7f0ff67fc640 1 --2- 172.21.15.67:0/51669231 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0fec079e00 0x7f0fec07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:11.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.629+0000 7f0ff67fc640 1 -- 172.21.15.67:0/51669231 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6509+0+0 (secure 0 0 0) 0x7f0ff009ca00 con 0x7f1000106660 2024-08-31T05:26:11.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.629+0000 7f100570c640 1 --2- 172.21.15.67:0/51669231 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0fec079e00 0x7f0fec07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:11.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.629+0000 7f100570c640 1 --2- 172.21.15.67:0/51669231 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0fec079e00 0x7f0fec07c2c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc006010 tx=0x7f0ffc0095f0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:11.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.633+0000 7f0ff67fc640 1 -- 172.21.15.67:0/51669231 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0ff0014030 con 0x7f1000106660 2024-08-31T05:26:11.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.830+0000 7f1007970640 1 -- 172.21.15.67:0/51669231 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f10001980d0 con 0x7f0fec079e00 2024-08-31T05:26:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.841+0000 7f0ff67fc640 1 -- 172.21.15.67:0/51669231 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f10001980d0 con 0x7f0fec079e00 2024-08-31T05:26:11.843 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:26:11.843 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (2m) 2s ago 12m 21.3M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:26:11.843 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (5m) 2s ago 13m 8912k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:26:11.843 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (4m) 24s ago 12m 8368k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:26:11.843 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (32s) 2s ago 13m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 910f4f105c4b 2024-08-31T05:26:11.844 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (27s) 24s ago 12m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 0dcc86f98a20 2024-08-31T05:26:11.844 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (114s) 2s ago 12m 80.4M - c8b91775d855 3a9a0f88928d 2024-08-31T05:26:11.844 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (7m) 2s ago 7m 92.0M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:26:11.844 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (7m) 2s ago 7m 155M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:26:11.844 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (7m) 24s ago 7m 16.1M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:26:11.844 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (7m) 24s ago 7m 18.1M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:26:11.844 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (4m) 2s ago 14m 589M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:26:11.844 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (3m) 24s ago 12m 524M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:26:11.844 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (59s) 2s ago 14m 106M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 25a28efbbd37 2024-08-31T05:26:11.844 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (44s) 24s ago 12m 92.8M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 6be0f0999860 2024-08-31T05:26:11.844 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (3m) 2s ago 13m 10.2M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:26:11.844 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (3m) 24s ago 12m 10.9M - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:26:11.844 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (7s) 2s ago 11m 81.4M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 aab0516dcbfa 2024-08-31T05:26:11.845 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (10m) 2s ago 10m 225M 1216M 19.1.1-242-g244a32d3 395b9209a980 82dbd3906629 2024-08-31T05:26:11.845 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (10m) 2s ago 10m 187M 1216M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:26:11.845 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (9m) 24s ago 9m 251M 2240M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:26:11.845 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (9m) 24s ago 9m 213M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:26:11.845 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (8m) 24s ago 8m 188M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:26:11.845 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (2m) 2s ago 12m 49.2M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:26:11.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.844+0000 7f1007970640 1 -- 172.21.15.67:0/51669231 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0fec079e00 msgr2=0x7f0fec07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:11.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.844+0000 7f1007970640 1 --2- 172.21.15.67:0/51669231 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0fec079e00 0x7f0fec07c2c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc006010 tx=0x7f0ffc0095f0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.844+0000 7f1007970640 1 -- 172.21.15.67:0/51669231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1000106660 msgr2=0x7f100019d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.844+0000 7f1007970640 1 --2- 172.21.15.67:0/51669231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1000106660 0x7f100019d920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000c810 tx=0x7f0ff000ccd0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.844+0000 7f1007970640 1 -- 172.21.15.67:0/51669231 shutdown_connections 2024-08-31T05:26:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.844+0000 7f1007970640 1 --2- 172.21.15.67:0/51669231 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0fec079e00 0x7f0fec07c2c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.844+0000 7f1007970640 1 --2- 172.21.15.67:0/51669231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1000106660 0x7f100019d920 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.844+0000 7f1007970640 1 --2- 172.21.15.67:0/51669231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10001005b0 0x7f100019d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.844+0000 7f1007970640 1 -- 172.21.15.67:0/51669231 >> 172.21.15.67:0/51669231 conn(0x7f10000fc2f0 msgr2=0x7f1000069ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.844+0000 7f1007970640 1 -- 172.21.15.67:0/51669231 shutdown_connections 2024-08-31T05:26:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.844+0000 7f1007970640 1 -- 172.21.15.67:0/51669231 wait complete. 2024-08-31T05:26:11.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.929+0000 7fa4a23c5640 1 -- 172.21.15.67:0/1275601924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c1005b0 msgr2=0x7fa49c100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:11.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.929+0000 7fa4a23c5640 1 --2- 172.21.15.67:0/1275601924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c1005b0 0x7fa49c100a10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa490009880 tx=0x7fa49002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.929+0000 7fa4a23c5640 1 -- 172.21.15.67:0/1275601924 shutdown_connections 2024-08-31T05:26:11.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.929+0000 7fa4a23c5640 1 --2- 172.21.15.67:0/1275601924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c1005b0 0x7fa49c100a10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.929+0000 7fa4a23c5640 1 --2- 172.21.15.67:0/1275601924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c106660 0x7fa49c106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.929+0000 7fa4a23c5640 1 -- 172.21.15.67:0/1275601924 >> 172.21.15.67:0/1275601924 conn(0x7fa49c0fc2f0 msgr2=0x7fa49c0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:11.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.929+0000 7fa4a23c5640 1 -- 172.21.15.67:0/1275601924 shutdown_connections 2024-08-31T05:26:11.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.929+0000 7fa4a23c5640 1 -- 172.21.15.67:0/1275601924 wait complete. 2024-08-31T05:26:11.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.929+0000 7fa4a23c5640 1 Processor -- start 2024-08-31T05:26:11.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.930+0000 7fa4a23c5640 1 -- start start 2024-08-31T05:26:11.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.930+0000 7fa4a23c5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c1005b0 0x7fa49c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:11.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.930+0000 7fa4a23c5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c106660 0x7fa49c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:11.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.930+0000 7fa4a23c5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c10da50 con 0x7fa49c1005b0 2024-08-31T05:26:11.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.930+0000 7fa4a23c5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c10d8d0 con 0x7fa49c106660 2024-08-31T05:26:11.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.930+0000 7fa49bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c1005b0 0x7fa49c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:11.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.930+0000 7fa49bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c1005b0 0x7fa49c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33134/0 (socket says 172.21.15.67:33134) 2024-08-31T05:26:11.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.930+0000 7fa49bfff640 1 -- 172.21.15.67:0/950356991 learned_addr learned my addr 172.21.15.67:0/950356991 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:26:11.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.930+0000 7fa49b7fe640 1 --2- 172.21.15.67:0/950356991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c106660 0x7fa49c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:11.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.930+0000 7fa49bfff640 1 -- 172.21.15.67:0/950356991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c106660 msgr2=0x7fa49c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:11.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.930+0000 7fa49bfff640 1 --2- 172.21.15.67:0/950356991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c106660 0x7fa49c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:11.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.930+0000 7fa49bfff640 1 -- 172.21.15.67:0/950356991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c199020 con 0x7fa49c1005b0 2024-08-31T05:26:11.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.931+0000 7fa49bfff640 1 --2- 172.21.15.67:0/950356991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c1005b0 0x7fa49c1984e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00d8d0 tx=0x7fa48c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:11.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.931+0000 7fa4997fa640 1 -- 172.21.15.67:0/950356991 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa48c017070 con 0x7fa49c1005b0 2024-08-31T05:26:11.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.931+0000 7fa4997fa640 1 -- 172.21.15.67:0/950356991 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa48c010460 con 0x7fa49c1005b0 2024-08-31T05:26:11.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.931+0000 7fa4a23c5640 1 -- 172.21.15.67:0/950356991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49c199310 con 0x7fa49c1005b0 2024-08-31T05:26:11.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.931+0000 7fa4a23c5640 1 -- 172.21.15.67:0/950356991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49c1a1910 con 0x7fa49c1005b0 2024-08-31T05:26:11.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.931+0000 7fa4997fa640 1 -- 172.21.15.67:0/950356991 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa48c00f5f0 con 0x7fa49c1005b0 2024-08-31T05:26:11.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.932+0000 7fa4a23c5640 1 -- 172.21.15.67:0/950356991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49c101cd0 con 0x7fa49c1005b0 2024-08-31T05:26:11.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.933+0000 7fa4997fa640 1 -- 172.21.15.67:0/950356991 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fa48c009a30 con 0x7fa49c1005b0 2024-08-31T05:26:11.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.933+0000 7fa4997fa640 1 --2- 172.21.15.67:0/950356991 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa484079e40 0x7fa48407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:11.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.933+0000 7fa4997fa640 1 -- 172.21.15.67:0/950356991 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6509+0+0 (secure 0 0 0) 0x7fa48c09c890 con 0x7fa49c1005b0 2024-08-31T05:26:11.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.933+0000 7fa49b7fe640 1 --2- 172.21.15.67:0/950356991 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa484079e40 0x7fa48407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:11.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.934+0000 7fa49b7fe640 1 --2- 172.21.15.67:0/950356991 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa484079e40 0x7fa48407c300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa49c06a590 tx=0x7fa490004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:11.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:11.938+0000 7fa4997fa640 1 -- 172.21.15.67:0/950356991 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa49c199310 con 0x7fa49c1005b0 2024-08-31T05:26:11.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:11 smithi073 ceph-mon[71452]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:11.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:11 smithi073 ceph-mon[71452]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:11.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:11 smithi073 ceph-mon[71452]: pgmap v134: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 19 active+undersized+degraded, 24 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/276 objects degraded (19.928%); 15/276 objects misplaced (5.435%); 0 B/s, 91 objects/s recovering 2024-08-31T05:26:12.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.197+0000 7fa4a23c5640 1 -- 172.21.15.67:0/950356991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa49c108a80 con 0x7fa49c1005b0 2024-08-31T05:26:12.200 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:11 smithi067 ceph-mon[99941]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:12.200 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:11 smithi067 ceph-mon[99941]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:12.200 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:11 smithi067 ceph-mon[99941]: pgmap v134: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 19 active+undersized+degraded, 24 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/276 objects degraded (19.928%); 15/276 objects misplaced (5.435%); 0 B/s, 91 objects/s recovering 2024-08-31T05:26:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.198+0000 7fa4997fa640 1 -- 172.21.15.67:0/950356991 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+732 (secure 0 0 0) 0x7fa48c0683e0 con 0x7fa49c1005b0 2024-08-31T05:26:12.200 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:26:12.200 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:26:12.200 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:26:12.201 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:26:12.201 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:26:12.201 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:26:12.201 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:26:12.201 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:26:12.201 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 5 2024-08-31T05:26:12.201 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:26:12.201 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:26:12.201 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:26:12.201 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:26:12.201 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:26:12.201 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 9, 2024-08-31T05:26:12.201 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 4 2024-08-31T05:26:12.201 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:26:12.202 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:26:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.200+0000 7fa4a23c5640 1 -- 172.21.15.67:0/950356991 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa484079e40 msgr2=0x7fa48407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.200+0000 7fa4a23c5640 1 --2- 172.21.15.67:0/950356991 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa484079e40 0x7fa48407c300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa49c06a590 tx=0x7fa490004f30 comp rx=0 tx=0).stop 2024-08-31T05:26:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.200+0000 7fa4a23c5640 1 -- 172.21.15.67:0/950356991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c1005b0 msgr2=0x7fa49c1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.200+0000 7fa4a23c5640 1 --2- 172.21.15.67:0/950356991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c1005b0 0x7fa49c1984e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00d8d0 tx=0x7fa48c00dd90 comp rx=0 tx=0).stop 2024-08-31T05:26:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.200+0000 7fa4a23c5640 1 -- 172.21.15.67:0/950356991 shutdown_connections 2024-08-31T05:26:12.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.200+0000 7fa4a23c5640 1 --2- 172.21.15.67:0/950356991 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa484079e40 0x7fa48407c300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.200+0000 7fa4a23c5640 1 --2- 172.21.15.67:0/950356991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c106660 0x7fa49c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.200+0000 7fa4a23c5640 1 --2- 172.21.15.67:0/950356991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49c1005b0 0x7fa49c1984e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.200+0000 7fa4a23c5640 1 -- 172.21.15.67:0/950356991 >> 172.21.15.67:0/950356991 conn(0x7fa49c0fc2f0 msgr2=0x7fa49c0fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:12.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.201+0000 7fa4a23c5640 1 -- 172.21.15.67:0/950356991 shutdown_connections 2024-08-31T05:26:12.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.201+0000 7fa4a23c5640 1 -- 172.21.15.67:0/950356991 wait complete. 2024-08-31T05:26:12.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.300+0000 7f6b29311640 1 -- 172.21.15.67:0/1287886320 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b241012e0 msgr2=0x7f6b241016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.300+0000 7f6b29311640 1 --2- 172.21.15.67:0/1287886320 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b241012e0 0x7f6b241016c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6b14009880 tx=0x7f6b1402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.300+0000 7f6b29311640 1 -- 172.21.15.67:0/1287886320 shutdown_connections 2024-08-31T05:26:12.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.300+0000 7f6b29311640 1 --2- 172.21.15.67:0/1287886320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b24101c90 0x7f6b24105240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.300+0000 7f6b29311640 1 --2- 172.21.15.67:0/1287886320 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b241012e0 0x7f6b241016c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.300+0000 7f6b29311640 1 -- 172.21.15.67:0/1287886320 >> 172.21.15.67:0/1287886320 conn(0x7f6b24076f80 msgr2=0x7f6b24077390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:12.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.300+0000 7f6b29311640 1 -- 172.21.15.67:0/1287886320 shutdown_connections 2024-08-31T05:26:12.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.300+0000 7f6b29311640 1 -- 172.21.15.67:0/1287886320 wait complete. 2024-08-31T05:26:12.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.301+0000 7f6b29311640 1 Processor -- start 2024-08-31T05:26:12.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.302+0000 7f6b29311640 1 -- start start 2024-08-31T05:26:12.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.302+0000 7f6b29311640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b24101c90 0x7f6b2419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:12.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.302+0000 7f6b29311640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b2419dbb0 0x7f6b24197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:12.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.302+0000 7f6b29311640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2410da70 con 0x7f6b2419dbb0 2024-08-31T05:26:12.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.302+0000 7f6b29311640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2410d8f0 con 0x7f6b24101c90 2024-08-31T05:26:12.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.302+0000 7f6b227fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b2419dbb0 0x7f6b24197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:12.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.302+0000 7f6b227fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b2419dbb0 0x7f6b24197740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33154/0 (socket says 172.21.15.67:33154) 2024-08-31T05:26:12.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.302+0000 7f6b227fc640 1 -- 172.21.15.67:0/3140731607 learned_addr learned my addr 172.21.15.67:0/3140731607 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:26:12.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.302+0000 7f6b22ffd640 1 --2- 172.21.15.67:0/3140731607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b24101c90 0x7f6b2419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:12.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.303+0000 7f6b227fc640 1 -- 172.21.15.67:0/3140731607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b24101c90 msgr2=0x7f6b2419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.303+0000 7f6b227fc640 1 --2- 172.21.15.67:0/3140731607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b24101c90 0x7f6b2419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.303+0000 7f6b227fc640 1 -- 172.21.15.67:0/3140731607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b24197c80 con 0x7f6b2419dbb0 2024-08-31T05:26:12.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.303+0000 7f6b227fc640 1 --2- 172.21.15.67:0/3140731607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b2419dbb0 0x7f6b24197740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b1800e970 tx=0x7f6b1800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:12.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.303+0000 7f6b0bfff640 1 -- 172.21.15.67:0/3140731607 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b1800cac0 con 0x7f6b2419dbb0 2024-08-31T05:26:12.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.303+0000 7f6b0bfff640 1 -- 172.21.15.67:0/3140731607 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b180054e0 con 0x7f6b2419dbb0 2024-08-31T05:26:12.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.303+0000 7f6b0bfff640 1 -- 172.21.15.67:0/3140731607 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b18010430 con 0x7f6b2419dbb0 2024-08-31T05:26:12.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.303+0000 7f6b29311640 1 -- 172.21.15.67:0/3140731607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b24197f70 con 0x7f6b2419dbb0 2024-08-31T05:26:12.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.303+0000 7f6b29311640 1 -- 172.21.15.67:0/3140731607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b24198500 con 0x7f6b2419dbb0 2024-08-31T05:26:12.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.305+0000 7f6b29311640 1 -- 172.21.15.67:0/3140731607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b24069670 con 0x7f6b2419dbb0 2024-08-31T05:26:12.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.306+0000 7f6b0bfff640 1 -- 172.21.15.67:0/3140731607 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f6b18004ee0 con 0x7f6b2419dbb0 2024-08-31T05:26:12.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.306+0000 7f6b0bfff640 1 --2- 172.21.15.67:0/3140731607 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6b0c079e40 0x7f6b0c07c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:12.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.307+0000 7f6b0bfff640 1 -- 172.21.15.67:0/3140731607 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6509+0+0 (secure 0 0 0) 0x7f6b1809d000 con 0x7f6b2419dbb0 2024-08-31T05:26:12.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.307+0000 7f6b22ffd640 1 --2- 172.21.15.67:0/3140731607 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6b0c079e40 0x7f6b0c07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:12.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.308+0000 7f6b22ffd640 1 --2- 172.21.15.67:0/3140731607 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6b0c079e40 0x7f6b0c07c300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6b14000c00 tx=0x7f6b14005690 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:12.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.312+0000 7f6b0bfff640 1 -- 172.21.15.67:0/3140731607 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6b180649e0 con 0x7f6b2419dbb0 2024-08-31T05:26:12.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.548+0000 7f6b29311640 1 -- 172.21.15.67:0/3140731607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6b240ff670 con 0x7f6b2419dbb0 2024-08-31T05:26:12.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.548+0000 7f6b0bfff640 1 -- 172.21.15.67:0/3140731607 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2042 (secure 0 0 0) 0x7f6b18068b50 con 0x7f6b2419dbb0 2024-08-31T05:26:12.551 INFO:teuthology.orchestra.run.smithi067.stdout:e15 2024-08-31T05:26:12.551 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-08-31T05:18:35:124059+0000 2024-08-31T05:26:12.551 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:26:12.551 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:26:12.551 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-08-31T05:26:12.552 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:26:12.552 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:26:12.552 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-08-31T05:26:12.552 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 13 2024-08-31T05:26:12.552 INFO:teuthology.orchestra.run.smithi067.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T05:26:12.552 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:26:12.552 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-08-31T05:18:33.086400+0000 2024-08-31T05:26:12.552 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-08-31T05:26:12.552 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-08-31T05:26:12.552 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2024-08-31T05:26:12.553 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-08-31T05:26:12.553 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-08-31T05:26:12.553 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-08-31T05:26:12.553 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-08-31T05:26:12.553 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-08-31T05:26:12.553 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 0 2024-08-31T05:26:12.553 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:26:12.553 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2024-08-31T05:26:12.553 INFO:teuthology.orchestra.run.smithi067.stdout:in 0 2024-08-31T05:26:12.553 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14554} 2024-08-31T05:26:12.553 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-08-31T05:26:12.553 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-08-31T05:26:12.553 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-08-31T05:26:12.553 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-08-31T05:26:12.554 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-08-31T05:26:12.554 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data enabled 2024-08-31T05:26:12.554 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-08-31T05:26:12.554 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-08-31T05:26:12.554 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2024-08-31T05:26:12.554 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 14554 members: 14554 2024-08-31T05:26:12.554 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.tskvpt{0:14554} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:26:12.554 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.beqeql{0:14566} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:26:12.554 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:26:12.554 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:26:12.554 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2024-08-31T05:26:12.554 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:26:12.554 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.kfbmeo{-1:24299} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:26:12.554 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.gsnhxi{-1:24307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6824/2383176383,v1:172.21.15.73:6825/2383176383] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:26:12.555 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-08-31T05:26:12.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.550+0000 7f6b29311640 1 -- 172.21.15.67:0/3140731607 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6b0c079e40 msgr2=0x7f6b0c07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.550+0000 7f6b29311640 1 --2- 172.21.15.67:0/3140731607 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6b0c079e40 0x7f6b0c07c300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6b14000c00 tx=0x7f6b14005690 comp rx=0 tx=0).stop 2024-08-31T05:26:12.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.550+0000 7f6b29311640 1 -- 172.21.15.67:0/3140731607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b2419dbb0 msgr2=0x7f6b24197740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.550+0000 7f6b29311640 1 --2- 172.21.15.67:0/3140731607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b2419dbb0 0x7f6b24197740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b1800e970 tx=0x7f6b1800ee30 comp rx=0 tx=0).stop 2024-08-31T05:26:12.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.550+0000 7f6b29311640 1 -- 172.21.15.67:0/3140731607 shutdown_connections 2024-08-31T05:26:12.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.550+0000 7f6b29311640 1 --2- 172.21.15.67:0/3140731607 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6b0c079e40 0x7f6b0c07c300 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.550+0000 7f6b29311640 1 --2- 172.21.15.67:0/3140731607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b2419dbb0 0x7f6b24197740 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.550+0000 7f6b29311640 1 --2- 172.21.15.67:0/3140731607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b24101c90 0x7f6b2419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.550+0000 7f6b29311640 1 -- 172.21.15.67:0/3140731607 >> 172.21.15.67:0/3140731607 conn(0x7f6b24076f80 msgr2=0x7f6b241026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:12.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.551+0000 7f6b29311640 1 -- 172.21.15.67:0/3140731607 shutdown_connections 2024-08-31T05:26:12.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.551+0000 7f6b29311640 1 -- 172.21.15.67:0/3140731607 wait complete. 2024-08-31T05:26:12.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.637+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1685307741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4103180 msgr2=0x7fb9c410b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.637+0000 7fb9cacb5640 1 --2- 172.21.15.67:0/1685307741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4103180 0x7fb9c410b670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009880 tx=0x7fb9b002a530 comp rx=0 tx=0).stop 2024-08-31T05:26:12.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.637+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1685307741 shutdown_connections 2024-08-31T05:26:12.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.637+0000 7fb9cacb5640 1 --2- 172.21.15.67:0/1685307741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4103180 0x7fb9c410b670 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.637+0000 7fb9cacb5640 1 --2- 172.21.15.67:0/1685307741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9c4102860 0x7fb9c4102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.637+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1685307741 >> 172.21.15.67:0/1685307741 conn(0x7fb9c40fc2c0 msgr2=0x7fb9c40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:12.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.637+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1685307741 shutdown_connections 2024-08-31T05:26:12.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.637+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1685307741 wait complete. 2024-08-31T05:26:12.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.638+0000 7fb9cacb5640 1 Processor -- start 2024-08-31T05:26:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.638+0000 7fb9cacb5640 1 -- start start 2024-08-31T05:26:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.638+0000 7fb9cacb5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9c4102860 0x7fb9c419d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.638+0000 7fb9cacb5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4103180 0x7fb9c419d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.638+0000 7fb9cacb5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c410eb90 con 0x7fb9c4103180 2024-08-31T05:26:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.638+0000 7fb9cacb5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c410ea10 con 0x7fb9c4102860 2024-08-31T05:26:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.639+0000 7fb9c3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4103180 0x7fb9c419d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.639+0000 7fb9c3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4103180 0x7fb9c419d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33176/0 (socket says 172.21.15.67:33176) 2024-08-31T05:26:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.639+0000 7fb9c3fff640 1 -- 172.21.15.67:0/1890823476 learned_addr learned my addr 172.21.15.67:0/1890823476 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:26:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.639+0000 7fb9c8a51640 1 --2- 172.21.15.67:0/1890823476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9c4102860 0x7fb9c419d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.639+0000 7fb9c3fff640 1 -- 172.21.15.67:0/1890823476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9c4102860 msgr2=0x7fb9c419d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.639+0000 7fb9c3fff640 1 --2- 172.21.15.67:0/1890823476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9c4102860 0x7fb9c419d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.639+0000 7fb9c3fff640 1 -- 172.21.15.67:0/1890823476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c41975c0 con 0x7fb9c4103180 2024-08-31T05:26:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.639+0000 7fb9c8a51640 1 --2- 172.21.15.67:0/1890823476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9c4102860 0x7fb9c419d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:26:12.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.639+0000 7fb9c3fff640 1 --2- 172.21.15.67:0/1890823476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4103180 0x7fb9c419d940 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0031460 tx=0x7fb9b0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:12.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.640+0000 7fb9c1ffb640 1 -- 172.21.15.67:0/1890823476 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9b003f070 con 0x7fb9c4103180 2024-08-31T05:26:12.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.640+0000 7fb9c1ffb640 1 -- 172.21.15.67:0/1890823476 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb9b00035f0 con 0x7fb9c4103180 2024-08-31T05:26:12.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.640+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1890823476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c4197850 con 0x7fb9c4103180 2024-08-31T05:26:12.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.640+0000 7fb9c1ffb640 1 -- 172.21.15.67:0/1890823476 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9b0035030 con 0x7fb9c4103180 2024-08-31T05:26:12.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.640+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1890823476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c4197cc0 con 0x7fb9c4103180 2024-08-31T05:26:12.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.642+0000 7fb9c1ffb640 1 -- 172.21.15.67:0/1890823476 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fb9b0042070 con 0x7fb9c4103180 2024-08-31T05:26:12.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.642+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1890823476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c406a830 con 0x7fb9c4103180 2024-08-31T05:26:12.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.643+0000 7fb9c1ffb640 1 --2- 172.21.15.67:0/1890823476 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb9b4079e40 0x7fb9b407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:12.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.643+0000 7fb9c1ffb640 1 -- 172.21.15.67:0/1890823476 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6509+0+0 (secure 0 0 0) 0x7fb9b00bd3a0 con 0x7fb9c4103180 2024-08-31T05:26:12.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.643+0000 7fb9c8a51640 1 --2- 172.21.15.67:0/1890823476 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb9b4079e40 0x7fb9b407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:12.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.643+0000 7fb9c8a51640 1 --2- 172.21.15.67:0/1890823476 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb9b4079e40 0x7fb9b407c300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80058c0 tx=0x7fb9b8005850 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:12.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.648+0000 7fb9c1ffb640 1 -- 172.21.15.67:0/1890823476 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb9b0084d80 con 0x7fb9c4103180 2024-08-31T05:26:12.761 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:12 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0[109157]: 2024-08-31T05:26:12.486+0000 7ff1c24a7640 -1 osd.0 47 log_to_monitors true 2024-08-31T05:26:12.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.861+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1890823476 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb9c4197fd0 con 0x7fb9b4079e40 2024-08-31T05:26:12.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.863+0000 7fb9c1ffb640 1 -- 172.21.15.67:0/1890823476 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fb9c4197fd0 con 0x7fb9b4079e40 2024-08-31T05:26:12.865 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:26:12.865 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:26:12.865 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:26:12.865 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-31T05:26:12.865 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:26:12.865 INFO:teuthology.orchestra.run.smithi067.stdout: "mon", 2024-08-31T05:26:12.865 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2024-08-31T05:26:12.865 INFO:teuthology.orchestra.run.smithi067.stdout: "crash" 2024-08-31T05:26:12.866 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:26:12.866 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "7/23 daemons upgraded", 2024-08-31T05:26:12.866 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading osd daemons", 2024-08-31T05:26:12.866 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:26:12.866 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:26:12.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.865+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1890823476 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb9b4079e40 msgr2=0x7fb9b407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.865+0000 7fb9cacb5640 1 --2- 172.21.15.67:0/1890823476 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb9b4079e40 0x7fb9b407c300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80058c0 tx=0x7fb9b8005850 comp rx=0 tx=0).stop 2024-08-31T05:26:12.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.865+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1890823476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4103180 msgr2=0x7fb9c419d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.865+0000 7fb9cacb5640 1 --2- 172.21.15.67:0/1890823476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4103180 0x7fb9c419d940 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0031460 tx=0x7fb9b0004530 comp rx=0 tx=0).stop 2024-08-31T05:26:12.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.866+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1890823476 shutdown_connections 2024-08-31T05:26:12.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.866+0000 7fb9cacb5640 1 --2- 172.21.15.67:0/1890823476 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb9b4079e40 0x7fb9b407c300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.866+0000 7fb9cacb5640 1 --2- 172.21.15.67:0/1890823476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9c4103180 0x7fb9c419d940 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.866+0000 7fb9cacb5640 1 --2- 172.21.15.67:0/1890823476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9c4102860 0x7fb9c419d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.866+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1890823476 >> 172.21.15.67:0/1890823476 conn(0x7fb9c40fc2c0 msgr2=0x7fb9c4108cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:12.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.866+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1890823476 shutdown_connections 2024-08-31T05:26:12.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.866+0000 7fb9cacb5640 1 -- 172.21.15.67:0/1890823476 wait complete. 2024-08-31T05:26:12.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.959+0000 7f1eb6443640 1 -- 172.21.15.67:0/4053988145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb0106660 msgr2=0x7f1eb0106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.959+0000 7f1eb6443640 1 --2- 172.21.15.67:0/4053988145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb0106660 0x7f1eb0106a40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0009880 tx=0x7f1ea002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.959+0000 7f1eb6443640 1 -- 172.21.15.67:0/4053988145 shutdown_connections 2024-08-31T05:26:12.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.959+0000 7f1eb6443640 1 --2- 172.21.15.67:0/4053988145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1eb01005b0 0x7f1eb0100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.959+0000 7f1eb6443640 1 --2- 172.21.15.67:0/4053988145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb0106660 0x7f1eb0106a40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.959+0000 7f1eb6443640 1 -- 172.21.15.67:0/4053988145 >> 172.21.15.67:0/4053988145 conn(0x7f1eb00fc2f0 msgr2=0x7f1eb00fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:12.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.959+0000 7f1eb6443640 1 -- 172.21.15.67:0/4053988145 shutdown_connections 2024-08-31T05:26:12.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.959+0000 7f1eb6443640 1 -- 172.21.15.67:0/4053988145 wait complete. 2024-08-31T05:26:12.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.960+0000 7f1eb6443640 1 Processor -- start 2024-08-31T05:26:12.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.960+0000 7f1eb6443640 1 -- start start 2024-08-31T05:26:12.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.960+0000 7f1eb6443640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1eb01005b0 0x7f1eb0102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:12.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.960+0000 7f1eb6443640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb0106660 0x7f1eb0102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:12.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.960+0000 7f1eb6443640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb010da70 con 0x7f1eb0106660 2024-08-31T05:26:12.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.961+0000 7f1eb6443640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb010d8f0 con 0x7f1eb01005b0 2024-08-31T05:26:12.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.961+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb0106660 0x7f1eb0102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:12.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.961+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb0106660 0x7f1eb0102760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33194/0 (socket says 172.21.15.67:33194) 2024-08-31T05:26:12.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.961+0000 7f1eaf7fe640 1 -- 172.21.15.67:0/4112501601 learned_addr learned my addr 172.21.15.67:0/4112501601 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:26:12.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.961+0000 7f1eaffff640 1 --2- 172.21.15.67:0/4112501601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1eb01005b0 0x7f1eb0102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:12.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.961+0000 7f1eaf7fe640 1 -- 172.21.15.67:0/4112501601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1eb01005b0 msgr2=0x7f1eb0102220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.961+0000 7f1eaf7fe640 1 --2- 172.21.15.67:0/4112501601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1eb01005b0 0x7f1eb0102220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.961+0000 7f1eaf7fe640 1 -- 172.21.15.67:0/4112501601 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb0102ca0 con 0x7f1eb0106660 2024-08-31T05:26:12.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.961+0000 7f1eaf7fe640 1 --2- 172.21.15.67:0/4112501601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb0106660 0x7f1eb0102760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400c8f0 tx=0x7f1ea400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:12.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.961+0000 7f1ead7fa640 1 -- 172.21.15.67:0/4112501601 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ea40079b0 con 0x7f1eb0106660 2024-08-31T05:26:12.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.961+0000 7f1eb6443640 1 -- 172.21.15.67:0/4112501601 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb0102f90 con 0x7f1eb0106660 2024-08-31T05:26:12.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.961+0000 7f1ead7fa640 1 -- 172.21.15.67:0/4112501601 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1ea40054e0 con 0x7f1eb0106660 2024-08-31T05:26:12.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.962+0000 7f1ead7fa640 1 -- 172.21.15.67:0/4112501601 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ea4004dd0 con 0x7f1eb0106660 2024-08-31T05:26:12.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.962+0000 7f1eb6443640 1 -- 172.21.15.67:0/4112501601 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb01a3bd0 con 0x7f1eb0106660 2024-08-31T05:26:12.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.963+0000 7f1eb6443640 1 -- 172.21.15.67:0/4112501601 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb0101cd0 con 0x7f1eb0106660 2024-08-31T05:26:12.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.964+0000 7f1ead7fa640 1 -- 172.21.15.67:0/4112501601 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f1ea4005020 con 0x7f1eb0106660 2024-08-31T05:26:12.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.964+0000 7f1ead7fa640 1 --2- 172.21.15.67:0/4112501601 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1e98079da0 0x7f1e9807c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:12.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.964+0000 7f1ead7fa640 1 -- 172.21.15.67:0/4112501601 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6509+0+0 (secure 0 0 0) 0x7f1ea409cae0 con 0x7f1eb0106660 2024-08-31T05:26:12.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.964+0000 7f1eaffff640 1 --2- 172.21.15.67:0/4112501601 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1e98079da0 0x7f1e9807c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:12.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.965+0000 7f1eaffff640 1 --2- 172.21.15.67:0/4112501601 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1e98079da0 0x7f1e9807c260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0004f90 tx=0x7f1ea0005bd0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:12.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:12.971+0000 7f1ead7fa640 1 -- 172.21.15.67:0/4112501601 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1ea4014030 con 0x7f1eb0106660 2024-08-31T05:26:13.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:12 smithi067 ceph-mon[99941]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:13.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:12 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/950356991' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:13.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:12 smithi067 ceph-mon[99941]: from='osd.0 [v2:172.21.15.67:6802/4065113034,v1:172.21.15.67:6803/4065113034]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T05:26:13.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:12 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3140731607' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:26:13.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:12 smithi073 ceph-mon[71452]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:13.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:12 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/950356991' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:13.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:12 smithi073 ceph-mon[71452]: from='osd.0 [v2:172.21.15.67:6802/4065113034,v1:172.21.15.67:6803/4065113034]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T05:26:13.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:12 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3140731607' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:26:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:13.243+0000 7f1eb6443640 1 -- 172.21.15.67:0/4112501601 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f1eb01a3ee0 con 0x7f1eb0106660 2024-08-31T05:26:13.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:13.243+0000 7f1ead7fa640 1 -- 172.21.15.67:0/4112501601 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1517 (secure 0 0 0) 0x7f1ea4064440 con 0x7f1eb0106660 2024-08-31T05:26:13.245 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 55/276 objects degraded (19.928%), 19 pgs degraded 2024-08-31T05:26:13.245 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:26:13.246 INFO:teuthology.orchestra.run.smithi067.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:26:13.246 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-31T05:26:13.246 INFO:teuthology.orchestra.run.smithi067.stdout: osd.0 (root=default,host=smithi067) is down 2024-08-31T05:26:13.246 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 55/276 objects degraded (19.928%), 19 pgs degraded 2024-08-31T05:26:13.246 INFO:teuthology.orchestra.run.smithi067.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-08-31T05:26:13.246 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-08-31T05:26:13.246 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-08-31T05:26:13.246 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-08-31T05:26:13.246 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-08-31T05:26:13.246 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-08-31T05:26:13.246 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-08-31T05:26:13.246 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-08-31T05:26:13.246 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-08-31T05:26:13.246 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-08-31T05:26:13.247 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-08-31T05:26:13.247 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-08-31T05:26:13.247 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-08-31T05:26:13.247 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-08-31T05:26:13.247 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-08-31T05:26:13.247 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-08-31T05:26:13.247 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-08-31T05:26:13.247 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-08-31T05:26:13.247 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-08-31T05:26:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:13.246+0000 7f1eb6443640 1 -- 172.21.15.67:0/4112501601 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1e98079da0 msgr2=0x7f1e9807c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:13.246+0000 7f1eb6443640 1 --2- 172.21.15.67:0/4112501601 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1e98079da0 0x7f1e9807c260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0004f90 tx=0x7f1ea0005bd0 comp rx=0 tx=0).stop 2024-08-31T05:26:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:13.246+0000 7f1eb6443640 1 -- 172.21.15.67:0/4112501601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb0106660 msgr2=0x7f1eb0102760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:13.246+0000 7f1eb6443640 1 --2- 172.21.15.67:0/4112501601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb0106660 0x7f1eb0102760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400c8f0 tx=0x7f1ea400cdb0 comp rx=0 tx=0).stop 2024-08-31T05:26:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:13.246+0000 7f1eb6443640 1 -- 172.21.15.67:0/4112501601 shutdown_connections 2024-08-31T05:26:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:13.246+0000 7f1eb6443640 1 --2- 172.21.15.67:0/4112501601 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1e98079da0 0x7f1e9807c260 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:13.246+0000 7f1eb6443640 1 --2- 172.21.15.67:0/4112501601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1eb0106660 0x7f1eb0102760 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:13.246+0000 7f1eb6443640 1 --2- 172.21.15.67:0/4112501601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1eb01005b0 0x7f1eb0102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:13.246+0000 7f1eb6443640 1 -- 172.21.15.67:0/4112501601 >> 172.21.15.67:0/4112501601 conn(0x7f1eb00fc2f0 msgr2=0x7f1eb0069b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:13.246+0000 7f1eb6443640 1 -- 172.21.15.67:0/4112501601 shutdown_connections 2024-08-31T05:26:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:13.246+0000 7f1eb6443640 1 -- 172.21.15.67:0/4112501601 wait complete. 2024-08-31T05:26:13.893 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:26:13 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0[109157]: 2024-08-31T05:26:13.827+0000 7ff1b621f640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:26:13.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:13 smithi067 ceph-mon[99941]: from='osd.0 [v2:172.21.15.67:6802/4065113034,v1:172.21.15.67:6803/4065113034]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T05:26:13.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:13 smithi067 ceph-mon[99941]: osdmap e55: 6 total, 5 up, 6 in 2024-08-31T05:26:13.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:13 smithi067 ceph-mon[99941]: from='osd.0 [v2:172.21.15.67:6802/4065113034,v1:172.21.15.67:6803/4065113034]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-08-31T05:26:13.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:13 smithi067 ceph-mon[99941]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:13.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:13 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/4112501601' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:26:13.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:13 smithi067 ceph-mon[99941]: pgmap v136: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 19 active+undersized+degraded, 24 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/276 objects degraded (19.928%); 15/276 objects misplaced (5.435%); 0 B/s, 90 objects/s recovering 2024-08-31T05:26:13.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:13 smithi067 ceph-mon[99941]: from='osd.0 [v2:172.21.15.67:6802/4065113034,v1:172.21.15.67:6803/4065113034]' entity='osd.0' 2024-08-31T05:26:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:13 smithi073 ceph-mon[71452]: from='osd.0 [v2:172.21.15.67:6802/4065113034,v1:172.21.15.67:6803/4065113034]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T05:26:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:13 smithi073 ceph-mon[71452]: osdmap e55: 6 total, 5 up, 6 in 2024-08-31T05:26:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:13 smithi073 ceph-mon[71452]: from='osd.0 [v2:172.21.15.67:6802/4065113034,v1:172.21.15.67:6803/4065113034]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-08-31T05:26:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:13 smithi073 ceph-mon[71452]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:13 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/4112501601' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:26:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:13 smithi073 ceph-mon[71452]: pgmap v136: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 19 active+undersized+degraded, 24 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/276 objects degraded (19.928%); 15/276 objects misplaced (5.435%); 0 B/s, 90 objects/s recovering 2024-08-31T05:26:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:13 smithi073 ceph-mon[71452]: from='osd.0 [v2:172.21.15.67:6802/4065113034,v1:172.21.15.67:6803/4065113034]' entity='osd.0' 2024-08-31T05:26:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:15.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:15.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:15.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:15.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:15.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-08-31T05:26:15.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-31T05:26:15.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-08-31T05:26:15.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-31T05:26:15.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: osd.0 [v2:172.21.15.67:6802/4065113034,v1:172.21.15.67:6803/4065113034] boot 2024-08-31T05:26:15.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: osdmap e56: 6 total, 6 up, 6 in 2024-08-31T05:26:15.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:15 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:26:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:15.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:15.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-08-31T05:26:15.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-31T05:26:15.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-08-31T05:26:15.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-31T05:26:15.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: osd.0 [v2:172.21.15.67:6802/4065113034,v1:172.21.15.67:6803/4065113034] boot 2024-08-31T05:26:15.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: osdmap e56: 6 total, 6 up, 6 in 2024-08-31T05:26:15.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:15 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:26:16.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:16 smithi067 ceph-mon[99941]: pgmap v138: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 19 active+undersized+degraded, 24 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/276 objects degraded (19.928%); 15/276 objects misplaced (5.435%); 0 B/s, 77 objects/s recovering 2024-08-31T05:26:16.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:16 smithi067 ceph-mon[99941]: osdmap e57: 6 total, 6 up, 6 in 2024-08-31T05:26:16.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:16 smithi073 ceph-mon[71452]: pgmap v138: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 19 active+undersized+degraded, 24 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/276 objects degraded (19.928%); 15/276 objects misplaced (5.435%); 0 B/s, 77 objects/s recovering 2024-08-31T05:26:16.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:16 smithi073 ceph-mon[71452]: osdmap e57: 6 total, 6 up, 6 in 2024-08-31T05:26:18.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:17 smithi073 ceph-mon[71452]: osdmap e58: 6 total, 6 up, 6 in 2024-08-31T05:26:18.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:17 smithi073 ceph-mon[71452]: osdmap e59: 6 total, 6 up, 6 in 2024-08-31T05:26:18.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:17 smithi073 ceph-mon[71452]: pgmap v142: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 19 active+undersized+degraded, 24 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 55/276 objects degraded (19.928%); 15/276 objects misplaced (5.435%) 2024-08-31T05:26:18.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:17 smithi067 ceph-mon[99941]: osdmap e58: 6 total, 6 up, 6 in 2024-08-31T05:26:18.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:17 smithi067 ceph-mon[99941]: osdmap e59: 6 total, 6 up, 6 in 2024-08-31T05:26:18.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:17 smithi067 ceph-mon[99941]: pgmap v142: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 19 active+undersized+degraded, 24 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 55/276 objects degraded (19.928%); 15/276 objects misplaced (5.435%) 2024-08-31T05:26:19.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:19 smithi073 ceph-mon[71452]: osdmap e60: 6 total, 6 up, 6 in 2024-08-31T05:26:19.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:19 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:19.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:19 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:26:20.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:19 smithi067 ceph-mon[99941]: osdmap e60: 6 total, 6 up, 6 in 2024-08-31T05:26:20.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:19 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:20.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:19 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:26:20.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:20 smithi073 ceph-mon[71452]: osdmap e61: 6 total, 6 up, 6 in 2024-08-31T05:26:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:20 smithi073 ceph-mon[71452]: pgmap v145: 65 pgs: 4 peering, 2 active+clean+remapped, 59 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 267 B/s rd, 0 op/s; 11 MiB/s, 1 keys/s, 155 objects/s recovering 2024-08-31T05:26:21.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:20 smithi067 ceph-mon[99941]: osdmap e61: 6 total, 6 up, 6 in 2024-08-31T05:26:21.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:20 smithi067 ceph-mon[99941]: pgmap v145: 65 pgs: 4 peering, 2 active+clean+remapped, 59 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 267 B/s rd, 0 op/s; 11 MiB/s, 1 keys/s, 155 objects/s recovering 2024-08-31T05:26:21.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:21 smithi073 ceph-mon[71452]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/276 objects degraded (19.928%), 19 pgs degraded) 2024-08-31T05:26:22.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:21 smithi067 ceph-mon[99941]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/276 objects degraded (19.928%), 19 pgs degraded) 2024-08-31T05:26:22.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:22 smithi073 ceph-mon[71452]: pgmap v146: 65 pgs: 4 peering, 2 active+clean+remapped, 59 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 211 B/s rd, 0 op/s; 9.1 MiB/s, 0 keys/s, 122 objects/s recovering 2024-08-31T05:26:23.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:22 smithi067 ceph-mon[99941]: pgmap v146: 65 pgs: 4 peering, 2 active+clean+remapped, 59 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 211 B/s rd, 0 op/s; 9.1 MiB/s, 0 keys/s, 122 objects/s recovering 2024-08-31T05:26:24.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:24 smithi073 ceph-mon[71452]: pgmap v147: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1021 B/s rd, 1 op/s; 7.3 MiB/s, 0 keys/s, 145 objects/s recovering 2024-08-31T05:26:25.008 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:24 smithi067 ceph-mon[99941]: pgmap v147: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1021 B/s rd, 1 op/s; 7.3 MiB/s, 0 keys/s, 145 objects/s recovering 2024-08-31T05:26:26.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:26 smithi073 ceph-mon[71452]: pgmap v148: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 5.5 MiB/s, 0 keys/s, 109 objects/s recovering 2024-08-31T05:26:27.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:26 smithi067 ceph-mon[99941]: pgmap v148: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 5.5 MiB/s, 0 keys/s, 109 objects/s recovering 2024-08-31T05:26:28.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:28 smithi073 ceph-mon[71452]: pgmap v149: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 568 B/s rd, 1 op/s; 0 B/s, 63 objects/s recovering 2024-08-31T05:26:29.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:28 smithi067 ceph-mon[99941]: pgmap v149: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 568 B/s rd, 1 op/s; 0 B/s, 63 objects/s recovering 2024-08-31T05:26:29.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:29 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-08-31T05:26:29.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:29 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:29.984 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:29 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-08-31T05:26:29.985 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:29 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:30.808 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:30 smithi067 ceph-mon[99941]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-31T05:26:30.808 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:30 smithi067 ceph-mon[99941]: Upgrade: osd.1 is safe to restart 2024-08-31T05:26:30.808 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:30 smithi067 ceph-mon[99941]: pgmap v150: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 0 B/s, 28 objects/s recovering 2024-08-31T05:26:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:30 smithi073 ceph-mon[71452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-31T05:26:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:30 smithi073 ceph-mon[71452]: Upgrade: osd.1 is safe to restart 2024-08-31T05:26:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:30 smithi073 ceph-mon[71452]: pgmap v150: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 0 B/s, 28 objects/s recovering 2024-08-31T05:26:32.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:31 smithi073 ceph-mon[71452]: Upgrade: Updating osd.1 2024-08-31T05:26:32.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:31 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:32.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:31 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T05:26:32.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:31 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:32.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:31 smithi073 ceph-mon[71452]: Deploying daemon osd.1 on smithi067 2024-08-31T05:26:32.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:31 smithi073 ceph-mon[71452]: pgmap v151: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 0 B/s, 23 objects/s recovering 2024-08-31T05:26:32.241 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:31 smithi067 ceph-mon[99941]: Upgrade: Updating osd.1 2024-08-31T05:26:32.241 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:31 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:32.241 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:31 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T05:26:32.241 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:31 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:32.241 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:31 smithi067 ceph-mon[99941]: Deploying daemon osd.1 on smithi067 2024-08-31T05:26:32.241 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:31 smithi067 ceph-mon[99941]: pgmap v151: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 0 B/s, 23 objects/s recovering 2024-08-31T05:26:34.162 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:33 smithi067 systemd[1]: Stopping Ceph osd.1 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:26:34.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:34 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1[44766]: 2024-08-31T05:26:34.160+0000 7f0e67ec2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:26:34.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:34 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1[44766]: 2024-08-31T05:26:34.160+0000 7f0e67ec2640 -1 osd.1 61 *** Got signal Terminated *** 2024-08-31T05:26:34.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:34 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1[44766]: 2024-08-31T05:26:34.160+0000 7f0e67ec2640 -1 osd.1 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:26:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:34 smithi067 ceph-mon[99941]: pgmap v152: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 23 objects/s recovering 2024-08-31T05:26:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:34 smithi067 ceph-mon[99941]: osd.1 marked itself down and dead 2024-08-31T05:26:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:26:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:34 smithi073 ceph-mon[71452]: pgmap v152: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 23 objects/s recovering 2024-08-31T05:26:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:34 smithi073 ceph-mon[71452]: osd.1 marked itself down and dead 2024-08-31T05:26:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:26:35.571 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:35 smithi067 podman[114107]: 2024-08-31 05:26:35.26287743 +0000 UTC m=+1.212793963 container died 82dbd3906629ef6a1b245c48a825de8f79bd46b94ae1f7e34960827e0e2b4e23 (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-244a32d, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-31T05:26:35.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:35 smithi067 ceph-mon[99941]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-31T05:26:35.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:35 smithi067 ceph-mon[99941]: osdmap e62: 6 total, 5 up, 6 in 2024-08-31T05:26:35.825 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:35 smithi067 podman[114107]: 2024-08-31 05:26:35.660684733 +0000 UTC m=+1.610601256 container cleanup 82dbd3906629ef6a1b245c48a825de8f79bd46b94ae1f7e34960827e0e2b4e23 (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-244a32d, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:26:35.825 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:35 smithi067 bash[114107]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1 2024-08-31T05:26:36.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:35 smithi073 ceph-mon[71452]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-31T05:26:36.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:35 smithi073 ceph-mon[71452]: osdmap e62: 6 total, 5 up, 6 in 2024-08-31T05:26:36.296 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:35 smithi067 podman[114122]: 2024-08-31 05:26:35.937637852 +0000 UTC m=+0.671741488 container remove 82dbd3906629ef6a1b245c48a825de8f79bd46b94ae1f7e34960827e0e2b4e23 (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-244a32d, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:26:36.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:36 smithi067 podman[114213]: 2024-08-31 05:26:36.198775978 +0000 UTC m=+0.016788225 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:26:36.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:36 smithi067 podman[114213]: 2024-08-31 05:26:36.322107109 +0000 UTC m=+0.140119352 container create c06f7f48d37a042cbd5d5d2ba1d3a034eb7a853f8f3601498e02f70354d433ac (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-31T05:26:36.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:36 smithi067 podman[114213]: 2024-08-31 05:26:36.524874099 +0000 UTC m=+0.342886337 container init c06f7f48d37a042cbd5d5d2ba1d3a034eb7a853f8f3601498e02f70354d433ac (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-31T05:26:36.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:36 smithi067 podman[114213]: 2024-08-31 05:26:36.528147955 +0000 UTC m=+0.346160192 container start c06f7f48d37a042cbd5d5d2ba1d3a034eb7a853f8f3601498e02f70354d433ac (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-31T05:26:37.014 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:36 smithi067 ceph-mon[99941]: pgmap v154: 65 pgs: 11 stale+active+clean, 54 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-08-31T05:26:37.014 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:36 smithi067 ceph-mon[99941]: osdmap e63: 6 total, 5 up, 6 in 2024-08-31T05:26:37.014 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:36 smithi067 podman[114213]: 2024-08-31 05:26:36.616632894 +0000 UTC m=+0.434645142 container attach c06f7f48d37a042cbd5d5d2ba1d3a034eb7a853f8f3601498e02f70354d433ac (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-31T05:26:37.014 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:36 smithi067 podman[114213]: 2024-08-31 05:26:36.723469532 +0000 UTC m=+0.541481772 container died c06f7f48d37a042cbd5d5d2ba1d3a034eb7a853f8f3601498e02f70354d433ac (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-08-31T05:26:37.050 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:36 smithi073 ceph-mon[71452]: pgmap v154: 65 pgs: 11 stale+active+clean, 54 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-08-31T05:26:37.051 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:36 smithi073 ceph-mon[71452]: osdmap e63: 6 total, 5 up, 6 in 2024-08-31T05:26:37.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:37 smithi067 podman[114235]: 2024-08-31 05:26:37.29554432 +0000 UTC m=+0.566407962 container remove c06f7f48d37a042cbd5d5d2ba1d3a034eb7a853f8f3601498e02f70354d433ac (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-31T05:26:37.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:37 smithi067 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.1.service: Deactivated successfully. 2024-08-31T05:26:37.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:37 smithi067 systemd[1]: Stopped Ceph osd.1 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:26:37.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:37 smithi067 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.1.service: Consumed 59.386s CPU time. 2024-08-31T05:26:37.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:37 smithi067 systemd[1]: Starting Ceph osd.1 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:26:38.010 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:37 smithi067 podman[114332]: 2024-08-31 05:26:37.638978038 +0000 UTC m=+0.016336931 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:26:38.010 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:37 smithi067 podman[114332]: 2024-08-31 05:26:37.755381424 +0000 UTC m=+0.132740310 container create c2069e85a1f7665253a0aa72ac3c921aa8dfb4a154d5d9c4281e831646166bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0) 2024-08-31T05:26:38.309 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 podman[114332]: 2024-08-31 05:26:38.008615516 +0000 UTC m=+0.385974404 container init c2069e85a1f7665253a0aa72ac3c921aa8dfb4a154d5d9c4281e831646166bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:26:38.309 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 podman[114332]: 2024-08-31 05:26:38.012781635 +0000 UTC m=+0.390140519 container start c2069e85a1f7665253a0aa72ac3c921aa8dfb4a154d5d9c4281e831646166bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=) 2024-08-31T05:26:38.309 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 podman[114332]: 2024-08-31 05:26:38.100214805 +0000 UTC m=+0.477573706 container attach c2069e85a1f7665253a0aa72ac3c921aa8dfb4a154d5d9c4281e831646166bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:26:38.309 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate[114348]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:38.309 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 bash[114332]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:38.310 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate[114348]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:38.310 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 bash[114332]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:38.310 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate[114348]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-31T05:26:38.310 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 bash[114332]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-31T05:26:38.310 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate[114348]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:38.310 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 bash[114332]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:38.310 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate[114348]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:38.310 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 bash[114332]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:26:38.310 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate[114348]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-31T05:26:38.310 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 bash[114332]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-31T05:26:38.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate[114348]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-08-31T05:26:38.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 bash[114332]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-08-31T05:26:38.922 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:38 smithi067 ceph-mon[99941]: pgmap v156: 65 pgs: 11 stale+active+clean, 54 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-08-31T05:26:38.923 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate[114348]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-08-31T05:26:38.923 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 bash[114332]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-08-31T05:26:38.923 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate[114348]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-08-31T05:26:38.923 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 bash[114332]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-08-31T05:26:38.923 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate[114348]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-31T05:26:38.923 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 bash[114332]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-31T05:26:38.923 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate[114348]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-31T05:26:38.923 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 bash[114332]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-31T05:26:38.924 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate[114348]: --> ceph-volume lvm activate successful for osd ID: 1 2024-08-31T05:26:38.924 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 bash[114332]: --> ceph-volume lvm activate successful for osd ID: 1 2024-08-31T05:26:38.924 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:38 smithi067 podman[114332]: 2024-08-31 05:26:38.631608225 +0000 UTC m=+1.008967111 container died c2069e85a1f7665253a0aa72ac3c921aa8dfb4a154d5d9c4281e831646166bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:26:39.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:38 smithi073 ceph-mon[71452]: pgmap v156: 65 pgs: 11 stale+active+clean, 54 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-08-31T05:26:39.574 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:39 smithi067 podman[114462]: 2024-08-31 05:26:39.321518428 +0000 UTC m=+0.683795583 container remove c2069e85a1f7665253a0aa72ac3c921aa8dfb4a154d5d9c4281e831646166bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-31T05:26:39.575 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:39 smithi067 podman[114522]: 2024-08-31 05:26:39.449141127 +0000 UTC m=+0.018209376 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:26:39.854 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:39 smithi067 ceph-mon[99941]: pgmap v157: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/276 objects degraded (13.406%) 2024-08-31T05:26:39.854 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:39 smithi067 ceph-mon[99941]: Health check failed: Degraded data redundancy: 37/276 objects degraded (13.406%), 13 pgs degraded (PG_DEGRADED) 2024-08-31T05:26:39.854 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:39 smithi067 podman[114522]: 2024-08-31 05:26:39.583500573 +0000 UTC m=+0.152568818 container create fa9e3fb20c5e4540fae31e2a12dd821af6aac322c18d37b452395cfdf7c643a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-08-31T05:26:39.854 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:39 smithi067 podman[114522]: 2024-08-31 05:26:39.817633513 +0000 UTC m=+0.386701759 container init fa9e3fb20c5e4540fae31e2a12dd821af6aac322c18d37b452395cfdf7c643a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-31T05:26:39.854 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:39 smithi067 podman[114522]: 2024-08-31 05:26:39.820877872 +0000 UTC m=+0.389946111 container start fa9e3fb20c5e4540fae31e2a12dd821af6aac322c18d37b452395cfdf7c643a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-31T05:26:39.854 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:39 smithi067 ceph-osd[114541]: -- 172.21.15.67:0/2617995660 <== mon.0 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c6e9cfe1e0 con 0x55c6e8fe8d00 2024-08-31T05:26:40.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:39 smithi073 ceph-mon[71452]: pgmap v157: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/276 objects degraded (13.406%) 2024-08-31T05:26:40.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:39 smithi073 ceph-mon[71452]: Health check failed: Degraded data redundancy: 37/276 objects degraded (13.406%), 13 pgs degraded (PG_DEGRADED) 2024-08-31T05:26:40.325 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:39 smithi067 bash[114522]: fa9e3fb20c5e4540fae31e2a12dd821af6aac322c18d37b452395cfdf7c643a0 2024-08-31T05:26:40.325 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:39 smithi067 systemd[1]: Started Ceph osd.1 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:26:41.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:40 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:41.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:40 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:41.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:40 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:41.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:40 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:41.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:40 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:41.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:40 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:41.801 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:41 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1[114537]: 2024-08-31T05:26:41.463+0000 7fc6ef883640 -1 Falling back to public interface 2024-08-31T05:26:42.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:41 smithi067 ceph-mon[99941]: pgmap v158: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/276 objects degraded (13.406%) 2024-08-31T05:26:42.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:41 smithi073 ceph-mon[71452]: pgmap v158: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/276 objects degraded (13.406%) 2024-08-31T05:26:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.346+0000 7f3c4ae47640 1 -- 172.21.15.67:0/3134026061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c44100b80 msgr2=0x7f3c44106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.346+0000 7f3c4ae47640 1 --2- 172.21.15.67:0/3134026061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c44100b80 0x7f3c44106360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009880 tx=0x7f3c3002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.346+0000 7f3c4ae47640 1 -- 172.21.15.67:0/3134026061 shutdown_connections 2024-08-31T05:26:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.346+0000 7f3c4ae47640 1 --2- 172.21.15.67:0/3134026061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c44100b80 0x7f3c44106360 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.346+0000 7f3c4ae47640 1 --2- 172.21.15.67:0/3134026061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c441001d0 0x7f3c441005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.346+0000 7f3c4ae47640 1 -- 172.21.15.67:0/3134026061 >> 172.21.15.67:0/3134026061 conn(0x7f3c44076f80 msgr2=0x7f3c44077390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.346+0000 7f3c4ae47640 1 -- 172.21.15.67:0/3134026061 shutdown_connections 2024-08-31T05:26:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.346+0000 7f3c4ae47640 1 -- 172.21.15.67:0/3134026061 wait complete. 2024-08-31T05:26:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.347+0000 7f3c4ae47640 1 Processor -- start 2024-08-31T05:26:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.347+0000 7f3c4ae47640 1 -- start start 2024-08-31T05:26:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.347+0000 7f3c4ae47640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c441001d0 0x7f3c44101150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.347+0000 7f3c4ae47640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c44100b80 0x7f3c44101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.347+0000 7f3c4ae47640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4410eb60 con 0x7f3c44100b80 2024-08-31T05:26:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.347+0000 7f3c4ae47640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4410e9e0 con 0x7f3c441001d0 2024-08-31T05:26:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.347+0000 7f3c43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c44100b80 0x7f3c44101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.347+0000 7f3c43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c44100b80 0x7f3c44101690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34464/0 (socket says 172.21.15.67:34464) 2024-08-31T05:26:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.347+0000 7f3c43fff640 1 -- 172.21.15.67:0/2744220647 learned_addr learned my addr 172.21.15.67:0/2744220647 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:26:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.347+0000 7f3c48be3640 1 --2- 172.21.15.67:0/2744220647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c441001d0 0x7f3c44101150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.348+0000 7f3c43fff640 1 -- 172.21.15.67:0/2744220647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c441001d0 msgr2=0x7f3c44101150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.348+0000 7f3c43fff640 1 --2- 172.21.15.67:0/2744220647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c441001d0 0x7f3c44101150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.348+0000 7f3c43fff640 1 -- 172.21.15.67:0/2744220647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c44101bd0 con 0x7f3c44100b80 2024-08-31T05:26:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.348+0000 7f3c43fff640 1 --2- 172.21.15.67:0/2744220647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c44100b80 0x7f3c44101690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3c300045e0 tx=0x7f3c30004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.348+0000 7f3c41ffb640 1 -- 172.21.15.67:0/2744220647 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c3003f070 con 0x7f3c44100b80 2024-08-31T05:26:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.348+0000 7f3c41ffb640 1 -- 172.21.15.67:0/2744220647 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c300035f0 con 0x7f3c44100b80 2024-08-31T05:26:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.348+0000 7f3c4ae47640 1 -- 172.21.15.67:0/2744220647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c44101e60 con 0x7f3c44100b80 2024-08-31T05:26:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.348+0000 7f3c41ffb640 1 -- 172.21.15.67:0/2744220647 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c30035030 con 0x7f3c44100b80 2024-08-31T05:26:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.348+0000 7f3c4ae47640 1 -- 172.21.15.67:0/2744220647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c441a3b90 con 0x7f3c44100b80 2024-08-31T05:26:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.350+0000 7f3c4ae47640 1 -- 172.21.15.67:0/2744220647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c44069580 con 0x7f3c44100b80 2024-08-31T05:26:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.350+0000 7f3c41ffb640 1 -- 172.21.15.67:0/2744220647 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f3c30042070 con 0x7f3c44100b80 2024-08-31T05:26:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.351+0000 7f3c41ffb640 1 --2- 172.21.15.67:0/2744220647 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3c34079e00 0x7f3c3407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.351+0000 7f3c41ffb640 1 -- 172.21.15.67:0/2744220647 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6245+0+0 (secure 0 0 0) 0x7f3c300bd390 con 0x7f3c44100b80 2024-08-31T05:26:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.351+0000 7f3c48be3640 1 --2- 172.21.15.67:0/2744220647 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3c34079e00 0x7f3c3407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.351+0000 7f3c48be3640 1 --2- 172.21.15.67:0/2744220647 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3c34079e00 0x7f3c3407c2c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3c38005fd0 tx=0x7f3c3800b390 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.356+0000 7f3c41ffb640 1 -- 172.21.15.67:0/2744220647 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3c30088f60 con 0x7f3c44100b80 2024-08-31T05:26:43.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.566+0000 7f3c4ae47640 1 -- 172.21.15.67:0/2744220647 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3c440623d0 con 0x7f3c34079e00 2024-08-31T05:26:43.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.567+0000 7f3c41ffb640 1 -- 172.21.15.67:0/2744220647 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f3c440623d0 con 0x7f3c34079e00 2024-08-31T05:26:43.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.569+0000 7f3c4ae47640 1 -- 172.21.15.67:0/2744220647 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3c34079e00 msgr2=0x7f3c3407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:43.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.569+0000 7f3c4ae47640 1 --2- 172.21.15.67:0/2744220647 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3c34079e00 0x7f3c3407c2c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3c38005fd0 tx=0x7f3c3800b390 comp rx=0 tx=0).stop 2024-08-31T05:26:43.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.569+0000 7f3c4ae47640 1 -- 172.21.15.67:0/2744220647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c44100b80 msgr2=0x7f3c44101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:43.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.569+0000 7f3c4ae47640 1 --2- 172.21.15.67:0/2744220647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c44100b80 0x7f3c44101690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3c300045e0 tx=0x7f3c30004610 comp rx=0 tx=0).stop 2024-08-31T05:26:43.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.569+0000 7f3c4ae47640 1 -- 172.21.15.67:0/2744220647 shutdown_connections 2024-08-31T05:26:43.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.569+0000 7f3c4ae47640 1 --2- 172.21.15.67:0/2744220647 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3c34079e00 0x7f3c3407c2c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.569+0000 7f3c4ae47640 1 --2- 172.21.15.67:0/2744220647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c44100b80 0x7f3c44101690 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.569+0000 7f3c4ae47640 1 --2- 172.21.15.67:0/2744220647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c441001d0 0x7f3c44101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.569+0000 7f3c4ae47640 1 -- 172.21.15.67:0/2744220647 >> 172.21.15.67:0/2744220647 conn(0x7f3c44076f80 msgr2=0x7f3c440fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:43.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.570+0000 7f3c4ae47640 1 -- 172.21.15.67:0/2744220647 shutdown_connections 2024-08-31T05:26:43.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.570+0000 7f3c4ae47640 1 -- 172.21.15.67:0/2744220647 wait complete. 2024-08-31T05:26:43.581 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:26:43.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.666+0000 7f4329c81640 1 -- 172.21.15.67:0/3862404974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43241016a0 msgr2=0x7f4324101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:43.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.666+0000 7f4329c81640 1 --2- 172.21.15.67:0/3862404974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43241016a0 0x7f4324101b00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4318009880 tx=0x7f431802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.666+0000 7f4329c81640 1 -- 172.21.15.67:0/3862404974 shutdown_connections 2024-08-31T05:26:43.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.666+0000 7f4329c81640 1 --2- 172.21.15.67:0/3862404974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43241016a0 0x7f4324101b00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.666+0000 7f4329c81640 1 --2- 172.21.15.67:0/3862404974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43241076a0 0x7f4324107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.666+0000 7f4329c81640 1 -- 172.21.15.67:0/3862404974 >> 172.21.15.67:0/3862404974 conn(0x7f43240fd3a0 msgr2=0x7f43240ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:43.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.666+0000 7f4329c81640 1 -- 172.21.15.67:0/3862404974 shutdown_connections 2024-08-31T05:26:43.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.666+0000 7f4329c81640 1 -- 172.21.15.67:0/3862404974 wait complete. 2024-08-31T05:26:43.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.667+0000 7f4329c81640 1 Processor -- start 2024-08-31T05:26:43.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.667+0000 7f4329c81640 1 -- start start 2024-08-31T05:26:43.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.667+0000 7f4329c81640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43241016a0 0x7f4324197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:43.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.667+0000 7f4329c81640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43241076a0 0x7f4324197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:43.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.667+0000 7f4329c81640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f432410eb70 con 0x7f43241016a0 2024-08-31T05:26:43.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.667+0000 7f4329c81640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f432410e9f0 con 0x7f43241076a0 2024-08-31T05:26:43.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.667+0000 7f43237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43241016a0 0x7f4324197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:43.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.668+0000 7f43237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43241016a0 0x7f4324197710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34486/0 (socket says 172.21.15.67:34486) 2024-08-31T05:26:43.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.668+0000 7f43237fe640 1 -- 172.21.15.67:0/1727752914 learned_addr learned my addr 172.21.15.67:0/1727752914 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:26:43.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.668+0000 7f4322ffd640 1 --2- 172.21.15.67:0/1727752914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43241076a0 0x7f4324197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:43.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.668+0000 7f43237fe640 1 -- 172.21.15.67:0/1727752914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43241076a0 msgr2=0x7f4324197c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:43.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.668+0000 7f43237fe640 1 --2- 172.21.15.67:0/1727752914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43241076a0 0x7f4324197c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.668+0000 7f43237fe640 1 -- 172.21.15.67:0/1727752914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432419bfe0 con 0x7f43241016a0 2024-08-31T05:26:43.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.668+0000 7f4322ffd640 1 --2- 172.21.15.67:0/1727752914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43241076a0 0x7f4324197c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:26:43.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.668+0000 7f43237fe640 1 --2- 172.21.15.67:0/1727752914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43241016a0 0x7f4324197710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f431400ea00 tx=0x7f431400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:43.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.668+0000 7f4320ff9640 1 -- 172.21.15.67:0/1727752914 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f431400cb80 con 0x7f43241016a0 2024-08-31T05:26:43.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.668+0000 7f4320ff9640 1 -- 172.21.15.67:0/1727752914 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f431400cd20 con 0x7f43241016a0 2024-08-31T05:26:43.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.668+0000 7f4329c81640 1 -- 172.21.15.67:0/1727752914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f432419c2d0 con 0x7f43241016a0 2024-08-31T05:26:43.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.668+0000 7f4320ff9640 1 -- 172.21.15.67:0/1727752914 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4314011470 con 0x7f43241016a0 2024-08-31T05:26:43.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.668+0000 7f4329c81640 1 -- 172.21.15.67:0/1727752914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f432419c860 con 0x7f43241016a0 2024-08-31T05:26:43.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.669+0000 7f4329c81640 1 -- 172.21.15.67:0/1727752914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4324102de0 con 0x7f43241016a0 2024-08-31T05:26:43.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.670+0000 7f4320ff9640 1 -- 172.21.15.67:0/1727752914 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f4314005020 con 0x7f43241016a0 2024-08-31T05:26:43.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.670+0000 7f4320ff9640 1 --2- 172.21.15.67:0/1727752914 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f430c079e00 0x7f430c07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:43.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.670+0000 7f4320ff9640 1 -- 172.21.15.67:0/1727752914 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6245+0+0 (secure 0 0 0) 0x7f431409ce80 con 0x7f43241016a0 2024-08-31T05:26:43.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.671+0000 7f4322ffd640 1 --2- 172.21.15.67:0/1727752914 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f430c079e00 0x7f430c07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:43.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.671+0000 7f4322ffd640 1 --2- 172.21.15.67:0/1727752914 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f430c079e00 0x7f430c07c2c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4318006010 tx=0x7f43180095f0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:43.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.675+0000 7f4320ff9640 1 -- 172.21.15.67:0/1727752914 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4314016030 con 0x7f43241016a0 2024-08-31T05:26:43.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.886+0000 7f4329c81640 1 -- 172.21.15.67:0/1727752914 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f432419cbd0 con 0x7f430c079e00 2024-08-31T05:26:43.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.888+0000 7f4320ff9640 1 -- 172.21.15.67:0/1727752914 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f432419cbd0 con 0x7f430c079e00 2024-08-31T05:26:43.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.890+0000 7f4329c81640 1 -- 172.21.15.67:0/1727752914 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f430c079e00 msgr2=0x7f430c07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:43.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.890+0000 7f4329c81640 1 --2- 172.21.15.67:0/1727752914 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f430c079e00 0x7f430c07c2c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4318006010 tx=0x7f43180095f0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.890+0000 7f4329c81640 1 -- 172.21.15.67:0/1727752914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43241016a0 msgr2=0x7f4324197710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:43.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.890+0000 7f4329c81640 1 --2- 172.21.15.67:0/1727752914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43241016a0 0x7f4324197710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f431400ea00 tx=0x7f431400eec0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.890+0000 7f4329c81640 1 -- 172.21.15.67:0/1727752914 shutdown_connections 2024-08-31T05:26:43.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.890+0000 7f4329c81640 1 --2- 172.21.15.67:0/1727752914 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f430c079e00 0x7f430c07c2c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.890+0000 7f4329c81640 1 --2- 172.21.15.67:0/1727752914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43241076a0 0x7f4324197c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.890+0000 7f4329c81640 1 --2- 172.21.15.67:0/1727752914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43241016a0 0x7f4324197710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.890+0000 7f4329c81640 1 -- 172.21.15.67:0/1727752914 >> 172.21.15.67:0/1727752914 conn(0x7f43240fd3a0 msgr2=0x7f43240fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:43.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.890+0000 7f4329c81640 1 -- 172.21.15.67:0/1727752914 shutdown_connections 2024-08-31T05:26:43.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.890+0000 7f4329c81640 1 -- 172.21.15.67:0/1727752914 wait complete. 2024-08-31T05:26:43.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.976+0000 7fc962efe640 1 -- 172.21.15.67:0/3768906350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc95c1005d0 msgr2=0x7fc95c100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:43.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.976+0000 7fc962efe640 1 --2- 172.21.15.67:0/3768906350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc95c1005d0 0x7fc95c100a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc948009880 tx=0x7fc94802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.976+0000 7fc962efe640 1 -- 172.21.15.67:0/3768906350 shutdown_connections 2024-08-31T05:26:43.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.976+0000 7fc962efe640 1 --2- 172.21.15.67:0/3768906350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc95c1005d0 0x7fc95c100a30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.976+0000 7fc962efe640 1 --2- 172.21.15.67:0/3768906350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc95c106680 0x7fc95c106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.976+0000 7fc962efe640 1 -- 172.21.15.67:0/3768906350 >> 172.21.15.67:0/3768906350 conn(0x7fc95c0fc2b0 msgr2=0x7fc95c0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:43.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.976+0000 7fc962efe640 1 -- 172.21.15.67:0/3768906350 shutdown_connections 2024-08-31T05:26:43.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.976+0000 7fc962efe640 1 -- 172.21.15.67:0/3768906350 wait complete. 2024-08-31T05:26:43.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.977+0000 7fc962efe640 1 Processor -- start 2024-08-31T05:26:43.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.977+0000 7fc962efe640 1 -- start start 2024-08-31T05:26:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.977+0000 7fc962efe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc95c1005d0 0x7fc95c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.977+0000 7fc962efe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc95c106680 0x7fc95c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.977+0000 7fc962efe640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c10da70 con 0x7fc95c1005d0 2024-08-31T05:26:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.977+0000 7fc962efe640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c10d8f0 con 0x7fc95c106680 2024-08-31T05:26:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.977+0000 7fc960c9a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc95c1005d0 0x7fc95c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.977+0000 7fc960c9a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc95c1005d0 0x7fc95c198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34510/0 (socket says 172.21.15.67:34510) 2024-08-31T05:26:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.977+0000 7fc960c9a640 1 -- 172.21.15.67:0/1343077976 learned_addr learned my addr 172.21.15.67:0/1343077976 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:26:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.978+0000 7fc95bfff640 1 --2- 172.21.15.67:0/1343077976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc95c106680 0x7fc95c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.978+0000 7fc960c9a640 1 -- 172.21.15.67:0/1343077976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc95c106680 msgr2=0x7fc95c198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.978+0000 7fc960c9a640 1 --2- 172.21.15.67:0/1343077976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc95c106680 0x7fc95c198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.978+0000 7fc960c9a640 1 -- 172.21.15.67:0/1343077976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95c1990b0 con 0x7fc95c1005d0 2024-08-31T05:26:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.978+0000 7fc95bfff640 1 --2- 172.21.15.67:0/1343077976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc95c106680 0x7fc95c198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:26:43.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.978+0000 7fc960c9a640 1 --2- 172.21.15.67:0/1343077976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc95c1005d0 0x7fc95c198520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc95000c810 tx=0x7fc95000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:43.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.978+0000 7fc959ffb640 1 -- 172.21.15.67:0/1343077976 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc950004020 con 0x7fc95c1005d0 2024-08-31T05:26:43.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.978+0000 7fc959ffb640 1 -- 172.21.15.67:0/1343077976 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc9500041c0 con 0x7fc95c1005d0 2024-08-31T05:26:43.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.978+0000 7fc962efe640 1 -- 172.21.15.67:0/1343077976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95c1a1590 con 0x7fc95c1005d0 2024-08-31T05:26:43.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.978+0000 7fc959ffb640 1 -- 172.21.15.67:0/1343077976 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9500047a0 con 0x7fc95c1005d0 2024-08-31T05:26:43.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.978+0000 7fc962efe640 1 -- 172.21.15.67:0/1343077976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc95c1a1990 con 0x7fc95c1005d0 2024-08-31T05:26:43.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.980+0000 7fc962efe640 1 -- 172.21.15.67:0/1343077976 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc95c101cf0 con 0x7fc95c1005d0 2024-08-31T05:26:43.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.980+0000 7fc959ffb640 1 -- 172.21.15.67:0/1343077976 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fc9500079b0 con 0x7fc95c1005d0 2024-08-31T05:26:43.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.981+0000 7fc959ffb640 1 --2- 172.21.15.67:0/1343077976 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc94c079e00 0x7fc94c07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:43.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.981+0000 7fc959ffb640 1 -- 172.21.15.67:0/1343077976 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6245+0+0 (secure 0 0 0) 0x7fc95009c950 con 0x7fc95c1005d0 2024-08-31T05:26:43.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.981+0000 7fc95bfff640 1 --2- 172.21.15.67:0/1343077976 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc94c079e00 0x7fc94c07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:43.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.981+0000 7fc95bfff640 1 --2- 172.21.15.67:0/1343077976 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc94c079e00 0x7fc94c07c2c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc948006010 tx=0x7fc9480095f0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:43.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:43.987+0000 7fc959ffb640 1 -- 172.21.15.67:0/1343077976 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc950014030 con 0x7fc95c1005d0 2024-08-31T05:26:44.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.191+0000 7fc962efe640 1 -- 172.21.15.67:0/1343077976 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc95c0623d0 con 0x7fc94c079e00 2024-08-31T05:26:44.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.201+0000 7fc959ffb640 1 -- 172.21.15.67:0/1343077976 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc95c0623d0 con 0x7fc94c079e00 2024-08-31T05:26:44.203 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:26:44.203 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (2m) 34s ago 13m 21.3M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:26:44.203 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (6m) 34s ago 13m 8912k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:26:44.203 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (5m) 56s ago 12m 8368k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:26:44.203 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (64s) 34s ago 13m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 910f4f105c4b 2024-08-31T05:26:44.203 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (59s) 56s ago 12m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 0dcc86f98a20 2024-08-31T05:26:44.203 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (2m) 34s ago 13m 80.4M - c8b91775d855 3a9a0f88928d 2024-08-31T05:26:44.203 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (8m) 34s ago 8m 92.0M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:26:44.203 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (8m) 34s ago 8m 155M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:26:44.203 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (8m) 56s ago 8m 16.1M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:26:44.203 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (8m) 56s ago 8m 18.1M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:26:44.204 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (4m) 34s ago 14m 589M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:26:44.204 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (4m) 56s ago 12m 524M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:26:44.204 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (91s) 34s ago 14m 106M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 25a28efbbd37 2024-08-31T05:26:44.204 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (76s) 56s ago 12m 92.8M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 6be0f0999860 2024-08-31T05:26:44.204 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (3m) 34s ago 13m 10.2M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:26:44.204 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (3m) 56s ago 12m 10.9M - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:26:44.204 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (39s) 34s ago 11m 81.4M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 aab0516dcbfa 2024-08-31T05:26:44.204 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 starting - - - 1216M 2024-08-31T05:26:44.204 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (10m) 34s ago 10m 187M 1216M 19.1.1-242-g244a32d3 395b9209a980 c1d51346842a 2024-08-31T05:26:44.204 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (10m) 56s ago 10m 251M 2240M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:26:44.204 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (9m) 56s ago 9m 213M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:26:44.204 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (9m) 56s ago 9m 188M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:26:44.204 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (3m) 34s ago 13m 49.2M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:26:44.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.203+0000 7fc962efe640 1 -- 172.21.15.67:0/1343077976 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc94c079e00 msgr2=0x7fc94c07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.203+0000 7fc962efe640 1 --2- 172.21.15.67:0/1343077976 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc94c079e00 0x7fc94c07c2c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc948006010 tx=0x7fc9480095f0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.203+0000 7fc962efe640 1 -- 172.21.15.67:0/1343077976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc95c1005d0 msgr2=0x7fc95c198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.203+0000 7fc962efe640 1 --2- 172.21.15.67:0/1343077976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc95c1005d0 0x7fc95c198520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc95000c810 tx=0x7fc95000ccd0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.203+0000 7fc962efe640 1 -- 172.21.15.67:0/1343077976 shutdown_connections 2024-08-31T05:26:44.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.203+0000 7fc962efe640 1 --2- 172.21.15.67:0/1343077976 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc94c079e00 0x7fc94c07c2c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.203+0000 7fc962efe640 1 --2- 172.21.15.67:0/1343077976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc95c106680 0x7fc95c198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.203+0000 7fc962efe640 1 --2- 172.21.15.67:0/1343077976 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc95c1005d0 0x7fc95c198520 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.203+0000 7fc962efe640 1 -- 172.21.15.67:0/1343077976 >> 172.21.15.67:0/1343077976 conn(0x7fc95c0fc2b0 msgr2=0x7fc95c0fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:44.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.203+0000 7fc962efe640 1 -- 172.21.15.67:0/1343077976 shutdown_connections 2024-08-31T05:26:44.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.203+0000 7fc962efe640 1 -- 172.21.15.67:0/1343077976 wait complete. 2024-08-31T05:26:44.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.287+0000 7f155b24b640 1 -- 172.21.15.67:0/1856308768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15541005d0 msgr2=0x7f1554100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.287+0000 7f155b24b640 1 --2- 172.21.15.67:0/1856308768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15541005d0 0x7f1554100a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1540009880 tx=0x7f154002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.287+0000 7f155b24b640 1 -- 172.21.15.67:0/1856308768 shutdown_connections 2024-08-31T05:26:44.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.287+0000 7f155b24b640 1 --2- 172.21.15.67:0/1856308768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15541005d0 0x7f1554100a30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.287+0000 7f155b24b640 1 --2- 172.21.15.67:0/1856308768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1554106680 0x7f1554106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.287+0000 7f155b24b640 1 -- 172.21.15.67:0/1856308768 >> 172.21.15.67:0/1856308768 conn(0x7f15540fc2b0 msgr2=0x7f15540fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:44.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.287+0000 7f155b24b640 1 -- 172.21.15.67:0/1856308768 shutdown_connections 2024-08-31T05:26:44.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.287+0000 7f155b24b640 1 -- 172.21.15.67:0/1856308768 wait complete. 2024-08-31T05:26:44.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.288+0000 7f155b24b640 1 Processor -- start 2024-08-31T05:26:44.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.288+0000 7f155b24b640 1 -- start start 2024-08-31T05:26:44.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.288+0000 7f155b24b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15541005d0 0x7f15541976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:44.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.288+0000 7f155b24b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1554106680 0x7f1554197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:44.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.288+0000 7f155b24b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f155410da70 con 0x7f15541005d0 2024-08-31T05:26:44.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.288+0000 7f155b24b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f155410d8f0 con 0x7f1554106680 2024-08-31T05:26:44.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.288+0000 7f1558fe7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15541005d0 0x7f15541976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:44.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.288+0000 7f1558fe7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15541005d0 0x7f15541976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34520/0 (socket says 172.21.15.67:34520) 2024-08-31T05:26:44.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.288+0000 7f1558fe7640 1 -- 172.21.15.67:0/2634735974 learned_addr learned my addr 172.21.15.67:0/2634735974 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:26:44.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.289+0000 7f1553fff640 1 --2- 172.21.15.67:0/2634735974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1554106680 0x7f1554197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:44.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.289+0000 7f1558fe7640 1 -- 172.21.15.67:0/2634735974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1554106680 msgr2=0x7f1554197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.289+0000 7f1558fe7640 1 --2- 172.21.15.67:0/2634735974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1554106680 0x7f1554197c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.289+0000 7f1558fe7640 1 -- 172.21.15.67:0/2634735974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155419bfa0 con 0x7f15541005d0 2024-08-31T05:26:44.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.289+0000 7f1558fe7640 1 --2- 172.21.15.67:0/2634735974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15541005d0 0x7f15541976d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f154800d8d0 tx=0x7f154800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:44.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.289+0000 7f1551ffb640 1 -- 172.21.15.67:0/2634735974 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1548017070 con 0x7f15541005d0 2024-08-31T05:26:44.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.289+0000 7f155b24b640 1 -- 172.21.15.67:0/2634735974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f155419c290 con 0x7f15541005d0 2024-08-31T05:26:44.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.289+0000 7f1551ffb640 1 -- 172.21.15.67:0/2634735974 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1548010460 con 0x7f15541005d0 2024-08-31T05:26:44.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.289+0000 7f1551ffb640 1 -- 172.21.15.67:0/2634735974 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f154800f5f0 con 0x7f15541005d0 2024-08-31T05:26:44.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.289+0000 7f155b24b640 1 -- 172.21.15.67:0/2634735974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f155419c820 con 0x7f15541005d0 2024-08-31T05:26:44.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.291+0000 7f155b24b640 1 -- 172.21.15.67:0/2634735974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1554101cf0 con 0x7f15541005d0 2024-08-31T05:26:44.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.291+0000 7f1551ffb640 1 -- 172.21.15.67:0/2634735974 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f1548009a30 con 0x7f15541005d0 2024-08-31T05:26:44.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.292+0000 7f1551ffb640 1 --2- 172.21.15.67:0/2634735974 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1544079e40 0x7f154407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:44.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.292+0000 7f1553fff640 1 --2- 172.21.15.67:0/2634735974 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1544079e40 0x7f154407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:44.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.292+0000 7f1551ffb640 1 -- 172.21.15.67:0/2634735974 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6245+0+0 (secure 0 0 0) 0x7f154809c740 con 0x7f15541005d0 2024-08-31T05:26:44.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.292+0000 7f1553fff640 1 --2- 172.21.15.67:0/2634735974 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1544079e40 0x7f154407c300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15540ff8a0 tx=0x7f1540004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:44.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.297+0000 7f1551ffb640 1 -- 172.21.15.67:0/2634735974 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1548068390 con 0x7f15541005d0 2024-08-31T05:26:44.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.576+0000 7f155b24b640 1 -- 172.21.15.67:0/2634735974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f155419cad0 con 0x7f15541005d0 2024-08-31T05:26:44.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.576+0000 7f1551ffb640 1 -- 172.21.15.67:0/2634735974 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f154806cdb0 con 0x7f15541005d0 2024-08-31T05:26:44.578 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:26:44.578 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:26:44.578 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:26:44.578 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:26:44.578 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:26:44.578 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:26:44.579 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:26:44.579 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:26:44.579 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4, 2024-08-31T05:26:44.579 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 1 2024-08-31T05:26:44.579 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:26:44.579 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:26:44.579 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:26:44.579 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:26:44.579 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:26:44.579 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 8, 2024-08-31T05:26:44.579 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 5 2024-08-31T05:26:44.580 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:26:44.580 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:26:44.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.579+0000 7f155b24b640 1 -- 172.21.15.67:0/2634735974 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1544079e40 msgr2=0x7f154407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.579+0000 7f155b24b640 1 --2- 172.21.15.67:0/2634735974 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1544079e40 0x7f154407c300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15540ff8a0 tx=0x7f1540004f30 comp rx=0 tx=0).stop 2024-08-31T05:26:44.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.579+0000 7f155b24b640 1 -- 172.21.15.67:0/2634735974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15541005d0 msgr2=0x7f15541976d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.579+0000 7f155b24b640 1 --2- 172.21.15.67:0/2634735974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15541005d0 0x7f15541976d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f154800d8d0 tx=0x7f154800dd90 comp rx=0 tx=0).stop 2024-08-31T05:26:44.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.579+0000 7f155b24b640 1 -- 172.21.15.67:0/2634735974 shutdown_connections 2024-08-31T05:26:44.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.579+0000 7f155b24b640 1 --2- 172.21.15.67:0/2634735974 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1544079e40 0x7f154407c300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.579+0000 7f155b24b640 1 --2- 172.21.15.67:0/2634735974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1554106680 0x7f1554197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.579+0000 7f155b24b640 1 --2- 172.21.15.67:0/2634735974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15541005d0 0x7f15541976d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.579+0000 7f155b24b640 1 -- 172.21.15.67:0/2634735974 >> 172.21.15.67:0/2634735974 conn(0x7f15540fc2b0 msgr2=0x7f155406a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:44.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.579+0000 7f155b24b640 1 -- 172.21.15.67:0/2634735974 shutdown_connections 2024-08-31T05:26:44.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.579+0000 7f155b24b640 1 -- 172.21.15.67:0/2634735974 wait complete. 2024-08-31T05:26:44.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.665+0000 7fc86d32e640 1 -- 172.21.15.67:0/3332780756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc868106660 msgr2=0x7fc868106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.665+0000 7fc86d32e640 1 --2- 172.21.15.67:0/3332780756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc868106660 0x7fc868106a40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc858009c20 tx=0x7fc85802a970 comp rx=0 tx=0).stop 2024-08-31T05:26:44.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.665+0000 7fc86d32e640 1 -- 172.21.15.67:0/3332780756 shutdown_connections 2024-08-31T05:26:44.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.665+0000 7fc86d32e640 1 --2- 172.21.15.67:0/3332780756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8681005b0 0x7fc868100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.665+0000 7fc86d32e640 1 --2- 172.21.15.67:0/3332780756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc868106660 0x7fc868106a40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.665+0000 7fc86d32e640 1 -- 172.21.15.67:0/3332780756 >> 172.21.15.67:0/3332780756 conn(0x7fc8680fc2f0 msgr2=0x7fc8680fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:44.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.665+0000 7fc86d32e640 1 -- 172.21.15.67:0/3332780756 shutdown_connections 2024-08-31T05:26:44.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.665+0000 7fc86d32e640 1 -- 172.21.15.67:0/3332780756 wait complete. 2024-08-31T05:26:44.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.666+0000 7fc86d32e640 1 Processor -- start 2024-08-31T05:26:44.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.666+0000 7fc86d32e640 1 -- start start 2024-08-31T05:26:44.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.666+0000 7fc86d32e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8681005b0 0x7fc868102740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:44.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.666+0000 7fc86d32e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc868106660 0x7fc868102c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:44.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.666+0000 7fc86d32e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc86810da50 con 0x7fc8681005b0 2024-08-31T05:26:44.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.666+0000 7fc86d32e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc86810d8d0 con 0x7fc868106660 2024-08-31T05:26:44.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.667+0000 7fc866ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8681005b0 0x7fc868102740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:44.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.667+0000 7fc866ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8681005b0 0x7fc868102740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34532/0 (socket says 172.21.15.67:34532) 2024-08-31T05:26:44.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.667+0000 7fc866ffd640 1 -- 172.21.15.67:0/2929837521 learned_addr learned my addr 172.21.15.67:0/2929837521 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:26:44.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.667+0000 7fc8667fc640 1 --2- 172.21.15.67:0/2929837521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc868106660 0x7fc868102c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:44.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.667+0000 7fc866ffd640 1 -- 172.21.15.67:0/2929837521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc868106660 msgr2=0x7fc868102c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.667+0000 7fc866ffd640 1 --2- 172.21.15.67:0/2929837521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc868106660 0x7fc868102c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.667+0000 7fc866ffd640 1 -- 172.21.15.67:0/2929837521 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8681031c0 con 0x7fc8681005b0 2024-08-31T05:26:44.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.667+0000 7fc8667fc640 1 --2- 172.21.15.67:0/2929837521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc868106660 0x7fc868102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:26:44.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.667+0000 7fc866ffd640 1 --2- 172.21.15.67:0/2929837521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8681005b0 0x7fc868102740 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc85802ae90 tx=0x7fc85802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:44.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.667+0000 7fc84ffff640 1 -- 172.21.15.67:0/2929837521 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc858047070 con 0x7fc8681005b0 2024-08-31T05:26:44.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.667+0000 7fc84ffff640 1 -- 172.21.15.67:0/2929837521 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc85802f7e0 con 0x7fc8681005b0 2024-08-31T05:26:44.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.667+0000 7fc86d32e640 1 -- 172.21.15.67:0/2929837521 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc868103450 con 0x7fc8681005b0 2024-08-31T05:26:44.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.667+0000 7fc86d32e640 1 -- 172.21.15.67:0/2929837521 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8681a3a90 con 0x7fc8681005b0 2024-08-31T05:26:44.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.667+0000 7fc84ffff640 1 -- 172.21.15.67:0/2929837521 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc858034070 con 0x7fc8681005b0 2024-08-31T05:26:44.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.668+0000 7fc86d32e640 1 -- 172.21.15.67:0/2929837521 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc868101cd0 con 0x7fc8681005b0 2024-08-31T05:26:44.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.669+0000 7fc84ffff640 1 -- 172.21.15.67:0/2929837521 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fc85804a070 con 0x7fc8681005b0 2024-08-31T05:26:44.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.670+0000 7fc84ffff640 1 --2- 172.21.15.67:0/2929837521 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc850079e00 0x7fc85007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:44.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.670+0000 7fc84ffff640 1 -- 172.21.15.67:0/2929837521 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6245+0+0 (secure 0 0 0) 0x7fc8580bd7d0 con 0x7fc8681005b0 2024-08-31T05:26:44.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.670+0000 7fc8667fc640 1 --2- 172.21.15.67:0/2929837521 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc850079e00 0x7fc85007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:44.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.670+0000 7fc8667fc640 1 --2- 172.21.15.67:0/2929837521 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc850079e00 0x7fc85007c2c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc8681041d0 tx=0x7fc85c005e50 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:44.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.674+0000 7fc84ffff640 1 -- 172.21.15.67:0/2929837521 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc85803f070 con 0x7fc8681005b0 2024-08-31T05:26:44.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.900+0000 7fc86d32e640 1 -- 172.21.15.67:0/2929837521 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc8681a3e40 con 0x7fc8681005b0 2024-08-31T05:26:44.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.901+0000 7fc84ffff640 1 -- 172.21.15.67:0/2929837521 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2042 (secure 0 0 0) 0x7fc858085230 con 0x7fc8681005b0 2024-08-31T05:26:44.903 INFO:teuthology.orchestra.run.smithi067.stdout:e15 2024-08-31T05:26:44.903 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-08-31T05:18:35:124059+0000 2024-08-31T05:26:44.903 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:26:44.903 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:26:44.903 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-08-31T05:26:44.903 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:26:44.903 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:26:44.903 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-08-31T05:26:44.904 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 13 2024-08-31T05:26:44.904 INFO:teuthology.orchestra.run.smithi067.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T05:26:44.904 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:26:44.904 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-08-31T05:18:33.086400+0000 2024-08-31T05:26:44.904 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-08-31T05:26:44.904 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-08-31T05:26:44.904 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2024-08-31T05:26:44.904 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-08-31T05:26:44.904 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-08-31T05:26:44.904 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-08-31T05:26:44.904 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-08-31T05:26:44.904 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-08-31T05:26:44.904 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 0 2024-08-31T05:26:44.904 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:26:44.905 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2024-08-31T05:26:44.905 INFO:teuthology.orchestra.run.smithi067.stdout:in 0 2024-08-31T05:26:44.905 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14554} 2024-08-31T05:26:44.905 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-08-31T05:26:44.905 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-08-31T05:26:44.905 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-08-31T05:26:44.905 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-08-31T05:26:44.905 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-08-31T05:26:44.905 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data enabled 2024-08-31T05:26:44.905 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-08-31T05:26:44.905 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-08-31T05:26:44.905 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2024-08-31T05:26:44.905 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 14554 members: 14554 2024-08-31T05:26:44.905 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.tskvpt{0:14554} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:26:44.906 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.beqeql{0:14566} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:26:44.906 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:26:44.906 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:26:44.906 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2024-08-31T05:26:44.906 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:26:44.906 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.kfbmeo{-1:24299} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:26:44.906 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.gsnhxi{-1:24307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6824/2383176383,v1:172.21.15.73:6825/2383176383] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:26:44.906 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-08-31T05:26:44.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.904+0000 7fc86d32e640 1 -- 172.21.15.67:0/2929837521 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc850079e00 msgr2=0x7fc85007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.904+0000 7fc86d32e640 1 --2- 172.21.15.67:0/2929837521 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc850079e00 0x7fc85007c2c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc8681041d0 tx=0x7fc85c005e50 comp rx=0 tx=0).stop 2024-08-31T05:26:44.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.904+0000 7fc86d32e640 1 -- 172.21.15.67:0/2929837521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8681005b0 msgr2=0x7fc868102740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.904+0000 7fc86d32e640 1 --2- 172.21.15.67:0/2929837521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8681005b0 0x7fc868102740 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc85802ae90 tx=0x7fc85802f5f0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.904+0000 7fc86d32e640 1 -- 172.21.15.67:0/2929837521 shutdown_connections 2024-08-31T05:26:44.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.904+0000 7fc86d32e640 1 --2- 172.21.15.67:0/2929837521 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc850079e00 0x7fc85007c2c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.904+0000 7fc86d32e640 1 --2- 172.21.15.67:0/2929837521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc868106660 0x7fc868102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.904+0000 7fc86d32e640 1 --2- 172.21.15.67:0/2929837521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8681005b0 0x7fc868102740 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.904+0000 7fc86d32e640 1 -- 172.21.15.67:0/2929837521 >> 172.21.15.67:0/2929837521 conn(0x7fc8680fc2f0 msgr2=0x7fc8681048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:44.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.904+0000 7fc86d32e640 1 -- 172.21.15.67:0/2929837521 shutdown_connections 2024-08-31T05:26:44.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.904+0000 7fc86d32e640 1 -- 172.21.15.67:0/2929837521 wait complete. 2024-08-31T05:26:44.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.990+0000 7fcc7c69e640 1 -- 172.21.15.67:0/521841207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc74106660 msgr2=0x7fcc74106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.990+0000 7fcc7c69e640 1 --2- 172.21.15.67:0/521841207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc74106660 0x7fcc74106a40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcc70009880 tx=0x7fcc7002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.992 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:44 smithi067 ceph-mon[99941]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:44.992 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:44 smithi067 ceph-mon[99941]: pgmap v159: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/276 objects degraded (13.406%) 2024-08-31T05:26:44.993 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:44 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2634735974' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:44.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.990+0000 7fcc7c69e640 1 -- 172.21.15.67:0/521841207 shutdown_connections 2024-08-31T05:26:44.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.990+0000 7fcc7c69e640 1 --2- 172.21.15.67:0/521841207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc741005b0 0x7fcc74100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.990+0000 7fcc7c69e640 1 --2- 172.21.15.67:0/521841207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc74106660 0x7fcc74106a40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.990+0000 7fcc7c69e640 1 -- 172.21.15.67:0/521841207 >> 172.21.15.67:0/521841207 conn(0x7fcc740fc2f0 msgr2=0x7fcc740fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:44.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.990+0000 7fcc7c69e640 1 -- 172.21.15.67:0/521841207 shutdown_connections 2024-08-31T05:26:44.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.990+0000 7fcc7c69e640 1 -- 172.21.15.67:0/521841207 wait complete. 2024-08-31T05:26:44.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.991+0000 7fcc7c69e640 1 Processor -- start 2024-08-31T05:26:44.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.991+0000 7fcc7c69e640 1 -- start start 2024-08-31T05:26:44.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.991+0000 7fcc7c69e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc741005b0 0x7fcc741965a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:44.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.991+0000 7fcc7c69e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc74106660 0x7fcc74196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:44.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.991+0000 7fcc7c69e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7410da50 con 0x7fcc74106660 2024-08-31T05:26:44.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.991+0000 7fcc7c69e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7410d8d0 con 0x7fcc741005b0 2024-08-31T05:26:44.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.991+0000 7fcc79c39640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc74106660 0x7fcc74196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:44.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.992+0000 7fcc79c39640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc74106660 0x7fcc74196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34552/0 (socket says 172.21.15.67:34552) 2024-08-31T05:26:44.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.992+0000 7fcc79c39640 1 -- 172.21.15.67:0/1704730089 learned_addr learned my addr 172.21.15.67:0/1704730089 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:26:44.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.992+0000 7fcc7a43a640 1 --2- 172.21.15.67:0/1704730089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc741005b0 0x7fcc741965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:44.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.992+0000 7fcc79c39640 1 -- 172.21.15.67:0/1704730089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc741005b0 msgr2=0x7fcc741965a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.992+0000 7fcc79c39640 1 --2- 172.21.15.67:0/1704730089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc741005b0 0x7fcc741965a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.992+0000 7fcc79c39640 1 -- 172.21.15.67:0/1704730089 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7419ae70 con 0x7fcc74106660 2024-08-31T05:26:44.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.992+0000 7fcc7a43a640 1 --2- 172.21.15.67:0/1704730089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc741005b0 0x7fcc741965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:26:44.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.992+0000 7fcc79c39640 1 --2- 172.21.15.67:0/1704730089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc74106660 0x7fcc74196ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcc64007910 tx=0x7fcc64007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:44.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.992+0000 7fcc6b7fe640 1 -- 172.21.15.67:0/1704730089 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc64019070 con 0x7fcc74106660 2024-08-31T05:26:44.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.992+0000 7fcc7c69e640 1 -- 172.21.15.67:0/1704730089 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc7419b100 con 0x7fcc74106660 2024-08-31T05:26:44.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.992+0000 7fcc7c69e640 1 -- 172.21.15.67:0/1704730089 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc7419b690 con 0x7fcc74106660 2024-08-31T05:26:44.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.992+0000 7fcc6b7fe640 1 -- 172.21.15.67:0/1704730089 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc64005020 con 0x7fcc74106660 2024-08-31T05:26:44.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.993+0000 7fcc6b7fe640 1 -- 172.21.15.67:0/1704730089 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc64004b30 con 0x7fcc74106660 2024-08-31T05:26:44.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.994+0000 7fcc7c69e640 1 -- 172.21.15.67:0/1704730089 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc74101cd0 con 0x7fcc74106660 2024-08-31T05:26:44.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.994+0000 7fcc6b7fe640 1 -- 172.21.15.67:0/1704730089 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fcc6401c070 con 0x7fcc74106660 2024-08-31T05:26:44.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.995+0000 7fcc6b7fe640 1 --2- 172.21.15.67:0/1704730089 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcc60079e40 0x7fcc6007c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:44.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.995+0000 7fcc6b7fe640 1 -- 172.21.15.67:0/1704730089 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6245+0+0 (secure 0 0 0) 0x7fcc64012050 con 0x7fcc74106660 2024-08-31T05:26:44.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.995+0000 7fcc7a43a640 1 --2- 172.21.15.67:0/1704730089 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcc60079e40 0x7fcc6007c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:44.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:44.996+0000 7fcc7a43a640 1 --2- 172.21.15.67:0/1704730089 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcc60079e40 0x7fcc6007c300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc70000c00 tx=0x7fcc70004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:45.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.000+0000 7fcc6b7fe640 1 -- 172.21.15.67:0/1704730089 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcc64065660 con 0x7fcc74106660 2024-08-31T05:26:45.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:44 smithi073 ceph-mon[71452]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:45.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:44 smithi073 ceph-mon[71452]: pgmap v159: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/276 objects degraded (13.406%) 2024-08-31T05:26:45.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:44 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2634735974' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:45.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.222+0000 7fcc7c69e640 1 -- 172.21.15.67:0/1704730089 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcc7419b940 con 0x7fcc60079e40 2024-08-31T05:26:45.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.224+0000 7fcc6b7fe640 1 -- 172.21.15.67:0/1704730089 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fcc7419b940 con 0x7fcc60079e40 2024-08-31T05:26:45.225 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:26:45.225 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:26:45.226 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:26:45.226 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-31T05:26:45.226 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:26:45.226 INFO:teuthology.orchestra.run.smithi067.stdout: "mon", 2024-08-31T05:26:45.226 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2024-08-31T05:26:45.226 INFO:teuthology.orchestra.run.smithi067.stdout: "crash" 2024-08-31T05:26:45.226 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:26:45.226 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "7/23 daemons upgraded", 2024-08-31T05:26:45.226 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading osd daemons", 2024-08-31T05:26:45.226 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:26:45.226 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:26:45.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.227+0000 7fcc7c69e640 1 -- 172.21.15.67:0/1704730089 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcc60079e40 msgr2=0x7fcc6007c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:45.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.227+0000 7fcc7c69e640 1 --2- 172.21.15.67:0/1704730089 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcc60079e40 0x7fcc6007c300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc70000c00 tx=0x7fcc70004f30 comp rx=0 tx=0).stop 2024-08-31T05:26:45.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.227+0000 7fcc7c69e640 1 -- 172.21.15.67:0/1704730089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc74106660 msgr2=0x7fcc74196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:45.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.227+0000 7fcc7c69e640 1 --2- 172.21.15.67:0/1704730089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc74106660 0x7fcc74196ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcc64007910 tx=0x7fcc64007dd0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.227+0000 7fcc7c69e640 1 -- 172.21.15.67:0/1704730089 shutdown_connections 2024-08-31T05:26:45.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.227+0000 7fcc7c69e640 1 --2- 172.21.15.67:0/1704730089 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcc60079e40 0x7fcc6007c300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.227+0000 7fcc7c69e640 1 --2- 172.21.15.67:0/1704730089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc74106660 0x7fcc74196ae0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.227+0000 7fcc7c69e640 1 --2- 172.21.15.67:0/1704730089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc741005b0 0x7fcc741965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.227+0000 7fcc7c69e640 1 -- 172.21.15.67:0/1704730089 >> 172.21.15.67:0/1704730089 conn(0x7fcc740fc2f0 msgr2=0x7fcc740fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:45.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.227+0000 7fcc7c69e640 1 -- 172.21.15.67:0/1704730089 shutdown_connections 2024-08-31T05:26:45.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.227+0000 7fcc7c69e640 1 -- 172.21.15.67:0/1704730089 wait complete. 2024-08-31T05:26:45.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.330+0000 7f9e82149640 1 -- 172.21.15.67:0/804946647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e7c1012e0 msgr2=0x7f9e7c1016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:45.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.330+0000 7f9e82149640 1 --2- 172.21.15.67:0/804946647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e7c1012e0 0x7f9e7c1016c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009880 tx=0x7f9e6c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.330+0000 7f9e82149640 1 -- 172.21.15.67:0/804946647 shutdown_connections 2024-08-31T05:26:45.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.330+0000 7f9e82149640 1 --2- 172.21.15.67:0/804946647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e7c101c90 0x7f9e7c105240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.330+0000 7f9e82149640 1 --2- 172.21.15.67:0/804946647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e7c1012e0 0x7f9e7c1016c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.330+0000 7f9e82149640 1 -- 172.21.15.67:0/804946647 >> 172.21.15.67:0/804946647 conn(0x7f9e7c076f80 msgr2=0x7f9e7c077390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:45.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.330+0000 7f9e82149640 1 -- 172.21.15.67:0/804946647 shutdown_connections 2024-08-31T05:26:45.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.330+0000 7f9e82149640 1 -- 172.21.15.67:0/804946647 wait complete. 2024-08-31T05:26:45.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.331+0000 7f9e82149640 1 Processor -- start 2024-08-31T05:26:45.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.331+0000 7f9e82149640 1 -- start start 2024-08-31T05:26:45.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.331+0000 7f9e82149640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e7c1012e0 0x7f9e7c1965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:45.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.331+0000 7f9e82149640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e7c101c90 0x7f9e7c196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:45.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.331+0000 7f9e82149640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c10da50 con 0x7f9e7c101c90 2024-08-31T05:26:45.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.331+0000 7f9e82149640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c10d8d0 con 0x7f9e7c1012e0 2024-08-31T05:26:45.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.331+0000 7f9e7affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e7c101c90 0x7f9e7c196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:45.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.331+0000 7f9e7affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e7c101c90 0x7f9e7c196b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34576/0 (socket says 172.21.15.67:34576) 2024-08-31T05:26:45.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.331+0000 7f9e7affd640 1 -- 172.21.15.67:0/2244197804 learned_addr learned my addr 172.21.15.67:0/2244197804 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:26:45.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.331+0000 7f9e7b7fe640 1 --2- 172.21.15.67:0/2244197804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e7c1012e0 0x7f9e7c1965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:45.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.332+0000 7f9e7affd640 1 -- 172.21.15.67:0/2244197804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e7c1012e0 msgr2=0x7f9e7c1965d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:45.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.332+0000 7f9e7affd640 1 --2- 172.21.15.67:0/2244197804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e7c1012e0 0x7f9e7c1965d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.332+0000 7f9e7affd640 1 -- 172.21.15.67:0/2244197804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7c1971c0 con 0x7f9e7c101c90 2024-08-31T05:26:45.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.332+0000 7f9e7affd640 1 --2- 172.21.15.67:0/2244197804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e7c101c90 0x7f9e7c196b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000c8f0 tx=0x7f9e7000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:45.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.332+0000 7f9e78ff9640 1 -- 172.21.15.67:0/2244197804 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e70014070 con 0x7f9e7c101c90 2024-08-31T05:26:45.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.332+0000 7f9e82149640 1 -- 172.21.15.67:0/2244197804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e7c19af60 con 0x7f9e7c101c90 2024-08-31T05:26:45.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.332+0000 7f9e78ff9640 1 -- 172.21.15.67:0/2244197804 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e70007c60 con 0x7f9e7c101c90 2024-08-31T05:26:45.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.332+0000 7f9e78ff9640 1 -- 172.21.15.67:0/2244197804 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e70003c30 con 0x7f9e7c101c90 2024-08-31T05:26:45.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.332+0000 7f9e82149640 1 -- 172.21.15.67:0/2244197804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7c19b4f0 con 0x7f9e7c101c90 2024-08-31T05:26:45.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.334+0000 7f9e82149640 1 -- 172.21.15.67:0/2244197804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e7c069670 con 0x7f9e7c101c90 2024-08-31T05:26:45.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.334+0000 7f9e78ff9640 1 -- 172.21.15.67:0/2244197804 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f9e70017070 con 0x7f9e7c101c90 2024-08-31T05:26:45.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.335+0000 7f9e78ff9640 1 --2- 172.21.15.67:0/2244197804 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9e64079e00 0x7f9e6407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:45.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.335+0000 7f9e78ff9640 1 -- 172.21.15.67:0/2244197804 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6245+0+0 (secure 0 0 0) 0x7f9e7009c6d0 con 0x7f9e7c101c90 2024-08-31T05:26:45.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.335+0000 7f9e7b7fe640 1 --2- 172.21.15.67:0/2244197804 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9e64079e00 0x7f9e6407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:45.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.335+0000 7f9e7b7fe640 1 --2- 172.21.15.67:0/2244197804 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9e64079e00 0x7f9e6407c2c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0096c0 tx=0x7f9e6c031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:45.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.340+0000 7f9e78ff9640 1 -- 172.21.15.67:0/2244197804 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9e700682a0 con 0x7f9e7c101c90 2024-08-31T05:26:45.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.616+0000 7f9e82149640 1 -- 172.21.15.67:0/2244197804 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f9e7c108b30 con 0x7f9e7c101c90 2024-08-31T05:26:45.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.616+0000 7f9e78ff9640 1 -- 172.21.15.67:0/2244197804 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1182 (secure 0 0 0) 0x7f9e7006ccc0 con 0x7f9e7c101c90 2024-08-31T05:26:45.618 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 37/276 objects degraded (13.406%), 13 pgs degraded 2024-08-31T05:26:45.618 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:26:45.618 INFO:teuthology.orchestra.run.smithi067.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:26:45.618 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-31T05:26:45.618 INFO:teuthology.orchestra.run.smithi067.stdout: osd.1 (root=default,host=smithi067) is down 2024-08-31T05:26:45.619 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 37/276 objects degraded (13.406%), 13 pgs degraded 2024-08-31T05:26:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-08-31T05:26:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-08-31T05:26:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-08-31T05:26:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-08-31T05:26:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-08-31T05:26:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-08-31T05:26:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-08-31T05:26:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-08-31T05:26:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-08-31T05:26:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-08-31T05:26:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-08-31T05:26:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-08-31T05:26:45.619 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-08-31T05:26:45.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.618+0000 7f9e82149640 1 -- 172.21.15.67:0/2244197804 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9e64079e00 msgr2=0x7f9e6407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:45.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.618+0000 7f9e82149640 1 --2- 172.21.15.67:0/2244197804 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9e64079e00 0x7f9e6407c2c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0096c0 tx=0x7f9e6c031400 comp rx=0 tx=0).stop 2024-08-31T05:26:45.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.619+0000 7f9e82149640 1 -- 172.21.15.67:0/2244197804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e7c101c90 msgr2=0x7f9e7c196b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:45.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.619+0000 7f9e82149640 1 --2- 172.21.15.67:0/2244197804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e7c101c90 0x7f9e7c196b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000c8f0 tx=0x7f9e7000cdb0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.619+0000 7f9e82149640 1 -- 172.21.15.67:0/2244197804 shutdown_connections 2024-08-31T05:26:45.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.619+0000 7f9e82149640 1 --2- 172.21.15.67:0/2244197804 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9e64079e00 0x7f9e6407c2c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.619+0000 7f9e82149640 1 --2- 172.21.15.67:0/2244197804 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9e7c101c90 0x7f9e7c196b10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.619+0000 7f9e82149640 1 --2- 172.21.15.67:0/2244197804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e7c1012e0 0x7f9e7c1965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.619+0000 7f9e82149640 1 -- 172.21.15.67:0/2244197804 >> 172.21.15.67:0/2244197804 conn(0x7f9e7c076f80 msgr2=0x7f9e7c0fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:45.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.619+0000 7f9e82149640 1 -- 172.21.15.67:0/2244197804 shutdown_connections 2024-08-31T05:26:45.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:26:45.619+0000 7f9e82149640 1 -- 172.21.15.67:0/2244197804 wait complete. 2024-08-31T05:26:46.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:45 smithi067 ceph-mon[99941]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:46.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:45 smithi067 ceph-mon[99941]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:46.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:45 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2929837521' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:26:46.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:45 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:46.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:45 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:46.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:45 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2244197804' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:26:46.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:45 smithi073 ceph-mon[71452]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:46.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:45 smithi073 ceph-mon[71452]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:46.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:45 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2929837521' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:26:46.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:45 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:46.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:45 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:46.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:45 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2244197804' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:26:46.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:46 smithi067 ceph-mon[99941]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:46.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:46 smithi067 ceph-mon[99941]: pgmap v160: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/276 objects degraded (13.406%) 2024-08-31T05:26:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:46 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:46 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:47.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:46 smithi073 ceph-mon[71452]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:47.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:46 smithi073 ceph-mon[71452]: pgmap v160: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/276 objects degraded (13.406%) 2024-08-31T05:26:47.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:46 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:47.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:46 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:48.325 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:48 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1[114537]: 2024-08-31T05:26:48.195+0000 7fc6ef883640 -1 osd.1 61 log_to_monitors true 2024-08-31T05:26:49.062 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:48 smithi067 ceph-mon[99941]: pgmap v161: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/276 objects degraded (13.406%) 2024-08-31T05:26:49.062 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:48 smithi067 ceph-mon[99941]: from='osd.1 [v2:172.21.15.67:6810/1815523117,v1:172.21.15.67:6811/1815523117]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T05:26:49.062 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:26:48 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1[114537]: 2024-08-31T05:26:48.746+0000 7fc6e35fb640 -1 osd.1 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:26:49.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:48 smithi073 ceph-mon[71452]: pgmap v161: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/276 objects degraded (13.406%) 2024-08-31T05:26:49.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:48 smithi073 ceph-mon[71452]: from='osd.1 [v2:172.21.15.67:6810/1815523117,v1:172.21.15.67:6811/1815523117]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T05:26:50.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: from='osd.1 [v2:172.21.15.67:6810/1815523117,v1:172.21.15.67:6811/1815523117]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T05:26:50.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: osdmap e64: 6 total, 5 up, 6 in 2024-08-31T05:26:50.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: from='osd.1 [v2:172.21.15.67:6810/1815523117,v1:172.21.15.67:6811/1815523117]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-08-31T05:26:50.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:50.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:50.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:50.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:50.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:50.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:50.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:50.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:50.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:50.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-08-31T05:26:50.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:50.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:26:50.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: from='osd.1 [v2:172.21.15.67:6810/1815523117,v1:172.21.15.67:6811/1815523117]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T05:26:50.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: osdmap e64: 6 total, 5 up, 6 in 2024-08-31T05:26:50.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: from='osd.1 [v2:172.21.15.67:6810/1815523117,v1:172.21.15.67:6811/1815523117]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-08-31T05:26:50.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:50.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:50.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:50.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:50.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:50.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:50.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:50.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:50.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:26:50.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-08-31T05:26:50.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:26:50.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:26:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:50 smithi067 ceph-mon[99941]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-31T05:26:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:50 smithi067 ceph-mon[99941]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-08-31T05:26:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:50 smithi067 ceph-mon[99941]: pgmap v163: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 37/276 objects degraded (13.406%) 2024-08-31T05:26:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:50 smithi067 ceph-mon[99941]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-31T05:26:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:50 smithi067 ceph-mon[99941]: osd.1 [v2:172.21.15.67:6810/1815523117,v1:172.21.15.67:6811/1815523117] boot 2024-08-31T05:26:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:50 smithi067 ceph-mon[99941]: osdmap e65: 6 total, 6 up, 6 in 2024-08-31T05:26:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:26:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:50 smithi067 ceph-mon[99941]: osdmap e66: 6 total, 6 up, 6 in 2024-08-31T05:26:51.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:50 smithi073 ceph-mon[71452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-31T05:26:51.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:50 smithi073 ceph-mon[71452]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-08-31T05:26:51.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:50 smithi073 ceph-mon[71452]: pgmap v163: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 37/276 objects degraded (13.406%) 2024-08-31T05:26:51.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:50 smithi073 ceph-mon[71452]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-31T05:26:51.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:50 smithi073 ceph-mon[71452]: osd.1 [v2:172.21.15.67:6810/1815523117,v1:172.21.15.67:6811/1815523117] boot 2024-08-31T05:26:51.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:50 smithi073 ceph-mon[71452]: osdmap e65: 6 total, 6 up, 6 in 2024-08-31T05:26:51.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:26:51.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:50 smithi073 ceph-mon[71452]: osdmap e66: 6 total, 6 up, 6 in 2024-08-31T05:26:53.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:52 smithi067 ceph-mon[99941]: pgmap v166: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 37/276 objects degraded (13.406%) 2024-08-31T05:26:53.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:52 smithi073 ceph-mon[71452]: pgmap v166: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 37/276 objects degraded (13.406%) 2024-08-31T05:26:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:54 smithi067 ceph-mon[99941]: pgmap v167: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 37/276 objects degraded (13.406%) 2024-08-31T05:26:55.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:54 smithi073 ceph-mon[71452]: pgmap v167: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 37/276 objects degraded (13.406%) 2024-08-31T05:26:56.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:55 smithi067 ceph-mon[99941]: pgmap v168: 65 pgs: 65 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 590 B/s rd, 1 op/s 2024-08-31T05:26:56.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:55 smithi067 ceph-mon[99941]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/276 objects degraded (13.406%), 13 pgs degraded) 2024-08-31T05:26:56.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:55 smithi073 ceph-mon[71452]: pgmap v168: 65 pgs: 65 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 590 B/s rd, 1 op/s 2024-08-31T05:26:56.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:55 smithi073 ceph-mon[71452]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/276 objects degraded (13.406%), 13 pgs degraded) 2024-08-31T05:26:59.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:26:58 smithi067 ceph-mon[99941]: pgmap v169: 65 pgs: 65 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-08-31T05:26:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:26:58 smithi073 ceph-mon[71452]: pgmap v169: 65 pgs: 65 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-08-31T05:27:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:00 smithi067 ceph-mon[99941]: pgmap v170: 65 pgs: 65 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 927 B/s rd, 1 op/s 2024-08-31T05:27:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:00 smithi073 ceph-mon[71452]: pgmap v170: 65 pgs: 65 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 927 B/s rd, 1 op/s 2024-08-31T05:27:03.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:02 smithi067 ceph-mon[99941]: pgmap v171: 65 pgs: 65 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 842 B/s rd, 1 op/s 2024-08-31T05:27:03.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:02 smithi073 ceph-mon[71452]: pgmap v171: 65 pgs: 65 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 842 B/s rd, 1 op/s 2024-08-31T05:27:05.042 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:04 smithi067 ceph-mon[99941]: pgmap v172: 65 pgs: 65 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:27:05.043 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:05.043 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:27:05.043 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-08-31T05:27:05.043 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:04 smithi073 ceph-mon[71452]: pgmap v172: 65 pgs: 65 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:27:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:27:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-08-31T05:27:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:06.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:05 smithi067 ceph-mon[99941]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-31T05:27:06.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:05 smithi067 ceph-mon[99941]: Upgrade: osd.2 is safe to restart 2024-08-31T05:27:06.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "2.1a"} : dispatch 2024-08-31T05:27:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:05 smithi073 ceph-mon[71452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-31T05:27:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:05 smithi073 ceph-mon[71452]: Upgrade: osd.2 is safe to restart 2024-08-31T05:27:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "2.1a"} : dispatch 2024-08-31T05:27:07.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:06 smithi067 ceph-mon[99941]: pgmap v173: 65 pgs: 65 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:27:07.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:06 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "2.1a"}]': finished 2024-08-31T05:27:07.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:06 smithi067 ceph-mon[99941]: osdmap e67: 6 total, 6 up, 6 in 2024-08-31T05:27:07.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:06 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:07.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:06 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T05:27:07.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:06 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:07.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:06 smithi073 ceph-mon[71452]: pgmap v173: 65 pgs: 65 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:27:07.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:06 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "2.1a"}]': finished 2024-08-31T05:27:07.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:06 smithi073 ceph-mon[71452]: osdmap e67: 6 total, 6 up, 6 in 2024-08-31T05:27:07.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:06 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:07.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:06 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T05:27:07.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:06 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:07.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:07 smithi073 ceph-mon[71452]: Upgrade: Updating osd.2 2024-08-31T05:27:07.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:07 smithi073 ceph-mon[71452]: Deploying daemon osd.2 on smithi067 2024-08-31T05:27:07.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:07 smithi073 ceph-mon[71452]: osdmap e68: 6 total, 6 up, 6 in 2024-08-31T05:27:07.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:07 smithi073 ceph-mon[71452]: osdmap e69: 6 total, 6 up, 6 in 2024-08-31T05:27:07.962 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:07 smithi067 ceph-mon[99941]: Upgrade: Updating osd.2 2024-08-31T05:27:07.962 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:07 smithi067 ceph-mon[99941]: Deploying daemon osd.2 on smithi067 2024-08-31T05:27:07.962 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:07 smithi067 ceph-mon[99941]: osdmap e68: 6 total, 6 up, 6 in 2024-08-31T05:27:07.962 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:07 smithi067 ceph-mon[99941]: osdmap e69: 6 total, 6 up, 6 in 2024-08-31T05:27:09.011 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:08 smithi067 ceph-mon[99941]: pgmap v176: 65 pgs: 65 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-08-31T05:27:09.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:08 smithi073 ceph-mon[71452]: pgmap v176: 65 pgs: 65 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-08-31T05:27:09.266 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:09 smithi067 systemd[1]: Stopping Ceph osd.2 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:27:09.574 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:09 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2[52254]: 2024-08-31T05:27:09.262+0000 7fb5aa4e7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:27:09.575 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:09 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2[52254]: 2024-08-31T05:27:09.262+0000 7fb5aa4e7640 -1 osd.2 70 *** Got signal Terminated *** 2024-08-31T05:27:09.575 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:09 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2[52254]: 2024-08-31T05:27:09.262+0000 7fb5aa4e7640 -1 osd.2 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:27:09.946 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:09 smithi067 ceph-mon[99941]: osdmap e70: 6 total, 6 up, 6 in 2024-08-31T05:27:09.946 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:09 smithi067 ceph-mon[99941]: osd.2 marked itself down and dead 2024-08-31T05:27:10.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:09 smithi073 ceph-mon[71452]: osdmap e70: 6 total, 6 up, 6 in 2024-08-31T05:27:10.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:09 smithi073 ceph-mon[71452]: osd.2 marked itself down and dead 2024-08-31T05:27:10.575 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:10 smithi067 podman[119746]: 2024-08-31 05:27:10.315088428 +0000 UTC m=+1.160053373 container died c1d51346842ade647ad7d92ba79b9f9d94cef6e2a364378f2254e256ed6ab39a (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-244a32d, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-31T05:27:10.974 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:10 smithi067 podman[119746]: 2024-08-31 05:27:10.663005441 +0000 UTC m=+1.507970376 container cleanup c1d51346842ade647ad7d92ba79b9f9d94cef6e2a364378f2254e256ed6ab39a (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-244a32d, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-08-31T05:27:10.974 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:10 smithi067 bash[119746]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2 2024-08-31T05:27:10.975 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:10 smithi067 ceph-mon[99941]: pgmap v179: 65 pgs: 1 peering, 64 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 4.0 MiB/s, 3 objects/s recovering 2024-08-31T05:27:10.975 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:10 smithi067 ceph-mon[99941]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-31T05:27:10.975 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:10 smithi067 ceph-mon[99941]: osdmap e71: 6 total, 5 up, 6 in 2024-08-31T05:27:11.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:10 smithi073 ceph-mon[71452]: pgmap v179: 65 pgs: 1 peering, 64 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 4.0 MiB/s, 3 objects/s recovering 2024-08-31T05:27:11.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:10 smithi073 ceph-mon[71452]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-31T05:27:11.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:10 smithi073 ceph-mon[71452]: osdmap e71: 6 total, 5 up, 6 in 2024-08-31T05:27:11.325 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:10 smithi067 podman[119761]: 2024-08-31 05:27:10.973331732 +0000 UTC m=+0.658161693 container remove c1d51346842ade647ad7d92ba79b9f9d94cef6e2a364378f2254e256ed6ab39a (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2, RELEASE=squid-244a32d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-31T05:27:11.611 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:11 smithi067 podman[119851]: 2024-08-31 05:27:11.23886951 +0000 UTC m=+0.015836985 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:27:11.611 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:11 smithi067 podman[119851]: 2024-08-31 05:27:11.357701767 +0000 UTC m=+0.134669244 container create 58e6203e0752b72a44d442f73f726f6c634f7aa175dd2f7f5558e396c0de3366 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-31T05:27:11.611 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:11 smithi067 podman[119851]: 2024-08-31 05:27:11.610095424 +0000 UTC m=+0.387062899 container init 58e6203e0752b72a44d442f73f726f6c634f7aa175dd2f7f5558e396c0de3366 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:27:12.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:11 smithi067 ceph-mon[99941]: osdmap e72: 6 total, 5 up, 6 in 2024-08-31T05:27:12.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:11 smithi067 ceph-mon[99941]: pgmap v182: 65 pgs: 9 stale+active+clean, 1 peering, 55 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 4.0 MiB/s, 3 objects/s recovering 2024-08-31T05:27:12.075 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:11 smithi067 podman[119851]: 2024-08-31 05:27:11.613578227 +0000 UTC m=+0.390545704 container start 58e6203e0752b72a44d442f73f726f6c634f7aa175dd2f7f5558e396c0de3366 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:27:12.075 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:11 smithi067 podman[119851]: 2024-08-31 05:27:11.693465109 +0000 UTC m=+0.470432584 container attach 58e6203e0752b72a44d442f73f726f6c634f7aa175dd2f7f5558e396c0de3366 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-31T05:27:12.075 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:11 smithi067 podman[119851]: 2024-08-31 05:27:11.807991069 +0000 UTC m=+0.584958544 container died 58e6203e0752b72a44d442f73f726f6c634f7aa175dd2f7f5558e396c0de3366 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:27:12.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:11 smithi073 ceph-mon[71452]: osdmap e72: 6 total, 5 up, 6 in 2024-08-31T05:27:12.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:11 smithi073 ceph-mon[71452]: pgmap v182: 65 pgs: 9 stale+active+clean, 1 peering, 55 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 4.0 MiB/s, 3 objects/s recovering 2024-08-31T05:27:12.825 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:12 smithi067 podman[119874]: 2024-08-31 05:27:12.447186867 +0000 UTC m=+0.633687934 container remove 58e6203e0752b72a44d442f73f726f6c634f7aa175dd2f7f5558e396c0de3366 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-31T05:27:12.825 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:12 smithi067 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.2.service: Deactivated successfully. 2024-08-31T05:27:12.825 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:12 smithi067 systemd[1]: Stopped Ceph osd.2 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:27:12.825 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:12 smithi067 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.2.service: Consumed 48.618s CPU time. 2024-08-31T05:27:12.825 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:12 smithi067 systemd[1]: Starting Ceph osd.2 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:27:13.219 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:12 smithi067 podman[119975]: 2024-08-31 05:27:12.807568357 +0000 UTC m=+0.016233793 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:27:13.219 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:12 smithi067 podman[119975]: 2024-08-31 05:27:12.93200554 +0000 UTC m=+0.140670966 container create cf723b933960c21f4ba7348927b5b57d2a6c477a06798fb4a23e1c5fc4512570 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-31T05:27:13.505 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 podman[119975]: 2024-08-31 05:27:13.218330036 +0000 UTC m=+0.426995463 container init cf723b933960c21f4ba7348927b5b57d2a6c477a06798fb4a23e1c5fc4512570 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-31T05:27:13.505 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 podman[119975]: 2024-08-31 05:27:13.222092741 +0000 UTC m=+0.430758179 container start cf723b933960c21f4ba7348927b5b57d2a6c477a06798fb4a23e1c5fc4512570 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-31T05:27:13.505 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 podman[119975]: 2024-08-31 05:27:13.343148251 +0000 UTC m=+0.551813687 container attach cf723b933960c21f4ba7348927b5b57d2a6c477a06798fb4a23e1c5fc4512570 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-08-31T05:27:13.505 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate[119991]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:13.505 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 bash[119975]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:13.505 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate[119991]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:13.505 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 bash[119975]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:13.505 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate[119991]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-31T05:27:13.505 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 bash[119975]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-31T05:27:13.506 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate[119991]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:13.506 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 bash[119975]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:13.506 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate[119991]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:13.506 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 bash[119975]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:13.506 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate[119991]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-31T05:27:13.506 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 bash[119975]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-31T05:27:13.772 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate[119991]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-08-31T05:27:13.773 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 bash[119975]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-08-31T05:27:14.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:13 smithi067 ceph-mon[99941]: pgmap v183: 65 pgs: 6 active+undersized, 6 stale+active+clean, 1 peering, 4 active+undersized+degraded, 48 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 op/s; 11/276 objects degraded (3.986%); 2.7 MiB/s, 2 objects/s recovering 2024-08-31T05:27:14.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:13 smithi067 ceph-mon[99941]: Health check failed: Degraded data redundancy: 11/276 objects degraded (3.986%), 4 pgs degraded (PG_DEGRADED) 2024-08-31T05:27:14.075 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate[119991]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-08-31T05:27:14.075 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 bash[119975]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-08-31T05:27:14.075 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate[119991]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-08-31T05:27:14.075 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 bash[119975]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-08-31T05:27:14.075 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate[119991]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-31T05:27:14.076 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 bash[119975]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-31T05:27:14.076 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate[119991]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-31T05:27:14.076 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 bash[119975]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-31T05:27:14.076 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate[119991]: --> ceph-volume lvm activate successful for osd ID: 2 2024-08-31T05:27:14.076 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 bash[119975]: --> ceph-volume lvm activate successful for osd ID: 2 2024-08-31T05:27:14.076 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:13 smithi067 podman[119975]: 2024-08-31 05:27:13.82823809 +0000 UTC m=+1.036903517 container died cf723b933960c21f4ba7348927b5b57d2a6c477a06798fb4a23e1c5fc4512570 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-31T05:27:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:13 smithi073 ceph-mon[71452]: pgmap v183: 65 pgs: 6 active+undersized, 6 stale+active+clean, 1 peering, 4 active+undersized+degraded, 48 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 op/s; 11/276 objects degraded (3.986%); 2.7 MiB/s, 2 objects/s recovering 2024-08-31T05:27:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:13 smithi073 ceph-mon[71452]: Health check failed: Degraded data redundancy: 11/276 objects degraded (3.986%), 4 pgs degraded (PG_DEGRADED) 2024-08-31T05:27:14.825 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:14 smithi067 podman[120120]: 2024-08-31 05:27:14.474729938 +0000 UTC m=+0.640769767 container remove cf723b933960c21f4ba7348927b5b57d2a6c477a06798fb4a23e1c5fc4512570 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-activate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-31T05:27:14.825 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:14 smithi067 podman[120181]: 2024-08-31 05:27:14.586422261 +0000 UTC m=+0.016444456 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:27:14.825 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:14 smithi067 podman[120181]: 2024-08-31 05:27:14.700874158 +0000 UTC m=+0.130896344 container create a62abe735da2df29470dae42e4a1e18dd1af41676f3d6cf13c705480bbe9a4a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:27:15.325 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:14 smithi067 podman[120181]: 2024-08-31 05:27:14.936818791 +0000 UTC m=+0.366840979 container init a62abe735da2df29470dae42e4a1e18dd1af41676f3d6cf13c705480bbe9a4a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-31T05:27:15.325 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:14 smithi067 podman[120181]: 2024-08-31 05:27:14.940172287 +0000 UTC m=+0.370194473 container start a62abe735da2df29470dae42e4a1e18dd1af41676f3d6cf13c705480bbe9a4a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731) 2024-08-31T05:27:15.325 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:14 smithi067 ceph-osd[120200]: -- 172.21.15.67:0/3265134449 <== mon.0 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a36a1201e0 con 0x55a3693ab180 2024-08-31T05:27:15.325 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:15 smithi067 bash[120181]: a62abe735da2df29470dae42e4a1e18dd1af41676f3d6cf13c705480bbe9a4a1 2024-08-31T05:27:15.325 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:15 smithi067 systemd[1]: Started Ceph osd.2 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:27:15.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.709+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3579497258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fcc106660 msgr2=0x7f7fcc106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:15.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.709+0000 7f7fd45b3640 1 --2- 172.21.15.67:0/3579497258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fcc106660 0x7f7fcc106a40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009880 tx=0x7f7fbc02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:27:15.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.709+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3579497258 shutdown_connections 2024-08-31T05:27:15.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.709+0000 7f7fd45b3640 1 --2- 172.21.15.67:0/3579497258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fcc1005b0 0x7f7fcc100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:15.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.709+0000 7f7fd45b3640 1 --2- 172.21.15.67:0/3579497258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fcc106660 0x7f7fcc106a40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:15.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.709+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3579497258 >> 172.21.15.67:0/3579497258 conn(0x7f7fcc0fc2f0 msgr2=0x7f7fcc0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:15.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.709+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3579497258 shutdown_connections 2024-08-31T05:27:15.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.709+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3579497258 wait complete. 2024-08-31T05:27:15.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.709+0000 7f7fd45b3640 1 Processor -- start 2024-08-31T05:27:15.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.709+0000 7f7fd45b3640 1 -- start start 2024-08-31T05:27:15.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.710+0000 7f7fd45b3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fcc1005b0 0x7f7fcc197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:15.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.710+0000 7f7fd45b3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fcc106660 0x7f7fcc197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:15.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.710+0000 7f7fd45b3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc10da70 con 0x7f7fcc106660 2024-08-31T05:27:15.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.710+0000 7f7fd45b3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc10d8f0 con 0x7f7fcc1005b0 2024-08-31T05:27:15.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.710+0000 7f7fd1b4e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fcc106660 0x7f7fcc197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:15.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.710+0000 7f7fd234f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fcc1005b0 0x7f7fcc197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:15.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.710+0000 7f7fd1b4e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fcc106660 0x7f7fcc197bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53792/0 (socket says 172.21.15.67:53792) 2024-08-31T05:27:15.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.710+0000 7f7fd1b4e640 1 -- 172.21.15.67:0/3994457266 learned_addr learned my addr 172.21.15.67:0/3994457266 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:27:15.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.710+0000 7f7fd1b4e640 1 -- 172.21.15.67:0/3994457266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fcc1005b0 msgr2=0x7f7fcc197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:15.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.710+0000 7f7fd1b4e640 1 --2- 172.21.15.67:0/3994457266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fcc1005b0 0x7f7fcc197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:15.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.710+0000 7f7fd1b4e640 1 -- 172.21.15.67:0/3994457266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc19bf50 con 0x7f7fcc106660 2024-08-31T05:27:15.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.711+0000 7f7fd1b4e640 1 --2- 172.21.15.67:0/3994457266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fcc106660 0x7f7fcc197bc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800c8f0 tx=0x7f7fc800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:15.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.711+0000 7f7fc37fe640 1 -- 172.21.15.67:0/3994457266 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7fc80079b0 con 0x7f7fcc106660 2024-08-31T05:27:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.711+0000 7f7fc37fe640 1 -- 172.21.15.67:0/3994457266 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7fc80054e0 con 0x7f7fcc106660 2024-08-31T05:27:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.711+0000 7f7fc37fe640 1 -- 172.21.15.67:0/3994457266 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7fc8004dd0 con 0x7f7fcc106660 2024-08-31T05:27:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.711+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3994457266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fcc19c240 con 0x7f7fcc106660 2024-08-31T05:27:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.711+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3994457266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fcc19c7d0 con 0x7f7fcc106660 2024-08-31T05:27:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.712+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3994457266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fcc101cd0 con 0x7f7fcc106660 2024-08-31T05:27:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.713+0000 7f7fc37fe640 1 -- 172.21.15.67:0/3994457266 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f7fc8005000 con 0x7f7fcc106660 2024-08-31T05:27:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.713+0000 7f7fc37fe640 1 --2- 172.21.15.67:0/3994457266 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7fb8079da0 0x7f7fb807c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.713+0000 7f7fc37fe640 1 -- 172.21.15.67:0/3994457266 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6216+0+0 (secure 0 0 0) 0x7f7fc809ccf0 con 0x7f7fcc106660 2024-08-31T05:27:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.714+0000 7f7fd234f640 1 --2- 172.21.15.67:0/3994457266 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7fb8079da0 0x7f7fb807c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.714+0000 7f7fd234f640 1 --2- 172.21.15.67:0/3994457266 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7fb8079da0 0x7f7fb807c260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0096c0 tx=0x7f7fbc004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:15.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.718+0000 7f7fc37fe640 1 -- 172.21.15.67:0/3994457266 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7fc8014030 con 0x7f7fcc106660 2024-08-31T05:27:15.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.924+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3994457266 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7fcc19cae0 con 0x7f7fb8079da0 2024-08-31T05:27:15.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.925+0000 7f7fc37fe640 1 -- 172.21.15.67:0/3994457266 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f7fcc19cae0 con 0x7f7fb8079da0 2024-08-31T05:27:15.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.928+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3994457266 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7fb8079da0 msgr2=0x7f7fb807c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:15.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.928+0000 7f7fd45b3640 1 --2- 172.21.15.67:0/3994457266 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7fb8079da0 0x7f7fb807c260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0096c0 tx=0x7f7fbc004f30 comp rx=0 tx=0).stop 2024-08-31T05:27:15.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.928+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3994457266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fcc106660 msgr2=0x7f7fcc197bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:15.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.928+0000 7f7fd45b3640 1 --2- 172.21.15.67:0/3994457266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fcc106660 0x7f7fcc197bc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800c8f0 tx=0x7f7fc800cdb0 comp rx=0 tx=0).stop 2024-08-31T05:27:15.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.928+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3994457266 shutdown_connections 2024-08-31T05:27:15.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.928+0000 7f7fd45b3640 1 --2- 172.21.15.67:0/3994457266 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7fb8079da0 0x7f7fb807c260 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:15.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.928+0000 7f7fd45b3640 1 --2- 172.21.15.67:0/3994457266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fcc106660 0x7f7fcc197bc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:15.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.928+0000 7f7fd45b3640 1 --2- 172.21.15.67:0/3994457266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fcc1005b0 0x7f7fcc197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:15.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.928+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3994457266 >> 172.21.15.67:0/3994457266 conn(0x7f7fcc0fc2f0 msgr2=0x7f7fcc0699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:15.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.928+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3994457266 shutdown_connections 2024-08-31T05:27:15.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:15.928+0000 7f7fd45b3640 1 -- 172.21.15.67:0/3994457266 wait complete. 2024-08-31T05:27:15.939 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:27:16.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.012+0000 7f68124b4640 1 -- 172.21.15.67:0/3096142757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f680c0ffb60 msgr2=0x7f680c0fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.012+0000 7f68124b4640 1 --2- 172.21.15.67:0/3096142757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f680c0ffb60 0x7f680c0fffc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6800009880 tx=0x7f680002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.012+0000 7f68124b4640 1 -- 172.21.15.67:0/3096142757 shutdown_connections 2024-08-31T05:27:16.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.012+0000 7f68124b4640 1 --2- 172.21.15.67:0/3096142757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f680c0ffb60 0x7f680c0fffc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.012+0000 7f68124b4640 1 --2- 172.21.15.67:0/3096142757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f680c107790 0x7f680c107b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.012+0000 7f68124b4640 1 -- 172.21.15.67:0/3096142757 >> 172.21.15.67:0/3096142757 conn(0x7f680c0fba30 msgr2=0x7f680c0fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:16.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.012+0000 7f68124b4640 1 -- 172.21.15.67:0/3096142757 shutdown_connections 2024-08-31T05:27:16.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.012+0000 7f68124b4640 1 -- 172.21.15.67:0/3096142757 wait complete. 2024-08-31T05:27:16.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.013+0000 7f68124b4640 1 Processor -- start 2024-08-31T05:27:16.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.013+0000 7f68124b4640 1 -- start start 2024-08-31T05:27:16.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.013+0000 7f68124b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f680c0ffb60 0x7f680c19d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:16.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.013+0000 7f68124b4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f680c107790 0x7f680c19d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:16.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.013+0000 7f68124b4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f680c10ebe0 con 0x7f680c0ffb60 2024-08-31T05:27:16.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.013+0000 7f68124b4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f680c10ea60 con 0x7f680c107790 2024-08-31T05:27:16.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.014+0000 7f680bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f680c0ffb60 0x7f680c19d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:16.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.014+0000 7f680bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f680c0ffb60 0x7f680c19d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53808/0 (socket says 172.21.15.67:53808) 2024-08-31T05:27:16.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.014+0000 7f680bfff640 1 -- 172.21.15.67:0/280726870 learned_addr learned my addr 172.21.15.67:0/280726870 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:27:16.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.014+0000 7f680b7fe640 1 --2- 172.21.15.67:0/280726870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f680c107790 0x7f680c19d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:16.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.014+0000 7f680bfff640 1 -- 172.21.15.67:0/280726870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f680c107790 msgr2=0x7f680c19d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.014+0000 7f680bfff640 1 --2- 172.21.15.67:0/280726870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f680c107790 0x7f680c19d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.014+0000 7f680bfff640 1 -- 172.21.15.67:0/280726870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c1975f0 con 0x7f680c0ffb60 2024-08-31T05:27:16.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.014+0000 7f680bfff640 1 --2- 172.21.15.67:0/280726870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f680c0ffb60 0x7f680c19d430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00e970 tx=0x7f67fc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:16.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.014+0000 7f68097fa640 1 -- 172.21.15.67:0/280726870 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67fc00cac0 con 0x7f680c0ffb60 2024-08-31T05:27:16.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.014+0000 7f68124b4640 1 -- 172.21.15.67:0/280726870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f680c1978e0 con 0x7f680c0ffb60 2024-08-31T05:27:16.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.014+0000 7f68097fa640 1 -- 172.21.15.67:0/280726870 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67fc0054e0 con 0x7f680c0ffb60 2024-08-31T05:27:16.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.014+0000 7f68097fa640 1 -- 172.21.15.67:0/280726870 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67fc010430 con 0x7f680c0ffb60 2024-08-31T05:27:16.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.014+0000 7f68124b4640 1 -- 172.21.15.67:0/280726870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f680c197e40 con 0x7f680c0ffb60 2024-08-31T05:27:16.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.016+0000 7f68124b4640 1 -- 172.21.15.67:0/280726870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f680c102e80 con 0x7f680c0ffb60 2024-08-31T05:27:16.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.016+0000 7f68097fa640 1 -- 172.21.15.67:0/280726870 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f67fc004e80 con 0x7f680c0ffb60 2024-08-31T05:27:16.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.017+0000 7f68097fa640 1 --2- 172.21.15.67:0/280726870 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f67f4079e00 0x7f67f407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:16.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.017+0000 7f68097fa640 1 -- 172.21.15.67:0/280726870 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6216+0+0 (secure 0 0 0) 0x7f67fc09d0a0 con 0x7f680c0ffb60 2024-08-31T05:27:16.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.017+0000 7f680b7fe640 1 --2- 172.21.15.67:0/280726870 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f67f4079e00 0x7f67f407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:16.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.017+0000 7f680b7fe640 1 --2- 172.21.15.67:0/280726870 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f67f4079e00 0x7f67f407c2c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f680c198730 tx=0x7f6800031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:16.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.021+0000 7f68097fa640 1 -- 172.21.15.67:0/280726870 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f67fc064b20 con 0x7f680c0ffb60 2024-08-31T05:27:16.230 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:16 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:16.230 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:16 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:16.230 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:16 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:27:16.230 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:16 smithi067 ceph-mon[99941]: pgmap v184: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/276 objects degraded (12.681%); 1.7 MiB/s, 1 objects/s recovering 2024-08-31T05:27:16.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.228+0000 7f68124b4640 1 -- 172.21.15.67:0/280726870 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f680c198150 con 0x7f67f4079e00 2024-08-31T05:27:16.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.229+0000 7f68097fa640 1 -- 172.21.15.67:0/280726870 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f680c198150 con 0x7f67f4079e00 2024-08-31T05:27:16.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.231+0000 7f68124b4640 1 -- 172.21.15.67:0/280726870 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f67f4079e00 msgr2=0x7f67f407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.231+0000 7f68124b4640 1 --2- 172.21.15.67:0/280726870 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f67f4079e00 0x7f67f407c2c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f680c198730 tx=0x7f6800031400 comp rx=0 tx=0).stop 2024-08-31T05:27:16.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.231+0000 7f68124b4640 1 -- 172.21.15.67:0/280726870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f680c0ffb60 msgr2=0x7f680c19d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.231+0000 7f68124b4640 1 --2- 172.21.15.67:0/280726870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f680c0ffb60 0x7f680c19d430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00e970 tx=0x7f67fc00ed70 comp rx=0 tx=0).stop 2024-08-31T05:27:16.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.231+0000 7f68124b4640 1 -- 172.21.15.67:0/280726870 shutdown_connections 2024-08-31T05:27:16.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.231+0000 7f68124b4640 1 --2- 172.21.15.67:0/280726870 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f67f4079e00 0x7f67f407c2c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.231+0000 7f68124b4640 1 --2- 172.21.15.67:0/280726870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f680c107790 0x7f680c19d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.231+0000 7f68124b4640 1 --2- 172.21.15.67:0/280726870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f680c0ffb60 0x7f680c19d430 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.231+0000 7f68124b4640 1 -- 172.21.15.67:0/280726870 >> 172.21.15.67:0/280726870 conn(0x7f680c0fba30 msgr2=0x7f680c0fd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:16.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.231+0000 7f68124b4640 1 -- 172.21.15.67:0/280726870 shutdown_connections 2024-08-31T05:27:16.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.231+0000 7f68124b4640 1 -- 172.21.15.67:0/280726870 wait complete. 2024-08-31T05:27:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.316+0000 7f7af064d640 1 -- 172.21.15.67:0/2991053546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae81028f0 msgr2=0x7f7ae8102cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.316+0000 7f7af064d640 1 --2- 172.21.15.67:0/2991053546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae81028f0 0x7f7ae8102cd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009880 tx=0x7f7ae402a530 comp rx=0 tx=0).stop 2024-08-31T05:27:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.316+0000 7f7af064d640 1 -- 172.21.15.67:0/2991053546 shutdown_connections 2024-08-31T05:27:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.316+0000 7f7af064d640 1 --2- 172.21.15.67:0/2991053546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae8103210 0x7f7ae810b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.316+0000 7f7af064d640 1 --2- 172.21.15.67:0/2991053546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae81028f0 0x7f7ae8102cd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.316+0000 7f7af064d640 1 -- 172.21.15.67:0/2991053546 >> 172.21.15.67:0/2991053546 conn(0x7f7ae80fc2f0 msgr2=0x7f7ae80fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:16.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.316+0000 7f7af064d640 1 -- 172.21.15.67:0/2991053546 shutdown_connections 2024-08-31T05:27:16.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.316+0000 7f7af064d640 1 -- 172.21.15.67:0/2991053546 wait complete. 2024-08-31T05:27:16.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.317+0000 7f7af064d640 1 Processor -- start 2024-08-31T05:27:16.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.317+0000 7f7af064d640 1 -- start start 2024-08-31T05:27:16.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.317+0000 7f7af064d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae81028f0 0x7f7ae819dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:16.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.317+0000 7f7af064d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae8103210 0x7f7ae819e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:16.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.317+0000 7f7af064d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae810eb80 con 0x7f7ae8103210 2024-08-31T05:27:16.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.317+0000 7f7af064d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae810ea00 con 0x7f7ae81028f0 2024-08-31T05:27:16.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.317+0000 7f7aedbe8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae8103210 0x7f7ae819e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:16.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.317+0000 7f7aedbe8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae8103210 0x7f7ae819e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53822/0 (socket says 172.21.15.67:53822) 2024-08-31T05:27:16.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.317+0000 7f7aedbe8640 1 -- 172.21.15.67:0/2659103341 learned_addr learned my addr 172.21.15.67:0/2659103341 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:27:16.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.317+0000 7f7aee3e9640 1 --2- 172.21.15.67:0/2659103341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae81028f0 0x7f7ae819dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:16.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.317+0000 7f7aedbe8640 1 -- 172.21.15.67:0/2659103341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae81028f0 msgr2=0x7f7ae819dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.317+0000 7f7aedbe8640 1 --2- 172.21.15.67:0/2659103341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae81028f0 0x7f7ae819dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.318+0000 7f7aedbe8640 1 -- 172.21.15.67:0/2659103341 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae81a2600 con 0x7f7ae8103210 2024-08-31T05:27:16.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.318+0000 7f7aedbe8640 1 --2- 172.21.15.67:0/2659103341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae8103210 0x7f7ae819e270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800d6f0 tx=0x7f7ad800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:16.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.318+0000 7f7adf7fe640 1 -- 172.21.15.67:0/2659103341 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ad8017070 con 0x7f7ae8103210 2024-08-31T05:27:16.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.318+0000 7f7af064d640 1 -- 172.21.15.67:0/2659103341 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae81a28f0 con 0x7f7ae8103210 2024-08-31T05:27:16.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.318+0000 7f7adf7fe640 1 -- 172.21.15.67:0/2659103341 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ad800de00 con 0x7f7ae8103210 2024-08-31T05:27:16.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.319+0000 7f7adf7fe640 1 -- 172.21.15.67:0/2659103341 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ad8004bb0 con 0x7f7ae8103210 2024-08-31T05:27:16.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.319+0000 7f7af064d640 1 -- 172.21.15.67:0/2659103341 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae81a2e80 con 0x7f7ae8103210 2024-08-31T05:27:16.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.320+0000 7f7af064d640 1 -- 172.21.15.67:0/2659103341 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae806a280 con 0x7f7ae8103210 2024-08-31T05:27:16.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.320+0000 7f7adf7fe640 1 -- 172.21.15.67:0/2659103341 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f7ad8009a30 con 0x7f7ae8103210 2024-08-31T05:27:16.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.321+0000 7f7adf7fe640 1 --2- 172.21.15.67:0/2659103341 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7ad4079e40 0x7f7ad407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:16.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.321+0000 7f7adf7fe640 1 -- 172.21.15.67:0/2659103341 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6216+0+0 (secure 0 0 0) 0x7f7ad809c520 con 0x7f7ae8103210 2024-08-31T05:27:16.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.321+0000 7f7aee3e9640 1 --2- 172.21.15.67:0/2659103341 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7ad4079e40 0x7f7ad407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:16.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.322+0000 7f7aee3e9640 1 --2- 172.21.15.67:0/2659103341 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7ad4079e40 0x7f7ad407c300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40096c0 tx=0x7f7ae4004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:16.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.326+0000 7f7adf7fe640 1 -- 172.21.15.67:0/2659103341 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7ad8064020 con 0x7f7ae8103210 2024-08-31T05:27:16.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:16 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:16.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:16 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:16.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:16 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:27:16.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:16 smithi073 ceph-mon[71452]: pgmap v184: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/276 objects degraded (12.681%); 1.7 MiB/s, 1 objects/s recovering 2024-08-31T05:27:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.546+0000 7f7af064d640 1 -- 172.21.15.67:0/2659103341 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7ae81a30a0 con 0x7f7ad4079e40 2024-08-31T05:27:16.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.556+0000 7f7adf7fe640 1 -- 172.21.15.67:0/2659103341 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f7ae81a30a0 con 0x7f7ad4079e40 2024-08-31T05:27:16.558 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:27:16.558 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (3m) 31s ago 14m 21.3M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:27:16.558 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (6m) 31s ago 14m 8975k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:27:16.558 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (5m) 88s ago 13m 8368k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:27:16.558 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (97s) 31s ago 14m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 910f4f105c4b 2024-08-31T05:27:16.559 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (92s) 88s ago 13m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 0dcc86f98a20 2024-08-31T05:27:16.559 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (2m) 31s ago 13m 82.0M - c8b91775d855 3a9a0f88928d 2024-08-31T05:27:16.559 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (8m) 31s ago 8m 92.0M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:27:16.559 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (8m) 31s ago 8m 155M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:27:16.559 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (8m) 88s ago 8m 16.1M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:27:16.559 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (8m) 88s ago 8m 18.1M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:27:16.559 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (5m) 31s ago 15m 589M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:27:16.559 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (4m) 88s ago 13m 524M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:27:16.559 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (2m) 31s ago 15m 108M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 25a28efbbd37 2024-08-31T05:27:16.560 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (109s) 88s ago 13m 92.8M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 6be0f0999860 2024-08-31T05:27:16.560 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (4m) 31s ago 14m 10.5M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:27:16.560 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (4m) 88s ago 13m 10.9M - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:27:16.560 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (72s) 31s ago 12m 208M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 aab0516dcbfa 2024-08-31T05:27:16.560 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (37s) 31s ago 11m 80.5M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 fa9e3fb20c5e 2024-08-31T05:27:16.560 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 starting - - - 1216M 2024-08-31T05:27:16.560 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (10m) 88s ago 10m 251M 2240M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:27:16.560 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (10m) 88s ago 10m 213M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:27:16.560 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (9m) 88s ago 9m 188M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:27:16.560 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (3m) 31s ago 13m 49.3M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:27:16.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.558+0000 7f7af064d640 1 -- 172.21.15.67:0/2659103341 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7ad4079e40 msgr2=0x7f7ad407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.558+0000 7f7af064d640 1 --2- 172.21.15.67:0/2659103341 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7ad4079e40 0x7f7ad407c300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40096c0 tx=0x7f7ae4004f30 comp rx=0 tx=0).stop 2024-08-31T05:27:16.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.558+0000 7f7af064d640 1 -- 172.21.15.67:0/2659103341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae8103210 msgr2=0x7f7ae819e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.558+0000 7f7af064d640 1 --2- 172.21.15.67:0/2659103341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae8103210 0x7f7ae819e270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800d6f0 tx=0x7f7ad800dbb0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.558+0000 7f7af064d640 1 -- 172.21.15.67:0/2659103341 shutdown_connections 2024-08-31T05:27:16.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.558+0000 7f7af064d640 1 --2- 172.21.15.67:0/2659103341 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7ad4079e40 0x7f7ad407c300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.558+0000 7f7af064d640 1 --2- 172.21.15.67:0/2659103341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae8103210 0x7f7ae819e270 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.558+0000 7f7af064d640 1 --2- 172.21.15.67:0/2659103341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ae81028f0 0x7f7ae819dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.558+0000 7f7af064d640 1 -- 172.21.15.67:0/2659103341 >> 172.21.15.67:0/2659103341 conn(0x7f7ae80fc2f0 msgr2=0x7f7ae81009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:16.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.558+0000 7f7af064d640 1 -- 172.21.15.67:0/2659103341 shutdown_connections 2024-08-31T05:27:16.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.558+0000 7f7af064d640 1 -- 172.21.15.67:0/2659103341 wait complete. 2024-08-31T05:27:16.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.641+0000 7f74ad50e640 1 -- 172.21.15.67:0/3751754026 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f749c031700 con 0x7f74a81028d0 2024-08-31T05:27:16.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.642+0000 7f74b0774640 1 -- 172.21.15.67:0/3751754026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a81028d0 msgr2=0x7f74a8102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.642+0000 7f74b0774640 1 --2- 172.21.15.67:0/3751754026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a81028d0 0x7f74a8102cb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f749c009880 tx=0x7f749c02a530 comp rx=0 tx=0).stop 2024-08-31T05:27:16.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.642+0000 7f74b0774640 1 -- 172.21.15.67:0/3751754026 shutdown_connections 2024-08-31T05:27:16.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.642+0000 7f74b0774640 1 --2- 172.21.15.67:0/3751754026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a81031f0 0x7f74a810b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.642+0000 7f74b0774640 1 --2- 172.21.15.67:0/3751754026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a81028d0 0x7f74a8102cb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.642+0000 7f74b0774640 1 -- 172.21.15.67:0/3751754026 >> 172.21.15.67:0/3751754026 conn(0x7f74a80fc2f0 msgr2=0x7f74a80fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:16.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.642+0000 7f74b0774640 1 -- 172.21.15.67:0/3751754026 shutdown_connections 2024-08-31T05:27:16.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.642+0000 7f74b0774640 1 -- 172.21.15.67:0/3751754026 wait complete. 2024-08-31T05:27:16.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.642+0000 7f74b0774640 1 Processor -- start 2024-08-31T05:27:16.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.643+0000 7f74b0774640 1 -- start start 2024-08-31T05:27:16.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.643+0000 7f74b0774640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a81028d0 0x7f74a8197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:16.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.643+0000 7f74b0774640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a81031f0 0x7f74a8197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:16.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.643+0000 7f74b0774640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f74a810eb80 con 0x7f74a81031f0 2024-08-31T05:27:16.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.643+0000 7f74b0774640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f74a810ea00 con 0x7f74a81028d0 2024-08-31T05:27:16.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.643+0000 7f74add0f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a81031f0 0x7f74a8197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:16.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.643+0000 7f74add0f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a81031f0 0x7f74a8197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53850/0 (socket says 172.21.15.67:53850) 2024-08-31T05:27:16.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.643+0000 7f74add0f640 1 -- 172.21.15.67:0/2889282704 learned_addr learned my addr 172.21.15.67:0/2889282704 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:27:16.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.643+0000 7f74ae510640 1 --2- 172.21.15.67:0/2889282704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a81028d0 0x7f74a8197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:16.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.643+0000 7f74add0f640 1 -- 172.21.15.67:0/2889282704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a81028d0 msgr2=0x7f74a8197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.643+0000 7f74add0f640 1 --2- 172.21.15.67:0/2889282704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a81028d0 0x7f74a8197740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.643+0000 7f74add0f640 1 -- 172.21.15.67:0/2889282704 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a819c010 con 0x7f74a81031f0 2024-08-31T05:27:16.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.643+0000 7f74add0f640 1 --2- 172.21.15.67:0/2889282704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a81031f0 0x7f74a8197c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f74a400e970 tx=0x7f74a400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:16.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.644+0000 7f749b7fe640 1 -- 172.21.15.67:0/2889282704 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74a400cac0 con 0x7f74a81031f0 2024-08-31T05:27:16.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.644+0000 7f74b0774640 1 -- 172.21.15.67:0/2889282704 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a819c300 con 0x7f74a81031f0 2024-08-31T05:27:16.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.644+0000 7f749b7fe640 1 -- 172.21.15.67:0/2889282704 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f74a40054e0 con 0x7f74a81031f0 2024-08-31T05:27:16.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.644+0000 7f74b0774640 1 -- 172.21.15.67:0/2889282704 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a819c890 con 0x7f74a81031f0 2024-08-31T05:27:16.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.644+0000 7f749b7fe640 1 -- 172.21.15.67:0/2889282704 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74a4004cd0 con 0x7f74a81031f0 2024-08-31T05:27:16.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.645+0000 7f74b0774640 1 -- 172.21.15.67:0/2889282704 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74a806a2a0 con 0x7f74a81031f0 2024-08-31T05:27:16.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.645+0000 7f749b7fe640 1 -- 172.21.15.67:0/2889282704 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f74a4004e70 con 0x7f74a81031f0 2024-08-31T05:27:16.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.646+0000 7f749b7fe640 1 --2- 172.21.15.67:0/2889282704 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7494079e00 0x7f749407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.646+0000 7f749b7fe640 1 -- 172.21.15.67:0/2889282704 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6216+0+0 (secure 0 0 0) 0x7f74a409d610 con 0x7f74a81031f0 2024-08-31T05:27:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.646+0000 7f74ae510640 1 --2- 172.21.15.67:0/2889282704 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7494079e00 0x7f749407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.647+0000 7f74ae510640 1 --2- 172.21.15.67:0/2889282704 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7494079e00 0x7f749407c2c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f749c0096c0 tx=0x7f749c004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:16.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.650+0000 7f749b7fe640 1 -- 172.21.15.67:0/2889282704 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f74a4065110 con 0x7f74a81031f0 2024-08-31T05:27:16.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.908+0000 7f74b0774640 1 -- 172.21.15.67:0/2889282704 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f74a8102cb0 con 0x7f74a81031f0 2024-08-31T05:27:16.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.909+0000 7f749b7fe640 1 -- 172.21.15.67:0/2889282704 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f74a4069280 con 0x7f74a81031f0 2024-08-31T05:27:16.911 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:27:16.911 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:27:16.911 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:27:16.911 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:27:16.911 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:27:16.911 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:27:16.911 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:27:16.911 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:27:16.912 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 3, 2024-08-31T05:27:16.912 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:27:16.912 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:27:16.912 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:27:16.912 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:27:16.912 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:27:16.912 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:27:16.912 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 7, 2024-08-31T05:27:16.912 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 6 2024-08-31T05:27:16.912 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:27:16.912 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:27:16.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.911+0000 7f74b0774640 1 -- 172.21.15.67:0/2889282704 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7494079e00 msgr2=0x7f749407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.911+0000 7f74b0774640 1 --2- 172.21.15.67:0/2889282704 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7494079e00 0x7f749407c2c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f749c0096c0 tx=0x7f749c004f30 comp rx=0 tx=0).stop 2024-08-31T05:27:16.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.911+0000 7f74b0774640 1 -- 172.21.15.67:0/2889282704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a81031f0 msgr2=0x7f74a8197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.911+0000 7f74b0774640 1 --2- 172.21.15.67:0/2889282704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a81031f0 0x7f74a8197c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f74a400e970 tx=0x7f74a400ed70 comp rx=0 tx=0).stop 2024-08-31T05:27:16.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.911+0000 7f74b0774640 1 -- 172.21.15.67:0/2889282704 shutdown_connections 2024-08-31T05:27:16.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.911+0000 7f74b0774640 1 --2- 172.21.15.67:0/2889282704 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7494079e00 0x7f749407c2c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.911+0000 7f74b0774640 1 --2- 172.21.15.67:0/2889282704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74a81031f0 0x7f74a8197c80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.911+0000 7f74b0774640 1 --2- 172.21.15.67:0/2889282704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74a81028d0 0x7f74a8197740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.911+0000 7f74b0774640 1 -- 172.21.15.67:0/2889282704 >> 172.21.15.67:0/2889282704 conn(0x7f74a80fc2f0 msgr2=0x7f74a8108ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:16.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.911+0000 7f74b0774640 1 -- 172.21.15.67:0/2889282704 shutdown_connections 2024-08-31T05:27:16.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.911+0000 7f74b0774640 1 -- 172.21.15.67:0/2889282704 wait complete. 2024-08-31T05:27:16.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.996+0000 7f59f450b640 1 -- 172.21.15.67:0/1525680082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59ec1016a0 msgr2=0x7f59ec101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.996+0000 7f59f450b640 1 --2- 172.21.15.67:0/1525680082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59ec1016a0 0x7f59ec101b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f59e0009880 tx=0x7f59e002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.996+0000 7f59f450b640 1 -- 172.21.15.67:0/1525680082 shutdown_connections 2024-08-31T05:27:16.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.996+0000 7f59f450b640 1 --2- 172.21.15.67:0/1525680082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59ec1016a0 0x7f59ec101b00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.996+0000 7f59f450b640 1 --2- 172.21.15.67:0/1525680082 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59ec1076a0 0x7f59ec107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.996+0000 7f59f450b640 1 -- 172.21.15.67:0/1525680082 >> 172.21.15.67:0/1525680082 conn(0x7f59ec0fd380 msgr2=0x7f59ec0ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:16.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.996+0000 7f59f450b640 1 -- 172.21.15.67:0/1525680082 shutdown_connections 2024-08-31T05:27:16.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.996+0000 7f59f450b640 1 -- 172.21.15.67:0/1525680082 wait complete. 2024-08-31T05:27:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.996+0000 7f59f450b640 1 Processor -- start 2024-08-31T05:27:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.997+0000 7f59f450b640 1 -- start start 2024-08-31T05:27:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.997+0000 7f59f450b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59ec1016a0 0x7f59ec074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.997+0000 7f59f450b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59ec1076a0 0x7f59ec0747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.997+0000 7f59f450b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec10eb70 con 0x7f59ec1076a0 2024-08-31T05:27:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.997+0000 7f59f450b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec10e9f0 con 0x7f59ec1016a0 2024-08-31T05:27:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.997+0000 7f59f1aa6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59ec1076a0 0x7f59ec0747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:17.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.997+0000 7f59f1aa6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59ec1076a0 0x7f59ec0747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53862/0 (socket says 172.21.15.67:53862) 2024-08-31T05:27:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.997+0000 7f59f1aa6640 1 -- 172.21.15.67:0/3515253477 learned_addr learned my addr 172.21.15.67:0/3515253477 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:27:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.997+0000 7f59f22a7640 1 --2- 172.21.15.67:0/3515253477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59ec1016a0 0x7f59ec074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.997+0000 7f59f1aa6640 1 -- 172.21.15.67:0/3515253477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59ec1016a0 msgr2=0x7f59ec074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.997+0000 7f59f1aa6640 1 --2- 172.21.15.67:0/3515253477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59ec1016a0 0x7f59ec074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.997+0000 7f59f1aa6640 1 -- 172.21.15.67:0/3515253477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec074d10 con 0x7f59ec1076a0 2024-08-31T05:27:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.997+0000 7f59f1aa6640 1 --2- 172.21.15.67:0/3515253477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59ec1076a0 0x7f59ec0747d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f59e0031460 tx=0x7f59e0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.998+0000 7f59eb7fe640 1 -- 172.21.15.67:0/3515253477 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59e003f070 con 0x7f59ec1076a0 2024-08-31T05:27:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.998+0000 7f59eb7fe640 1 -- 172.21.15.67:0/3515253477 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f59e00035f0 con 0x7f59ec1076a0 2024-08-31T05:27:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.998+0000 7f59f450b640 1 -- 172.21.15.67:0/3515253477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ec074fa0 con 0x7f59ec1076a0 2024-08-31T05:27:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.998+0000 7f59eb7fe640 1 -- 172.21.15.67:0/3515253477 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59e0035030 con 0x7f59ec1076a0 2024-08-31T05:27:17.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.998+0000 7f59f450b640 1 -- 172.21.15.67:0/3515253477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ec1a3b80 con 0x7f59ec1076a0 2024-08-31T05:27:17.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.999+0000 7f59f450b640 1 -- 172.21.15.67:0/3515253477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ec102de0 con 0x7f59ec1076a0 2024-08-31T05:27:17.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:16.999+0000 7f59eb7fe640 1 -- 172.21.15.67:0/3515253477 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f59e0042070 con 0x7f59ec1076a0 2024-08-31T05:27:17.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.000+0000 7f59eb7fe640 1 --2- 172.21.15.67:0/3515253477 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f59d4079e40 0x7f59d407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:17.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.000+0000 7f59eb7fe640 1 -- 172.21.15.67:0/3515253477 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6216+0+0 (secure 0 0 0) 0x7f59e00bd1d0 con 0x7f59ec1076a0 2024-08-31T05:27:17.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.000+0000 7f59f22a7640 1 --2- 172.21.15.67:0/3515253477 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f59d4079e40 0x7f59d407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:17.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.000+0000 7f59f22a7640 1 --2- 172.21.15.67:0/3515253477 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f59d4079e40 0x7f59d407c300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f59dc005fd0 tx=0x7f59dc009500 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:17.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.004+0000 7f59eb7fe640 1 -- 172.21.15.67:0/3515253477 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f59e0088e40 con 0x7f59ec1076a0 2024-08-31T05:27:17.073 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:16 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2[120196]: 2024-08-31T05:27:16.835+0000 7fe583aed640 -1 Falling back to public interface 2024-08-31T05:27:17.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.232+0000 7f59f450b640 1 -- 172.21.15.67:0/3515253477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f59ec109c10 con 0x7f59ec1076a0 2024-08-31T05:27:17.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.233+0000 7f59eb7fe640 1 -- 172.21.15.67:0/3515253477 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2042 (secure 0 0 0) 0x7f59e008d860 con 0x7f59ec1076a0 2024-08-31T05:27:17.235 INFO:teuthology.orchestra.run.smithi067.stdout:e15 2024-08-31T05:27:17.235 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-08-31T05:18:35:124059+0000 2024-08-31T05:27:17.235 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:27:17.236 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:27:17.236 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-08-31T05:27:17.236 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:27:17.236 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:27:17.236 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-08-31T05:27:17.236 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 13 2024-08-31T05:27:17.236 INFO:teuthology.orchestra.run.smithi067.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T05:27:17.236 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:27:17.236 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-08-31T05:18:33.086400+0000 2024-08-31T05:27:17.236 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-08-31T05:27:17.236 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-08-31T05:27:17.236 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2024-08-31T05:27:17.236 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-08-31T05:27:17.236 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-08-31T05:27:17.237 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-08-31T05:27:17.237 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-08-31T05:27:17.237 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-08-31T05:27:17.237 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 0 2024-08-31T05:27:17.237 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:27:17.237 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2024-08-31T05:27:17.237 INFO:teuthology.orchestra.run.smithi067.stdout:in 0 2024-08-31T05:27:17.237 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14554} 2024-08-31T05:27:17.237 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-08-31T05:27:17.237 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-08-31T05:27:17.238 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-08-31T05:27:17.238 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-08-31T05:27:17.238 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-08-31T05:27:17.238 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data enabled 2024-08-31T05:27:17.238 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-08-31T05:27:17.239 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-08-31T05:27:17.239 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2024-08-31T05:27:17.239 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 14554 members: 14554 2024-08-31T05:27:17.239 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.tskvpt{0:14554} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:27:17.239 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.beqeql{0:14566} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:27:17.239 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:27:17.239 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:27:17.239 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2024-08-31T05:27:17.239 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:27:17.239 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.kfbmeo{-1:24299} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:27:17.240 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.gsnhxi{-1:24307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6824/2383176383,v1:172.21.15.73:6825/2383176383] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:27:17.240 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-08-31T05:27:17.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.235+0000 7f59f450b640 1 -- 172.21.15.67:0/3515253477 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f59d4079e40 msgr2=0x7f59d407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:17.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.235+0000 7f59f450b640 1 --2- 172.21.15.67:0/3515253477 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f59d4079e40 0x7f59d407c300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f59dc005fd0 tx=0x7f59dc009500 comp rx=0 tx=0).stop 2024-08-31T05:27:17.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.235+0000 7f59f450b640 1 -- 172.21.15.67:0/3515253477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59ec1076a0 msgr2=0x7f59ec0747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:17.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.235+0000 7f59f450b640 1 --2- 172.21.15.67:0/3515253477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59ec1076a0 0x7f59ec0747d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f59e0031460 tx=0x7f59e0004530 comp rx=0 tx=0).stop 2024-08-31T05:27:17.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.235+0000 7f59f450b640 1 -- 172.21.15.67:0/3515253477 shutdown_connections 2024-08-31T05:27:17.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.235+0000 7f59f450b640 1 --2- 172.21.15.67:0/3515253477 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f59d4079e40 0x7f59d407c300 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.235+0000 7f59f450b640 1 --2- 172.21.15.67:0/3515253477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59ec1076a0 0x7f59ec0747d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.235+0000 7f59f450b640 1 --2- 172.21.15.67:0/3515253477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59ec1016a0 0x7f59ec074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.235+0000 7f59f450b640 1 -- 172.21.15.67:0/3515253477 >> 172.21.15.67:0/3515253477 conn(0x7f59ec0fd380 msgr2=0x7f59ec0fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:17.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.236+0000 7f59f450b640 1 -- 172.21.15.67:0/3515253477 shutdown_connections 2024-08-31T05:27:17.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.236+0000 7f59f450b640 1 -- 172.21.15.67:0/3515253477 wait complete. 2024-08-31T05:27:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:17 smithi067 ceph-mon[99941]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:17 smithi067 ceph-mon[99941]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:17 smithi067 ceph-mon[99941]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:17.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:17 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2889282704' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:17.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.329+0000 7f7fe5a30640 1 -- 172.21.15.67:0/4218878274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fe0102920 msgr2=0x7f7fe0102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:17.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.329+0000 7f7fe5a30640 1 --2- 172.21.15.67:0/4218878274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fe0102920 0x7f7fe0102d00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00098b0 tx=0x7f7fd002a560 comp rx=0 tx=0).stop 2024-08-31T05:27:17.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.329+0000 7f7fe5a30640 1 -- 172.21.15.67:0/4218878274 shutdown_connections 2024-08-31T05:27:17.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.329+0000 7f7fe5a30640 1 --2- 172.21.15.67:0/4218878274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fe0103240 0x7f7fe010b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.329+0000 7f7fe5a30640 1 --2- 172.21.15.67:0/4218878274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fe0102920 0x7f7fe0102d00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.329+0000 7f7fe5a30640 1 -- 172.21.15.67:0/4218878274 >> 172.21.15.67:0/4218878274 conn(0x7f7fe00fc320 msgr2=0x7f7fe00fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:17.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.329+0000 7f7fe5a30640 1 -- 172.21.15.67:0/4218878274 shutdown_connections 2024-08-31T05:27:17.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.329+0000 7f7fe5a30640 1 -- 172.21.15.67:0/4218878274 wait complete. 2024-08-31T05:27:17.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.330+0000 7f7fe5a30640 1 Processor -- start 2024-08-31T05:27:17.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.330+0000 7f7fe5a30640 1 -- start start 2024-08-31T05:27:17.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.330+0000 7f7fe5a30640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fe0102920 0x7f7fe019d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:17.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.330+0000 7f7fe5a30640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fe0103240 0x7f7fe019d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.330+0000 7f7fe5a30640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe010ebd0 con 0x7f7fe0103240 2024-08-31T05:27:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.330+0000 7f7fe5a30640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe010ea50 con 0x7f7fe0102920 2024-08-31T05:27:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.330+0000 7f7fde7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fe0103240 0x7f7fe019d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.330+0000 7f7fde7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fe0103240 0x7f7fe019d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53880/0 (socket says 172.21.15.67:53880) 2024-08-31T05:27:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.330+0000 7f7fde7fc640 1 -- 172.21.15.67:0/1036274894 learned_addr learned my addr 172.21.15.67:0/1036274894 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:27:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.330+0000 7f7fdeffd640 1 --2- 172.21.15.67:0/1036274894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fe0102920 0x7f7fe019d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.330+0000 7f7fde7fc640 1 -- 172.21.15.67:0/1036274894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fe0102920 msgr2=0x7f7fe019d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.330+0000 7f7fde7fc640 1 --2- 172.21.15.67:0/1036274894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fe0102920 0x7f7fe019d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.330+0000 7f7fde7fc640 1 -- 172.21.15.67:0/1036274894 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe0197600 con 0x7f7fe0103240 2024-08-31T05:27:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.331+0000 7f7fdeffd640 1 --2- 172.21.15.67:0/1036274894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fe0102920 0x7f7fe019d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:27:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.331+0000 7f7fde7fc640 1 --2- 172.21.15.67:0/1036274894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fe0103240 0x7f7fe019d980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400d8d0 tx=0x7f7fd400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.331+0000 7f7fe4a2e640 1 -- 172.21.15.67:0/1036274894 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7fd4017030 con 0x7f7fe0103240 2024-08-31T05:27:17.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.331+0000 7f7fe4a2e640 1 -- 172.21.15.67:0/1036274894 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7fd4004020 con 0x7f7fe0103240 2024-08-31T05:27:17.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.331+0000 7f7fe5a30640 1 -- 172.21.15.67:0/1036274894 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe01978f0 con 0x7f7fe0103240 2024-08-31T05:27:17.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.331+0000 7f7fe4a2e640 1 -- 172.21.15.67:0/1036274894 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7fd40047a0 con 0x7f7fe0103240 2024-08-31T05:27:17.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.331+0000 7f7fe5a30640 1 -- 172.21.15.67:0/1036274894 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe0197e80 con 0x7f7fe0103240 2024-08-31T05:27:17.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.332+0000 7f7fe5a30640 1 -- 172.21.15.67:0/1036274894 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe006aae0 con 0x7f7fe0103240 2024-08-31T05:27:17.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.333+0000 7f7fe4a2e640 1 -- 172.21.15.67:0/1036274894 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f7fd40041d0 con 0x7f7fe0103240 2024-08-31T05:27:17.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.333+0000 7f7fe4a2e640 1 --2- 172.21.15.67:0/1036274894 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7fc8079e40 0x7f7fc807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:17.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.333+0000 7f7fe4a2e640 1 -- 172.21.15.67:0/1036274894 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6216+0+0 (secure 0 0 0) 0x7f7fd4018070 con 0x7f7fe0103240 2024-08-31T05:27:17.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.333+0000 7f7fdeffd640 1 --2- 172.21.15.67:0/1036274894 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7fc8079e40 0x7f7fc807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:17.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.334+0000 7f7fdeffd640 1 --2- 172.21.15.67:0/1036274894 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7fc8079e40 0x7f7fc807c300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000c00 tx=0x7f7fd0031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:17.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.338+0000 7f7fe4a2e640 1 -- 172.21.15.67:0/1036274894 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7fd4064210 con 0x7f7fe0103240 2024-08-31T05:27:17.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:17 smithi073 ceph-mon[71452]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:17.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:17 smithi073 ceph-mon[71452]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:17.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:17 smithi073 ceph-mon[71452]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:17.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:17 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2889282704' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:17.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.543+0000 7f7fe5a30640 1 -- 172.21.15.67:0/1036274894 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7fe0198190 con 0x7f7fc8079e40 2024-08-31T05:27:17.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.545+0000 7f7fe4a2e640 1 -- 172.21.15.67:0/1036274894 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f7fe0198190 con 0x7f7fc8079e40 2024-08-31T05:27:17.547 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:27:17.547 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:27:17.547 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:27:17.547 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-31T05:27:17.547 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:27:17.548 INFO:teuthology.orchestra.run.smithi067.stdout: "mon", 2024-08-31T05:27:17.548 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2024-08-31T05:27:17.548 INFO:teuthology.orchestra.run.smithi067.stdout: "crash" 2024-08-31T05:27:17.548 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:27:17.548 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "8/23 daemons upgraded", 2024-08-31T05:27:17.548 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading osd daemons", 2024-08-31T05:27:17.549 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:27:17.549 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:27:17.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.547+0000 7f7fe5a30640 1 -- 172.21.15.67:0/1036274894 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7fc8079e40 msgr2=0x7f7fc807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:17.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.547+0000 7f7fe5a30640 1 --2- 172.21.15.67:0/1036274894 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7fc8079e40 0x7f7fc807c300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000c00 tx=0x7f7fd0031400 comp rx=0 tx=0).stop 2024-08-31T05:27:17.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.547+0000 7f7fe5a30640 1 -- 172.21.15.67:0/1036274894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fe0103240 msgr2=0x7f7fe019d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:17.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.547+0000 7f7fe5a30640 1 --2- 172.21.15.67:0/1036274894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fe0103240 0x7f7fe019d980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400d8d0 tx=0x7f7fd400dd90 comp rx=0 tx=0).stop 2024-08-31T05:27:17.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.547+0000 7f7fe5a30640 1 -- 172.21.15.67:0/1036274894 shutdown_connections 2024-08-31T05:27:17.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.547+0000 7f7fe5a30640 1 --2- 172.21.15.67:0/1036274894 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7fc8079e40 0x7f7fc807c300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.547+0000 7f7fe5a30640 1 --2- 172.21.15.67:0/1036274894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fe0103240 0x7f7fe019d980 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.547+0000 7f7fe5a30640 1 --2- 172.21.15.67:0/1036274894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fe0102920 0x7f7fe019d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.547+0000 7f7fe5a30640 1 -- 172.21.15.67:0/1036274894 >> 172.21.15.67:0/1036274894 conn(0x7f7fe00fc320 msgr2=0x7f7fe0107c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:17.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.547+0000 7f7fe5a30640 1 -- 172.21.15.67:0/1036274894 shutdown_connections 2024-08-31T05:27:17.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.547+0000 7f7fe5a30640 1 -- 172.21.15.67:0/1036274894 wait complete. 2024-08-31T05:27:17.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.629+0000 7f7b4c02a640 1 -- 172.21.15.67:0/2492795921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b44103180 msgr2=0x7f7b4410b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:17.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.629+0000 7f7b4c02a640 1 --2- 172.21.15.67:0/2492795921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b44103180 0x7f7b4410b670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009880 tx=0x7f7b3402a530 comp rx=0 tx=0).stop 2024-08-31T05:27:17.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.629+0000 7f7b4c02a640 1 -- 172.21.15.67:0/2492795921 shutdown_connections 2024-08-31T05:27:17.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.629+0000 7f7b4c02a640 1 --2- 172.21.15.67:0/2492795921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b44103180 0x7f7b4410b670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.629+0000 7f7b4c02a640 1 --2- 172.21.15.67:0/2492795921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b44102860 0x7f7b44102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.629+0000 7f7b4c02a640 1 -- 172.21.15.67:0/2492795921 >> 172.21.15.67:0/2492795921 conn(0x7f7b440fc2c0 msgr2=0x7f7b440fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:17.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.629+0000 7f7b4c02a640 1 -- 172.21.15.67:0/2492795921 shutdown_connections 2024-08-31T05:27:17.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.629+0000 7f7b4c02a640 1 -- 172.21.15.67:0/2492795921 wait complete. 2024-08-31T05:27:17.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.630+0000 7f7b4c02a640 1 Processor -- start 2024-08-31T05:27:17.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.630+0000 7f7b4c02a640 1 -- start start 2024-08-31T05:27:17.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.630+0000 7f7b4c02a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b44102860 0x7f7b4419d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:17.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.630+0000 7f7b4c02a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b44103180 0x7f7b4419d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:17.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.630+0000 7f7b4c02a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4410eb90 con 0x7f7b44102860 2024-08-31T05:27:17.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.630+0000 7f7b4c02a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4410ea10 con 0x7f7b44103180 2024-08-31T05:27:17.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.630+0000 7f7b49dc6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b44102860 0x7f7b4419d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:17.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.630+0000 7f7b49dc6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b44102860 0x7f7b4419d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53906/0 (socket says 172.21.15.67:53906) 2024-08-31T05:27:17.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.630+0000 7f7b49dc6640 1 -- 172.21.15.67:0/3692790906 learned_addr learned my addr 172.21.15.67:0/3692790906 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:27:17.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.631+0000 7f7b495c5640 1 --2- 172.21.15.67:0/3692790906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b44103180 0x7f7b4419d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:17.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.631+0000 7f7b49dc6640 1 -- 172.21.15.67:0/3692790906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b44103180 msgr2=0x7f7b4419d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:17.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.631+0000 7f7b49dc6640 1 --2- 172.21.15.67:0/3692790906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b44103180 0x7f7b4419d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.631+0000 7f7b49dc6640 1 -- 172.21.15.67:0/3692790906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b441975a0 con 0x7f7b44102860 2024-08-31T05:27:17.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.631+0000 7f7b49dc6640 1 --2- 172.21.15.67:0/3692790906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b44102860 0x7f7b4419d3e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000c8f0 tx=0x7f7b4000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:17.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.631+0000 7f7b3affd640 1 -- 172.21.15.67:0/3692790906 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b400079b0 con 0x7f7b44102860 2024-08-31T05:27:17.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.631+0000 7f7b4c02a640 1 -- 172.21.15.67:0/3692790906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b44197890 con 0x7f7b44102860 2024-08-31T05:27:17.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.631+0000 7f7b3affd640 1 -- 172.21.15.67:0/3692790906 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b400054e0 con 0x7f7b44102860 2024-08-31T05:27:17.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.631+0000 7f7b4c02a640 1 -- 172.21.15.67:0/3692790906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b44197df0 con 0x7f7b44102860 2024-08-31T05:27:17.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.631+0000 7f7b3affd640 1 -- 172.21.15.67:0/3692790906 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b40004dd0 con 0x7f7b44102860 2024-08-31T05:27:17.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.632+0000 7f7b4c02a640 1 -- 172.21.15.67:0/3692790906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b4406a830 con 0x7f7b44102860 2024-08-31T05:27:17.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.633+0000 7f7b3affd640 1 -- 172.21.15.67:0/3692790906 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f7b40005020 con 0x7f7b44102860 2024-08-31T05:27:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.634+0000 7f7b3affd640 1 --2- 172.21.15.67:0/3692790906 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7b30079da0 0x7f7b3007c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.634+0000 7f7b3affd640 1 -- 172.21.15.67:0/3692790906 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6216+0+0 (secure 0 0 0) 0x7f7b4009c9d0 con 0x7f7b44102860 2024-08-31T05:27:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.634+0000 7f7b495c5640 1 --2- 172.21.15.67:0/3692790906 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7b30079da0 0x7f7b3007c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.634+0000 7f7b495c5640 1 --2- 172.21.15.67:0/3692790906 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7b30079da0 0x7f7b3007c260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7b441986e0 tx=0x7f7b34031420 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.639+0000 7f7b3affd640 1 -- 172.21.15.67:0/3692790906 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7b40014030 con 0x7f7b44102860 2024-08-31T05:27:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.896+0000 7f7b4c02a640 1 -- 172.21.15.67:0/3692790906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7b44105d00 con 0x7f7b44102860 2024-08-31T05:27:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.897+0000 7f7b3affd640 1 -- 172.21.15.67:0/3692790906 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1130 (secure 0 0 0) 0x7f7b40064450 con 0x7f7b44102860 2024-08-31T05:27:17.899 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 35/276 objects degraded (12.681%), 12 pgs degraded 2024-08-31T05:27:17.899 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:27:17.899 INFO:teuthology.orchestra.run.smithi067.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:27:17.899 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-31T05:27:17.899 INFO:teuthology.orchestra.run.smithi067.stdout: osd.2 (root=default,host=smithi067) is down 2024-08-31T05:27:17.899 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 35/276 objects degraded (12.681%), 12 pgs degraded 2024-08-31T05:27:17.899 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-08-31T05:27:17.899 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-08-31T05:27:17.899 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-08-31T05:27:17.900 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-08-31T05:27:17.900 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-08-31T05:27:17.900 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-08-31T05:27:17.900 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-08-31T05:27:17.900 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-08-31T05:27:17.900 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-08-31T05:27:17.900 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-08-31T05:27:17.900 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-08-31T05:27:17.900 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-08-31T05:27:17.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.899+0000 7f7b4c02a640 1 -- 172.21.15.67:0/3692790906 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7b30079da0 msgr2=0x7f7b3007c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:17.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.899+0000 7f7b4c02a640 1 --2- 172.21.15.67:0/3692790906 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7b30079da0 0x7f7b3007c260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7b441986e0 tx=0x7f7b34031420 comp rx=0 tx=0).stop 2024-08-31T05:27:17.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.899+0000 7f7b4c02a640 1 -- 172.21.15.67:0/3692790906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b44102860 msgr2=0x7f7b4419d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:17.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.899+0000 7f7b4c02a640 1 --2- 172.21.15.67:0/3692790906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b44102860 0x7f7b4419d3e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000c8f0 tx=0x7f7b4000cdb0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.899+0000 7f7b4c02a640 1 -- 172.21.15.67:0/3692790906 shutdown_connections 2024-08-31T05:27:17.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.899+0000 7f7b4c02a640 1 --2- 172.21.15.67:0/3692790906 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7b30079da0 0x7f7b3007c260 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.899+0000 7f7b4c02a640 1 --2- 172.21.15.67:0/3692790906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b44103180 0x7f7b4419d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.899+0000 7f7b4c02a640 1 --2- 172.21.15.67:0/3692790906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b44102860 0x7f7b4419d3e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:17.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.899+0000 7f7b4c02a640 1 -- 172.21.15.67:0/3692790906 >> 172.21.15.67:0/3692790906 conn(0x7f7b440fc2c0 msgr2=0x7f7b44108cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:17.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.899+0000 7f7b4c02a640 1 -- 172.21.15.67:0/3692790906 shutdown_connections 2024-08-31T05:27:17.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:17.899+0000 7f7b4c02a640 1 -- 172.21.15.67:0/3692790906 wait complete. 2024-08-31T05:27:18.245 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:18 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3515253477' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:27:18.246 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:18 smithi067 ceph-mon[99941]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:18.246 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:18 smithi067 ceph-mon[99941]: pgmap v185: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/276 objects degraded (12.681%) 2024-08-31T05:27:18.246 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:18 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3692790906' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:27:18.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:18 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3515253477' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:27:18.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:18 smithi073 ceph-mon[71452]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:18.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:18 smithi073 ceph-mon[71452]: pgmap v185: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/276 objects degraded (12.681%) 2024-08-31T05:27:18.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:18 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3692790906' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:27:20.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:20.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:27:20.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:20.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:20 smithi073 ceph-mon[71452]: pgmap v186: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/276 objects degraded (12.681%) 2024-08-31T05:27:20.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:20.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:21.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:21.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:27:21.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:21.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:20 smithi067 ceph-mon[99941]: pgmap v186: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/276 objects degraded (12.681%) 2024-08-31T05:27:21.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:21.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:22.156 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:22 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:22.156 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:22 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:22.156 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:22 smithi067 ceph-mon[99941]: pgmap v187: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/276 objects degraded (12.681%) 2024-08-31T05:27:22.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:22 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:22.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:22 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:22.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:22 smithi073 ceph-mon[71452]: pgmap v187: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 274 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/276 objects degraded (12.681%) 2024-08-31T05:27:22.519 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:22 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2[120196]: 2024-08-31T05:27:22.154+0000 7fe583aed640 -1 osd.2 70 log_to_monitors true 2024-08-31T05:27:23.117 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:23 smithi067 ceph-mon[99941]: from='osd.2 [v2:172.21.15.67:6818/90122133,v1:172.21.15.67:6819/90122133]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T05:27:23.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:23 smithi067 ceph-mon[99941]: Health check update: Degraded data redundancy: 35/276 objects degraded (12.681%), 12 pgs degraded (PG_DEGRADED) 2024-08-31T05:27:23.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:23 smithi073 ceph-mon[71452]: from='osd.2 [v2:172.21.15.67:6818/90122133,v1:172.21.15.67:6819/90122133]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T05:27:23.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:23 smithi073 ceph-mon[71452]: Health check update: Degraded data redundancy: 35/276 objects degraded (12.681%), 12 pgs degraded (PG_DEGRADED) 2024-08-31T05:27:23.574 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:27:23 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2[120196]: 2024-08-31T05:27:23.115+0000 7fe57b86d640 -1 osd.2 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:27:24.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:24 smithi067 ceph-mon[99941]: from='osd.2 [v2:172.21.15.67:6818/90122133,v1:172.21.15.67:6819/90122133]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T05:27:24.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:24 smithi067 ceph-mon[99941]: osdmap e73: 6 total, 5 up, 6 in 2024-08-31T05:27:24.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:24 smithi067 ceph-mon[99941]: from='osd.2 [v2:172.21.15.67:6818/90122133,v1:172.21.15.67:6819/90122133]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-08-31T05:27:24.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:24 smithi067 ceph-mon[99941]: pgmap v189: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 35/276 objects degraded (12.681%) 2024-08-31T05:27:24.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:24 smithi073 ceph-mon[71452]: from='osd.2 [v2:172.21.15.67:6818/90122133,v1:172.21.15.67:6819/90122133]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T05:27:24.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:24 smithi073 ceph-mon[71452]: osdmap e73: 6 total, 5 up, 6 in 2024-08-31T05:27:24.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:24 smithi073 ceph-mon[71452]: from='osd.2 [v2:172.21.15.67:6818/90122133,v1:172.21.15.67:6819/90122133]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-08-31T05:27:24.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:24 smithi073 ceph-mon[71452]: pgmap v189: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 35/276 objects degraded (12.681%) 2024-08-31T05:27:25.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-31T05:27:25.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: osd.2 [v2:172.21.15.67:6818/90122133,v1:172.21.15.67:6819/90122133] boot 2024-08-31T05:27:25.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: osdmap e74: 6 total, 6 up, 6 in 2024-08-31T05:27:25.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:27:25.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:25.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:25.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:25.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:27:25.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:25.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:27:25.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:25.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:25.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:25.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-08-31T05:27:25.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-31T05:27:25.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-08-31T05:27:25.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:25 smithi067 ceph-mon[99941]: osdmap e75: 6 total, 6 up, 6 in 2024-08-31T05:27:25.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-31T05:27:25.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: osd.2 [v2:172.21.15.67:6818/90122133,v1:172.21.15.67:6819/90122133] boot 2024-08-31T05:27:25.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: osdmap e74: 6 total, 6 up, 6 in 2024-08-31T05:27:25.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:27:25.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:25.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:25.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:25.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:27:25.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:25.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:27:25.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:25.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:25.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:25.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-08-31T05:27:25.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-31T05:27:25.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-08-31T05:27:25.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:25 smithi073 ceph-mon[71452]: osdmap e75: 6 total, 6 up, 6 in 2024-08-31T05:27:26.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:26 smithi073 ceph-mon[71452]: pgmap v192: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/276 objects degraded (12.681%) 2024-08-31T05:27:26.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:26 smithi067 ceph-mon[99941]: pgmap v192: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/276 objects degraded (12.681%) 2024-08-31T05:27:29.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:28 smithi067 ceph-mon[99941]: pgmap v193: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/276 objects degraded (12.681%) 2024-08-31T05:27:29.097 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:28 smithi073 ceph-mon[71452]: pgmap v193: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/276 objects degraded (12.681%) 2024-08-31T05:27:30.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:29 smithi067 ceph-mon[99941]: pgmap v194: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:27:30.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:29 smithi067 ceph-mon[99941]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/276 objects degraded (12.681%), 12 pgs degraded) 2024-08-31T05:27:30.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:29 smithi073 ceph-mon[71452]: pgmap v194: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:27:30.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:29 smithi073 ceph-mon[71452]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/276 objects degraded (12.681%), 12 pgs degraded) 2024-08-31T05:27:33.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:32 smithi067 ceph-mon[99941]: pgmap v195: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:27:33.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:32 smithi073 ceph-mon[71452]: pgmap v195: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:27:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:34 smithi067 ceph-mon[99941]: pgmap v196: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 961 B/s rd, 0 op/s 2024-08-31T05:27:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:27:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:34 smithi073 ceph-mon[71452]: pgmap v196: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 961 B/s rd, 0 op/s 2024-08-31T05:27:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:27:37.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:36 smithi067 ceph-mon[99941]: pgmap v197: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 870 B/s rd, 0 op/s 2024-08-31T05:27:37.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:36 smithi073 ceph-mon[71452]: pgmap v197: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 870 B/s rd, 0 op/s 2024-08-31T05:27:39.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:38 smithi067 ceph-mon[99941]: pgmap v198: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 op/s 2024-08-31T05:27:39.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:38 smithi073 ceph-mon[71452]: pgmap v198: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 op/s 2024-08-31T05:27:40.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:39 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-08-31T05:27:40.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:39 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:40.087 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:39 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-08-31T05:27:40.087 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:39 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:40.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:40 smithi067 ceph-mon[99941]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-31T05:27:40.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:40 smithi067 ceph-mon[99941]: Upgrade: osd.3 is safe to restart 2024-08-31T05:27:40.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:40 smithi067 ceph-mon[99941]: pgmap v199: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:27:41.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:40 smithi073 ceph-mon[71452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-31T05:27:41.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:40 smithi073 ceph-mon[71452]: Upgrade: osd.3 is safe to restart 2024-08-31T05:27:41.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:40 smithi073 ceph-mon[71452]: pgmap v199: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:27:42.267 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:41 smithi073 ceph-mon[71452]: Upgrade: Updating osd.3 2024-08-31T05:27:42.267 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:41 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:42.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:41 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T05:27:42.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:41 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:42.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:41 smithi073 ceph-mon[71452]: Deploying daemon osd.3 on smithi073 2024-08-31T05:27:42.268 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:41 smithi073 ceph-mon[71452]: pgmap v200: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:27:42.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:41 smithi067 ceph-mon[99941]: Upgrade: Updating osd.3 2024-08-31T05:27:42.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:41 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:42.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:41 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T05:27:42.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:41 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:42.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:41 smithi067 ceph-mon[99941]: Deploying daemon osd.3 on smithi073 2024-08-31T05:27:42.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:41 smithi067 ceph-mon[99941]: pgmap v200: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:27:44.110 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:43 smithi073 systemd[1]: Stopping Ceph osd.3 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:27:44.446 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:44 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[30552]: 2024-08-31T05:27:44.120+0000 7f16e7f15640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:27:44.446 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:44 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[30552]: 2024-08-31T05:27:44.120+0000 7f16e7f15640 -1 osd.3 75 *** Got signal Terminated *** 2024-08-31T05:27:44.446 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:44 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[30552]: 2024-08-31T05:27:44.120+0000 7f16e7f15640 -1 osd.3 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:27:45.069 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:44 smithi073 ceph-mon[71452]: pgmap v201: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:27:45.069 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:44 smithi073 ceph-mon[71452]: osd.3 marked itself down and dead 2024-08-31T05:27:45.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:44 smithi067 ceph-mon[99941]: pgmap v201: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:27:45.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:44 smithi067 ceph-mon[99941]: osd.3 marked itself down and dead 2024-08-31T05:27:45.446 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:45 smithi073 podman[79106]: 2024-08-31 05:27:45.279615583 +0000 UTC m=+1.270824888 container died 54b8f72fb60dfaf28ca6c32c748369557e340cb2da446b889351fd061293c115 (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3, RELEASE=squid-244a32d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-08-31T05:27:45.923 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:45 smithi073 ceph-mon[71452]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-31T05:27:45.923 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:45 smithi073 ceph-mon[71452]: osdmap e76: 6 total, 5 up, 6 in 2024-08-31T05:27:45.923 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:45 smithi073 podman[79106]: 2024-08-31 05:27:45.653357513 +0000 UTC m=+1.644566817 container cleanup 54b8f72fb60dfaf28ca6c32c748369557e340cb2da446b889351fd061293c115 (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3, RELEASE=squid-244a32d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-31T05:27:45.923 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:45 smithi073 bash[79106]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3 2024-08-31T05:27:46.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:45 smithi067 ceph-mon[99941]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-31T05:27:46.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:45 smithi067 ceph-mon[99941]: osdmap e76: 6 total, 5 up, 6 in 2024-08-31T05:27:46.195 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:45 smithi073 podman[79132]: 2024-08-31 05:27:45.9215422 +0000 UTC m=+0.644314132 container remove 54b8f72fb60dfaf28ca6c32c748369557e340cb2da446b889351fd061293c115 (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-244a32d, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2) 2024-08-31T05:27:46.534 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:46 smithi073 podman[79221]: 2024-08-31 05:27:46.172947785 +0000 UTC m=+0.016068502 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:27:46.534 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:46 smithi073 podman[79221]: 2024-08-31 05:27:46.297596885 +0000 UTC m=+0.140717602 container create 2063841fb20cf5a3733c791ea907b8f40a5656c43d0cd8794d04a0367457fd29 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:27:46.534 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:46 smithi073 podman[79221]: 2024-08-31 05:27:46.53334917 +0000 UTC m=+0.376469890 container init 2063841fb20cf5a3733c791ea907b8f40a5656c43d0cd8794d04a0367457fd29 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:27:46.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:46 smithi073 ceph-mon[71452]: pgmap v203: 65 pgs: 13 stale+active+clean, 52 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-08-31T05:27:46.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:46 smithi073 ceph-mon[71452]: osdmap e77: 6 total, 5 up, 6 in 2024-08-31T05:27:46.946 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:46 smithi073 podman[79221]: 2024-08-31 05:27:46.536776915 +0000 UTC m=+0.379897638 container start 2063841fb20cf5a3733c791ea907b8f40a5656c43d0cd8794d04a0367457fd29 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.1) 2024-08-31T05:27:46.946 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:46 smithi073 podman[79221]: 2024-08-31 05:27:46.600393506 +0000 UTC m=+0.443514229 container attach 2063841fb20cf5a3733c791ea907b8f40a5656c43d0cd8794d04a0367457fd29 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-31T05:27:46.946 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:46 smithi073 podman[79221]: 2024-08-31 05:27:46.731385414 +0000 UTC m=+0.574506128 container died 2063841fb20cf5a3733c791ea907b8f40a5656c43d0cd8794d04a0367457fd29 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-31T05:27:47.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:46 smithi067 ceph-mon[99941]: pgmap v203: 65 pgs: 13 stale+active+clean, 52 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-08-31T05:27:47.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:46 smithi067 ceph-mon[99941]: osdmap e77: 6 total, 5 up, 6 in 2024-08-31T05:27:47.696 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:47 smithi073 podman[79245]: 2024-08-31 05:27:47.387893784 +0000 UTC m=+0.651352432 container remove 2063841fb20cf5a3733c791ea907b8f40a5656c43d0cd8794d04a0367457fd29 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-31T05:27:47.696 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:47 smithi073 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.3.service: Deactivated successfully. 2024-08-31T05:27:47.696 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:47 smithi073 systemd[1]: Stopped Ceph osd.3 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:27:47.696 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:47 smithi073 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.3.service: Consumed 1min 2.261s CPU time. 2024-08-31T05:27:47.696 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:47 smithi073 systemd[1]: Starting Ceph osd.3 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:27:48.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:47.999+0000 7f5afd812640 1 -- 172.21.15.67:0/1390794899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5af8106670 msgr2=0x7f5af8106a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:47.999+0000 7f5afd812640 1 --2- 172.21.15.67:0/1390794899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5af8106670 0x7f5af8106a50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009880 tx=0x7f5ae802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:47.999+0000 7f5afd812640 1 -- 172.21.15.67:0/1390794899 shutdown_connections 2024-08-31T05:27:48.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:47.999+0000 7f5afd812640 1 --2- 172.21.15.67:0/1390794899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5af81005c0 0x7f5af8100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:47.999+0000 7f5afd812640 1 --2- 172.21.15.67:0/1390794899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5af8106670 0x7f5af8106a50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:47.999+0000 7f5afd812640 1 -- 172.21.15.67:0/1390794899 >> 172.21.15.67:0/1390794899 conn(0x7f5af80fc2c0 msgr2=0x7f5af80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:48.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:47.999+0000 7f5afd812640 1 -- 172.21.15.67:0/1390794899 shutdown_connections 2024-08-31T05:27:48.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:47.999+0000 7f5afd812640 1 -- 172.21.15.67:0/1390794899 wait complete. 2024-08-31T05:27:48.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.000+0000 7f5afd812640 1 Processor -- start 2024-08-31T05:27:48.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.000+0000 7f5afd812640 1 -- start start 2024-08-31T05:27:48.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.000+0000 7f5afd812640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5af81005c0 0x7f5af8197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:48.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.000+0000 7f5afd812640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5af8106670 0x7f5af8197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:48.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.001+0000 7f5afd812640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5af810da80 con 0x7f5af8106670 2024-08-31T05:27:48.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.001+0000 7f5afd812640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5af810d900 con 0x7f5af81005c0 2024-08-31T05:27:48.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.001+0000 7f5af67fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5af8106670 0x7f5af8197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:48.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.001+0000 7f5af6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5af81005c0 0x7f5af8197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:48.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.001+0000 7f5af67fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5af8106670 0x7f5af8197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38666/0 (socket says 172.21.15.67:38666) 2024-08-31T05:27:48.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.001+0000 7f5af6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5af81005c0 0x7f5af8197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:40710/0 (socket says 172.21.15.67:40710) 2024-08-31T05:27:48.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.001+0000 7f5af67fc640 1 -- 172.21.15.67:0/2073730036 learned_addr learned my addr 172.21.15.67:0/2073730036 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:27:48.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.001+0000 7f5af67fc640 1 -- 172.21.15.67:0/2073730036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5af81005c0 msgr2=0x7f5af8197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.001+0000 7f5af67fc640 1 --2- 172.21.15.67:0/2073730036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5af81005c0 0x7f5af8197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.001+0000 7f5af67fc640 1 -- 172.21.15.67:0/2073730036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af819bfd0 con 0x7f5af8106670 2024-08-31T05:27:48.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.001+0000 7f5af67fc640 1 --2- 172.21.15.67:0/2073730036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5af8106670 0x7f5af8197c40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00e970 tx=0x7f5aec00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:48.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.001+0000 7f5afc810640 1 -- 172.21.15.67:0/2073730036 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5aec00cac0 con 0x7f5af8106670 2024-08-31T05:27:48.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.001+0000 7f5afc810640 1 -- 172.21.15.67:0/2073730036 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5aec0054e0 con 0x7f5af8106670 2024-08-31T05:27:48.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.002+0000 7f5afd812640 1 -- 172.21.15.67:0/2073730036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af819c2c0 con 0x7f5af8106670 2024-08-31T05:27:48.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.002+0000 7f5afc810640 1 -- 172.21.15.67:0/2073730036 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5aec010430 con 0x7f5af8106670 2024-08-31T05:27:48.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.002+0000 7f5afd812640 1 -- 172.21.15.67:0/2073730036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af819c850 con 0x7f5af8106670 2024-08-31T05:27:48.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.003+0000 7f5afd812640 1 -- 172.21.15.67:0/2073730036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af8101ce0 con 0x7f5af8106670 2024-08-31T05:27:48.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.003+0000 7f5afc810640 1 -- 172.21.15.67:0/2073730036 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f5aec004e80 con 0x7f5af8106670 2024-08-31T05:27:48.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.004+0000 7f5afc810640 1 --2- 172.21.15.67:0/2073730036 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f5ae0079e00 0x7f5ae007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:48.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.004+0000 7f5af6ffd640 1 --2- 172.21.15.67:0/2073730036 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f5ae0079e00 0x7f5ae007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:48.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.004+0000 7f5afc810640 1 -- 172.21.15.67:0/2073730036 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6216+0+0 (secure 0 0 0) 0x7f5aec09cfd0 con 0x7f5af8106670 2024-08-31T05:27:48.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.005+0000 7f5af6ffd640 1 --2- 172.21.15.67:0/2073730036 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f5ae0079e00 0x7f5ae007c2c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80096c0 tx=0x7f5ae8004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:48.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.009+0000 7f5afc810640 1 -- 172.21.15.67:0/2073730036 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5aec064a50 con 0x7f5af8106670 2024-08-31T05:27:48.087 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:47 smithi073 podman[79346]: 2024-08-31 05:27:47.728747792 +0000 UTC m=+0.015727913 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:27:48.087 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:47 smithi073 podman[79346]: 2024-08-31 05:27:47.840153966 +0000 UTC m=+0.127134066 container create 8fc00d4f54d96832042735a297332fd58936f993268e02f87f1beb2b1da0b8ac (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-31T05:27:48.087 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 podman[79346]: 2024-08-31 05:27:48.085817502 +0000 UTC m=+0.372797609 container init 8fc00d4f54d96832042735a297332fd58936f993268e02f87f1beb2b1da0b8ac (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-31T05:27:48.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.246+0000 7f5afd812640 1 -- 172.21.15.67:0/2073730036 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5af819cb60 con 0x7f5ae0079e00 2024-08-31T05:27:48.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.247+0000 7f5afc810640 1 -- 172.21.15.67:0/2073730036 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f5af819cb60 con 0x7f5ae0079e00 2024-08-31T05:27:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.249+0000 7f5afd812640 1 -- 172.21.15.67:0/2073730036 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f5ae0079e00 msgr2=0x7f5ae007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.249+0000 7f5afd812640 1 --2- 172.21.15.67:0/2073730036 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f5ae0079e00 0x7f5ae007c2c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80096c0 tx=0x7f5ae8004f30 comp rx=0 tx=0).stop 2024-08-31T05:27:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.249+0000 7f5afd812640 1 -- 172.21.15.67:0/2073730036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5af8106670 msgr2=0x7f5af8197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.249+0000 7f5afd812640 1 --2- 172.21.15.67:0/2073730036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5af8106670 0x7f5af8197c40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00e970 tx=0x7f5aec00ed70 comp rx=0 tx=0).stop 2024-08-31T05:27:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.249+0000 7f5afd812640 1 -- 172.21.15.67:0/2073730036 shutdown_connections 2024-08-31T05:27:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.249+0000 7f5afd812640 1 --2- 172.21.15.67:0/2073730036 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f5ae0079e00 0x7f5ae007c2c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.249+0000 7f5afd812640 1 --2- 172.21.15.67:0/2073730036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5af8106670 0x7f5af8197c40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.249+0000 7f5afd812640 1 --2- 172.21.15.67:0/2073730036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5af81005c0 0x7f5af8197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.249+0000 7f5afd812640 1 -- 172.21.15.67:0/2073730036 >> 172.21.15.67:0/2073730036 conn(0x7f5af80fc2c0 msgr2=0x7f5af8069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:48.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.249+0000 7f5afd812640 1 -- 172.21.15.67:0/2073730036 shutdown_connections 2024-08-31T05:27:48.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.249+0000 7f5afd812640 1 -- 172.21.15.67:0/2073730036 wait complete. 2024-08-31T05:27:48.260 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:27:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.334+0000 7f9b40b42640 1 -- 172.21.15.67:0/2268903962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b3c1005b0 msgr2=0x7f9b3c100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.334+0000 7f9b40b42640 1 --2- 172.21.15.67:0/2268903962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b3c1005b0 0x7f9b3c100a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009880 tx=0x7f9b2c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.334+0000 7f9b40b42640 1 -- 172.21.15.67:0/2268903962 shutdown_connections 2024-08-31T05:27:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.334+0000 7f9b40b42640 1 --2- 172.21.15.67:0/2268903962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b3c1005b0 0x7f9b3c100a10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.334+0000 7f9b40b42640 1 --2- 172.21.15.67:0/2268903962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c106660 0x7f9b3c106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.334+0000 7f9b40b42640 1 -- 172.21.15.67:0/2268903962 >> 172.21.15.67:0/2268903962 conn(0x7f9b3c0fc2f0 msgr2=0x7f9b3c0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.334+0000 7f9b40b42640 1 -- 172.21.15.67:0/2268903962 shutdown_connections 2024-08-31T05:27:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.334+0000 7f9b40b42640 1 -- 172.21.15.67:0/2268903962 wait complete. 2024-08-31T05:27:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.335+0000 7f9b40b42640 1 Processor -- start 2024-08-31T05:27:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.335+0000 7f9b40b42640 1 -- start start 2024-08-31T05:27:48.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.335+0000 7f9b40b42640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b3c1005b0 0x7f9b3c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:48.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.335+0000 7f9b40b42640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c106660 0x7f9b3c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:48.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.335+0000 7f9b40b42640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c10da70 con 0x7f9b3c1005b0 2024-08-31T05:27:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.335+0000 7f9b40b42640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c10d8f0 con 0x7f9b3c106660 2024-08-31T05:27:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.335+0000 7f9b3a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b3c1005b0 0x7f9b3c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.335+0000 7f9b3a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b3c1005b0 0x7f9b3c198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37146/0 (socket says 172.21.15.67:37146) 2024-08-31T05:27:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.335+0000 7f9b3a59c640 1 -- 172.21.15.67:0/2034440485 learned_addr learned my addr 172.21.15.67:0/2034440485 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:27:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.335+0000 7f9b39d9b640 1 --2- 172.21.15.67:0/2034440485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c106660 0x7f9b3c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.335+0000 7f9b3a59c640 1 -- 172.21.15.67:0/2034440485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c106660 msgr2=0x7f9b3c198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.335+0000 7f9b3a59c640 1 --2- 172.21.15.67:0/2034440485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c106660 0x7f9b3c198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.335+0000 7f9b3a59c640 1 -- 172.21.15.67:0/2034440485 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c199060 con 0x7f9b3c1005b0 2024-08-31T05:27:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.335+0000 7f9b3a59c640 1 --2- 172.21.15.67:0/2034440485 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b3c1005b0 0x7f9b3c198520 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400e970 tx=0x7f9b2400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.336+0000 7f9b337fe640 1 -- 172.21.15.67:0/2034440485 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b2400cac0 con 0x7f9b3c1005b0 2024-08-31T05:27:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.336+0000 7f9b337fe640 1 -- 172.21.15.67:0/2034440485 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9b240054e0 con 0x7f9b3c1005b0 2024-08-31T05:27:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.336+0000 7f9b40b42640 1 -- 172.21.15.67:0/2034440485 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c199350 con 0x7f9b3c1005b0 2024-08-31T05:27:48.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.336+0000 7f9b337fe640 1 -- 172.21.15.67:0/2034440485 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b24010430 con 0x7f9b3c1005b0 2024-08-31T05:27:48.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.336+0000 7f9b40b42640 1 -- 172.21.15.67:0/2034440485 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c1a1950 con 0x7f9b3c1005b0 2024-08-31T05:27:48.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.337+0000 7f9b40b42640 1 -- 172.21.15.67:0/2034440485 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c101cd0 con 0x7f9b3c1005b0 2024-08-31T05:27:48.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.337+0000 7f9b337fe640 1 -- 172.21.15.67:0/2034440485 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f9b24004e80 con 0x7f9b3c1005b0 2024-08-31T05:27:48.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.338+0000 7f9b337fe640 1 --2- 172.21.15.67:0/2034440485 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9b28079e00 0x7f9b2807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.338+0000 7f9b337fe640 1 -- 172.21.15.67:0/2034440485 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6216+0+0 (secure 0 0 0) 0x7f9b2409cfd0 con 0x7f9b3c1005b0 2024-08-31T05:27:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.338+0000 7f9b39d9b640 1 --2- 172.21.15.67:0/2034440485 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9b28079e00 0x7f9b2807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:48.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.338+0000 7f9b39d9b640 1 --2- 172.21.15.67:0/2034440485 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9b28079e00 0x7f9b2807c2c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c06a590 tx=0x7f9b2c004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:48.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.342+0000 7f9b337fe640 1 -- 172.21.15.67:0/2034440485 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9b3c199350 con 0x7f9b3c1005b0 2024-08-31T05:27:48.385 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 podman[79346]: 2024-08-31 05:27:48.089148337 +0000 UTC m=+0.376128445 container start 8fc00d4f54d96832042735a297332fd58936f993268e02f87f1beb2b1da0b8ac (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1) 2024-08-31T05:27:48.385 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 podman[79346]: 2024-08-31 05:27:48.169422086 +0000 UTC m=+0.456402191 container attach 8fc00d4f54d96832042735a297332fd58936f993268e02f87f1beb2b1da0b8ac (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:27:48.385 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate[79361]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:48.386 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 bash[79346]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:48.386 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate[79361]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:48.386 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 bash[79346]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:48.386 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate[79361]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-31T05:27:48.386 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 bash[79346]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-31T05:27:48.386 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate[79361]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:48.386 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 bash[79346]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:48.386 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate[79361]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:48.386 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 bash[79346]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:27:48.386 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate[79361]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-31T05:27:48.387 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 bash[79346]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-31T05:27:48.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.545+0000 7f9b40b42640 1 -- 172.21.15.67:0/2034440485 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9b3c108af0 con 0x7f9b28079e00 2024-08-31T05:27:48.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.546+0000 7f9b337fe640 1 -- 172.21.15.67:0/2034440485 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f9b2c004260 con 0x7f9b28079e00 2024-08-31T05:27:48.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.548+0000 7f9b40b42640 1 -- 172.21.15.67:0/2034440485 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9b28079e00 msgr2=0x7f9b2807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.548+0000 7f9b40b42640 1 --2- 172.21.15.67:0/2034440485 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9b28079e00 0x7f9b2807c2c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c06a590 tx=0x7f9b2c004f30 comp rx=0 tx=0).stop 2024-08-31T05:27:48.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.548+0000 7f9b40b42640 1 -- 172.21.15.67:0/2034440485 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b3c1005b0 msgr2=0x7f9b3c198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.548+0000 7f9b40b42640 1 --2- 172.21.15.67:0/2034440485 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b3c1005b0 0x7f9b3c198520 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400e970 tx=0x7f9b2400ed70 comp rx=0 tx=0).stop 2024-08-31T05:27:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.548+0000 7f9b40b42640 1 -- 172.21.15.67:0/2034440485 shutdown_connections 2024-08-31T05:27:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.548+0000 7f9b40b42640 1 --2- 172.21.15.67:0/2034440485 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9b28079e00 0x7f9b2807c2c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.548+0000 7f9b40b42640 1 --2- 172.21.15.67:0/2034440485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c106660 0x7f9b3c198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.548+0000 7f9b40b42640 1 --2- 172.21.15.67:0/2034440485 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b3c1005b0 0x7f9b3c198520 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.548+0000 7f9b40b42640 1 -- 172.21.15.67:0/2034440485 >> 172.21.15.67:0/2034440485 conn(0x7f9b3c0fc2f0 msgr2=0x7f9b3c0fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.549+0000 7f9b40b42640 1 -- 172.21.15.67:0/2034440485 shutdown_connections 2024-08-31T05:27:48.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.549+0000 7f9b40b42640 1 -- 172.21.15.67:0/2034440485 wait complete. 2024-08-31T05:27:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.632+0000 7f4ca05fa640 1 -- 172.21.15.67:0/2208770160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c981016a0 msgr2=0x7f4c98101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.632+0000 7f4ca05fa640 1 --2- 172.21.15.67:0/2208770160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c981016a0 0x7f4c98101b00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009880 tx=0x7f4c9402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.632+0000 7f4ca05fa640 1 -- 172.21.15.67:0/2208770160 shutdown_connections 2024-08-31T05:27:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.632+0000 7f4ca05fa640 1 --2- 172.21.15.67:0/2208770160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c981016a0 0x7f4c98101b00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.632+0000 7f4ca05fa640 1 --2- 172.21.15.67:0/2208770160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c981076a0 0x7f4c98107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.632+0000 7f4ca05fa640 1 -- 172.21.15.67:0/2208770160 >> 172.21.15.67:0/2208770160 conn(0x7f4c980fd3a0 msgr2=0x7f4c980ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.632+0000 7f4ca05fa640 1 -- 172.21.15.67:0/2208770160 shutdown_connections 2024-08-31T05:27:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.632+0000 7f4ca05fa640 1 -- 172.21.15.67:0/2208770160 wait complete. 2024-08-31T05:27:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.633+0000 7f4ca05fa640 1 Processor -- start 2024-08-31T05:27:48.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.633+0000 7f4ca05fa640 1 -- start start 2024-08-31T05:27:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.633+0000 7f4ca05fa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c981016a0 0x7f4c9819d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.633+0000 7f4ca05fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c981076a0 0x7f4c9819d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.633+0000 7f4ca05fa640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9810eb70 con 0x7f4c981076a0 2024-08-31T05:27:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.633+0000 7f4ca05fa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9810e9f0 con 0x7f4c981016a0 2024-08-31T05:27:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.633+0000 7f4c9db95640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c981076a0 0x7f4c9819d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.633+0000 7f4c9db95640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c981076a0 0x7f4c9819d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37160/0 (socket says 172.21.15.67:37160) 2024-08-31T05:27:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.633+0000 7f4c9db95640 1 -- 172.21.15.67:0/335223324 learned_addr learned my addr 172.21.15.67:0/335223324 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:27:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.634+0000 7f4c9e396640 1 --2- 172.21.15.67:0/335223324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c981016a0 0x7f4c9819d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.634+0000 7f4c9db95640 1 -- 172.21.15.67:0/335223324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c981016a0 msgr2=0x7f4c9819d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.634+0000 7f4c9db95640 1 --2- 172.21.15.67:0/335223324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c981016a0 0x7f4c9819d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.634+0000 7f4c9db95640 1 -- 172.21.15.67:0/335223324 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c981975a0 con 0x7f4c981076a0 2024-08-31T05:27:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.634+0000 7f4c9db95640 1 --2- 172.21.15.67:0/335223324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c981076a0 0x7f4c9819d920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4c94031460 tx=0x7f4c940045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.634+0000 7f4c8f7fe640 1 -- 172.21.15.67:0/335223324 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c9403f070 con 0x7f4c981076a0 2024-08-31T05:27:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.634+0000 7f4c8f7fe640 1 -- 172.21.15.67:0/335223324 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4c940035f0 con 0x7f4c981076a0 2024-08-31T05:27:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.634+0000 7f4ca05fa640 1 -- 172.21.15.67:0/335223324 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c98197830 con 0x7f4c981076a0 2024-08-31T05:27:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.634+0000 7f4c8f7fe640 1 -- 172.21.15.67:0/335223324 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c94035030 con 0x7f4c981076a0 2024-08-31T05:27:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.634+0000 7f4ca05fa640 1 -- 172.21.15.67:0/335223324 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c98197d60 con 0x7f4c981076a0 2024-08-31T05:27:48.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.635+0000 7f4ca05fa640 1 -- 172.21.15.67:0/335223324 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c98102de0 con 0x7f4c981076a0 2024-08-31T05:27:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.636+0000 7f4c8f7fe640 1 -- 172.21.15.67:0/335223324 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f4c94042070 con 0x7f4c981076a0 2024-08-31T05:27:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.636+0000 7f4c8f7fe640 1 --2- 172.21.15.67:0/335223324 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4c84079e00 0x7f4c8407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.636+0000 7f4c9e396640 1 --2- 172.21.15.67:0/335223324 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4c84079e00 0x7f4c8407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.636+0000 7f4c8f7fe640 1 -- 172.21.15.67:0/335223324 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6216+0+0 (secure 0 0 0) 0x7f4c940bd2b0 con 0x7f4c981076a0 2024-08-31T05:27:48.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.637+0000 7f4c9e396640 1 --2- 172.21.15.67:0/335223324 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4c84079e00 0x7f4c8407c2c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4c88005fd0 tx=0x7f4c8800b390 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:48.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.641+0000 7f4c8f7fe640 1 -- 172.21.15.67:0/335223324 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4c94088ea0 con 0x7f4c981076a0 2024-08-31T05:27:48.683 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate[79361]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-08-31T05:27:48.683 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 bash[79346]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-08-31T05:27:48.683 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate[79361]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-08-31T05:27:48.683 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 bash[79346]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-08-31T05:27:48.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:48 smithi067 ceph-mon[99941]: pgmap v205: 65 pgs: 13 stale+active+clean, 52 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-08-31T05:27:48.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.835+0000 7f4ca05fa640 1 -- 172.21.15.67:0/335223324 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4c98198ad0 con 0x7f4c84079e00 2024-08-31T05:27:48.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.845+0000 7f4c8f7fe640 1 -- 172.21.15.67:0/335223324 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f4c98198ad0 con 0x7f4c84079e00 2024-08-31T05:27:48.847 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:27:48.847 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (3m) 28s ago 14m 20.7M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:27:48.847 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (7m) 28s ago 14m 9021k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:27:48.847 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (6m) 2m ago 13m 8368k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:27:48.848 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (2m) 28s ago 14m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 910f4f105c4b 2024-08-31T05:27:48.848 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (2m) 2m ago 13m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 0dcc86f98a20 2024-08-31T05:27:48.848 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (3m) 28s ago 14m 77.9M - c8b91775d855 3a9a0f88928d 2024-08-31T05:27:48.848 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (9m) 28s ago 9m 92.0M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:27:48.848 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (9m) 28s ago 9m 155M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:27:48.848 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (9m) 2m ago 9m 16.1M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:27:48.848 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (9m) 2m ago 9m 18.1M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:27:48.848 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (6m) 28s ago 15m 591M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:27:48.848 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (5m) 2m ago 13m 524M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:27:48.848 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (2m) 28s ago 16m 109M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 25a28efbbd37 2024-08-31T05:27:48.848 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (2m) 2m ago 13m 92.8M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 6be0f0999860 2024-08-31T05:27:48.848 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (4m) 28s ago 14m 10.2M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:27:48.848 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (4m) 2m ago 13m 10.9M - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:27:48.848 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (104s) 28s ago 12m 207M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 aab0516dcbfa 2024-08-31T05:27:48.849 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (69s) 28s ago 12m 152M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 fa9e3fb20c5e 2024-08-31T05:27:48.849 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (34s) 28s ago 11m 79.4M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 a62abe735da2 2024-08-31T05:27:48.849 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (11m) 2m ago 11m 251M 2240M 19.1.1-242-g244a32d3 395b9209a980 54b8f72fb60d 2024-08-31T05:27:48.849 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (10m) 2m ago 10m 213M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:27:48.849 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (10m) 2m ago 10m 188M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:27:48.849 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (4m) 28s ago 14m 55.7M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:27:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.847+0000 7f4ca05fa640 1 -- 172.21.15.67:0/335223324 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4c84079e00 msgr2=0x7f4c8407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.847+0000 7f4ca05fa640 1 --2- 172.21.15.67:0/335223324 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4c84079e00 0x7f4c8407c2c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4c88005fd0 tx=0x7f4c8800b390 comp rx=0 tx=0).stop 2024-08-31T05:27:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.847+0000 7f4ca05fa640 1 -- 172.21.15.67:0/335223324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c981076a0 msgr2=0x7f4c9819d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.847+0000 7f4ca05fa640 1 --2- 172.21.15.67:0/335223324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c981076a0 0x7f4c9819d920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4c94031460 tx=0x7f4c940045e0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.847+0000 7f4ca05fa640 1 -- 172.21.15.67:0/335223324 shutdown_connections 2024-08-31T05:27:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.847+0000 7f4ca05fa640 1 --2- 172.21.15.67:0/335223324 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4c84079e00 0x7f4c8407c2c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.847+0000 7f4ca05fa640 1 --2- 172.21.15.67:0/335223324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c981076a0 0x7f4c9819d920 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.847+0000 7f4ca05fa640 1 --2- 172.21.15.67:0/335223324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c981016a0 0x7f4c9819d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.847+0000 7f4ca05fa640 1 -- 172.21.15.67:0/335223324 >> 172.21.15.67:0/335223324 conn(0x7f4c980fd3a0 msgr2=0x7f4c980fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.847+0000 7f4ca05fa640 1 -- 172.21.15.67:0/335223324 shutdown_connections 2024-08-31T05:27:48.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.848+0000 7f4ca05fa640 1 -- 172.21.15.67:0/335223324 wait complete. 2024-08-31T05:27:48.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.930+0000 7f1e539b5640 1 -- 172.21.15.67:0/671352687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e4c103180 msgr2=0x7f1e4c10b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.930+0000 7f1e539b5640 1 --2- 172.21.15.67:0/671352687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e4c103180 0x7f1e4c10b670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009880 tx=0x7f1e3c02a530 comp rx=0 tx=0).stop 2024-08-31T05:27:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.930+0000 7f1e539b5640 1 -- 172.21.15.67:0/671352687 shutdown_connections 2024-08-31T05:27:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.930+0000 7f1e539b5640 1 --2- 172.21.15.67:0/671352687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e4c103180 0x7f1e4c10b670 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.930+0000 7f1e539b5640 1 --2- 172.21.15.67:0/671352687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e4c102860 0x7f1e4c102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.930+0000 7f1e539b5640 1 -- 172.21.15.67:0/671352687 >> 172.21.15.67:0/671352687 conn(0x7f1e4c0fc2c0 msgr2=0x7f1e4c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.930+0000 7f1e539b5640 1 -- 172.21.15.67:0/671352687 shutdown_connections 2024-08-31T05:27:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.930+0000 7f1e539b5640 1 -- 172.21.15.67:0/671352687 wait complete. 2024-08-31T05:27:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e539b5640 1 Processor -- start 2024-08-31T05:27:48.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e539b5640 1 -- start start 2024-08-31T05:27:48.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e539b5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e4c102860 0x7f1e4c197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e539b5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e4c103180 0x7f1e4c197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e539b5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10eb70 con 0x7f1e4c102860 2024-08-31T05:27:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e539b5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10e9f0 con 0x7f1e4c103180 2024-08-31T05:27:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e51751640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e4c102860 0x7f1e4c197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e51751640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e4c102860 0x7f1e4c197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37178/0 (socket says 172.21.15.67:37178) 2024-08-31T05:27:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e51751640 1 -- 172.21.15.67:0/3412587067 learned_addr learned my addr 172.21.15.67:0/3412587067 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:27:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e50f50640 1 --2- 172.21.15.67:0/3412587067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e4c103180 0x7f1e4c197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e51751640 1 -- 172.21.15.67:0/3412587067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e4c103180 msgr2=0x7f1e4c197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e51751640 1 --2- 172.21.15.67:0/3412587067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e4c103180 0x7f1e4c197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e51751640 1 -- 172.21.15.67:0/3412587067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c19c020 con 0x7f1e4c102860 2024-08-31T05:27:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e50f50640 1 --2- 172.21.15.67:0/3412587067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e4c103180 0x7f1e4c197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:27:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.931+0000 7f1e51751640 1 --2- 172.21.15.67:0/3412587067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e4c102860 0x7f1e4c197750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800d8d0 tx=0x7f1e4800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.932+0000 7f1e427fc640 1 -- 172.21.15.67:0/3412587067 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e48017070 con 0x7f1e4c102860 2024-08-31T05:27:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.932+0000 7f1e427fc640 1 -- 172.21.15.67:0/3412587067 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e48010460 con 0x7f1e4c102860 2024-08-31T05:27:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.932+0000 7f1e539b5640 1 -- 172.21.15.67:0/3412587067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4c19c310 con 0x7f1e4c102860 2024-08-31T05:27:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.932+0000 7f1e427fc640 1 -- 172.21.15.67:0/3412587067 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e4800f5f0 con 0x7f1e4c102860 2024-08-31T05:27:48.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.932+0000 7f1e539b5640 1 -- 172.21.15.67:0/3412587067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4c19c8a0 con 0x7f1e4c102860 2024-08-31T05:27:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.933+0000 7f1e539b5640 1 -- 172.21.15.67:0/3412587067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e4c06a830 con 0x7f1e4c102860 2024-08-31T05:27:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.933+0000 7f1e427fc640 1 -- 172.21.15.67:0/3412587067 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f1e48009a30 con 0x7f1e4c102860 2024-08-31T05:27:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.934+0000 7f1e427fc640 1 --2- 172.21.15.67:0/3412587067 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1e38079e00 0x7f1e3807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.934+0000 7f1e427fc640 1 -- 172.21.15.67:0/3412587067 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6216+0+0 (secure 0 0 0) 0x7f1e4809c8b0 con 0x7f1e4c102860 2024-08-31T05:27:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.934+0000 7f1e50f50640 1 --2- 172.21.15.67:0/3412587067 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1e38079e00 0x7f1e3807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:48.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.934+0000 7f1e50f50640 1 --2- 172.21.15.67:0/3412587067 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1e38079e00 0x7f1e3807c2c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c108670 tx=0x7f1e3c031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:48.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:48.939+0000 7f1e427fc640 1 -- 172.21.15.67:0/3412587067 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1e48064330 con 0x7f1e4c102860 2024-08-31T05:27:48.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:48 smithi073 ceph-mon[71452]: pgmap v205: 65 pgs: 13 stale+active+clean, 52 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-08-31T05:27:48.946 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate[79361]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-08-31T05:27:48.946 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 bash[79346]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-08-31T05:27:48.946 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate[79361]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-31T05:27:48.946 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 bash[79346]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-31T05:27:48.946 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate[79361]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-31T05:27:48.946 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 bash[79346]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-31T05:27:48.946 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate[79361]: --> ceph-volume lvm activate successful for osd ID: 3 2024-08-31T05:27:48.946 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 bash[79346]: --> ceph-volume lvm activate successful for osd ID: 3 2024-08-31T05:27:48.946 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:48 smithi073 podman[79346]: 2024-08-31 05:27:48.710665526 +0000 UTC m=+0.997645628 container died 8fc00d4f54d96832042735a297332fd58936f993268e02f87f1beb2b1da0b8ac (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T05:27:49.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.199+0000 7f1e539b5640 1 -- 172.21.15.67:0/3412587067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1e4c198ab0 con 0x7f1e4c102860 2024-08-31T05:27:49.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.199+0000 7f1e427fc640 1 -- 172.21.15.67:0/3412587067 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f1e480684a0 con 0x7f1e4c102860 2024-08-31T05:27:49.201 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:27:49.202 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:27:49.202 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:27:49.202 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:27:49.202 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:27:49.202 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:27:49.202 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:27:49.202 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:27:49.202 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2, 2024-08-31T05:27:49.202 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 3 2024-08-31T05:27:49.202 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:27:49.202 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:27:49.202 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:27:49.202 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:27:49.202 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:27:49.203 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 6, 2024-08-31T05:27:49.203 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 7 2024-08-31T05:27:49.203 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:27:49.203 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:27:49.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.201+0000 7f1e539b5640 1 -- 172.21.15.67:0/3412587067 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1e38079e00 msgr2=0x7f1e3807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.201+0000 7f1e539b5640 1 --2- 172.21.15.67:0/3412587067 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1e38079e00 0x7f1e3807c2c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c108670 tx=0x7f1e3c031400 comp rx=0 tx=0).stop 2024-08-31T05:27:49.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.201+0000 7f1e539b5640 1 -- 172.21.15.67:0/3412587067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e4c102860 msgr2=0x7f1e4c197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.201+0000 7f1e539b5640 1 --2- 172.21.15.67:0/3412587067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e4c102860 0x7f1e4c197750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800d8d0 tx=0x7f1e4800dd90 comp rx=0 tx=0).stop 2024-08-31T05:27:49.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.202+0000 7f1e539b5640 1 -- 172.21.15.67:0/3412587067 shutdown_connections 2024-08-31T05:27:49.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.202+0000 7f1e539b5640 1 --2- 172.21.15.67:0/3412587067 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1e38079e00 0x7f1e3807c2c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.202+0000 7f1e539b5640 1 --2- 172.21.15.67:0/3412587067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e4c103180 0x7f1e4c197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.202+0000 7f1e539b5640 1 --2- 172.21.15.67:0/3412587067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e4c102860 0x7f1e4c197750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.202+0000 7f1e539b5640 1 -- 172.21.15.67:0/3412587067 >> 172.21.15.67:0/3412587067 conn(0x7f1e4c0fc2c0 msgr2=0x7f1e4c108cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:49.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.202+0000 7f1e539b5640 1 -- 172.21.15.67:0/3412587067 shutdown_connections 2024-08-31T05:27:49.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.202+0000 7f1e539b5640 1 -- 172.21.15.67:0/3412587067 wait complete. 2024-08-31T05:27:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.285+0000 7f73bde43640 1 -- 172.21.15.67:0/1084418112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b8106660 msgr2=0x7f73b8106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.285+0000 7f73bde43640 1 --2- 172.21.15.67:0/1084418112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b8106660 0x7f73b8106a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009880 tx=0x7f73a802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.285+0000 7f73bde43640 1 -- 172.21.15.67:0/1084418112 shutdown_connections 2024-08-31T05:27:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.285+0000 7f73bde43640 1 --2- 172.21.15.67:0/1084418112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73b81005b0 0x7f73b8100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.285+0000 7f73bde43640 1 --2- 172.21.15.67:0/1084418112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b8106660 0x7f73b8106a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.285+0000 7f73bde43640 1 -- 172.21.15.67:0/1084418112 >> 172.21.15.67:0/1084418112 conn(0x7f73b80fc2f0 msgr2=0x7f73b80fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.285+0000 7f73bde43640 1 -- 172.21.15.67:0/1084418112 shutdown_connections 2024-08-31T05:27:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.285+0000 7f73bde43640 1 -- 172.21.15.67:0/1084418112 wait complete. 2024-08-31T05:27:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.286+0000 7f73bde43640 1 Processor -- start 2024-08-31T05:27:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.286+0000 7f73bde43640 1 -- start start 2024-08-31T05:27:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.286+0000 7f73bde43640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73b81005b0 0x7f73b81976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.286+0000 7f73bde43640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b8106660 0x7f73b8197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.286+0000 7f73bde43640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f73b806a8f0 con 0x7f73b8106660 2024-08-31T05:27:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.286+0000 7f73bde43640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f73b806a770 con 0x7f73b81005b0 2024-08-31T05:27:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.286+0000 7f73affff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b8106660 0x7f73b8197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:49.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.286+0000 7f73affff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b8106660 0x7f73b8197be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37188/0 (socket says 172.21.15.67:37188) 2024-08-31T05:27:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.286+0000 7f73affff640 1 -- 172.21.15.67:0/716003525 learned_addr learned my addr 172.21.15.67:0/716003525 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:27:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.286+0000 7f73b77fe640 1 --2- 172.21.15.67:0/716003525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73b81005b0 0x7f73b81976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.286+0000 7f73affff640 1 -- 172.21.15.67:0/716003525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73b81005b0 msgr2=0x7f73b81976a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.286+0000 7f73affff640 1 --2- 172.21.15.67:0/716003525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73b81005b0 0x7f73b81976a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.286+0000 7f73affff640 1 -- 172.21.15.67:0/716003525 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b819bf70 con 0x7f73b8106660 2024-08-31T05:27:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.286+0000 7f73affff640 1 --2- 172.21.15.67:0/716003525 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b8106660 0x7f73b8197be0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f73a000d8d0 tx=0x7f73a000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.287+0000 7f73b57fa640 1 -- 172.21.15.67:0/716003525 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73a0017070 con 0x7f73b8106660 2024-08-31T05:27:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.287+0000 7f73bde43640 1 -- 172.21.15.67:0/716003525 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b819c260 con 0x7f73b8106660 2024-08-31T05:27:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.287+0000 7f73b57fa640 1 -- 172.21.15.67:0/716003525 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f73a0010460 con 0x7f73b8106660 2024-08-31T05:27:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.287+0000 7f73b57fa640 1 -- 172.21.15.67:0/716003525 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73a000f5f0 con 0x7f73b8106660 2024-08-31T05:27:49.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.287+0000 7f73bde43640 1 -- 172.21.15.67:0/716003525 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b819c7f0 con 0x7f73b8106660 2024-08-31T05:27:49.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.288+0000 7f73bde43640 1 -- 172.21.15.67:0/716003525 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b8101cd0 con 0x7f73b8106660 2024-08-31T05:27:49.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.288+0000 7f73b57fa640 1 -- 172.21.15.67:0/716003525 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f73a0009a30 con 0x7f73b8106660 2024-08-31T05:27:49.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.289+0000 7f73b57fa640 1 --2- 172.21.15.67:0/716003525 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f73a4079e00 0x7f73a407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:49.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.289+0000 7f73b57fa640 1 -- 172.21.15.67:0/716003525 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6216+0+0 (secure 0 0 0) 0x7f73a009c8b0 con 0x7f73b8106660 2024-08-31T05:27:49.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.289+0000 7f73b77fe640 1 --2- 172.21.15.67:0/716003525 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f73a4079e00 0x7f73a407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:49.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.289+0000 7f73b77fe640 1 --2- 172.21.15.67:0/716003525 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f73a4079e00 0x7f73a407c2c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f73a80096c0 tx=0x7f73a8004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:49.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.293+0000 7f73b57fa640 1 -- 172.21.15.67:0/716003525 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f73a0064330 con 0x7f73b8106660 2024-08-31T05:27:49.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.515+0000 7f73bde43640 1 -- 172.21.15.67:0/716003525 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f73b8198a00 con 0x7f73b8106660 2024-08-31T05:27:49.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.516+0000 7f73b57fa640 1 -- 172.21.15.67:0/716003525 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2042 (secure 0 0 0) 0x7f73a00684a0 con 0x7f73b8106660 2024-08-31T05:27:49.518 INFO:teuthology.orchestra.run.smithi067.stdout:e15 2024-08-31T05:27:49.518 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-08-31T05:18:35:124059+0000 2024-08-31T05:27:49.518 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:27:49.518 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:27:49.518 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 13 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-08-31T05:18:33.086400+0000 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-08-31T05:27:49.519 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 0 2024-08-31T05:27:49.520 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:27:49.520 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2024-08-31T05:27:49.520 INFO:teuthology.orchestra.run.smithi067.stdout:in 0 2024-08-31T05:27:49.520 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14554} 2024-08-31T05:27:49.520 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-08-31T05:27:49.520 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-08-31T05:27:49.520 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-08-31T05:27:49.520 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-08-31T05:27:49.520 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-08-31T05:27:49.520 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data enabled 2024-08-31T05:27:49.520 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-08-31T05:27:49.520 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-08-31T05:27:49.520 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2024-08-31T05:27:49.520 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 14554 members: 14554 2024-08-31T05:27:49.521 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.tskvpt{0:14554} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:27:49.521 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.beqeql{0:14566} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:27:49.521 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:27:49.521 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:27:49.521 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2024-08-31T05:27:49.521 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:27:49.521 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.kfbmeo{-1:24299} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:27:49.521 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.gsnhxi{-1:24307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6824/2383176383,v1:172.21.15.73:6825/2383176383] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:27:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-08-31T05:27:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.518+0000 7f73bde43640 1 -- 172.21.15.67:0/716003525 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f73a4079e00 msgr2=0x7f73a407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.518+0000 7f73bde43640 1 --2- 172.21.15.67:0/716003525 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f73a4079e00 0x7f73a407c2c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f73a80096c0 tx=0x7f73a8004f30 comp rx=0 tx=0).stop 2024-08-31T05:27:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.518+0000 7f73bde43640 1 -- 172.21.15.67:0/716003525 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b8106660 msgr2=0x7f73b8197be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.518+0000 7f73bde43640 1 --2- 172.21.15.67:0/716003525 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b8106660 0x7f73b8197be0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f73a000d8d0 tx=0x7f73a000dd90 comp rx=0 tx=0).stop 2024-08-31T05:27:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.519+0000 7f73bde43640 1 -- 172.21.15.67:0/716003525 shutdown_connections 2024-08-31T05:27:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.519+0000 7f73bde43640 1 --2- 172.21.15.67:0/716003525 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f73a4079e00 0x7f73a407c2c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.519+0000 7f73bde43640 1 --2- 172.21.15.67:0/716003525 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73b8106660 0x7f73b8197be0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.519+0000 7f73bde43640 1 --2- 172.21.15.67:0/716003525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73b81005b0 0x7f73b81976a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.519+0000 7f73bde43640 1 -- 172.21.15.67:0/716003525 >> 172.21.15.67:0/716003525 conn(0x7f73b80fc2f0 msgr2=0x7f73b80fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.519+0000 7f73bde43640 1 -- 172.21.15.67:0/716003525 shutdown_connections 2024-08-31T05:27:49.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.519+0000 7f73bde43640 1 -- 172.21.15.67:0/716003525 wait complete. 2024-08-31T05:27:49.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.604+0000 7fb607efa640 1 -- 172.21.15.67:0/1928773926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6001076a0 msgr2=0x7fb600107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.604+0000 7fb607efa640 1 --2- 172.21.15.67:0/1928773926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6001076a0 0x7fb600107a80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009880 tx=0x7fb5fc02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.604+0000 7fb607efa640 1 -- 172.21.15.67:0/1928773926 shutdown_connections 2024-08-31T05:27:49.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.604+0000 7fb607efa640 1 --2- 172.21.15.67:0/1928773926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6001016a0 0x7fb600101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.604+0000 7fb607efa640 1 --2- 172.21.15.67:0/1928773926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6001076a0 0x7fb600107a80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.604+0000 7fb607efa640 1 -- 172.21.15.67:0/1928773926 >> 172.21.15.67:0/1928773926 conn(0x7fb6000fd3c0 msgr2=0x7fb6000ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:49.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.604+0000 7fb607efa640 1 -- 172.21.15.67:0/1928773926 shutdown_connections 2024-08-31T05:27:49.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.604+0000 7fb607efa640 1 -- 172.21.15.67:0/1928773926 wait complete. 2024-08-31T05:27:49.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.604+0000 7fb607efa640 1 Processor -- start 2024-08-31T05:27:49.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.605+0000 7fb607efa640 1 -- start start 2024-08-31T05:27:49.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.605+0000 7fb607efa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6001016a0 0x7fb600197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:49.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.605+0000 7fb607efa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6001076a0 0x7fb600197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:49.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.605+0000 7fb607efa640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb60010eb70 con 0x7fb6001076a0 2024-08-31T05:27:49.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.605+0000 7fb607efa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb60010e9f0 con 0x7fb6001016a0 2024-08-31T05:27:49.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.605+0000 7fb605495640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6001076a0 0x7fb600197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:49.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.605+0000 7fb605495640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6001076a0 0x7fb600197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37210/0 (socket says 172.21.15.67:37210) 2024-08-31T05:27:49.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.605+0000 7fb605495640 1 -- 172.21.15.67:0/1479406618 learned_addr learned my addr 172.21.15.67:0/1479406618 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:27:49.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.605+0000 7fb605c96640 1 --2- 172.21.15.67:0/1479406618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6001016a0 0x7fb600197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:49.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.605+0000 7fb605495640 1 -- 172.21.15.67:0/1479406618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6001016a0 msgr2=0x7fb600197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.605+0000 7fb605495640 1 --2- 172.21.15.67:0/1479406618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6001016a0 0x7fb600197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.605+0000 7fb605495640 1 -- 172.21.15.67:0/1479406618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60019c000 con 0x7fb6001076a0 2024-08-31T05:27:49.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.605+0000 7fb605495640 1 --2- 172.21.15.67:0/1479406618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6001076a0 0x7fb600197c70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000e970 tx=0x7fb5f000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:49.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.606+0000 7fb5f6ffd640 1 -- 172.21.15.67:0/1479406618 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb5f000cac0 con 0x7fb6001076a0 2024-08-31T05:27:49.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.606+0000 7fb5f6ffd640 1 -- 172.21.15.67:0/1479406618 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb5f00054e0 con 0x7fb6001076a0 2024-08-31T05:27:49.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.606+0000 7fb607efa640 1 -- 172.21.15.67:0/1479406618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60019c2f0 con 0x7fb6001076a0 2024-08-31T05:27:49.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.606+0000 7fb5f6ffd640 1 -- 172.21.15.67:0/1479406618 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb5f0010430 con 0x7fb6001076a0 2024-08-31T05:27:49.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.606+0000 7fb607efa640 1 -- 172.21.15.67:0/1479406618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60019c880 con 0x7fb6001076a0 2024-08-31T05:27:49.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.607+0000 7fb607efa640 1 -- 172.21.15.67:0/1479406618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb600102de0 con 0x7fb6001076a0 2024-08-31T05:27:49.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.608+0000 7fb5f6ffd640 1 -- 172.21.15.67:0/1479406618 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fb5f0004e80 con 0x7fb6001076a0 2024-08-31T05:27:49.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.608+0000 7fb5f6ffd640 1 --2- 172.21.15.67:0/1479406618 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb5ec079e00 0x7fb5ec07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:49.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.608+0000 7fb605c96640 1 --2- 172.21.15.67:0/1479406618 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb5ec079e00 0x7fb5ec07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:49.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.608+0000 7fb5f6ffd640 1 -- 172.21.15.67:0/1479406618 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6216+0+0 (secure 0 0 0) 0x7fb5f009cfd0 con 0x7fb6001076a0 2024-08-31T05:27:49.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.609+0000 7fb605c96640 1 --2- 172.21.15.67:0/1479406618 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb5ec079e00 0x7fb5ec07c2c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc0096c0 tx=0x7fb5fc031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:49.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.613+0000 7fb5f6ffd640 1 -- 172.21.15.67:0/1479406618 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb5f0064a50 con 0x7fb6001076a0 2024-08-31T05:27:49.672 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:49 smithi073 podman[79486]: 2024-08-31 05:27:49.378197213 +0000 UTC m=+0.661708959 container remove 8fc00d4f54d96832042735a297332fd58936f993268e02f87f1beb2b1da0b8ac (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:27:49.672 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:49 smithi073 podman[79546]: 2024-08-31 05:27:49.570914385 +0000 UTC m=+0.100101626 container create 9f4ce308ec1dcf61de8fa1db5822898fe0908782ed36414ec24722beea5726f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-31T05:27:49.672 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:49 smithi073 podman[79546]: 2024-08-31 05:27:49.486513319 +0000 UTC m=+0.015700557 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:27:49.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.819+0000 7fb607efa640 1 -- 172.21.15.67:0/1479406618 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb60019cb90 con 0x7fb5ec079e00 2024-08-31T05:27:49.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:49 smithi067 ceph-mon[99941]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:49.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:49 smithi067 ceph-mon[99941]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:49.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:49 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3412587067' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:49.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:49 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/716003525' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:27:49.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:49.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:27:49.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.820+0000 7fb5f6ffd640 1 -- 172.21.15.67:0/1479406618 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fb60019cb90 con 0x7fb5ec079e00 2024-08-31T05:27:49.822 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:27:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:27:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:27:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-31T05:27:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:27:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "mon", 2024-08-31T05:27:49.822 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2024-08-31T05:27:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "crash" 2024-08-31T05:27:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:27:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "9/23 daemons upgraded", 2024-08-31T05:27:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading osd daemons", 2024-08-31T05:27:49.823 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:27:49.823 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:27:49.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.822+0000 7fb607efa640 1 -- 172.21.15.67:0/1479406618 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb5ec079e00 msgr2=0x7fb5ec07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.822+0000 7fb607efa640 1 --2- 172.21.15.67:0/1479406618 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb5ec079e00 0x7fb5ec07c2c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc0096c0 tx=0x7fb5fc031400 comp rx=0 tx=0).stop 2024-08-31T05:27:49.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.822+0000 7fb607efa640 1 -- 172.21.15.67:0/1479406618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6001076a0 msgr2=0x7fb600197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.822+0000 7fb607efa640 1 --2- 172.21.15.67:0/1479406618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6001076a0 0x7fb600197c70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000e970 tx=0x7fb5f000ed70 comp rx=0 tx=0).stop 2024-08-31T05:27:49.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.822+0000 7fb607efa640 1 -- 172.21.15.67:0/1479406618 shutdown_connections 2024-08-31T05:27:49.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.822+0000 7fb607efa640 1 --2- 172.21.15.67:0/1479406618 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb5ec079e00 0x7fb5ec07c2c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.822+0000 7fb607efa640 1 --2- 172.21.15.67:0/1479406618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6001076a0 0x7fb600197c70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.822+0000 7fb607efa640 1 --2- 172.21.15.67:0/1479406618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6001016a0 0x7fb600197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.822+0000 7fb607efa640 1 -- 172.21.15.67:0/1479406618 >> 172.21.15.67:0/1479406618 conn(0x7fb6000fd3c0 msgr2=0x7fb6000fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:49.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.823+0000 7fb607efa640 1 -- 172.21.15.67:0/1479406618 shutdown_connections 2024-08-31T05:27:49.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.823+0000 7fb607efa640 1 -- 172.21.15.67:0/1479406618 wait complete. 2024-08-31T05:27:49.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.906+0000 7f3a025e5640 1 -- 172.21.15.67:0/331342312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39fc1016a0 msgr2=0x7f39fc101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.906+0000 7f3a025e5640 1 --2- 172.21.15.67:0/331342312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39fc1016a0 0x7f39fc101b00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009880 tx=0x7f39f002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.906+0000 7f3a025e5640 1 -- 172.21.15.67:0/331342312 shutdown_connections 2024-08-31T05:27:49.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.906+0000 7f3a025e5640 1 --2- 172.21.15.67:0/331342312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39fc1016a0 0x7f39fc101b00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.906+0000 7f3a025e5640 1 --2- 172.21.15.67:0/331342312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39fc1076a0 0x7f39fc107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.906+0000 7f3a025e5640 1 -- 172.21.15.67:0/331342312 >> 172.21.15.67:0/331342312 conn(0x7f39fc0fd3a0 msgr2=0x7f39fc0ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:49.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.907+0000 7f3a025e5640 1 -- 172.21.15.67:0/331342312 shutdown_connections 2024-08-31T05:27:49.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.907+0000 7f3a025e5640 1 -- 172.21.15.67:0/331342312 wait complete. 2024-08-31T05:27:49.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.907+0000 7f3a025e5640 1 Processor -- start 2024-08-31T05:27:49.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.907+0000 7f3a025e5640 1 -- start start 2024-08-31T05:27:49.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f3a025e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39fc1016a0 0x7f39fc19d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:49.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f3a025e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39fc1076a0 0x7f39fc19d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:49.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f3a025e5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc10eb70 con 0x7f39fc1016a0 2024-08-31T05:27:49.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f3a025e5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc10e9f0 con 0x7f39fc1076a0 2024-08-31T05:27:49.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f39fbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39fc1016a0 0x7f39fc19d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:49.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f39fbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39fc1016a0 0x7f39fc19d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37234/0 (socket says 172.21.15.67:37234) 2024-08-31T05:27:49.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f39fbfff640 1 -- 172.21.15.67:0/1797728820 learned_addr learned my addr 172.21.15.67:0/1797728820 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:27:49.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f39fb7fe640 1 --2- 172.21.15.67:0/1797728820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39fc1076a0 0x7f39fc19d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:49.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f39fbfff640 1 -- 172.21.15.67:0/1797728820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39fc1076a0 msgr2=0x7f39fc19d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f39fbfff640 1 --2- 172.21.15.67:0/1797728820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39fc1076a0 0x7f39fc19d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f39fbfff640 1 -- 172.21.15.67:0/1797728820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc1975a0 con 0x7f39fc1016a0 2024-08-31T05:27:49.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f39fb7fe640 1 --2- 172.21.15.67:0/1797728820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39fc1076a0 0x7f39fc19d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:27:49.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f39fbfff640 1 --2- 172.21.15.67:0/1797728820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39fc1016a0 0x7f39fc19d3e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00e970 tx=0x7f39ec00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:49.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f39f97fa640 1 -- 172.21.15.67:0/1797728820 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39ec00cac0 con 0x7f39fc1016a0 2024-08-31T05:27:49.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.908+0000 7f3a025e5640 1 -- 172.21.15.67:0/1797728820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39fc197890 con 0x7f39fc1016a0 2024-08-31T05:27:49.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.909+0000 7f39f97fa640 1 -- 172.21.15.67:0/1797728820 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39ec0054e0 con 0x7f39fc1016a0 2024-08-31T05:27:49.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.909+0000 7f39f97fa640 1 -- 172.21.15.67:0/1797728820 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39ec010430 con 0x7f39fc1016a0 2024-08-31T05:27:49.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.909+0000 7f3a025e5640 1 -- 172.21.15.67:0/1797728820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39fc197df0 con 0x7f39fc1016a0 2024-08-31T05:27:49.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.910+0000 7f3a025e5640 1 -- 172.21.15.67:0/1797728820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39fc102de0 con 0x7f39fc1016a0 2024-08-31T05:27:49.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.911+0000 7f39f97fa640 1 -- 172.21.15.67:0/1797728820 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f39ec004e80 con 0x7f39fc1016a0 2024-08-31T05:27:49.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.911+0000 7f39f97fa640 1 --2- 172.21.15.67:0/1797728820 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39e4079e00 0x7f39e407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:49.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.911+0000 7f39f97fa640 1 -- 172.21.15.67:0/1797728820 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6216+0+0 (secure 0 0 0) 0x7f39ec09cfd0 con 0x7f39fc1016a0 2024-08-31T05:27:49.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.911+0000 7f39fb7fe640 1 --2- 172.21.15.67:0/1797728820 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39e4079e00 0x7f39e407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:49.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.912+0000 7f39fb7fe640 1 --2- 172.21.15.67:0/1797728820 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39e4079e00 0x7f39e407c2c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f39fc1986e0 tx=0x7f39f0031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:49.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:49.918+0000 7f39f97fa640 1 -- 172.21.15.67:0/1797728820 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f39ec064a50 con 0x7f39fc1016a0 2024-08-31T05:27:49.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:49 smithi073 ceph-mon[71452]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:49.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:49 smithi073 ceph-mon[71452]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:49.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:49 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3412587067' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:49.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:49 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/716003525' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:27:49.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:49.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:27:49.947 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:49 smithi073 podman[79546]: 2024-08-31 05:27:49.768076864 +0000 UTC m=+0.297264104 container init 9f4ce308ec1dcf61de8fa1db5822898fe0908782ed36414ec24722beea5726f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-31T05:27:49.947 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:49 smithi073 podman[79546]: 2024-08-31 05:27:49.771309434 +0000 UTC m=+0.300496673 container start 9f4ce308ec1dcf61de8fa1db5822898fe0908782ed36414ec24722beea5726f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-31T05:27:49.947 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:49 smithi073 ceph-osd[79566]: -- 172.21.15.73:0/3118024299 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5582ab1921e0 con 0x5582aa418d00 2024-08-31T05:27:49.947 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:49 smithi073 bash[79546]: 9f4ce308ec1dcf61de8fa1db5822898fe0908782ed36414ec24722beea5726f8 2024-08-31T05:27:49.947 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:49 smithi073 systemd[1]: Started Ceph osd.3 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:27:50.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:50.178+0000 7f3a025e5640 1 -- 172.21.15.67:0/1797728820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f39fc109c10 con 0x7f39fc1016a0 2024-08-31T05:27:50.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:50.179+0000 7f39f97fa640 1 -- 172.21.15.67:0/1797728820 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+290 (secure 0 0 0) 0x7f39ec06b0e0 con 0x7f39fc1016a0 2024-08-31T05:27:50.182 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2024-08-31T05:27:50.182 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:27:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:27:50.182 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-31T05:27:50.182 INFO:teuthology.orchestra.run.smithi067.stdout: osd.3 (root=default,host=smithi073) is down 2024-08-31T05:27:50.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:50.181+0000 7f3a025e5640 1 -- 172.21.15.67:0/1797728820 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39e4079e00 msgr2=0x7f39e407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:50.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:50.181+0000 7f3a025e5640 1 --2- 172.21.15.67:0/1797728820 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39e4079e00 0x7f39e407c2c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f39fc1986e0 tx=0x7f39f0031400 comp rx=0 tx=0).stop 2024-08-31T05:27:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:50.181+0000 7f3a025e5640 1 -- 172.21.15.67:0/1797728820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39fc1016a0 msgr2=0x7f39fc19d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:50.181+0000 7f3a025e5640 1 --2- 172.21.15.67:0/1797728820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39fc1016a0 0x7f39fc19d3e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00e970 tx=0x7f39ec00ed70 comp rx=0 tx=0).stop 2024-08-31T05:27:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:50.181+0000 7f3a025e5640 1 -- 172.21.15.67:0/1797728820 shutdown_connections 2024-08-31T05:27:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:50.181+0000 7f3a025e5640 1 --2- 172.21.15.67:0/1797728820 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39e4079e00 0x7f39e407c2c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:50.181+0000 7f3a025e5640 1 --2- 172.21.15.67:0/1797728820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39fc1076a0 0x7f39fc19d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:50.181+0000 7f3a025e5640 1 --2- 172.21.15.67:0/1797728820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39fc1016a0 0x7f39fc19d3e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:50.181+0000 7f3a025e5640 1 -- 172.21.15.67:0/1797728820 >> 172.21.15.67:0/1797728820 conn(0x7f39fc0fd3a0 msgr2=0x7f39fc0fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:50.181+0000 7f3a025e5640 1 -- 172.21.15.67:0/1797728820 shutdown_connections 2024-08-31T05:27:50.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:27:50.181+0000 7f3a025e5640 1 -- 172.21.15.67:0/1797728820 wait complete. 2024-08-31T05:27:50.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:50 smithi073 ceph-mon[71452]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:50.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:50 smithi073 ceph-mon[71452]: pgmap v206: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 50/276 objects degraded (18.116%) 2024-08-31T05:27:50.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:50.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:50.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:27:50.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:50 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/1797728820' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:27:50.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:50 smithi073 ceph-mon[71452]: Health check failed: Degraded data redundancy: 50/276 objects degraded (18.116%), 16 pgs degraded (PG_DEGRADED) 2024-08-31T05:27:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:50 smithi067 ceph-mon[99941]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:50 smithi067 ceph-mon[99941]: pgmap v206: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 50/276 objects degraded (18.116%) 2024-08-31T05:27:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:27:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:50 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/1797728820' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:27:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:50 smithi067 ceph-mon[99941]: Health check failed: Degraded data redundancy: 50/276 objects degraded (18.116%), 16 pgs degraded (PG_DEGRADED) 2024-08-31T05:27:51.696 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:51 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[79562]: 2024-08-31T05:27:51.423+0000 7f6eb76eb640 -1 Falling back to public interface 2024-08-31T05:27:52.065 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:51 smithi073 ceph-mon[71452]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:52.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:51 smithi067 ceph-mon[99941]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:53.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:52 smithi067 ceph-mon[99941]: pgmap v207: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/276 objects degraded (18.116%) 2024-08-31T05:27:53.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:52 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:53.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:52 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:53.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:52 smithi073 ceph-mon[71452]: pgmap v207: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/276 objects degraded (18.116%) 2024-08-31T05:27:53.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:52 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:53.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:52 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:54.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:54.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:54.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:54 smithi073 ceph-mon[71452]: pgmap v208: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 50/276 objects degraded (18.116%) 2024-08-31T05:27:54.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:54.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:54.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:54 smithi067 ceph-mon[99941]: pgmap v208: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 50/276 objects degraded (18.116%) 2024-08-31T05:27:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:56 smithi067 ceph-mon[99941]: pgmap v209: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 50/276 objects degraded (18.116%) 2024-08-31T05:27:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:56 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:56 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:56 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:56 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:27:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:56 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:56.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:56 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:27:56.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:56 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:56.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:56 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:56.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:56 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:56.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:56 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-08-31T05:27:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:56 smithi073 ceph-mon[71452]: pgmap v209: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 50/276 objects degraded (18.116%) 2024-08-31T05:27:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:56 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:56 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:56 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:56 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:27:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:56 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:27:57.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:56 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:27:57.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:56 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:57.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:56 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:57.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:56 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:27:57.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:56 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-08-31T05:27:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:57 smithi067 ceph-mon[99941]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-31T05:27:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:57 smithi067 ceph-mon[99941]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-08-31T05:27:58.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:57 smithi073 ceph-mon[71452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-31T05:27:58.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:57 smithi073 ceph-mon[71452]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-08-31T05:27:58.695 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:58 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[79562]: 2024-08-31T05:27:58.467+0000 7f6eb76eb640 -1 osd.3 75 log_to_monitors true 2024-08-31T05:27:59.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:58 smithi067 ceph-mon[99941]: pgmap v210: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 50/276 objects degraded (18.116%) 2024-08-31T05:27:59.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:58 smithi067 ceph-mon[99941]: from='osd.3 [v2:172.21.15.73:6800/76055997,v1:172.21.15.73:6801/76055997]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T05:27:59.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:58 smithi067 ceph-mon[99941]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T05:27:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:58 smithi073 ceph-mon[71452]: pgmap v210: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 50/276 objects degraded (18.116%) 2024-08-31T05:27:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:58 smithi073 ceph-mon[71452]: from='osd.3 [v2:172.21.15.73:6800/76055997,v1:172.21.15.73:6801/76055997]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T05:27:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:58 smithi073 ceph-mon[71452]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T05:27:59.196 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:27:58 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[79562]: 2024-08-31T05:27:58.767+0000 7f6eab463640 -1 osd.3 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:28:00.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:59 smithi067 ceph-mon[99941]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T05:28:00.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:59 smithi067 ceph-mon[99941]: from='osd.3 [v2:172.21.15.73:6800/76055997,v1:172.21.15.73:6801/76055997]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-08-31T05:28:00.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:59 smithi067 ceph-mon[99941]: osdmap e78: 6 total, 5 up, 6 in 2024-08-31T05:28:00.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:27:59 smithi067 ceph-mon[99941]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-08-31T05:28:00.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:59 smithi073 ceph-mon[71452]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T05:28:00.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:59 smithi073 ceph-mon[71452]: from='osd.3 [v2:172.21.15.73:6800/76055997,v1:172.21.15.73:6801/76055997]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-08-31T05:28:00.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:59 smithi073 ceph-mon[71452]: osdmap e78: 6 total, 5 up, 6 in 2024-08-31T05:28:00.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:27:59 smithi073 ceph-mon[71452]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-08-31T05:28:00.910 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:00 smithi067 ceph-mon[99941]: pgmap v212: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 50/276 objects degraded (18.116%) 2024-08-31T05:28:00.910 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:00 smithi067 ceph-mon[99941]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-31T05:28:00.910 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:00 smithi067 ceph-mon[99941]: osd.3 [v2:172.21.15.73:6800/76055997,v1:172.21.15.73:6801/76055997] boot 2024-08-31T05:28:00.911 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:00 smithi067 ceph-mon[99941]: osdmap e79: 6 total, 6 up, 6 in 2024-08-31T05:28:00.911 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:28:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:00 smithi073 ceph-mon[71452]: pgmap v212: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 50/276 objects degraded (18.116%) 2024-08-31T05:28:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:00 smithi073 ceph-mon[71452]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-31T05:28:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:00 smithi073 ceph-mon[71452]: osd.3 [v2:172.21.15.73:6800/76055997,v1:172.21.15.73:6801/76055997] boot 2024-08-31T05:28:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:00 smithi073 ceph-mon[71452]: osdmap e79: 6 total, 6 up, 6 in 2024-08-31T05:28:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:28:02.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:01 smithi067 ceph-mon[99941]: osdmap e80: 6 total, 6 up, 6 in 2024-08-31T05:28:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:01 smithi073 ceph-mon[71452]: osdmap e80: 6 total, 6 up, 6 in 2024-08-31T05:28:03.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:02 smithi067 ceph-mon[99941]: pgmap v215: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 50/276 objects degraded (18.116%) 2024-08-31T05:28:03.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:02 smithi073 ceph-mon[71452]: pgmap v215: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 50/276 objects degraded (18.116%) 2024-08-31T05:28:04.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:03 smithi067 ceph-mon[99941]: pgmap v216: 65 pgs: 13 active+undersized, 13 active+undersized+degraded, 39 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 43/276 objects degraded (15.580%) 2024-08-31T05:28:04.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:03 smithi073 ceph-mon[71452]: pgmap v216: 65 pgs: 13 active+undersized, 13 active+undersized+degraded, 39 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 43/276 objects degraded (15.580%) 2024-08-31T05:28:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:04 smithi067 ceph-mon[99941]: Health check update: Degraded data redundancy: 43/276 objects degraded (15.580%), 13 pgs degraded (PG_DEGRADED) 2024-08-31T05:28:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:28:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:04 smithi073 ceph-mon[71452]: Health check update: Degraded data redundancy: 43/276 objects degraded (15.580%), 13 pgs degraded (PG_DEGRADED) 2024-08-31T05:28:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:28:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:05 smithi067 ceph-mon[99941]: pgmap v217: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 590 B/s rd, 1 op/s 2024-08-31T05:28:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:05 smithi073 ceph-mon[71452]: pgmap v217: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 590 B/s rd, 1 op/s 2024-08-31T05:28:07.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:06 smithi067 ceph-mon[99941]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/276 objects degraded (15.580%), 13 pgs degraded) 2024-08-31T05:28:07.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:06 smithi073 ceph-mon[71452]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/276 objects degraded (15.580%), 13 pgs degraded) 2024-08-31T05:28:08.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:07 smithi067 ceph-mon[99941]: pgmap v218: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-08-31T05:28:08.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:07 smithi073 ceph-mon[71452]: pgmap v218: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-08-31T05:28:10.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:10 smithi073 ceph-mon[71452]: pgmap v219: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 928 B/s rd, 1 op/s 2024-08-31T05:28:11.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:10 smithi067 ceph-mon[99941]: pgmap v219: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 928 B/s rd, 1 op/s 2024-08-31T05:28:12.035 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:11 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-08-31T05:28:12.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:11 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-08-31T05:28:13.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:12 smithi067 ceph-mon[99941]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-31T05:28:13.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:12 smithi067 ceph-mon[99941]: Upgrade: osd.4 is safe to restart 2024-08-31T05:28:13.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:12 smithi067 ceph-mon[99941]: pgmap v220: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 843 B/s rd, 1 op/s 2024-08-31T05:28:13.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:12 smithi073 ceph-mon[71452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-31T05:28:13.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:12 smithi073 ceph-mon[71452]: Upgrade: osd.4 is safe to restart 2024-08-31T05:28:13.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:12 smithi073 ceph-mon[71452]: pgmap v220: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 843 B/s rd, 1 op/s 2024-08-31T05:28:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:13 smithi067 ceph-mon[99941]: Upgrade: Updating osd.4 2024-08-31T05:28:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:13 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:13 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T05:28:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:13 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:28:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:13 smithi067 ceph-mon[99941]: Deploying daemon osd.4 on smithi073 2024-08-31T05:28:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:13 smithi067 ceph-mon[99941]: pgmap v221: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:28:14.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:13 smithi073 ceph-mon[71452]: Upgrade: Updating osd.4 2024-08-31T05:28:14.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:13 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:14.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:13 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T05:28:14.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:13 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:28:14.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:13 smithi073 ceph-mon[71452]: Deploying daemon osd.4 on smithi073 2024-08-31T05:28:14.329 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:13 smithi073 ceph-mon[71452]: pgmap v221: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:28:15.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:15 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:16.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:15 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:16.265 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:15 smithi073 systemd[1]: Stopping Ceph osd.4 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:28:16.265 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:16 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[37439]: 2024-08-31T05:28:16.240+0000 7f63b45e2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:28:16.265 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:16 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[37439]: 2024-08-31T05:28:16.240+0000 7f63b45e2640 -1 osd.4 80 *** Got signal Terminated *** 2024-08-31T05:28:16.266 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:16 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[37439]: 2024-08-31T05:28:16.240+0000 7f63b45e2640 -1 osd.4 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:28:16.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:16 smithi073 ceph-mon[71452]: pgmap v222: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:28:16.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:16 smithi073 ceph-mon[71452]: osd.4 marked itself down and dead 2024-08-31T05:28:17.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:16 smithi067 ceph-mon[99941]: pgmap v222: 65 pgs: 65 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:28:17.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:16 smithi067 ceph-mon[99941]: osd.4 marked itself down and dead 2024-08-31T05:28:17.545 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:17 smithi073 podman[84146]: 2024-08-31 05:28:17.241881262 +0000 UTC m=+1.101806817 container died 5b4c2fa3c7a3e055f74e2f83d5d32ecca91a3958428053a8a42d6e917c0166a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-244a32d, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-31T05:28:17.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:17 smithi073 ceph-mon[71452]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-31T05:28:17.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:17 smithi073 ceph-mon[71452]: osdmap e81: 6 total, 5 up, 6 in 2024-08-31T05:28:17.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:17 smithi073 podman[84146]: 2024-08-31 05:28:17.716963595 +0000 UTC m=+1.576889138 container cleanup 5b4c2fa3c7a3e055f74e2f83d5d32ecca91a3958428053a8a42d6e917c0166a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4, org.label-schema.vendor=CentOS, RELEASE=squid-244a32d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-08-31T05:28:17.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:17 smithi073 bash[84146]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4 2024-08-31T05:28:18.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:17 smithi067 ceph-mon[99941]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-31T05:28:18.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:17 smithi067 ceph-mon[99941]: osdmap e81: 6 total, 5 up, 6 in 2024-08-31T05:28:18.329 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:17 smithi073 podman[84164]: 2024-08-31 05:28:17.977654616 +0000 UTC m=+0.733457355 container remove 5b4c2fa3c7a3e055f74e2f83d5d32ecca91a3958428053a8a42d6e917c0166a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-244a32d, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-31T05:28:18.626 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:18 smithi073 podman[84252]: 2024-08-31 05:28:18.328522114 +0000 UTC m=+0.109651403 container create 89aeb8a71e79cb403dce99d790d00efaaf7682aac39945352237d2e35071351a (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:28:18.626 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:18 smithi073 podman[84252]: 2024-08-31 05:28:18.234585833 +0000 UTC m=+0.015715138 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:28:18.626 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:18 smithi073 podman[84252]: 2024-08-31 05:28:18.548352265 +0000 UTC m=+0.329481557 container init 89aeb8a71e79cb403dce99d790d00efaaf7682aac39945352237d2e35071351a (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-31T05:28:18.626 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:18 smithi073 podman[84252]: 2024-08-31 05:28:18.551625662 +0000 UTC m=+0.332754948 container start 89aeb8a71e79cb403dce99d790d00efaaf7682aac39945352237d2e35071351a (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD) 2024-08-31T05:28:18.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:18 smithi073 ceph-mon[71452]: pgmap v224: 65 pgs: 5 stale+active+clean, 60 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-08-31T05:28:18.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:18 smithi073 ceph-mon[71452]: osdmap e82: 6 total, 5 up, 6 in 2024-08-31T05:28:18.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:18 smithi073 podman[84252]: 2024-08-31 05:28:18.631717452 +0000 UTC m=+0.412846746 container attach 89aeb8a71e79cb403dce99d790d00efaaf7682aac39945352237d2e35071351a (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-31T05:28:18.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:18 smithi073 podman[84252]: 2024-08-31 05:28:18.759301335 +0000 UTC m=+0.540430623 container died 89aeb8a71e79cb403dce99d790d00efaaf7682aac39945352237d2e35071351a (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-08-31T05:28:19.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:18 smithi067 ceph-mon[99941]: pgmap v224: 65 pgs: 5 stale+active+clean, 60 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-08-31T05:28:19.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:18 smithi067 ceph-mon[99941]: osdmap e82: 6 total, 5 up, 6 in 2024-08-31T05:28:19.696 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:19 smithi073 podman[84275]: 2024-08-31 05:28:19.344216847 +0000 UTC m=+0.575424618 container remove 89aeb8a71e79cb403dce99d790d00efaaf7682aac39945352237d2e35071351a (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-31T05:28:19.696 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:19 smithi073 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.4.service: Deactivated successfully. 2024-08-31T05:28:19.696 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:19 smithi073 systemd[1]: Stopped Ceph osd.4 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:28:19.696 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:19 smithi073 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.4.service: Consumed 52.042s CPU time. 2024-08-31T05:28:19.696 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:19 smithi073 systemd[1]: Starting Ceph osd.4 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:28:20.082 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:19 smithi073 podman[84375]: 2024-08-31 05:28:19.69792016 +0000 UTC m=+0.015958940 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:28:20.082 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:19 smithi073 podman[84375]: 2024-08-31 05:28:19.828783346 +0000 UTC m=+0.146822168 container create a0a934d65e7dfb2b0b6ea5a520b87435491c6f6a85340589c3c2adce37087613 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-31T05:28:20.082 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 podman[84375]: 2024-08-31 05:28:20.081179154 +0000 UTC m=+0.399217934 container init a0a934d65e7dfb2b0b6ea5a520b87435491c6f6a85340589c3c2adce37087613 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.278+0000 7f9459c3c640 1 -- 172.21.15.67:0/522768422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94541005b0 msgr2=0x7f9454100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.278+0000 7f9459c3c640 1 --2- 172.21.15.67:0/522768422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94541005b0 0x7f9454100a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f943c009880 tx=0x7f943c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.278+0000 7f9459c3c640 1 -- 172.21.15.67:0/522768422 shutdown_connections 2024-08-31T05:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.278+0000 7f9459c3c640 1 --2- 172.21.15.67:0/522768422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94541005b0 0x7f9454100a10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.278+0000 7f9459c3c640 1 --2- 172.21.15.67:0/522768422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9454106660 0x7f9454106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.278+0000 7f9459c3c640 1 -- 172.21.15.67:0/522768422 >> 172.21.15.67:0/522768422 conn(0x7f94540fc2f0 msgr2=0x7f94540fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.278+0000 7f9459c3c640 1 -- 172.21.15.67:0/522768422 shutdown_connections 2024-08-31T05:28:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.278+0000 7f9459c3c640 1 -- 172.21.15.67:0/522768422 wait complete. 2024-08-31T05:28:20.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.279+0000 7f9459c3c640 1 Processor -- start 2024-08-31T05:28:20.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.279+0000 7f9459c3c640 1 -- start start 2024-08-31T05:28:20.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.279+0000 7f9459c3c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94541005b0 0x7f9454198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:20.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.279+0000 7f9459c3c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9454106660 0x7f9454198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.279+0000 7f9459c3c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f945410da70 con 0x7f9454106660 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.279+0000 7f9459c3c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f945410d8f0 con 0x7f94541005b0 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.279+0000 7f9452ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9454106660 0x7f9454198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.280+0000 7f9452ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9454106660 0x7f9454198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33658/0 (socket says 172.21.15.67:33658) 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.280+0000 7f9452ffd640 1 -- 172.21.15.67:0/2396226490 learned_addr learned my addr 172.21.15.67:0/2396226490 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.280+0000 7f94537fe640 1 --2- 172.21.15.67:0/2396226490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94541005b0 0x7f9454198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.280+0000 7f9452ffd640 1 -- 172.21.15.67:0/2396226490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94541005b0 msgr2=0x7f9454198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.280+0000 7f9452ffd640 1 --2- 172.21.15.67:0/2396226490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94541005b0 0x7f9454198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.280+0000 7f9452ffd640 1 -- 172.21.15.67:0/2396226490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9454199060 con 0x7f9454106660 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.280+0000 7f9452ffd640 1 --2- 172.21.15.67:0/2396226490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9454106660 0x7f9454198a60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f943c004f90 tx=0x7f943c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.280+0000 7f9450ff9640 1 -- 172.21.15.67:0/2396226490 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f943c03f070 con 0x7f9454106660 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.280+0000 7f9459c3c640 1 -- 172.21.15.67:0/2396226490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94541992f0 con 0x7f9454106660 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.280+0000 7f9450ff9640 1 -- 172.21.15.67:0/2396226490 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f943c004ac0 con 0x7f9454106660 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.280+0000 7f9450ff9640 1 -- 172.21.15.67:0/2396226490 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f943c035030 con 0x7f9454106660 2024-08-31T05:28:20.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.280+0000 7f9459c3c640 1 -- 172.21.15.67:0/2396226490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94541a18a0 con 0x7f9454106660 2024-08-31T05:28:20.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.282+0000 7f9459c3c640 1 -- 172.21.15.67:0/2396226490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9454101cd0 con 0x7f9454106660 2024-08-31T05:28:20.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.282+0000 7f9450ff9640 1 -- 172.21.15.67:0/2396226490 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f943c042070 con 0x7f9454106660 2024-08-31T05:28:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.283+0000 7f9450ff9640 1 --2- 172.21.15.67:0/2396226490 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9440079e00 0x7f944007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.283+0000 7f9450ff9640 1 -- 172.21.15.67:0/2396226490 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6216+0+0 (secure 0 0 0) 0x7f943c0bd280 con 0x7f9454106660 2024-08-31T05:28:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.283+0000 7f94537fe640 1 --2- 172.21.15.67:0/2396226490 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9440079e00 0x7f944007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.284+0000 7f94537fe640 1 --2- 172.21.15.67:0/2396226490 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9440079e00 0x7f944007c2c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9444009bd0 tx=0x7f9444005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:20.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.288+0000 7f9450ff9640 1 -- 172.21.15.67:0/2396226490 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f943c088e70 con 0x7f9454106660 2024-08-31T05:28:20.369 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 podman[84375]: 2024-08-31 05:28:20.08453106 +0000 UTC m=+0.402569831 container start a0a934d65e7dfb2b0b6ea5a520b87435491c6f6a85340589c3c2adce37087613 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_BRANCH=HEAD) 2024-08-31T05:28:20.370 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 podman[84375]: 2024-08-31 05:28:20.198454428 +0000 UTC m=+0.516493193 container attach a0a934d65e7dfb2b0b6ea5a520b87435491c6f6a85340589c3c2adce37087613 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-31T05:28:20.370 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate[84390]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:20.370 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 bash[84375]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:20.370 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate[84390]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:20.370 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 bash[84375]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:20.370 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate[84390]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-31T05:28:20.370 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 bash[84375]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-31T05:28:20.370 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate[84390]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:20.370 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 bash[84375]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:20.370 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate[84390]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:20.370 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 bash[84375]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:20.370 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate[84390]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-31T05:28:20.370 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 bash[84375]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-31T05:28:20.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.494+0000 7f9459c3c640 1 -- 172.21.15.67:0/2396226490 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f94540623d0 con 0x7f9440079e00 2024-08-31T05:28:20.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.495+0000 7f9450ff9640 1 -- 172.21.15.67:0/2396226490 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f94540623d0 con 0x7f9440079e00 2024-08-31T05:28:20.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.497+0000 7f9459c3c640 1 -- 172.21.15.67:0/2396226490 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9440079e00 msgr2=0x7f944007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.497+0000 7f9459c3c640 1 --2- 172.21.15.67:0/2396226490 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9440079e00 0x7f944007c2c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9444009bd0 tx=0x7f9444005f90 comp rx=0 tx=0).stop 2024-08-31T05:28:20.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.497+0000 7f9459c3c640 1 -- 172.21.15.67:0/2396226490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9454106660 msgr2=0x7f9454198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.497+0000 7f9459c3c640 1 --2- 172.21.15.67:0/2396226490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9454106660 0x7f9454198a60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f943c004f90 tx=0x7f943c0046c0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.497+0000 7f9459c3c640 1 -- 172.21.15.67:0/2396226490 shutdown_connections 2024-08-31T05:28:20.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.497+0000 7f9459c3c640 1 --2- 172.21.15.67:0/2396226490 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9440079e00 0x7f944007c2c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.497+0000 7f9459c3c640 1 --2- 172.21.15.67:0/2396226490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9454106660 0x7f9454198a60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.497+0000 7f9459c3c640 1 --2- 172.21.15.67:0/2396226490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94541005b0 0x7f9454198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.497+0000 7f9459c3c640 1 -- 172.21.15.67:0/2396226490 >> 172.21.15.67:0/2396226490 conn(0x7f94540fc2f0 msgr2=0x7f94540fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:20.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.497+0000 7f9459c3c640 1 -- 172.21.15.67:0/2396226490 shutdown_connections 2024-08-31T05:28:20.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.498+0000 7f9459c3c640 1 -- 172.21.15.67:0/2396226490 wait complete. 2024-08-31T05:28:20.508 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:28:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.582+0000 7f6a87085640 1 -- 172.21.15.67:0/1035549632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a801076a0 msgr2=0x7f6a80107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.582+0000 7f6a87085640 1 --2- 172.21.15.67:0/1035549632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a801076a0 0x7f6a80107a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009880 tx=0x7f6a7402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.582+0000 7f6a87085640 1 -- 172.21.15.67:0/1035549632 shutdown_connections 2024-08-31T05:28:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.582+0000 7f6a87085640 1 --2- 172.21.15.67:0/1035549632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a801016a0 0x7f6a80101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.582+0000 7f6a87085640 1 --2- 172.21.15.67:0/1035549632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a801076a0 0x7f6a80107a80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.582+0000 7f6a87085640 1 -- 172.21.15.67:0/1035549632 >> 172.21.15.67:0/1035549632 conn(0x7f6a800fd380 msgr2=0x7f6a800ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.582+0000 7f6a87085640 1 -- 172.21.15.67:0/1035549632 shutdown_connections 2024-08-31T05:28:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.582+0000 7f6a87085640 1 -- 172.21.15.67:0/1035549632 wait complete. 2024-08-31T05:28:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.582+0000 7f6a87085640 1 Processor -- start 2024-08-31T05:28:20.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.583+0000 7f6a87085640 1 -- start start 2024-08-31T05:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.583+0000 7f6a87085640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a801016a0 0x7f6a80197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.583+0000 7f6a87085640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a801076a0 0x7f6a80197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.583+0000 7f6a87085640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8010eb50 con 0x7f6a801076a0 2024-08-31T05:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.583+0000 7f6a87085640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8010e9d0 con 0x7f6a801016a0 2024-08-31T05:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.583+0000 7f6a7ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a801076a0 0x7f6a80197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.583+0000 7f6a7ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a801076a0 0x7f6a80197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33674/0 (socket says 172.21.15.67:33674) 2024-08-31T05:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.583+0000 7f6a7ffff640 1 -- 172.21.15.67:0/1102601656 learned_addr learned my addr 172.21.15.67:0/1102601656 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.583+0000 7f6a84e21640 1 --2- 172.21.15.67:0/1102601656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a801016a0 0x7f6a80197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.583+0000 7f6a7ffff640 1 -- 172.21.15.67:0/1102601656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a801016a0 msgr2=0x7f6a80197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.583+0000 7f6a7ffff640 1 --2- 172.21.15.67:0/1102601656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a801016a0 0x7f6a80197740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.583+0000 7f6a7ffff640 1 -- 172.21.15.67:0/1102601656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a80198330 con 0x7f6a801076a0 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.583+0000 7f6a7ffff640 1 --2- 172.21.15.67:0/1102601656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a801076a0 0x7f6a80197c80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00c8a0 tx=0x7f6a6c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.584+0000 7f6a7dffb640 1 -- 172.21.15.67:0/1102601656 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a6c0079b0 con 0x7f6a801076a0 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.584+0000 7f6a87085640 1 -- 172.21.15.67:0/1102601656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a8019c0d0 con 0x7f6a801076a0 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.584+0000 7f6a7dffb640 1 -- 172.21.15.67:0/1102601656 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a6c007b50 con 0x7f6a801076a0 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.584+0000 7f6a7dffb640 1 -- 172.21.15.67:0/1102601656 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a6c018700 con 0x7f6a801076a0 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.584+0000 7f6a87085640 1 -- 172.21.15.67:0/1102601656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a8019c660 con 0x7f6a801076a0 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.585+0000 7f6a87085640 1 -- 172.21.15.67:0/1102601656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a80102de0 con 0x7f6a801076a0 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.585+0000 7f6a7dffb640 1 -- 172.21.15.67:0/1102601656 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f6a6c007d00 con 0x7f6a801076a0 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.586+0000 7f6a7dffb640 1 --2- 172.21.15.67:0/1102601656 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a70079e40 0x7f6a7007c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.586+0000 7f6a7dffb640 1 -- 172.21.15.67:0/1102601656 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6216+0+0 (secure 0 0 0) 0x7f6a6c09caf0 con 0x7f6a801076a0 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.586+0000 7f6a84e21640 1 --2- 172.21.15.67:0/1102601656 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a70079e40 0x7f6a7007c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:20.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.587+0000 7f6a84e21640 1 --2- 172.21.15.67:0/1102601656 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a70079e40 0x7f6a7007c300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a74000c00 tx=0x7f6a74031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:20.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.591+0000 7f6a7dffb640 1 -- 172.21.15.67:0/1102601656 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6a6c014030 con 0x7f6a801076a0 2024-08-31T05:28:20.623 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate[84390]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-08-31T05:28:20.623 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 bash[84375]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-08-31T05:28:20.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.793+0000 7f6a87085640 1 -- 172.21.15.67:0/1102601656 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6a801048e0 con 0x7f6a70079e40 2024-08-31T05:28:20.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.795+0000 7f6a7dffb640 1 -- 172.21.15.67:0/1102601656 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f6a801048e0 con 0x7f6a70079e40 2024-08-31T05:28:20.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.797+0000 7f6a87085640 1 -- 172.21.15.67:0/1102601656 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a70079e40 msgr2=0x7f6a7007c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.797+0000 7f6a87085640 1 --2- 172.21.15.67:0/1102601656 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a70079e40 0x7f6a7007c300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a74000c00 tx=0x7f6a74031400 comp rx=0 tx=0).stop 2024-08-31T05:28:20.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.797+0000 7f6a87085640 1 -- 172.21.15.67:0/1102601656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a801076a0 msgr2=0x7f6a80197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.797+0000 7f6a87085640 1 --2- 172.21.15.67:0/1102601656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a801076a0 0x7f6a80197c80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00c8a0 tx=0x7f6a6c00cd60 comp rx=0 tx=0).stop 2024-08-31T05:28:20.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.797+0000 7f6a87085640 1 -- 172.21.15.67:0/1102601656 shutdown_connections 2024-08-31T05:28:20.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.797+0000 7f6a87085640 1 --2- 172.21.15.67:0/1102601656 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a70079e40 0x7f6a7007c300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.797+0000 7f6a87085640 1 --2- 172.21.15.67:0/1102601656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a801076a0 0x7f6a80197c80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.797+0000 7f6a87085640 1 --2- 172.21.15.67:0/1102601656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a801016a0 0x7f6a80197740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.797+0000 7f6a87085640 1 -- 172.21.15.67:0/1102601656 >> 172.21.15.67:0/1102601656 conn(0x7f6a800fd380 msgr2=0x7f6a800fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:20.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.797+0000 7f6a87085640 1 -- 172.21.15.67:0/1102601656 shutdown_connections 2024-08-31T05:28:20.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.797+0000 7f6a87085640 1 -- 172.21.15.67:0/1102601656 wait complete. 2024-08-31T05:28:20.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.880+0000 7f16dac42640 1 -- 172.21.15.67:0/1362279008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16d41016a0 msgr2=0x7f16d4101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.880+0000 7f16dac42640 1 --2- 172.21.15.67:0/1362279008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16d41016a0 0x7f16d4101b00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009880 tx=0x7f16c002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.880+0000 7f16dac42640 1 -- 172.21.15.67:0/1362279008 shutdown_connections 2024-08-31T05:28:20.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.881+0000 7f16dac42640 1 --2- 172.21.15.67:0/1362279008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16d41016a0 0x7f16d4101b00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.881+0000 7f16dac42640 1 --2- 172.21.15.67:0/1362279008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d41076a0 0x7f16d4107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.881+0000 7f16dac42640 1 -- 172.21.15.67:0/1362279008 >> 172.21.15.67:0/1362279008 conn(0x7f16d40fd3a0 msgr2=0x7f16d40ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:20.883 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:20.883 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:28:20.883 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:20 smithi067 ceph-mon[99941]: pgmap v226: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-08-31T05:28:20.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.881+0000 7f16dac42640 1 -- 172.21.15.67:0/1362279008 shutdown_connections 2024-08-31T05:28:20.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.881+0000 7f16dac42640 1 -- 172.21.15.67:0/1362279008 wait complete. 2024-08-31T05:28:20.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.881+0000 7f16dac42640 1 Processor -- start 2024-08-31T05:28:20.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.881+0000 7f16dac42640 1 -- start start 2024-08-31T05:28:20.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.882+0000 7f16dac42640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d41016a0 0x7f16d4074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:20.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.882+0000 7f16dac42640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16d41076a0 0x7f16d40747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:20.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.882+0000 7f16dac42640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f16d410eb50 con 0x7f16d41076a0 2024-08-31T05:28:20.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.882+0000 7f16dac42640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f16d410e9d0 con 0x7f16d41016a0 2024-08-31T05:28:20.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.882+0000 7f16d3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16d41076a0 0x7f16d40747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:20.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.882+0000 7f16d3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16d41076a0 0x7f16d40747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33686/0 (socket says 172.21.15.67:33686) 2024-08-31T05:28:20.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.882+0000 7f16d3fff640 1 -- 172.21.15.67:0/1009602922 learned_addr learned my addr 172.21.15.67:0/1009602922 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:28:20.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.882+0000 7f16d89de640 1 --2- 172.21.15.67:0/1009602922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d41016a0 0x7f16d4074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:20.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.882+0000 7f16d3fff640 1 -- 172.21.15.67:0/1009602922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d41016a0 msgr2=0x7f16d4074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.882+0000 7f16d3fff640 1 --2- 172.21.15.67:0/1009602922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d41016a0 0x7f16d4074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.882+0000 7f16d3fff640 1 -- 172.21.15.67:0/1009602922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d4074d10 con 0x7f16d41076a0 2024-08-31T05:28:20.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.883+0000 7f16d3fff640 1 --2- 172.21.15.67:0/1009602922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16d41076a0 0x7f16d40747d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f16c0031460 tx=0x7f16c00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:20.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.883+0000 7f16d1ffb640 1 -- 172.21.15.67:0/1009602922 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16c003f070 con 0x7f16d41076a0 2024-08-31T05:28:20.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.883+0000 7f16d1ffb640 1 -- 172.21.15.67:0/1009602922 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f16c0004cf0 con 0x7f16d41076a0 2024-08-31T05:28:20.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.883+0000 7f16d1ffb640 1 -- 172.21.15.67:0/1009602922 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16c0035030 con 0x7f16d41076a0 2024-08-31T05:28:20.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.883+0000 7f16dac42640 1 -- 172.21.15.67:0/1009602922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d4074fa0 con 0x7f16d41076a0 2024-08-31T05:28:20.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.883+0000 7f16dac42640 1 -- 172.21.15.67:0/1009602922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d41a3b60 con 0x7f16d41076a0 2024-08-31T05:28:20.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.884+0000 7f16dac42640 1 -- 172.21.15.67:0/1009602922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16d4102de0 con 0x7f16d41076a0 2024-08-31T05:28:20.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.885+0000 7f16d1ffb640 1 -- 172.21.15.67:0/1009602922 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f16c0042070 con 0x7f16d41076a0 2024-08-31T05:28:20.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.885+0000 7f16d1ffb640 1 --2- 172.21.15.67:0/1009602922 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f16c4079e40 0x7f16c407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:20.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.885+0000 7f16d1ffb640 1 -- 172.21.15.67:0/1009602922 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6216+0+0 (secure 0 0 0) 0x7f16c00bd290 con 0x7f16d41076a0 2024-08-31T05:28:20.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.885+0000 7f16d89de640 1 --2- 172.21.15.67:0/1009602922 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f16c4079e40 0x7f16c407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:20.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.886+0000 7f16d89de640 1 --2- 172.21.15.67:0/1009602922 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f16c4079e40 0x7f16c407c300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f16c80058c0 tx=0x7f16c800a2d0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:20.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:20.890+0000 7f16d1ffb640 1 -- 172.21.15.67:0/1009602922 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f16c0088f00 con 0x7f16d41076a0 2024-08-31T05:28:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:28:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-mon[71452]: pgmap v226: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-08-31T05:28:20.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate[84390]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-08-31T05:28:20.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 bash[84375]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-08-31T05:28:20.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate[84390]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-08-31T05:28:20.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 bash[84375]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-08-31T05:28:20.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate[84390]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-31T05:28:20.947 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 bash[84375]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-31T05:28:20.947 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate[84390]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-31T05:28:20.947 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 bash[84375]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-31T05:28:20.947 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate[84390]: --> ceph-volume lvm activate successful for osd ID: 4 2024-08-31T05:28:20.947 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 bash[84375]: --> ceph-volume lvm activate successful for osd ID: 4 2024-08-31T05:28:20.947 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:20 smithi073 podman[84375]: 2024-08-31 05:28:20.695295049 +0000 UTC m=+1.013333813 container died a0a934d65e7dfb2b0b6ea5a520b87435491c6f6a85340589c3c2adce37087613 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-31T05:28:21.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.081+0000 7f16dac42640 1 -- 172.21.15.67:0/1009602922 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f16d40623d0 con 0x7f16c4079e40 2024-08-31T05:28:21.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.091+0000 7f16d1ffb640 1 -- 172.21.15.67:0/1009602922 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f16d40623d0 con 0x7f16c4079e40 2024-08-31T05:28:21.093 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:28:21.093 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (4m) 60s ago 15m 20.7M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:28:21.093 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (7m) 60s ago 15m 9021k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:28:21.093 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (6m) 28s ago 14m 8544k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:28:21.093 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (2m) 60s ago 15m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 910f4f105c4b 2024-08-31T05:28:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (2m) 28s ago 14m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 0dcc86f98a20 2024-08-31T05:28:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (4m) 60s ago 14m 77.9M - c8b91775d855 3a9a0f88928d 2024-08-31T05:28:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (9m) 60s ago 9m 92.0M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:28:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (9m) 60s ago 9m 155M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:28:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (9m) 28s ago 9m 16.9M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:28:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (9m) 28s ago 9m 18.9M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:28:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (6m) 60s ago 16m 591M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:28:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (5m) 28s ago 14m 525M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:28:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (3m) 60s ago 16m 109M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 25a28efbbd37 2024-08-31T05:28:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (2m) 28s ago 14m 103M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 6be0f0999860 2024-08-31T05:28:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (5m) 60s ago 15m 10.2M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:28:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (5m) 28s ago 14m 10.6M - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:28:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (2m) 60s ago 13m 207M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 aab0516dcbfa 2024-08-31T05:28:21.094 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (101s) 60s ago 12m 152M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 fa9e3fb20c5e 2024-08-31T05:28:21.095 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (66s) 60s ago 12m 79.4M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 a62abe735da2 2024-08-31T05:28:21.095 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (31s) 28s ago 11m 80.3M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 9f4ce308ec1d 2024-08-31T05:28:21.095 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (11m) 28s ago 11m 226M 2240M 19.1.1-242-g244a32d3 395b9209a980 5b4c2fa3c7a3 2024-08-31T05:28:21.095 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (10m) 28s ago 10m 204M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:28:21.095 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (4m) 60s ago 14m 55.7M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:28:21.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.093+0000 7f16dac42640 1 -- 172.21.15.67:0/1009602922 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f16c4079e40 msgr2=0x7f16c407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:21.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.093+0000 7f16dac42640 1 --2- 172.21.15.67:0/1009602922 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f16c4079e40 0x7f16c407c300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f16c80058c0 tx=0x7f16c800a2d0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.093+0000 7f16dac42640 1 -- 172.21.15.67:0/1009602922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16d41076a0 msgr2=0x7f16d40747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:21.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.093+0000 7f16dac42640 1 --2- 172.21.15.67:0/1009602922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16d41076a0 0x7f16d40747d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f16c0031460 tx=0x7f16c00048f0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.093+0000 7f16dac42640 1 -- 172.21.15.67:0/1009602922 shutdown_connections 2024-08-31T05:28:21.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.093+0000 7f16dac42640 1 --2- 172.21.15.67:0/1009602922 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f16c4079e40 0x7f16c407c300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.093+0000 7f16dac42640 1 --2- 172.21.15.67:0/1009602922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16d41076a0 0x7f16d40747d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.093+0000 7f16dac42640 1 --2- 172.21.15.67:0/1009602922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16d41016a0 0x7f16d4074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.093+0000 7f16dac42640 1 -- 172.21.15.67:0/1009602922 >> 172.21.15.67:0/1009602922 conn(0x7f16d40fd3a0 msgr2=0x7f16d40fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:21.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.094+0000 7f16dac42640 1 -- 172.21.15.67:0/1009602922 shutdown_connections 2024-08-31T05:28:21.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.094+0000 7f16dac42640 1 -- 172.21.15.67:0/1009602922 wait complete. 2024-08-31T05:28:21.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.177+0000 7fa402fa0640 1 -- 172.21.15.67:0/1613452104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc1026f0 msgr2=0x7fa3fc102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:21.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.177+0000 7fa402fa0640 1 --2- 172.21.15.67:0/1613452104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc1026f0 0x7fa3fc102ad0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec009c20 tx=0x7fa3ec02aa00 comp rx=0 tx=0).stop 2024-08-31T05:28:21.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.177+0000 7fa402fa0640 1 -- 172.21.15.67:0/1613452104 shutdown_connections 2024-08-31T05:28:21.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.177+0000 7fa402fa0640 1 --2- 172.21.15.67:0/1613452104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3fc103010 0x7fa3fc10b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.177+0000 7fa402fa0640 1 --2- 172.21.15.67:0/1613452104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc1026f0 0x7fa3fc102ad0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.177+0000 7fa402fa0640 1 -- 172.21.15.67:0/1613452104 >> 172.21.15.67:0/1613452104 conn(0x7fa3fc0fc0b0 msgr2=0x7fa3fc0fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:21.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.178+0000 7fa402fa0640 1 -- 172.21.15.67:0/1613452104 shutdown_connections 2024-08-31T05:28:21.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.178+0000 7fa402fa0640 1 -- 172.21.15.67:0/1613452104 wait complete. 2024-08-31T05:28:21.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.178+0000 7fa402fa0640 1 Processor -- start 2024-08-31T05:28:21.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.178+0000 7fa402fa0640 1 -- start start 2024-08-31T05:28:21.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.179+0000 7fa402fa0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3fc1026f0 0x7fa3fc197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:21.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.179+0000 7fa402fa0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc103010 0x7fa3fc197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:21.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.179+0000 7fa402fa0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc10ea00 con 0x7fa3fc103010 2024-08-31T05:28:21.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.179+0000 7fa402fa0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc10e880 con 0x7fa3fc1026f0 2024-08-31T05:28:21.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.179+0000 7fa40179d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc103010 0x7fa3fc197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:21.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.179+0000 7fa40179d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc103010 0x7fa3fc197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33704/0 (socket says 172.21.15.67:33704) 2024-08-31T05:28:21.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.179+0000 7fa40179d640 1 -- 172.21.15.67:0/2338022059 learned_addr learned my addr 172.21.15.67:0/2338022059 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:28:21.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.179+0000 7fa401f9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3fc1026f0 0x7fa3fc197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:21.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.179+0000 7fa40179d640 1 -- 172.21.15.67:0/2338022059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3fc1026f0 msgr2=0x7fa3fc197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:21.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.179+0000 7fa40179d640 1 --2- 172.21.15.67:0/2338022059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3fc1026f0 0x7fa3fc197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.179+0000 7fa40179d640 1 -- 172.21.15.67:0/2338022059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3fc19bf10 con 0x7fa3fc103010 2024-08-31T05:28:21.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.179+0000 7fa40179d640 1 --2- 172.21.15.67:0/2338022059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc103010 0x7fa3fc197b80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000b420 tx=0x7fa3f000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:21.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.180+0000 7fa3faffd640 1 -- 172.21.15.67:0/2338022059 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3f0011630 con 0x7fa3fc103010 2024-08-31T05:28:21.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.180+0000 7fa3faffd640 1 -- 172.21.15.67:0/2338022059 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa3f0016070 con 0x7fa3fc103010 2024-08-31T05:28:21.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.180+0000 7fa402fa0640 1 -- 172.21.15.67:0/2338022059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3fc19c200 con 0x7fa3fc103010 2024-08-31T05:28:21.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.180+0000 7fa3faffd640 1 -- 172.21.15.67:0/2338022059 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3f0010d40 con 0x7fa3fc103010 2024-08-31T05:28:21.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.180+0000 7fa402fa0640 1 -- 172.21.15.67:0/2338022059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3fc19c790 con 0x7fa3fc103010 2024-08-31T05:28:21.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.181+0000 7fa402fa0640 1 -- 172.21.15.67:0/2338022059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3fc06a2a0 con 0x7fa3fc103010 2024-08-31T05:28:21.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.182+0000 7fa3faffd640 1 -- 172.21.15.67:0/2338022059 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fa3f001b460 con 0x7fa3fc103010 2024-08-31T05:28:21.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.182+0000 7fa3faffd640 1 --2- 172.21.15.67:0/2338022059 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa3e4079e40 0x7fa3e407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:21.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.183+0000 7fa401f9e640 1 --2- 172.21.15.67:0/2338022059 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa3e4079e40 0x7fa3e407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:21.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.183+0000 7fa3faffd640 1 -- 172.21.15.67:0/2338022059 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6216+0+0 (secure 0 0 0) 0x7fa3f009bfc0 con 0x7fa3fc103010 2024-08-31T05:28:21.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.183+0000 7fa401f9e640 1 --2- 172.21.15.67:0/2338022059 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa3e4079e40 0x7fa3e407c300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec009430 tx=0x7fa3ec03a040 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:21.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.187+0000 7fa3faffd640 1 -- 172.21.15.67:0/2338022059 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa3f0063ac0 con 0x7fa3fc103010 2024-08-31T05:28:21.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.444+0000 7fa402fa0640 1 -- 172.21.15.67:0/2338022059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa3fc1989a0 con 0x7fa3fc103010 2024-08-31T05:28:21.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.445+0000 7fa3faffd640 1 -- 172.21.15.67:0/2338022059 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fa3f0067c30 con 0x7fa3fc103010 2024-08-31T05:28:21.447 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:28:21.447 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:28:21.447 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:28:21.447 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:28:21.447 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:28:21.447 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:28:21.447 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:28:21.447 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:28:21.447 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 1, 2024-08-31T05:28:21.447 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 4 2024-08-31T05:28:21.447 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:28:21.447 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:28:21.448 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:28:21.448 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:28:21.448 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:28:21.448 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 5, 2024-08-31T05:28:21.448 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 8 2024-08-31T05:28:21.448 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:28:21.448 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:28:21.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.447+0000 7fa402fa0640 1 -- 172.21.15.67:0/2338022059 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa3e4079e40 msgr2=0x7fa3e407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:21.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.447+0000 7fa402fa0640 1 --2- 172.21.15.67:0/2338022059 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa3e4079e40 0x7fa3e407c300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec009430 tx=0x7fa3ec03a040 comp rx=0 tx=0).stop 2024-08-31T05:28:21.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.447+0000 7fa402fa0640 1 -- 172.21.15.67:0/2338022059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc103010 msgr2=0x7fa3fc197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:21.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.447+0000 7fa402fa0640 1 --2- 172.21.15.67:0/2338022059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc103010 0x7fa3fc197b80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000b420 tx=0x7fa3f000b8e0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.447+0000 7fa402fa0640 1 -- 172.21.15.67:0/2338022059 shutdown_connections 2024-08-31T05:28:21.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.447+0000 7fa402fa0640 1 --2- 172.21.15.67:0/2338022059 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa3e4079e40 0x7fa3e407c300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.447+0000 7fa402fa0640 1 --2- 172.21.15.67:0/2338022059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3fc103010 0x7fa3fc197b80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.447+0000 7fa402fa0640 1 --2- 172.21.15.67:0/2338022059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3fc1026f0 0x7fa3fc197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.447+0000 7fa402fa0640 1 -- 172.21.15.67:0/2338022059 >> 172.21.15.67:0/2338022059 conn(0x7fa3fc0fc0b0 msgr2=0x7fa3fc103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:21.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.447+0000 7fa402fa0640 1 -- 172.21.15.67:0/2338022059 shutdown_connections 2024-08-31T05:28:21.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.447+0000 7fa402fa0640 1 -- 172.21.15.67:0/2338022059 wait complete. 2024-08-31T05:28:21.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.531+0000 7fd085e59640 1 -- 172.21.15.67:0/4061755839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0801005b0 msgr2=0x7fd080100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:21.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.531+0000 7fd085e59640 1 --2- 172.21.15.67:0/4061755839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0801005b0 0x7fd080100a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd068009880 tx=0x7fd06802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.531+0000 7fd085e59640 1 -- 172.21.15.67:0/4061755839 shutdown_connections 2024-08-31T05:28:21.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.531+0000 7fd085e59640 1 --2- 172.21.15.67:0/4061755839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0801005b0 0x7fd080100a10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.531+0000 7fd085e59640 1 --2- 172.21.15.67:0/4061755839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd080106660 0x7fd080106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.531+0000 7fd085e59640 1 -- 172.21.15.67:0/4061755839 >> 172.21.15.67:0/4061755839 conn(0x7fd0800fc2f0 msgr2=0x7fd0800fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:21.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.531+0000 7fd085e59640 1 -- 172.21.15.67:0/4061755839 shutdown_connections 2024-08-31T05:28:21.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.531+0000 7fd085e59640 1 -- 172.21.15.67:0/4061755839 wait complete. 2024-08-31T05:28:21.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.532+0000 7fd085e59640 1 Processor -- start 2024-08-31T05:28:21.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.532+0000 7fd085e59640 1 -- start start 2024-08-31T05:28:21.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.532+0000 7fd085e59640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0801005b0 0x7fd08019f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:21.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.532+0000 7fd085e59640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd080106660 0x7fd08019fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:21.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.532+0000 7fd085e59640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd08010da70 con 0x7fd0801005b0 2024-08-31T05:28:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.532+0000 7fd085e59640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd08010d8f0 con 0x7fd080106660 2024-08-31T05:28:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.532+0000 7fd07f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0801005b0 0x7fd08019f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.532+0000 7fd07f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0801005b0 0x7fd08019f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33732/0 (socket says 172.21.15.67:33732) 2024-08-31T05:28:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.532+0000 7fd07f7fe640 1 -- 172.21.15.67:0/152627417 learned_addr learned my addr 172.21.15.67:0/152627417 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:28:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.532+0000 7fd076ffd640 1 --2- 172.21.15.67:0/152627417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd080106660 0x7fd08019fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.533+0000 7fd07f7fe640 1 -- 172.21.15.67:0/152627417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd080106660 msgr2=0x7fd08019fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.533+0000 7fd07f7fe640 1 --2- 172.21.15.67:0/152627417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd080106660 0x7fd08019fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.533+0000 7fd07f7fe640 1 -- 172.21.15.67:0/152627417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0801996e0 con 0x7fd0801005b0 2024-08-31T05:28:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.533+0000 7fd07f7fe640 1 --2- 172.21.15.67:0/152627417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0801005b0 0x7fd08019f610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd07000e970 tx=0x7fd07000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.533+0000 7fd07d7fa640 1 -- 172.21.15.67:0/152627417 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd07000cac0 con 0x7fd0801005b0 2024-08-31T05:28:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.533+0000 7fd085e59640 1 -- 172.21.15.67:0/152627417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0801999d0 con 0x7fd0801005b0 2024-08-31T05:28:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.533+0000 7fd07d7fa640 1 -- 172.21.15.67:0/152627417 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd0700054e0 con 0x7fd0801005b0 2024-08-31T05:28:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.533+0000 7fd07d7fa640 1 -- 172.21.15.67:0/152627417 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd070010430 con 0x7fd0801005b0 2024-08-31T05:28:21.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.533+0000 7fd085e59640 1 -- 172.21.15.67:0/152627417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd080199f30 con 0x7fd0801005b0 2024-08-31T05:28:21.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.534+0000 7fd085e59640 1 -- 172.21.15.67:0/152627417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd080101cd0 con 0x7fd0801005b0 2024-08-31T05:28:21.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.535+0000 7fd07d7fa640 1 -- 172.21.15.67:0/152627417 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fd070004ec0 con 0x7fd0801005b0 2024-08-31T05:28:21.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.535+0000 7fd07d7fa640 1 --2- 172.21.15.67:0/152627417 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd06c079e00 0x7fd06c07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:21.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.535+0000 7fd07d7fa640 1 -- 172.21.15.67:0/152627417 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6216+0+0 (secure 0 0 0) 0x7fd07009d0c0 con 0x7fd0801005b0 2024-08-31T05:28:21.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.536+0000 7fd076ffd640 1 --2- 172.21.15.67:0/152627417 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd06c079e00 0x7fd06c07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:21.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.536+0000 7fd076ffd640 1 --2- 172.21.15.67:0/152627417 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd06c079e00 0x7fd06c07c2c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd08019af30 tx=0x7fd068004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.540+0000 7fd07d7fa640 1 -- 172.21.15.67:0/152627417 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd070064b40 con 0x7fd0801005b0 2024-08-31T05:28:21.624 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:21 smithi073 podman[84517]: 2024-08-31 05:28:21.311035539 +0000 UTC m=+0.604386035 container remove a0a934d65e7dfb2b0b6ea5a520b87435491c6f6a85340589c3c2adce37087613 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-08-31T05:28:21.625 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:21 smithi073 podman[84574]: 2024-08-31 05:28:21.42020164 +0000 UTC m=+0.015689912 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:28:21.625 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:21 smithi073 podman[84574]: 2024-08-31 05:28:21.520277569 +0000 UTC m=+0.115765886 container create 5f02556c012ddb8fa371a9b907eaaca66b278cdd77dc2f15df356bcb96fcab5a (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-31T05:28:21.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.768+0000 7fd085e59640 1 -- 172.21.15.67:0/152627417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd08019a240 con 0x7fd0801005b0 2024-08-31T05:28:21.770 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:21 smithi067 ceph-mon[99941]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:21.770 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:21 smithi067 ceph-mon[99941]: Health check failed: Degraded data redundancy: 46/276 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-08-31T05:28:21.770 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:21 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2338022059' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:28:21.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.768+0000 7fd07d7fa640 1 -- 172.21.15.67:0/152627417 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2042 (secure 0 0 0) 0x7fd070068cb0 con 0x7fd0801005b0 2024-08-31T05:28:21.771 INFO:teuthology.orchestra.run.smithi067.stdout:e15 2024-08-31T05:28:21.771 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-08-31T05:18:35:124059+0000 2024-08-31T05:28:21.771 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:28:21.771 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:28:21.771 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-08-31T05:28:21.771 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:28:21.771 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:28:21.771 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-08-31T05:28:21.771 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 13 2024-08-31T05:28:21.771 INFO:teuthology.orchestra.run.smithi067.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T05:28:21.771 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:28:21.771 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-08-31T05:18:33.086400+0000 2024-08-31T05:28:21.771 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-08-31T05:28:21.772 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-08-31T05:28:21.772 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2024-08-31T05:28:21.772 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-08-31T05:28:21.772 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-08-31T05:28:21.772 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-08-31T05:28:21.772 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-08-31T05:28:21.772 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-08-31T05:28:21.772 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 0 2024-08-31T05:28:21.772 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:28:21.772 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2024-08-31T05:28:21.772 INFO:teuthology.orchestra.run.smithi067.stdout:in 0 2024-08-31T05:28:21.772 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14554} 2024-08-31T05:28:21.772 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-08-31T05:28:21.772 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-08-31T05:28:21.773 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-08-31T05:28:21.773 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-08-31T05:28:21.773 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-08-31T05:28:21.773 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data enabled 2024-08-31T05:28:21.773 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-08-31T05:28:21.773 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-08-31T05:28:21.773 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2024-08-31T05:28:21.773 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 14554 members: 14554 2024-08-31T05:28:21.773 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.tskvpt{0:14554} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:28:21.773 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.beqeql{0:14566} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:28:21.773 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:28:21.773 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:28:21.774 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2024-08-31T05:28:21.774 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:28:21.774 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.kfbmeo{-1:24299} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:28:21.774 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.gsnhxi{-1:24307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6824/2383176383,v1:172.21.15.73:6825/2383176383] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:28:21.774 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-08-31T05:28:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.770+0000 7fd085e59640 1 -- 172.21.15.67:0/152627417 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd06c079e00 msgr2=0x7fd06c07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.770+0000 7fd085e59640 1 --2- 172.21.15.67:0/152627417 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd06c079e00 0x7fd06c07c2c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd08019af30 tx=0x7fd068004f30 comp rx=0 tx=0).stop 2024-08-31T05:28:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.770+0000 7fd085e59640 1 -- 172.21.15.67:0/152627417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0801005b0 msgr2=0x7fd08019f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.770+0000 7fd085e59640 1 --2- 172.21.15.67:0/152627417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0801005b0 0x7fd08019f610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd07000e970 tx=0x7fd07000ed70 comp rx=0 tx=0).stop 2024-08-31T05:28:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.770+0000 7fd085e59640 1 -- 172.21.15.67:0/152627417 shutdown_connections 2024-08-31T05:28:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.770+0000 7fd085e59640 1 --2- 172.21.15.67:0/152627417 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd06c079e00 0x7fd06c07c2c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.770+0000 7fd085e59640 1 --2- 172.21.15.67:0/152627417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd080106660 0x7fd08019fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.770+0000 7fd085e59640 1 --2- 172.21.15.67:0/152627417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0801005b0 0x7fd08019f610 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.770+0000 7fd085e59640 1 -- 172.21.15.67:0/152627417 >> 172.21.15.67:0/152627417 conn(0x7fd0800fc2f0 msgr2=0x7fd080069ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.770+0000 7fd085e59640 1 -- 172.21.15.67:0/152627417 shutdown_connections 2024-08-31T05:28:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.770+0000 7fd085e59640 1 -- 172.21.15.67:0/152627417 wait complete. 2024-08-31T05:28:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.854+0000 7f222dd24640 1 -- 172.21.15.67:0/1136447693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22281028d0 msgr2=0x7f2228102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.854+0000 7f222dd24640 1 --2- 172.21.15.67:0/1136447693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22281028d0 0x7f2228102cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2218009880 tx=0x7f221802a530 comp rx=0 tx=0).stop 2024-08-31T05:28:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.854+0000 7f222dd24640 1 -- 172.21.15.67:0/1136447693 shutdown_connections 2024-08-31T05:28:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.854+0000 7f222dd24640 1 --2- 172.21.15.67:0/1136447693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22281031f0 0x7f222810b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.854+0000 7f222dd24640 1 --2- 172.21.15.67:0/1136447693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22281028d0 0x7f2228102cb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.854+0000 7f222dd24640 1 -- 172.21.15.67:0/1136447693 >> 172.21.15.67:0/1136447693 conn(0x7f22280fc2f0 msgr2=0x7f22280fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.855+0000 7f222dd24640 1 -- 172.21.15.67:0/1136447693 shutdown_connections 2024-08-31T05:28:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.855+0000 7f222dd24640 1 -- 172.21.15.67:0/1136447693 wait complete. 2024-08-31T05:28:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.855+0000 7f222dd24640 1 Processor -- start 2024-08-31T05:28:21.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.855+0000 7f222dd24640 1 -- start start 2024-08-31T05:28:21.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.855+0000 7f222dd24640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22281028d0 0x7f2228197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:21.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.855+0000 7f222dd24640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22281031f0 0x7f2228197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:21.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f222dd24640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f222810eb80 con 0x7f22281028d0 2024-08-31T05:28:21.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f222dd24640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f222810ea00 con 0x7f22281031f0 2024-08-31T05:28:21.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f22277fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22281028d0 0x7f2228197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:21.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f22277fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22281028d0 0x7f2228197740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33742/0 (socket says 172.21.15.67:33742) 2024-08-31T05:28:21.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f22277fe640 1 -- 172.21.15.67:0/3540325859 learned_addr learned my addr 172.21.15.67:0/3540325859 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:28:21.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f221effd640 1 --2- 172.21.15.67:0/3540325859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22281031f0 0x7f2228197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:21.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f22277fe640 1 -- 172.21.15.67:0/3540325859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22281031f0 msgr2=0x7f2228197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:21.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f22277fe640 1 --2- 172.21.15.67:0/3540325859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22281031f0 0x7f2228197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:21.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f22277fe640 1 -- 172.21.15.67:0/3540325859 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222819c010 con 0x7f22281028d0 2024-08-31T05:28:21.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f22277fe640 1 --2- 172.21.15.67:0/3540325859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22281028d0 0x7f2228197740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2218004f90 tx=0x7f22180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:21.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f22257fa640 1 -- 172.21.15.67:0/3540325859 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f221803f070 con 0x7f22281028d0 2024-08-31T05:28:21.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f22257fa640 1 -- 172.21.15.67:0/3540325859 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2218004ac0 con 0x7f22281028d0 2024-08-31T05:28:21.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f222dd24640 1 -- 172.21.15.67:0/3540325859 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f222819c2a0 con 0x7f22281028d0 2024-08-31T05:28:21.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f22257fa640 1 -- 172.21.15.67:0/3540325859 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2218035030 con 0x7f22281028d0 2024-08-31T05:28:21.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.856+0000 7f222dd24640 1 -- 172.21.15.67:0/3540325859 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f222819c7d0 con 0x7f22281028d0 2024-08-31T05:28:21.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.857+0000 7f222dd24640 1 -- 172.21.15.67:0/3540325859 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f222806a2a0 con 0x7f22281028d0 2024-08-31T05:28:21.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.858+0000 7f22257fa640 1 -- 172.21.15.67:0/3540325859 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f2218042070 con 0x7f22281028d0 2024-08-31T05:28:21.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.859+0000 7f22257fa640 1 --2- 172.21.15.67:0/3540325859 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2214079e00 0x7f221407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:21.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.859+0000 7f22257fa640 1 -- 172.21.15.67:0/3540325859 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6216+0+0 (secure 0 0 0) 0x7f22180bd280 con 0x7f22281028d0 2024-08-31T05:28:21.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.859+0000 7f221effd640 1 --2- 172.21.15.67:0/3540325859 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2214079e00 0x7f221407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:21.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.859+0000 7f221effd640 1 --2- 172.21.15.67:0/3540325859 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2214079e00 0x7f221407c2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f22281086a0 tx=0x7f2210005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:21.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:21.863+0000 7f22257fa640 1 -- 172.21.15.67:0/3540325859 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2218088e70 con 0x7f22281028d0 2024-08-31T05:28:21.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:21 smithi073 ceph-mon[71452]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:21.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:21 smithi073 ceph-mon[71452]: Health check failed: Degraded data redundancy: 46/276 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-08-31T05:28:21.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:21 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2338022059' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:28:21.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:21 smithi073 podman[84574]: 2024-08-31 05:28:21.756672635 +0000 UTC m=+0.352160907 container init 5f02556c012ddb8fa371a9b907eaaca66b278cdd77dc2f15df356bcb96fcab5a (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:28:21.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:21 smithi073 podman[84574]: 2024-08-31 05:28:21.760453976 +0000 UTC m=+0.355942251 container start 5f02556c012ddb8fa371a9b907eaaca66b278cdd77dc2f15df356bcb96fcab5a (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-31T05:28:21.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:21 smithi073 bash[84574]: 5f02556c012ddb8fa371a9b907eaaca66b278cdd77dc2f15df356bcb96fcab5a 2024-08-31T05:28:21.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:21 smithi073 systemd[1]: Started Ceph osd.4 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:28:22.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.077+0000 7f222dd24640 1 -- 172.21.15.67:0/3540325859 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2228198aa0 con 0x7f2214079e00 2024-08-31T05:28:22.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.078+0000 7f22257fa640 1 -- 172.21.15.67:0/3540325859 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f2228198aa0 con 0x7f2214079e00 2024-08-31T05:28:22.080 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:28:22.080 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:28:22.080 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:28:22.080 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-31T05:28:22.080 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:28:22.080 INFO:teuthology.orchestra.run.smithi067.stdout: "mon", 2024-08-31T05:28:22.080 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2024-08-31T05:28:22.080 INFO:teuthology.orchestra.run.smithi067.stdout: "crash" 2024-08-31T05:28:22.080 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:28:22.081 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "10/23 daemons upgraded", 2024-08-31T05:28:22.081 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading osd daemons", 2024-08-31T05:28:22.081 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:28:22.081 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:28:22.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.080+0000 7f222dd24640 1 -- 172.21.15.67:0/3540325859 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2214079e00 msgr2=0x7f221407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:22.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.080+0000 7f222dd24640 1 --2- 172.21.15.67:0/3540325859 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2214079e00 0x7f221407c2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f22281086a0 tx=0x7f2210005f90 comp rx=0 tx=0).stop 2024-08-31T05:28:22.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.080+0000 7f222dd24640 1 -- 172.21.15.67:0/3540325859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22281028d0 msgr2=0x7f2228197740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:22.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.080+0000 7f222dd24640 1 --2- 172.21.15.67:0/3540325859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22281028d0 0x7f2228197740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2218004f90 tx=0x7f22180046c0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.080+0000 7f222dd24640 1 -- 172.21.15.67:0/3540325859 shutdown_connections 2024-08-31T05:28:22.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.080+0000 7f222dd24640 1 --2- 172.21.15.67:0/3540325859 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2214079e00 0x7f221407c2c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.080+0000 7f222dd24640 1 --2- 172.21.15.67:0/3540325859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22281031f0 0x7f2228197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.080+0000 7f222dd24640 1 --2- 172.21.15.67:0/3540325859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22281028d0 0x7f2228197740 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.080+0000 7f222dd24640 1 -- 172.21.15.67:0/3540325859 >> 172.21.15.67:0/3540325859 conn(0x7f22280fc2f0 msgr2=0x7f2228108ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:22.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.080+0000 7f222dd24640 1 -- 172.21.15.67:0/3540325859 shutdown_connections 2024-08-31T05:28:22.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.080+0000 7f222dd24640 1 -- 172.21.15.67:0/3540325859 wait complete. 2024-08-31T05:28:22.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.166+0000 7fcd56ae2640 1 -- 172.21.15.67:0/1744254893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd501028b0 msgr2=0x7fcd50102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:22.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.166+0000 7fcd56ae2640 1 --2- 172.21.15.67:0/1744254893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd501028b0 0x7fcd50102c90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcd440098b0 tx=0x7fcd4402a560 comp rx=0 tx=0).stop 2024-08-31T05:28:22.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.166+0000 7fcd56ae2640 1 -- 172.21.15.67:0/1744254893 shutdown_connections 2024-08-31T05:28:22.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.166+0000 7fcd56ae2640 1 --2- 172.21.15.67:0/1744254893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd501031d0 0x7fcd5010b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.166+0000 7fcd56ae2640 1 --2- 172.21.15.67:0/1744254893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd501028b0 0x7fcd50102c90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.166+0000 7fcd56ae2640 1 -- 172.21.15.67:0/1744254893 >> 172.21.15.67:0/1744254893 conn(0x7fcd500fc2f0 msgr2=0x7fcd500fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:22.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.166+0000 7fcd56ae2640 1 -- 172.21.15.67:0/1744254893 shutdown_connections 2024-08-31T05:28:22.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.166+0000 7fcd56ae2640 1 -- 172.21.15.67:0/1744254893 wait complete. 2024-08-31T05:28:22.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.166+0000 7fcd56ae2640 1 Processor -- start 2024-08-31T05:28:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.166+0000 7fcd56ae2640 1 -- start start 2024-08-31T05:28:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.167+0000 7fcd56ae2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd501028b0 0x7fcd50197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.167+0000 7fcd56ae2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd501031d0 0x7fcd50197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.167+0000 7fcd56ae2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5010eb60 con 0x7fcd501031d0 2024-08-31T05:28:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.167+0000 7fcd56ae2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5010e9e0 con 0x7fcd501028b0 2024-08-31T05:28:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.167+0000 7fcd4ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd501031d0 0x7fcd50197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:22.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.167+0000 7fcd5487e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd501028b0 0x7fcd50197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.167+0000 7fcd4ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd501031d0 0x7fcd50197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33758/0 (socket says 172.21.15.67:33758) 2024-08-31T05:28:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.167+0000 7fcd4ffff640 1 -- 172.21.15.67:0/2054923154 learned_addr learned my addr 172.21.15.67:0/2054923154 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:28:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.167+0000 7fcd5487e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd501028b0 0x7fcd50197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:44160/0 (socket says 172.21.15.67:44160) 2024-08-31T05:28:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.167+0000 7fcd4ffff640 1 -- 172.21.15.67:0/2054923154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd501028b0 msgr2=0x7fcd50197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.167+0000 7fcd4ffff640 1 --2- 172.21.15.67:0/2054923154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd501028b0 0x7fcd50197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.167+0000 7fcd4ffff640 1 -- 172.21.15.67:0/2054923154 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5019bfd0 con 0x7fcd501031d0 2024-08-31T05:28:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.167+0000 7fcd5487e640 1 --2- 172.21.15.67:0/2054923154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd501028b0 0x7fcd50197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:28:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.167+0000 7fcd4ffff640 1 --2- 172.21.15.67:0/2054923154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd501031d0 0x7fcd50197c40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00e9e0 tx=0x7fcd3c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.168+0000 7fcd4dffb640 1 -- 172.21.15.67:0/2054923154 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd3c00cb50 con 0x7fcd501031d0 2024-08-31T05:28:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.168+0000 7fcd56ae2640 1 -- 172.21.15.67:0/2054923154 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd5019c2c0 con 0x7fcd501031d0 2024-08-31T05:28:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.168+0000 7fcd4dffb640 1 -- 172.21.15.67:0/2054923154 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd3c00ccf0 con 0x7fcd501031d0 2024-08-31T05:28:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.168+0000 7fcd4dffb640 1 -- 172.21.15.67:0/2054923154 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd3c0049d0 con 0x7fcd501031d0 2024-08-31T05:28:22.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.168+0000 7fcd56ae2640 1 -- 172.21.15.67:0/2054923154 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd5019c850 con 0x7fcd501031d0 2024-08-31T05:28:22.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.169+0000 7fcd56ae2640 1 -- 172.21.15.67:0/2054923154 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd5006a2c0 con 0x7fcd501031d0 2024-08-31T05:28:22.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.170+0000 7fcd4dffb640 1 -- 172.21.15.67:0/2054923154 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fcd3c004020 con 0x7fcd501031d0 2024-08-31T05:28:22.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.170+0000 7fcd4dffb640 1 --2- 172.21.15.67:0/2054923154 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcd40079e00 0x7fcd4007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:22.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.170+0000 7fcd4dffb640 1 -- 172.21.15.67:0/2054923154 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6216+0+0 (secure 0 0 0) 0x7fcd3c09cb00 con 0x7fcd501031d0 2024-08-31T05:28:22.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.171+0000 7fcd5487e640 1 --2- 172.21.15.67:0/2054923154 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcd40079e00 0x7fcd4007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:22.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.171+0000 7fcd5487e640 1 --2- 172.21.15.67:0/2054923154 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcd40079e00 0x7fcd4007c2c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcd44000c00 tx=0x7fcd44031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:22.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.175+0000 7fcd4dffb640 1 -- 172.21.15.67:0/2054923154 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcd3c064580 con 0x7fcd501031d0 2024-08-31T05:28:22.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.459+0000 7fcd56ae2640 1 -- 172.21.15.67:0/2054923154 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fcd50104d00 con 0x7fcd501031d0 2024-08-31T05:28:22.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.460+0000 7fcd4dffb640 1 -- 172.21.15.67:0/2054923154 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1296 (secure 0 0 0) 0x7fcd3c0686f0 con 0x7fcd501031d0 2024-08-31T05:28:22.462 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 46/276 objects degraded (16.667%), 15 pgs degraded 2024-08-31T05:28:22.462 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:28:22.462 INFO:teuthology.orchestra.run.smithi067.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:28:22.462 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-31T05:28:22.462 INFO:teuthology.orchestra.run.smithi067.stdout: osd.4 (root=default,host=smithi073) is down 2024-08-31T05:28:22.462 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 46/276 objects degraded (16.667%), 15 pgs degraded 2024-08-31T05:28:22.462 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-08-31T05:28:22.462 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-08-31T05:28:22.463 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-08-31T05:28:22.463 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-08-31T05:28:22.463 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-08-31T05:28:22.463 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-08-31T05:28:22.463 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.b is active+undersized+degraded, acting [0,5] 2024-08-31T05:28:22.463 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-08-31T05:28:22.463 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-08-31T05:28:22.463 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.14 is active+undersized+degraded, acting [0,5] 2024-08-31T05:28:22.463 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-08-31T05:28:22.463 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-08-31T05:28:22.463 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-08-31T05:28:22.463 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-08-31T05:28:22.463 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-08-31T05:28:22.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.462+0000 7fcd56ae2640 1 -- 172.21.15.67:0/2054923154 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcd40079e00 msgr2=0x7fcd4007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:22.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.462+0000 7fcd56ae2640 1 --2- 172.21.15.67:0/2054923154 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcd40079e00 0x7fcd4007c2c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcd44000c00 tx=0x7fcd44031400 comp rx=0 tx=0).stop 2024-08-31T05:28:22.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.462+0000 7fcd56ae2640 1 -- 172.21.15.67:0/2054923154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd501031d0 msgr2=0x7fcd50197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:22.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.462+0000 7fcd56ae2640 1 --2- 172.21.15.67:0/2054923154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd501031d0 0x7fcd50197c40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00e9e0 tx=0x7fcd3c00eea0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.462+0000 7fcd56ae2640 1 -- 172.21.15.67:0/2054923154 shutdown_connections 2024-08-31T05:28:22.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.462+0000 7fcd56ae2640 1 --2- 172.21.15.67:0/2054923154 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fcd40079e00 0x7fcd4007c2c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.462+0000 7fcd56ae2640 1 --2- 172.21.15.67:0/2054923154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd501031d0 0x7fcd50197c40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.462+0000 7fcd56ae2640 1 --2- 172.21.15.67:0/2054923154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd501028b0 0x7fcd50197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.462+0000 7fcd56ae2640 1 -- 172.21.15.67:0/2054923154 >> 172.21.15.67:0/2054923154 conn(0x7fcd500fc2f0 msgr2=0x7fcd50107ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:22.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.462+0000 7fcd56ae2640 1 -- 172.21.15.67:0/2054923154 shutdown_connections 2024-08-31T05:28:22.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:22.462+0000 7fcd56ae2640 1 -- 172.21.15.67:0/2054923154 wait complete. 2024-08-31T05:28:22.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:22 smithi073 ceph-mon[71452]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:22.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:22 smithi073 ceph-mon[71452]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:22.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:22 smithi073 ceph-mon[71452]: pgmap v227: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 46/276 objects degraded (16.667%) 2024-08-31T05:28:22.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:22 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/152627417' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:28:22.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:22 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:22.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:22 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:22.753 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:22 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:28:22.754 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:22 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2054923154' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:28:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:22 smithi067 ceph-mon[99941]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:22 smithi067 ceph-mon[99941]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:22 smithi067 ceph-mon[99941]: pgmap v227: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 46/276 objects degraded (16.667%) 2024-08-31T05:28:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:22 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/152627417' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:28:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:22 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:22 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:22 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:28:22.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:22 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2054923154' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:28:23.885 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:23 smithi073 ceph-mon[71452]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:23.885 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:23 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:28:23.654+0000 7fa1a1d61640 -1 Falling back to public interface 2024-08-31T05:28:24.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:23 smithi067 ceph-mon[99941]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:24.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:24 smithi073 ceph-mon[71452]: pgmap v228: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-08-31T05:28:25.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:24 smithi067 ceph-mon[99941]: pgmap v228: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-08-31T05:28:25.940 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:25.940 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:25.941 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:25.941 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:25 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:26.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:26.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:26.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:26.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:25 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:26.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:26 smithi073 ceph-mon[71452]: pgmap v229: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 341 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-08-31T05:28:27.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:26 smithi067 ceph-mon[99941]: pgmap v229: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 341 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-08-31T05:28:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:28 smithi073 ceph-mon[71452]: pgmap v230: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 307 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-08-31T05:28:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:28 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:28 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:28.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:28 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:28:28.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:28 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:28:28.947 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:28 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:29.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:28 smithi067 ceph-mon[99941]: pgmap v230: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 307 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-08-31T05:28:29.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:28 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:29.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:28 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:29.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:28 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:28:29.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:28 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:28:29.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:28 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:30.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:29 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:28:30.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:29 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:28:30.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:29 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:28:30.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:29 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:28:30.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:29 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-08-31T05:28:30.119 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:29 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:28:30.120 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:29 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:28:30.120 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:29 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:28:30.120 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:29 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:28:30.120 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:29 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-08-31T05:28:30.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:30 smithi073 ceph-mon[71452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-31T05:28:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:30 smithi073 ceph-mon[71452]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-08-31T05:28:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:30 smithi073 ceph-mon[71452]: pgmap v231: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 683 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-08-31T05:28:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:30 smithi073 ceph-mon[71452]: from='osd.4 [v2:172.21.15.73:6808/4064820171,v1:172.21.15.73:6809/4064820171]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:28:30.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:30 smithi073 ceph-mon[71452]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:28:30.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:30 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:28:30.637+0000 7fa1a1d61640 -1 osd.4 80 log_to_monitors true 2024-08-31T05:28:30.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:28:30 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:28:30.782+0000 7fa195ad9640 -1 osd.4 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:28:31.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:30 smithi067 ceph-mon[99941]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-31T05:28:31.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:30 smithi067 ceph-mon[99941]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-08-31T05:28:31.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:30 smithi067 ceph-mon[99941]: pgmap v231: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 683 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-08-31T05:28:31.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:30 smithi067 ceph-mon[99941]: from='osd.4 [v2:172.21.15.73:6808/4064820171,v1:172.21.15.73:6809/4064820171]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:28:31.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:30 smithi067 ceph-mon[99941]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:28:32.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:31 smithi067 ceph-mon[99941]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T05:28:32.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:31 smithi067 ceph-mon[99941]: osdmap e83: 6 total, 5 up, 6 in 2024-08-31T05:28:32.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:31 smithi067 ceph-mon[99941]: from='osd.4 [v2:172.21.15.73:6808/4064820171,v1:172.21.15.73:6809/4064820171]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-08-31T05:28:32.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:31 smithi067 ceph-mon[99941]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-08-31T05:28:32.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:31 smithi073 ceph-mon[71452]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T05:28:32.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:31 smithi073 ceph-mon[71452]: osdmap e83: 6 total, 5 up, 6 in 2024-08-31T05:28:32.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:31 smithi073 ceph-mon[71452]: from='osd.4 [v2:172.21.15.73:6808/4064820171,v1:172.21.15.73:6809/4064820171]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-08-31T05:28:32.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:31 smithi073 ceph-mon[71452]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-08-31T05:28:33.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:32 smithi067 ceph-mon[99941]: pgmap v233: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-08-31T05:28:33.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:32 smithi067 ceph-mon[99941]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-31T05:28:33.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:32 smithi067 ceph-mon[99941]: osd.4 [v2:172.21.15.73:6808/4064820171,v1:172.21.15.73:6809/4064820171] boot 2024-08-31T05:28:33.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:32 smithi067 ceph-mon[99941]: osdmap e84: 6 total, 6 up, 6 in 2024-08-31T05:28:33.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:32 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:28:33.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:32 smithi067 ceph-mon[99941]: osdmap e85: 6 total, 6 up, 6 in 2024-08-31T05:28:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:32 smithi073 ceph-mon[71452]: pgmap v233: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 46/276 objects degraded (16.667%) 2024-08-31T05:28:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:32 smithi073 ceph-mon[71452]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-31T05:28:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:32 smithi073 ceph-mon[71452]: osd.4 [v2:172.21.15.73:6808/4064820171,v1:172.21.15.73:6809/4064820171] boot 2024-08-31T05:28:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:32 smithi073 ceph-mon[71452]: osdmap e84: 6 total, 6 up, 6 in 2024-08-31T05:28:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:32 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:28:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:32 smithi073 ceph-mon[71452]: osdmap e85: 6 total, 6 up, 6 in 2024-08-31T05:28:34.003 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:33 smithi067 ceph-mon[99941]: pgmap v236: 65 pgs: 13 active+undersized, 10 active+undersized+degraded, 42 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 27/276 objects degraded (9.783%) 2024-08-31T05:28:34.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:33 smithi067 ceph-mon[99941]: Health check update: Degraded data redundancy: 27/276 objects degraded (9.783%), 10 pgs degraded (PG_DEGRADED) 2024-08-31T05:28:34.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:33 smithi073 ceph-mon[71452]: pgmap v236: 65 pgs: 13 active+undersized, 10 active+undersized+degraded, 42 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 27/276 objects degraded (9.783%) 2024-08-31T05:28:34.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:33 smithi073 ceph-mon[71452]: Health check update: Degraded data redundancy: 27/276 objects degraded (9.783%), 10 pgs degraded (PG_DEGRADED) 2024-08-31T05:28:35.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:35.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:28:36.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:36.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:28:36.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:36 smithi067 ceph-mon[99941]: pgmap v237: 65 pgs: 3 active+undersized, 2 active+undersized+degraded, 60 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 5/276 objects degraded (1.812%) 2024-08-31T05:28:36.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:36 smithi073 ceph-mon[71452]: pgmap v237: 65 pgs: 3 active+undersized, 2 active+undersized+degraded, 60 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 5/276 objects degraded (1.812%) 2024-08-31T05:28:38.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:38 smithi073 ceph-mon[71452]: pgmap v238: 65 pgs: 65 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 590 B/s rd, 1 op/s 2024-08-31T05:28:39.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:38 smithi067 ceph-mon[99941]: pgmap v238: 65 pgs: 65 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 590 B/s rd, 1 op/s 2024-08-31T05:28:39.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:39 smithi073 ceph-mon[71452]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/276 objects degraded (1.812%), 2 pgs degraded) 2024-08-31T05:28:40.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:39 smithi067 ceph-mon[99941]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/276 objects degraded (1.812%), 2 pgs degraded) 2024-08-31T05:28:40.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:40 smithi073 ceph-mon[71452]: pgmap v239: 65 pgs: 65 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-08-31T05:28:41.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:40 smithi067 ceph-mon[99941]: pgmap v239: 65 pgs: 65 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-08-31T05:28:43.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:42 smithi067 ceph-mon[99941]: pgmap v240: 65 pgs: 65 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 927 B/s rd, 1 op/s 2024-08-31T05:28:43.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:42 smithi073 ceph-mon[71452]: pgmap v240: 65 pgs: 65 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 927 B/s rd, 1 op/s 2024-08-31T05:28:44.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:44 smithi073 ceph-mon[71452]: pgmap v241: 65 pgs: 65 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-08-31T05:28:44.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:44 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-08-31T05:28:44.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:44 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:45.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:44 smithi067 ceph-mon[99941]: pgmap v241: 65 pgs: 65 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-08-31T05:28:45.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:44 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-08-31T05:28:45.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:44 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:45.900 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:45 smithi073 ceph-mon[71452]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-31T05:28:45.900 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:45 smithi073 ceph-mon[71452]: Upgrade: osd.5 is safe to restart 2024-08-31T05:28:45.900 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:45 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:45.900 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:45 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T05:28:45.900 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:45 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:28:46.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:45 smithi067 ceph-mon[99941]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-31T05:28:46.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:45 smithi067 ceph-mon[99941]: Upgrade: osd.5 is safe to restart 2024-08-31T05:28:46.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:45 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:46.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:45 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T05:28:46.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:45 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:28:47.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:46 smithi067 ceph-mon[99941]: Upgrade: Updating osd.5 2024-08-31T05:28:47.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:46 smithi067 ceph-mon[99941]: Deploying daemon osd.5 on smithi073 2024-08-31T05:28:47.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:46 smithi067 ceph-mon[99941]: pgmap v242: 65 pgs: 65 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:28:47.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:46 smithi073 ceph-mon[71452]: Upgrade: Updating osd.5 2024-08-31T05:28:47.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:46 smithi073 ceph-mon[71452]: Deploying daemon osd.5 on smithi073 2024-08-31T05:28:47.081 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:46 smithi073 ceph-mon[71452]: pgmap v242: 65 pgs: 65 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:28:48.188 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:48 smithi073 systemd[1]: Stopping Ceph osd.5 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:28:48.446 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[44370]: 2024-08-31T05:28:48.413+0000 7f28c1840640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:28:48.446 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[44370]: 2024-08-31T05:28:48.413+0000 7f28c1840640 -1 osd.5 85 *** Got signal Terminated *** 2024-08-31T05:28:48.446 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:48 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[44370]: 2024-08-31T05:28:48.413+0000 7f28c1840640 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:28:49.061 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:48 smithi073 ceph-mon[71452]: pgmap v243: 65 pgs: 65 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:28:49.061 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:48 smithi073 ceph-mon[71452]: osd.5 marked itself down and dead 2024-08-31T05:28:49.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:48 smithi067 ceph-mon[99941]: pgmap v243: 65 pgs: 65 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:28:49.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:48 smithi067 ceph-mon[99941]: osd.5 marked itself down and dead 2024-08-31T05:28:49.446 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:49 smithi073 podman[89167]: 2024-08-31 05:28:49.106837975 +0000 UTC m=+0.775173521 container died 228dbcbb33917b52bd924fef876f7d7541312a72d96a21452965593bb18ae66b (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-244a32d, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-31T05:28:49.767 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:49 smithi073 podman[89167]: 2024-08-31 05:28:49.571209373 +0000 UTC m=+1.239544918 container cleanup 228dbcbb33917b52bd924fef876f7d7541312a72d96a21452965593bb18ae66b (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5, GIT_CLEAN=True, RELEASE=squid-244a32d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:28:49.767 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:49 smithi073 bash[89167]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5 2024-08-31T05:28:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:49 smithi067 ceph-mon[99941]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-31T05:28:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:49 smithi067 ceph-mon[99941]: osdmap e86: 6 total, 5 up, 6 in 2024-08-31T05:28:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:28:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:49 smithi067 ceph-mon[99941]: osdmap e87: 6 total, 5 up, 6 in 2024-08-31T05:28:50.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:49 smithi073 podman[89182]: 2024-08-31 05:28:49.898216472 +0000 UTC m=+0.792520614 container remove 228dbcbb33917b52bd924fef876f7d7541312a72d96a21452965593bb18ae66b (image=quay.ceph.io/ceph-ci/ceph@sha256:8981da674036ac9fb23f900abc794894ab7d6a73126c5f835a5120af093af60a, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-244a32d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:28:50.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:49 smithi073 ceph-mon[71452]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-31T05:28:50.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:49 smithi073 ceph-mon[71452]: osdmap e86: 6 total, 5 up, 6 in 2024-08-31T05:28:50.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:50.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:28:50.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:49 smithi073 ceph-mon[71452]: osdmap e87: 6 total, 5 up, 6 in 2024-08-31T05:28:50.519 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:50 smithi073 podman[89268]: 2024-08-31 05:28:50.110897775 +0000 UTC m=+0.016313420 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:28:50.519 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:50 smithi073 podman[89268]: 2024-08-31 05:28:50.232311181 +0000 UTC m=+0.137726868 container create 2a057ea69b772c0425ebd9d7b3da185856a32460b09cfe47269ab0481d19e605 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-31T05:28:50.519 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:50 smithi073 podman[89268]: 2024-08-31 05:28:50.442960779 +0000 UTC m=+0.348376430 container init 2a057ea69b772c0425ebd9d7b3da185856a32460b09cfe47269ab0481d19e605 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-08-31T05:28:50.519 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:50 smithi073 podman[89268]: 2024-08-31 05:28:50.446447657 +0000 UTC m=+0.351863302 container start 2a057ea69b772c0425ebd9d7b3da185856a32460b09cfe47269ab0481d19e605 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-08-31T05:28:50.519 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:50 smithi073 podman[89268]: 2024-08-31 05:28:50.517949724 +0000 UTC m=+0.423365380 container attach 2a057ea69b772c0425ebd9d7b3da185856a32460b09cfe47269ab0481d19e605 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-31T05:28:50.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:50 smithi073 ceph-mon[71452]: pgmap v245: 65 pgs: 8 peering, 11 stale+active+clean, 46 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-08-31T05:28:50.769 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:50 smithi073 ceph-mon[71452]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-08-31T05:28:50.770 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:50 smithi073 podman[89268]: 2024-08-31 05:28:50.637790885 +0000 UTC m=+0.543206530 container died 2a057ea69b772c0425ebd9d7b3da185856a32460b09cfe47269ab0481d19e605 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:28:51.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:50 smithi067 ceph-mon[99941]: pgmap v245: 65 pgs: 8 peering, 11 stale+active+clean, 46 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-08-31T05:28:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:50 smithi067 ceph-mon[99941]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-08-31T05:28:51.446 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:51 smithi073 podman[89291]: 2024-08-31 05:28:51.171450587 +0000 UTC m=+0.527510078 container remove 2a057ea69b772c0425ebd9d7b3da185856a32460b09cfe47269ab0481d19e605 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:28:51.446 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:51 smithi073 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.5.service: Deactivated successfully. 2024-08-31T05:28:51.446 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:51 smithi073 systemd[1]: Stopped Ceph osd.5 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:28:51.446 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:51 smithi073 systemd[1]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.5.service: Consumed 51.782s CPU time. 2024-08-31T05:28:51.446 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:51 smithi073 systemd[1]: Starting Ceph osd.5 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:28:51.848 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:51 smithi067 ceph-mon[99941]: pgmap v247: 65 pgs: 3 active+undersized, 8 peering, 7 stale+active+clean, 3 active+undersized+degraded, 44 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 10/276 objects degraded (3.623%) 2024-08-31T05:28:51.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:51 smithi067 ceph-mon[99941]: Health check failed: Degraded data redundancy: 10/276 objects degraded (3.623%), 3 pgs degraded (PG_DEGRADED) 2024-08-31T05:28:51.859 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:51 smithi073 ceph-mon[71452]: pgmap v247: 65 pgs: 3 active+undersized, 8 peering, 7 stale+active+clean, 3 active+undersized+degraded, 44 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 10/276 objects degraded (3.623%) 2024-08-31T05:28:51.859 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:51 smithi073 ceph-mon[71452]: Health check failed: Degraded data redundancy: 10/276 objects degraded (3.623%), 3 pgs degraded (PG_DEGRADED) 2024-08-31T05:28:51.859 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:51 smithi073 podman[89393]: 2024-08-31 05:28:51.597235553 +0000 UTC m=+0.109186113 container create e59a4b7490444fe8bb0abdf5d8bf883e310b06961e2ec694a4fb99796fc2e23e (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD) 2024-08-31T05:28:51.860 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:51 smithi073 podman[89393]: 2024-08-31 05:28:51.50355937 +0000 UTC m=+0.015509938 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:28:51.860 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:51 smithi073 podman[89393]: 2024-08-31 05:28:51.858458055 +0000 UTC m=+0.370408616 container init e59a4b7490444fe8bb0abdf5d8bf883e310b06961e2ec694a4fb99796fc2e23e (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-31T05:28:52.134 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:51 smithi073 podman[89393]: 2024-08-31 05:28:51.861934307 +0000 UTC m=+0.373884874 container start e59a4b7490444fe8bb0abdf5d8bf883e310b06961e2ec694a4fb99796fc2e23e (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-08-31T05:28:52.134 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:51 smithi073 podman[89393]: 2024-08-31 05:28:51.933483681 +0000 UTC m=+0.445434257 container attach e59a4b7490444fe8bb0abdf5d8bf883e310b06961e2ec694a4fb99796fc2e23e (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1) 2024-08-31T05:28:52.134 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:51 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate[89407]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:52.134 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:51 smithi073 bash[89393]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:52.134 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate[89407]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:52.134 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 bash[89393]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:52.134 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate[89407]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-31T05:28:52.134 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 bash[89393]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-31T05:28:52.134 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate[89407]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:52.134 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 bash[89393]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:52.135 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate[89407]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:52.135 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 bash[89393]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-31T05:28:52.135 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate[89407]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-31T05:28:52.135 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 bash[89393]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-31T05:28:52.431 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate[89407]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-08-31T05:28:52.431 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 bash[89393]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-08-31T05:28:52.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.559+0000 7f24d0e5c640 1 -- 172.21.15.67:0/1091818307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24cc1016a0 msgr2=0x7f24cc101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:52.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.559+0000 7f24d0e5c640 1 --2- 172.21.15.67:0/1091818307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24cc1016a0 0x7f24cc101b00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009880 tx=0x7f24b402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:28:52.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.559+0000 7f24d0e5c640 1 -- 172.21.15.67:0/1091818307 shutdown_connections 2024-08-31T05:28:52.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.559+0000 7f24d0e5c640 1 --2- 172.21.15.67:0/1091818307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24cc1016a0 0x7f24cc101b00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:52.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.559+0000 7f24d0e5c640 1 --2- 172.21.15.67:0/1091818307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1076a0 0x7f24cc107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:52.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.559+0000 7f24d0e5c640 1 -- 172.21.15.67:0/1091818307 >> 172.21.15.67:0/1091818307 conn(0x7f24cc0fd380 msgr2=0x7f24cc0ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:52.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.559+0000 7f24d0e5c640 1 -- 172.21.15.67:0/1091818307 shutdown_connections 2024-08-31T05:28:52.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.559+0000 7f24d0e5c640 1 -- 172.21.15.67:0/1091818307 wait complete. 2024-08-31T05:28:52.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.560+0000 7f24d0e5c640 1 Processor -- start 2024-08-31T05:28:52.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.560+0000 7f24d0e5c640 1 -- start start 2024-08-31T05:28:52.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.560+0000 7f24d0e5c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1016a0 0x7f24cc074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:52.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.560+0000 7f24d0e5c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24cc1076a0 0x7f24cc0747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:52.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.560+0000 7f24d0e5c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc10eb70 con 0x7f24cc1076a0 2024-08-31T05:28:52.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.560+0000 7f24d0e5c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc10e9f0 con 0x7f24cc1016a0 2024-08-31T05:28:52.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.561+0000 7f24c9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24cc1076a0 0x7f24cc0747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:52.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.561+0000 7f24c9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24cc1076a0 0x7f24cc0747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41084/0 (socket says 172.21.15.67:41084) 2024-08-31T05:28:52.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.561+0000 7f24c9d9b640 1 -- 172.21.15.67:0/274792137 learned_addr learned my addr 172.21.15.67:0/274792137 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:28:52.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.561+0000 7f24ca59c640 1 --2- 172.21.15.67:0/274792137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1016a0 0x7f24cc074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:52.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.561+0000 7f24c9d9b640 1 -- 172.21.15.67:0/274792137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1016a0 msgr2=0x7f24cc074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:52.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.561+0000 7f24c9d9b640 1 --2- 172.21.15.67:0/274792137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1016a0 0x7f24cc074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:52.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.561+0000 7f24c9d9b640 1 -- 172.21.15.67:0/274792137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24cc074d10 con 0x7f24cc1076a0 2024-08-31T05:28:52.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.561+0000 7f24c9d9b640 1 --2- 172.21.15.67:0/274792137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24cc1076a0 0x7f24cc0747d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f24b4031460 tx=0x7f24b40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:52.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.561+0000 7f24c37fe640 1 -- 172.21.15.67:0/274792137 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24b403f070 con 0x7f24cc1076a0 2024-08-31T05:28:52.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.561+0000 7f24c37fe640 1 -- 172.21.15.67:0/274792137 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24b40035f0 con 0x7f24cc1076a0 2024-08-31T05:28:52.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.562+0000 7f24c37fe640 1 -- 172.21.15.67:0/274792137 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24b4035030 con 0x7f24cc1076a0 2024-08-31T05:28:52.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.562+0000 7f24d0e5c640 1 -- 172.21.15.67:0/274792137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24cc074fa0 con 0x7f24cc1076a0 2024-08-31T05:28:52.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.562+0000 7f24d0e5c640 1 -- 172.21.15.67:0/274792137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24cc1a3b60 con 0x7f24cc1076a0 2024-08-31T05:28:52.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.563+0000 7f24d0e5c640 1 -- 172.21.15.67:0/274792137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24cc102de0 con 0x7f24cc1076a0 2024-08-31T05:28:52.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.563+0000 7f24c37fe640 1 -- 172.21.15.67:0/274792137 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f24b4042070 con 0x7f24cc1076a0 2024-08-31T05:28:52.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.564+0000 7f24c37fe640 1 --2- 172.21.15.67:0/274792137 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f24b8079e40 0x7f24b807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:52.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.564+0000 7f24c37fe640 1 -- 172.21.15.67:0/274792137 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6216+0+0 (secure 0 0 0) 0x7f24b40bd220 con 0x7f24cc1076a0 2024-08-31T05:28:52.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.564+0000 7f24ca59c640 1 --2- 172.21.15.67:0/274792137 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f24b8079e40 0x7f24b807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:52.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.565+0000 7f24ca59c640 1 --2- 172.21.15.67:0/274792137 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f24b8079e40 0x7f24b807c300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f24bc005fd0 tx=0x7f24bc00b390 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:52.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.569+0000 7f24c37fe640 1 -- 172.21.15.67:0/274792137 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f24b4088e90 con 0x7f24cc1076a0 2024-08-31T05:28:52.696 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate[89407]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-08-31T05:28:52.696 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 bash[89393]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-08-31T05:28:52.696 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate[89407]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-08-31T05:28:52.696 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 bash[89393]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-08-31T05:28:52.696 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate[89407]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-31T05:28:52.696 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 bash[89393]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-31T05:28:52.696 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate[89407]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-31T05:28:52.696 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 bash[89393]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-31T05:28:52.697 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate[89407]: --> ceph-volume lvm activate successful for osd ID: 5 2024-08-31T05:28:52.697 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 bash[89393]: --> ceph-volume lvm activate successful for osd ID: 5 2024-08-31T05:28:52.697 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:52 smithi073 podman[89393]: 2024-08-31 05:28:52.458559299 +0000 UTC m=+0.970509870 container died e59a4b7490444fe8bb0abdf5d8bf883e310b06961e2ec694a4fb99796fc2e23e (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, io.buildah.version=1.37.1) 2024-08-31T05:28:52.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.773+0000 7f24d0e5c640 1 -- 172.21.15.67:0/274792137 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f24cc109c80 con 0x7f24b8079e40 2024-08-31T05:28:52.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.775+0000 7f24c37fe640 1 -- 172.21.15.67:0/274792137 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f24bc003890 con 0x7f24b8079e40 2024-08-31T05:28:52.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.777+0000 7f24d0e5c640 1 -- 172.21.15.67:0/274792137 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f24b8079e40 msgr2=0x7f24b807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:52.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.777+0000 7f24d0e5c640 1 --2- 172.21.15.67:0/274792137 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f24b8079e40 0x7f24b807c300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f24bc005fd0 tx=0x7f24bc00b390 comp rx=0 tx=0).stop 2024-08-31T05:28:52.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.777+0000 7f24d0e5c640 1 -- 172.21.15.67:0/274792137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24cc1076a0 msgr2=0x7f24cc0747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:52.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.777+0000 7f24d0e5c640 1 --2- 172.21.15.67:0/274792137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24cc1076a0 0x7f24cc0747d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f24b4031460 tx=0x7f24b40045e0 comp rx=0 tx=0).stop 2024-08-31T05:28:52.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.777+0000 7f24d0e5c640 1 -- 172.21.15.67:0/274792137 shutdown_connections 2024-08-31T05:28:52.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.777+0000 7f24d0e5c640 1 --2- 172.21.15.67:0/274792137 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f24b8079e40 0x7f24b807c300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:52.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.777+0000 7f24d0e5c640 1 --2- 172.21.15.67:0/274792137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24cc1076a0 0x7f24cc0747d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:52.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.777+0000 7f24d0e5c640 1 --2- 172.21.15.67:0/274792137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc1016a0 0x7f24cc074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:52.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.777+0000 7f24d0e5c640 1 -- 172.21.15.67:0/274792137 >> 172.21.15.67:0/274792137 conn(0x7f24cc0fd380 msgr2=0x7f24cc0fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:52.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.777+0000 7f24d0e5c640 1 -- 172.21.15.67:0/274792137 shutdown_connections 2024-08-31T05:28:52.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.777+0000 7f24d0e5c640 1 -- 172.21.15.67:0/274792137 wait complete. 2024-08-31T05:28:52.787 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:28:52.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.861+0000 7fed2b84c640 1 -- 172.21.15.67:0/3661419442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed24106670 msgr2=0x7fed24106a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:52.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.861+0000 7fed2b84c640 1 --2- 172.21.15.67:0/3661419442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed24106670 0x7fed24106a50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed20009880 tx=0x7fed2002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:28:52.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.861+0000 7fed2b84c640 1 -- 172.21.15.67:0/3661419442 shutdown_connections 2024-08-31T05:28:52.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.861+0000 7fed2b84c640 1 --2- 172.21.15.67:0/3661419442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed241005c0 0x7fed24100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:52.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.861+0000 7fed2b84c640 1 --2- 172.21.15.67:0/3661419442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed24106670 0x7fed24106a50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:52.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.861+0000 7fed2b84c640 1 -- 172.21.15.67:0/3661419442 >> 172.21.15.67:0/3661419442 conn(0x7fed240fc2c0 msgr2=0x7fed240fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:52.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.862+0000 7fed2b84c640 1 -- 172.21.15.67:0/3661419442 shutdown_connections 2024-08-31T05:28:52.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.862+0000 7fed2b84c640 1 -- 172.21.15.67:0/3661419442 wait complete. 2024-08-31T05:28:52.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.862+0000 7fed2b84c640 1 Processor -- start 2024-08-31T05:28:52.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.862+0000 7fed2b84c640 1 -- start start 2024-08-31T05:28:52.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed2b84c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed241005c0 0x7fed24198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:52.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed2b84c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed24106670 0x7fed24198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:52.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed2b84c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fed2410da80 con 0x7fed24106670 2024-08-31T05:28:52.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed2b84c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fed2410d900 con 0x7fed241005c0 2024-08-31T05:28:52.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed28de7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed24106670 0x7fed24198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:52.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed28de7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed24106670 0x7fed24198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41110/0 (socket says 172.21.15.67:41110) 2024-08-31T05:28:52.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed28de7640 1 -- 172.21.15.67:0/3500262722 learned_addr learned my addr 172.21.15.67:0/3500262722 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:28:52.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed295e8640 1 --2- 172.21.15.67:0/3500262722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed241005c0 0x7fed24198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:52.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed28de7640 1 -- 172.21.15.67:0/3500262722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed241005c0 msgr2=0x7fed24198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:52.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed28de7640 1 --2- 172.21.15.67:0/3500262722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed241005c0 0x7fed24198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:52.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed28de7640 1 -- 172.21.15.67:0/3500262722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed241990d0 con 0x7fed24106670 2024-08-31T05:28:52.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed295e8640 1 --2- 172.21.15.67:0/3500262722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed241005c0 0x7fed24198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:52.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed28de7640 1 --2- 172.21.15.67:0/3500262722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed24106670 0x7fed24198a80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fed1800e970 tx=0x7fed1800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:52.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed167fc640 1 -- 172.21.15.67:0/3500262722 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed1800cac0 con 0x7fed24106670 2024-08-31T05:28:52.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed2b84c640 1 -- 172.21.15.67:0/3500262722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed241a15b0 con 0x7fed24106670 2024-08-31T05:28:52.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed167fc640 1 -- 172.21.15.67:0/3500262722 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed180054e0 con 0x7fed24106670 2024-08-31T05:28:52.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed167fc640 1 -- 172.21.15.67:0/3500262722 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed18010430 con 0x7fed24106670 2024-08-31T05:28:52.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.863+0000 7fed2b84c640 1 -- 172.21.15.67:0/3500262722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed241a19b0 con 0x7fed24106670 2024-08-31T05:28:52.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.864+0000 7fed2b84c640 1 -- 172.21.15.67:0/3500262722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed24101ce0 con 0x7fed24106670 2024-08-31T05:28:52.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.865+0000 7fed167fc640 1 -- 172.21.15.67:0/3500262722 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fed18004ea0 con 0x7fed24106670 2024-08-31T05:28:52.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.865+0000 7fed167fc640 1 --2- 172.21.15.67:0/3500262722 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fed10079e00 0x7fed1007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:52.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.866+0000 7fed167fc640 1 -- 172.21.15.67:0/3500262722 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6216+0+0 (secure 0 0 0) 0x7fed1809d0a0 con 0x7fed24106670 2024-08-31T05:28:52.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.866+0000 7fed295e8640 1 --2- 172.21.15.67:0/3500262722 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fed10079e00 0x7fed1007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:52.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.866+0000 7fed295e8640 1 --2- 172.21.15.67:0/3500262722 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fed10079e00 0x7fed1007c2c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fed20000c00 tx=0x7fed20004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:52.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:52.870+0000 7fed167fc640 1 -- 172.21.15.67:0/3500262722 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fed18064b20 con 0x7fed24106670 2024-08-31T05:28:53.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.072+0000 7fed2b84c640 1 -- 172.21.15.67:0/3500262722 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fed24108b00 con 0x7fed10079e00 2024-08-31T05:28:53.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:52 smithi067 ceph-mon[99941]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:53.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.074+0000 7fed167fc640 1 -- 172.21.15.67:0/3500262722 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fed20004400 con 0x7fed10079e00 2024-08-31T05:28:53.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.075+0000 7fed2b84c640 1 -- 172.21.15.67:0/3500262722 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fed10079e00 msgr2=0x7fed1007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:53.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.075+0000 7fed2b84c640 1 --2- 172.21.15.67:0/3500262722 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fed10079e00 0x7fed1007c2c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fed20000c00 tx=0x7fed20004f30 comp rx=0 tx=0).stop 2024-08-31T05:28:53.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.075+0000 7fed2b84c640 1 -- 172.21.15.67:0/3500262722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed24106670 msgr2=0x7fed24198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:53.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.075+0000 7fed2b84c640 1 --2- 172.21.15.67:0/3500262722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed24106670 0x7fed24198a80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fed1800e970 tx=0x7fed1800ed70 comp rx=0 tx=0).stop 2024-08-31T05:28:53.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.076+0000 7fed2b84c640 1 -- 172.21.15.67:0/3500262722 shutdown_connections 2024-08-31T05:28:53.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.076+0000 7fed2b84c640 1 --2- 172.21.15.67:0/3500262722 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fed10079e00 0x7fed1007c2c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.076+0000 7fed2b84c640 1 --2- 172.21.15.67:0/3500262722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed24106670 0x7fed24198a80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.076+0000 7fed2b84c640 1 --2- 172.21.15.67:0/3500262722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed241005c0 0x7fed24198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.076+0000 7fed2b84c640 1 -- 172.21.15.67:0/3500262722 >> 172.21.15.67:0/3500262722 conn(0x7fed240fc2c0 msgr2=0x7fed240fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:53.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.076+0000 7fed2b84c640 1 -- 172.21.15.67:0/3500262722 shutdown_connections 2024-08-31T05:28:53.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.076+0000 7fed2b84c640 1 -- 172.21.15.67:0/3500262722 wait complete. 2024-08-31T05:28:53.105 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:52 smithi073 ceph-mon[71452]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:53.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.159+0000 7f2bc4b53640 1 -- 172.21.15.67:0/3418570924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bc0100160 msgr2=0x7f2bc0100540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:53.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.159+0000 7f2bc4b53640 1 --2- 172.21.15.67:0/3418570924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bc0100160 0x7f2bc0100540 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009880 tx=0x7f2bb002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.159+0000 7f2bc4b53640 1 -- 172.21.15.67:0/3418570924 shutdown_connections 2024-08-31T05:28:53.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.159+0000 7f2bc4b53640 1 --2- 172.21.15.67:0/3418570924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bc0100b10 0x7f2bc0106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.159+0000 7f2bc4b53640 1 --2- 172.21.15.67:0/3418570924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bc0100160 0x7f2bc0100540 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.159+0000 7f2bc4b53640 1 -- 172.21.15.67:0/3418570924 >> 172.21.15.67:0/3418570924 conn(0x7f2bc0076ef0 msgr2=0x7f2bc0077300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:53.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.159+0000 7f2bc4b53640 1 -- 172.21.15.67:0/3418570924 shutdown_connections 2024-08-31T05:28:53.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.159+0000 7f2bc4b53640 1 -- 172.21.15.67:0/3418570924 wait complete. 2024-08-31T05:28:53.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.160+0000 7f2bc4b53640 1 Processor -- start 2024-08-31T05:28:53.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.160+0000 7f2bc4b53640 1 -- start start 2024-08-31T05:28:53.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.160+0000 7f2bc4b53640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bc0100160 0x7f2bc0197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:53.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.160+0000 7f2bc4b53640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bc0100b10 0x7f2bc0197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:53.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.160+0000 7f2bc4b53640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc010eb80 con 0x7f2bc0100160 2024-08-31T05:28:53.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.160+0000 7f2bc4b53640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc010ea00 con 0x7f2bc0100b10 2024-08-31T05:28:53.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.160+0000 7f2bbe59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bc0100160 0x7f2bc0197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:53.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.160+0000 7f2bbe59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bc0100160 0x7f2bc0197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41122/0 (socket says 172.21.15.67:41122) 2024-08-31T05:28:53.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.160+0000 7f2bbe59c640 1 -- 172.21.15.67:0/303896037 learned_addr learned my addr 172.21.15.67:0/303896037 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:28:53.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.160+0000 7f2bbdd9b640 1 --2- 172.21.15.67:0/303896037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bc0100b10 0x7f2bc0197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:53.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.161+0000 7f2bbe59c640 1 -- 172.21.15.67:0/303896037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bc0100b10 msgr2=0x7f2bc0197c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:53.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.161+0000 7f2bbe59c640 1 --2- 172.21.15.67:0/303896037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bc0100b10 0x7f2bc0197c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.161+0000 7f2bbe59c640 1 -- 172.21.15.67:0/303896037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc019bfd0 con 0x7f2bc0100160 2024-08-31T05:28:53.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.161+0000 7f2bbe59c640 1 --2- 172.21.15.67:0/303896037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bc0100160 0x7f2bc0197700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0031460 tx=0x7f2bb0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:53.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.161+0000 7f2baf7fe640 1 -- 172.21.15.67:0/303896037 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2bb003f070 con 0x7f2bc0100160 2024-08-31T05:28:53.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.161+0000 7f2baf7fe640 1 -- 172.21.15.67:0/303896037 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bb00035f0 con 0x7f2bc0100160 2024-08-31T05:28:53.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.161+0000 7f2bc4b53640 1 -- 172.21.15.67:0/303896037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc019c260 con 0x7f2bc0100160 2024-08-31T05:28:53.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.161+0000 7f2baf7fe640 1 -- 172.21.15.67:0/303896037 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2bb0035030 con 0x7f2bc0100160 2024-08-31T05:28:53.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.161+0000 7f2bc4b53640 1 -- 172.21.15.67:0/303896037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc019c790 con 0x7f2bc0100160 2024-08-31T05:28:53.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.162+0000 7f2bc4b53640 1 -- 172.21.15.67:0/303896037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc0069b30 con 0x7f2bc0100160 2024-08-31T05:28:53.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.163+0000 7f2baf7fe640 1 -- 172.21.15.67:0/303896037 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f2bb0042070 con 0x7f2bc0100160 2024-08-31T05:28:53.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.163+0000 7f2baf7fe640 1 --2- 172.21.15.67:0/303896037 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ba8079e00 0x7f2ba807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:53.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.163+0000 7f2baf7fe640 1 -- 172.21.15.67:0/303896037 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6216+0+0 (secure 0 0 0) 0x7f2bb00bd310 con 0x7f2bc0100160 2024-08-31T05:28:53.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.163+0000 7f2bbdd9b640 1 --2- 172.21.15.67:0/303896037 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ba8079e00 0x7f2ba807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:53.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.164+0000 7f2bbdd9b640 1 --2- 172.21.15.67:0/303896037 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ba8079e00 0x7f2ba807c2c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00ff9f0 tx=0x7f2bb4005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:53.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.168+0000 7f2baf7fe640 1 -- 172.21.15.67:0/303896037 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2bb0088f00 con 0x7f2bc0100160 2024-08-31T05:28:53.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.364+0000 7f2bc4b53640 1 -- 172.21.15.67:0/303896037 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2bc019cb00 con 0x7f2ba8079e00 2024-08-31T05:28:53.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.374+0000 7f2baf7fe640 1 -- 172.21.15.67:0/303896037 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f2bc019cb00 con 0x7f2ba8079e00 2024-08-31T05:28:53.376 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:28:53.376 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (4m) 92s ago 15m 20.7M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:28:53.376 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (8m) 92s ago 15m 9021k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:28:53.376 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (7m) 28s ago 15m 8581k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (3m) 92s ago 15m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 910f4f105c4b 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (3m) 28s ago 14m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 0dcc86f98a20 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (4m) 92s ago 15m 77.9M - c8b91775d855 3a9a0f88928d 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (10m) 92s ago 10m 92.0M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (10m) 92s ago 10m 155M - 19.1.1-242-g244a32d3 395b9209a980 7abcc8555883 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (10m) 28s ago 10m 17.1M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (10m) 28s ago 10m 19.1M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (7m) 92s ago 16m 591M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (6m) 28s ago 14m 525M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (3m) 92s ago 17m 109M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 25a28efbbd37 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (3m) 28s ago 14m 103M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 6be0f0999860 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (5m) 92s ago 15m 10.2M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (5m) 28s ago 14m 10.5M - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (2m) 92s ago 13m 207M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 aab0516dcbfa 2024-08-31T05:28:53.377 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (2m) 92s ago 13m 152M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 fa9e3fb20c5e 2024-08-31T05:28:53.378 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (98s) 92s ago 12m 79.4M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 a62abe735da2 2024-08-31T05:28:53.378 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (63s) 28s ago 12m 157M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 9f4ce308ec1d 2024-08-31T05:28:53.378 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (31s) 28s ago 11m 80.5M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 5f02556c012d 2024-08-31T05:28:53.378 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (11m) 28s ago 11m 205M 2240M 19.1.1-242-g244a32d3 395b9209a980 228dbcbb3391 2024-08-31T05:28:53.378 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (5m) 92s ago 15m 55.7M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:28:53.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.376+0000 7f2bc4b53640 1 -- 172.21.15.67:0/303896037 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ba8079e00 msgr2=0x7f2ba807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.376+0000 7f2bc4b53640 1 --2- 172.21.15.67:0/303896037 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ba8079e00 0x7f2ba807c2c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00ff9f0 tx=0x7f2bb4005f90 comp rx=0 tx=0).stop 2024-08-31T05:28:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.376+0000 7f2bc4b53640 1 -- 172.21.15.67:0/303896037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bc0100160 msgr2=0x7f2bc0197700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.376+0000 7f2bc4b53640 1 --2- 172.21.15.67:0/303896037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bc0100160 0x7f2bc0197700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0031460 tx=0x7f2bb0004530 comp rx=0 tx=0).stop 2024-08-31T05:28:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.376+0000 7f2bc4b53640 1 -- 172.21.15.67:0/303896037 shutdown_connections 2024-08-31T05:28:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.376+0000 7f2bc4b53640 1 --2- 172.21.15.67:0/303896037 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ba8079e00 0x7f2ba807c2c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.376+0000 7f2bc4b53640 1 --2- 172.21.15.67:0/303896037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bc0100b10 0x7f2bc0197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.376+0000 7f2bc4b53640 1 --2- 172.21.15.67:0/303896037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2bc0100160 0x7f2bc0197700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.376+0000 7f2bc4b53640 1 -- 172.21.15.67:0/303896037 >> 172.21.15.67:0/303896037 conn(0x7f2bc0076ef0 msgr2=0x7f2bc00fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.377+0000 7f2bc4b53640 1 -- 172.21.15.67:0/303896037 shutdown_connections 2024-08-31T05:28:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.377+0000 7f2bc4b53640 1 -- 172.21.15.67:0/303896037 wait complete. 2024-08-31T05:28:53.432 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:53 smithi073 podman[89533]: 2024-08-31 05:28:53.10418457 +0000 UTC m=+0.635307639 container remove e59a4b7490444fe8bb0abdf5d8bf883e310b06961e2ec694a4fb99796fc2e23e (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-activate, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:28:53.432 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:53 smithi073 podman[89593]: 2024-08-31 05:28:53.212800007 +0000 UTC m=+0.015619566 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:28:53.432 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:53 smithi073 podman[89593]: 2024-08-31 05:28:53.321970519 +0000 UTC m=+0.124790120 container create 530ae5c5d1ac1c23295d5858d10f361af082aec089a59e0b247f777f3cc4e45e (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-31T05:28:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.458+0000 7f98a8507640 1 -- 172.21.15.67:0/3634798603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a01016b0 msgr2=0x7f98a0101b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.458+0000 7f98a8507640 1 --2- 172.21.15.67:0/3634798603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a01016b0 0x7f98a0101b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9890009880 tx=0x7f989002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.458+0000 7f98a8507640 1 -- 172.21.15.67:0/3634798603 shutdown_connections 2024-08-31T05:28:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.458+0000 7f98a8507640 1 --2- 172.21.15.67:0/3634798603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a01016b0 0x7f98a0101b10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.458+0000 7f98a8507640 1 --2- 172.21.15.67:0/3634798603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a01076b0 0x7f98a0107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.458+0000 7f98a8507640 1 -- 172.21.15.67:0/3634798603 >> 172.21.15.67:0/3634798603 conn(0x7f98a00fd3b0 msgr2=0x7f98a00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.458+0000 7f98a8507640 1 -- 172.21.15.67:0/3634798603 shutdown_connections 2024-08-31T05:28:53.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.458+0000 7f98a8507640 1 -- 172.21.15.67:0/3634798603 wait complete. 2024-08-31T05:28:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.459+0000 7f98a8507640 1 Processor -- start 2024-08-31T05:28:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.459+0000 7f98a8507640 1 -- start start 2024-08-31T05:28:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.459+0000 7f98a8507640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a01016b0 0x7f98a019d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.459+0000 7f98a8507640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a01076b0 0x7f98a019d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.459+0000 7f98a8507640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f98a010eb80 con 0x7f98a01016b0 2024-08-31T05:28:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.459+0000 7f98a8507640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f98a010ea00 con 0x7f98a01076b0 2024-08-31T05:28:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.459+0000 7f98a62a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a01016b0 0x7f98a019d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.459+0000 7f98a62a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a01016b0 0x7f98a019d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41140/0 (socket says 172.21.15.67:41140) 2024-08-31T05:28:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.459+0000 7f98a62a3640 1 -- 172.21.15.67:0/2720981413 learned_addr learned my addr 172.21.15.67:0/2720981413 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:28:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.460+0000 7f98a62a3640 1 -- 172.21.15.67:0/2720981413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a01076b0 msgr2=0x7f98a019d910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T05:28:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.460+0000 7f98a62a3640 1 --2- 172.21.15.67:0/2720981413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a01076b0 0x7f98a019d910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.460+0000 7f98a62a3640 1 -- 172.21.15.67:0/2720981413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a0197590 con 0x7f98a01016b0 2024-08-31T05:28:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.460+0000 7f98a62a3640 1 --2- 172.21.15.67:0/2720981413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a01016b0 0x7f98a019d3d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f989c00e970 tx=0x7f989c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:53.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.460+0000 7f98977fe640 1 -- 172.21.15.67:0/2720981413 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f989c00cac0 con 0x7f98a01016b0 2024-08-31T05:28:53.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.460+0000 7f98a8507640 1 -- 172.21.15.67:0/2720981413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a0197880 con 0x7f98a01016b0 2024-08-31T05:28:53.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.460+0000 7f98977fe640 1 -- 172.21.15.67:0/2720981413 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f989c0054e0 con 0x7f98a01016b0 2024-08-31T05:28:53.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.460+0000 7f98977fe640 1 -- 172.21.15.67:0/2720981413 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f989c010430 con 0x7f98a01016b0 2024-08-31T05:28:53.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.460+0000 7f98a8507640 1 -- 172.21.15.67:0/2720981413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a0197e10 con 0x7f98a01016b0 2024-08-31T05:28:53.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.461+0000 7f98a8507640 1 -- 172.21.15.67:0/2720981413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a0102df0 con 0x7f98a01016b0 2024-08-31T05:28:53.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.462+0000 7f98977fe640 1 -- 172.21.15.67:0/2720981413 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f989c004e80 con 0x7f98a01016b0 2024-08-31T05:28:53.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.462+0000 7f98977fe640 1 --2- 172.21.15.67:0/2720981413 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f988c079e00 0x7f988c07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:53.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.462+0000 7f98977fe640 1 -- 172.21.15.67:0/2720981413 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6216+0+0 (secure 0 0 0) 0x7f989c09d0a0 con 0x7f98a01016b0 2024-08-31T05:28:53.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.462+0000 7f98a5aa2640 1 --2- 172.21.15.67:0/2720981413 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f988c079e00 0x7f988c07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:53.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.463+0000 7f98a5aa2640 1 --2- 172.21.15.67:0/2720981413 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f988c079e00 0x7f988c07c2c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9890031460 tx=0x7f9890000bc0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:53.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.467+0000 7f98977fe640 1 -- 172.21.15.67:0/2720981413 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f989c064b20 con 0x7f98a01016b0 2024-08-31T05:28:53.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.727+0000 7f98a8507640 1 -- 172.21.15.67:0/2720981413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f98a0109c20 con 0x7f98a01016b0 2024-08-31T05:28:53.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.728+0000 7f98977fe640 1 -- 172.21.15.67:0/2720981413 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+730 (secure 0 0 0) 0x7f989c069e20 con 0x7f98a01016b0 2024-08-31T05:28:53.730 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:28:53.730 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:28:53.730 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:28:53.730 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:28:53.730 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:28:53.730 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:28:53.730 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:28:53.730 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:28:53.730 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 5 2024-08-31T05:28:53.730 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:28:53.730 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:28:53.730 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4 2024-08-31T05:28:53.730 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:28:53.730 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:28:53.731 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 4, 2024-08-31T05:28:53.731 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 9 2024-08-31T05:28:53.731 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:28:53.731 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:28:53.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.730+0000 7f98a8507640 1 -- 172.21.15.67:0/2720981413 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f988c079e00 msgr2=0x7f988c07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:53.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.730+0000 7f98a8507640 1 --2- 172.21.15.67:0/2720981413 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f988c079e00 0x7f988c07c2c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9890031460 tx=0x7f9890000bc0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.730+0000 7f98a8507640 1 -- 172.21.15.67:0/2720981413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a01016b0 msgr2=0x7f98a019d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:53.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.730+0000 7f98a8507640 1 --2- 172.21.15.67:0/2720981413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a01016b0 0x7f98a019d3d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f989c00e970 tx=0x7f989c00ed70 comp rx=0 tx=0).stop 2024-08-31T05:28:53.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.730+0000 7f98a8507640 1 -- 172.21.15.67:0/2720981413 shutdown_connections 2024-08-31T05:28:53.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.730+0000 7f98a8507640 1 --2- 172.21.15.67:0/2720981413 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f988c079e00 0x7f988c07c2c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.730+0000 7f98a8507640 1 --2- 172.21.15.67:0/2720981413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98a01076b0 0x7f98a019d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.730+0000 7f98a8507640 1 --2- 172.21.15.67:0/2720981413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98a01016b0 0x7f98a019d3d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.730+0000 7f98a8507640 1 -- 172.21.15.67:0/2720981413 >> 172.21.15.67:0/2720981413 conn(0x7f98a00fd3b0 msgr2=0x7f98a00fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:53.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.730+0000 7f98a8507640 1 -- 172.21.15.67:0/2720981413 shutdown_connections 2024-08-31T05:28:53.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.730+0000 7f98a8507640 1 -- 172.21.15.67:0/2720981413 wait complete. 2024-08-31T05:28:53.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.814+0000 7f42f76a7640 1 -- 172.21.15.67:0/2126848526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f01016a0 msgr2=0x7f42f0101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:53.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.814+0000 7f42f76a7640 1 --2- 172.21.15.67:0/2126848526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f01016a0 0x7f42f0101b00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009880 tx=0x7f42e002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.814+0000 7f42f76a7640 1 -- 172.21.15.67:0/2126848526 shutdown_connections 2024-08-31T05:28:53.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.814+0000 7f42f76a7640 1 --2- 172.21.15.67:0/2126848526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f01016a0 0x7f42f0101b00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.814+0000 7f42f76a7640 1 --2- 172.21.15.67:0/2126848526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f01076a0 0x7f42f0107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.814+0000 7f42f76a7640 1 -- 172.21.15.67:0/2126848526 >> 172.21.15.67:0/2126848526 conn(0x7f42f00fd3a0 msgr2=0x7f42f00ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:53.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.814+0000 7f42f76a7640 1 -- 172.21.15.67:0/2126848526 shutdown_connections 2024-08-31T05:28:53.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.814+0000 7f42f76a7640 1 -- 172.21.15.67:0/2126848526 wait complete. 2024-08-31T05:28:53.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.815+0000 7f42f76a7640 1 Processor -- start 2024-08-31T05:28:53.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.815+0000 7f42f76a7640 1 -- start start 2024-08-31T05:28:53.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.815+0000 7f42f76a7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f01016a0 0x7f42f019d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:53.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.815+0000 7f42f76a7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f01076a0 0x7f42f019d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:53.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.815+0000 7f42f76a7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f42f010eb70 con 0x7f42f01076a0 2024-08-31T05:28:53.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.815+0000 7f42f76a7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f42f010e9f0 con 0x7f42f01016a0 2024-08-31T05:28:53.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.815+0000 7f42f4c42640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f01076a0 0x7f42f019d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:53.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.815+0000 7f42f4c42640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f01076a0 0x7f42f019d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41156/0 (socket says 172.21.15.67:41156) 2024-08-31T05:28:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.815+0000 7f42f4c42640 1 -- 172.21.15.67:0/3435234253 learned_addr learned my addr 172.21.15.67:0/3435234253 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:28:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.815+0000 7f42f5443640 1 --2- 172.21.15.67:0/3435234253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f01016a0 0x7f42f019d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.815+0000 7f42f4c42640 1 -- 172.21.15.67:0/3435234253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f01016a0 msgr2=0x7f42f019d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.815+0000 7f42f4c42640 1 --2- 172.21.15.67:0/3435234253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f01016a0 0x7f42f019d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.815+0000 7f42f4c42640 1 -- 172.21.15.67:0/3435234253 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f01975a0 con 0x7f42f01076a0 2024-08-31T05:28:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.815+0000 7f42f5443640 1 --2- 172.21.15.67:0/3435234253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f01016a0 0x7f42f019d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:28:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.816+0000 7f42f4c42640 1 --2- 172.21.15.67:0/3435234253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f01076a0 0x7f42f019d920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f42e0031460 tx=0x7f42e0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.816+0000 7f42e67fc640 1 -- 172.21.15.67:0/3435234253 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42e003f070 con 0x7f42f01076a0 2024-08-31T05:28:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.816+0000 7f42e67fc640 1 -- 172.21.15.67:0/3435234253 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42e00035f0 con 0x7f42f01076a0 2024-08-31T05:28:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.816+0000 7f42f76a7640 1 -- 172.21.15.67:0/3435234253 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f0197830 con 0x7f42f01076a0 2024-08-31T05:28:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.816+0000 7f42e67fc640 1 -- 172.21.15.67:0/3435234253 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42e0035030 con 0x7f42f01076a0 2024-08-31T05:28:53.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.816+0000 7f42f76a7640 1 -- 172.21.15.67:0/3435234253 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f0197d60 con 0x7f42f01076a0 2024-08-31T05:28:53.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.817+0000 7f42f76a7640 1 -- 172.21.15.67:0/3435234253 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f0102de0 con 0x7f42f01076a0 2024-08-31T05:28:53.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.818+0000 7f42e67fc640 1 -- 172.21.15.67:0/3435234253 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f42e0042070 con 0x7f42f01076a0 2024-08-31T05:28:53.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.818+0000 7f42e67fc640 1 --2- 172.21.15.67:0/3435234253 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f42dc079e00 0x7f42dc07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:53.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.818+0000 7f42e67fc640 1 -- 172.21.15.67:0/3435234253 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6216+0+0 (secure 0 0 0) 0x7f42e00bd270 con 0x7f42f01076a0 2024-08-31T05:28:53.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.818+0000 7f42f5443640 1 --2- 172.21.15.67:0/3435234253 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f42dc079e00 0x7f42dc07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:53.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.819+0000 7f42f5443640 1 --2- 172.21.15.67:0/3435234253 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f42dc079e00 0x7f42dc07c2c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009fc0 tx=0x7f42ec005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:53.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:53.823+0000 7f42e67fc640 1 -- 172.21.15.67:0/3435234253 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f42e0088e60 con 0x7f42f01076a0 2024-08-31T05:28:53.946 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:53 smithi073 podman[89593]: 2024-08-31 05:28:53.549251015 +0000 UTC m=+0.352070577 container init 530ae5c5d1ac1c23295d5858d10f361af082aec089a59e0b247f777f3cc4e45e (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-31T05:28:53.946 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:53 smithi073 podman[89593]: 2024-08-31 05:28:53.552332504 +0000 UTC m=+0.355152059 container start 530ae5c5d1ac1c23295d5858d10f361af082aec089a59e0b247f777f3cc4e45e (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-31T05:28:53.946 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:53 smithi073 ceph-osd[89612]: -- 172.21.15.73:0/2483053841 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559d716c61e0 con 0x559d709b8d00 2024-08-31T05:28:53.946 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:53 smithi073 bash[89593]: 530ae5c5d1ac1c23295d5858d10f361af082aec089a59e0b247f777f3cc4e45e 2024-08-31T05:28:53.946 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:53 smithi073 systemd[1]: Started Ceph osd.5 for 5fd95148-6757-11ef-bcd4-c7b262605968. 2024-08-31T05:28:54.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.044+0000 7f42f76a7640 1 -- 172.21.15.67:0/3435234253 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f42f0198ad0 con 0x7f42f01076a0 2024-08-31T05:28:54.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.044+0000 7f42e67fc640 1 -- 172.21.15.67:0/3435234253 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2042 (secure 0 0 0) 0x7f42e008d880 con 0x7f42f01076a0 2024-08-31T05:28:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:e15 2024-08-31T05:28:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-08-31T05:18:35:124059+0000 2024-08-31T05:28:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:28:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:28:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-08-31T05:28:54.047 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:28:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:28:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-08-31T05:28:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 13 2024-08-31T05:28:54.047 INFO:teuthology.orchestra.run.smithi067.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T05:28:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:28:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-08-31T05:18:33.086400+0000 2024-08-31T05:28:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-08-31T05:28:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-08-31T05:28:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2024-08-31T05:28:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-08-31T05:28:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-08-31T05:28:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-08-31T05:28:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-08-31T05:28:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-08-31T05:28:54.048 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 0 2024-08-31T05:28:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:28:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2024-08-31T05:28:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:in 0 2024-08-31T05:28:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14554} 2024-08-31T05:28:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-08-31T05:28:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-08-31T05:28:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-08-31T05:28:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-08-31T05:28:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-08-31T05:28:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data enabled 2024-08-31T05:28:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-08-31T05:28:54.049 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-08-31T05:28:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2024-08-31T05:28:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 14554 members: 14554 2024-08-31T05:28:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.tskvpt{0:14554} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/2961844124,v1:172.21.15.67:6827/2961844124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:28:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.beqeql{0:14566} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.67:6828/1181644963,v1:172.21.15.67:6829/1181644963] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:28:54.050 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:28:54.050 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:28:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2024-08-31T05:28:54.050 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:28:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.kfbmeo{-1:24299} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:28:54.050 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.gsnhxi{-1:24307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6824/2383176383,v1:172.21.15.73:6825/2383176383] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:28:54.053 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-08-31T05:28:54.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.047+0000 7f42f76a7640 1 -- 172.21.15.67:0/3435234253 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f42dc079e00 msgr2=0x7f42dc07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.047+0000 7f42f76a7640 1 --2- 172.21.15.67:0/3435234253 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f42dc079e00 0x7f42dc07c2c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009fc0 tx=0x7f42ec005f90 comp rx=0 tx=0).stop 2024-08-31T05:28:54.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.047+0000 7f42f76a7640 1 -- 172.21.15.67:0/3435234253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f01076a0 msgr2=0x7f42f019d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.047+0000 7f42f76a7640 1 --2- 172.21.15.67:0/3435234253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f01076a0 0x7f42f019d920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f42e0031460 tx=0x7f42e0004530 comp rx=0 tx=0).stop 2024-08-31T05:28:54.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.047+0000 7f42f76a7640 1 -- 172.21.15.67:0/3435234253 shutdown_connections 2024-08-31T05:28:54.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.047+0000 7f42f76a7640 1 --2- 172.21.15.67:0/3435234253 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f42dc079e00 0x7f42dc07c2c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.047+0000 7f42f76a7640 1 --2- 172.21.15.67:0/3435234253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f01076a0 0x7f42f019d920 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.047+0000 7f42f76a7640 1 --2- 172.21.15.67:0/3435234253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f01016a0 0x7f42f019d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.047+0000 7f42f76a7640 1 -- 172.21.15.67:0/3435234253 >> 172.21.15.67:0/3435234253 conn(0x7f42f00fd3a0 msgr2=0x7f42f00fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:54.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.047+0000 7f42f76a7640 1 -- 172.21.15.67:0/3435234253 shutdown_connections 2024-08-31T05:28:54.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.047+0000 7f42f76a7640 1 -- 172.21.15.67:0/3435234253 wait complete. 2024-08-31T05:28:54.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.131+0000 7f9b4f3da640 1 -- 172.21.15.67:0/1977319294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b481016a0 msgr2=0x7f9b48101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.131+0000 7f9b4f3da640 1 --2- 172.21.15.67:0/1977319294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b481016a0 0x7f9b48101b00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009880 tx=0x7f9b3c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.131+0000 7f9b4f3da640 1 -- 172.21.15.67:0/1977319294 shutdown_connections 2024-08-31T05:28:54.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.131+0000 7f9b4f3da640 1 --2- 172.21.15.67:0/1977319294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b481016a0 0x7f9b48101b00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.131+0000 7f9b4f3da640 1 --2- 172.21.15.67:0/1977319294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b481076a0 0x7f9b48107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.131+0000 7f9b4f3da640 1 -- 172.21.15.67:0/1977319294 >> 172.21.15.67:0/1977319294 conn(0x7f9b480fd3a0 msgr2=0x7f9b480ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:54.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.131+0000 7f9b4f3da640 1 -- 172.21.15.67:0/1977319294 shutdown_connections 2024-08-31T05:28:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.131+0000 7f9b4f3da640 1 -- 172.21.15.67:0/1977319294 wait complete. 2024-08-31T05:28:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.132+0000 7f9b4f3da640 1 Processor -- start 2024-08-31T05:28:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.132+0000 7f9b4f3da640 1 -- start start 2024-08-31T05:28:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.132+0000 7f9b4f3da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b481016a0 0x7f9b48074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.132+0000 7f9b4f3da640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b481076a0 0x7f9b480747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.132+0000 7f9b4f3da640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4810eb70 con 0x7f9b481076a0 2024-08-31T05:28:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.132+0000 7f9b4f3da640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4810e9f0 con 0x7f9b481016a0 2024-08-31T05:28:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.132+0000 7f9b4c975640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b481076a0 0x7f9b480747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.132+0000 7f9b4c975640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b481076a0 0x7f9b480747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41174/0 (socket says 172.21.15.67:41174) 2024-08-31T05:28:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.132+0000 7f9b4d176640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b481016a0 0x7f9b48074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:54.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.132+0000 7f9b4c975640 1 -- 172.21.15.67:0/4061419440 learned_addr learned my addr 172.21.15.67:0/4061419440 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:28:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.133+0000 7f9b4c975640 1 -- 172.21.15.67:0/4061419440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b481016a0 msgr2=0x7f9b48074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.133+0000 7f9b4c975640 1 --2- 172.21.15.67:0/4061419440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b481016a0 0x7f9b48074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.133+0000 7f9b4c975640 1 -- 172.21.15.67:0/4061419440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b48074d10 con 0x7f9b481076a0 2024-08-31T05:28:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.133+0000 7f9b4d176640 1 --2- 172.21.15.67:0/4061419440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b481016a0 0x7f9b48074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:28:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.133+0000 7f9b4c975640 1 --2- 172.21.15.67:0/4061419440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b481076a0 0x7f9b480747d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c031460 tx=0x7f9b3c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.133+0000 7f9b3a7fc640 1 -- 172.21.15.67:0/4061419440 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b3c03f070 con 0x7f9b481076a0 2024-08-31T05:28:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.133+0000 7f9b3a7fc640 1 -- 172.21.15.67:0/4061419440 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9b3c0035f0 con 0x7f9b481076a0 2024-08-31T05:28:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.133+0000 7f9b4f3da640 1 -- 172.21.15.67:0/4061419440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b48074fa0 con 0x7f9b481076a0 2024-08-31T05:28:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.133+0000 7f9b3a7fc640 1 -- 172.21.15.67:0/4061419440 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b3c035030 con 0x7f9b481076a0 2024-08-31T05:28:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.133+0000 7f9b4f3da640 1 -- 172.21.15.67:0/4061419440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b481a3b00 con 0x7f9b481076a0 2024-08-31T05:28:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.134+0000 7f9b4f3da640 1 -- 172.21.15.67:0/4061419440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b48102de0 con 0x7f9b481076a0 2024-08-31T05:28:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.135+0000 7f9b3a7fc640 1 -- 172.21.15.67:0/4061419440 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f9b3c042070 con 0x7f9b481076a0 2024-08-31T05:28:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.135+0000 7f9b3a7fc640 1 --2- 172.21.15.67:0/4061419440 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9b34079e40 0x7f9b3407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.135+0000 7f9b3a7fc640 1 -- 172.21.15.67:0/4061419440 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6216+0+0 (secure 0 0 0) 0x7f9b3c0bd1d0 con 0x7f9b481076a0 2024-08-31T05:28:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.135+0000 7f9b4d176640 1 --2- 172.21.15.67:0/4061419440 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9b34079e40 0x7f9b3407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.136+0000 7f9b4d176640 1 --2- 172.21.15.67:0/4061419440 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9b34079e40 0x7f9b3407c300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009fc0 tx=0x7f9b44005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:54.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.140+0000 7f9b3a7fc640 1 -- 172.21.15.67:0/4061419440 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9b3c088e40 con 0x7f9b481076a0 2024-08-31T05:28:54.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.344+0000 7f9b4f3da640 1 -- 172.21.15.67:0/4061419440 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9b480623d0 con 0x7f9b34079e40 2024-08-31T05:28:54.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.345+0000 7f9b3a7fc640 1 -- 172.21.15.67:0/4061419440 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f9b480623d0 con 0x7f9b34079e40 2024-08-31T05:28:54.347 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:28:54.347 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:28:54.347 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:28:54.347 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-31T05:28:54.347 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:28:54.348 INFO:teuthology.orchestra.run.smithi067.stdout: "mon", 2024-08-31T05:28:54.348 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2024-08-31T05:28:54.348 INFO:teuthology.orchestra.run.smithi067.stdout: "crash" 2024-08-31T05:28:54.348 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:28:54.348 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "11/23 daemons upgraded", 2024-08-31T05:28:54.348 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading osd daemons", 2024-08-31T05:28:54.348 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:28:54.348 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:28:54.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.347+0000 7f9b4f3da640 1 -- 172.21.15.67:0/4061419440 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9b34079e40 msgr2=0x7f9b3407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.347+0000 7f9b4f3da640 1 --2- 172.21.15.67:0/4061419440 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9b34079e40 0x7f9b3407c300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009fc0 tx=0x7f9b44005f90 comp rx=0 tx=0).stop 2024-08-31T05:28:54.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.347+0000 7f9b4f3da640 1 -- 172.21.15.67:0/4061419440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b481076a0 msgr2=0x7f9b480747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.347+0000 7f9b4f3da640 1 --2- 172.21.15.67:0/4061419440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b481076a0 0x7f9b480747d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c031460 tx=0x7f9b3c004530 comp rx=0 tx=0).stop 2024-08-31T05:28:54.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.347+0000 7f9b4f3da640 1 -- 172.21.15.67:0/4061419440 shutdown_connections 2024-08-31T05:28:54.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.347+0000 7f9b4f3da640 1 --2- 172.21.15.67:0/4061419440 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9b34079e40 0x7f9b3407c300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.347+0000 7f9b4f3da640 1 --2- 172.21.15.67:0/4061419440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b481076a0 0x7f9b480747d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.347+0000 7f9b4f3da640 1 --2- 172.21.15.67:0/4061419440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b481016a0 0x7f9b48074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.347+0000 7f9b4f3da640 1 -- 172.21.15.67:0/4061419440 >> 172.21.15.67:0/4061419440 conn(0x7f9b480fd3a0 msgr2=0x7f9b480fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:54.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.347+0000 7f9b4f3da640 1 -- 172.21.15.67:0/4061419440 shutdown_connections 2024-08-31T05:28:54.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.347+0000 7f9b4f3da640 1 -- 172.21.15.67:0/4061419440 wait complete. 2024-08-31T05:28:54.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.430+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/2664092410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4102860 msgr2=0x7fe2f4102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.430+0000 7fe2fbc7e640 1 --2- 172.21.15.67:0/2664092410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4102860 0x7fe2f4102c40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009880 tx=0x7fe2f002a530 comp rx=0 tx=0).stop 2024-08-31T05:28:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.430+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/2664092410 shutdown_connections 2024-08-31T05:28:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.430+0000 7fe2fbc7e640 1 --2- 172.21.15.67:0/2664092410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f4103180 0x7fe2f410b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.430+0000 7fe2fbc7e640 1 --2- 172.21.15.67:0/2664092410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4102860 0x7fe2f4102c40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.430+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/2664092410 >> 172.21.15.67:0/2664092410 conn(0x7fe2f40fc2c0 msgr2=0x7fe2f40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.430+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/2664092410 shutdown_connections 2024-08-31T05:28:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.430+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/2664092410 wait complete. 2024-08-31T05:28:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.431+0000 7fe2fbc7e640 1 Processor -- start 2024-08-31T05:28:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.431+0000 7fe2fbc7e640 1 -- start start 2024-08-31T05:28:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.431+0000 7fe2fbc7e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4102860 0x7fe2f41004c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.431+0000 7fe2fbc7e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f4103180 0x7fe2f4100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.431+0000 7fe2fbc7e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f410eb90 con 0x7fe2f4102860 2024-08-31T05:28:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.431+0000 7fe2fbc7e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f410ea10 con 0x7fe2f4103180 2024-08-31T05:28:54.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.431+0000 7fe2f9a1a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4102860 0x7fe2f41004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:54.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.431+0000 7fe2f9a1a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4102860 0x7fe2f41004c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41198/0 (socket says 172.21.15.67:41198) 2024-08-31T05:28:54.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.431+0000 7fe2f9a1a640 1 -- 172.21.15.67:0/605076345 learned_addr learned my addr 172.21.15.67:0/605076345 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:28:54.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.431+0000 7fe2f9219640 1 --2- 172.21.15.67:0/605076345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f4103180 0x7fe2f4100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:54.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.432+0000 7fe2f9a1a640 1 -- 172.21.15.67:0/605076345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f4103180 msgr2=0x7fe2f4100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.432+0000 7fe2f9a1a640 1 --2- 172.21.15.67:0/605076345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f4103180 0x7fe2f4100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.432+0000 7fe2f9a1a640 1 -- 172.21.15.67:0/605076345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f4100f40 con 0x7fe2f4102860 2024-08-31T05:28:54.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.432+0000 7fe2f9a1a640 1 --2- 172.21.15.67:0/605076345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4102860 0x7fe2f41004c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0031460 tx=0x7fe2f00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:54.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.432+0000 7fe2eaffd640 1 -- 172.21.15.67:0/605076345 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2f003f070 con 0x7fe2f4102860 2024-08-31T05:28:54.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.432+0000 7fe2eaffd640 1 -- 172.21.15.67:0/605076345 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2f00035f0 con 0x7fe2f4102860 2024-08-31T05:28:54.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.432+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/605076345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f41011d0 con 0x7fe2f4102860 2024-08-31T05:28:54.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.432+0000 7fe2eaffd640 1 -- 172.21.15.67:0/605076345 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2f0035030 con 0x7fe2f4102860 2024-08-31T05:28:54.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.432+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/605076345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f41a3b40 con 0x7fe2f4102860 2024-08-31T05:28:54.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.433+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/605076345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f406a830 con 0x7fe2f4102860 2024-08-31T05:28:54.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.434+0000 7fe2eaffd640 1 -- 172.21.15.67:0/605076345 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fe2f0042070 con 0x7fe2f4102860 2024-08-31T05:28:54.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.434+0000 7fe2eaffd640 1 --2- 172.21.15.67:0/605076345 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe2e0079e40 0x7fe2e007c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:54.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.434+0000 7fe2eaffd640 1 -- 172.21.15.67:0/605076345 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6216+0+0 (secure 0 0 0) 0x7fe2f00bd220 con 0x7fe2f4102860 2024-08-31T05:28:54.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.434+0000 7fe2f9219640 1 --2- 172.21.15.67:0/605076345 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe2e0079e40 0x7fe2e007c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:54.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.435+0000 7fe2f9219640 1 --2- 172.21.15.67:0/605076345 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe2e0079e40 0x7fe2e007c300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4101f50 tx=0x7fe2e400b2e0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:54.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.439+0000 7fe2eaffd640 1 -- 172.21.15.67:0/605076345 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe2f0088e90 con 0x7fe2f4102860 2024-08-31T05:28:54.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.702+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/605076345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe2f4105d30 con 0x7fe2f4102860 2024-08-31T05:28:54.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.702+0000 7fe2eaffd640 1 -- 172.21.15.67:0/605076345 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1110 (secure 0 0 0) 0x7fe2f008d8b0 con 0x7fe2f4102860 2024-08-31T05:28:54.704 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 2 pgs peering; Degraded data redundancy: 25/276 objects degraded (9.058%), 7 pgs degraded 2024-08-31T05:28:54.704 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:28:54.704 INFO:teuthology.orchestra.run.smithi067.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:28:54.704 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-31T05:28:54.704 INFO:teuthology.orchestra.run.smithi067.stdout: osd.5 (root=default,host=smithi073) is down 2024-08-31T05:28:54.704 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 2 pgs peering 2024-08-31T05:28:54.704 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.16 is stuck peering for 6m, current state peering, last acting [3,2] 2024-08-31T05:28:54.705 INFO:teuthology.orchestra.run.smithi067.stdout: pg 3.f is stuck peering for 5m, current state peering, last acting [3,0] 2024-08-31T05:28:54.705 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 25/276 objects degraded (9.058%), 7 pgs degraded 2024-08-31T05:28:54.705 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-08-31T05:28:54.705 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.b is active+undersized+degraded, acting [0,4] 2024-08-31T05:28:54.705 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-08-31T05:28:54.705 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.14 is active+undersized+degraded, acting [0,4] 2024-08-31T05:28:54.705 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-08-31T05:28:54.705 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-08-31T05:28:54.705 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-08-31T05:28:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.704+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/605076345 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe2e0079e40 msgr2=0x7fe2e007c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.704+0000 7fe2fbc7e640 1 --2- 172.21.15.67:0/605076345 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe2e0079e40 0x7fe2e007c300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4101f50 tx=0x7fe2e400b2e0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.704+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/605076345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4102860 msgr2=0x7fe2f41004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.704+0000 7fe2fbc7e640 1 --2- 172.21.15.67:0/605076345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4102860 0x7fe2f41004c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0031460 tx=0x7fe2f00045e0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.704+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/605076345 shutdown_connections 2024-08-31T05:28:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.704+0000 7fe2fbc7e640 1 --2- 172.21.15.67:0/605076345 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe2e0079e40 0x7fe2e007c300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.704+0000 7fe2fbc7e640 1 --2- 172.21.15.67:0/605076345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f4103180 0x7fe2f4100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.704+0000 7fe2fbc7e640 1 --2- 172.21.15.67:0/605076345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2f4102860 0x7fe2f41004c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.704+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/605076345 >> 172.21.15.67:0/605076345 conn(0x7fe2f40fc2c0 msgr2=0x7fe2f4108c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:54.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.704+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/605076345 shutdown_connections 2024-08-31T05:28:54.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:28:54.704+0000 7fe2fbc7e640 1 -- 172.21.15.67:0/605076345 wait complete. 2024-08-31T05:28:54.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:54 smithi073 ceph-mon[71452]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:54.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:54 smithi073 ceph-mon[71452]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:54.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:54.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:54.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:28:54.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:54 smithi073 ceph-mon[71452]: pgmap v248: 65 pgs: 13 active+undersized, 8 peering, 1 stale+active+clean, 7 active+undersized+degraded, 36 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 1 op/s; 25/276 objects degraded (9.058%) 2024-08-31T05:28:54.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:54 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2720981413' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:28:54.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:54 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3435234253' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:28:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:54 smithi067 ceph-mon[99941]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:54 smithi067 ceph-mon[99941]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:28:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:54 smithi067 ceph-mon[99941]: pgmap v248: 65 pgs: 13 active+undersized, 8 peering, 1 stale+active+clean, 7 active+undersized+degraded, 36 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 1 op/s; 25/276 objects degraded (9.058%) 2024-08-31T05:28:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:54 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2720981413' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:28:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:54 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3435234253' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:28:55.445 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:28:55 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:28:55.227+0000 7f847bf41640 -1 Falling back to public interface 2024-08-31T05:28:55.935 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:55 smithi073 ceph-mon[71452]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:55.935 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:55 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/605076345' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:28:56.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:55 smithi067 ceph-mon[99941]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:56.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:55 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/605076345' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:28:56.942 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:56 smithi067 ceph-mon[99941]: pgmap v249: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 42/276 objects degraded (15.217%) 2024-08-31T05:28:56.942 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:56 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:56.942 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:56 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:56.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:56 smithi073 ceph-mon[71452]: pgmap v249: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 42/276 objects degraded (15.217%) 2024-08-31T05:28:56.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:56 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:56.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:56 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:57.931 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:57 smithi073 ceph-mon[71452]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-08-31T05:28:57.932 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:57 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:57.932 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:57 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:57.932 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:57 smithi073 ceph-mon[71452]: Health check update: Degraded data redundancy: 42/276 objects degraded (15.217%), 13 pgs degraded (PG_DEGRADED) 2024-08-31T05:28:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:57 smithi067 ceph-mon[99941]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-08-31T05:28:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:57 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:57 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:28:58.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:57 smithi067 ceph-mon[99941]: Health check update: Degraded data redundancy: 42/276 objects degraded (15.217%), 13 pgs degraded (PG_DEGRADED) 2024-08-31T05:28:58.838 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:28:58 smithi073 ceph-mon[71452]: pgmap v250: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 42/276 objects degraded (15.217%) 2024-08-31T05:28:59.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:28:58 smithi067 ceph-mon[99941]: pgmap v250: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 42/276 objects degraded (15.217%) 2024-08-31T05:29:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: pgmap v251: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 42/276 objects degraded (15.217%) 2024-08-31T05:29:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-08-31T05:29:01.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-08-31T05:29:01.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-08-31T05:29:01.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-08-31T05:29:01.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-08-31T05:29:01.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-08-31T05:29:01.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:01.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:00 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-08-31T05:29:01.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:29:00.964+0000 7f847bf41640 -1 osd.5 85 log_to_monitors true 2024-08-31T05:29:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: pgmap v251: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 42/276 objects degraded (15.217%) 2024-08-31T05:29:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:29:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-08-31T05:29:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-08-31T05:29:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-08-31T05:29:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-08-31T05:29:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-08-31T05:29:01.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-08-31T05:29:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-08-31T05:29:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-08-31T05:29:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-08-31T05:29:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-08-31T05:29:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-08-31T05:29:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-08-31T05:29:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:01.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:00 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-08-31T05:29:01.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: Upgrade: Setting container_image for all osd 2024-08-31T05:29:01.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-08-31T05:29:01.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: osdmap e88: 6 total, 5 up, 6 in 2024-08-31T05:29:01.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: from='osd.5 [v2:172.21.15.73:6816/4053532830,v1:172.21.15.73:6817/4053532830]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:29:01.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:29:01.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-08-31T05:29:01.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 2 up:standby 2024-08-31T05:29:01.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:01.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:01.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:29:01.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:01.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:01.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:01.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:01.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:01.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:01 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: Upgrade: Setting container_image for all osd 2024-08-31T05:29:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-08-31T05:29:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: osdmap e88: 6 total, 5 up, 6 in 2024-08-31T05:29:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: from='osd.5 [v2:172.21.15.73:6816/4053532830,v1:172.21.15.73:6817/4053532830]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:29:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:29:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-08-31T05:29:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 2 up:standby 2024-08-31T05:29:02.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:02.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:02.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:29:02.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:02.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:02.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:02.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:02.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:02.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:01 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:03.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:02 smithi067 ceph-mon[99941]: pgmap v253: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 42/276 objects degraded (15.217%) 2024-08-31T05:29:03.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:02 smithi067 ceph-mon[99941]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T05:29:03.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:02 smithi067 ceph-mon[99941]: osdmap e89: 6 total, 5 up, 6 in 2024-08-31T05:29:03.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:02 smithi067 ceph-mon[99941]: from='osd.5 [v2:172.21.15.73:6816/4053532830,v1:172.21.15.73:6817/4053532830]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-08-31T05:29:03.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:02 smithi067 ceph-mon[99941]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-08-31T05:29:03.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:02 smithi067 ceph-mon[99941]: mds.? [v2:172.21.15.67:6828/57850643,v1:172.21.15.67:6829/57850643] up:boot 2024-08-31T05:29:03.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:02 smithi067 ceph-mon[99941]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 3 up:standby 2024-08-31T05:29:03.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:02 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mds metadata", "who": "cephfs.smithi067.beqeql"} : dispatch 2024-08-31T05:29:03.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:02 smithi067 ceph-mon[99941]: from='osd.5 ' entity='osd.5' 2024-08-31T05:29:03.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:29:02 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:29:02.698+0000 7f846fcb9640 -1 osd.5 85 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:29:03.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:02 smithi073 ceph-mon[71452]: pgmap v253: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 274 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 42/276 objects degraded (15.217%) 2024-08-31T05:29:03.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:02 smithi073 ceph-mon[71452]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T05:29:03.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:02 smithi073 ceph-mon[71452]: osdmap e89: 6 total, 5 up, 6 in 2024-08-31T05:29:03.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:02 smithi073 ceph-mon[71452]: from='osd.5 [v2:172.21.15.73:6816/4053532830,v1:172.21.15.73:6817/4053532830]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-08-31T05:29:03.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:02 smithi073 ceph-mon[71452]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-08-31T05:29:03.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:02 smithi073 ceph-mon[71452]: mds.? [v2:172.21.15.67:6828/57850643,v1:172.21.15.67:6829/57850643] up:boot 2024-08-31T05:29:03.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:02 smithi073 ceph-mon[71452]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 3 up:standby 2024-08-31T05:29:03.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:02 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mds metadata", "who": "cephfs.smithi067.beqeql"} : dispatch 2024-08-31T05:29:03.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:02 smithi073 ceph-mon[71452]: from='osd.5 ' entity='osd.5' 2024-08-31T05:29:04.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:04 smithi067 ceph-mon[99941]: Upgrade: Updating mds.cephfs.smithi067.tskvpt 2024-08-31T05:29:04.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:04.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.tskvpt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:29:04.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:04.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:04 smithi067 ceph-mon[99941]: Deploying daemon mds.cephfs.smithi067.tskvpt on smithi067 2024-08-31T05:29:04.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:04 smithi067 ceph-mon[99941]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-31T05:29:04.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:04 smithi067 ceph-mon[99941]: pgmap v256: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 42/276 objects degraded (15.217%) 2024-08-31T05:29:04.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:04 smithi067 ceph-mon[99941]: osd.5 [v2:172.21.15.73:6816/4053532830,v1:172.21.15.73:6817/4053532830] boot 2024-08-31T05:29:04.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:04 smithi067 ceph-mon[99941]: osdmap e90: 6 total, 6 up, 6 in 2024-08-31T05:29:04.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:29:04.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:04 smithi073 ceph-mon[71452]: Upgrade: Updating mds.cephfs.smithi067.tskvpt 2024-08-31T05:29:04.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:04.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.tskvpt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:29:04.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:04.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:04 smithi073 ceph-mon[71452]: Deploying daemon mds.cephfs.smithi067.tskvpt on smithi067 2024-08-31T05:29:04.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:04 smithi073 ceph-mon[71452]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-31T05:29:04.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:04 smithi073 ceph-mon[71452]: pgmap v256: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 42/276 objects degraded (15.217%) 2024-08-31T05:29:04.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:04 smithi073 ceph-mon[71452]: osd.5 [v2:172.21.15.73:6816/4053532830,v1:172.21.15.73:6817/4053532830] boot 2024-08-31T05:29:04.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:04 smithi073 ceph-mon[71452]: osdmap e90: 6 total, 6 up, 6 in 2024-08-31T05:29:04.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:29:05.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:05 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067[99937]: 2024-08-31T05:29:05.236+0000 7f607dfa4640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T05:29:05.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:29:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:05 smithi073 ceph-mon[71452]: osdmap e91: 6 total, 6 up, 6 in 2024-08-31T05:29:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:05 smithi073 ceph-mon[71452]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T05:29:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:05 smithi073 ceph-mon[71452]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T05:29:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:05 smithi073 ceph-mon[71452]: osdmap e92: 6 total, 6 up, 6 in 2024-08-31T05:29:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:05 smithi073 ceph-mon[71452]: Standby daemon mds.cephfs.smithi073.kfbmeo assigned to filesystem cephfs as rank 0 2024-08-31T05:29:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:05 smithi073 ceph-mon[71452]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T05:29:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:05 smithi073 ceph-mon[71452]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-08-31T05:29:05.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:05 smithi073 ceph-mon[71452]: fsmap cephfs:1/1 {0=cephfs.smithi073.kfbmeo=up:replay} 2 up:standby 2024-08-31T05:29:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:29:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:05 smithi067 ceph-mon[99941]: osdmap e91: 6 total, 6 up, 6 in 2024-08-31T05:29:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:05 smithi067 ceph-mon[99941]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T05:29:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:05 smithi067 ceph-mon[99941]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T05:29:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:05 smithi067 ceph-mon[99941]: osdmap e92: 6 total, 6 up, 6 in 2024-08-31T05:29:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:05 smithi067 ceph-mon[99941]: Standby daemon mds.cephfs.smithi073.kfbmeo assigned to filesystem cephfs as rank 0 2024-08-31T05:29:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:05 smithi067 ceph-mon[99941]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T05:29:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:05 smithi067 ceph-mon[99941]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-08-31T05:29:06.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:05 smithi067 ceph-mon[99941]: fsmap cephfs:1/1 {0=cephfs.smithi073.kfbmeo=up:replay} 2 up:standby 2024-08-31T05:29:06.948 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:06 smithi073 ceph-mon[71452]: pgmap v259: 65 pgs: 7 peering, 14 active+undersized, 9 active+undersized+degraded, 35 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 32/276 objects degraded (11.594%) 2024-08-31T05:29:07.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:06 smithi067 ceph-mon[99941]: pgmap v259: 65 pgs: 7 peering, 14 active+undersized, 9 active+undersized+degraded, 35 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 32/276 objects degraded (11.594%) 2024-08-31T05:29:07.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:07 smithi073 ceph-mon[71452]: Health check update: Degraded data redundancy: 32/276 objects degraded (11.594%), 9 pgs degraded (PG_DEGRADED) 2024-08-31T05:29:08.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:07 smithi067 ceph-mon[99941]: Health check update: Degraded data redundancy: 32/276 objects degraded (11.594%), 9 pgs degraded (PG_DEGRADED) 2024-08-31T05:29:08.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:08 smithi073 ceph-mon[71452]: pgmap v260: 65 pgs: 7 peering, 5 active+undersized, 3 active+undersized+degraded, 50 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.7 MiB/s rd, 2 op/s; 14/276 objects degraded (5.072%) 2024-08-31T05:29:09.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:08 smithi067 ceph-mon[99941]: pgmap v260: 65 pgs: 7 peering, 5 active+undersized, 3 active+undersized+degraded, 50 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.7 MiB/s rd, 2 op/s; 14/276 objects degraded (5.072%) 2024-08-31T05:29:10.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:09 smithi067 ceph-mon[99941]: pgmap v261: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 8 op/s 2024-08-31T05:29:10.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:09 smithi067 ceph-mon[99941]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/276 objects degraded (5.072%), 3 pgs degraded) 2024-08-31T05:29:10.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:09 smithi073 ceph-mon[71452]: pgmap v261: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 8 op/s 2024-08-31T05:29:10.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:09 smithi073 ceph-mon[71452]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/276 objects degraded (5.072%), 3 pgs degraded) 2024-08-31T05:29:12.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:12 smithi067 ceph-mon[99941]: mds.? [v2:172.21.15.67:6826/3864481333,v1:172.21.15.67:6827/3864481333] up:boot 2024-08-31T05:29:12.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:12 smithi067 ceph-mon[99941]: fsmap cephfs:1/1 {0=cephfs.smithi073.kfbmeo=up:replay} 3 up:standby 2024-08-31T05:29:12.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:12 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mds metadata", "who": "cephfs.smithi067.tskvpt"} : dispatch 2024-08-31T05:29:12.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:12 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:12.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:12 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:12.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:12 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:12.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:12 smithi067 ceph-mon[99941]: pgmap v262: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-08-31T05:29:12.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:12 smithi073 ceph-mon[71452]: mds.? [v2:172.21.15.67:6826/3864481333,v1:172.21.15.67:6827/3864481333] up:boot 2024-08-31T05:29:12.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:12 smithi073 ceph-mon[71452]: fsmap cephfs:1/1 {0=cephfs.smithi073.kfbmeo=up:replay} 3 up:standby 2024-08-31T05:29:12.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:12 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mds metadata", "who": "cephfs.smithi067.tskvpt"} : dispatch 2024-08-31T05:29:12.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:12 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:12.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:12 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:12.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:12 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:12.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:12 smithi073 ceph-mon[71452]: pgmap v262: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-08-31T05:29:14.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:14 smithi073 ceph-mon[71452]: reconnect by client.24329 192.168.0.1:0/1177961946 after 0.000999977 2024-08-31T05:29:14.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:14 smithi073 ceph-mon[71452]: reconnect by client.14600 192.168.0.1:0/3622886171 after 0.000999977 2024-08-31T05:29:14.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:14 smithi073 ceph-mon[71452]: mds.? [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] up:reconnect 2024-08-31T05:29:14.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:14 smithi073 ceph-mon[71452]: fsmap cephfs:1/1 {0=cephfs.smithi073.kfbmeo=up:reconnect} 3 up:standby 2024-08-31T05:29:14.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:14 smithi073 ceph-mon[71452]: pgmap v263: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-08-31T05:29:14.977 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:14 smithi067 ceph-mon[99941]: reconnect by client.24329 192.168.0.1:0/1177961946 after 0.000999977 2024-08-31T05:29:14.977 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:14 smithi067 ceph-mon[99941]: reconnect by client.14600 192.168.0.1:0/3622886171 after 0.000999977 2024-08-31T05:29:14.977 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:14 smithi067 ceph-mon[99941]: mds.? [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] up:reconnect 2024-08-31T05:29:14.977 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:14 smithi067 ceph-mon[99941]: fsmap cephfs:1/1 {0=cephfs.smithi073.kfbmeo=up:reconnect} 3 up:standby 2024-08-31T05:29:14.978 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:14 smithi067 ceph-mon[99941]: pgmap v263: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-08-31T05:29:15.873 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:15 smithi067 ceph-mon[99941]: mds.? [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] up:rejoin 2024-08-31T05:29:15.874 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:15 smithi067 ceph-mon[99941]: fsmap cephfs:1/1 {0=cephfs.smithi073.kfbmeo=up:rejoin} 3 up:standby 2024-08-31T05:29:15.874 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:15 smithi067 ceph-mon[99941]: daemon mds.cephfs.smithi073.kfbmeo is now active in filesystem cephfs as rank 0 2024-08-31T05:29:15.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:15 smithi073 ceph-mon[71452]: mds.? [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] up:rejoin 2024-08-31T05:29:15.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:15 smithi073 ceph-mon[71452]: fsmap cephfs:1/1 {0=cephfs.smithi073.kfbmeo=up:rejoin} 3 up:standby 2024-08-31T05:29:15.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:15 smithi073 ceph-mon[71452]: daemon mds.cephfs.smithi073.kfbmeo is now active in filesystem cephfs as rank 0 2024-08-31T05:29:16.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:16 smithi073 ceph-mon[71452]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T05:29:16.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:16 smithi073 ceph-mon[71452]: mds.? [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] up:active 2024-08-31T05:29:16.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:16 smithi073 ceph-mon[71452]: fsmap cephfs:1 {0=cephfs.smithi073.kfbmeo=up:active} 3 up:standby 2024-08-31T05:29:16.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:16 smithi073 ceph-mon[71452]: pgmap v264: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 7 op/s 2024-08-31T05:29:16.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:16 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:16.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:16 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:17.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:16 smithi067 ceph-mon[99941]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T05:29:17.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:16 smithi067 ceph-mon[99941]: mds.? [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] up:active 2024-08-31T05:29:17.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:16 smithi067 ceph-mon[99941]: fsmap cephfs:1 {0=cephfs.smithi073.kfbmeo=up:active} 3 up:standby 2024-08-31T05:29:17.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:16 smithi067 ceph-mon[99941]: pgmap v264: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 7 op/s 2024-08-31T05:29:17.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:16 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:17.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:16 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:18.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:18 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:18.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:18 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:18.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:18 smithi067 ceph-mon[99941]: pgmap v265: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-08-31T05:29:18.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:18 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:18.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:18 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:18.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:18 smithi073 ceph-mon[71452]: pgmap v265: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-08-31T05:29:20.891 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:20.891 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:29:20.891 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:20.891 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:20 smithi067 ceph-mon[99941]: pgmap v266: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-08-31T05:29:20.891 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:20.891 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:20.892 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:20.892 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:29:20.892 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:20.892 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:20.892 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:20.892 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:20.892 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:20.892 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:20 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:20.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:29:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:20 smithi073 ceph-mon[71452]: pgmap v266: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-08-31T05:29:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:29:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:20 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:23.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:22 smithi067 ceph-mon[99941]: pgmap v267: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.2 MiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-08-31T05:29:23.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:22 smithi067 ceph-mon[99941]: Upgrade: Updating mds.cephfs.smithi067.beqeql 2024-08-31T05:29:23.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:22 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:23.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:22 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.beqeql", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:29:23.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:22 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:23.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:22 smithi067 ceph-mon[99941]: Deploying daemon mds.cephfs.smithi067.beqeql on smithi067 2024-08-31T05:29:23.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:22 smithi073 ceph-mon[71452]: pgmap v267: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.2 MiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-08-31T05:29:23.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:22 smithi073 ceph-mon[71452]: Upgrade: Updating mds.cephfs.smithi067.beqeql 2024-08-31T05:29:23.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:22 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:23.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:22 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.beqeql", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:29:23.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:22 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:23.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:22 smithi073 ceph-mon[71452]: Deploying daemon mds.cephfs.smithi067.beqeql on smithi067 2024-08-31T05:29:24.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.806+0000 7f022f7ed640 1 -- 172.21.15.67:0/3962157530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0228103180 msgr2=0x7f022810b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:24.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.806+0000 7f022f7ed640 1 --2- 172.21.15.67:0/3962157530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0228103180 0x7f022810b670 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0224009880 tx=0x7f022402a530 comp rx=0 tx=0).stop 2024-08-31T05:29:24.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.806+0000 7f022f7ed640 1 -- 172.21.15.67:0/3962157530 shutdown_connections 2024-08-31T05:29:24.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.806+0000 7f022f7ed640 1 --2- 172.21.15.67:0/3962157530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0228103180 0x7f022810b670 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.806+0000 7f022f7ed640 1 --2- 172.21.15.67:0/3962157530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0228102860 0x7f0228102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.806+0000 7f022f7ed640 1 -- 172.21.15.67:0/3962157530 >> 172.21.15.67:0/3962157530 conn(0x7f02280fc2c0 msgr2=0x7f02280fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:24.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.806+0000 7f022f7ed640 1 -- 172.21.15.67:0/3962157530 shutdown_connections 2024-08-31T05:29:24.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.807+0000 7f022f7ed640 1 -- 172.21.15.67:0/3962157530 wait complete. 2024-08-31T05:29:24.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.807+0000 7f022f7ed640 1 Processor -- start 2024-08-31T05:29:24.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.807+0000 7f022f7ed640 1 -- start start 2024-08-31T05:29:24.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.807+0000 7f022f7ed640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0228102860 0x7f02281004c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.807+0000 7f022f7ed640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0228103180 0x7f0228100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.807+0000 7f022f7ed640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f022810eb90 con 0x7f0228103180 2024-08-31T05:29:24.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.807+0000 7f022f7ed640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f022810ea10 con 0x7f0228102860 2024-08-31T05:29:24.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.808+0000 7f022cd88640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0228103180 0x7f0228100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.808+0000 7f022cd88640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0228103180 0x7f0228100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45200/0 (socket says 172.21.15.67:45200) 2024-08-31T05:29:24.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.808+0000 7f022cd88640 1 -- 172.21.15.67:0/1522667261 learned_addr learned my addr 172.21.15.67:0/1522667261 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:29:24.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.808+0000 7f022d589640 1 --2- 172.21.15.67:0/1522667261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0228102860 0x7f02281004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.808+0000 7f022cd88640 1 -- 172.21.15.67:0/1522667261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0228102860 msgr2=0x7f02281004c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:24.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.808+0000 7f022cd88640 1 --2- 172.21.15.67:0/1522667261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0228102860 0x7f02281004c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.808+0000 7f022cd88640 1 -- 172.21.15.67:0/1522667261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0228100f40 con 0x7f0228103180 2024-08-31T05:29:24.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.808+0000 7f022cd88640 1 --2- 172.21.15.67:0/1522667261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0228103180 0x7f0228100a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0224031460 tx=0x7f02240045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:24.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.808+0000 7f021a7fc640 1 -- 172.21.15.67:0/1522667261 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f022403f070 con 0x7f0228103180 2024-08-31T05:29:24.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.809+0000 7f021a7fc640 1 -- 172.21.15.67:0/1522667261 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02240035f0 con 0x7f0228103180 2024-08-31T05:29:24.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.809+0000 7f021a7fc640 1 -- 172.21.15.67:0/1522667261 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0224035030 con 0x7f0228103180 2024-08-31T05:29:24.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.809+0000 7f022f7ed640 1 -- 172.21.15.67:0/1522667261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02281011d0 con 0x7f0228103180 2024-08-31T05:29:24.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.809+0000 7f022f7ed640 1 -- 172.21.15.67:0/1522667261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02281a3b80 con 0x7f0228103180 2024-08-31T05:29:24.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.810+0000 7f022f7ed640 1 -- 172.21.15.67:0/1522667261 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022806a830 con 0x7f0228103180 2024-08-31T05:29:24.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.811+0000 7f021a7fc640 1 -- 172.21.15.67:0/1522667261 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f0224042070 con 0x7f0228103180 2024-08-31T05:29:24.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.811+0000 7f021a7fc640 1 --2- 172.21.15.67:0/1522667261 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0214079e00 0x7f021407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.812+0000 7f022d589640 1 --2- 172.21.15.67:0/1522667261 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0214079e00 0x7f021407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.812+0000 7f021a7fc640 1 -- 172.21.15.67:0/1522667261 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6302+0+0 (secure 0 0 0) 0x7f02240bd810 con 0x7f0228103180 2024-08-31T05:29:24.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.812+0000 7f022d589640 1 --2- 172.21.15.67:0/1522667261 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0214079e00 0x7f021407c2c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f021c009bd0 tx=0x7f021c005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:24.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:24.816+0000 7f021a7fc640 1 -- 172.21.15.67:0/1522667261 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0224089430 con 0x7f0228103180 2024-08-31T05:29:24.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:24 smithi073 ceph-mon[71452]: pgmap v268: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.9 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-08-31T05:29:25.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.017+0000 7f022f7ed640 1 -- 172.21.15.67:0/1522667261 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f02280623d0 con 0x7f0214079e00 2024-08-31T05:29:25.019 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:24 smithi067 ceph-mon[99941]: pgmap v268: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.9 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-08-31T05:29:25.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.018+0000 7f021a7fc640 1 -- 172.21.15.67:0/1522667261 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f02280623d0 con 0x7f0214079e00 2024-08-31T05:29:25.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.020+0000 7f022f7ed640 1 -- 172.21.15.67:0/1522667261 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0214079e00 msgr2=0x7f021407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.020+0000 7f022f7ed640 1 --2- 172.21.15.67:0/1522667261 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0214079e00 0x7f021407c2c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f021c009bd0 tx=0x7f021c005f90 comp rx=0 tx=0).stop 2024-08-31T05:29:25.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.020+0000 7f022f7ed640 1 -- 172.21.15.67:0/1522667261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0228103180 msgr2=0x7f0228100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.020+0000 7f022f7ed640 1 --2- 172.21.15.67:0/1522667261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0228103180 0x7f0228100a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0224031460 tx=0x7f02240045c0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.020+0000 7f022f7ed640 1 -- 172.21.15.67:0/1522667261 shutdown_connections 2024-08-31T05:29:25.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.020+0000 7f022f7ed640 1 --2- 172.21.15.67:0/1522667261 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0214079e00 0x7f021407c2c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.020+0000 7f022f7ed640 1 --2- 172.21.15.67:0/1522667261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0228103180 0x7f0228100a00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.020+0000 7f022f7ed640 1 --2- 172.21.15.67:0/1522667261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0228102860 0x7f02281004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.020+0000 7f022f7ed640 1 -- 172.21.15.67:0/1522667261 >> 172.21.15.67:0/1522667261 conn(0x7f02280fc2c0 msgr2=0x7f0228108cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:25.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.020+0000 7f022f7ed640 1 -- 172.21.15.67:0/1522667261 shutdown_connections 2024-08-31T05:29:25.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.020+0000 7f022f7ed640 1 -- 172.21.15.67:0/1522667261 wait complete. 2024-08-31T05:29:25.031 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:29:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.104+0000 7f6e38885640 1 -- 172.21.15.67:0/1979606723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e34107790 msgr2=0x7f6e34107b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.104+0000 7f6e38885640 1 --2- 172.21.15.67:0/1979606723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e34107790 0x7f6e34107b70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009880 tx=0x7f6e2402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.104+0000 7f6e38885640 1 -- 172.21.15.67:0/1979606723 shutdown_connections 2024-08-31T05:29:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.104+0000 7f6e38885640 1 --2- 172.21.15.67:0/1979606723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e340ffb60 0x7f6e340fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.104+0000 7f6e38885640 1 --2- 172.21.15.67:0/1979606723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e34107790 0x7f6e34107b70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.104+0000 7f6e38885640 1 -- 172.21.15.67:0/1979606723 >> 172.21.15.67:0/1979606723 conn(0x7f6e340fba30 msgr2=0x7f6e340fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:25.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.104+0000 7f6e38885640 1 -- 172.21.15.67:0/1979606723 shutdown_connections 2024-08-31T05:29:25.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.104+0000 7f6e38885640 1 -- 172.21.15.67:0/1979606723 wait complete. 2024-08-31T05:29:25.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.105+0000 7f6e38885640 1 Processor -- start 2024-08-31T05:29:25.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.105+0000 7f6e38885640 1 -- start start 2024-08-31T05:29:25.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.105+0000 7f6e38885640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e340ffb60 0x7f6e34100d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.105+0000 7f6e38885640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e34107790 0x7f6e34101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.105+0000 7f6e38885640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3410ebe0 con 0x7f6e340ffb60 2024-08-31T05:29:25.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.105+0000 7f6e38885640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3410ea60 con 0x7f6e34107790 2024-08-31T05:29:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.106+0000 7f6e3259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e340ffb60 0x7f6e34100d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.106+0000 7f6e3259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e340ffb60 0x7f6e34100d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45218/0 (socket says 172.21.15.67:45218) 2024-08-31T05:29:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.106+0000 7f6e3259c640 1 -- 172.21.15.67:0/516809657 learned_addr learned my addr 172.21.15.67:0/516809657 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:29:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.106+0000 7f6e31d9b640 1 --2- 172.21.15.67:0/516809657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e34107790 0x7f6e34101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.106+0000 7f6e3259c640 1 -- 172.21.15.67:0/516809657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e34107790 msgr2=0x7f6e34101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.106+0000 7f6e3259c640 1 --2- 172.21.15.67:0/516809657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e34107790 0x7f6e34101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.106+0000 7f6e3259c640 1 -- 172.21.15.67:0/516809657 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e341017c0 con 0x7f6e340ffb60 2024-08-31T05:29:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.106+0000 7f6e3259c640 1 --2- 172.21.15.67:0/516809657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e340ffb60 0x7f6e34100d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6e24031460 tx=0x7f6e24004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.106+0000 7f6e237fe640 1 -- 172.21.15.67:0/516809657 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e2403f070 con 0x7f6e340ffb60 2024-08-31T05:29:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.106+0000 7f6e237fe640 1 -- 172.21.15.67:0/516809657 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e240035f0 con 0x7f6e340ffb60 2024-08-31T05:29:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.106+0000 7f6e38885640 1 -- 172.21.15.67:0/516809657 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e34101a50 con 0x7f6e340ffb60 2024-08-31T05:29:25.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.106+0000 7f6e237fe640 1 -- 172.21.15.67:0/516809657 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e24035030 con 0x7f6e340ffb60 2024-08-31T05:29:25.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.106+0000 7f6e38885640 1 -- 172.21.15.67:0/516809657 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e341a3b20 con 0x7f6e340ffb60 2024-08-31T05:29:25.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.107+0000 7f6e38885640 1 -- 172.21.15.67:0/516809657 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e34102e80 con 0x7f6e340ffb60 2024-08-31T05:29:25.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.108+0000 7f6e237fe640 1 -- 172.21.15.67:0/516809657 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f6e24042070 con 0x7f6e340ffb60 2024-08-31T05:29:25.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.108+0000 7f6e237fe640 1 --2- 172.21.15.67:0/516809657 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6e1c079e00 0x7f6e1c07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.109+0000 7f6e237fe640 1 -- 172.21.15.67:0/516809657 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6302+0+0 (secure 0 0 0) 0x7f6e240bd2c0 con 0x7f6e340ffb60 2024-08-31T05:29:25.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.109+0000 7f6e31d9b640 1 --2- 172.21.15.67:0/516809657 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6e1c079e00 0x7f6e1c07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.109+0000 7f6e31d9b640 1 --2- 172.21.15.67:0/516809657 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6e1c079e00 0x7f6e1c07c2c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6e341027d0 tx=0x7f6e28005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:25.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.113+0000 7f6e237fe640 1 -- 172.21.15.67:0/516809657 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6e24088e60 con 0x7f6e340ffb60 2024-08-31T05:29:25.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.316+0000 7f6e38885640 1 -- 172.21.15.67:0/516809657 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6e340fd8f0 con 0x7f6e1c079e00 2024-08-31T05:29:25.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.317+0000 7f6e237fe640 1 -- 172.21.15.67:0/516809657 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f6e340fd8f0 con 0x7f6e1c079e00 2024-08-31T05:29:25.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.319+0000 7f6e38885640 1 -- 172.21.15.67:0/516809657 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6e1c079e00 msgr2=0x7f6e1c07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.319+0000 7f6e38885640 1 --2- 172.21.15.67:0/516809657 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6e1c079e00 0x7f6e1c07c2c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6e341027d0 tx=0x7f6e28005f90 comp rx=0 tx=0).stop 2024-08-31T05:29:25.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.319+0000 7f6e38885640 1 -- 172.21.15.67:0/516809657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e340ffb60 msgr2=0x7f6e34100d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.319+0000 7f6e38885640 1 --2- 172.21.15.67:0/516809657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e340ffb60 0x7f6e34100d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6e24031460 tx=0x7f6e24004530 comp rx=0 tx=0).stop 2024-08-31T05:29:25.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.319+0000 7f6e38885640 1 -- 172.21.15.67:0/516809657 shutdown_connections 2024-08-31T05:29:25.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.319+0000 7f6e38885640 1 --2- 172.21.15.67:0/516809657 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6e1c079e00 0x7f6e1c07c2c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.319+0000 7f6e38885640 1 --2- 172.21.15.67:0/516809657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e34107790 0x7f6e34101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.319+0000 7f6e38885640 1 --2- 172.21.15.67:0/516809657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e340ffb60 0x7f6e34100d40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.319+0000 7f6e38885640 1 -- 172.21.15.67:0/516809657 >> 172.21.15.67:0/516809657 conn(0x7f6e340fba30 msgr2=0x7f6e340fd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:25.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.319+0000 7f6e38885640 1 -- 172.21.15.67:0/516809657 shutdown_connections 2024-08-31T05:29:25.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.319+0000 7f6e38885640 1 -- 172.21.15.67:0/516809657 wait complete. 2024-08-31T05:29:25.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.402+0000 7fc676be3640 1 -- 172.21.15.67:0/1076374886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6701076a0 msgr2=0x7fc670107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.402+0000 7fc676be3640 1 --2- 172.21.15.67:0/1076374886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6701076a0 0x7fc670107a80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc664009880 tx=0x7fc66402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.402+0000 7fc676be3640 1 -- 172.21.15.67:0/1076374886 shutdown_connections 2024-08-31T05:29:25.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.402+0000 7fc676be3640 1 --2- 172.21.15.67:0/1076374886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6701016a0 0x7fc670101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.402+0000 7fc676be3640 1 --2- 172.21.15.67:0/1076374886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6701076a0 0x7fc670107a80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.402+0000 7fc676be3640 1 -- 172.21.15.67:0/1076374886 >> 172.21.15.67:0/1076374886 conn(0x7fc6700fd3a0 msgr2=0x7fc6700ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:25.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.402+0000 7fc676be3640 1 -- 172.21.15.67:0/1076374886 shutdown_connections 2024-08-31T05:29:25.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.402+0000 7fc676be3640 1 -- 172.21.15.67:0/1076374886 wait complete. 2024-08-31T05:29:25.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.403+0000 7fc676be3640 1 Processor -- start 2024-08-31T05:29:25.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.403+0000 7fc676be3640 1 -- start start 2024-08-31T05:29:25.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.403+0000 7fc676be3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6701016a0 0x7fc670074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.403+0000 7fc676be3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6701076a0 0x7fc6700747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.403+0000 7fc676be3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc67010eb70 con 0x7fc6701076a0 2024-08-31T05:29:25.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.403+0000 7fc676be3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc67010e9f0 con 0x7fc6701016a0 2024-08-31T05:29:25.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.403+0000 7fc66ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6701076a0 0x7fc6700747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.403+0000 7fc66ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6701076a0 0x7fc6700747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45236/0 (socket says 172.21.15.67:45236) 2024-08-31T05:29:25.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.403+0000 7fc66ffff640 1 -- 172.21.15.67:0/4209492411 learned_addr learned my addr 172.21.15.67:0/4209492411 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:29:25.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.403+0000 7fc67497f640 1 --2- 172.21.15.67:0/4209492411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6701016a0 0x7fc670074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.404+0000 7fc66ffff640 1 -- 172.21.15.67:0/4209492411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6701016a0 msgr2=0x7fc670074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.404+0000 7fc66ffff640 1 --2- 172.21.15.67:0/4209492411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6701016a0 0x7fc670074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.404+0000 7fc66ffff640 1 -- 172.21.15.67:0/4209492411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc670074d10 con 0x7fc6701076a0 2024-08-31T05:29:25.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.404+0000 7fc66ffff640 1 --2- 172.21.15.67:0/4209492411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6701076a0 0x7fc6700747d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00d6f0 tx=0x7fc65c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:25.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.404+0000 7fc66dffb640 1 -- 172.21.15.67:0/4209492411 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc65c017070 con 0x7fc6701076a0 2024-08-31T05:29:25.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.404+0000 7fc66dffb640 1 -- 172.21.15.67:0/4209492411 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc65c00de00 con 0x7fc6701076a0 2024-08-31T05:29:25.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.404+0000 7fc676be3640 1 -- 172.21.15.67:0/4209492411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc670075000 con 0x7fc6701076a0 2024-08-31T05:29:25.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.404+0000 7fc66dffb640 1 -- 172.21.15.67:0/4209492411 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc65c004bb0 con 0x7fc6701076a0 2024-08-31T05:29:25.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.404+0000 7fc676be3640 1 -- 172.21.15.67:0/4209492411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6701a3bc0 con 0x7fc6701076a0 2024-08-31T05:29:25.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.405+0000 7fc676be3640 1 -- 172.21.15.67:0/4209492411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc670102de0 con 0x7fc6701076a0 2024-08-31T05:29:25.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.406+0000 7fc66dffb640 1 -- 172.21.15.67:0/4209492411 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fc65c009a30 con 0x7fc6701076a0 2024-08-31T05:29:25.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.406+0000 7fc66dffb640 1 --2- 172.21.15.67:0/4209492411 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc660079e40 0x7fc66007c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.406+0000 7fc66dffb640 1 -- 172.21.15.67:0/4209492411 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6302+0+0 (secure 0 0 0) 0x7fc65c09c4c0 con 0x7fc6701076a0 2024-08-31T05:29:25.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.406+0000 7fc67497f640 1 --2- 172.21.15.67:0/4209492411 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc660079e40 0x7fc66007c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.407+0000 7fc67497f640 1 --2- 172.21.15.67:0/4209492411 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc660079e40 0x7fc66007c300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc6640096c0 tx=0x7fc664031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:25.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.411+0000 7fc66dffb640 1 -- 172.21.15.67:0/4209492411 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc65c0680e0 con 0x7fc6701076a0 2024-08-31T05:29:25.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.605+0000 7fc676be3640 1 -- 172.21.15.67:0/4209492411 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc6700623d0 con 0x7fc660079e40 2024-08-31T05:29:25.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.615+0000 7fc66dffb640 1 -- 172.21.15.67:0/4209492411 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc6700623d0 con 0x7fc660079e40 2024-08-31T05:29:25.617 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:29:25.617 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (5m) 9s ago 16m 20.8M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:29:25.617 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (8m) 9s ago 16m 9202k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:29:25.617 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (8m) 29s ago 15m 8619k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:29:25.617 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (3m) 9s ago 16m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 910f4f105c4b 2024-08-31T05:29:25.617 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (3m) 29s ago 15m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 0dcc86f98a20 2024-08-31T05:29:25.617 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (5m) 9s ago 16m 82.1M - c8b91775d855 3a9a0f88928d 2024-08-31T05:29:25.617 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (10m) 9s ago 10m 12.1M - 19.1.1-242-g244a32d3 395b9209a980 b504d8b4e091 2024-08-31T05:29:25.617 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (14s) 9s ago 11m 80.3M - 19.3.0-4560-gd19e6118 79f4cde5e369 b01bdece784a 2024-08-31T05:29:25.617 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (11m) 29s ago 11m 17.3M - 19.1.1-242-g244a32d3 395b9209a980 27ee06e4ac68 2024-08-31T05:29:25.617 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (10m) 29s ago 10m 19.3M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:29:25.617 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (7m) 9s ago 17m 595M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:29:25.617 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (6m) 29s ago 15m 525M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:29:25.618 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (4m) 9s ago 17m 116M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 25a28efbbd37 2024-08-31T05:29:25.618 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (3m) 29s ago 15m 104M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 6be0f0999860 2024-08-31T05:29:25.618 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (6m) 9s ago 16m 10.0M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:29:25.618 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (6m) 29s ago 15m 10.9M - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:29:25.618 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (3m) 9s ago 14m 198M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 aab0516dcbfa 2024-08-31T05:29:25.618 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (2m) 9s ago 13m 162M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 fa9e3fb20c5e 2024-08-31T05:29:25.618 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (2m) 9s ago 13m 156M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 a62abe735da2 2024-08-31T05:29:25.618 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (96s) 29s ago 12m 158M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 9f4ce308ec1d 2024-08-31T05:29:25.618 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (64s) 29s ago 12m 149M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 5f02556c012d 2024-08-31T05:29:25.618 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (32s) 29s ago 12m 78.8M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 530ae5c5d1ac 2024-08-31T05:29:25.618 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (5m) 9s ago 15m 55.9M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:29:25.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.617+0000 7fc676be3640 1 -- 172.21.15.67:0/4209492411 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc660079e40 msgr2=0x7fc66007c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.617+0000 7fc676be3640 1 --2- 172.21.15.67:0/4209492411 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc660079e40 0x7fc66007c300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc6640096c0 tx=0x7fc664031400 comp rx=0 tx=0).stop 2024-08-31T05:29:25.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.617+0000 7fc676be3640 1 -- 172.21.15.67:0/4209492411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6701076a0 msgr2=0x7fc6700747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.617+0000 7fc676be3640 1 --2- 172.21.15.67:0/4209492411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6701076a0 0x7fc6700747d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00d6f0 tx=0x7fc65c00dbb0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.617+0000 7fc676be3640 1 -- 172.21.15.67:0/4209492411 shutdown_connections 2024-08-31T05:29:25.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.617+0000 7fc676be3640 1 --2- 172.21.15.67:0/4209492411 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fc660079e40 0x7fc66007c300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.617+0000 7fc676be3640 1 --2- 172.21.15.67:0/4209492411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6701076a0 0x7fc6700747d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.617+0000 7fc676be3640 1 --2- 172.21.15.67:0/4209492411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6701016a0 0x7fc670074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.617+0000 7fc676be3640 1 -- 172.21.15.67:0/4209492411 >> 172.21.15.67:0/4209492411 conn(0x7fc6700fd3a0 msgr2=0x7fc6700fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:25.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.617+0000 7fc676be3640 1 -- 172.21.15.67:0/4209492411 shutdown_connections 2024-08-31T05:29:25.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.617+0000 7fc676be3640 1 -- 172.21.15.67:0/4209492411 wait complete. 2024-08-31T05:29:25.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.698+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2918965151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cb4106650 msgr2=0x7f2cb4106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.698+0000 7f2cbc0e6640 1 --2- 172.21.15.67:0/2918965151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cb4106650 0x7f2cb4106a30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0009880 tx=0x7f2cb002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.698+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2918965151 shutdown_connections 2024-08-31T05:29:25.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.698+0000 7f2cbc0e6640 1 --2- 172.21.15.67:0/2918965151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb41005c0 0x7f2cb4100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.698+0000 7f2cbc0e6640 1 --2- 172.21.15.67:0/2918965151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cb4106650 0x7f2cb4106a30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.698+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2918965151 >> 172.21.15.67:0/2918965151 conn(0x7f2cb40fc2e0 msgr2=0x7f2cb40fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:25.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.699+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2918965151 shutdown_connections 2024-08-31T05:29:25.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.699+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2918965151 wait complete. 2024-08-31T05:29:25.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.699+0000 7f2cbc0e6640 1 Processor -- start 2024-08-31T05:29:25.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.699+0000 7f2cbc0e6640 1 -- start start 2024-08-31T05:29:25.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.699+0000 7f2cbc0e6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cb41005c0 0x7f2cb41976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.699+0000 7f2cbc0e6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb4106650 0x7f2cb4197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.699+0000 7f2cbc0e6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb410da80 con 0x7f2cb41005c0 2024-08-31T05:29:25.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.699+0000 7f2cbc0e6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb410d900 con 0x7f2cb4106650 2024-08-31T05:29:25.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.699+0000 7f2cb9e82640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cb41005c0 0x7f2cb41976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.700+0000 7f2cb9e82640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cb41005c0 0x7f2cb41976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45256/0 (socket says 172.21.15.67:45256) 2024-08-31T05:29:25.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.700+0000 7f2cb9e82640 1 -- 172.21.15.67:0/2152559583 learned_addr learned my addr 172.21.15.67:0/2152559583 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:29:25.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.700+0000 7f2cb9681640 1 --2- 172.21.15.67:0/2152559583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb4106650 0x7f2cb4197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.700+0000 7f2cb9e82640 1 -- 172.21.15.67:0/2152559583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb4106650 msgr2=0x7f2cb4197be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.700+0000 7f2cb9e82640 1 --2- 172.21.15.67:0/2152559583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb4106650 0x7f2cb4197be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.700+0000 7f2cb9e82640 1 -- 172.21.15.67:0/2152559583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb419bf70 con 0x7f2cb41005c0 2024-08-31T05:29:25.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.700+0000 7f2cb9681640 1 --2- 172.21.15.67:0/2152559583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb4106650 0x7f2cb4197be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:25.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.700+0000 7f2cb9e82640 1 --2- 172.21.15.67:0/2152559583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cb41005c0 0x7f2cb41976a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0031460 tx=0x7f2cb00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:25.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.700+0000 7f2caaffd640 1 -- 172.21.15.67:0/2152559583 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2cb003f070 con 0x7f2cb41005c0 2024-08-31T05:29:25.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.700+0000 7f2caaffd640 1 -- 172.21.15.67:0/2152559583 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2cb00035f0 con 0x7f2cb41005c0 2024-08-31T05:29:25.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.700+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2152559583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb419c200 con 0x7f2cb41005c0 2024-08-31T05:29:25.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.700+0000 7f2caaffd640 1 -- 172.21.15.67:0/2152559583 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2cb0035030 con 0x7f2cb41005c0 2024-08-31T05:29:25.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.700+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2152559583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb419c730 con 0x7f2cb41005c0 2024-08-31T05:29:25.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.701+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2152559583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb4101d00 con 0x7f2cb41005c0 2024-08-31T05:29:25.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.702+0000 7f2caaffd640 1 -- 172.21.15.67:0/2152559583 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f2cb0042070 con 0x7f2cb41005c0 2024-08-31T05:29:25.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.702+0000 7f2caaffd640 1 --2- 172.21.15.67:0/2152559583 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ca0079e00 0x7f2ca007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.703+0000 7f2cb9681640 1 --2- 172.21.15.67:0/2152559583 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ca0079e00 0x7f2ca007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.703+0000 7f2caaffd640 1 -- 172.21.15.67:0/2152559583 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6302+0+0 (secure 0 0 0) 0x7f2cb00bd440 con 0x7f2cb41005c0 2024-08-31T05:29:25.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.703+0000 7f2cb9681640 1 --2- 172.21.15.67:0/2152559583 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ca0079e00 0x7f2ca007c2c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40058c0 tx=0x7f2ca4005850 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:25.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.707+0000 7f2caaffd640 1 -- 172.21.15.67:0/2152559583 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2cb0084e70 con 0x7f2cb41005c0 2024-08-31T05:29:25.968 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:25 smithi067 ceph-mon[99941]: osdmap e93: 6 total, 6 up, 6 in 2024-08-31T05:29:25.968 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:25 smithi067 ceph-mon[99941]: fsmap cephfs:1 {0=cephfs.smithi073.kfbmeo=up:active} 2 up:standby 2024-08-31T05:29:25.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.974+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2152559583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2cb4198a00 con 0x7f2cb41005c0 2024-08-31T05:29:25.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.975+0000 7f2caaffd640 1 -- 172.21.15.67:0/2152559583 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f2cb008d320 con 0x7f2cb41005c0 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 6 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2, 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 1 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:29:25.978 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:29:25.979 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.1.1-242-g244a32d3 (244a32d3583bb0aa259286ff61157888a54a3ca5) squid (stable)": 2, 2024-08-31T05:29:25.979 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 11 2024-08-31T05:29:25.979 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:29:25.979 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:29:25.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.977+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2152559583 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ca0079e00 msgr2=0x7f2ca007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.977+0000 7f2cbc0e6640 1 --2- 172.21.15.67:0/2152559583 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ca0079e00 0x7f2ca007c2c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40058c0 tx=0x7f2ca4005850 comp rx=0 tx=0).stop 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.977+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2152559583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cb41005c0 msgr2=0x7f2cb41976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.977+0000 7f2cbc0e6640 1 --2- 172.21.15.67:0/2152559583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cb41005c0 0x7f2cb41976a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0031460 tx=0x7f2cb00045e0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.977+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2152559583 shutdown_connections 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.977+0000 7f2cbc0e6640 1 --2- 172.21.15.67:0/2152559583 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ca0079e00 0x7f2ca007c2c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.977+0000 7f2cbc0e6640 1 --2- 172.21.15.67:0/2152559583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb4106650 0x7f2cb4197be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.977+0000 7f2cbc0e6640 1 --2- 172.21.15.67:0/2152559583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cb41005c0 0x7f2cb41976a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.977+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2152559583 >> 172.21.15.67:0/2152559583 conn(0x7f2cb40fc2e0 msgr2=0x7f2cb4069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.978+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2152559583 shutdown_connections 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:25.978+0000 7f2cbc0e6640 1 -- 172.21.15.67:0/2152559583 wait complete. 2024-08-31T05:29:26.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.063+0000 7f6a93626640 1 -- 172.21.15.67:0/3464999166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a8c106660 msgr2=0x7f6a8c106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:26.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.063+0000 7f6a93626640 1 --2- 172.21.15.67:0/3464999166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a8c106660 0x7f6a8c106a40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009880 tx=0x7f6a8802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.063+0000 7f6a93626640 1 -- 172.21.15.67:0/3464999166 shutdown_connections 2024-08-31T05:29:26.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.063+0000 7f6a93626640 1 --2- 172.21.15.67:0/3464999166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c1005b0 0x7f6a8c100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.063+0000 7f6a93626640 1 --2- 172.21.15.67:0/3464999166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a8c106660 0x7f6a8c106a40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.063+0000 7f6a93626640 1 -- 172.21.15.67:0/3464999166 >> 172.21.15.67:0/3464999166 conn(0x7f6a8c0fc2f0 msgr2=0x7f6a8c0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:26.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.063+0000 7f6a93626640 1 -- 172.21.15.67:0/3464999166 shutdown_connections 2024-08-31T05:29:26.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.063+0000 7f6a93626640 1 -- 172.21.15.67:0/3464999166 wait complete. 2024-08-31T05:29:26.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.063+0000 7f6a93626640 1 Processor -- start 2024-08-31T05:29:26.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.063+0000 7f6a93626640 1 -- start start 2024-08-31T05:29:26.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.064+0000 7f6a93626640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a8c1005b0 0x7f6a8c102740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:26.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.064+0000 7f6a93626640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c106660 0x7f6a8c102c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:26.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.064+0000 7f6a93626640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8c10da50 con 0x7f6a8c1005b0 2024-08-31T05:29:26.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.064+0000 7f6a93626640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8c10d8d0 con 0x7f6a8c106660 2024-08-31T05:29:26.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.064+0000 7f6a913c2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a8c1005b0 0x7f6a8c102740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:26.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.064+0000 7f6a913c2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a8c1005b0 0x7f6a8c102740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45280/0 (socket says 172.21.15.67:45280) 2024-08-31T05:29:26.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.064+0000 7f6a913c2640 1 -- 172.21.15.67:0/4073500720 learned_addr learned my addr 172.21.15.67:0/4073500720 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:29:26.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.064+0000 7f6a90bc1640 1 --2- 172.21.15.67:0/4073500720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c106660 0x7f6a8c102c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:26.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.064+0000 7f6a913c2640 1 -- 172.21.15.67:0/4073500720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c106660 msgr2=0x7f6a8c102c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:26.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.064+0000 7f6a913c2640 1 --2- 172.21.15.67:0/4073500720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c106660 0x7f6a8c102c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.064+0000 7f6a913c2640 1 -- 172.21.15.67:0/4073500720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8c1031c0 con 0x7f6a8c1005b0 2024-08-31T05:29:26.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.064+0000 7f6a913c2640 1 --2- 172.21.15.67:0/4073500720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a8c1005b0 0x7f6a8c102740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a88004f90 tx=0x7f6a880048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:26.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.064+0000 7f6a7e7fc640 1 -- 172.21.15.67:0/4073500720 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a8803f070 con 0x7f6a8c1005b0 2024-08-31T05:29:26.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.065+0000 7f6a7e7fc640 1 -- 172.21.15.67:0/4073500720 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a88004c70 con 0x7f6a8c1005b0 2024-08-31T05:29:26.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.065+0000 7f6a93626640 1 -- 172.21.15.67:0/4073500720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a8c103450 con 0x7f6a8c1005b0 2024-08-31T05:29:26.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.065+0000 7f6a7e7fc640 1 -- 172.21.15.67:0/4073500720 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a88035030 con 0x7f6a8c1005b0 2024-08-31T05:29:26.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.065+0000 7f6a93626640 1 -- 172.21.15.67:0/4073500720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a8c1a3a90 con 0x7f6a8c1005b0 2024-08-31T05:29:26.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.066+0000 7f6a93626640 1 -- 172.21.15.67:0/4073500720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a8c101cd0 con 0x7f6a8c1005b0 2024-08-31T05:29:26.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.066+0000 7f6a7e7fc640 1 -- 172.21.15.67:0/4073500720 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f6a88042070 con 0x7f6a8c1005b0 2024-08-31T05:29:26.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.067+0000 7f6a7e7fc640 1 --2- 172.21.15.67:0/4073500720 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a78079e00 0x7f6a7807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:26.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.067+0000 7f6a7e7fc640 1 -- 172.21.15.67:0/4073500720 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6302+0+0 (secure 0 0 0) 0x7f6a880bd370 con 0x7f6a8c1005b0 2024-08-31T05:29:26.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.067+0000 7f6a90bc1640 1 --2- 172.21.15.67:0/4073500720 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a78079e00 0x7f6a7807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:26.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.067+0000 7f6a90bc1640 1 --2- 172.21.15.67:0/4073500720 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a78079e00 0x7f6a7807c2c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c1041d0 tx=0x7f6a8000b390 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:26.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.071+0000 7f6a7e7fc640 1 -- 172.21.15.67:0/4073500720 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6a88088f10 con 0x7f6a8c1005b0 2024-08-31T05:29:26.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:25 smithi073 ceph-mon[71452]: osdmap e93: 6 total, 6 up, 6 in 2024-08-31T05:29:26.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:25 smithi073 ceph-mon[71452]: fsmap cephfs:1 {0=cephfs.smithi073.kfbmeo=up:active} 2 up:standby 2024-08-31T05:29:26.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.296+0000 7f6a93626640 1 -- 172.21.15.67:0/4073500720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6a8c1a3d40 con 0x7f6a8c1005b0 2024-08-31T05:29:26.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.297+0000 7f6a7e7fc640 1 -- 172.21.15.67:0/4073500720 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1841 (secure 0 0 0) 0x7f6a8808d930 con 0x7f6a8c1005b0 2024-08-31T05:29:26.300 INFO:teuthology.orchestra.run.smithi067.stdout:e24 2024-08-31T05:29:26.300 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-08-31T05:29:24:749485+0000 2024-08-31T05:29:26.300 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:29:26.300 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:29:26.300 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-08-31T05:29:26.300 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:29:26.300 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:29:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-08-31T05:29:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 23 2024-08-31T05:29:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-31T05:29:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:29:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-08-31T05:29:15.613825+0000 2024-08-31T05:29:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-08-31T05:29:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-08-31T05:29:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2024-08-31T05:29:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-08-31T05:29:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-08-31T05:29:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-08-31T05:29:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-08-31T05:29:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-08-31T05:29:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 92 2024-08-31T05:29:26.302 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:29:26.302 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2024-08-31T05:29:26.302 INFO:teuthology.orchestra.run.smithi067.stdout:in 0 2024-08-31T05:29:26.302 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=24299} 2024-08-31T05:29:26.302 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-08-31T05:29:26.302 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-08-31T05:29:26.302 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-08-31T05:29:26.302 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-08-31T05:29:26.302 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-08-31T05:29:26.302 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data enabled 2024-08-31T05:29:26.302 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-08-31T05:29:26.302 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-08-31T05:29:26.303 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2024-08-31T05:29:26.303 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 24299 members: 24299 2024-08-31T05:29:26.303 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.kfbmeo{0:24299} state up:active seq 164 join_fscid=1 addr [v2:172.21.15.73:6826/1624245945,v1:172.21.15.73:6827/1624245945] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:26.303 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:29:26.303 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:29:26.303 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2024-08-31T05:29:26.303 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:29:26.303 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.gsnhxi{-1:24307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6824/2383176383,v1:172.21.15.73:6825/2383176383] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:26.303 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.tskvpt{-1:34322} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.67:6826/3864481333,v1:172.21.15.67:6827/3864481333] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:26.304 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 24 2024-08-31T05:29:26.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.300+0000 7f6a93626640 1 -- 172.21.15.67:0/4073500720 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a78079e00 msgr2=0x7f6a7807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:26.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.300+0000 7f6a93626640 1 --2- 172.21.15.67:0/4073500720 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a78079e00 0x7f6a7807c2c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c1041d0 tx=0x7f6a8000b390 comp rx=0 tx=0).stop 2024-08-31T05:29:26.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.300+0000 7f6a93626640 1 -- 172.21.15.67:0/4073500720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a8c1005b0 msgr2=0x7f6a8c102740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:26.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.300+0000 7f6a93626640 1 --2- 172.21.15.67:0/4073500720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a8c1005b0 0x7f6a8c102740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a88004f90 tx=0x7f6a880048f0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.300+0000 7f6a93626640 1 -- 172.21.15.67:0/4073500720 shutdown_connections 2024-08-31T05:29:26.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.300+0000 7f6a93626640 1 --2- 172.21.15.67:0/4073500720 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f6a78079e00 0x7f6a7807c2c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.300+0000 7f6a93626640 1 --2- 172.21.15.67:0/4073500720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c106660 0x7f6a8c102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.300+0000 7f6a93626640 1 --2- 172.21.15.67:0/4073500720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a8c1005b0 0x7f6a8c102740 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.300+0000 7f6a93626640 1 -- 172.21.15.67:0/4073500720 >> 172.21.15.67:0/4073500720 conn(0x7f6a8c0fc2f0 msgr2=0x7f6a8c1048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:26.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.300+0000 7f6a93626640 1 -- 172.21.15.67:0/4073500720 shutdown_connections 2024-08-31T05:29:26.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.300+0000 7f6a93626640 1 -- 172.21.15.67:0/4073500720 wait complete. 2024-08-31T05:29:26.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.389+0000 7efd8fc12640 1 -- 172.21.15.67:0/4039933749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd881016a0 msgr2=0x7efd88101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:26.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.389+0000 7efd8fc12640 1 --2- 172.21.15.67:0/4039933749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd881016a0 0x7efd88101b00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efd78009880 tx=0x7efd7802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.389+0000 7efd8fc12640 1 -- 172.21.15.67:0/4039933749 shutdown_connections 2024-08-31T05:29:26.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.389+0000 7efd8fc12640 1 --2- 172.21.15.67:0/4039933749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd881016a0 0x7efd88101b00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.389+0000 7efd8fc12640 1 --2- 172.21.15.67:0/4039933749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd881076a0 0x7efd88107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.389+0000 7efd8fc12640 1 -- 172.21.15.67:0/4039933749 >> 172.21.15.67:0/4039933749 conn(0x7efd880fd3a0 msgr2=0x7efd880ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:26.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.389+0000 7efd8fc12640 1 -- 172.21.15.67:0/4039933749 shutdown_connections 2024-08-31T05:29:26.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.389+0000 7efd8fc12640 1 -- 172.21.15.67:0/4039933749 wait complete. 2024-08-31T05:29:26.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.389+0000 7efd8fc12640 1 Processor -- start 2024-08-31T05:29:26.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.389+0000 7efd8fc12640 1 -- start start 2024-08-31T05:29:26.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.390+0000 7efd8fc12640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd881016a0 0x7efd88197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:26.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.390+0000 7efd8fc12640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd881076a0 0x7efd88197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:26.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.390+0000 7efd8fc12640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efd8810eb50 con 0x7efd881076a0 2024-08-31T05:29:26.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.390+0000 7efd8fc12640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efd8810e9d0 con 0x7efd881016a0 2024-08-31T05:29:26.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.390+0000 7efd8d1ad640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd881076a0 0x7efd88197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:26.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.390+0000 7efd8d1ad640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd881076a0 0x7efd88197c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45304/0 (socket says 172.21.15.67:45304) 2024-08-31T05:29:26.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.390+0000 7efd8d1ad640 1 -- 172.21.15.67:0/3850261075 learned_addr learned my addr 172.21.15.67:0/3850261075 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:29:26.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.390+0000 7efd8d9ae640 1 --2- 172.21.15.67:0/3850261075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd881016a0 0x7efd88197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:26.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.390+0000 7efd8d1ad640 1 -- 172.21.15.67:0/3850261075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd881016a0 msgr2=0x7efd88197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:26.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.390+0000 7efd8d1ad640 1 --2- 172.21.15.67:0/3850261075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd881016a0 0x7efd88197710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.390+0000 7efd8d1ad640 1 -- 172.21.15.67:0/3850261075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8819bfe0 con 0x7efd881076a0 2024-08-31T05:29:26.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.390+0000 7efd8d1ad640 1 --2- 172.21.15.67:0/3850261075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd881076a0 0x7efd88197c50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd78031460 tx=0x7efd780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:26.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.390+0000 7efd7effd640 1 -- 172.21.15.67:0/3850261075 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd7803f070 con 0x7efd881076a0 2024-08-31T05:29:26.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.391+0000 7efd8fc12640 1 -- 172.21.15.67:0/3850261075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8819c270 con 0x7efd881076a0 2024-08-31T05:29:26.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.391+0000 7efd7effd640 1 -- 172.21.15.67:0/3850261075 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efd78004cf0 con 0x7efd881076a0 2024-08-31T05:29:26.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.391+0000 7efd7effd640 1 -- 172.21.15.67:0/3850261075 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd78035030 con 0x7efd881076a0 2024-08-31T05:29:26.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.391+0000 7efd8fc12640 1 -- 172.21.15.67:0/3850261075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8819c7a0 con 0x7efd881076a0 2024-08-31T05:29:26.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.392+0000 7efd8fc12640 1 -- 172.21.15.67:0/3850261075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd88102de0 con 0x7efd881076a0 2024-08-31T05:29:26.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.392+0000 7efd7effd640 1 -- 172.21.15.67:0/3850261075 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7efd78042070 con 0x7efd881076a0 2024-08-31T05:29:26.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.393+0000 7efd7effd640 1 --2- 172.21.15.67:0/3850261075 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efd74079e40 0x7efd7407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:26.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.393+0000 7efd7effd640 1 -- 172.21.15.67:0/3850261075 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6302+0+0 (secure 0 0 0) 0x7efd780bd390 con 0x7efd881076a0 2024-08-31T05:29:26.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.393+0000 7efd8d9ae640 1 --2- 172.21.15.67:0/3850261075 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efd74079e40 0x7efd7407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:26.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.393+0000 7efd8d9ae640 1 --2- 172.21.15.67:0/3850261075 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efd74079e40 0x7efd7407c300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd840058c0 tx=0x7efd8400a4c0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:26.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.397+0000 7efd7effd640 1 -- 172.21.15.67:0/3850261075 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efd78084e40 con 0x7efd881076a0 2024-08-31T05:29:26.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.612+0000 7efd8fc12640 1 -- 172.21.15.67:0/3850261075 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efd8819ca50 con 0x7efd74079e40 2024-08-31T05:29:26.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.613+0000 7efd7effd640 1 -- 172.21.15.67:0/3850261075 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7efd8819ca50 con 0x7efd74079e40 2024-08-31T05:29:26.616 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:29:26.616 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:29:26.616 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:29:26.616 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-31T05:29:26.616 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:29:26.616 INFO:teuthology.orchestra.run.smithi067.stdout: "mon", 2024-08-31T05:29:26.617 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2024-08-31T05:29:26.617 INFO:teuthology.orchestra.run.smithi067.stdout: "osd", 2024-08-31T05:29:26.617 INFO:teuthology.orchestra.run.smithi067.stdout: "crash" 2024-08-31T05:29:26.617 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:29:26.617 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "13/23 daemons upgraded", 2024-08-31T05:29:26.617 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading mds daemons", 2024-08-31T05:29:26.617 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:29:26.617 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:29:26.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.616+0000 7efd8fc12640 1 -- 172.21.15.67:0/3850261075 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efd74079e40 msgr2=0x7efd7407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:26.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.616+0000 7efd8fc12640 1 --2- 172.21.15.67:0/3850261075 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efd74079e40 0x7efd7407c300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd840058c0 tx=0x7efd8400a4c0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.616+0000 7efd8fc12640 1 -- 172.21.15.67:0/3850261075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd881076a0 msgr2=0x7efd88197c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:26.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.616+0000 7efd8fc12640 1 --2- 172.21.15.67:0/3850261075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd881076a0 0x7efd88197c50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd78031460 tx=0x7efd780048f0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.616+0000 7efd8fc12640 1 -- 172.21.15.67:0/3850261075 shutdown_connections 2024-08-31T05:29:26.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.616+0000 7efd8fc12640 1 --2- 172.21.15.67:0/3850261075 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efd74079e40 0x7efd7407c300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.616+0000 7efd8fc12640 1 --2- 172.21.15.67:0/3850261075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd881076a0 0x7efd88197c50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.616+0000 7efd8fc12640 1 --2- 172.21.15.67:0/3850261075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd881016a0 0x7efd88197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.616+0000 7efd8fc12640 1 -- 172.21.15.67:0/3850261075 >> 172.21.15.67:0/3850261075 conn(0x7efd880fd3a0 msgr2=0x7efd880fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:26.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.616+0000 7efd8fc12640 1 -- 172.21.15.67:0/3850261075 shutdown_connections 2024-08-31T05:29:26.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.616+0000 7efd8fc12640 1 -- 172.21.15.67:0/3850261075 wait complete. 2024-08-31T05:29:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.704+0000 7f30e9e2c640 1 -- 172.21.15.67:0/4237470695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30e4103190 msgr2=0x7f30e410b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.704+0000 7f30e9e2c640 1 --2- 172.21.15.67:0/4237470695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30e4103190 0x7f30e410b680 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009880 tx=0x7f30d802a530 comp rx=0 tx=0).stop 2024-08-31T05:29:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.704+0000 7f30e9e2c640 1 -- 172.21.15.67:0/4237470695 shutdown_connections 2024-08-31T05:29:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.704+0000 7f30e9e2c640 1 --2- 172.21.15.67:0/4237470695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30e4103190 0x7f30e410b680 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.704+0000 7f30e9e2c640 1 --2- 172.21.15.67:0/4237470695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30e4102870 0x7f30e4102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.704+0000 7f30e9e2c640 1 -- 172.21.15.67:0/4237470695 >> 172.21.15.67:0/4237470695 conn(0x7f30e40fc2b0 msgr2=0x7f30e40fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.704+0000 7f30e9e2c640 1 -- 172.21.15.67:0/4237470695 shutdown_connections 2024-08-31T05:29:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.704+0000 7f30e9e2c640 1 -- 172.21.15.67:0/4237470695 wait complete. 2024-08-31T05:29:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.705+0000 7f30e9e2c640 1 Processor -- start 2024-08-31T05:29:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.705+0000 7f30e9e2c640 1 -- start start 2024-08-31T05:29:26.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.706+0000 7f30e9e2c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30e4102870 0x7f30e4197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.706+0000 7f30e37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30e4102870 0x7f30e4197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.706+0000 7f30e37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30e4102870 0x7f30e4197560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45330/0 (socket says 172.21.15.67:45330) 2024-08-31T05:29:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.706+0000 7f30e37fe640 1 -- 172.21.15.67:0/1715122496 learned_addr learned my addr 172.21.15.67:0/1715122496 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:29:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.706+0000 7f30e9e2c640 1 --2- 172.21.15.67:0/1715122496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30e4103190 0x7f30e4197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:26.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.706+0000 7f30e9e2c640 1 -- 172.21.15.67:0/1715122496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f30e410eba0 con 0x7f30e4102870 2024-08-31T05:29:26.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.707+0000 7f30e9e2c640 1 -- 172.21.15.67:0/1715122496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f30e410ea20 con 0x7f30e4103190 2024-08-31T05:29:26.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.707+0000 7f30e2ffd640 1 --2- 172.21.15.67:0/1715122496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30e4103190 0x7f30e4197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:26.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.707+0000 7f30e37fe640 1 -- 172.21.15.67:0/1715122496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30e4103190 msgr2=0x7f30e4197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:26.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.707+0000 7f30e37fe640 1 --2- 172.21.15.67:0/1715122496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30e4103190 0x7f30e4197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.707+0000 7f30e37fe640 1 -- 172.21.15.67:0/1715122496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e419be30 con 0x7f30e4102870 2024-08-31T05:29:26.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.707+0000 7f30e37fe640 1 --2- 172.21.15.67:0/1715122496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30e4102870 0x7f30e4197560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f30d400c8f0 tx=0x7f30d400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:26.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.707+0000 7f30e0ff9640 1 -- 172.21.15.67:0/1715122496 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f30d40079b0 con 0x7f30e4102870 2024-08-31T05:29:26.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.708+0000 7f30e0ff9640 1 -- 172.21.15.67:0/1715122496 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f30d40054e0 con 0x7f30e4102870 2024-08-31T05:29:26.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.708+0000 7f30e9e2c640 1 -- 172.21.15.67:0/1715122496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e419c0c0 con 0x7f30e4102870 2024-08-31T05:29:26.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.708+0000 7f30e0ff9640 1 -- 172.21.15.67:0/1715122496 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f30d4004dd0 con 0x7f30e4102870 2024-08-31T05:29:26.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.708+0000 7f30e9e2c640 1 -- 172.21.15.67:0/1715122496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e419c650 con 0x7f30e4102870 2024-08-31T05:29:26.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.709+0000 7f30e9e2c640 1 -- 172.21.15.67:0/1715122496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e406ab40 con 0x7f30e4102870 2024-08-31T05:29:26.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.709+0000 7f30e0ff9640 1 -- 172.21.15.67:0/1715122496 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f30d400f4a0 con 0x7f30e4102870 2024-08-31T05:29:26.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.710+0000 7f30e0ff9640 1 --2- 172.21.15.67:0/1715122496 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f30cc079da0 0x7f30cc07c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:26.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.710+0000 7f30e0ff9640 1 -- 172.21.15.67:0/1715122496 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6302+0+0 (secure 0 0 0) 0x7f30d409c970 con 0x7f30e4102870 2024-08-31T05:29:26.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.710+0000 7f30e2ffd640 1 --2- 172.21.15.67:0/1715122496 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f30cc079da0 0x7f30cc07c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:26.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.711+0000 7f30e2ffd640 1 --2- 172.21.15.67:0/1715122496 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f30cc079da0 0x7f30cc07c260 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f30d80096c0 tx=0x7f30d8000bc0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:26.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.715+0000 7f30e0ff9640 1 -- 172.21.15.67:0/1715122496 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f30d409ee20 con 0x7f30e4102870 2024-08-31T05:29:26.879 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:26 smithi067 ceph-mon[99941]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:26.880 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:26 smithi067 ceph-mon[99941]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:26.880 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:26 smithi067 ceph-mon[99941]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:26.880 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:26 smithi067 ceph-mon[99941]: pgmap v270: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-08-31T05:29:26.880 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:26 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2152559583' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:26.880 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:26 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/4073500720' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:29:26.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.983+0000 7f30e9e2c640 1 -- 172.21.15.67:0/1715122496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f30e419c960 con 0x7f30e4102870 2024-08-31T05:29:26.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.983+0000 7f30e0ff9640 1 -- 172.21.15.67:0/1715122496 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f30d4014030 con 0x7f30e4102870 2024-08-31T05:29:26.986 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-31T05:29:26.986 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:29:26.986 INFO:teuthology.orchestra.run.smithi067.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:29:26.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.985+0000 7f30e9e2c640 1 -- 172.21.15.67:0/1715122496 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f30cc079da0 msgr2=0x7f30cc07c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:26.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.985+0000 7f30e9e2c640 1 --2- 172.21.15.67:0/1715122496 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f30cc079da0 0x7f30cc07c260 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f30d80096c0 tx=0x7f30d8000bc0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.985+0000 7f30e9e2c640 1 -- 172.21.15.67:0/1715122496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30e4102870 msgr2=0x7f30e4197560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:26.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.985+0000 7f30e9e2c640 1 --2- 172.21.15.67:0/1715122496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30e4102870 0x7f30e4197560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f30d400c8f0 tx=0x7f30d400cdb0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.985+0000 7f30e9e2c640 1 -- 172.21.15.67:0/1715122496 shutdown_connections 2024-08-31T05:29:26.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.985+0000 7f30e9e2c640 1 --2- 172.21.15.67:0/1715122496 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f30cc079da0 0x7f30cc07c260 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.985+0000 7f30e9e2c640 1 --2- 172.21.15.67:0/1715122496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30e4103190 0x7f30e4197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.985+0000 7f30e9e2c640 1 --2- 172.21.15.67:0/1715122496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30e4102870 0x7f30e4197560 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:26.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.985+0000 7f30e9e2c640 1 -- 172.21.15.67:0/1715122496 >> 172.21.15.67:0/1715122496 conn(0x7f30e40fc2b0 msgr2=0x7f30e410b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:26.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.986+0000 7f30e9e2c640 1 -- 172.21.15.67:0/1715122496 shutdown_connections 2024-08-31T05:29:26.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:26.986+0000 7f30e9e2c640 1 -- 172.21.15.67:0/1715122496 wait complete. 2024-08-31T05:29:27.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:26 smithi073 ceph-mon[71452]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:27.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:26 smithi073 ceph-mon[71452]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:27.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:26 smithi073 ceph-mon[71452]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:27.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:26 smithi073 ceph-mon[71452]: pgmap v270: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-08-31T05:29:27.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:26 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2152559583' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:27.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:26 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/4073500720' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:29:27.972 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:27 smithi067 ceph-mon[99941]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:27.972 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:27 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/1715122496' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:29:27.972 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:27 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:27.972 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:27 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:27.972 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:27 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:28.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:27 smithi073 ceph-mon[71452]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:28.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:27 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/1715122496' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:29:28.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:27 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:28.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:27 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:28.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:27 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:29.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:28 smithi067 ceph-mon[99941]: pgmap v271: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-08-31T05:29:29.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:28 smithi067 ceph-mon[99941]: mds.? [v2:172.21.15.67:6828/352208921,v1:172.21.15.67:6829/352208921] up:boot 2024-08-31T05:29:29.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:28 smithi067 ceph-mon[99941]: fsmap cephfs:1 {0=cephfs.smithi073.kfbmeo=up:active} 3 up:standby 2024-08-31T05:29:29.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:28 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mds metadata", "who": "cephfs.smithi067.beqeql"} : dispatch 2024-08-31T05:29:29.097 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:28 smithi073 ceph-mon[71452]: pgmap v271: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-08-31T05:29:29.097 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:28 smithi073 ceph-mon[71452]: mds.? [v2:172.21.15.67:6828/352208921,v1:172.21.15.67:6829/352208921] up:boot 2024-08-31T05:29:29.097 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:28 smithi073 ceph-mon[71452]: fsmap cephfs:1 {0=cephfs.smithi073.kfbmeo=up:active} 3 up:standby 2024-08-31T05:29:29.097 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:28 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mds metadata", "who": "cephfs.smithi067.beqeql"} : dispatch 2024-08-31T05:29:30.917 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:30 smithi067 ceph-mon[99941]: pgmap v272: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:31.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:30 smithi073 ceph-mon[71452]: pgmap v272: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:33.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:32 smithi067 ceph-mon[99941]: pgmap v273: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:33.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:32 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:33.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:32 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:33.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:32 smithi073 ceph-mon[71452]: pgmap v273: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:32 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:32 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:34 smithi067 ceph-mon[99941]: pgmap v274: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:34.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:34.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:34.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:34 smithi073 ceph-mon[71452]: pgmap v274: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:35.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:29:35.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:29:36.206 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:36 smithi067 ceph-mon[99941]: pgmap v275: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:36.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:36 smithi073 ceph-mon[71452]: pgmap v275: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:37.342 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:37 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:37.342 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:37 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:37.342 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:37 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:37.342 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:37 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:29:37.343 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:37 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:37.343 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:37 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:37.343 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:37 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:37.343 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:37 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:37.343 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:37 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:37.343 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:37 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:37 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:37 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:37 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:37 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:29:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:37 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:37 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:37 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:37 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:37.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:37 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:37.576 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:37 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:38.511 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:38 smithi073 ceph-mon[71452]: pgmap v276: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:38.511 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:38 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:38.511 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:38 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.gsnhxi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:29:38.511 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:38 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:38.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:38 smithi067 ceph-mon[99941]: pgmap v276: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:38.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:38 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:38.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:38 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.gsnhxi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:29:38.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:38 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:39.423 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:39 smithi073 ceph-mon[71452]: Upgrade: Updating mds.cephfs.smithi073.gsnhxi 2024-08-31T05:29:39.423 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:39 smithi073 ceph-mon[71452]: Deploying daemon mds.cephfs.smithi073.gsnhxi on smithi073 2024-08-31T05:29:39.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:39 smithi067 ceph-mon[99941]: Upgrade: Updating mds.cephfs.smithi073.gsnhxi 2024-08-31T05:29:39.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:39 smithi067 ceph-mon[99941]: Deploying daemon mds.cephfs.smithi073.gsnhxi on smithi073 2024-08-31T05:29:40.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:40 smithi067 ceph-mon[99941]: pgmap v277: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:40.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:40 smithi073 ceph-mon[71452]: pgmap v277: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:41.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:41 smithi073 ceph-mon[71452]: osdmap e94: 6 total, 6 up, 6 in 2024-08-31T05:29:41.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:41 smithi073 ceph-mon[71452]: fsmap cephfs:1 {0=cephfs.smithi073.kfbmeo=up:active} 2 up:standby 2024-08-31T05:29:41.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:41 smithi067 ceph-mon[99941]: osdmap e94: 6 total, 6 up, 6 in 2024-08-31T05:29:41.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:41 smithi067 ceph-mon[99941]: fsmap cephfs:1 {0=cephfs.smithi073.kfbmeo=up:active} 2 up:standby 2024-08-31T05:29:42.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:42 smithi067 ceph-mon[99941]: pgmap v279: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:42.588 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:42 smithi073 ceph-mon[71452]: pgmap v279: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:44.164 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:43 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:44.164 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:43 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:44.164 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:43 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:44.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:43 smithi073 ceph-mon[71452]: mds.? [v2:172.21.15.73:6824/2489979765,v1:172.21.15.73:6825/2489979765] up:boot 2024-08-31T05:29:44.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:43 smithi073 ceph-mon[71452]: fsmap cephfs:1 {0=cephfs.smithi073.kfbmeo=up:active} 3 up:standby 2024-08-31T05:29:44.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:43 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mds metadata", "who": "cephfs.smithi073.gsnhxi"} : dispatch 2024-08-31T05:29:44.165 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:43 smithi073 ceph-mon[71452]: pgmap v280: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:43 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:43 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:43 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:43 smithi067 ceph-mon[99941]: mds.? [v2:172.21.15.73:6824/2489979765,v1:172.21.15.73:6825/2489979765] up:boot 2024-08-31T05:29:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:43 smithi067 ceph-mon[99941]: fsmap cephfs:1 {0=cephfs.smithi073.kfbmeo=up:active} 3 up:standby 2024-08-31T05:29:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:43 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mds metadata", "who": "cephfs.smithi073.gsnhxi"} : dispatch 2024-08-31T05:29:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:43 smithi067 ceph-mon[99941]: pgmap v280: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:46.723 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:46 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:46.723 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:46 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:46.723 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:46 smithi073 ceph-mon[71452]: pgmap v281: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:46.723 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:46 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:46.723 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:46 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:46.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:46 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:46.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:46 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:46.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:46 smithi067 ceph-mon[99941]: pgmap v281: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:46.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:46 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:46.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:46 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:48.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:48 smithi073 ceph-mon[71452]: pgmap v282: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:49.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:48 smithi067 ceph-mon[99941]: pgmap v282: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:50.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:50.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:50.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:50.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:29:50.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:50.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:50.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:50.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:50.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:50.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:50.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:29:50.697 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:50 smithi073 ceph-mon[71452]: pgmap v283: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:50.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:50.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:50.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:50.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:29:50.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:50.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:50.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:50.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:50.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:50.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:50.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:29:50.826 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:50 smithi067 ceph-mon[99941]: pgmap v283: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:52.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:51 smithi073 ceph-mon[71452]: Upgrade: Updating mds.cephfs.smithi073.kfbmeo 2024-08-31T05:29:52.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:51 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:52.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:51 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.kfbmeo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:29:52.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:51 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:52.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:51 smithi073 ceph-mon[71452]: Deploying daemon mds.cephfs.smithi073.kfbmeo on smithi073 2024-08-31T05:29:52.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:51 smithi073 ceph-mon[71452]: pgmap v284: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:52.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:51 smithi067 ceph-mon[99941]: Upgrade: Updating mds.cephfs.smithi073.kfbmeo 2024-08-31T05:29:52.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:51 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:29:52.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:51 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi073.kfbmeo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:29:52.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:51 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:52.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:51 smithi067 ceph-mon[99941]: Deploying daemon mds.cephfs.smithi073.kfbmeo on smithi073 2024-08-31T05:29:52.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:51 smithi067 ceph-mon[99941]: pgmap v284: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-08-31T05:29:53.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:52 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067[99937]: 2024-08-31T05:29:52.951+0000 7f607dfa4640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T05:29:53.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:53 smithi073 ceph-mon[71452]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T05:29:53.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:53 smithi073 ceph-mon[71452]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T05:29:53.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:53 smithi073 ceph-mon[71452]: osdmap e95: 6 total, 6 up, 6 in 2024-08-31T05:29:53.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:53 smithi073 ceph-mon[71452]: Standby daemon mds.cephfs.smithi067.tskvpt assigned to filesystem cephfs as rank 0 2024-08-31T05:29:53.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:53 smithi073 ceph-mon[71452]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T05:29:53.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:53 smithi073 ceph-mon[71452]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-08-31T05:29:53.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:53 smithi073 ceph-mon[71452]: fsmap cephfs:1/1 {0=cephfs.smithi067.tskvpt=up:replay} 2 up:standby 2024-08-31T05:29:54.003 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:53 smithi067 ceph-mon[99941]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T05:29:54.030 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:53 smithi067 ceph-mon[99941]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T05:29:54.030 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:53 smithi067 ceph-mon[99941]: osdmap e95: 6 total, 6 up, 6 in 2024-08-31T05:29:54.030 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:53 smithi067 ceph-mon[99941]: Standby daemon mds.cephfs.smithi067.tskvpt assigned to filesystem cephfs as rank 0 2024-08-31T05:29:54.030 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:53 smithi067 ceph-mon[99941]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T05:29:54.030 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:53 smithi067 ceph-mon[99941]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-08-31T05:29:54.030 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:53 smithi067 ceph-mon[99941]: fsmap cephfs:1/1 {0=cephfs.smithi067.tskvpt=up:replay} 2 up:standby 2024-08-31T05:29:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:54 smithi067 ceph-mon[99941]: pgmap v286: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 409 KiB/s rd, 0 op/s 2024-08-31T05:29:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:54 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mds metadata", "who": "cephfs.smithi073.kfbmeo"} : dispatch 2024-08-31T05:29:55.100 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:54 smithi073 ceph-mon[71452]: pgmap v286: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 409 KiB/s rd, 0 op/s 2024-08-31T05:29:55.100 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:54 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mds metadata", "who": "cephfs.smithi073.kfbmeo"} : dispatch 2024-08-31T05:29:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:56 smithi067 ceph-mon[99941]: pgmap v287: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.4 MiB/s rd, 1 op/s 2024-08-31T05:29:57.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.075+0000 7f30040ec640 1 -- 172.21.15.67:0/1613969107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ffc074ce0 msgr2=0x7f2ffc10d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.075+0000 7f30040ec640 1 --2- 172.21.15.67:0/1613969107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ffc074ce0 0x7f2ffc10d9a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2fec009880 tx=0x7f2fec02a530 comp rx=0 tx=0).stop 2024-08-31T05:29:57.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.075+0000 7f30040ec640 1 -- 172.21.15.67:0/1613969107 shutdown_connections 2024-08-31T05:29:57.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.075+0000 7f30040ec640 1 --2- 172.21.15.67:0/1613969107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ffc074ce0 0x7f2ffc10d9a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.075+0000 7f30040ec640 1 --2- 172.21.15.67:0/1613969107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc0743c0 0x7f2ffc0747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.075+0000 7f30040ec640 1 -- 172.21.15.67:0/1613969107 >> 172.21.15.67:0/1613969107 conn(0x7f2ffc0fd3a0 msgr2=0x7f2ffc0ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:57.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.075+0000 7f30040ec640 1 -- 172.21.15.67:0/1613969107 shutdown_connections 2024-08-31T05:29:57.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.075+0000 7f30040ec640 1 -- 172.21.15.67:0/1613969107 wait complete. 2024-08-31T05:29:57.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.076+0000 7f30040ec640 1 Processor -- start 2024-08-31T05:29:57.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.076+0000 7f30040ec640 1 -- start start 2024-08-31T05:29:57.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.076+0000 7f30040ec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ffc0743c0 0x7f2ffc19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:57.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.076+0000 7f30040ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc074ce0 0x7f2ffc19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:57.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.076+0000 7f30040ec640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2ffc110d90 con 0x7f2ffc0743c0 2024-08-31T05:29:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.076+0000 7f30040ec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ffc110c10 con 0x7f2ffc074ce0 2024-08-31T05:29:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.077+0000 7f3001e88640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ffc0743c0 0x7f2ffc19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.077+0000 7f3001e88640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ffc0743c0 0x7f2ffc19f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57450/0 (socket says 172.21.15.67:57450) 2024-08-31T05:29:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.077+0000 7f3001e88640 1 -- 172.21.15.67:0/1136213307 learned_addr learned my addr 172.21.15.67:0/1136213307 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:29:57.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.077+0000 7f3001687640 1 --2- 172.21.15.67:0/1136213307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc074ce0 0x7f2ffc19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.077+0000 7f3001e88640 1 -- 172.21.15.67:0/1136213307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc074ce0 msgr2=0x7f2ffc19fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.077+0000 7f3001e88640 1 --2- 172.21.15.67:0/1136213307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc074ce0 0x7f2ffc19fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.077+0000 7f3001e88640 1 -- 172.21.15.67:0/1136213307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ffc1997c0 con 0x7f2ffc0743c0 2024-08-31T05:29:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.077+0000 7f3001e88640 1 --2- 172.21.15.67:0/1136213307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ffc0743c0 0x7f2ffc19f640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800e970 tx=0x7f2ff800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.077+0000 7f2ff2ffd640 1 -- 172.21.15.67:0/1136213307 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ff800cac0 con 0x7f2ffc0743c0 2024-08-31T05:29:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.077+0000 7f2ff2ffd640 1 -- 172.21.15.67:0/1136213307 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ff80054e0 con 0x7f2ffc0743c0 2024-08-31T05:29:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.077+0000 7f30040ec640 1 -- 172.21.15.67:0/1136213307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ffc199ab0 con 0x7f2ffc0743c0 2024-08-31T05:29:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.077+0000 7f2ff2ffd640 1 -- 172.21.15.67:0/1136213307 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ff8010430 con 0x7f2ffc0743c0 2024-08-31T05:29:57.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.078+0000 7f30040ec640 1 -- 172.21.15.67:0/1136213307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ffc19a010 con 0x7f2ffc0743c0 2024-08-31T05:29:57.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.079+0000 7f30040ec640 1 -- 172.21.15.67:0/1136213307 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ffc075a70 con 0x7f2ffc0743c0 2024-08-31T05:29:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.080+0000 7f2ff2ffd640 1 -- 172.21.15.67:0/1136213307 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f2ff8004e80 con 0x7f2ffc0743c0 2024-08-31T05:29:57.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.081+0000 7f2ff2ffd640 1 --2- 172.21.15.67:0/1136213307 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2fe8079e00 0x7f2fe807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:57.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.081+0000 7f2ff2ffd640 1 -- 172.21.15.67:0/1136213307 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f2ff809d2b0 con 0x7f2ffc0743c0 2024-08-31T05:29:57.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.081+0000 7f3001687640 1 --2- 172.21.15.67:0/1136213307 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2fe8079e00 0x7f2fe807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:57.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.082+0000 7f3001687640 1 --2- 172.21.15.67:0/1136213307 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2fe8079e00 0x7f2fe807c2c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc19ab10 tx=0x7f2fec031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:57.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.085+0000 7f2ff2ffd640 1 -- 172.21.15.67:0/1136213307 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2ff8064d00 con 0x7f2ffc0743c0 2024-08-31T05:29:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:56 smithi073 ceph-mon[71452]: pgmap v287: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.4 MiB/s rd, 1 op/s 2024-08-31T05:29:57.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.290+0000 7f30040ec640 1 -- 172.21.15.67:0/1136213307 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2ffc19a320 con 0x7f2fe8079e00 2024-08-31T05:29:57.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.292+0000 7f2ff2ffd640 1 -- 172.21.15.67:0/1136213307 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f2ffc19a320 con 0x7f2fe8079e00 2024-08-31T05:29:57.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.294+0000 7f30040ec640 1 -- 172.21.15.67:0/1136213307 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2fe8079e00 msgr2=0x7f2fe807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.294+0000 7f30040ec640 1 --2- 172.21.15.67:0/1136213307 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2fe8079e00 0x7f2fe807c2c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc19ab10 tx=0x7f2fec031400 comp rx=0 tx=0).stop 2024-08-31T05:29:57.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.294+0000 7f30040ec640 1 -- 172.21.15.67:0/1136213307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ffc0743c0 msgr2=0x7f2ffc19f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.294+0000 7f30040ec640 1 --2- 172.21.15.67:0/1136213307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ffc0743c0 0x7f2ffc19f640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800e970 tx=0x7f2ff800ed70 comp rx=0 tx=0).stop 2024-08-31T05:29:57.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.294+0000 7f30040ec640 1 -- 172.21.15.67:0/1136213307 shutdown_connections 2024-08-31T05:29:57.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.294+0000 7f30040ec640 1 --2- 172.21.15.67:0/1136213307 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2fe8079e00 0x7f2fe807c2c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.294+0000 7f30040ec640 1 --2- 172.21.15.67:0/1136213307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ffc074ce0 0x7f2ffc19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.294+0000 7f30040ec640 1 --2- 172.21.15.67:0/1136213307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ffc0743c0 0x7f2ffc19f640 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.294+0000 7f30040ec640 1 -- 172.21.15.67:0/1136213307 >> 172.21.15.67:0/1136213307 conn(0x7f2ffc0fd3a0 msgr2=0x7f2ffc10afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:57.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.294+0000 7f30040ec640 1 -- 172.21.15.67:0/1136213307 shutdown_connections 2024-08-31T05:29:57.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.294+0000 7f30040ec640 1 -- 172.21.15.67:0/1136213307 wait complete. 2024-08-31T05:29:57.304 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:29:57.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.379+0000 7f39bfd07640 1 -- 172.21.15.67:0/4215323336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39b8106660 msgr2=0x7f39b8106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.379+0000 7f39bfd07640 1 --2- 172.21.15.67:0/4215323336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39b8106660 0x7f39b8106a40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009880 tx=0x7f39b402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.379+0000 7f39bfd07640 1 -- 172.21.15.67:0/4215323336 shutdown_connections 2024-08-31T05:29:57.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.379+0000 7f39bfd07640 1 --2- 172.21.15.67:0/4215323336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b81005b0 0x7f39b8100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.379+0000 7f39bfd07640 1 --2- 172.21.15.67:0/4215323336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39b8106660 0x7f39b8106a40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.379+0000 7f39bfd07640 1 -- 172.21.15.67:0/4215323336 >> 172.21.15.67:0/4215323336 conn(0x7f39b80fc2f0 msgr2=0x7f39b80fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:57.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.380+0000 7f39bfd07640 1 -- 172.21.15.67:0/4215323336 shutdown_connections 2024-08-31T05:29:57.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.380+0000 7f39bfd07640 1 -- 172.21.15.67:0/4215323336 wait complete. 2024-08-31T05:29:57.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.380+0000 7f39bfd07640 1 Processor -- start 2024-08-31T05:29:57.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.380+0000 7f39bfd07640 1 -- start start 2024-08-31T05:29:57.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.381+0000 7f39bfd07640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b81005b0 0x7f39b81965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:57.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.381+0000 7f39bfd07640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39b8106660 0x7f39b8196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:57.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.381+0000 7f39bfd07640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f39b810dad0 con 0x7f39b8106660 2024-08-31T05:29:57.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.381+0000 7f39bfd07640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f39b810d950 con 0x7f39b81005b0 2024-08-31T05:29:57.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.381+0000 7f39bd2a2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39b8106660 0x7f39b8196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:57.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.381+0000 7f39bd2a2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39b8106660 0x7f39b8196af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57460/0 (socket says 172.21.15.67:57460) 2024-08-31T05:29:57.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.381+0000 7f39bd2a2640 1 -- 172.21.15.67:0/2550579949 learned_addr learned my addr 172.21.15.67:0/2550579949 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:29:57.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.381+0000 7f39bdaa3640 1 --2- 172.21.15.67:0/2550579949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b81005b0 0x7f39b81965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:57.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.381+0000 7f39bd2a2640 1 -- 172.21.15.67:0/2550579949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b81005b0 msgr2=0x7f39b81965b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.381+0000 7f39bd2a2640 1 --2- 172.21.15.67:0/2550579949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b81005b0 0x7f39b81965b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.381+0000 7f39bd2a2640 1 -- 172.21.15.67:0/2550579949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b819ae80 con 0x7f39b8106660 2024-08-31T05:29:57.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.382+0000 7f39bd2a2640 1 --2- 172.21.15.67:0/2550579949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39b8106660 0x7f39b8196af0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f39a800b420 tx=0x7f39a800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:57.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.382+0000 7f39aeffd640 1 -- 172.21.15.67:0/2550579949 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39a8011630 con 0x7f39b8106660 2024-08-31T05:29:57.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.382+0000 7f39bfd07640 1 -- 172.21.15.67:0/2550579949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b819b170 con 0x7f39b8106660 2024-08-31T05:29:57.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.382+0000 7f39aeffd640 1 -- 172.21.15.67:0/2550579949 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39a8016070 con 0x7f39b8106660 2024-08-31T05:29:57.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.382+0000 7f39aeffd640 1 -- 172.21.15.67:0/2550579949 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39a8010d40 con 0x7f39b8106660 2024-08-31T05:29:57.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.383+0000 7f39bfd07640 1 -- 172.21.15.67:0/2550579949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b819b780 con 0x7f39b8106660 2024-08-31T05:29:57.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.384+0000 7f39bfd07640 1 -- 172.21.15.67:0/2550579949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b8101cd0 con 0x7f39b8106660 2024-08-31T05:29:57.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.384+0000 7f39aeffd640 1 -- 172.21.15.67:0/2550579949 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f39a801b460 con 0x7f39b8106660 2024-08-31T05:29:57.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.385+0000 7f39aeffd640 1 --2- 172.21.15.67:0/2550579949 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39a4079e00 0x7f39a407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:57.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.385+0000 7f39aeffd640 1 -- 172.21.15.67:0/2550579949 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f39a809c200 con 0x7f39b8106660 2024-08-31T05:29:57.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.385+0000 7f39bdaa3640 1 --2- 172.21.15.67:0/2550579949 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39a4079e00 0x7f39a407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:57.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.385+0000 7f39bdaa3640 1 --2- 172.21.15.67:0/2550579949 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39a4079e00 0x7f39a407c2c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f39b40096c0 tx=0x7f39b4004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:57.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.390+0000 7f39aeffd640 1 -- 172.21.15.67:0/2550579949 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f39a8021250 con 0x7f39b8106660 2024-08-31T05:29:57.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.597+0000 7f39bfd07640 1 -- 172.21.15.67:0/2550579949 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f39b819ba30 con 0x7f39a4079e00 2024-08-31T05:29:57.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.598+0000 7f39aeffd640 1 -- 172.21.15.67:0/2550579949 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f39b819ba30 con 0x7f39a4079e00 2024-08-31T05:29:57.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.601+0000 7f39bfd07640 1 -- 172.21.15.67:0/2550579949 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39a4079e00 msgr2=0x7f39a407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.601+0000 7f39bfd07640 1 --2- 172.21.15.67:0/2550579949 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39a4079e00 0x7f39a407c2c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f39b40096c0 tx=0x7f39b4004f30 comp rx=0 tx=0).stop 2024-08-31T05:29:57.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.601+0000 7f39bfd07640 1 -- 172.21.15.67:0/2550579949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39b8106660 msgr2=0x7f39b8196af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.601+0000 7f39bfd07640 1 --2- 172.21.15.67:0/2550579949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39b8106660 0x7f39b8196af0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f39a800b420 tx=0x7f39a800b8e0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.601+0000 7f39bfd07640 1 -- 172.21.15.67:0/2550579949 shutdown_connections 2024-08-31T05:29:57.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.601+0000 7f39bfd07640 1 --2- 172.21.15.67:0/2550579949 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f39a4079e00 0x7f39a407c2c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.601+0000 7f39bfd07640 1 --2- 172.21.15.67:0/2550579949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39b8106660 0x7f39b8196af0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.601+0000 7f39bfd07640 1 --2- 172.21.15.67:0/2550579949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b81005b0 0x7f39b81965b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.601+0000 7f39bfd07640 1 -- 172.21.15.67:0/2550579949 >> 172.21.15.67:0/2550579949 conn(0x7f39b80fc2f0 msgr2=0x7f39b80fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:57.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.601+0000 7f39bfd07640 1 -- 172.21.15.67:0/2550579949 shutdown_connections 2024-08-31T05:29:57.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.601+0000 7f39bfd07640 1 -- 172.21.15.67:0/2550579949 wait complete. 2024-08-31T05:29:57.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.685+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1395247224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a281028b0 msgr2=0x7f0a28102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.685+0000 7f0a2ef77640 1 --2- 172.21.15.67:0/1395247224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a281028b0 0x7f0a28102c90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0098b0 tx=0x7f0a1c02a560 comp rx=0 tx=0).stop 2024-08-31T05:29:57.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.685+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1395247224 shutdown_connections 2024-08-31T05:29:57.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.685+0000 7f0a2ef77640 1 --2- 172.21.15.67:0/1395247224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a281031d0 0x7f0a2810b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.685+0000 7f0a2ef77640 1 --2- 172.21.15.67:0/1395247224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a281028b0 0x7f0a28102c90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.685+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1395247224 >> 172.21.15.67:0/1395247224 conn(0x7f0a280fc2f0 msgr2=0x7f0a280fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:57.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.685+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1395247224 shutdown_connections 2024-08-31T05:29:57.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.686+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1395247224 wait complete. 2024-08-31T05:29:57.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.686+0000 7f0a2ef77640 1 Processor -- start 2024-08-31T05:29:57.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.686+0000 7f0a2ef77640 1 -- start start 2024-08-31T05:29:57.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.687+0000 7f0a2ef77640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a281028b0 0x7f0a2819f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:57.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.687+0000 7f0a2ef77640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a281031d0 0x7f0a2819fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:57.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.687+0000 7f0a2ef77640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2810eb60 con 0x7f0a281031d0 2024-08-31T05:29:57.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.687+0000 7f0a2ef77640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2810e9e0 con 0x7f0a281028b0 2024-08-31T05:29:57.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.687+0000 7f0a27fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a281031d0 0x7f0a2819fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:57.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.687+0000 7f0a27fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a281031d0 0x7f0a2819fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57478/0 (socket says 172.21.15.67:57478) 2024-08-31T05:29:57.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.687+0000 7f0a27fff640 1 -- 172.21.15.67:0/1524296090 learned_addr learned my addr 172.21.15.67:0/1524296090 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:29:57.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.687+0000 7f0a2cd13640 1 --2- 172.21.15.67:0/1524296090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a281028b0 0x7f0a2819f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:57.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.687+0000 7f0a2cd13640 1 -- 172.21.15.67:0/1524296090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a281031d0 msgr2=0x7f0a2819fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.687+0000 7f0a2cd13640 1 --2- 172.21.15.67:0/1524296090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a281031d0 0x7f0a2819fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.687+0000 7f0a2cd13640 1 -- 172.21.15.67:0/1524296090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a28199770 con 0x7f0a281028b0 2024-08-31T05:29:57.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.688+0000 7f0a2cd13640 1 --2- 172.21.15.67:0/1524296090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a281028b0 0x7f0a2819f6a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c02aa80 tx=0x7f0a1c0045c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:57.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.688+0000 7f0a25ffb640 1 -- 172.21.15.67:0/1524296090 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a1c03f070 con 0x7f0a281028b0 2024-08-31T05:29:57.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.688+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1524296090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a28199a00 con 0x7f0a281028b0 2024-08-31T05:29:57.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.688+0000 7f0a25ffb640 1 -- 172.21.15.67:0/1524296090 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a1c0035f0 con 0x7f0a281028b0 2024-08-31T05:29:57.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.688+0000 7f0a25ffb640 1 -- 172.21.15.67:0/1524296090 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a1c035030 con 0x7f0a281028b0 2024-08-31T05:29:57.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.688+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1524296090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a28199f30 con 0x7f0a281028b0 2024-08-31T05:29:57.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.689+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1524296090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a2806a2c0 con 0x7f0a281028b0 2024-08-31T05:29:57.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.691+0000 7f0a25ffb640 1 -- 172.21.15.67:0/1524296090 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f0a1c042070 con 0x7f0a281028b0 2024-08-31T05:29:57.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.691+0000 7f0a25ffb640 1 --2- 172.21.15.67:0/1524296090 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0a18079e00 0x7f0a1807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:57.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.692+0000 7f0a25ffb640 1 -- 172.21.15.67:0/1524296090 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f0a1c0bd990 con 0x7f0a281028b0 2024-08-31T05:29:57.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.692+0000 7f0a27fff640 1 --2- 172.21.15.67:0/1524296090 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0a18079e00 0x7f0a1807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:57.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.692+0000 7f0a27fff640 1 --2- 172.21.15.67:0/1524296090 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0a18079e00 0x7f0a1807c2c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a2819afc0 tx=0x7f0a1400a380 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:57.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.695+0000 7f0a25ffb640 1 -- 172.21.15.67:0/1524296090 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0a1c0894b0 con 0x7f0a281028b0 2024-08-31T05:29:57.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.886+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1524296090 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0a2819a2a0 con 0x7f0a18079e00 2024-08-31T05:29:57.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.896+0000 7f0a25ffb640 1 -- 172.21.15.67:0/1524296090 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f0a2819a2a0 con 0x7f0a18079e00 2024-08-31T05:29:57.898 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:29:57.898 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (6m) 25s ago 16m 20.8M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:29:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (9m) 25s ago 16m 9227k - 19.1.1-242-g244a32d3 395b9209a980 aa19b192de3f 2024-08-31T05:29:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (8m) 12s ago 16m 8908k - 19.1.1-242-g244a32d3 395b9209a980 7d924a3a8ad9 2024-08-31T05:29:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (4m) 25s ago 16m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 910f4f105c4b 2024-08-31T05:29:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (4m) 12s ago 16m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 0dcc86f98a20 2024-08-31T05:29:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (5m) 25s ago 16m 82.1M - c8b91775d855 3a9a0f88928d 2024-08-31T05:29:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (31s) 25s ago 11m 81.9M - 19.3.0-4560-gd19e6118 79f4cde5e369 e70ebd5a7787 2024-08-31T05:29:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (47s) 25s ago 11m 80.9M - 19.3.0-4560-gd19e6118 79f4cde5e369 b01bdece784a 2024-08-31T05:29:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (15s) 12s ago 11m 81.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 961d09a035db 2024-08-31T05:29:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (11m) 12s ago 11m 87.2M - 19.1.1-242-g244a32d3 395b9209a980 48221a14b146 2024-08-31T05:29:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (8m) 25s ago 18m 595M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:29:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (7m) 12s ago 15m 526M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:29:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (4m) 25s ago 18m 117M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 25a28efbbd37 2024-08-31T05:29:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (4m) 12s ago 15m 107M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 6be0f0999860 2024-08-31T05:29:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (6m) 25s ago 16m 10.9M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:29:57.900 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (6m) 12s ago 15m 10.2M - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:29:57.900 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (3m) 25s ago 14m 196M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 aab0516dcbfa 2024-08-31T05:29:57.900 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (3m) 25s ago 14m 164M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 fa9e3fb20c5e 2024-08-31T05:29:57.900 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (2m) 25s ago 13m 157M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 a62abe735da2 2024-08-31T05:29:57.900 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (2m) 12s ago 13m 166M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 9f4ce308ec1d 2024-08-31T05:29:57.900 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (96s) 12s ago 13m 152M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 5f02556c012d 2024-08-31T05:29:57.900 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (64s) 12s ago 12m 162M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 530ae5c5d1ac 2024-08-31T05:29:57.900 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (6m) 25s ago 16m 55.9M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:29:57.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.899+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1524296090 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0a18079e00 msgr2=0x7f0a1807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.899+0000 7f0a2ef77640 1 --2- 172.21.15.67:0/1524296090 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0a18079e00 0x7f0a1807c2c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a2819afc0 tx=0x7f0a1400a380 comp rx=0 tx=0).stop 2024-08-31T05:29:57.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.899+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1524296090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a281028b0 msgr2=0x7f0a2819f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.899+0000 7f0a2ef77640 1 --2- 172.21.15.67:0/1524296090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a281028b0 0x7f0a2819f6a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c02aa80 tx=0x7f0a1c0045c0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.899+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1524296090 shutdown_connections 2024-08-31T05:29:57.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.899+0000 7f0a2ef77640 1 --2- 172.21.15.67:0/1524296090 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0a18079e00 0x7f0a1807c2c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.899+0000 7f0a2ef77640 1 --2- 172.21.15.67:0/1524296090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a281031d0 0x7f0a2819fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.899+0000 7f0a2ef77640 1 --2- 172.21.15.67:0/1524296090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a281028b0 0x7f0a2819f6a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.899+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1524296090 >> 172.21.15.67:0/1524296090 conn(0x7f0a280fc2f0 msgr2=0x7f0a281009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:57.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.899+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1524296090 shutdown_connections 2024-08-31T05:29:57.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:57.899+0000 7f0a2ef77640 1 -- 172.21.15.67:0/1524296090 wait complete. 2024-08-31T05:29:58.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.004+0000 7f8cf7dee640 1 -- 172.21.15.67:0/1396689181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf01005b0 msgr2=0x7f8cf0100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.004+0000 7f8cf7dee640 1 --2- 172.21.15.67:0/1396689181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf01005b0 0x7f8cf0100a10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009880 tx=0x7f8ce002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.004+0000 7f8cf7dee640 1 -- 172.21.15.67:0/1396689181 shutdown_connections 2024-08-31T05:29:58.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.005+0000 7f8cf7dee640 1 --2- 172.21.15.67:0/1396689181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf01005b0 0x7f8cf0100a10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.005+0000 7f8cf7dee640 1 --2- 172.21.15.67:0/1396689181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cf0106660 0x7f8cf0106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.005+0000 7f8cf7dee640 1 -- 172.21.15.67:0/1396689181 >> 172.21.15.67:0/1396689181 conn(0x7f8cf00fc2f0 msgr2=0x7f8cf00fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:58.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.005+0000 7f8cf7dee640 1 -- 172.21.15.67:0/1396689181 shutdown_connections 2024-08-31T05:29:58.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.005+0000 7f8cf7dee640 1 -- 172.21.15.67:0/1396689181 wait complete. 2024-08-31T05:29:58.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.006+0000 7f8cf7dee640 1 Processor -- start 2024-08-31T05:29:58.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.006+0000 7f8cf7dee640 1 -- start start 2024-08-31T05:29:58.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.007+0000 7f8cf7dee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cf01005b0 0x7f8cf01026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.007+0000 7f8cf7dee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf0106660 0x7f8cf0102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.007+0000 7f8cf7dee640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf010da70 con 0x7f8cf0106660 2024-08-31T05:29:58.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.007+0000 7f8cf7dee640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf010d8f0 con 0x7f8cf01005b0 2024-08-31T05:29:58.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.007+0000 7f8cf5b8a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cf01005b0 0x7f8cf01026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.007+0000 7f8cf5b8a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cf01005b0 0x7f8cf01026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:55038/0 (socket says 172.21.15.67:55038) 2024-08-31T05:29:58.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.007+0000 7f8cf5b8a640 1 -- 172.21.15.67:0/3898486373 learned_addr learned my addr 172.21.15.67:0/3898486373 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:29:58.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.007+0000 7f8cf5389640 1 --2- 172.21.15.67:0/3898486373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf0106660 0x7f8cf0102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.007+0000 7f8cf5389640 1 -- 172.21.15.67:0/3898486373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cf01005b0 msgr2=0x7f8cf01026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.007+0000 7f8cf5389640 1 --2- 172.21.15.67:0/3898486373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cf01005b0 0x7f8cf01026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.007+0000 7f8cf5389640 1 -- 172.21.15.67:0/3898486373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf0103170 con 0x7f8cf0106660 2024-08-31T05:29:58.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.008+0000 7f8cf5389640 1 --2- 172.21.15.67:0/3898486373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf0106660 0x7f8cf0102c30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0006010 tx=0x7f8ce00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:58.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.008+0000 7f8ce6ffd640 1 -- 172.21.15.67:0/3898486373 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ce003f070 con 0x7f8cf0106660 2024-08-31T05:29:58.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.008+0000 7f8cf7dee640 1 -- 172.21.15.67:0/3898486373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf0103400 con 0x7f8cf0106660 2024-08-31T05:29:58.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.008+0000 7f8ce6ffd640 1 -- 172.21.15.67:0/3898486373 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ce0004cf0 con 0x7f8cf0106660 2024-08-31T05:29:58.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.008+0000 7f8ce6ffd640 1 -- 172.21.15.67:0/3898486373 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ce0035030 con 0x7f8cf0106660 2024-08-31T05:29:58.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.008+0000 7f8cf7dee640 1 -- 172.21.15.67:0/3898486373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf01a3ad0 con 0x7f8cf0106660 2024-08-31T05:29:58.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.009+0000 7f8cf7dee640 1 -- 172.21.15.67:0/3898486373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd4005290 con 0x7f8cf0106660 2024-08-31T05:29:58.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.011+0000 7f8ce6ffd640 1 -- 172.21.15.67:0/3898486373 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f8ce0042070 con 0x7f8cf0106660 2024-08-31T05:29:58.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.011+0000 7f8ce6ffd640 1 --2- 172.21.15.67:0/3898486373 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8cdc079e40 0x7f8cdc07c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.011+0000 7f8ce6ffd640 1 -- 172.21.15.67:0/3898486373 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f8ce00bd1e0 con 0x7f8cf0106660 2024-08-31T05:29:58.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.012+0000 7f8cf5b8a640 1 --2- 172.21.15.67:0/3898486373 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8cdc079e40 0x7f8cdc07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.012+0000 7f8cf5b8a640 1 --2- 172.21.15.67:0/3898486373 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8cdc079e40 0x7f8cdc07c300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00bca0 tx=0x7f8cec00b410 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:58.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.016+0000 7f8ce6ffd640 1 -- 172.21.15.67:0/3898486373 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8ce0088da0 con 0x7f8cf0106660 2024-08-31T05:29:58.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.281+0000 7f8cf7dee640 1 -- 172.21.15.67:0/3898486373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8cd4005d90 con 0x7f8cf0106660 2024-08-31T05:29:58.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.282+0000 7f8ce6ffd640 1 -- 172.21.15.67:0/3898486373 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f8ce008d0e0 con 0x7f8cf0106660 2024-08-31T05:29:58.283 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:29:58.284 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:29:58.284 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:29:58.284 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:29:58.284 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:29:58.284 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:29:58.284 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:29:58.284 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:29:58.284 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 6 2024-08-31T05:29:58.284 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:29:58.284 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:29:58.284 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 3 2024-08-31T05:29:58.284 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:29:58.284 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:29:58.284 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 13 2024-08-31T05:29:58.285 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:29:58.285 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:29:58.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.284+0000 7f8cf7dee640 1 -- 172.21.15.67:0/3898486373 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8cdc079e40 msgr2=0x7f8cdc07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.284+0000 7f8cf7dee640 1 --2- 172.21.15.67:0/3898486373 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8cdc079e40 0x7f8cdc07c300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00bca0 tx=0x7f8cec00b410 comp rx=0 tx=0).stop 2024-08-31T05:29:58.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.284+0000 7f8cf7dee640 1 -- 172.21.15.67:0/3898486373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf0106660 msgr2=0x7f8cf0102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.284+0000 7f8cf7dee640 1 --2- 172.21.15.67:0/3898486373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf0106660 0x7f8cf0102c30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0006010 tx=0x7f8ce00048f0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.284+0000 7f8cf7dee640 1 -- 172.21.15.67:0/3898486373 shutdown_connections 2024-08-31T05:29:58.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.284+0000 7f8cf7dee640 1 --2- 172.21.15.67:0/3898486373 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8cdc079e40 0x7f8cdc07c300 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.284+0000 7f8cf7dee640 1 --2- 172.21.15.67:0/3898486373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8cf0106660 0x7f8cf0102c30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.284+0000 7f8cf7dee640 1 --2- 172.21.15.67:0/3898486373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cf01005b0 0x7f8cf01026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.284+0000 7f8cf7dee640 1 -- 172.21.15.67:0/3898486373 >> 172.21.15.67:0/3898486373 conn(0x7f8cf00fc2f0 msgr2=0x7f8cf01048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:58.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.284+0000 7f8cf7dee640 1 -- 172.21.15.67:0/3898486373 shutdown_connections 2024-08-31T05:29:58.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.284+0000 7f8cf7dee640 1 -- 172.21.15.67:0/3898486373 wait complete. 2024-08-31T05:29:58.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.367+0000 7fb486ead640 1 -- 172.21.15.67:0/791996710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb480102850 msgr2=0x7fb480102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.367+0000 7fb486ead640 1 --2- 172.21.15.67:0/791996710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb480102850 0x7fb480102c30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb474009880 tx=0x7fb47402a530 comp rx=0 tx=0).stop 2024-08-31T05:29:58.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.367+0000 7fb486ead640 1 -- 172.21.15.67:0/791996710 shutdown_connections 2024-08-31T05:29:58.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.367+0000 7fb486ead640 1 --2- 172.21.15.67:0/791996710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480103170 0x7fb48010b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.367+0000 7fb486ead640 1 --2- 172.21.15.67:0/791996710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb480102850 0x7fb480102c30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.367+0000 7fb486ead640 1 -- 172.21.15.67:0/791996710 >> 172.21.15.67:0/791996710 conn(0x7fb4800fc2f0 msgr2=0x7fb4800fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:58.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.367+0000 7fb486ead640 1 -- 172.21.15.67:0/791996710 shutdown_connections 2024-08-31T05:29:58.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.367+0000 7fb486ead640 1 -- 172.21.15.67:0/791996710 wait complete. 2024-08-31T05:29:58.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.368+0000 7fb486ead640 1 Processor -- start 2024-08-31T05:29:58.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.368+0000 7fb486ead640 1 -- start start 2024-08-31T05:29:58.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.368+0000 7fb486ead640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb480102850 0x7fb4801004b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.368+0000 7fb486ead640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480103170 0x7fb4801009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.368+0000 7fb486ead640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb48010eb80 con 0x7fb480102850 2024-08-31T05:29:58.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.368+0000 7fb486ead640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb48010ea00 con 0x7fb480103170 2024-08-31T05:29:58.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.368+0000 7fb484c49640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb480102850 0x7fb4801004b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.368+0000 7fb484c49640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb480102850 0x7fb4801004b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44336/0 (socket says 172.21.15.67:44336) 2024-08-31T05:29:58.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.368+0000 7fb484c49640 1 -- 172.21.15.67:0/1558526929 learned_addr learned my addr 172.21.15.67:0/1558526929 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:29:58.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.369+0000 7fb47ffff640 1 --2- 172.21.15.67:0/1558526929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480103170 0x7fb4801009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.369+0000 7fb484c49640 1 -- 172.21.15.67:0/1558526929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480103170 msgr2=0x7fb4801009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.369+0000 7fb484c49640 1 --2- 172.21.15.67:0/1558526929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480103170 0x7fb4801009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.369+0000 7fb484c49640 1 -- 172.21.15.67:0/1558526929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb480100f30 con 0x7fb480102850 2024-08-31T05:29:58.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.369+0000 7fb484c49640 1 --2- 172.21.15.67:0/1558526929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb480102850 0x7fb4801004b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb474031460 tx=0x7fb474004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:58.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.369+0000 7fb47dffb640 1 -- 172.21.15.67:0/1558526929 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb47403f070 con 0x7fb480102850 2024-08-31T05:29:58.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.369+0000 7fb486ead640 1 -- 172.21.15.67:0/1558526929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4801011c0 con 0x7fb480102850 2024-08-31T05:29:58.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.369+0000 7fb47dffb640 1 -- 172.21.15.67:0/1558526929 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4740035f0 con 0x7fb480102850 2024-08-31T05:29:58.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.370+0000 7fb47dffb640 1 -- 172.21.15.67:0/1558526929 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb474035030 con 0x7fb480102850 2024-08-31T05:29:58.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.370+0000 7fb486ead640 1 -- 172.21.15.67:0/1558526929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4801a3b10 con 0x7fb480102850 2024-08-31T05:29:58.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.371+0000 7fb486ead640 1 -- 172.21.15.67:0/1558526929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb48006a320 con 0x7fb480102850 2024-08-31T05:29:58.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.372+0000 7fb47dffb640 1 -- 172.21.15.67:0/1558526929 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fb474042070 con 0x7fb480102850 2024-08-31T05:29:58.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.372+0000 7fb47dffb640 1 --2- 172.21.15.67:0/1558526929 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb470079e40 0x7fb47007c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.372+0000 7fb47dffb640 1 -- 172.21.15.67:0/1558526929 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7fb4740bd840 con 0x7fb480102850 2024-08-31T05:29:58.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.373+0000 7fb47ffff640 1 --2- 172.21.15.67:0/1558526929 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb470079e40 0x7fb47007c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.373+0000 7fb47ffff640 1 --2- 172.21.15.67:0/1558526929 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb470079e40 0x7fb47007c300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb480101f40 tx=0x7fb46c005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:58.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.378+0000 7fb47dffb640 1 -- 172.21.15.67:0/1558526929 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb4740894a0 con 0x7fb480102850 2024-08-31T05:29:58.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.598+0000 7fb486ead640 1 -- 172.21.15.67:0/1558526929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb4801a3e80 con 0x7fb480102850 2024-08-31T05:29:58.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.599+0000 7fb47dffb640 1 -- 172.21.15.67:0/1558526929 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) ==== 76+0+1828 (secure 0 0 0) 0x7fb47408dec0 con 0x7fb480102850 2024-08-31T05:29:58.601 INFO:teuthology.orchestra.run.smithi067.stdout:e29 2024-08-31T05:29:58.601 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-08-31T05:29:52:957323+0000 2024-08-31T05:29:58.601 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:29:58.601 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:29:58.601 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-08-31T05:29:58.601 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:29:58.601 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:29:58.601 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-08-31T05:29:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 29 2024-08-31T05:29:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-31T05:29:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:29:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-08-31T05:29:52.957311+0000 2024-08-31T05:29:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-08-31T05:29:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-08-31T05:29:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2024-08-31T05:29:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-08-31T05:29:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-08-31T05:29:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-08-31T05:29:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-08-31T05:29:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-08-31T05:29:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 95 2024-08-31T05:29:58.602 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:in 0 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=34322} 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data enabled 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 0 members: 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.tskvpt{0:34322} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.67:6826/3864481333,v1:172.21.15.67:6827/3864481333] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:58.603 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:29:58.604 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:29:58.604 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2024-08-31T05:29:58.604 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:29:58.604 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.beqeql{-1:34354} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.67:6828/352208921,v1:172.21.15.67:6829/352208921] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:58.604 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.gsnhxi{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6824/2489979765,v1:172.21.15.73:6825/2489979765] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:58.604 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 29 2024-08-31T05:29:58.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.601+0000 7fb486ead640 1 -- 172.21.15.67:0/1558526929 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb470079e40 msgr2=0x7fb47007c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.601+0000 7fb486ead640 1 --2- 172.21.15.67:0/1558526929 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb470079e40 0x7fb47007c300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb480101f40 tx=0x7fb46c005f90 comp rx=0 tx=0).stop 2024-08-31T05:29:58.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.601+0000 7fb486ead640 1 -- 172.21.15.67:0/1558526929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb480102850 msgr2=0x7fb4801004b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.601+0000 7fb486ead640 1 --2- 172.21.15.67:0/1558526929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb480102850 0x7fb4801004b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb474031460 tx=0x7fb474004530 comp rx=0 tx=0).stop 2024-08-31T05:29:58.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.601+0000 7fb486ead640 1 -- 172.21.15.67:0/1558526929 shutdown_connections 2024-08-31T05:29:58.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.601+0000 7fb486ead640 1 --2- 172.21.15.67:0/1558526929 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb470079e40 0x7fb47007c300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.601+0000 7fb486ead640 1 --2- 172.21.15.67:0/1558526929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480103170 0x7fb4801009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.601+0000 7fb486ead640 1 --2- 172.21.15.67:0/1558526929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb480102850 0x7fb4801004b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.601+0000 7fb486ead640 1 -- 172.21.15.67:0/1558526929 >> 172.21.15.67:0/1558526929 conn(0x7fb4800fc2f0 msgr2=0x7fb48010ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:58.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.601+0000 7fb486ead640 1 -- 172.21.15.67:0/1558526929 shutdown_connections 2024-08-31T05:29:58.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.601+0000 7fb486ead640 1 -- 172.21.15.67:0/1558526929 wait complete. 2024-08-31T05:29:58.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.686+0000 7f0db4ab0640 1 -- 172.21.15.67:0/820979558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0db0106660 msgr2=0x7f0db0106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.686+0000 7f0db4ab0640 1 --2- 172.21.15.67:0/820979558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0db0106660 0x7f0db0106a40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0da0009880 tx=0x7f0da002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.686+0000 7f0db4ab0640 1 -- 172.21.15.67:0/820979558 shutdown_connections 2024-08-31T05:29:58.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.686+0000 7f0db4ab0640 1 --2- 172.21.15.67:0/820979558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0db01005b0 0x7f0db0100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.686+0000 7f0db4ab0640 1 --2- 172.21.15.67:0/820979558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0db0106660 0x7f0db0106a40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.686+0000 7f0db4ab0640 1 -- 172.21.15.67:0/820979558 >> 172.21.15.67:0/820979558 conn(0x7f0db00fc2f0 msgr2=0x7f0db00fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:58.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.686+0000 7f0db4ab0640 1 -- 172.21.15.67:0/820979558 shutdown_connections 2024-08-31T05:29:58.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.686+0000 7f0db4ab0640 1 -- 172.21.15.67:0/820979558 wait complete. 2024-08-31T05:29:58.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.687+0000 7f0db4ab0640 1 Processor -- start 2024-08-31T05:29:58.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.687+0000 7f0db4ab0640 1 -- start start 2024-08-31T05:29:58.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.687+0000 7f0db4ab0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0db01005b0 0x7f0db0197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.687+0000 7f0db4ab0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0db0106660 0x7f0db0197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.687+0000 7f0db4ab0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0db010da70 con 0x7f0db01005b0 2024-08-31T05:29:58.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.687+0000 7f0db4ab0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0db010d8f0 con 0x7f0db0106660 2024-08-31T05:29:58.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.687+0000 7f0dae59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0db01005b0 0x7f0db0197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.687+0000 7f0dae59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0db01005b0 0x7f0db0197690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44348/0 (socket says 172.21.15.67:44348) 2024-08-31T05:29:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.687+0000 7f0dae59c640 1 -- 172.21.15.67:0/2467219734 learned_addr learned my addr 172.21.15.67:0/2467219734 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:29:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.687+0000 7f0dadd9b640 1 --2- 172.21.15.67:0/2467219734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0db0106660 0x7f0db0197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.687+0000 7f0dae59c640 1 -- 172.21.15.67:0/2467219734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0db0106660 msgr2=0x7f0db0197bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.687+0000 7f0dae59c640 1 --2- 172.21.15.67:0/2467219734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0db0106660 0x7f0db0197bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.687+0000 7f0dae59c640 1 -- 172.21.15.67:0/2467219734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db019bf60 con 0x7f0db01005b0 2024-08-31T05:29:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.688+0000 7f0dae59c640 1 --2- 172.21.15.67:0/2467219734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0db01005b0 0x7f0db0197690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0da0004f90 tx=0x7f0da00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.688+0000 7f0d9f7fe640 1 -- 172.21.15.67:0/2467219734 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0da003f070 con 0x7f0db01005b0 2024-08-31T05:29:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.688+0000 7f0d9f7fe640 1 -- 172.21.15.67:0/2467219734 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0da0004c70 con 0x7f0db01005b0 2024-08-31T05:29:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.688+0000 7f0db4ab0640 1 -- 172.21.15.67:0/2467219734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db019c1f0 con 0x7f0db01005b0 2024-08-31T05:29:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.688+0000 7f0d9f7fe640 1 -- 172.21.15.67:0/2467219734 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0da0035030 con 0x7f0db01005b0 2024-08-31T05:29:58.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.688+0000 7f0db4ab0640 1 -- 172.21.15.67:0/2467219734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db019c720 con 0x7f0db01005b0 2024-08-31T05:29:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.689+0000 7f0db4ab0640 1 -- 172.21.15.67:0/2467219734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db0101cd0 con 0x7f0db01005b0 2024-08-31T05:29:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.690+0000 7f0d9f7fe640 1 -- 172.21.15.67:0/2467219734 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f0da0042070 con 0x7f0db01005b0 2024-08-31T05:29:58.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.691+0000 7f0d9f7fe640 1 --2- 172.21.15.67:0/2467219734 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0d98079e00 0x7f0d9807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.691+0000 7f0dadd9b640 1 --2- 172.21.15.67:0/2467219734 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0d98079e00 0x7f0d9807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.691+0000 7f0d9f7fe640 1 -- 172.21.15.67:0/2467219734 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f0da00bd9b0 con 0x7f0db01005b0 2024-08-31T05:29:58.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.692+0000 7f0dadd9b640 1 --2- 172.21.15.67:0/2467219734 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0d98079e00 0x7f0d9807c2c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0db00fdc20 tx=0x7f0da400b390 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:58.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.695+0000 7f0d9f7fe640 1 -- 172.21.15.67:0/2467219734 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0da0089570 con 0x7f0db01005b0 2024-08-31T05:29:58.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.904+0000 7f0db4ab0640 1 -- 172.21.15.67:0/2467219734 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0db01989f0 con 0x7f0d98079e00 2024-08-31T05:29:58.906 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:58 smithi067 ceph-mon[99941]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:58.906 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:58 smithi067 ceph-mon[99941]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:58.906 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:58 smithi067 ceph-mon[99941]: pgmap v288: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 7.4 MiB/s rd, 2 op/s 2024-08-31T05:29:58.906 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:58 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3898486373' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:58.906 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:58 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/1558526929' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:29:58.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.905+0000 7f0d9f7fe640 1 -- 172.21.15.67:0/2467219734 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f0db01989f0 con 0x7f0d98079e00 2024-08-31T05:29:58.907 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:29:58.907 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:29:58.907 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:29:58.907 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-31T05:29:58.907 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:29:58.907 INFO:teuthology.orchestra.run.smithi067.stdout: "mon", 2024-08-31T05:29:58.907 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2024-08-31T05:29:58.907 INFO:teuthology.orchestra.run.smithi067.stdout: "osd", 2024-08-31T05:29:58.907 INFO:teuthology.orchestra.run.smithi067.stdout: "crash" 2024-08-31T05:29:58.907 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:29:58.908 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "15/23 daemons upgraded", 2024-08-31T05:29:58.908 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading mds daemons", 2024-08-31T05:29:58.908 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:29:58.908 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:29:58.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.909+0000 7f0db4ab0640 1 -- 172.21.15.67:0/2467219734 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0d98079e00 msgr2=0x7f0d9807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.909+0000 7f0db4ab0640 1 --2- 172.21.15.67:0/2467219734 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0d98079e00 0x7f0d9807c2c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0db00fdc20 tx=0x7f0da400b390 comp rx=0 tx=0).stop 2024-08-31T05:29:58.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.909+0000 7f0db4ab0640 1 -- 172.21.15.67:0/2467219734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0db01005b0 msgr2=0x7f0db0197690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.909+0000 7f0db4ab0640 1 --2- 172.21.15.67:0/2467219734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0db01005b0 0x7f0db0197690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0da0004f90 tx=0x7f0da00048f0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.909+0000 7f0db4ab0640 1 -- 172.21.15.67:0/2467219734 shutdown_connections 2024-08-31T05:29:58.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.909+0000 7f0db4ab0640 1 --2- 172.21.15.67:0/2467219734 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0d98079e00 0x7f0d9807c2c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.909+0000 7f0db4ab0640 1 --2- 172.21.15.67:0/2467219734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0db0106660 0x7f0db0197bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.909+0000 7f0db4ab0640 1 --2- 172.21.15.67:0/2467219734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0db01005b0 0x7f0db0197690 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.909+0000 7f0db4ab0640 1 -- 172.21.15.67:0/2467219734 >> 172.21.15.67:0/2467219734 conn(0x7f0db00fc2f0 msgr2=0x7f0db0069b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:58.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.909+0000 7f0db4ab0640 1 -- 172.21.15.67:0/2467219734 shutdown_connections 2024-08-31T05:29:58.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.909+0000 7f0db4ab0640 1 -- 172.21.15.67:0/2467219734 wait complete. 2024-08-31T05:29:58.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.995+0000 7f0174c47640 1 -- 172.21.15.67:0/3843905491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0170103210 msgr2=0x7f017010b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.995+0000 7f0174c47640 1 --2- 172.21.15.67:0/3843905491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0170103210 0x7f017010b700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0164009880 tx=0x7f016402a530 comp rx=0 tx=0).stop 2024-08-31T05:29:58.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.995+0000 7f0174c47640 1 -- 172.21.15.67:0/3843905491 shutdown_connections 2024-08-31T05:29:58.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.996+0000 7f0174c47640 1 --2- 172.21.15.67:0/3843905491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0170103210 0x7f017010b700 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.996+0000 7f0174c47640 1 --2- 172.21.15.67:0/3843905491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01701028f0 0x7f0170102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.996+0000 7f0174c47640 1 -- 172.21.15.67:0/3843905491 >> 172.21.15.67:0/3843905491 conn(0x7f01700fc2f0 msgr2=0x7f01700fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:58.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.996+0000 7f0174c47640 1 -- 172.21.15.67:0/3843905491 shutdown_connections 2024-08-31T05:29:58.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.996+0000 7f0174c47640 1 -- 172.21.15.67:0/3843905491 wait complete. 2024-08-31T05:29:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.997+0000 7f0174c47640 1 Processor -- start 2024-08-31T05:29:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.997+0000 7f0174c47640 1 -- start start 2024-08-31T05:29:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.997+0000 7f0174c47640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01701028f0 0x7f0170197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.997+0000 7f0174c47640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0170103210 0x7f0170197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.997+0000 7f0174c47640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f017010eb80 con 0x7f01701028f0 2024-08-31T05:29:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.997+0000 7f0174c47640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f017010ea00 con 0x7f0170103210 2024-08-31T05:29:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.997+0000 7f016e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01701028f0 0x7f0170197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.997+0000 7f016e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01701028f0 0x7f0170197720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44366/0 (socket says 172.21.15.67:44366) 2024-08-31T05:29:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.997+0000 7f016e59c640 1 -- 172.21.15.67:0/3752720018 learned_addr learned my addr 172.21.15.67:0/3752720018 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:29:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.997+0000 7f016dd9b640 1 --2- 172.21.15.67:0/3752720018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0170103210 0x7f0170197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:59.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.997+0000 7f016e59c640 1 -- 172.21.15.67:0/3752720018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0170103210 msgr2=0x7f0170197c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:59.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.997+0000 7f016e59c640 1 --2- 172.21.15.67:0/3752720018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0170103210 0x7f0170197c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.997+0000 7f016e59c640 1 -- 172.21.15.67:0/3752720018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017019bff0 con 0x7f01701028f0 2024-08-31T05:29:59.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.997+0000 7f016dd9b640 1 --2- 172.21.15.67:0/3752720018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0170103210 0x7f0170197c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:59.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.998+0000 7f016e59c640 1 --2- 172.21.15.67:0/3752720018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01701028f0 0x7f0170197720 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f016000c8f0 tx=0x7f016000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:59.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.998+0000 7f015f7fe640 1 -- 172.21.15.67:0/3752720018 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01600079b0 con 0x7f01701028f0 2024-08-31T05:29:59.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.998+0000 7f0174c47640 1 -- 172.21.15.67:0/3752720018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017019c2e0 con 0x7f01701028f0 2024-08-31T05:29:59.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.998+0000 7f015f7fe640 1 -- 172.21.15.67:0/3752720018 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01600054e0 con 0x7f01701028f0 2024-08-31T05:29:59.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.998+0000 7f015f7fe640 1 -- 172.21.15.67:0/3752720018 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0160004dd0 con 0x7f01701028f0 2024-08-31T05:29:59.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.998+0000 7f0174c47640 1 -- 172.21.15.67:0/3752720018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f017019c870 con 0x7f01701028f0 2024-08-31T05:29:59.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:58.999+0000 7f0174c47640 1 -- 172.21.15.67:0/3752720018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f017006a280 con 0x7f01701028f0 2024-08-31T05:29:59.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.001+0000 7f015f7fe640 1 -- 172.21.15.67:0/3752720018 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f0160005020 con 0x7f01701028f0 2024-08-31T05:29:59.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.001+0000 7f015f7fe640 1 --2- 172.21.15.67:0/3752720018 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0158079da0 0x7f015807c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:59.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.002+0000 7f015f7fe640 1 -- 172.21.15.67:0/3752720018 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f016009ca60 con 0x7f01701028f0 2024-08-31T05:29:59.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.002+0000 7f016dd9b640 1 --2- 172.21.15.67:0/3752720018 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0158079da0 0x7f015807c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:59.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.002+0000 7f016dd9b640 1 --2- 172.21.15.67:0/3752720018 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0158079da0 0x7f015807c260 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f01701086f0 tx=0x7f0164004f50 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:59.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.006+0000 7f015f7fe640 1 -- 172.21.15.67:0/3752720018 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0160014030 con 0x7f01701028f0 2024-08-31T05:29:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:58 smithi073 ceph-mon[71452]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:58 smithi073 ceph-mon[71452]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:58 smithi073 ceph-mon[71452]: pgmap v288: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 7.4 MiB/s rd, 2 op/s 2024-08-31T05:29:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:58 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3898486373' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:29:59.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:58 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/1558526929' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:29:59.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.268+0000 7f0174c47640 1 -- 172.21.15.67:0/3752720018 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0170105d80 con 0x7f01701028f0 2024-08-31T05:29:59.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.269+0000 7f015f7fe640 1 -- 172.21.15.67:0/3752720018 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+297 (secure 0 0 0) 0x7f0160064430 con 0x7f01701028f0 2024-08-31T05:29:59.272 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-08-31T05:29:59.272 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-31T05:29:59.272 INFO:teuthology.orchestra.run.smithi067.stdout: fs cephfs is degraded 2024-08-31T05:29:59.272 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:29:59.272 INFO:teuthology.orchestra.run.smithi067.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:29:59.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.272+0000 7f0174c47640 1 -- 172.21.15.67:0/3752720018 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0158079da0 msgr2=0x7f015807c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:59.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.272+0000 7f0174c47640 1 --2- 172.21.15.67:0/3752720018 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0158079da0 0x7f015807c260 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f01701086f0 tx=0x7f0164004f50 comp rx=0 tx=0).stop 2024-08-31T05:29:59.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.272+0000 7f0174c47640 1 -- 172.21.15.67:0/3752720018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01701028f0 msgr2=0x7f0170197720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:59.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.272+0000 7f0174c47640 1 --2- 172.21.15.67:0/3752720018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01701028f0 0x7f0170197720 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f016000c8f0 tx=0x7f016000cdb0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.272+0000 7f0174c47640 1 -- 172.21.15.67:0/3752720018 shutdown_connections 2024-08-31T05:29:59.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.272+0000 7f0174c47640 1 --2- 172.21.15.67:0/3752720018 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0158079da0 0x7f015807c260 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.272+0000 7f0174c47640 1 --2- 172.21.15.67:0/3752720018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0170103210 0x7f0170197c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.272+0000 7f0174c47640 1 --2- 172.21.15.67:0/3752720018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01701028f0 0x7f0170197720 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.272+0000 7f0174c47640 1 -- 172.21.15.67:0/3752720018 >> 172.21.15.67:0/3752720018 conn(0x7f01700fc2f0 msgr2=0x7f0170103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:59.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.272+0000 7f0174c47640 1 -- 172.21.15.67:0/3752720018 shutdown_connections 2024-08-31T05:29:59.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:29:59.272+0000 7f0174c47640 1 -- 172.21.15.67:0/3752720018 wait complete. 2024-08-31T05:30:00.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:59 smithi067 ceph-mon[99941]: from='client.44317 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:00.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:29:59 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3752720018' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:30:00.097 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:59 smithi073 ceph-mon[71452]: from='client.44317 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:00.097 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:29:59 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3752720018' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:30:00.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:00 smithi073 ceph-mon[71452]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:00.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:00 smithi073 ceph-mon[71452]: pgmap v289: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-08-31T05:30:00.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:00 smithi073 ceph-mon[71452]: Health detail: HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-08-31T05:30:00.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:00 smithi073 ceph-mon[71452]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-31T05:30:00.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:00 smithi073 ceph-mon[71452]: fs cephfs is degraded 2024-08-31T05:30:00.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:00 smithi073 ceph-mon[71452]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:30:00.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:00 smithi073 ceph-mon[71452]: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:30:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:00 smithi067 ceph-mon[99941]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:00 smithi067 ceph-mon[99941]: pgmap v289: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-08-31T05:30:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:00 smithi067 ceph-mon[99941]: Health detail: HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-08-31T05:30:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:00 smithi067 ceph-mon[99941]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-31T05:30:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:00 smithi067 ceph-mon[99941]: fs cephfs is degraded 2024-08-31T05:30:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:00 smithi067 ceph-mon[99941]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:30:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:00 smithi067 ceph-mon[99941]: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:30:03.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:02 smithi067 ceph-mon[99941]: pgmap v290: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-08-31T05:30:03.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:02 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:03.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:02 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:03.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:02 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:03.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:02 smithi073 ceph-mon[71452]: pgmap v290: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-08-31T05:30:03.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:02 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:03.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:02 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:03.194 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:02 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:03.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:03 smithi073 ceph-mon[71452]: reconnect by client.24329 192.168.0.1:0/1177961946 after 0.000999978 2024-08-31T05:30:03.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:03 smithi073 ceph-mon[71452]: reconnect by client.14600 192.168.0.1:0/3622886171 after 0.000999978 2024-08-31T05:30:03.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:03 smithi073 ceph-mon[71452]: mds.? [v2:172.21.15.67:6826/3864481333,v1:172.21.15.67:6827/3864481333] up:reconnect 2024-08-31T05:30:03.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:03 smithi073 ceph-mon[71452]: mds.? [v2:172.21.15.73:6826/668223470,v1:172.21.15.73:6827/668223470] up:boot 2024-08-31T05:30:03.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:03 smithi073 ceph-mon[71452]: fsmap cephfs:1/1 {0=cephfs.smithi067.tskvpt=up:reconnect} 3 up:standby 2024-08-31T05:30:03.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:03 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mds metadata", "who": "cephfs.smithi073.kfbmeo"} : dispatch 2024-08-31T05:30:04.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:03 smithi067 ceph-mon[99941]: reconnect by client.24329 192.168.0.1:0/1177961946 after 0.000999978 2024-08-31T05:30:04.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:03 smithi067 ceph-mon[99941]: reconnect by client.14600 192.168.0.1:0/3622886171 after 0.000999978 2024-08-31T05:30:04.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:03 smithi067 ceph-mon[99941]: mds.? [v2:172.21.15.67:6826/3864481333,v1:172.21.15.67:6827/3864481333] up:reconnect 2024-08-31T05:30:04.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:03 smithi067 ceph-mon[99941]: mds.? [v2:172.21.15.73:6826/668223470,v1:172.21.15.73:6827/668223470] up:boot 2024-08-31T05:30:04.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:03 smithi067 ceph-mon[99941]: fsmap cephfs:1/1 {0=cephfs.smithi067.tskvpt=up:reconnect} 3 up:standby 2024-08-31T05:30:04.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:03 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "mds metadata", "who": "cephfs.smithi073.kfbmeo"} : dispatch 2024-08-31T05:30:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:04 smithi067 ceph-mon[99941]: pgmap v291: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 6 op/s 2024-08-31T05:30:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:04 smithi067 ceph-mon[99941]: mds.? [v2:172.21.15.67:6826/3864481333,v1:172.21.15.67:6827/3864481333] up:rejoin 2024-08-31T05:30:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:04 smithi067 ceph-mon[99941]: fsmap cephfs:1/1 {0=cephfs.smithi067.tskvpt=up:rejoin} 3 up:standby 2024-08-31T05:30:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:04 smithi067 ceph-mon[99941]: daemon mds.cephfs.smithi067.tskvpt is now active in filesystem cephfs as rank 0 2024-08-31T05:30:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:30:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:04 smithi073 ceph-mon[71452]: pgmap v291: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 6 op/s 2024-08-31T05:30:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:04 smithi073 ceph-mon[71452]: mds.? [v2:172.21.15.67:6826/3864481333,v1:172.21.15.67:6827/3864481333] up:rejoin 2024-08-31T05:30:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:04 smithi073 ceph-mon[71452]: fsmap cephfs:1/1 {0=cephfs.smithi067.tskvpt=up:rejoin} 3 up:standby 2024-08-31T05:30:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:04 smithi073 ceph-mon[71452]: daemon mds.cephfs.smithi067.tskvpt is now active in filesystem cephfs as rank 0 2024-08-31T05:30:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:30:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:05 smithi067 ceph-mon[99941]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T05:30:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:05 smithi067 ceph-mon[99941]: mds.? [v2:172.21.15.67:6826/3864481333,v1:172.21.15.67:6827/3864481333] up:active 2024-08-31T05:30:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:05 smithi067 ceph-mon[99941]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 3 up:standby 2024-08-31T05:30:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:05 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:06.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:05 smithi073 ceph-mon[71452]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T05:30:06.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:05 smithi073 ceph-mon[71452]: mds.? [v2:172.21.15.67:6826/3864481333,v1:172.21.15.67:6827/3864481333] up:active 2024-08-31T05:30:06.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:05 smithi073 ceph-mon[71452]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 3 up:standby 2024-08-31T05:30:06.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:06.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:06.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:06.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:05 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:07.074 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:06 smithi073 ceph-mon[71452]: pgmap v292: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-08-31T05:30:07.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:06 smithi067 ceph-mon[99941]: pgmap v292: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-08-31T05:30:08.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:07 smithi067 ceph-mon[99941]: pgmap v293: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 5 op/s 2024-08-31T05:30:08.129 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:07 smithi073 ceph-mon[71452]: pgmap v293: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 5 op/s 2024-08-31T05:30:10.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:10.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:10.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:10.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:30:10.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:10.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:10.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:10.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:10.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:10.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:10.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:10.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: Upgrade: Setting container_image for all mds 2024-08-31T05:30:10.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:10.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi067.beqeql"} : dispatch 2024-08-31T05:30:10.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi067.beqeql"}]': finished 2024-08-31T05:30:10.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi067.tskvpt"} : dispatch 2024-08-31T05:30:10.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi067.tskvpt"}]': finished 2024-08-31T05:30:10.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.gsnhxi"} : dispatch 2024-08-31T05:30:10.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.gsnhxi"}]': finished 2024-08-31T05:30:10.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.kfbmeo"} : dispatch 2024-08-31T05:30:10.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.kfbmeo"}]': finished 2024-08-31T05:30:10.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: Upgrade: Setting filesystem cephfs Joinable 2024-08-31T05:30:10.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-08-31T05:30:10.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:09 smithi073 ceph-mon[71452]: pgmap v294: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-08-31T05:30:10.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:10.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:10.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:10.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:30:10.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:10.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:10.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:10.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:10.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:10.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:10.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:10.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: Upgrade: Setting container_image for all mds 2024-08-31T05:30:10.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:10.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi067.beqeql"} : dispatch 2024-08-31T05:30:10.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi067.beqeql"}]': finished 2024-08-31T05:30:10.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi067.tskvpt"} : dispatch 2024-08-31T05:30:10.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi067.tskvpt"}]': finished 2024-08-31T05:30:10.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.gsnhxi"} : dispatch 2024-08-31T05:30:10.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.gsnhxi"}]': finished 2024-08-31T05:30:10.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.kfbmeo"} : dispatch 2024-08-31T05:30:10.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi073.kfbmeo"}]': finished 2024-08-31T05:30:10.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: Upgrade: Setting filesystem cephfs Joinable 2024-08-31T05:30:10.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-08-31T05:30:10.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:09 smithi067 ceph-mon[99941]: pgmap v294: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-08-31T05:30:11.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:11 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-08-31T05:30:11.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:11 smithi073 ceph-mon[71452]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 3 up:standby 2024-08-31T05:30:11.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:11 smithi073 ceph-mon[71452]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-08-31T05:30:11.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:11 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-08-31T05:30:11.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:11 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-08-31T05:30:11.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:11 smithi067 ceph-mon[99941]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 3 up:standby 2024-08-31T05:30:11.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:11 smithi067 ceph-mon[99941]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-08-31T05:30:11.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:11 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-08-31T05:30:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:12 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-08-31T05:30:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:12 smithi067 ceph-mon[99941]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 3 up:standby 2024-08-31T05:30:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:12 smithi067 ceph-mon[99941]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:30:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:12 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:12 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:12 smithi067 ceph-mon[99941]: Upgrade: Setting container_image for all rgw 2024-08-31T05:30:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:12 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:12 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:12 smithi067 ceph-mon[99941]: Upgrade: Setting container_image for all rbd-mirror 2024-08-31T05:30:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:12 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:12 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:12.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:12 smithi067 ceph-mon[99941]: pgmap v295: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.3 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-08-31T05:30:12.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:12 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-08-31T05:30:12.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:12 smithi073 ceph-mon[71452]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 3 up:standby 2024-08-31T05:30:12.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:12 smithi073 ceph-mon[71452]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:30:12.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:12 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:12.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:12 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:12.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:12 smithi073 ceph-mon[71452]: Upgrade: Setting container_image for all rgw 2024-08-31T05:30:12.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:12 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:12.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:12 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:12.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:12 smithi073 ceph-mon[71452]: Upgrade: Setting container_image for all rbd-mirror 2024-08-31T05:30:12.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:12 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:12.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:12 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:12.447 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:12 smithi073 ceph-mon[71452]: pgmap v295: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.3 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-08-31T05:30:14.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:13 smithi067 ceph-mon[99941]: Upgrade: Updating ceph-exporter.smithi067 (1/2) 2024-08-31T05:30:14.005 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:13 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:14.005 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:13 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi067", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-08-31T05:30:14.005 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:13 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:14.005 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:13 smithi067 ceph-mon[99941]: Deploying daemon ceph-exporter.smithi067 on smithi067 2024-08-31T05:30:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:13 smithi073 ceph-mon[71452]: Upgrade: Updating ceph-exporter.smithi067 (1/2) 2024-08-31T05:30:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:13 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:13 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi067", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-08-31T05:30:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:13 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:13 smithi073 ceph-mon[71452]: Deploying daemon ceph-exporter.smithi067 on smithi067 2024-08-31T05:30:15.058 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:14 smithi067 ceph-mon[99941]: pgmap v296: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-08-31T05:30:15.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:14 smithi073 ceph-mon[71452]: pgmap v296: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-08-31T05:30:17.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:16 smithi067 ceph-mon[99941]: pgmap v297: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-08-31T05:30:17.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:16 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:17.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:16 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:17.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:16 smithi073 ceph-mon[71452]: pgmap v297: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-08-31T05:30:17.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:16 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:17.085 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:16 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:18.879 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:18 smithi073 ceph-mon[71452]: pgmap v298: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-08-31T05:30:18.879 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:18 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:18.879 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:18 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-08-31T05:30:18.879 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:18 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:19.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:18 smithi067 ceph-mon[99941]: pgmap v298: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-08-31T05:30:19.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:18 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:19.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:18 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi073", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-08-31T05:30:19.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:18 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:19.983 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:19 smithi073 ceph-mon[71452]: Upgrade: Updating ceph-exporter.smithi073 (2/2) 2024-08-31T05:30:19.983 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:19 smithi073 ceph-mon[71452]: Deploying daemon ceph-exporter.smithi073 on smithi073 2024-08-31T05:30:19.983 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:19 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:19.983 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:19 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:30:20.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:19 smithi067 ceph-mon[99941]: Upgrade: Updating ceph-exporter.smithi073 (2/2) 2024-08-31T05:30:20.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:19 smithi067 ceph-mon[99941]: Deploying daemon ceph-exporter.smithi073 on smithi073 2024-08-31T05:30:20.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:19 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:20.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:19 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:30:21.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:20 smithi067 ceph-mon[99941]: pgmap v299: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-08-31T05:30:21.094 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:20 smithi073 ceph-mon[71452]: pgmap v299: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-08-31T05:30:22.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:22 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:22.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:22 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:22.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:22 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:22.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:22 smithi067 ceph-mon[99941]: pgmap v300: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-08-31T05:30:22.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:22 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:22.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:22 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:22.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:22 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:22.658 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:22 smithi073 ceph-mon[71452]: pgmap v300: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-08-31T05:30:24.795 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:24 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:24.795 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:24 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:24.795 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:24 smithi073 ceph-mon[71452]: pgmap v301: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-08-31T05:30:24.795 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:24 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:24.795 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:24 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:24.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:24 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:24.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:24 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:24.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:24 smithi067 ceph-mon[99941]: pgmap v301: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-08-31T05:30:24.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:24 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:24.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:24 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:27.015 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:26 smithi073 ceph-mon[71452]: pgmap v302: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-08-31T05:30:27.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:26 smithi067 ceph-mon[99941]: pgmap v302: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-08-31T05:30:28.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:28 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:28.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:28 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:28.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:28 smithi067 ceph-mon[99941]: pgmap v303: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 3 op/s 2024-08-31T05:30:28.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:28 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:28.695 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:28 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:28.696 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:28 smithi073 ceph-mon[71452]: pgmap v303: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 3 op/s 2024-08-31T05:30:29.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.366+0000 7f10d1a6a640 1 -- 172.21.15.67:0/4007717579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10cc102850 msgr2=0x7f10cc102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:29.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.366+0000 7f10d1a6a640 1 --2- 172.21.15.67:0/4007717579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10cc102850 0x7f10cc102c30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009880 tx=0x7f10bc02a530 comp rx=0 tx=0).stop 2024-08-31T05:30:29.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.366+0000 7f10d1a6a640 1 -- 172.21.15.67:0/4007717579 shutdown_connections 2024-08-31T05:30:29.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.366+0000 7f10d1a6a640 1 --2- 172.21.15.67:0/4007717579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10cc103170 0x7f10cc10b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.366+0000 7f10d1a6a640 1 --2- 172.21.15.67:0/4007717579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10cc102850 0x7f10cc102c30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.366+0000 7f10d1a6a640 1 -- 172.21.15.67:0/4007717579 >> 172.21.15.67:0/4007717579 conn(0x7f10cc0fc270 msgr2=0x7f10cc0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:29.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.366+0000 7f10d1a6a640 1 -- 172.21.15.67:0/4007717579 shutdown_connections 2024-08-31T05:30:29.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.366+0000 7f10d1a6a640 1 -- 172.21.15.67:0/4007717579 wait complete. 2024-08-31T05:30:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.366+0000 7f10d1a6a640 1 Processor -- start 2024-08-31T05:30:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.366+0000 7f10d1a6a640 1 -- start start 2024-08-31T05:30:29.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.367+0000 7f10d1a6a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10cc102850 0x7f10cc1004b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:29.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.367+0000 7f10d1a6a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10cc103170 0x7f10cc1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:29.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.367+0000 7f10d1a6a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc10eb80 con 0x7f10cc102850 2024-08-31T05:30:29.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.367+0000 7f10d1a6a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc10ea00 con 0x7f10cc103170 2024-08-31T05:30:29.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.367+0000 7f10cb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10cc102850 0x7f10cc1004b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:29.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.367+0000 7f10cb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10cc102850 0x7f10cc1004b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51444/0 (socket says 172.21.15.67:51444) 2024-08-31T05:30:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.367+0000 7f10cb7fe640 1 -- 172.21.15.67:0/3273993970 learned_addr learned my addr 172.21.15.67:0/3273993970 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:30:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.367+0000 7f10c2ffd640 1 --2- 172.21.15.67:0/3273993970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10cc103170 0x7f10cc1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.367+0000 7f10cb7fe640 1 -- 172.21.15.67:0/3273993970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10cc103170 msgr2=0x7f10cc1009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.367+0000 7f10cb7fe640 1 --2- 172.21.15.67:0/3273993970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10cc103170 0x7f10cc1009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.367+0000 7f10cb7fe640 1 -- 172.21.15.67:0/3273993970 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10cc100f30 con 0x7f10cc102850 2024-08-31T05:30:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.367+0000 7f10cb7fe640 1 --2- 172.21.15.67:0/3273993970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10cc102850 0x7f10cc1004b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f10bc031460 tx=0x7f10bc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.367+0000 7f10c97fa640 1 -- 172.21.15.67:0/3273993970 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10bc03f070 con 0x7f10cc102850 2024-08-31T05:30:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.368+0000 7f10c97fa640 1 -- 172.21.15.67:0/3273993970 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10bc0035f0 con 0x7f10cc102850 2024-08-31T05:30:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.368+0000 7f10d1a6a640 1 -- 172.21.15.67:0/3273993970 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10cc1011c0 con 0x7f10cc102850 2024-08-31T05:30:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.368+0000 7f10c97fa640 1 -- 172.21.15.67:0/3273993970 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10bc035030 con 0x7f10cc102850 2024-08-31T05:30:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.368+0000 7f10d1a6a640 1 -- 172.21.15.67:0/3273993970 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10cc1a3c50 con 0x7f10cc102850 2024-08-31T05:30:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.369+0000 7f10d1a6a640 1 -- 172.21.15.67:0/3273993970 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10cc06ab40 con 0x7f10cc102850 2024-08-31T05:30:29.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.369+0000 7f10c97fa640 1 -- 172.21.15.67:0/3273993970 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f10bc042070 con 0x7f10cc102850 2024-08-31T05:30:29.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.370+0000 7f10c97fa640 1 --2- 172.21.15.67:0/3273993970 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f10b8079e40 0x7f10b807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:29.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.370+0000 7f10c97fa640 1 -- 172.21.15.67:0/3273993970 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f10bc0bd2d0 con 0x7f10cc102850 2024-08-31T05:30:29.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.370+0000 7f10c2ffd640 1 --2- 172.21.15.67:0/3273993970 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f10b8079e40 0x7f10b807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:29.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.371+0000 7f10c2ffd640 1 --2- 172.21.15.67:0/3273993970 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f10b8079e40 0x7f10b807c300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f10cc101f40 tx=0x7f10b400b2e0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:29.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.375+0000 7f10c97fa640 1 -- 172.21.15.67:0/3273993970 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f10bc088e90 con 0x7f10cc102850 2024-08-31T05:30:29.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.580+0000 7f10d1a6a640 1 -- 172.21.15.67:0/3273993970 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f10cc0623d0 con 0x7f10b8079e40 2024-08-31T05:30:29.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.581+0000 7f10c97fa640 1 -- 172.21.15.67:0/3273993970 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7f10cc0623d0 con 0x7f10b8079e40 2024-08-31T05:30:29.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.583+0000 7f10d1a6a640 1 -- 172.21.15.67:0/3273993970 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f10b8079e40 msgr2=0x7f10b807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:29.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.583+0000 7f10d1a6a640 1 --2- 172.21.15.67:0/3273993970 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f10b8079e40 0x7f10b807c300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f10cc101f40 tx=0x7f10b400b2e0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.583+0000 7f10d1a6a640 1 -- 172.21.15.67:0/3273993970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10cc102850 msgr2=0x7f10cc1004b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:29.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.583+0000 7f10d1a6a640 1 --2- 172.21.15.67:0/3273993970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10cc102850 0x7f10cc1004b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f10bc031460 tx=0x7f10bc0045e0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.584+0000 7f10d1a6a640 1 -- 172.21.15.67:0/3273993970 shutdown_connections 2024-08-31T05:30:29.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.584+0000 7f10d1a6a640 1 --2- 172.21.15.67:0/3273993970 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f10b8079e40 0x7f10b807c300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.584+0000 7f10d1a6a640 1 --2- 172.21.15.67:0/3273993970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10cc103170 0x7f10cc1009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.584+0000 7f10d1a6a640 1 --2- 172.21.15.67:0/3273993970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10cc102850 0x7f10cc1004b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.584+0000 7f10d1a6a640 1 -- 172.21.15.67:0/3273993970 >> 172.21.15.67:0/3273993970 conn(0x7f10cc0fc270 msgr2=0x7f10cc108c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:29.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.584+0000 7f10d1a6a640 1 -- 172.21.15.67:0/3273993970 shutdown_connections 2024-08-31T05:30:29.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.584+0000 7f10d1a6a640 1 -- 172.21.15.67:0/3273993970 wait complete. 2024-08-31T05:30:29.594 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:30:29.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.668+0000 7f0c89bec640 1 -- 172.21.15.67:0/4068923682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c841005b0 msgr2=0x7f0c84100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:29.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.668+0000 7f0c89bec640 1 --2- 172.21.15.67:0/4068923682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c841005b0 0x7f0c84100a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009880 tx=0x7f0c6c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.668+0000 7f0c89bec640 1 -- 172.21.15.67:0/4068923682 shutdown_connections 2024-08-31T05:30:29.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.668+0000 7f0c89bec640 1 --2- 172.21.15.67:0/4068923682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c841005b0 0x7f0c84100a10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.668+0000 7f0c89bec640 1 --2- 172.21.15.67:0/4068923682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c84106660 0x7f0c84106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.668+0000 7f0c89bec640 1 -- 172.21.15.67:0/4068923682 >> 172.21.15.67:0/4068923682 conn(0x7f0c840fc2f0 msgr2=0x7f0c840fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:29.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.669+0000 7f0c89bec640 1 -- 172.21.15.67:0/4068923682 shutdown_connections 2024-08-31T05:30:29.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.669+0000 7f0c89bec640 1 -- 172.21.15.67:0/4068923682 wait complete. 2024-08-31T05:30:29.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.669+0000 7f0c89bec640 1 Processor -- start 2024-08-31T05:30:29.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.669+0000 7f0c89bec640 1 -- start start 2024-08-31T05:30:29.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c89bec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c841005b0 0x7f0c84102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:29.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c89bec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c84106660 0x7f0c84102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:29.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c89bec640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8410da50 con 0x7f0c841005b0 2024-08-31T05:30:29.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c89bec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8410d8d0 con 0x7f0c84106660 2024-08-31T05:30:29.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c837fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c841005b0 0x7f0c84102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:29.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c837fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c841005b0 0x7f0c84102220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51462/0 (socket says 172.21.15.67:51462) 2024-08-31T05:30:29.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c837fe640 1 -- 172.21.15.67:0/3034292127 learned_addr learned my addr 172.21.15.67:0/3034292127 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:30:29.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c82ffd640 1 --2- 172.21.15.67:0/3034292127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c84106660 0x7f0c84102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:29.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c837fe640 1 -- 172.21.15.67:0/3034292127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c84106660 msgr2=0x7f0c84102760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:29.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c837fe640 1 --2- 172.21.15.67:0/3034292127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c84106660 0x7f0c84102760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c837fe640 1 -- 172.21.15.67:0/3034292127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c84102ca0 con 0x7f0c841005b0 2024-08-31T05:30:29.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c82ffd640 1 --2- 172.21.15.67:0/3034292127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c84106660 0x7f0c84102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:30:29.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c837fe640 1 --2- 172.21.15.67:0/3034292127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c841005b0 0x7f0c84102220 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400db80 tx=0x7f0c7400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:29.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c80ff9640 1 -- 172.21.15.67:0/3034292127 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c74017070 con 0x7f0c841005b0 2024-08-31T05:30:29.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.670+0000 7f0c89bec640 1 -- 172.21.15.67:0/3034292127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c84102f90 con 0x7f0c841005b0 2024-08-31T05:30:29.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.671+0000 7f0c80ff9640 1 -- 172.21.15.67:0/3034292127 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0c74003e30 con 0x7f0c841005b0 2024-08-31T05:30:29.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.671+0000 7f0c80ff9640 1 -- 172.21.15.67:0/3034292127 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c74010460 con 0x7f0c841005b0 2024-08-31T05:30:29.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.671+0000 7f0c89bec640 1 -- 172.21.15.67:0/3034292127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c841a3b20 con 0x7f0c841005b0 2024-08-31T05:30:29.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.672+0000 7f0c89bec640 1 -- 172.21.15.67:0/3034292127 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c84101cd0 con 0x7f0c841005b0 2024-08-31T05:30:29.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.672+0000 7f0c80ff9640 1 -- 172.21.15.67:0/3034292127 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f0c7400dc70 con 0x7f0c841005b0 2024-08-31T05:30:29.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.673+0000 7f0c80ff9640 1 --2- 172.21.15.67:0/3034292127 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0c70079e00 0x7f0c7007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:29.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.673+0000 7f0c80ff9640 1 -- 172.21.15.67:0/3034292127 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f0c7409cf10 con 0x7f0c841005b0 2024-08-31T05:30:29.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.673+0000 7f0c82ffd640 1 --2- 172.21.15.67:0/3034292127 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0c70079e00 0x7f0c7007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:29.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.673+0000 7f0c82ffd640 1 --2- 172.21.15.67:0/3034292127 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0c70079e00 0x7f0c7007c2c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0c84103cb0 tx=0x7f0c6c004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:29.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.677+0000 7f0c80ff9640 1 -- 172.21.15.67:0/3034292127 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0c740648e0 con 0x7f0c841005b0 2024-08-31T05:30:29.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.884+0000 7f0c89bec640 1 -- 172.21.15.67:0/3034292127 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0c8406a190 con 0x7f0c70079e00 2024-08-31T05:30:29.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.886+0000 7f0c80ff9640 1 -- 172.21.15.67:0/3034292127 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7f0c8406a190 con 0x7f0c70079e00 2024-08-31T05:30:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.888+0000 7f0c89bec640 1 -- 172.21.15.67:0/3034292127 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0c70079e00 msgr2=0x7f0c7007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.888+0000 7f0c89bec640 1 --2- 172.21.15.67:0/3034292127 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0c70079e00 0x7f0c7007c2c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0c84103cb0 tx=0x7f0c6c004f30 comp rx=0 tx=0).stop 2024-08-31T05:30:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.888+0000 7f0c89bec640 1 -- 172.21.15.67:0/3034292127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c841005b0 msgr2=0x7f0c84102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.888+0000 7f0c89bec640 1 --2- 172.21.15.67:0/3034292127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c841005b0 0x7f0c84102220 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400db80 tx=0x7f0c7400b630 comp rx=0 tx=0).stop 2024-08-31T05:30:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.888+0000 7f0c89bec640 1 -- 172.21.15.67:0/3034292127 shutdown_connections 2024-08-31T05:30:29.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.888+0000 7f0c89bec640 1 --2- 172.21.15.67:0/3034292127 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0c70079e00 0x7f0c7007c2c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.888+0000 7f0c89bec640 1 --2- 172.21.15.67:0/3034292127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c84106660 0x7f0c84102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.888+0000 7f0c89bec640 1 --2- 172.21.15.67:0/3034292127 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0c841005b0 0x7f0c84102220 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.888+0000 7f0c89bec640 1 -- 172.21.15.67:0/3034292127 >> 172.21.15.67:0/3034292127 conn(0x7f0c840fc2f0 msgr2=0x7f0c84069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:29.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.888+0000 7f0c89bec640 1 -- 172.21.15.67:0/3034292127 shutdown_connections 2024-08-31T05:30:29.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.888+0000 7f0c89bec640 1 -- 172.21.15.67:0/3034292127 wait complete. 2024-08-31T05:30:29.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.976+0000 7fa6722fd640 1 -- 172.21.15.67:0/1131151567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66c106610 msgr2=0x7fa66c1069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:29.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.976+0000 7fa6722fd640 1 --2- 172.21.15.67:0/1131151567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66c106610 0x7fa66c1069f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa65c009880 tx=0x7fa65c02a4b0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.976+0000 7fa6722fd640 1 -- 172.21.15.67:0/1131151567 shutdown_connections 2024-08-31T05:30:29.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.976+0000 7fa6722fd640 1 --2- 172.21.15.67:0/1131151567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa66c100c70 0x7fa66c1010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.976+0000 7fa6722fd640 1 --2- 172.21.15.67:0/1131151567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66c106610 0x7fa66c1069f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.976+0000 7fa6722fd640 1 -- 172.21.15.67:0/1131151567 >> 172.21.15.67:0/1131151567 conn(0x7fa66c0fba30 msgr2=0x7fa66c0fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:29.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.976+0000 7fa6722fd640 1 -- 172.21.15.67:0/1131151567 shutdown_connections 2024-08-31T05:30:29.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.976+0000 7fa6722fd640 1 -- 172.21.15.67:0/1131151567 wait complete. 2024-08-31T05:30:29.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.977+0000 7fa6722fd640 1 Processor -- start 2024-08-31T05:30:29.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.977+0000 7fa6722fd640 1 -- start start 2024-08-31T05:30:29.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.977+0000 7fa6722fd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa66c100c70 0x7fa66c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:29.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.977+0000 7fa6722fd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66c106610 0x7fa66c198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:29.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.977+0000 7fa6722fd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c10dac0 con 0x7fa66c106610 2024-08-31T05:30:29.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.977+0000 7fa6722fd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c10d940 con 0x7fa66c100c70 2024-08-31T05:30:29.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.978+0000 7fa66b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66c106610 0x7fa66c198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:29.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.978+0000 7fa66b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66c106610 0x7fa66c198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51480/0 (socket says 172.21.15.67:51480) 2024-08-31T05:30:29.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.978+0000 7fa66b7fe640 1 -- 172.21.15.67:0/1456849680 learned_addr learned my addr 172.21.15.67:0/1456849680 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:30:29.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.978+0000 7fa66bfff640 1 --2- 172.21.15.67:0/1456849680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa66c100c70 0x7fa66c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:29.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.978+0000 7fa66b7fe640 1 -- 172.21.15.67:0/1456849680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa66c100c70 msgr2=0x7fa66c1985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:29.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.978+0000 7fa66b7fe640 1 --2- 172.21.15.67:0/1456849680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa66c100c70 0x7fa66c1985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:29.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.978+0000 7fa66b7fe640 1 -- 172.21.15.67:0/1456849680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66c199130 con 0x7fa66c106610 2024-08-31T05:30:29.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.978+0000 7fa66b7fe640 1 --2- 172.21.15.67:0/1456849680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66c106610 0x7fa66c198b30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa66000d8d0 tx=0x7fa66000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:29.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.978+0000 7fa6697fa640 1 -- 172.21.15.67:0/1456849680 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa660017070 con 0x7fa66c106610 2024-08-31T05:30:29.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.978+0000 7fa6697fa640 1 -- 172.21.15.67:0/1456849680 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa660010460 con 0x7fa66c106610 2024-08-31T05:30:29.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.978+0000 7fa6722fd640 1 -- 172.21.15.67:0/1456849680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66c199420 con 0x7fa66c106610 2024-08-31T05:30:29.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.978+0000 7fa6697fa640 1 -- 172.21.15.67:0/1456849680 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa66000f5f0 con 0x7fa66c106610 2024-08-31T05:30:29.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.979+0000 7fa6722fd640 1 -- 172.21.15.67:0/1456849680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa66c1a1960 con 0x7fa66c106610 2024-08-31T05:30:29.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.980+0000 7fa6722fd640 1 -- 172.21.15.67:0/1456849680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa66c101e90 con 0x7fa66c106610 2024-08-31T05:30:29.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.980+0000 7fa6697fa640 1 -- 172.21.15.67:0/1456849680 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fa660009a30 con 0x7fa66c106610 2024-08-31T05:30:29.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.981+0000 7fa6697fa640 1 --2- 172.21.15.67:0/1456849680 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa654079e40 0x7fa65407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:29.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.981+0000 7fa6697fa640 1 -- 172.21.15.67:0/1456849680 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7fa66009c830 con 0x7fa66c106610 2024-08-31T05:30:29.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.981+0000 7fa66bfff640 1 --2- 172.21.15.67:0/1456849680 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa654079e40 0x7fa65407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:29.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.982+0000 7fa66bfff640 1 --2- 172.21.15.67:0/1456849680 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa654079e40 0x7fa65407c300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0096c0 tx=0x7fa65c031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:29.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:29.987+0000 7fa6697fa640 1 -- 172.21.15.67:0/1456849680 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa66c199420 con 0x7fa66c106610 2024-08-31T05:30:30.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.189+0000 7fa6722fd640 1 -- 172.21.15.67:0/1456849680 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa66c0623d0 con 0x7fa654079e40 2024-08-31T05:30:30.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.200+0000 7fa6697fa640 1 -- 172.21.15.67:0/1456849680 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fa66c0623d0 con 0x7fa654079e40 2024-08-31T05:30:30.202 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:30:30.203 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (6m) 0s ago 17m 21.4M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:30:30.203 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (14s) 0s ago 17m 75.3M - 19.3.0-4560-gd19e6118 79f4cde5e369 fccbf3efb30b 2024-08-31T05:30:30.203 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (9s) 6s ago 16m 74.4M - 19.3.0-4560-gd19e6118 79f4cde5e369 5533dcfe7e99 2024-08-31T05:30:30.203 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (4m) 0s ago 17m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 910f4f105c4b 2024-08-31T05:30:30.203 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (4m) 6s ago 16m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 0dcc86f98a20 2024-08-31T05:30:30.203 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (6m) 0s ago 17m 80.9M - c8b91775d855 3a9a0f88928d 2024-08-31T05:30:30.203 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (63s) 0s ago 12m 234M - 19.3.0-4560-gd19e6118 79f4cde5e369 e70ebd5a7787 2024-08-31T05:30:30.204 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (79s) 0s ago 12m 154M - 19.3.0-4560-gd19e6118 79f4cde5e369 b01bdece784a 2024-08-31T05:30:30.204 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (47s) 6s ago 12m 83.6M - 19.3.0-4560-gd19e6118 79f4cde5e369 961d09a035db 2024-08-31T05:30:30.204 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (28s) 6s ago 11m 83.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 e539a6598628 2024-08-31T05:30:30.204 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (8m) 0s ago 18m 597M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:30:30.204 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (7m) 6s ago 16m 526M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:30:30.204 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (5m) 0s ago 18m 121M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 25a28efbbd37 2024-08-31T05:30:30.204 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (5m) 6s ago 16m 108M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 6be0f0999860 2024-08-31T05:30:30.204 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (7m) 0s ago 17m 10.9M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:30:30.204 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (7m) 6s ago 16m 10.1M - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:30:30.205 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (4m) 0s ago 15m 196M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 aab0516dcbfa 2024-08-31T05:30:30.205 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (3m) 0s ago 14m 167M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 fa9e3fb20c5e 2024-08-31T05:30:30.205 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (3m) 0s ago 14m 159M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 a62abe735da2 2024-08-31T05:30:30.205 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (2m) 6s ago 13m 168M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 9f4ce308ec1d 2024-08-31T05:30:30.205 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (2m) 6s ago 13m 155M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 5f02556c012d 2024-08-31T05:30:30.206 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (96s) 6s ago 13m 166M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 530ae5c5d1ac 2024-08-31T05:30:30.206 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (6m) 0s ago 16m 55.9M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:30:30.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.203+0000 7fa6722fd640 1 -- 172.21.15.67:0/1456849680 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa654079e40 msgr2=0x7fa65407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:30.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.203+0000 7fa6722fd640 1 --2- 172.21.15.67:0/1456849680 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa654079e40 0x7fa65407c300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0096c0 tx=0x7fa65c031400 comp rx=0 tx=0).stop 2024-08-31T05:30:30.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.203+0000 7fa6722fd640 1 -- 172.21.15.67:0/1456849680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66c106610 msgr2=0x7fa66c198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:30.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.203+0000 7fa6722fd640 1 --2- 172.21.15.67:0/1456849680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66c106610 0x7fa66c198b30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa66000d8d0 tx=0x7fa66000dd90 comp rx=0 tx=0).stop 2024-08-31T05:30:30.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.203+0000 7fa6722fd640 1 -- 172.21.15.67:0/1456849680 shutdown_connections 2024-08-31T05:30:30.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.203+0000 7fa6722fd640 1 --2- 172.21.15.67:0/1456849680 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa654079e40 0x7fa65407c300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.203+0000 7fa6722fd640 1 --2- 172.21.15.67:0/1456849680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa66c106610 0x7fa66c198b30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.203+0000 7fa6722fd640 1 --2- 172.21.15.67:0/1456849680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa66c100c70 0x7fa66c1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.203+0000 7fa6722fd640 1 -- 172.21.15.67:0/1456849680 >> 172.21.15.67:0/1456849680 conn(0x7fa66c0fba30 msgr2=0x7fa66c0fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:30.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.203+0000 7fa6722fd640 1 -- 172.21.15.67:0/1456849680 shutdown_connections 2024-08-31T05:30:30.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.203+0000 7fa6722fd640 1 -- 172.21.15.67:0/1456849680 wait complete. 2024-08-31T05:30:30.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.286+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/631468299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b4102850 msgr2=0x7fb0b4102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:30.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.286+0000 7fb0b8e9c640 1 --2- 172.21.15.67:0/631468299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b4102850 0x7fb0b4102c30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009880 tx=0x7fb0a402a530 comp rx=0 tx=0).stop 2024-08-31T05:30:30.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.286+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/631468299 shutdown_connections 2024-08-31T05:30:30.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.286+0000 7fb0b8e9c640 1 --2- 172.21.15.67:0/631468299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0b4103170 0x7fb0b410b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.286+0000 7fb0b8e9c640 1 --2- 172.21.15.67:0/631468299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b4102850 0x7fb0b4102c30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.286+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/631468299 >> 172.21.15.67:0/631468299 conn(0x7fb0b40fc270 msgr2=0x7fb0b40fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:30.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.286+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/631468299 shutdown_connections 2024-08-31T05:30:30.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.286+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/631468299 wait complete. 2024-08-31T05:30:30.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.287+0000 7fb0b8e9c640 1 Processor -- start 2024-08-31T05:30:30.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.287+0000 7fb0b8e9c640 1 -- start start 2024-08-31T05:30:30.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.287+0000 7fb0b8e9c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0b4102850 0x7fb0b4197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:30.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.287+0000 7fb0b8e9c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b4103170 0x7fb0b4197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:30.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.287+0000 7fb0b8e9c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b410eb80 con 0x7fb0b4103170 2024-08-31T05:30:30.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.287+0000 7fb0b8e9c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b410ea00 con 0x7fb0b4102850 2024-08-31T05:30:30.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.287+0000 7fb0abfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b4103170 0x7fb0b4197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:30.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.288+0000 7fb0abfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b4103170 0x7fb0b4197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51508/0 (socket says 172.21.15.67:51508) 2024-08-31T05:30:30.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.288+0000 7fb0abfff640 1 -- 172.21.15.67:0/1549187572 learned_addr learned my addr 172.21.15.67:0/1549187572 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:30:30.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.288+0000 7fb0b259c640 1 --2- 172.21.15.67:0/1549187572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0b4102850 0x7fb0b4197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:30.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.288+0000 7fb0abfff640 1 -- 172.21.15.67:0/1549187572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0b4102850 msgr2=0x7fb0b4197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:30.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.288+0000 7fb0abfff640 1 --2- 172.21.15.67:0/1549187572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0b4102850 0x7fb0b4197740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.288+0000 7fb0abfff640 1 -- 172.21.15.67:0/1549187572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b419c010 con 0x7fb0b4103170 2024-08-31T05:30:30.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.288+0000 7fb0abfff640 1 --2- 172.21.15.67:0/1549187572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b4103170 0x7fb0b4197c80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00d6d0 tx=0x7fb09c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:30.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.288+0000 7fb0ab7fe640 1 -- 172.21.15.67:0/1549187572 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb09c017070 con 0x7fb0b4103170 2024-08-31T05:30:30.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.288+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/1549187572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b419c300 con 0x7fb0b4103170 2024-08-31T05:30:30.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.288+0000 7fb0ab7fe640 1 -- 172.21.15.67:0/1549187572 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb09c0054e0 con 0x7fb0b4103170 2024-08-31T05:30:30.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.288+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/1549187572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b419c890 con 0x7fb0b4103170 2024-08-31T05:30:30.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.288+0000 7fb0ab7fe640 1 -- 172.21.15.67:0/1549187572 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb09c004ae0 con 0x7fb0b4103170 2024-08-31T05:30:30.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.290+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/1549187572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b406ab40 con 0x7fb0b4103170 2024-08-31T05:30:30.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.290+0000 7fb0ab7fe640 1 -- 172.21.15.67:0/1549187572 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fb09c010460 con 0x7fb0b4103170 2024-08-31T05:30:30.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.291+0000 7fb0ab7fe640 1 --2- 172.21.15.67:0/1549187572 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb0a0079e40 0x7fb0a007c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:30.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.291+0000 7fb0ab7fe640 1 -- 172.21.15.67:0/1549187572 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7fb09c09c530 con 0x7fb0b4103170 2024-08-31T05:30:30.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.291+0000 7fb0b259c640 1 --2- 172.21.15.67:0/1549187572 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb0a0079e40 0x7fb0a007c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:30.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.291+0000 7fb0b259c640 1 --2- 172.21.15.67:0/1549187572 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb0a0079e40 0x7fb0a007c300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40096c0 tx=0x7fb0a4031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:30.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.296+0000 7fb0ab7fe640 1 -- 172.21.15.67:0/1549187572 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb09c0680f0 con 0x7fb0b4103170 2024-08-31T05:30:30.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.558+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/1549187572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb0b4102c30 con 0x7fb0b4103170 2024-08-31T05:30:30.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.559+0000 7fb0ab7fe640 1 -- 172.21.15.67:0/1549187572 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fb09c06cb10 con 0x7fb0b4103170 2024-08-31T05:30:30.561 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:30:30.561 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:30:30.561 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:30:30.561 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:30:30.561 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:30:30.561 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:30:30.561 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:30:30.561 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:30:30.562 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 6 2024-08-31T05:30:30.562 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:30:30.562 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:30:30.562 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 4 2024-08-31T05:30:30.562 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:30:30.562 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:30:30.562 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 14 2024-08-31T05:30:30.562 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:30:30.562 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:30:30.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.563+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/1549187572 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb0a0079e40 msgr2=0x7fb0a007c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:30.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.563+0000 7fb0b8e9c640 1 --2- 172.21.15.67:0/1549187572 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb0a0079e40 0x7fb0a007c300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40096c0 tx=0x7fb0a4031400 comp rx=0 tx=0).stop 2024-08-31T05:30:30.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.563+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/1549187572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b4103170 msgr2=0x7fb0b4197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:30.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.563+0000 7fb0b8e9c640 1 --2- 172.21.15.67:0/1549187572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b4103170 0x7fb0b4197c80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00d6d0 tx=0x7fb09c00db90 comp rx=0 tx=0).stop 2024-08-31T05:30:30.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.563+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/1549187572 shutdown_connections 2024-08-31T05:30:30.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.563+0000 7fb0b8e9c640 1 --2- 172.21.15.67:0/1549187572 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb0a0079e40 0x7fb0a007c300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.563+0000 7fb0b8e9c640 1 --2- 172.21.15.67:0/1549187572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0b4103170 0x7fb0b4197c80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.563+0000 7fb0b8e9c640 1 --2- 172.21.15.67:0/1549187572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0b4102850 0x7fb0b4197740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.563+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/1549187572 >> 172.21.15.67:0/1549187572 conn(0x7fb0b40fc270 msgr2=0x7fb0b4108c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:30.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.563+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/1549187572 shutdown_connections 2024-08-31T05:30:30.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.563+0000 7fb0b8e9c640 1 -- 172.21.15.67:0/1549187572 wait complete. 2024-08-31T05:30:30.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.656+0000 7f9110293640 1 -- 172.21.15.67:0/4260650923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91081005b0 msgr2=0x7f9108100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:30.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.656+0000 7f9110293640 1 --2- 172.21.15.67:0/4260650923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91081005b0 0x7f9108100a10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009880 tx=0x7f90f802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.656+0000 7f9110293640 1 -- 172.21.15.67:0/4260650923 shutdown_connections 2024-08-31T05:30:30.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.656+0000 7f9110293640 1 --2- 172.21.15.67:0/4260650923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91081005b0 0x7f9108100a10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.656+0000 7f9110293640 1 --2- 172.21.15.67:0/4260650923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9108106660 0x7f9108106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.656+0000 7f9110293640 1 -- 172.21.15.67:0/4260650923 >> 172.21.15.67:0/4260650923 conn(0x7f91080fc2f0 msgr2=0x7f91080fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:30.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.656+0000 7f9110293640 1 -- 172.21.15.67:0/4260650923 shutdown_connections 2024-08-31T05:30:30.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.656+0000 7f9110293640 1 -- 172.21.15.67:0/4260650923 wait complete. 2024-08-31T05:30:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.657+0000 7f9110293640 1 Processor -- start 2024-08-31T05:30:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.657+0000 7f9110293640 1 -- start start 2024-08-31T05:30:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.657+0000 7f9110293640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91081005b0 0x7f9108196570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.657+0000 7f9110293640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9108106660 0x7f9108196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.657+0000 7f9110293640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f910810da50 con 0x7f9108106660 2024-08-31T05:30:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.657+0000 7f9110293640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f910810d8d0 con 0x7f91081005b0 2024-08-31T05:30:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.657+0000 7f910d82e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9108106660 0x7f9108196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:30.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.657+0000 7f910d82e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9108106660 0x7f9108196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51534/0 (socket says 172.21.15.67:51534) 2024-08-31T05:30:30.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.657+0000 7f910d82e640 1 -- 172.21.15.67:0/2351383495 learned_addr learned my addr 172.21.15.67:0/2351383495 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:30:30.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.658+0000 7f910e02f640 1 --2- 172.21.15.67:0/2351383495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91081005b0 0x7f9108196570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:30.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.658+0000 7f910d82e640 1 -- 172.21.15.67:0/2351383495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91081005b0 msgr2=0x7f9108196570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:30.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.658+0000 7f910d82e640 1 --2- 172.21.15.67:0/2351383495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91081005b0 0x7f9108196570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.658+0000 7f910d82e640 1 -- 172.21.15.67:0/2351383495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910819ae40 con 0x7f9108106660 2024-08-31T05:30:30.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.658+0000 7f910d82e640 1 --2- 172.21.15.67:0/2351383495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9108106660 0x7f9108196ab0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f90f8004f90 tx=0x7f90f80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:30.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.658+0000 7f90ff7fe640 1 -- 172.21.15.67:0/2351383495 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90f803f070 con 0x7f9108106660 2024-08-31T05:30:30.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.658+0000 7f9110293640 1 -- 172.21.15.67:0/2351383495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910819b0d0 con 0x7f9108106660 2024-08-31T05:30:30.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.658+0000 7f90ff7fe640 1 -- 172.21.15.67:0/2351383495 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f90f8004cf0 con 0x7f9108106660 2024-08-31T05:30:30.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.658+0000 7f90ff7fe640 1 -- 172.21.15.67:0/2351383495 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90f8035030 con 0x7f9108106660 2024-08-31T05:30:30.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.658+0000 7f9110293640 1 -- 172.21.15.67:0/2351383495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f910819b600 con 0x7f9108106660 2024-08-31T05:30:30.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.659+0000 7f9110293640 1 -- 172.21.15.67:0/2351383495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9108101cd0 con 0x7f9108106660 2024-08-31T05:30:30.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.660+0000 7f90ff7fe640 1 -- 172.21.15.67:0/2351383495 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f90f8042070 con 0x7f9108106660 2024-08-31T05:30:30.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.661+0000 7f90ff7fe640 1 --2- 172.21.15.67:0/2351383495 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f90f4079e00 0x7f90f407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:30.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.661+0000 7f90ff7fe640 1 -- 172.21.15.67:0/2351383495 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f90f80bd600 con 0x7f9108106660 2024-08-31T05:30:30.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.661+0000 7f910e02f640 1 --2- 172.21.15.67:0/2351383495 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f90f4079e00 0x7f90f407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:30.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.661+0000 7f910e02f640 1 --2- 172.21.15.67:0/2351383495 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f90f4079e00 0x7f90f407c2c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f91040058c0 tx=0x7f910400a2d0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:30.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.666+0000 7f90ff7fe640 1 -- 172.21.15.67:0/2351383495 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f90f80890a0 con 0x7f9108106660 2024-08-31T05:30:30.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:30 smithi067 ceph-mon[99941]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:30.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:30 smithi067 ceph-mon[99941]: pgmap v304: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.9 MiB/s rd, 3 op/s 2024-08-31T05:30:30.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:30 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:30.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:30 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:30.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:30 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/1549187572' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:30.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:30 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:30.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:30 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.891+0000 7f9110293640 1 -- 172.21.15.67:0/2351383495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9108197900 con 0x7f9108106660 2024-08-31T05:30:30.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.892+0000 7f90ff7fe640 1 -- 172.21.15.67:0/2351383495 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) ==== 76+0+2040 (secure 0 0 0) 0x7f9108197900 con 0x7f9108106660 2024-08-31T05:30:30.894 INFO:teuthology.orchestra.run.smithi067.stdout:e35 2024-08-31T05:30:30.894 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-08-31T05:30:11:070139+0000 2024-08-31T05:30:30.894 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:30:30.894 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:30:30.894 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-08-31T05:30:30.894 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:30:30.894 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:30:30.894 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-08-31T05:30:30.894 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 35 2024-08-31T05:30:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T05:30:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:30:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-08-31T05:30:11.070122+0000 2024-08-31T05:30:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-08-31T05:30:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-08-31T05:30:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2024-08-31T05:30:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-08-31T05:30:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-08-31T05:30:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-08-31T05:30:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-08-31T05:30:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-08-31T05:30:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 95 2024-08-31T05:30:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:30:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2024-08-31T05:30:30.896 INFO:teuthology.orchestra.run.smithi067.stdout:in 0 2024-08-31T05:30:30.896 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=34322} 2024-08-31T05:30:30.896 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-08-31T05:30:30.896 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-08-31T05:30:30.896 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-08-31T05:30:30.896 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-08-31T05:30:30.896 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-08-31T05:30:30.896 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data enabled 2024-08-31T05:30:30.896 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-08-31T05:30:30.896 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-08-31T05:30:30.896 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2024-08-31T05:30:30.896 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 34322 members: 34322 2024-08-31T05:30:30.896 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.tskvpt{0:34322} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.67:6826/3864481333,v1:172.21.15.67:6827/3864481333] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:30:30.896 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.beqeql{0:34354} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.67:6828/352208921,v1:172.21.15.67:6829/352208921] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:30:30.897 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:30:30.897 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:30:30.897 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2024-08-31T05:30:30.897 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:30:30.897 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.gsnhxi{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6824/2489979765,v1:172.21.15.73:6825/2489979765] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:30:30.897 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.kfbmeo{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/668223470,v1:172.21.15.73:6827/668223470] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:30:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 35 2024-08-31T05:30:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.894+0000 7f9110293640 1 -- 172.21.15.67:0/2351383495 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f90f4079e00 msgr2=0x7f90f407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.894+0000 7f9110293640 1 --2- 172.21.15.67:0/2351383495 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f90f4079e00 0x7f90f407c2c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f91040058c0 tx=0x7f910400a2d0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.894+0000 7f9110293640 1 -- 172.21.15.67:0/2351383495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9108106660 msgr2=0x7f9108196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.894+0000 7f9110293640 1 --2- 172.21.15.67:0/2351383495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9108106660 0x7f9108196ab0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f90f8004f90 tx=0x7f90f80048f0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.894+0000 7f9110293640 1 -- 172.21.15.67:0/2351383495 shutdown_connections 2024-08-31T05:30:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.894+0000 7f9110293640 1 --2- 172.21.15.67:0/2351383495 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f90f4079e00 0x7f90f407c2c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.894+0000 7f9110293640 1 --2- 172.21.15.67:0/2351383495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9108106660 0x7f9108196ab0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.894+0000 7f9110293640 1 --2- 172.21.15.67:0/2351383495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91081005b0 0x7f9108196570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.894+0000 7f9110293640 1 -- 172.21.15.67:0/2351383495 >> 172.21.15.67:0/2351383495 conn(0x7f91080fc2f0 msgr2=0x7f91080fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.894+0000 7f9110293640 1 -- 172.21.15.67:0/2351383495 shutdown_connections 2024-08-31T05:30:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.894+0000 7f9110293640 1 -- 172.21.15.67:0/2351383495 wait complete. 2024-08-31T05:30:30.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.983+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1536585605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cdc101c90 msgr2=0x7f9cdc105240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:30.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.983+0000 7f9ce3aec640 1 --2- 172.21.15.67:0/1536585605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cdc101c90 0x7f9cdc105240 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009880 tx=0x7f9ccc02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.983+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1536585605 shutdown_connections 2024-08-31T05:30:30.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.983+0000 7f9ce3aec640 1 --2- 172.21.15.67:0/1536585605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cdc101c90 0x7f9cdc105240 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.983+0000 7f9ce3aec640 1 --2- 172.21.15.67:0/1536585605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc1012e0 0x7f9cdc1016c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.983+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1536585605 >> 172.21.15.67:0/1536585605 conn(0x7f9cdc076f80 msgr2=0x7f9cdc077390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:30.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.984+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1536585605 shutdown_connections 2024-08-31T05:30:30.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.984+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1536585605 wait complete. 2024-08-31T05:30:30.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.984+0000 7f9ce3aec640 1 Processor -- start 2024-08-31T05:30:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.984+0000 7f9ce3aec640 1 -- start start 2024-08-31T05:30:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.984+0000 7f9ce3aec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc1012e0 0x7f9cdc1022e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.984+0000 7f9ce3aec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cdc101c90 0x7f9cdc102820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.984+0000 7f9ce3aec640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9cdc10da30 con 0x7f9cdc101c90 2024-08-31T05:30:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.984+0000 7f9ce3aec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9cdc10d8b0 con 0x7f9cdc1012e0 2024-08-31T05:30:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.985+0000 7f9ce1087640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cdc101c90 0x7f9cdc102820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.985+0000 7f9ce1087640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cdc101c90 0x7f9cdc102820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51558/0 (socket says 172.21.15.67:51558) 2024-08-31T05:30:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.985+0000 7f9ce1087640 1 -- 172.21.15.67:0/1888624030 learned_addr learned my addr 172.21.15.67:0/1888624030 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:30:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.985+0000 7f9ce1888640 1 --2- 172.21.15.67:0/1888624030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc1012e0 0x7f9cdc1022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.985+0000 7f9ce1087640 1 -- 172.21.15.67:0/1888624030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc1012e0 msgr2=0x7f9cdc1022e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.985+0000 7f9ce1087640 1 --2- 172.21.15.67:0/1888624030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc1012e0 0x7f9cdc1022e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.985+0000 7f9ce1087640 1 -- 172.21.15.67:0/1888624030 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cdc102d60 con 0x7f9cdc101c90 2024-08-31T05:30:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.985+0000 7f9ce1087640 1 --2- 172.21.15.67:0/1888624030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cdc101c90 0x7f9cdc102820 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc031460 tx=0x7f9ccc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.985+0000 7f9cd2ffd640 1 -- 172.21.15.67:0/1888624030 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ccc03f070 con 0x7f9cdc101c90 2024-08-31T05:30:30.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.985+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1888624030 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cdc102ff0 con 0x7f9cdc101c90 2024-08-31T05:30:30.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.985+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1888624030 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cdc1a3ae0 con 0x7f9cdc101c90 2024-08-31T05:30:30.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.985+0000 7f9cd2ffd640 1 -- 172.21.15.67:0/1888624030 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9ccc0035f0 con 0x7f9cdc101c90 2024-08-31T05:30:30.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.986+0000 7f9cd2ffd640 1 -- 172.21.15.67:0/1888624030 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ccc035030 con 0x7f9cdc101c90 2024-08-31T05:30:30.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.986+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1888624030 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cdc069670 con 0x7f9cdc101c90 2024-08-31T05:30:30.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.987+0000 7f9cd2ffd640 1 -- 172.21.15.67:0/1888624030 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f9ccc042070 con 0x7f9cdc101c90 2024-08-31T05:30:30.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.988+0000 7f9cd2ffd640 1 --2- 172.21.15.67:0/1888624030 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9cc8079e40 0x7f9cc807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:30.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.988+0000 7f9cd2ffd640 1 -- 172.21.15.67:0/1888624030 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f9ccc0bd300 con 0x7f9cdc101c90 2024-08-31T05:30:30.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.988+0000 7f9ce1888640 1 --2- 172.21.15.67:0/1888624030 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9cc8079e40 0x7f9cc807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:30.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.988+0000 7f9ce1888640 1 --2- 172.21.15.67:0/1888624030 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9cc8079e40 0x7f9cc807c300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800bbe0 tx=0x7f9cd800b390 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:30.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:30.993+0000 7f9cd2ffd640 1 -- 172.21.15.67:0/1888624030 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9ccc088e60 con 0x7f9cdc101c90 2024-08-31T05:30:31.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:30 smithi073 ceph-mon[71452]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:31.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:30 smithi073 ceph-mon[71452]: pgmap v304: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.9 MiB/s rd, 3 op/s 2024-08-31T05:30:31.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:30 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:31.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:30 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:31.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:30 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/1549187572' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:31.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:30 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:31.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:30 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:31.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.203+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1888624030 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9cdc0623d0 con 0x7f9cc8079e40 2024-08-31T05:30:31.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.205+0000 7f9cd2ffd640 1 -- 172.21.15.67:0/1888624030 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+466 (secure 0 0 0) 0x7f9cdc0623d0 con 0x7f9cc8079e40 2024-08-31T05:30:31.207 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:30:31.207 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61", 2024-08-31T05:30:31.207 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2024-08-31T05:30:31.207 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-31T05:30:31.207 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2024-08-31T05:30:31.207 INFO:teuthology.orchestra.run.smithi067.stdout: "mon", 2024-08-31T05:30:31.207 INFO:teuthology.orchestra.run.smithi067.stdout: "osd", 2024-08-31T05:30:31.207 INFO:teuthology.orchestra.run.smithi067.stdout: "mds", 2024-08-31T05:30:31.207 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2024-08-31T05:30:31.207 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2024-08-31T05:30:31.207 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph-exporter" 2024-08-31T05:30:31.207 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-08-31T05:30:31.207 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "18/23 daemons upgraded", 2024-08-31T05:30:31.208 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-08-31T05:30:31.208 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:30:31.208 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:30:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.207+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1888624030 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9cc8079e40 msgr2=0x7f9cc807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.207+0000 7f9ce3aec640 1 --2- 172.21.15.67:0/1888624030 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9cc8079e40 0x7f9cc807c300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800bbe0 tx=0x7f9cd800b390 comp rx=0 tx=0).stop 2024-08-31T05:30:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.207+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1888624030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cdc101c90 msgr2=0x7f9cdc102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.207+0000 7f9ce3aec640 1 --2- 172.21.15.67:0/1888624030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cdc101c90 0x7f9cdc102820 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc031460 tx=0x7f9ccc0045e0 comp rx=0 tx=0).stop 2024-08-31T05:30:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.207+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1888624030 shutdown_connections 2024-08-31T05:30:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.207+0000 7f9ce3aec640 1 --2- 172.21.15.67:0/1888624030 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9cc8079e40 0x7f9cc807c300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.207+0000 7f9ce3aec640 1 --2- 172.21.15.67:0/1888624030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9cdc101c90 0x7f9cdc102820 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:31.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.207+0000 7f9ce3aec640 1 --2- 172.21.15.67:0/1888624030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc1012e0 0x7f9cdc1022e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.207+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1888624030 >> 172.21.15.67:0/1888624030 conn(0x7f9cdc076f80 msgr2=0x7f9cdc104700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.207+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1888624030 shutdown_connections 2024-08-31T05:30:31.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.207+0000 7f9ce3aec640 1 -- 172.21.15.67:0/1888624030 wait complete. 2024-08-31T05:30:31.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.291+0000 7f909e9ac640 1 -- 172.21.15.67:0/3173049581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9098102850 msgr2=0x7f9098102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:31.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.291+0000 7f909e9ac640 1 --2- 172.21.15.67:0/3173049581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9098102850 0x7f9098102c30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9088009880 tx=0x7f908802a530 comp rx=0 tx=0).stop 2024-08-31T05:30:31.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.291+0000 7f909e9ac640 1 -- 172.21.15.67:0/3173049581 shutdown_connections 2024-08-31T05:30:31.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.291+0000 7f909e9ac640 1 --2- 172.21.15.67:0/3173049581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9098103170 0x7f909810b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:31.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.291+0000 7f909e9ac640 1 --2- 172.21.15.67:0/3173049581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9098102850 0x7f9098102c30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:31.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.291+0000 7f909e9ac640 1 -- 172.21.15.67:0/3173049581 >> 172.21.15.67:0/3173049581 conn(0x7f90980fc270 msgr2=0x7f90980fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:31.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.291+0000 7f909e9ac640 1 -- 172.21.15.67:0/3173049581 shutdown_connections 2024-08-31T05:30:31.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.291+0000 7f909e9ac640 1 -- 172.21.15.67:0/3173049581 wait complete. 2024-08-31T05:30:31.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.292+0000 7f909e9ac640 1 Processor -- start 2024-08-31T05:30:31.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.292+0000 7f909e9ac640 1 -- start start 2024-08-31T05:30:31.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.292+0000 7f909e9ac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9098102850 0x7f9098197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:31.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.292+0000 7f909e9ac640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9098103170 0x7f9098197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:31.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.292+0000 7f909e9ac640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f909810eb80 con 0x7f9098103170 2024-08-31T05:30:31.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.292+0000 7f909e9ac640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f909810ea00 con 0x7f9098102850 2024-08-31T05:30:31.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.292+0000 7f90977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9098103170 0x7f9098197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:31.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.292+0000 7f90977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9098103170 0x7f9098197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51568/0 (socket says 172.21.15.67:51568) 2024-08-31T05:30:31.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.292+0000 7f90977fe640 1 -- 172.21.15.67:0/1509859092 learned_addr learned my addr 172.21.15.67:0/1509859092 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:30:31.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.293+0000 7f9097fff640 1 --2- 172.21.15.67:0/1509859092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9098102850 0x7f9098197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:31.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.293+0000 7f90977fe640 1 -- 172.21.15.67:0/1509859092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9098102850 msgr2=0x7f9098197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:31.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.293+0000 7f90977fe640 1 --2- 172.21.15.67:0/1509859092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9098102850 0x7f9098197740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:31.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.293+0000 7f90977fe640 1 -- 172.21.15.67:0/1509859092 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909819c010 con 0x7f9098103170 2024-08-31T05:30:31.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.293+0000 7f90977fe640 1 --2- 172.21.15.67:0/1509859092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9098103170 0x7f9098197c80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f908c00d6d0 tx=0x7f908c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:31.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.293+0000 7f90957fa640 1 -- 172.21.15.67:0/1509859092 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f908c017070 con 0x7f9098103170 2024-08-31T05:30:31.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.293+0000 7f90957fa640 1 -- 172.21.15.67:0/1509859092 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f908c0054e0 con 0x7f9098103170 2024-08-31T05:30:31.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.293+0000 7f90957fa640 1 -- 172.21.15.67:0/1509859092 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f908c004ae0 con 0x7f9098103170 2024-08-31T05:30:31.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.294+0000 7f909e9ac640 1 -- 172.21.15.67:0/1509859092 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909819c300 con 0x7f9098103170 2024-08-31T05:30:31.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.294+0000 7f909e9ac640 1 -- 172.21.15.67:0/1509859092 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f909819c890 con 0x7f9098103170 2024-08-31T05:30:31.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.295+0000 7f909e9ac640 1 -- 172.21.15.67:0/1509859092 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f909806ab40 con 0x7f9098103170 2024-08-31T05:30:31.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.295+0000 7f90957fa640 1 -- 172.21.15.67:0/1509859092 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f908c004de0 con 0x7f9098103170 2024-08-31T05:30:31.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.296+0000 7f90957fa640 1 --2- 172.21.15.67:0/1509859092 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9080079e00 0x7f908007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:31.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.296+0000 7f90957fa640 1 -- 172.21.15.67:0/1509859092 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f908c09c600 con 0x7f9098103170 2024-08-31T05:30:31.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.296+0000 7f9097fff640 1 --2- 172.21.15.67:0/1509859092 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9080079e00 0x7f908007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:31.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.297+0000 7f9097fff640 1 --2- 172.21.15.67:0/1509859092 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9080079e00 0x7f908007c2c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f90880096c0 tx=0x7f9088031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:31.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.301+0000 7f90957fa640 1 -- 172.21.15.67:0/1509859092 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f908c068140 con 0x7f9098103170 2024-08-31T05:30:31.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.561+0000 7f909e9ac640 1 -- 172.21.15.67:0/1509859092 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f9098198aa0 con 0x7f9098103170 2024-08-31T05:30:31.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.562+0000 7f90957fa640 1 -- 172.21.15.67:0/1509859092 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f908c06cb60 con 0x7f9098103170 2024-08-31T05:30:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-31T05:30:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:30:31.564 INFO:teuthology.orchestra.run.smithi067.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:30:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.564+0000 7f909e9ac640 1 -- 172.21.15.67:0/1509859092 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9080079e00 msgr2=0x7f908007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.564+0000 7f909e9ac640 1 --2- 172.21.15.67:0/1509859092 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9080079e00 0x7f908007c2c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f90880096c0 tx=0x7f9088031400 comp rx=0 tx=0).stop 2024-08-31T05:30:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.564+0000 7f909e9ac640 1 -- 172.21.15.67:0/1509859092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9098103170 msgr2=0x7f9098197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.564+0000 7f909e9ac640 1 --2- 172.21.15.67:0/1509859092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9098103170 0x7f9098197c80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f908c00d6d0 tx=0x7f908c00db90 comp rx=0 tx=0).stop 2024-08-31T05:30:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.564+0000 7f909e9ac640 1 -- 172.21.15.67:0/1509859092 shutdown_connections 2024-08-31T05:30:31.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.564+0000 7f909e9ac640 1 --2- 172.21.15.67:0/1509859092 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9080079e00 0x7f908007c2c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:31.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.564+0000 7f909e9ac640 1 --2- 172.21.15.67:0/1509859092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9098103170 0x7f9098197c80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:31.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.564+0000 7f909e9ac640 1 --2- 172.21.15.67:0/1509859092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9098102850 0x7f9098197740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:31.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.564+0000 7f909e9ac640 1 -- 172.21.15.67:0/1509859092 >> 172.21.15.67:0/1509859092 conn(0x7f90980fc270 msgr2=0x7f9098108c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:31.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.564+0000 7f909e9ac640 1 -- 172.21.15.67:0/1509859092 shutdown_connections 2024-08-31T05:30:31.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:30:31.564+0000 7f909e9ac640 1 -- 172.21.15.67:0/1509859092 wait complete. 2024-08-31T05:30:32.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:31 smithi067 ceph-mon[99941]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:32.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:31 smithi067 ceph-mon[99941]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:32.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:31 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2351383495' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:30:32.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:31 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/1509859092' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:30:32.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:31 smithi073 ceph-mon[71452]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:32.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:31 smithi073 ceph-mon[71452]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:32.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:31 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2351383495' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:30:32.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:31 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/1509859092' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:30:33.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:32 smithi067 ceph-mon[99941]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:33.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:32 smithi067 ceph-mon[99941]: pgmap v305: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1 op/s 2024-08-31T05:30:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:32 smithi073 ceph-mon[71452]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:32 smithi073 ceph-mon[71452]: pgmap v305: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1 op/s 2024-08-31T05:30:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:34 smithi067 ceph-mon[99941]: pgmap v306: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 2 op/s 2024-08-31T05:30:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:30:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:35.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:35.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:35.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:35.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:35.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:35.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-08-31T05:30:35.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:30:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:34 smithi073 ceph-mon[71452]: pgmap v306: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 2 op/s 2024-08-31T05:30:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:30:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:35.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:35.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:35.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-08-31T05:30:35.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:30:36.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: Upgrade: Setting filesystem cephfs Joinable 2024-08-31T05:30:36.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-08-31T05:30:36.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:30:36.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:36.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi067"} : dispatch 2024-08-31T05:30:36.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi067"}]': finished 2024-08-31T05:30:36.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi073"} : dispatch 2024-08-31T05:30:36.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi073"}]': finished 2024-08-31T05:30:36.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:36.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:36.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:36.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-08-31T05:30:36.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-08-31T05:30:36.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-08-31T05:30:36.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-08-31T05:30:36.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-08-31T05:30:36.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-08-31T05:30:36.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-08-31T05:30:36.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-08-31T05:30:36.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-08-31T05:30:36.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-08-31T05:30:36.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-08-31T05:30:36.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-08-31T05:30:36.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-08-31T05:30:36.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-08-31T05:30:36.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-08-31T05:30:36.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-08-31T05:30:36.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-08-31T05:30:36.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-08-31T05:30:36.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-08-31T05:30:36.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-08-31T05:30:36.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-08-31T05:30:36.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-08-31T05:30:36.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-08-31T05:30:36.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:36.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:36.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:30:36.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:36.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:36.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:36.081 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:30:36.081 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:36.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: Upgrade: Setting filesystem cephfs Joinable 2024-08-31T05:30:36.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-08-31T05:30:36.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: fsmap cephfs:1 {0=cephfs.smithi067.tskvpt=up:active} 1 up:standby-replay 2 up:standby 2024-08-31T05:30:36.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:36.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi067"} : dispatch 2024-08-31T05:30:36.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi067"}]': finished 2024-08-31T05:30:36.197 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi073"} : dispatch 2024-08-31T05:30:36.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi073"}]': finished 2024-08-31T05:30:36.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:36.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:36.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:36.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:30:36.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-08-31T05:30:36.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-08-31T05:30:36.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-08-31T05:30:36.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-08-31T05:30:36.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-08-31T05:30:36.199 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-08-31T05:30:36.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-08-31T05:30:36.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-08-31T05:30:36.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-08-31T05:30:36.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-08-31T05:30:36.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-08-31T05:30:36.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-08-31T05:30:36.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-08-31T05:30:36.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-08-31T05:30:36.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-08-31T05:30:36.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-08-31T05:30:36.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-08-31T05:30:36.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-08-31T05:30:36.200 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-08-31T05:30:36.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-08-31T05:30:36.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-08-31T05:30:36.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-08-31T05:30:36.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-08-31T05:30:36.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-08-31T05:30:36.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:36.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:36.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:30:36.201 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:36.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:36.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:36.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:30:36.202 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:37.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:36 smithi067 ceph-mon[99941]: Upgrade: Setting container_image for all ceph-exporter 2024-08-31T05:30:37.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:36 smithi067 ceph-mon[99941]: Upgrade: Setting container_image for all iscsi 2024-08-31T05:30:37.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:36 smithi067 ceph-mon[99941]: Upgrade: Setting container_image for all nfs 2024-08-31T05:30:37.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:36 smithi067 ceph-mon[99941]: Upgrade: Setting container_image for all nvmeof 2024-08-31T05:30:37.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:36 smithi067 ceph-mon[99941]: Upgrade: Finalizing container_image settings 2024-08-31T05:30:37.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:36 smithi067 ceph-mon[99941]: Upgrade: Complete! 2024-08-31T05:30:37.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:36 smithi067 ceph-mon[99941]: pgmap v307: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:36 smithi073 ceph-mon[71452]: Upgrade: Setting container_image for all ceph-exporter 2024-08-31T05:30:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:36 smithi073 ceph-mon[71452]: Upgrade: Setting container_image for all iscsi 2024-08-31T05:30:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:36 smithi073 ceph-mon[71452]: Upgrade: Setting container_image for all nfs 2024-08-31T05:30:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:36 smithi073 ceph-mon[71452]: Upgrade: Setting container_image for all nvmeof 2024-08-31T05:30:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:36 smithi073 ceph-mon[71452]: Upgrade: Finalizing container_image settings 2024-08-31T05:30:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:36 smithi073 ceph-mon[71452]: Upgrade: Complete! 2024-08-31T05:30:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:36 smithi073 ceph-mon[71452]: pgmap v307: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:38.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:38 smithi067 ceph-mon[99941]: pgmap v308: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:39.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:38 smithi073 ceph-mon[71452]: pgmap v308: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:41.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:40 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:41.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:40 smithi067 ceph-mon[99941]: pgmap v309: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:30:41.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:40 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:30:41.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:40 smithi073 ceph-mon[71452]: pgmap v309: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:30:43.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:42 smithi067 ceph-mon[99941]: pgmap v310: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:43.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:42 smithi073 ceph-mon[71452]: pgmap v310: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:45.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:44 smithi067 ceph-mon[99941]: pgmap v311: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:30:45.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:44 smithi073 ceph-mon[71452]: pgmap v311: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:30:46.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:46 smithi073 ceph-mon[71452]: pgmap v312: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:47.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:46 smithi067 ceph-mon[99941]: pgmap v312: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:49.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:48 smithi067 ceph-mon[99941]: pgmap v313: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:49.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:48 smithi073 ceph-mon[71452]: pgmap v313: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:30:50.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:30:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:50 smithi067 ceph-mon[99941]: pgmap v314: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:30:51.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:50 smithi073 ceph-mon[71452]: pgmap v314: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:30:52.107 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:51 smithi067 ceph-mon[99941]: pgmap v315: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:52.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:51 smithi073 ceph-mon[71452]: pgmap v315: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:54 smithi067 ceph-mon[99941]: pgmap v316: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:30:55.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:54 smithi073 ceph-mon[71452]: pgmap v316: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:30:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:56 smithi067 ceph-mon[99941]: pgmap v317: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:57.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:56 smithi073 ceph-mon[71452]: pgmap v317: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:59.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:30:58 smithi067 ceph-mon[99941]: pgmap v318: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:30:59.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:30:58 smithi073 ceph-mon[71452]: pgmap v318: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:00 smithi067 ceph-mon[99941]: pgmap v319: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:01.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:00 smithi073 ceph-mon[71452]: pgmap v319: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:01.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.661+0000 7fb29e91f640 1 -- 172.21.15.67:0/3622693335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb298100d50 msgr2=0x7fb2981011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:01.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.661+0000 7fb29e91f640 1 --2- 172.21.15.67:0/3622693335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb298100d50 0x7fb2981011b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009880 tx=0x7fb28c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:31:01.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.661+0000 7fb29e91f640 1 -- 172.21.15.67:0/3622693335 shutdown_connections 2024-08-31T05:31:01.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.661+0000 7fb29e91f640 1 --2- 172.21.15.67:0/3622693335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb298100d50 0x7fb2981011b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:01.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.661+0000 7fb29e91f640 1 --2- 172.21.15.67:0/3622693335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb298106830 0x7fb298106c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:01.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.661+0000 7fb29e91f640 1 -- 172.21.15.67:0/3622693335 >> 172.21.15.67:0/3622693335 conn(0x7fb2980fba30 msgr2=0x7fb2980fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.661+0000 7fb29e91f640 1 -- 172.21.15.67:0/3622693335 shutdown_connections 2024-08-31T05:31:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.661+0000 7fb29e91f640 1 -- 172.21.15.67:0/3622693335 wait complete. 2024-08-31T05:31:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.661+0000 7fb29e91f640 1 Processor -- start 2024-08-31T05:31:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.662+0000 7fb29e91f640 1 -- start start 2024-08-31T05:31:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.662+0000 7fb29e91f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb298100d50 0x7fb29819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.662+0000 7fb29e91f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb298106830 0x7fb29819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.662+0000 7fb29e91f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb29810dd00 con 0x7fb298106830 2024-08-31T05:31:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.662+0000 7fb29e91f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb29810db80 con 0x7fb298100d50 2024-08-31T05:31:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.662+0000 7fb2977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb298106830 0x7fb29819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.662+0000 7fb2977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb298106830 0x7fb29819fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35516/0 (socket says 172.21.15.67:35516) 2024-08-31T05:31:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.662+0000 7fb2977fe640 1 -- 172.21.15.67:0/470274176 learned_addr learned my addr 172.21.15.67:0/470274176 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:31:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.662+0000 7fb297fff640 1 --2- 172.21.15.67:0/470274176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb298100d50 0x7fb29819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.663+0000 7fb2977fe640 1 -- 172.21.15.67:0/470274176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb298100d50 msgr2=0x7fb29819f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.663+0000 7fb2977fe640 1 --2- 172.21.15.67:0/470274176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb298100d50 0x7fb29819f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:01.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.663+0000 7fb2977fe640 1 -- 172.21.15.67:0/470274176 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb298199a50 con 0x7fb298106830 2024-08-31T05:31:01.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.663+0000 7fb297fff640 1 --2- 172.21.15.67:0/470274176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb298100d50 0x7fb29819f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:31:01.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.663+0000 7fb2977fe640 1 --2- 172.21.15.67:0/470274176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb298106830 0x7fb29819fdd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb28c031460 tx=0x7fb28c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:01.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.663+0000 7fb2957fa640 1 -- 172.21.15.67:0/470274176 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb28c03f070 con 0x7fb298106830 2024-08-31T05:31:01.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.663+0000 7fb29e91f640 1 -- 172.21.15.67:0/470274176 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb298199ce0 con 0x7fb298106830 2024-08-31T05:31:01.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.663+0000 7fb2957fa640 1 -- 172.21.15.67:0/470274176 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb28c0035f0 con 0x7fb298106830 2024-08-31T05:31:01.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.663+0000 7fb2957fa640 1 -- 172.21.15.67:0/470274176 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb28c035030 con 0x7fb298106830 2024-08-31T05:31:01.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.663+0000 7fb29e91f640 1 -- 172.21.15.67:0/470274176 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb29819a210 con 0x7fb298106830 2024-08-31T05:31:01.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.664+0000 7fb29e91f640 1 -- 172.21.15.67:0/470274176 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb298101f70 con 0x7fb298106830 2024-08-31T05:31:01.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.665+0000 7fb2957fa640 1 -- 172.21.15.67:0/470274176 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fb28c042070 con 0x7fb298106830 2024-08-31T05:31:01.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.665+0000 7fb2957fa640 1 --2- 172.21.15.67:0/470274176 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb280079e00 0x7fb28007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:01.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.665+0000 7fb2957fa640 1 -- 172.21.15.67:0/470274176 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7fb28c0bd410 con 0x7fb298106830 2024-08-31T05:31:01.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.665+0000 7fb297fff640 1 --2- 172.21.15.67:0/470274176 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb280079e00 0x7fb28007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:01.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.666+0000 7fb297fff640 1 --2- 172.21.15.67:0/470274176 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb280079e00 0x7fb28007c2c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb288005fd0 tx=0x7fb288005850 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:01.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.670+0000 7fb2957fa640 1 -- 172.21.15.67:0/470274176 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb28c084de0 con 0x7fb298106830 2024-08-31T05:31:01.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.877+0000 7fb29e91f640 1 -- 172.21.15.67:0/470274176 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb298069da0 con 0x7fb280079e00 2024-08-31T05:31:01.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.878+0000 7fb2957fa640 1 -- 172.21.15.67:0/470274176 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7fb298069da0 con 0x7fb280079e00 2024-08-31T05:31:01.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.881+0000 7fb29e91f640 1 -- 172.21.15.67:0/470274176 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb280079e00 msgr2=0x7fb28007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:01.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.881+0000 7fb29e91f640 1 --2- 172.21.15.67:0/470274176 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb280079e00 0x7fb28007c2c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb288005fd0 tx=0x7fb288005850 comp rx=0 tx=0).stop 2024-08-31T05:31:01.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.881+0000 7fb29e91f640 1 -- 172.21.15.67:0/470274176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb298106830 msgr2=0x7fb29819fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:01.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.881+0000 7fb29e91f640 1 --2- 172.21.15.67:0/470274176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb298106830 0x7fb29819fdd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb28c031460 tx=0x7fb28c0045e0 comp rx=0 tx=0).stop 2024-08-31T05:31:01.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.881+0000 7fb29e91f640 1 -- 172.21.15.67:0/470274176 shutdown_connections 2024-08-31T05:31:01.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.881+0000 7fb29e91f640 1 --2- 172.21.15.67:0/470274176 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb280079e00 0x7fb28007c2c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:01.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.881+0000 7fb29e91f640 1 --2- 172.21.15.67:0/470274176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb298106830 0x7fb29819fdd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:01.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.881+0000 7fb29e91f640 1 --2- 172.21.15.67:0/470274176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb298100d50 0x7fb29819f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:01.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.881+0000 7fb29e91f640 1 -- 172.21.15.67:0/470274176 >> 172.21.15.67:0/470274176 conn(0x7fb2980fba30 msgr2=0x7fb2980fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:01.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.881+0000 7fb29e91f640 1 -- 172.21.15.67:0/470274176 shutdown_connections 2024-08-31T05:31:01.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:01.881+0000 7fb29e91f640 1 -- 172.21.15.67:0/470274176 wait complete. 2024-08-31T05:31:02.670 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph orch ps' 2024-08-31T05:31:02.969 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:31:03.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:02 smithi067 ceph-mon[99941]: pgmap v320: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:03.117 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:02 smithi073 ceph-mon[71452]: pgmap v320: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:03.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.486+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/3397773581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a581005c0 msgr2=0x7f4a58100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:03.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.486+0000 7f4a5e2ef640 1 --2- 172.21.15.67:0/3397773581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a581005c0 0x7f4a58100a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009880 tx=0x7f4a4c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:31:03.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.486+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/3397773581 shutdown_connections 2024-08-31T05:31:03.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.486+0000 7f4a5e2ef640 1 --2- 172.21.15.67:0/3397773581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a581005c0 0x7f4a58100a20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:03.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.486+0000 7f4a5e2ef640 1 --2- 172.21.15.67:0/3397773581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a58106670 0x7f4a58106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:03.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.486+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/3397773581 >> 172.21.15.67:0/3397773581 conn(0x7f4a580fc2c0 msgr2=0x7f4a580fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:03.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.486+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/3397773581 shutdown_connections 2024-08-31T05:31:03.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.486+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/3397773581 wait complete. 2024-08-31T05:31:03.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.487+0000 7f4a5e2ef640 1 Processor -- start 2024-08-31T05:31:03.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.487+0000 7f4a5e2ef640 1 -- start start 2024-08-31T05:31:03.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.487+0000 7f4a5e2ef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a581005c0 0x7f4a581976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:03.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.487+0000 7f4a5e2ef640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a58106670 0x7f4a58197c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:03.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.487+0000 7f4a5e2ef640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5810da80 con 0x7f4a58106670 2024-08-31T05:31:03.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.487+0000 7f4a5e2ef640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5810d900 con 0x7f4a581005c0 2024-08-31T05:31:03.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.487+0000 7f4a577fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a58106670 0x7f4a58197c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:03.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.487+0000 7f4a57fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a581005c0 0x7f4a581976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:03.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.488+0000 7f4a57fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a581005c0 0x7f4a581976c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.67:42554/0 (socket says 172.21.15.67:42554) 2024-08-31T05:31:03.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.488+0000 7f4a57fff640 1 -- 172.21.15.67:0/1080445579 learned_addr learned my addr 172.21.15.67:0/1080445579 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:31:03.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.488+0000 7f4a577fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a58106670 0x7f4a58197c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35538/0 (socket says 172.21.15.67:35538) 2024-08-31T05:31:03.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.488+0000 7f4a57fff640 1 -- 172.21.15.67:0/1080445579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a58106670 msgr2=0x7f4a58197c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:03.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.488+0000 7f4a57fff640 1 --2- 172.21.15.67:0/1080445579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a58106670 0x7f4a58197c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:03.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.488+0000 7f4a57fff640 1 -- 172.21.15.67:0/1080445579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5819bf90 con 0x7f4a581005c0 2024-08-31T05:31:03.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.488+0000 7f4a57fff640 1 --2- 172.21.15.67:0/1080445579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a581005c0 0x7f4a581976c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800e970 tx=0x7f4a4800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:03.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.488+0000 7f4a557fa640 1 -- 172.21.15.67:0/1080445579 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a4800cac0 con 0x7f4a581005c0 2024-08-31T05:31:03.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.488+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/1080445579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5819c280 con 0x7f4a581005c0 2024-08-31T05:31:03.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.488+0000 7f4a557fa640 1 -- 172.21.15.67:0/1080445579 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4a480054e0 con 0x7f4a581005c0 2024-08-31T05:31:03.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.488+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/1080445579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a5819c810 con 0x7f4a581005c0 2024-08-31T05:31:03.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.488+0000 7f4a557fa640 1 -- 172.21.15.67:0/1080445579 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a48004cd0 con 0x7f4a581005c0 2024-08-31T05:31:03.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.489+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/1080445579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a58101ce0 con 0x7f4a581005c0 2024-08-31T05:31:03.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.490+0000 7f4a557fa640 1 -- 172.21.15.67:0/1080445579 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f4a48004e70 con 0x7f4a581005c0 2024-08-31T05:31:03.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.490+0000 7f4a557fa640 1 --2- 172.21.15.67:0/1080445579 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4a40079e00 0x7f4a4007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:03.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.491+0000 7f4a557fa640 1 -- 172.21.15.67:0/1080445579 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f4a4809d120 con 0x7f4a581005c0 2024-08-31T05:31:03.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.491+0000 7f4a577fe640 1 --2- 172.21.15.67:0/1080445579 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4a40079e00 0x7f4a4007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:03.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.491+0000 7f4a577fe640 1 --2- 172.21.15.67:0/1080445579 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4a40079e00 0x7f4a4007c2c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4a580fe770 tx=0x7f4a4c004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:03.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.495+0000 7f4a557fa640 1 -- 172.21.15.67:0/1080445579 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4a48064b90 con 0x7f4a581005c0 2024-08-31T05:31:03.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.696+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/1080445579 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4a5819cb20 con 0x7f4a40079e00 2024-08-31T05:31:03.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.706+0000 7f4a557fa640 1 -- 172.21.15.67:0/1080445579 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f4a5819cb20 con 0x7f4a40079e00 2024-08-31T05:31:03.709 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:31:03.709 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (7m) 33s ago 17m 21.4M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:31:03.709 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (47s) 33s ago 18m 75.3M - 19.3.0-4560-gd19e6118 79f4cde5e369 fccbf3efb30b 2024-08-31T05:31:03.709 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (42s) 40s ago 17m 74.4M - 19.3.0-4560-gd19e6118 79f4cde5e369 5533dcfe7e99 2024-08-31T05:31:03.709 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (5m) 33s ago 18m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 910f4f105c4b 2024-08-31T05:31:03.709 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (5m) 40s ago 17m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 0dcc86f98a20 2024-08-31T05:31:03.709 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (6m) 33s ago 17m 80.9M - c8b91775d855 3a9a0f88928d 2024-08-31T05:31:03.709 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (96s) 33s ago 12m 234M - 19.3.0-4560-gd19e6118 79f4cde5e369 e70ebd5a7787 2024-08-31T05:31:03.709 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (112s) 33s ago 12m 154M - 19.3.0-4560-gd19e6118 79f4cde5e369 b01bdece784a 2024-08-31T05:31:03.709 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (81s) 40s ago 12m 83.6M - 19.3.0-4560-gd19e6118 79f4cde5e369 961d09a035db 2024-08-31T05:31:03.709 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (61s) 40s ago 12m 83.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 e539a6598628 2024-08-31T05:31:03.709 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (9m) 33s ago 19m 597M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:31:03.710 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (8m) 40s ago 17m 526M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:31:03.710 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (5m) 33s ago 19m 121M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 25a28efbbd37 2024-08-31T05:31:03.710 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (5m) 40s ago 16m 108M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 6be0f0999860 2024-08-31T05:31:03.710 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (7m) 33s ago 17m 10.9M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:31:03.710 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (7m) 40s ago 17m 10.1M - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:31:03.710 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (4m) 33s ago 15m 196M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 aab0516dcbfa 2024-08-31T05:31:03.710 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (4m) 33s ago 15m 167M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 fa9e3fb20c5e 2024-08-31T05:31:03.710 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (3m) 33s ago 14m 159M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 a62abe735da2 2024-08-31T05:31:03.710 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (3m) 40s ago 14m 168M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 9f4ce308ec1d 2024-08-31T05:31:03.710 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (2m) 40s ago 14m 155M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 5f02556c012d 2024-08-31T05:31:03.710 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (2m) 40s ago 13m 166M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 530ae5c5d1ac 2024-08-31T05:31:03.710 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (7m) 33s ago 17m 55.9M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:31:03.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.708+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/1080445579 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4a40079e00 msgr2=0x7f4a4007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:03.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.708+0000 7f4a5e2ef640 1 --2- 172.21.15.67:0/1080445579 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4a40079e00 0x7f4a4007c2c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4a580fe770 tx=0x7f4a4c004f30 comp rx=0 tx=0).stop 2024-08-31T05:31:03.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.708+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/1080445579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a581005c0 msgr2=0x7f4a581976c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:03.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.708+0000 7f4a5e2ef640 1 --2- 172.21.15.67:0/1080445579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a581005c0 0x7f4a581976c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800e970 tx=0x7f4a4800ed70 comp rx=0 tx=0).stop 2024-08-31T05:31:03.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.708+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/1080445579 shutdown_connections 2024-08-31T05:31:03.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.708+0000 7f4a5e2ef640 1 --2- 172.21.15.67:0/1080445579 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4a40079e00 0x7f4a4007c2c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:03.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.708+0000 7f4a5e2ef640 1 --2- 172.21.15.67:0/1080445579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a58106670 0x7f4a58197c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:03.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.708+0000 7f4a5e2ef640 1 --2- 172.21.15.67:0/1080445579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a581005c0 0x7f4a581976c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:03.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.708+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/1080445579 >> 172.21.15.67:0/1080445579 conn(0x7f4a580fc2c0 msgr2=0x7f4a5806a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:03.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.708+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/1080445579 shutdown_connections 2024-08-31T05:31:03.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:03.708+0000 7f4a5e2ef640 1 -- 172.21.15.67:0/1080445579 wait complete. 2024-08-31T05:31:03.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:03 smithi073 ceph-mon[71452]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:04.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:03 smithi067 ceph-mon[99941]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:04.572 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph orch upgrade status' 2024-08-31T05:31:04.846 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:31:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:04 smithi067 ceph-mon[99941]: from='client.44373 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:04 smithi067 ceph-mon[99941]: pgmap v321: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:31:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:04 smithi073 ceph-mon[71452]: from='client.44373 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:04 smithi073 ceph-mon[71452]: pgmap v321: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:31:05.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.262+0000 7f0999192640 1 -- 172.21.15.67:0/2970117290 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09941076a0 msgr2=0x7f0994107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:05.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.262+0000 7f0999192640 1 --2- 172.21.15.67:0/2970117290 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09941076a0 0x7f0994107a80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f097c009880 tx=0x7f097c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:31:05.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.262+0000 7f0999192640 1 -- 172.21.15.67:0/2970117290 shutdown_connections 2024-08-31T05:31:05.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.262+0000 7f0999192640 1 --2- 172.21.15.67:0/2970117290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09941016a0 0x7f0994101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:05.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.262+0000 7f0999192640 1 --2- 172.21.15.67:0/2970117290 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09941076a0 0x7f0994107a80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:05.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.262+0000 7f0999192640 1 -- 172.21.15.67:0/2970117290 >> 172.21.15.67:0/2970117290 conn(0x7f09940fd380 msgr2=0x7f09940ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:05.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.262+0000 7f0999192640 1 -- 172.21.15.67:0/2970117290 shutdown_connections 2024-08-31T05:31:05.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.262+0000 7f0999192640 1 -- 172.21.15.67:0/2970117290 wait complete. 2024-08-31T05:31:05.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.262+0000 7f0999192640 1 Processor -- start 2024-08-31T05:31:05.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.263+0000 7f0999192640 1 -- start start 2024-08-31T05:31:05.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.263+0000 7f0999192640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09941016a0 0x7f0994074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:05.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.263+0000 7f0999192640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09941076a0 0x7f09940747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:05.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.263+0000 7f0999192640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f099410eb70 con 0x7f09941076a0 2024-08-31T05:31:05.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.263+0000 7f0999192640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f099410e9f0 con 0x7f09941016a0 2024-08-31T05:31:05.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.263+0000 7f099259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09941076a0 0x7f09940747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:05.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.263+0000 7f099259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09941076a0 0x7f09940747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35544/0 (socket says 172.21.15.67:35544) 2024-08-31T05:31:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.263+0000 7f099259c640 1 -- 172.21.15.67:0/1193636688 learned_addr learned my addr 172.21.15.67:0/1193636688 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:31:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.263+0000 7f0992d9d640 1 --2- 172.21.15.67:0/1193636688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09941016a0 0x7f0994074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.263+0000 7f099259c640 1 -- 172.21.15.67:0/1193636688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09941016a0 msgr2=0x7f0994074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.263+0000 7f099259c640 1 --2- 172.21.15.67:0/1193636688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09941016a0 0x7f0994074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.263+0000 7f099259c640 1 -- 172.21.15.67:0/1193636688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0994074d10 con 0x7f09941076a0 2024-08-31T05:31:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.263+0000 7f0992d9d640 1 --2- 172.21.15.67:0/1193636688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09941016a0 0x7f0994074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.264+0000 7f099259c640 1 --2- 172.21.15.67:0/1193636688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09941076a0 0x7f09940747d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f098400e970 tx=0x7f098400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.264+0000 7f098bfff640 1 -- 172.21.15.67:0/1193636688 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f098400cac0 con 0x7f09941076a0 2024-08-31T05:31:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.264+0000 7f098bfff640 1 -- 172.21.15.67:0/1193636688 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f09840054e0 con 0x7f09941076a0 2024-08-31T05:31:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.264+0000 7f0999192640 1 -- 172.21.15.67:0/1193636688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0994075000 con 0x7f09941076a0 2024-08-31T05:31:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.264+0000 7f098bfff640 1 -- 172.21.15.67:0/1193636688 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0984010430 con 0x7f09941076a0 2024-08-31T05:31:05.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.264+0000 7f0999192640 1 -- 172.21.15.67:0/1193636688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09941a3be0 con 0x7f09941076a0 2024-08-31T05:31:05.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.265+0000 7f0999192640 1 -- 172.21.15.67:0/1193636688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0994102de0 con 0x7f09941076a0 2024-08-31T05:31:05.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.266+0000 7f098bfff640 1 -- 172.21.15.67:0/1193636688 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f0984004ea0 con 0x7f09941076a0 2024-08-31T05:31:05.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.266+0000 7f098bfff640 1 --2- 172.21.15.67:0/1193636688 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0980079e00 0x7f098007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:05.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.266+0000 7f098bfff640 1 -- 172.21.15.67:0/1193636688 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f098409d0a0 con 0x7f09941076a0 2024-08-31T05:31:05.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.266+0000 7f0992d9d640 1 --2- 172.21.15.67:0/1193636688 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0980079e00 0x7f098007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:05.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.267+0000 7f0992d9d640 1 --2- 172.21.15.67:0/1193636688 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0980079e00 0x7f098007c2c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f097c0096c0 tx=0x7f097c031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:05.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.271+0000 7f098bfff640 1 -- 172.21.15.67:0/1193636688 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0984064a70 con 0x7f09941076a0 2024-08-31T05:31:05.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.473+0000 7f0999192640 1 -- 172.21.15.67:0/1193636688 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f09940623d0 con 0x7f0980079e00 2024-08-31T05:31:05.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.474+0000 7f098bfff640 1 -- 172.21.15.67:0/1193636688 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f09940623d0 con 0x7f0980079e00 2024-08-31T05:31:05.477 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:31:05.477 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": null, 2024-08-31T05:31:05.477 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": false, 2024-08-31T05:31:05.477 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "", 2024-08-31T05:31:05.477 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [], 2024-08-31T05:31:05.477 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": null, 2024-08-31T05:31:05.477 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2024-08-31T05:31:05.477 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2024-08-31T05:31:05.477 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:31:05.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.476+0000 7f0999192640 1 -- 172.21.15.67:0/1193636688 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0980079e00 msgr2=0x7f098007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:05.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.476+0000 7f0999192640 1 --2- 172.21.15.67:0/1193636688 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0980079e00 0x7f098007c2c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f097c0096c0 tx=0x7f097c031400 comp rx=0 tx=0).stop 2024-08-31T05:31:05.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.476+0000 7f0999192640 1 -- 172.21.15.67:0/1193636688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09941076a0 msgr2=0x7f09940747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:05.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.476+0000 7f0999192640 1 --2- 172.21.15.67:0/1193636688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09941076a0 0x7f09940747d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f098400e970 tx=0x7f098400ed70 comp rx=0 tx=0).stop 2024-08-31T05:31:05.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.476+0000 7f0999192640 1 -- 172.21.15.67:0/1193636688 shutdown_connections 2024-08-31T05:31:05.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.476+0000 7f0999192640 1 --2- 172.21.15.67:0/1193636688 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0980079e00 0x7f098007c2c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:05.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.476+0000 7f0999192640 1 --2- 172.21.15.67:0/1193636688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09941076a0 0x7f09940747d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:05.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.476+0000 7f0999192640 1 --2- 172.21.15.67:0/1193636688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09941016a0 0x7f0994074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:05.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.476+0000 7f0999192640 1 -- 172.21.15.67:0/1193636688 >> 172.21.15.67:0/1193636688 conn(0x7f09940fd380 msgr2=0x7f09940fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:05.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.477+0000 7f0999192640 1 -- 172.21.15.67:0/1193636688 shutdown_connections 2024-08-31T05:31:05.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:05.477+0000 7f0999192640 1 -- 172.21.15.67:0/1193636688 wait complete. 2024-08-31T05:31:06.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:05 smithi067 ceph-mon[99941]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:06.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:05 smithi067 ceph-mon[99941]: pgmap v322: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:06.121 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph health detail' 2024-08-31T05:31:06.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:05 smithi073 ceph-mon[71452]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:05 smithi073 ceph-mon[71452]: pgmap v322: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:06.374 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:31:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.817+0000 7fe1f9107640 1 -- 172.21.15.67:0/259885944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f41076a0 msgr2=0x7fe1f4107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.817+0000 7fe1f9107640 1 --2- 172.21.15.67:0/259885944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f41076a0 0x7fe1f4107a80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009880 tx=0x7fe1e402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:31:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.817+0000 7fe1f9107640 1 -- 172.21.15.67:0/259885944 shutdown_connections 2024-08-31T05:31:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.817+0000 7fe1f9107640 1 --2- 172.21.15.67:0/259885944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1f41016a0 0x7fe1f4101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.817+0000 7fe1f9107640 1 --2- 172.21.15.67:0/259885944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f41076a0 0x7fe1f4107a80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.817+0000 7fe1f9107640 1 -- 172.21.15.67:0/259885944 >> 172.21.15.67:0/259885944 conn(0x7fe1f40fd3a0 msgr2=0x7fe1f40ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.817+0000 7fe1f9107640 1 -- 172.21.15.67:0/259885944 shutdown_connections 2024-08-31T05:31:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.817+0000 7fe1f9107640 1 -- 172.21.15.67:0/259885944 wait complete. 2024-08-31T05:31:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.818+0000 7fe1f9107640 1 Processor -- start 2024-08-31T05:31:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.818+0000 7fe1f9107640 1 -- start start 2024-08-31T05:31:06.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.818+0000 7fe1f9107640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f41016a0 0x7fe1f419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:06.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.818+0000 7fe1f9107640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1f41076a0 0x7fe1f419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:06.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.818+0000 7fe1f9107640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f410eb50 con 0x7fe1f41016a0 2024-08-31T05:31:06.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.818+0000 7fe1f9107640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f410e9d0 con 0x7fe1f41076a0 2024-08-31T05:31:06.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.818+0000 7fe1f2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f41016a0 0x7fe1f419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:06.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.818+0000 7fe1f2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f41016a0 0x7fe1f419f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35566/0 (socket says 172.21.15.67:35566) 2024-08-31T05:31:06.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.818+0000 7fe1f2d9d640 1 -- 172.21.15.67:0/1346925749 learned_addr learned my addr 172.21.15.67:0/1346925749 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:31:06.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.819+0000 7fe1f259c640 1 --2- 172.21.15.67:0/1346925749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1f41076a0 0x7fe1f419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:06.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.819+0000 7fe1f2d9d640 1 -- 172.21.15.67:0/1346925749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1f41076a0 msgr2=0x7fe1f419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:06.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.819+0000 7fe1f2d9d640 1 --2- 172.21.15.67:0/1346925749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1f41076a0 0x7fe1f419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:06.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.819+0000 7fe1f2d9d640 1 -- 172.21.15.67:0/1346925749 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f41997f0 con 0x7fe1f41016a0 2024-08-31T05:31:06.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.819+0000 7fe1f2d9d640 1 --2- 172.21.15.67:0/1346925749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f41016a0 0x7fe1f419f670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4031460 tx=0x7fe1e40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:06.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.819+0000 7fe1dbfff640 1 -- 172.21.15.67:0/1346925749 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1e403f070 con 0x7fe1f41016a0 2024-08-31T05:31:06.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.819+0000 7fe1dbfff640 1 -- 172.21.15.67:0/1346925749 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1e4004cf0 con 0x7fe1f41016a0 2024-08-31T05:31:06.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.819+0000 7fe1f9107640 1 -- 172.21.15.67:0/1346925749 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f4199a80 con 0x7fe1f41016a0 2024-08-31T05:31:06.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.819+0000 7fe1dbfff640 1 -- 172.21.15.67:0/1346925749 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1e4035030 con 0x7fe1f41016a0 2024-08-31T05:31:06.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.819+0000 7fe1f9107640 1 -- 172.21.15.67:0/1346925749 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f4199fb0 con 0x7fe1f41016a0 2024-08-31T05:31:06.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.820+0000 7fe1f9107640 1 -- 172.21.15.67:0/1346925749 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f4102de0 con 0x7fe1f41016a0 2024-08-31T05:31:06.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.821+0000 7fe1dbfff640 1 -- 172.21.15.67:0/1346925749 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fe1e4042070 con 0x7fe1f41016a0 2024-08-31T05:31:06.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.822+0000 7fe1dbfff640 1 --2- 172.21.15.67:0/1346925749 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe1dc079e00 0x7fe1dc07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:06.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.822+0000 7fe1f259c640 1 --2- 172.21.15.67:0/1346925749 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe1dc079e00 0x7fe1dc07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:06.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.822+0000 7fe1dbfff640 1 -- 172.21.15.67:0/1346925749 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7fe1e40bd410 con 0x7fe1f41016a0 2024-08-31T05:31:06.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.822+0000 7fe1f259c640 1 --2- 172.21.15.67:0/1346925749 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe1dc079e00 0x7fe1dc07c2c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe1f41009a0 tx=0x7fe1e800a2d0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:06.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:06.826+0000 7fe1dbfff640 1 -- 172.21.15.67:0/1346925749 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe1e4084de0 con 0x7fe1f41016a0 2024-08-31T05:31:07.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:07.084+0000 7fe1f9107640 1 -- 172.21.15.67:0/1346925749 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe1f419ad20 con 0x7fe1f41016a0 2024-08-31T05:31:07.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:07.084+0000 7fe1dbfff640 1 -- 172.21.15.67:0/1346925749 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fe1e4088f50 con 0x7fe1f41016a0 2024-08-31T05:31:07.087 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-31T05:31:07.087 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-31T05:31:07.087 INFO:teuthology.orchestra.run.smithi067.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-31T05:31:07.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:07.086+0000 7fe1f9107640 1 -- 172.21.15.67:0/1346925749 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe1dc079e00 msgr2=0x7fe1dc07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:07.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:07.086+0000 7fe1f9107640 1 --2- 172.21.15.67:0/1346925749 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe1dc079e00 0x7fe1dc07c2c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe1f41009a0 tx=0x7fe1e800a2d0 comp rx=0 tx=0).stop 2024-08-31T05:31:07.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:07.086+0000 7fe1f9107640 1 -- 172.21.15.67:0/1346925749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f41016a0 msgr2=0x7fe1f419f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:07.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:07.086+0000 7fe1f9107640 1 --2- 172.21.15.67:0/1346925749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f41016a0 0x7fe1f419f670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4031460 tx=0x7fe1e40048f0 comp rx=0 tx=0).stop 2024-08-31T05:31:07.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:07.086+0000 7fe1f9107640 1 -- 172.21.15.67:0/1346925749 shutdown_connections 2024-08-31T05:31:07.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:07.086+0000 7fe1f9107640 1 --2- 172.21.15.67:0/1346925749 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe1dc079e00 0x7fe1dc07c2c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:07.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:07.086+0000 7fe1f9107640 1 --2- 172.21.15.67:0/1346925749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1f41076a0 0x7fe1f419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:07.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:07.086+0000 7fe1f9107640 1 --2- 172.21.15.67:0/1346925749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f41016a0 0x7fe1f419f670 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:07.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:07.086+0000 7fe1f9107640 1 -- 172.21.15.67:0/1346925749 >> 172.21.15.67:0/1346925749 conn(0x7fe1f40fd3a0 msgr2=0x7fe1f40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:07.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:07.087+0000 7fe1f9107640 1 -- 172.21.15.67:0/1346925749 shutdown_connections 2024-08-31T05:31:07.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:07.087+0000 7fe1f9107640 1 -- 172.21.15.67:0/1346925749 wait complete. 2024-08-31T05:31:07.408 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:07 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/1346925749' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:31:07.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:07 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/1346925749' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-08-31T05:31:07.769 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph versions' 2024-08-31T05:31:08.021 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:31:08.422 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:08 smithi067 ceph-mon[99941]: pgmap v323: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:08.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:08 smithi073 ceph-mon[71452]: pgmap v323: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:08.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.499+0000 7f264261e640 1 -- 172.21.15.67:0/1293201737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f263c103180 msgr2=0x7f263c10b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:08.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.499+0000 7f264261e640 1 --2- 172.21.15.67:0/1293201737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f263c103180 0x7f263c10b670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2630009880 tx=0x7f263002a530 comp rx=0 tx=0).stop 2024-08-31T05:31:08.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.499+0000 7f264261e640 1 -- 172.21.15.67:0/1293201737 shutdown_connections 2024-08-31T05:31:08.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.499+0000 7f264261e640 1 --2- 172.21.15.67:0/1293201737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f263c103180 0x7f263c10b670 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:08.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.499+0000 7f264261e640 1 --2- 172.21.15.67:0/1293201737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c102860 0x7f263c102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.499+0000 7f264261e640 1 -- 172.21.15.67:0/1293201737 >> 172.21.15.67:0/1293201737 conn(0x7f263c0fc2c0 msgr2=0x7f263c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.499+0000 7f264261e640 1 -- 172.21.15.67:0/1293201737 shutdown_connections 2024-08-31T05:31:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.499+0000 7f264261e640 1 -- 172.21.15.67:0/1293201737 wait complete. 2024-08-31T05:31:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.500+0000 7f264261e640 1 Processor -- start 2024-08-31T05:31:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.500+0000 7f264261e640 1 -- start start 2024-08-31T05:31:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.500+0000 7f264261e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c102860 0x7f263c1004c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.500+0000 7f264261e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f263c103180 0x7f263c100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.500+0000 7f264261e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f263c10eb70 con 0x7f263c103180 2024-08-31T05:31:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.500+0000 7f264261e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f263c10e9f0 con 0x7f263c102860 2024-08-31T05:31:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.500+0000 7f263b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f263c103180 0x7f263c100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.501+0000 7f263b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f263c103180 0x7f263c100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55984/0 (socket says 172.21.15.67:55984) 2024-08-31T05:31:08.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.501+0000 7f263bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c102860 0x7f263c1004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:08.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.501+0000 7f263b7fe640 1 -- 172.21.15.67:0/3469108851 learned_addr learned my addr 172.21.15.67:0/3469108851 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:31:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.501+0000 7f263b7fe640 1 -- 172.21.15.67:0/3469108851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c102860 msgr2=0x7f263c1004c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.501+0000 7f263b7fe640 1 --2- 172.21.15.67:0/3469108851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c102860 0x7f263c1004c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.501+0000 7f263b7fe640 1 -- 172.21.15.67:0/3469108851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263c100f40 con 0x7f263c103180 2024-08-31T05:31:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.501+0000 7f263b7fe640 1 --2- 172.21.15.67:0/3469108851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f263c103180 0x7f263c100a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2630031460 tx=0x7f2630004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.501+0000 7f26397fa640 1 -- 172.21.15.67:0/3469108851 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f263003f070 con 0x7f263c103180 2024-08-31T05:31:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.501+0000 7f264261e640 1 -- 172.21.15.67:0/3469108851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263c1011d0 con 0x7f263c103180 2024-08-31T05:31:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.501+0000 7f26397fa640 1 -- 172.21.15.67:0/3469108851 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f26300035f0 con 0x7f263c103180 2024-08-31T05:31:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.501+0000 7f26397fa640 1 -- 172.21.15.67:0/3469108851 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2630035030 con 0x7f263c103180 2024-08-31T05:31:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.501+0000 7f264261e640 1 -- 172.21.15.67:0/3469108851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f263c1a3b40 con 0x7f263c103180 2024-08-31T05:31:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.502+0000 7f264261e640 1 -- 172.21.15.67:0/3469108851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f263c06a830 con 0x7f263c103180 2024-08-31T05:31:08.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.503+0000 7f26397fa640 1 -- 172.21.15.67:0/3469108851 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f2630042070 con 0x7f263c103180 2024-08-31T05:31:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.503+0000 7f26397fa640 1 --2- 172.21.15.67:0/3469108851 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2624079e00 0x7f262407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.504+0000 7f26397fa640 1 -- 172.21.15.67:0/3469108851 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f26300bd320 con 0x7f263c103180 2024-08-31T05:31:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.504+0000 7f263bfff640 1 --2- 172.21.15.67:0/3469108851 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2624079e00 0x7f262407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:08.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.504+0000 7f263bfff640 1 --2- 172.21.15.67:0/3469108851 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2624079e00 0x7f262407c2c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f262c005d00 tx=0x7f262c00b410 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:08.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.508+0000 7f26397fa640 1 -- 172.21.15.67:0/3469108851 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2630088e60 con 0x7f263c103180 2024-08-31T05:31:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.768+0000 7f264261e640 1 -- 172.21.15.67:0/3469108851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f263c105d00 con 0x7f263c103180 2024-08-31T05:31:08.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.769+0000 7f26397fa640 1 -- 172.21.15.67:0/3469108851 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f263008d1a0 con 0x7f263c103180 2024-08-31T05:31:08.772 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:31:08.772 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:31:08.772 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:31:08.772 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:31:08.772 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:31:08.772 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:31:08.772 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:31:08.772 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:31:08.772 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 6 2024-08-31T05:31:08.773 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:31:08.773 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:31:08.773 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 4 2024-08-31T05:31:08.773 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:31:08.773 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:31:08.773 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 14 2024-08-31T05:31:08.773 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:31:08.773 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:31:08.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.772+0000 7f264261e640 1 -- 172.21.15.67:0/3469108851 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2624079e00 msgr2=0x7f262407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.772+0000 7f264261e640 1 --2- 172.21.15.67:0/3469108851 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2624079e00 0x7f262407c2c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f262c005d00 tx=0x7f262c00b410 comp rx=0 tx=0).stop 2024-08-31T05:31:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.772+0000 7f264261e640 1 -- 172.21.15.67:0/3469108851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f263c103180 msgr2=0x7f263c100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.772+0000 7f264261e640 1 --2- 172.21.15.67:0/3469108851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f263c103180 0x7f263c100a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2630031460 tx=0x7f2630004530 comp rx=0 tx=0).stop 2024-08-31T05:31:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.772+0000 7f264261e640 1 -- 172.21.15.67:0/3469108851 shutdown_connections 2024-08-31T05:31:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.772+0000 7f264261e640 1 --2- 172.21.15.67:0/3469108851 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2624079e00 0x7f262407c2c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.772+0000 7f264261e640 1 --2- 172.21.15.67:0/3469108851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f263c103180 0x7f263c100a00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.772+0000 7f264261e640 1 --2- 172.21.15.67:0/3469108851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c102860 0x7f263c1004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.772+0000 7f264261e640 1 -- 172.21.15.67:0/3469108851 >> 172.21.15.67:0/3469108851 conn(0x7f263c0fc2c0 msgr2=0x7f263c108cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.772+0000 7f264261e640 1 -- 172.21.15.67:0/3469108851 shutdown_connections 2024-08-31T05:31:08.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:31:08.772+0000 7f264261e640 1 -- 172.21.15.67:0/3469108851 wait complete. 2024-08-31T05:31:09.394 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-08-31T05:31:09.416 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:09 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3469108851' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:31:09.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:09 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3469108851' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:31:09.648 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:31:10.154 INFO:teuthology.orchestra.run.smithi067.stdout:wait for servicemap items w/ changing names to refresh 2024-08-31T05:31:10.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:10 smithi067 ceph-mon[99941]: pgmap v324: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:10.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:10 smithi073 ceph-mon[71452]: pgmap v324: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:10.778 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'sleep 60' 2024-08-31T05:31:11.072 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:31:13.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:12 smithi067 ceph-mon[99941]: pgmap v325: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:13.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:12 smithi073 ceph-mon[71452]: pgmap v325: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:15.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:14 smithi067 ceph-mon[99941]: pgmap v326: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:15.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:14 smithi073 ceph-mon[71452]: pgmap v326: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:17.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:16 smithi067 ceph-mon[99941]: pgmap v327: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:17.149 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:16 smithi073 ceph-mon[71452]: pgmap v327: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:19.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:18 smithi067 ceph-mon[99941]: pgmap v328: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:19.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:18 smithi073 ceph-mon[71452]: pgmap v328: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:20.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:19 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:31:20.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:19 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:31:21.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:20 smithi067 ceph-mon[99941]: pgmap v329: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:21.198 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:20 smithi073 ceph-mon[71452]: pgmap v329: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:22.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:21 smithi067 ceph-mon[99941]: pgmap v330: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:22.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:21 smithi073 ceph-mon[71452]: pgmap v330: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:25.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:24 smithi067 ceph-mon[99941]: pgmap v331: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:25.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:24 smithi073 ceph-mon[71452]: pgmap v331: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:27.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:26 smithi067 ceph-mon[99941]: pgmap v332: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:27.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:26 smithi073 ceph-mon[71452]: pgmap v332: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:29.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:28 smithi067 ceph-mon[99941]: pgmap v333: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:29.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:28 smithi073 ceph-mon[71452]: pgmap v333: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:31.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:30 smithi067 ceph-mon[99941]: pgmap v334: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:31.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:30 smithi073 ceph-mon[71452]: pgmap v334: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:33.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:32 smithi067 ceph-mon[99941]: pgmap v335: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:33.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:32 smithi073 ceph-mon[71452]: pgmap v335: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:34.003 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:33 smithi067 ceph-mon[99941]: pgmap v336: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:34.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:33 smithi073 ceph-mon[71452]: pgmap v336: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:35.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:31:35.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:31:36.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:31:36.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:35 smithi067 ceph-mon[99941]: pgmap v337: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:36.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:35 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:31:36.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:31:36.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:35 smithi073 ceph-mon[71452]: pgmap v337: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:36.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:35 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:31:37.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:36 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:31:37.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:36 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:31:37.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:36 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:31:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:36 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:31:38.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:37 smithi067 ceph-mon[99941]: pgmap v338: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:38.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:37 smithi073 ceph-mon[71452]: pgmap v338: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:41.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:40 smithi067 ceph-mon[99941]: pgmap v339: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:41.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:40 smithi073 ceph-mon[71452]: pgmap v339: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:42.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:42 smithi073 ceph-mon[71452]: pgmap v340: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:43.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:42 smithi067 ceph-mon[99941]: pgmap v340: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:45.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:44 smithi067 ceph-mon[99941]: pgmap v341: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:45.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:44 smithi073 ceph-mon[71452]: pgmap v341: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:47.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:46 smithi067 ceph-mon[99941]: pgmap v342: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:47.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:46 smithi073 ceph-mon[71452]: pgmap v342: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:47.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:47 smithi073 ceph-mon[71452]: pgmap v343: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:48.237 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:47 smithi067 ceph-mon[99941]: pgmap v343: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:49.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:31:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:31:50.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:50 smithi073 ceph-mon[71452]: pgmap v344: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:50 smithi067 ceph-mon[99941]: pgmap v344: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:53.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:52 smithi067 ceph-mon[99941]: pgmap v345: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:53.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:52 smithi073 ceph-mon[71452]: pgmap v345: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:55.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:54 smithi067 ceph-mon[99941]: pgmap v346: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:55.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:54 smithi073 ceph-mon[71452]: pgmap v346: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:31:57.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:56 smithi067 ceph-mon[99941]: pgmap v347: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:57.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:56 smithi073 ceph-mon[71452]: pgmap v347: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:58.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:31:57 smithi073 ceph-mon[71452]: pgmap v348: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:31:58.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:31:57 smithi067 ceph-mon[99941]: pgmap v348: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:01.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:00 smithi067 ceph-mon[99941]: pgmap v349: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:01.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:00 smithi073 ceph-mon[71452]: pgmap v349: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:03.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:02 smithi067 ceph-mon[99941]: pgmap v350: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:03.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:02 smithi073 ceph-mon[71452]: pgmap v350: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:04 smithi067 ceph-mon[99941]: pgmap v351: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:05.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:32:05.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:04 smithi073 ceph-mon[71452]: pgmap v351: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:32:06.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:05 smithi067 ceph-mon[99941]: pgmap v352: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:06.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:05 smithi073 ceph-mon[71452]: pgmap v352: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:09.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:08 smithi067 ceph-mon[99941]: pgmap v353: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:09.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:08 smithi073 ceph-mon[71452]: pgmap v353: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:11.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:10 smithi067 ceph-mon[99941]: pgmap v354: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:11.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:10 smithi073 ceph-mon[71452]: pgmap v354: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:12.203 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph orch ps' 2024-08-31T05:32:12.467 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:12.887 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:12 smithi067 ceph-mon[99941]: pgmap v355: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.885+0000 7f8e89065640 1 -- 172.21.15.67:0/2324361628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e841016a0 msgr2=0x7f8e84101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.885+0000 7f8e89065640 1 --2- 172.21.15.67:0/2324361628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e841016a0 0x7f8e84101b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009880 tx=0x7f8e6c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.885+0000 7f8e89065640 1 -- 172.21.15.67:0/2324361628 shutdown_connections 2024-08-31T05:32:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.885+0000 7f8e89065640 1 --2- 172.21.15.67:0/2324361628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e841016a0 0x7f8e84101b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.885+0000 7f8e89065640 1 --2- 172.21.15.67:0/2324361628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e841076a0 0x7f8e84107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.885+0000 7f8e89065640 1 -- 172.21.15.67:0/2324361628 >> 172.21.15.67:0/2324361628 conn(0x7f8e840fd3a0 msgr2=0x7f8e840ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.885+0000 7f8e89065640 1 -- 172.21.15.67:0/2324361628 shutdown_connections 2024-08-31T05:32:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.885+0000 7f8e89065640 1 -- 172.21.15.67:0/2324361628 wait complete. 2024-08-31T05:32:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.886+0000 7f8e89065640 1 Processor -- start 2024-08-31T05:32:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.886+0000 7f8e89065640 1 -- start start 2024-08-31T05:32:12.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.886+0000 7f8e89065640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e841016a0 0x7f8e8419f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.886+0000 7f8e89065640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e841076a0 0x7f8e8419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.886+0000 7f8e89065640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8410eb70 con 0x7f8e841016a0 2024-08-31T05:32:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.886+0000 7f8e89065640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8410e9f0 con 0x7f8e841076a0 2024-08-31T05:32:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.887+0000 7f8e82d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e841016a0 0x7f8e8419f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.887+0000 7f8e82d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e841016a0 0x7f8e8419f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48502/0 (socket says 172.21.15.67:48502) 2024-08-31T05:32:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.887+0000 7f8e82d9d640 1 -- 172.21.15.67:0/668943994 learned_addr learned my addr 172.21.15.67:0/668943994 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.887+0000 7f8e8259c640 1 --2- 172.21.15.67:0/668943994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e841076a0 0x7f8e8419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.887+0000 7f8e82d9d640 1 -- 172.21.15.67:0/668943994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e841076a0 msgr2=0x7f8e8419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.887+0000 7f8e82d9d640 1 --2- 172.21.15.67:0/668943994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e841076a0 0x7f8e8419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.887+0000 7f8e82d9d640 1 -- 172.21.15.67:0/668943994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e84199790 con 0x7f8e841016a0 2024-08-31T05:32:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.887+0000 7f8e82d9d640 1 --2- 172.21.15.67:0/668943994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e841016a0 0x7f8e8419f610 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400d6f0 tx=0x7f8e7400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.887+0000 7f8e7bfff640 1 -- 172.21.15.67:0/668943994 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e74017070 con 0x7f8e841016a0 2024-08-31T05:32:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.887+0000 7f8e89065640 1 -- 172.21.15.67:0/668943994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e84199a80 con 0x7f8e841016a0 2024-08-31T05:32:12.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.887+0000 7f8e7bfff640 1 -- 172.21.15.67:0/668943994 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e7400de00 con 0x7f8e841016a0 2024-08-31T05:32:12.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.887+0000 7f8e7bfff640 1 -- 172.21.15.67:0/668943994 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e74004bb0 con 0x7f8e841016a0 2024-08-31T05:32:12.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.887+0000 7f8e89065640 1 -- 172.21.15.67:0/668943994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e84199fe0 con 0x7f8e841016a0 2024-08-31T05:32:12.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.889+0000 7f8e89065640 1 -- 172.21.15.67:0/668943994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e84102de0 con 0x7f8e841016a0 2024-08-31T05:32:12.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.889+0000 7f8e7bfff640 1 -- 172.21.15.67:0/668943994 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f8e74004e60 con 0x7f8e841016a0 2024-08-31T05:32:12.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.890+0000 7f8e7bfff640 1 --2- 172.21.15.67:0/668943994 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e70079e00 0x7f8e7007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:12.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.890+0000 7f8e8259c640 1 --2- 172.21.15.67:0/668943994 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e70079e00 0x7f8e7007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:12.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.890+0000 7f8e7bfff640 1 -- 172.21.15.67:0/668943994 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f8e7409c660 con 0x7f8e841016a0 2024-08-31T05:32:12.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.890+0000 7f8e8259c640 1 --2- 172.21.15.67:0/668943994 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e70079e00 0x7f8e7007c2c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8e8419aae0 tx=0x7f8e6c031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:12.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:12.895+0000 7f8e7bfff640 1 -- 172.21.15.67:0/668943994 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8e74064030 con 0x7f8e841016a0 2024-08-31T05:32:13.059 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:12 smithi073 ceph-mon[71452]: pgmap v355: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:13.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:13.087+0000 7f8e89065640 1 -- 172.21.15.67:0/668943994 --> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8e8419a290 con 0x7f8e70079e00 2024-08-31T05:32:13.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:13.097+0000 7f8e7bfff640 1 -- 172.21.15.67:0/668943994 <== mgr.24465 v2:172.21.15.67:6800/539581811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f8e8419a290 con 0x7f8e70079e00 2024-08-31T05:32:13.098 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:32:13.099 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (8m) 103s ago 18m 21.4M - 0.27.0 11f11916f8cd fe7eff3e735a 2024-08-31T05:32:13.099 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi067 smithi067 running (117s) 103s ago 19m 75.3M - 19.3.0-4560-gd19e6118 79f4cde5e369 fccbf3efb30b 2024-08-31T05:32:13.099 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-exporter.smithi073 smithi073 running (112s) 109s ago 18m 74.4M - 19.3.0-4560-gd19e6118 79f4cde5e369 5533dcfe7e99 2024-08-31T05:32:13.099 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (6m) 103s ago 19m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 910f4f105c4b 2024-08-31T05:32:13.099 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi073 smithi073 running (6m) 109s ago 18m 6895k - 19.3.0-4560-gd19e6118 79f4cde5e369 0dcc86f98a20 2024-08-31T05:32:13.099 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (7m) 103s ago 18m 80.9M - c8b91775d855 3a9a0f88928d 2024-08-31T05:32:13.099 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.beqeql smithi067 running (2m) 103s ago 13m 234M - 19.3.0-4560-gd19e6118 79f4cde5e369 e70ebd5a7787 2024-08-31T05:32:13.099 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.tskvpt smithi067 running (3m) 103s ago 13m 154M - 19.3.0-4560-gd19e6118 79f4cde5e369 b01bdece784a 2024-08-31T05:32:13.099 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.gsnhxi smithi073 running (2m) 109s ago 13m 83.6M - 19.3.0-4560-gd19e6118 79f4cde5e369 961d09a035db 2024-08-31T05:32:13.099 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi073.kfbmeo smithi073 running (2m) 109s ago 13m 83.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 e539a6598628 2024-08-31T05:32:13.099 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.hftacj smithi067 *:8443,9283,8765 running (10m) 103s ago 20m 597M - 19.3.0-4560-gd19e6118 79f4cde5e369 91c0924cebd1 2024-08-31T05:32:13.099 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi073.zfoyxd smithi073 *:8443,9283,8765 running (9m) 109s ago 18m 526M - 19.3.0-4560-gd19e6118 79f4cde5e369 696e7fa6cad2 2024-08-31T05:32:13.099 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (7m) 103s ago 20m 121M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 25a28efbbd37 2024-08-31T05:32:13.100 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi073 smithi073 running (6m) 109s ago 18m 108M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 6be0f0999860 2024-08-31T05:32:13.100 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (9m) 103s ago 19m 10.9M - 1.7.0 72c9c2088986 08772d17ef44 2024-08-31T05:32:13.100 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi073 smithi073 *:9100 running (9m) 109s ago 18m 10.1M - 1.7.0 72c9c2088986 89cd7c9ac708 2024-08-31T05:32:13.100 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (6m) 103s ago 17m 196M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 aab0516dcbfa 2024-08-31T05:32:13.100 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (5m) 103s ago 16m 167M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 fa9e3fb20c5e 2024-08-31T05:32:13.100 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (4m) 103s ago 16m 159M 1216M 19.3.0-4560-gd19e6118 79f4cde5e369 a62abe735da2 2024-08-31T05:32:13.100 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi073 running (4m) 109s ago 15m 168M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 9f4ce308ec1d 2024-08-31T05:32:13.100 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi073 running (3m) 109s ago 15m 155M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 5f02556c012d 2024-08-31T05:32:13.100 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi073 running (3m) 109s ago 14m 166M 2240M 19.3.0-4560-gd19e6118 79f4cde5e369 530ae5c5d1ac 2024-08-31T05:32:13.100 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (8m) 103s ago 18m 55.9M - 2.51.0 1d3b7f56885b 24b5119d5d56 2024-08-31T05:32:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:13.099+0000 7f8e89065640 1 -- 172.21.15.67:0/668943994 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e70079e00 msgr2=0x7f8e7007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:13.099+0000 7f8e89065640 1 --2- 172.21.15.67:0/668943994 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e70079e00 0x7f8e7007c2c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8e8419aae0 tx=0x7f8e6c031400 comp rx=0 tx=0).stop 2024-08-31T05:32:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:13.099+0000 7f8e89065640 1 -- 172.21.15.67:0/668943994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e841016a0 msgr2=0x7f8e8419f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:13.099+0000 7f8e89065640 1 --2- 172.21.15.67:0/668943994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e841016a0 0x7f8e8419f610 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400d6f0 tx=0x7f8e7400dbb0 comp rx=0 tx=0).stop 2024-08-31T05:32:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:13.099+0000 7f8e89065640 1 -- 172.21.15.67:0/668943994 shutdown_connections 2024-08-31T05:32:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:13.099+0000 7f8e89065640 1 --2- 172.21.15.67:0/668943994 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e70079e00 0x7f8e7007c2c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:13.099+0000 7f8e89065640 1 --2- 172.21.15.67:0/668943994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e841076a0 0x7f8e8419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:13.099+0000 7f8e89065640 1 --2- 172.21.15.67:0/668943994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e841016a0 0x7f8e8419f610 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:13.099+0000 7f8e89065640 1 -- 172.21.15.67:0/668943994 >> 172.21.15.67:0/668943994 conn(0x7f8e840fd3a0 msgr2=0x7f8e840fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:13.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:13.099+0000 7f8e89065640 1 -- 172.21.15.67:0/668943994 shutdown_connections 2024-08-31T05:32:13.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:13.099+0000 7f8e89065640 1 -- 172.21.15.67:0/668943994 wait complete. 2024-08-31T05:32:13.799 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph versions' 2024-08-31T05:32:14.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:13 smithi067 ceph-mon[99941]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:14.004 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:13 smithi067 ceph-mon[99941]: pgmap v356: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:14.060 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:14.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:13 smithi073 ceph-mon[71452]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:13 smithi073 ceph-mon[71452]: pgmap v356: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:14.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.525+0000 7f952b2f4640 1 -- 172.21.15.67:0/2328193856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9524100da0 msgr2=0x7f952410da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:14.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.525+0000 7f952b2f4640 1 --2- 172.21.15.67:0/2328193856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9524100da0 0x7f952410da60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9514009880 tx=0x7f951402a490 comp rx=0 tx=0).stop 2024-08-31T05:32:14.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.526+0000 7f952b2f4640 1 -- 172.21.15.67:0/2328193856 shutdown_connections 2024-08-31T05:32:14.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.526+0000 7f952b2f4640 1 --2- 172.21.15.67:0/2328193856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9524100da0 0x7f952410da60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:14.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.526+0000 7f952b2f4640 1 --2- 172.21.15.67:0/2328193856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95241003f0 0x7f95241007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.526+0000 7f952b2f4640 1 -- 172.21.15.67:0/2328193856 >> 172.21.15.67:0/2328193856 conn(0x7f95240fc2c0 msgr2=0x7f95240fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.526+0000 7f952b2f4640 1 -- 172.21.15.67:0/2328193856 shutdown_connections 2024-08-31T05:32:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.526+0000 7f952b2f4640 1 -- 172.21.15.67:0/2328193856 wait complete. 2024-08-31T05:32:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.526+0000 7f952b2f4640 1 Processor -- start 2024-08-31T05:32:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.526+0000 7f952b2f4640 1 -- start start 2024-08-31T05:32:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.526+0000 7f952b2f4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95241003f0 0x7f952419f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.526+0000 7f952b2f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524100da0 0x7f952419fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.526+0000 7f952b2f4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9524110d20 con 0x7f95241003f0 2024-08-31T05:32:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.526+0000 7f952b2f4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9524110ba0 con 0x7f9524100da0 2024-08-31T05:32:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.527+0000 7f9529090640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95241003f0 0x7f952419f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.527+0000 7f9529090640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95241003f0 0x7f952419f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48522/0 (socket says 172.21.15.67:48522) 2024-08-31T05:32:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.527+0000 7f9529090640 1 -- 172.21.15.67:0/3770060549 learned_addr learned my addr 172.21.15.67:0/3770060549 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.527+0000 7f952888f640 1 --2- 172.21.15.67:0/3770060549 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524100da0 0x7f952419fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.527+0000 7f9529090640 1 -- 172.21.15.67:0/3770060549 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524100da0 msgr2=0x7f952419fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.527+0000 7f9529090640 1 --2- 172.21.15.67:0/3770060549 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524100da0 0x7f952419fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.527+0000 7f9529090640 1 -- 172.21.15.67:0/3770060549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9524199730 con 0x7f95241003f0 2024-08-31T05:32:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.527+0000 7f952888f640 1 --2- 172.21.15.67:0/3770060549 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524100da0 0x7f952419fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:32:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.527+0000 7f9529090640 1 --2- 172.21.15.67:0/3770060549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95241003f0 0x7f952419f660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f952000c8a0 tx=0x7f952000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.527+0000 7f951a7fc640 1 -- 172.21.15.67:0/3770060549 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95200079b0 con 0x7f95241003f0 2024-08-31T05:32:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.527+0000 7f951a7fc640 1 -- 172.21.15.67:0/3770060549 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9520007b50 con 0x7f95241003f0 2024-08-31T05:32:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.527+0000 7f952b2f4640 1 -- 172.21.15.67:0/3770060549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9524199a20 con 0x7f95241003f0 2024-08-31T05:32:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.527+0000 7f951a7fc640 1 -- 172.21.15.67:0/3770060549 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9520018700 con 0x7f95241003f0 2024-08-31T05:32:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.527+0000 7f952b2f4640 1 -- 172.21.15.67:0/3770060549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9524199fb0 con 0x7f95241003f0 2024-08-31T05:32:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.529+0000 7f952b2f4640 1 -- 172.21.15.67:0/3770060549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952406a830 con 0x7f95241003f0 2024-08-31T05:32:14.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.529+0000 7f951a7fc640 1 -- 172.21.15.67:0/3770060549 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f9520007d00 con 0x7f95241003f0 2024-08-31T05:32:14.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.530+0000 7f951a7fc640 1 --2- 172.21.15.67:0/3770060549 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9510079e00 0x7f951007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:14.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.530+0000 7f951a7fc640 1 -- 172.21.15.67:0/3770060549 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f952009cd30 con 0x7f95241003f0 2024-08-31T05:32:14.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.530+0000 7f952888f640 1 --2- 172.21.15.67:0/3770060549 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9510079e00 0x7f951007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:14.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.530+0000 7f952888f640 1 --2- 172.21.15.67:0/3770060549 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9510079e00 0x7f951007c2c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f952419af80 tx=0x7f9514009560 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:14.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.534+0000 7f951a7fc640 1 -- 172.21.15.67:0/3770060549 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9520014030 con 0x7f95241003f0 2024-08-31T05:32:14.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.793+0000 7f952b2f4640 1 -- 172.21.15.67:0/3770060549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f952410b140 con 0x7f95241003f0 2024-08-31T05:32:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.793+0000 7f951a7fc640 1 -- 172.21.15.67:0/3770060549 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f9520064700 con 0x7f95241003f0 2024-08-31T05:32:14.795 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-08-31T05:32:14.795 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2024-08-31T05:32:14.795 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:32:14.795 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:32:14.796 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2024-08-31T05:32:14.796 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 2 2024-08-31T05:32:14.796 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:32:14.796 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2024-08-31T05:32:14.796 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 6 2024-08-31T05:32:14.796 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:32:14.796 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-08-31T05:32:14.796 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 4 2024-08-31T05:32:14.796 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-08-31T05:32:14.796 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2024-08-31T05:32:14.796 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)": 14 2024-08-31T05:32:14.796 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-08-31T05:32:14.796 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-08-31T05:32:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.796+0000 7f952b2f4640 1 -- 172.21.15.67:0/3770060549 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9510079e00 msgr2=0x7f951007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.796+0000 7f952b2f4640 1 --2- 172.21.15.67:0/3770060549 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9510079e00 0x7f951007c2c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f952419af80 tx=0x7f9514009560 comp rx=0 tx=0).stop 2024-08-31T05:32:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.796+0000 7f952b2f4640 1 -- 172.21.15.67:0/3770060549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95241003f0 msgr2=0x7f952419f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.796+0000 7f952b2f4640 1 --2- 172.21.15.67:0/3770060549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95241003f0 0x7f952419f660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f952000c8a0 tx=0x7f952000cd60 comp rx=0 tx=0).stop 2024-08-31T05:32:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.796+0000 7f952b2f4640 1 -- 172.21.15.67:0/3770060549 shutdown_connections 2024-08-31T05:32:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.796+0000 7f952b2f4640 1 --2- 172.21.15.67:0/3770060549 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f9510079e00 0x7f951007c2c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.796+0000 7f952b2f4640 1 --2- 172.21.15.67:0/3770060549 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524100da0 0x7f952419fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.796+0000 7f952b2f4640 1 --2- 172.21.15.67:0/3770060549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95241003f0 0x7f952419f660 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.796+0000 7f952b2f4640 1 -- 172.21.15.67:0/3770060549 >> 172.21.15.67:0/3770060549 conn(0x7f95240fc2c0 msgr2=0x7f95240fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:14.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.796+0000 7f952b2f4640 1 -- 172.21.15.67:0/3770060549 shutdown_connections 2024-08-31T05:32:14.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:14.796+0000 7f952b2f4640 1 -- 172.21.15.67:0/3770060549 wait complete. 2024-08-31T05:32:15.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:14 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3770060549' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:32:15.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:14 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3770060549' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:32:15.479 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-08-31T05:32:15.737 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:16.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:15 smithi067 ceph-mon[99941]: pgmap v357: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:16.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:15 smithi073 ceph-mon[71452]: pgmap v357: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.216+0000 7f2de47c3640 1 -- 172.21.15.67:0/3142479712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc1031e0 msgr2=0x7f2ddc10b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.216+0000 7f2de47c3640 1 --2- 172.21.15.67:0/3142479712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc1031e0 0x7f2ddc10b6d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0098b0 tx=0x7f2dcc02a560 comp rx=0 tx=0).stop 2024-08-31T05:32:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.216+0000 7f2de47c3640 1 -- 172.21.15.67:0/3142479712 shutdown_connections 2024-08-31T05:32:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.216+0000 7f2de47c3640 1 --2- 172.21.15.67:0/3142479712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc1031e0 0x7f2ddc10b6d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.216+0000 7f2de47c3640 1 --2- 172.21.15.67:0/3142479712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc1028c0 0x7f2ddc102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.216+0000 7f2de47c3640 1 -- 172.21.15.67:0/3142479712 >> 172.21.15.67:0/3142479712 conn(0x7f2ddc0fc2c0 msgr2=0x7f2ddc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.217+0000 7f2de47c3640 1 -- 172.21.15.67:0/3142479712 shutdown_connections 2024-08-31T05:32:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.217+0000 7f2de47c3640 1 -- 172.21.15.67:0/3142479712 wait complete. 2024-08-31T05:32:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.217+0000 7f2de47c3640 1 Processor -- start 2024-08-31T05:32:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.217+0000 7f2de47c3640 1 -- start start 2024-08-31T05:32:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.218+0000 7f2de47c3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc1028c0 0x7f2ddc19d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.218+0000 7f2de47c3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc1031e0 0x7f2ddc19d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.218+0000 7f2de47c3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc10eb70 con 0x7f2ddc1028c0 2024-08-31T05:32:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.218+0000 7f2de47c3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc10e9f0 con 0x7f2ddc1031e0 2024-08-31T05:32:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.218+0000 7f2de255f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc1028c0 0x7f2ddc19d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.218+0000 7f2de255f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc1028c0 0x7f2ddc19d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48538/0 (socket says 172.21.15.67:48538) 2024-08-31T05:32:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.218+0000 7f2de255f640 1 -- 172.21.15.67:0/1596618214 learned_addr learned my addr 172.21.15.67:0/1596618214 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.218+0000 7f2de1d5e640 1 --2- 172.21.15.67:0/1596618214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc1031e0 0x7f2ddc19d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.218+0000 7f2de255f640 1 -- 172.21.15.67:0/1596618214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc1031e0 msgr2=0x7f2ddc19d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.218+0000 7f2de255f640 1 --2- 172.21.15.67:0/1596618214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc1031e0 0x7f2ddc19d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.218+0000 7f2de255f640 1 -- 172.21.15.67:0/1596618214 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ddc19e050 con 0x7f2ddc1028c0 2024-08-31T05:32:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.218+0000 7f2de255f640 1 --2- 172.21.15.67:0/1596618214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc1028c0 0x7f2ddc19d460 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800c8a0 tx=0x7f2dd800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.218+0000 7f2dd37fe640 1 -- 172.21.15.67:0/1596618214 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2dd80079b0 con 0x7f2ddc1028c0 2024-08-31T05:32:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.218+0000 7f2dd37fe640 1 -- 172.21.15.67:0/1596618214 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2dd8007b50 con 0x7f2ddc1028c0 2024-08-31T05:32:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.219+0000 7f2de47c3640 1 -- 172.21.15.67:0/1596618214 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ddc197740 con 0x7f2ddc1028c0 2024-08-31T05:32:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.219+0000 7f2dd37fe640 1 -- 172.21.15.67:0/1596618214 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2dd8018700 con 0x7f2ddc1028c0 2024-08-31T05:32:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.219+0000 7f2de47c3640 1 -- 172.21.15.67:0/1596618214 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ddc197ca0 con 0x7f2ddc1028c0 2024-08-31T05:32:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.220+0000 7f2de47c3640 1 -- 172.21.15.67:0/1596618214 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ddc06a7d0 con 0x7f2ddc1028c0 2024-08-31T05:32:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.220+0000 7f2dd37fe640 1 -- 172.21.15.67:0/1596618214 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f2dd8007d00 con 0x7f2ddc1028c0 2024-08-31T05:32:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.221+0000 7f2dd37fe640 1 --2- 172.21.15.67:0/1596618214 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2dc8079e00 0x7f2dc807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.221+0000 7f2dd37fe640 1 -- 172.21.15.67:0/1596618214 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f2dd809cd30 con 0x7f2ddc1028c0 2024-08-31T05:32:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.221+0000 7f2de1d5e640 1 --2- 172.21.15.67:0/1596618214 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2dc8079e00 0x7f2dc807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.221+0000 7f2de1d5e640 1 --2- 172.21.15.67:0/1596618214 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2dc8079e00 0x7f2dc807c2c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc000c00 tx=0x7f2dcc031420 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:16.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.226+0000 7f2dd37fe640 1 -- 172.21.15.67:0/1596618214 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2dd8014030 con 0x7f2ddc1028c0 2024-08-31T05:32:16.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.484+0000 7f2de47c3640 1 -- 172.21.15.67:0/1596618214 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2ddc105d50 con 0x7f2ddc1028c0 2024-08-31T05:32:16.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.485+0000 7f2dd37fe640 1 -- 172.21.15.67:0/1596618214 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f2dd8064700 con 0x7f2ddc1028c0 2024-08-31T05:32:16.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.487+0000 7f2de47c3640 1 -- 172.21.15.67:0/1596618214 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2dc8079e00 msgr2=0x7f2dc807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:16.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.487+0000 7f2de47c3640 1 --2- 172.21.15.67:0/1596618214 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2dc8079e00 0x7f2dc807c2c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc000c00 tx=0x7f2dcc031420 comp rx=0 tx=0).stop 2024-08-31T05:32:16.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.487+0000 7f2de47c3640 1 -- 172.21.15.67:0/1596618214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc1028c0 msgr2=0x7f2ddc19d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:16.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.487+0000 7f2de47c3640 1 --2- 172.21.15.67:0/1596618214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc1028c0 0x7f2ddc19d460 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800c8a0 tx=0x7f2dd800cd60 comp rx=0 tx=0).stop 2024-08-31T05:32:16.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.487+0000 7f2de47c3640 1 -- 172.21.15.67:0/1596618214 shutdown_connections 2024-08-31T05:32:16.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.487+0000 7f2de47c3640 1 --2- 172.21.15.67:0/1596618214 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2dc8079e00 0x7f2dc807c2c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:16.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.487+0000 7f2de47c3640 1 --2- 172.21.15.67:0/1596618214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc1031e0 0x7f2ddc19d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:16.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.487+0000 7f2de47c3640 1 --2- 172.21.15.67:0/1596618214 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ddc1028c0 0x7f2ddc19d460 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:16.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.487+0000 7f2de47c3640 1 -- 172.21.15.67:0/1596618214 >> 172.21.15.67:0/1596618214 conn(0x7f2ddc0fc2c0 msgr2=0x7f2ddc103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:16.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.488+0000 7f2de47c3640 1 -- 172.21.15.67:0/1596618214 shutdown_connections 2024-08-31T05:32:16.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:16.488+0000 7f2de47c3640 1 -- 172.21.15.67:0/1596618214 wait complete. 2024-08-31T05:32:16.498 INFO:teuthology.orchestra.run.smithi067.stdout:true 2024-08-31T05:32:17.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:16 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/1596618214' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:32:17.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:16 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/1596618214' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:32:17.211 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -e sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-08-31T05:32:17.466 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:17.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:17 smithi067 ceph-mon[99941]: pgmap v358: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:17.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.950+0000 7f72451fd640 1 -- 172.21.15.67:0/1260753552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7240100160 msgr2=0x7f7240100540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:17.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.950+0000 7f72451fd640 1 --2- 172.21.15.67:0/1260753552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7240100160 0x7f7240100540 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7238009c20 tx=0x7f723802a970 comp rx=0 tx=0).stop 2024-08-31T05:32:17.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.950+0000 7f72451fd640 1 -- 172.21.15.67:0/1260753552 shutdown_connections 2024-08-31T05:32:17.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.950+0000 7f72451fd640 1 --2- 172.21.15.67:0/1260753552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7240100b10 0x7f7240106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:17.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.950+0000 7f72451fd640 1 --2- 172.21.15.67:0/1260753552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7240100160 0x7f7240100540 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:17.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.950+0000 7f72451fd640 1 -- 172.21.15.67:0/1260753552 >> 172.21.15.67:0/1260753552 conn(0x7f7240076ef0 msgr2=0x7f7240077300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:17.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.950+0000 7f72451fd640 1 -- 172.21.15.67:0/1260753552 shutdown_connections 2024-08-31T05:32:17.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.950+0000 7f72451fd640 1 -- 172.21.15.67:0/1260753552 wait complete. 2024-08-31T05:32:17.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.951+0000 7f72451fd640 1 Processor -- start 2024-08-31T05:32:17.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.951+0000 7f72451fd640 1 -- start start 2024-08-31T05:32:17.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.951+0000 7f72451fd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7240100160 0x7f724019f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:17.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.951+0000 7f72451fd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7240100b10 0x7f724019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:17.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.951+0000 7f72451fd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f724010ebe0 con 0x7f7240100b10 2024-08-31T05:32:17.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.951+0000 7f72451fd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f724010ea60 con 0x7f7240100160 2024-08-31T05:32:17.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.951+0000 7f723e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7240100b10 0x7f724019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:17.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.951+0000 7f723e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7240100b10 0x7f724019fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48566/0 (socket says 172.21.15.67:48566) 2024-08-31T05:32:17.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.951+0000 7f723e59c640 1 -- 172.21.15.67:0/2864443926 learned_addr learned my addr 172.21.15.67:0/2864443926 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:17.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.951+0000 7f723ed9d640 1 --2- 172.21.15.67:0/2864443926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7240100160 0x7f724019f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:17.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.952+0000 7f723e59c640 1 -- 172.21.15.67:0/2864443926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7240100160 msgr2=0x7f724019f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:17.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.952+0000 7f723e59c640 1 --2- 172.21.15.67:0/2864443926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7240100160 0x7f724019f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:17.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.952+0000 7f723e59c640 1 -- 172.21.15.67:0/2864443926 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7240199860 con 0x7f7240100b10 2024-08-31T05:32:17.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.952+0000 7f723e59c640 1 --2- 172.21.15.67:0/2864443926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7240100b10 0x7f724019fbe0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f722800b3d0 tx=0x7f722800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:17.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.952+0000 7f7237fff640 1 -- 172.21.15.67:0/2864443926 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7228015020 con 0x7f7240100b10 2024-08-31T05:32:17.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.952+0000 7f7237fff640 1 -- 172.21.15.67:0/2864443926 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7228011af0 con 0x7f7240100b10 2024-08-31T05:32:17.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.952+0000 7f7237fff640 1 -- 172.21.15.67:0/2864443926 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7228010d30 con 0x7f7240100b10 2024-08-31T05:32:17.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.952+0000 7f72451fd640 1 -- 172.21.15.67:0/2864443926 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7240199b50 con 0x7f7240100b10 2024-08-31T05:32:17.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.952+0000 7f72451fd640 1 -- 172.21.15.67:0/2864443926 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f724019a160 con 0x7f7240100b10 2024-08-31T05:32:17.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.953+0000 7f72451fd640 1 -- 172.21.15.67:0/2864443926 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7240069b30 con 0x7f7240100b10 2024-08-31T05:32:17.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.954+0000 7f7237fff640 1 -- 172.21.15.67:0/2864443926 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f7228018020 con 0x7f7240100b10 2024-08-31T05:32:17.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.954+0000 7f7237fff640 1 --2- 172.21.15.67:0/2864443926 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f722c079e00 0x7f722c07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:17.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.954+0000 7f7237fff640 1 -- 172.21.15.67:0/2864443926 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f722809c360 con 0x7f7240100b10 2024-08-31T05:32:17.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.955+0000 7f723ed9d640 1 --2- 172.21.15.67:0/2864443926 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f722c079e00 0x7f722c07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:17.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.955+0000 7f723ed9d640 1 --2- 172.21.15.67:0/2864443926 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f722c079e00 0x7f722c07c2c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7238009430 tx=0x7f723803c040 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:17.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:17.959+0000 7f7237fff640 1 -- 172.21.15.67:0/2864443926 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f722801f020 con 0x7f7240100b10 2024-08-31T05:32:18.142 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:17 smithi073 ceph-mon[71452]: pgmap v358: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:18.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:18.216+0000 7f72451fd640 1 -- 172.21.15.67:0/2864443926 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f724019ae60 con 0x7f7240100b10 2024-08-31T05:32:18.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:18.216+0000 7f7237fff640 1 -- 172.21.15.67:0/2864443926 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f7228063d30 con 0x7f7240100b10 2024-08-31T05:32:18.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:18.219+0000 7f72451fd640 1 -- 172.21.15.67:0/2864443926 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f722c079e00 msgr2=0x7f722c07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:18.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:18.219+0000 7f72451fd640 1 --2- 172.21.15.67:0/2864443926 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f722c079e00 0x7f722c07c2c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7238009430 tx=0x7f723803c040 comp rx=0 tx=0).stop 2024-08-31T05:32:18.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:18.219+0000 7f72451fd640 1 -- 172.21.15.67:0/2864443926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7240100b10 msgr2=0x7f724019fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:18.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:18.219+0000 7f72451fd640 1 --2- 172.21.15.67:0/2864443926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7240100b10 0x7f724019fbe0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f722800b3d0 tx=0x7f722800b890 comp rx=0 tx=0).stop 2024-08-31T05:32:18.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:18.219+0000 7f72451fd640 1 -- 172.21.15.67:0/2864443926 shutdown_connections 2024-08-31T05:32:18.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:18.219+0000 7f72451fd640 1 --2- 172.21.15.67:0/2864443926 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f722c079e00 0x7f722c07c2c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:18.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:18.219+0000 7f72451fd640 1 --2- 172.21.15.67:0/2864443926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7240100b10 0x7f724019fbe0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:18.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:18.219+0000 7f72451fd640 1 --2- 172.21.15.67:0/2864443926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7240100160 0x7f724019f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:18.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:18.219+0000 7f72451fd640 1 -- 172.21.15.67:0/2864443926 >> 172.21.15.67:0/2864443926 conn(0x7f7240076ef0 msgr2=0x7f72400fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:18.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:18.220+0000 7f72451fd640 1 -- 172.21.15.67:0/2864443926 shutdown_connections 2024-08-31T05:32:18.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:18.220+0000 7f72451fd640 1 -- 172.21.15.67:0/2864443926 wait complete. 2024-08-31T05:32:18.230 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)" 2024-08-31T05:32:18.852 DEBUG:teuthology.parallel:result is None 2024-08-31T05:32:18.852 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T05:32:18.865 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2024-08-31T05:32:18.866 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-31T05:32:19.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:18 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2864443926' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:32:19.120 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:19.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:18 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2864443926' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-08-31T05:32:19.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.607+0000 7fe471d20640 1 -- 172.21.15.67:0/898036094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46c106660 msgr2=0x7fe46c106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.607+0000 7fe471d20640 1 --2- 172.21.15.67:0/898036094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46c106660 0x7fe46c106a40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009c20 tx=0x7fe45c02a970 comp rx=0 tx=0).stop 2024-08-31T05:32:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.607+0000 7fe471d20640 1 -- 172.21.15.67:0/898036094 shutdown_connections 2024-08-31T05:32:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.607+0000 7fe471d20640 1 --2- 172.21.15.67:0/898036094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe46c1005b0 0x7fe46c100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.607+0000 7fe471d20640 1 --2- 172.21.15.67:0/898036094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46c106660 0x7fe46c106a40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.607+0000 7fe471d20640 1 -- 172.21.15.67:0/898036094 >> 172.21.15.67:0/898036094 conn(0x7fe46c0fc2f0 msgr2=0x7fe46c0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.607+0000 7fe471d20640 1 -- 172.21.15.67:0/898036094 shutdown_connections 2024-08-31T05:32:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.607+0000 7fe471d20640 1 -- 172.21.15.67:0/898036094 wait complete. 2024-08-31T05:32:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.607+0000 7fe471d20640 1 Processor -- start 2024-08-31T05:32:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.608+0000 7fe471d20640 1 -- start start 2024-08-31T05:32:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.608+0000 7fe471d20640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe46c1005b0 0x7fe46c197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.608+0000 7fe471d20640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46c106660 0x7fe46c197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.608+0000 7fe471d20640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe46c10da70 con 0x7fe46c106660 2024-08-31T05:32:19.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.608+0000 7fe471d20640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe46c10d8f0 con 0x7fe46c1005b0 2024-08-31T05:32:19.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.608+0000 7fe46affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46c106660 0x7fe46c197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.608+0000 7fe46affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46c106660 0x7fe46c197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58132/0 (socket says 172.21.15.67:58132) 2024-08-31T05:32:19.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.608+0000 7fe46affd640 1 -- 172.21.15.67:0/2849216797 learned_addr learned my addr 172.21.15.67:0/2849216797 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:19.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.608+0000 7fe46b7fe640 1 --2- 172.21.15.67:0/2849216797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe46c1005b0 0x7fe46c197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.608+0000 7fe46affd640 1 -- 172.21.15.67:0/2849216797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe46c1005b0 msgr2=0x7fe46c197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.608+0000 7fe46affd640 1 --2- 172.21.15.67:0/2849216797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe46c1005b0 0x7fe46c197720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.608+0000 7fe46affd640 1 -- 172.21.15.67:0/2849216797 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46c19bff0 con 0x7fe46c106660 2024-08-31T05:32:19.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.609+0000 7fe46affd640 1 --2- 172.21.15.67:0/2849216797 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46c106660 0x7fe46c197c60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe46000e970 tx=0x7fe46000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:19.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.609+0000 7fe468ff9640 1 -- 172.21.15.67:0/2849216797 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe46000cac0 con 0x7fe46c106660 2024-08-31T05:32:19.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.609+0000 7fe471d20640 1 -- 172.21.15.67:0/2849216797 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe46c19c2e0 con 0x7fe46c106660 2024-08-31T05:32:19.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.609+0000 7fe468ff9640 1 -- 172.21.15.67:0/2849216797 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe4600054e0 con 0x7fe46c106660 2024-08-31T05:32:19.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.609+0000 7fe468ff9640 1 -- 172.21.15.67:0/2849216797 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe460010430 con 0x7fe46c106660 2024-08-31T05:32:19.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.609+0000 7fe471d20640 1 -- 172.21.15.67:0/2849216797 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe46c19c870 con 0x7fe46c106660 2024-08-31T05:32:19.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.610+0000 7fe471d20640 1 -- 172.21.15.67:0/2849216797 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe46c101cd0 con 0x7fe46c106660 2024-08-31T05:32:19.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.611+0000 7fe468ff9640 1 -- 172.21.15.67:0/2849216797 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fe460004e80 con 0x7fe46c106660 2024-08-31T05:32:19.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.611+0000 7fe468ff9640 1 --2- 172.21.15.67:0/2849216797 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe454079e00 0x7fe45407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.611+0000 7fe468ff9640 1 -- 172.21.15.67:0/2849216797 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7fe46009d100 con 0x7fe46c106660 2024-08-31T05:32:19.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.611+0000 7fe46b7fe640 1 --2- 172.21.15.67:0/2849216797 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe454079e00 0x7fe45407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.612+0000 7fe46b7fe640 1 --2- 172.21.15.67:0/2849216797 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe454079e00 0x7fe45407c2c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009430 tx=0x7fe45c03c040 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:19.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.616+0000 7fe468ff9640 1 -- 172.21.15.67:0/2849216797 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe460064a70 con 0x7fe46c106660 2024-08-31T05:32:19.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.838+0000 7fe471d20640 1 -- 172.21.15.67:0/2849216797 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe46c100a10 con 0x7fe46c106660 2024-08-31T05:32:19.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.839+0000 7fe468ff9640 1 -- 172.21.15.67:0/2849216797 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) ==== 76+0+2040 (secure 0 0 0) 0x7fe460068be0 con 0x7fe46c106660 2024-08-31T05:32:19.841 INFO:teuthology.orchestra.run.smithi067.stdout:e36 2024-08-31T05:32:19.841 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-08-31T05:30:35:000543+0000 2024-08-31T05:32:19.841 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:32:19.841 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:32:19.841 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-08-31T05:32:19.841 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:19.841 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:32:19.841 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-08-31T05:32:19.841 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 36 2024-08-31T05:32:19.841 INFO:teuthology.orchestra.run.smithi067.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T05:32:19.842 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-08-31T05:18:19.419969+0000 2024-08-31T05:32:19.842 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-08-31T05:30:34.127307+0000 2024-08-31T05:32:19.842 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-08-31T05:32:19.842 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-08-31T05:32:19.842 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2024-08-31T05:32:19.842 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-08-31T05:32:19.842 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-08-31T05:32:19.842 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-08-31T05:32:19.842 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-08-31T05:32:19.842 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-08-31T05:32:19.842 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 95 2024-08-31T05:32:19.842 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:32:19.842 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2024-08-31T05:32:19.842 INFO:teuthology.orchestra.run.smithi067.stdout:in 0 2024-08-31T05:32:19.843 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=34322} 2024-08-31T05:32:19.843 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-08-31T05:32:19.843 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-08-31T05:32:19.843 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-08-31T05:32:19.843 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-08-31T05:32:19.843 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-08-31T05:32:19.843 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data enabled 2024-08-31T05:32:19.843 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-08-31T05:32:19.843 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-08-31T05:32:19.843 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2024-08-31T05:32:19.843 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 34322 members: 34322 2024-08-31T05:32:19.843 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.tskvpt{0:34322} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.67:6826/3864481333,v1:172.21.15.67:6827/3864481333] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:32:19.843 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.beqeql{0:34354} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.67:6828/352208921,v1:172.21.15.67:6829/352208921] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:32:19.843 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:19.844 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:19.844 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2024-08-31T05:32:19.844 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:19.844 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.gsnhxi{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6824/2489979765,v1:172.21.15.73:6825/2489979765] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:32:19.844 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi073.kfbmeo{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.73:6826/668223470,v1:172.21.15.73:6827/668223470] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:32:19.844 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 36 2024-08-31T05:32:19.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.842+0000 7fe471d20640 1 -- 172.21.15.67:0/2849216797 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe454079e00 msgr2=0x7fe45407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.842+0000 7fe471d20640 1 --2- 172.21.15.67:0/2849216797 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe454079e00 0x7fe45407c2c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009430 tx=0x7fe45c03c040 comp rx=0 tx=0).stop 2024-08-31T05:32:19.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.842+0000 7fe471d20640 1 -- 172.21.15.67:0/2849216797 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46c106660 msgr2=0x7fe46c197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.842+0000 7fe471d20640 1 --2- 172.21.15.67:0/2849216797 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46c106660 0x7fe46c197c60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe46000e970 tx=0x7fe46000ed70 comp rx=0 tx=0).stop 2024-08-31T05:32:19.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.842+0000 7fe471d20640 1 -- 172.21.15.67:0/2849216797 shutdown_connections 2024-08-31T05:32:19.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.842+0000 7fe471d20640 1 --2- 172.21.15.67:0/2849216797 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe454079e00 0x7fe45407c2c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.842+0000 7fe471d20640 1 --2- 172.21.15.67:0/2849216797 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe46c106660 0x7fe46c197c60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.842+0000 7fe471d20640 1 --2- 172.21.15.67:0/2849216797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe46c1005b0 0x7fe46c197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.842+0000 7fe471d20640 1 -- 172.21.15.67:0/2849216797 >> 172.21.15.67:0/2849216797 conn(0x7fe46c0fc2f0 msgr2=0x7fe46c1048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:19.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.842+0000 7fe471d20640 1 -- 172.21.15.67:0/2849216797 shutdown_connections 2024-08-31T05:32:19.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:19.842+0000 7fe471d20640 1 -- 172.21.15.67:0/2849216797 wait complete. 2024-08-31T05:32:20.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:19 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:32:20.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:19 smithi073 ceph-mon[71452]: pgmap v359: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:20.269 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:19 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:32:20.269 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:19 smithi067 ceph-mon[99941]: pgmap v359: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:20.436 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-08-31T05:32:20.447 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:32:20.700 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:21.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:20 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2849216797' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:32:21.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.172+0000 7fdbb65b6640 1 -- 172.21.15.67:0/1711230610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbb0100a80 msgr2=0x7fdbb0106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:21.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.172+0000 7fdbb65b6640 1 --2- 172.21.15.67:0/1711230610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbb0100a80 0x7fdbb0106340 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009880 tx=0x7fdba402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.172+0000 7fdbb65b6640 1 -- 172.21.15.67:0/1711230610 shutdown_connections 2024-08-31T05:32:21.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.172+0000 7fdbb65b6640 1 --2- 172.21.15.67:0/1711230610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbb0100a80 0x7fdbb0106340 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.172+0000 7fdbb65b6640 1 --2- 172.21.15.67:0/1711230610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbb01000d0 0x7fdbb01004b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.172+0000 7fdbb65b6640 1 -- 172.21.15.67:0/1711230610 >> 172.21.15.67:0/1711230610 conn(0x7fdbb0077010 msgr2=0x7fdbb0077420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:21.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.172+0000 7fdbb65b6640 1 -- 172.21.15.67:0/1711230610 shutdown_connections 2024-08-31T05:32:21.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.172+0000 7fdbb65b6640 1 -- 172.21.15.67:0/1711230610 wait complete. 2024-08-31T05:32:21.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.173+0000 7fdbb65b6640 1 Processor -- start 2024-08-31T05:32:21.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.173+0000 7fdbb65b6640 1 -- start start 2024-08-31T05:32:21.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.173+0000 7fdbb65b6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbb01000d0 0x7fdbb0101050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.173+0000 7fdbb65b6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbb0100a80 0x7fdbb0101590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.173+0000 7fdbb65b6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb010eb70 con 0x7fdbb01000d0 2024-08-31T05:32:21.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.173+0000 7fdbb65b6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb010e9f0 con 0x7fdbb0100a80 2024-08-31T05:32:21.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.174+0000 7fdbaffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbb01000d0 0x7fdbb0101050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.174+0000 7fdbaffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbb01000d0 0x7fdbb0101050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58156/0 (socket says 172.21.15.67:58156) 2024-08-31T05:32:21.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.174+0000 7fdbaffff640 1 -- 172.21.15.67:0/4048911449 learned_addr learned my addr 172.21.15.67:0/4048911449 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:21.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.174+0000 7fdbaf7fe640 1 --2- 172.21.15.67:0/4048911449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbb0100a80 0x7fdbb0101590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.174+0000 7fdbaffff640 1 -- 172.21.15.67:0/4048911449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbb0100a80 msgr2=0x7fdbb0101590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:21.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.174+0000 7fdbaffff640 1 --2- 172.21.15.67:0/4048911449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbb0100a80 0x7fdbb0101590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.174+0000 7fdbaffff640 1 -- 172.21.15.67:0/4048911449 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb0101ad0 con 0x7fdbb01000d0 2024-08-31T05:32:21.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.174+0000 7fdbaffff640 1 --2- 172.21.15.67:0/4048911449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbb01000d0 0x7fdbb0101050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c810 tx=0x7fdba000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:21.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.174+0000 7fdbad7fa640 1 -- 172.21.15.67:0/4048911449 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdba0004020 con 0x7fdbb01000d0 2024-08-31T05:32:21.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.174+0000 7fdbad7fa640 1 -- 172.21.15.67:0/4048911449 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdba00041c0 con 0x7fdbb01000d0 2024-08-31T05:32:21.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.174+0000 7fdbad7fa640 1 -- 172.21.15.67:0/4048911449 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdba00047a0 con 0x7fdbb01000d0 2024-08-31T05:32:21.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.174+0000 7fdbb65b6640 1 -- 172.21.15.67:0/4048911449 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb0101dc0 con 0x7fdbb01000d0 2024-08-31T05:32:21.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.174+0000 7fdbb65b6640 1 -- 172.21.15.67:0/4048911449 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb01a3be0 con 0x7fdbb01000d0 2024-08-31T05:32:21.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.175+0000 7fdbb65b6640 1 -- 172.21.15.67:0/4048911449 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb0069ba0 con 0x7fdbb01000d0 2024-08-31T05:32:21.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.176+0000 7fdbad7fa640 1 -- 172.21.15.67:0/4048911449 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fdba00079b0 con 0x7fdbb01000d0 2024-08-31T05:32:21.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.176+0000 7fdbad7fa640 1 --2- 172.21.15.67:0/4048911449 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fdb98079e40 0x7fdb9807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.177+0000 7fdbad7fa640 1 -- 172.21.15.67:0/4048911449 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7fdba009c8c0 con 0x7fdbb01000d0 2024-08-31T05:32:21.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.177+0000 7fdbaf7fe640 1 --2- 172.21.15.67:0/4048911449 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fdb98079e40 0x7fdb9807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.177+0000 7fdbaf7fe640 1 --2- 172.21.15.67:0/4048911449 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fdb98079e40 0x7fdb9807c300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdba4031460 tx=0x7fdba4009560 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:21.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.181+0000 7fdbad7fa640 1 -- 172.21.15.67:0/4048911449 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdba0014030 con 0x7fdbb01000d0 2024-08-31T05:32:21.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:20 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2849216797' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:32:21.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.402+0000 7fdbb65b6640 1 -- 172.21.15.67:0/4048911449 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdbb0109c40 con 0x7fdbb01000d0 2024-08-31T05:32:21.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.403+0000 7fdbad7fa640 1 -- 172.21.15.67:0/4048911449 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5319 (secure 0 0 0) 0x7fdba0064310 con 0x7fdbb01000d0 2024-08-31T05:32:21.404 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:21.405 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":36,"btime":"2024-08-31T05:30:35:000543+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44309,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2489979765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2489979765},{"type":"v1","addr":"172.21.15.73:6825","nonce":2489979765}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44335,"name":"cephfs.smithi073.kfbmeo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/668223470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":668223470},{"type":"v1","addr":"172.21.15.73:6827","nonce":668223470}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:30:34.127307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34354":{"gid":34354,"name":"cephfs.smithi067.beqeql","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6829/352208921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":352208921},{"type":"v1","addr":"172.21.15.67:6829","nonce":352208921}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34322,"qdb_cluster":[34322]},"id":1}]} 2024-08-31T05:32:21.405 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 36 2024-08-31T05:32:21.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.405+0000 7fdbb65b6640 1 -- 172.21.15.67:0/4048911449 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fdb98079e40 msgr2=0x7fdb9807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:21.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.405+0000 7fdbb65b6640 1 --2- 172.21.15.67:0/4048911449 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fdb98079e40 0x7fdb9807c300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdba4031460 tx=0x7fdba4009560 comp rx=0 tx=0).stop 2024-08-31T05:32:21.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.405+0000 7fdbb65b6640 1 -- 172.21.15.67:0/4048911449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbb01000d0 msgr2=0x7fdbb0101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:21.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.405+0000 7fdbb65b6640 1 --2- 172.21.15.67:0/4048911449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbb01000d0 0x7fdbb0101050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c810 tx=0x7fdba000ccd0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.405+0000 7fdbb65b6640 1 -- 172.21.15.67:0/4048911449 shutdown_connections 2024-08-31T05:32:21.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.405+0000 7fdbb65b6640 1 --2- 172.21.15.67:0/4048911449 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fdb98079e40 0x7fdb9807c300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.405+0000 7fdbb65b6640 1 --2- 172.21.15.67:0/4048911449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbb0100a80 0x7fdbb0101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.405+0000 7fdbb65b6640 1 --2- 172.21.15.67:0/4048911449 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbb01000d0 0x7fdbb0101050 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.405+0000 7fdbb65b6640 1 -- 172.21.15.67:0/4048911449 >> 172.21.15.67:0/4048911449 conn(0x7fdbb0077010 msgr2=0x7fdbb00fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:21.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.405+0000 7fdbb65b6640 1 -- 172.21.15.67:0/4048911449 shutdown_connections 2024-08-31T05:32:21.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:21.405+0000 7fdbb65b6640 1 -- 172.21.15.67:0/4048911449 wait complete. 2024-08-31T05:32:22.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:21 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/4048911449' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:32:22.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:21 smithi067 ceph-mon[99941]: pgmap v360: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:22.108 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 1, 'flags': 50} 2024-08-31T05:32:22.108 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 14 2024-08-31T05:32:22.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:21 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/4048911449' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:32:22.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:21 smithi073 ceph-mon[71452]: pgmap v360: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:22.371 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:22.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.857+0000 7f4950d95640 1 -- 172.21.15.67:0/1031739261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c1016a0 msgr2=0x7f494c101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:22.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.857+0000 7f4950d95640 1 --2- 172.21.15.67:0/1031739261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c1016a0 0x7f494c101b00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4940009880 tx=0x7f494002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:22.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.857+0000 7f4950d95640 1 -- 172.21.15.67:0/1031739261 shutdown_connections 2024-08-31T05:32:22.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.857+0000 7f4950d95640 1 --2- 172.21.15.67:0/1031739261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c1016a0 0x7f494c101b00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:22.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.857+0000 7f4950d95640 1 --2- 172.21.15.67:0/1031739261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c1076a0 0x7f494c107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:22.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.857+0000 7f4950d95640 1 -- 172.21.15.67:0/1031739261 >> 172.21.15.67:0/1031739261 conn(0x7f494c0fd3a0 msgr2=0x7f494c0ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:22.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.857+0000 7f4950d95640 1 -- 172.21.15.67:0/1031739261 shutdown_connections 2024-08-31T05:32:22.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.857+0000 7f4950d95640 1 -- 172.21.15.67:0/1031739261 wait complete. 2024-08-31T05:32:22.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.858+0000 7f4950d95640 1 Processor -- start 2024-08-31T05:32:22.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.858+0000 7f4950d95640 1 -- start start 2024-08-31T05:32:22.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.858+0000 7f4950d95640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c1016a0 0x7f494c197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:22.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.858+0000 7f4950d95640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c1076a0 0x7f494c197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:22.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.858+0000 7f4950d95640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f494c10eb70 con 0x7f494c1076a0 2024-08-31T05:32:22.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.858+0000 7f4950d95640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f494c10e9f0 con 0x7f494c1016a0 2024-08-31T05:32:22.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.858+0000 7f4949d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c1076a0 0x7f494c197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:22.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.858+0000 7f4949d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c1076a0 0x7f494c197c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58170/0 (socket says 172.21.15.67:58170) 2024-08-31T05:32:22.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.858+0000 7f4949d9b640 1 -- 172.21.15.67:0/2615548839 learned_addr learned my addr 172.21.15.67:0/2615548839 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:22.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.858+0000 7f494a59c640 1 --2- 172.21.15.67:0/2615548839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c1016a0 0x7f494c197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:22.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.859+0000 7f4949d9b640 1 -- 172.21.15.67:0/2615548839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c1016a0 msgr2=0x7f494c197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:22.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.859+0000 7f4949d9b640 1 --2- 172.21.15.67:0/2615548839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c1016a0 0x7f494c197710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:22.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.859+0000 7f4949d9b640 1 -- 172.21.15.67:0/2615548839 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494c19bfe0 con 0x7f494c1076a0 2024-08-31T05:32:22.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.859+0000 7f494a59c640 1 --2- 172.21.15.67:0/2615548839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c1016a0 0x7f494c197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:32:22.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.859+0000 7f4949d9b640 1 --2- 172.21.15.67:0/2615548839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c1076a0 0x7f494c197c50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4940031460 tx=0x7f4940004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:22.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.859+0000 7f493b7fe640 1 -- 172.21.15.67:0/2615548839 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f494003f070 con 0x7f494c1076a0 2024-08-31T05:32:22.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.859+0000 7f493b7fe640 1 -- 172.21.15.67:0/2615548839 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f49400035f0 con 0x7f494c1076a0 2024-08-31T05:32:22.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.859+0000 7f4950d95640 1 -- 172.21.15.67:0/2615548839 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494c19c270 con 0x7f494c1076a0 2024-08-31T05:32:22.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.859+0000 7f493b7fe640 1 -- 172.21.15.67:0/2615548839 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4940035030 con 0x7f494c1076a0 2024-08-31T05:32:22.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.859+0000 7f4950d95640 1 -- 172.21.15.67:0/2615548839 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f494c19c7a0 con 0x7f494c1076a0 2024-08-31T05:32:22.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.860+0000 7f4950d95640 1 -- 172.21.15.67:0/2615548839 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f494c102de0 con 0x7f494c1076a0 2024-08-31T05:32:22.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.861+0000 7f493b7fe640 1 -- 172.21.15.67:0/2615548839 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f4940042070 con 0x7f494c1076a0 2024-08-31T05:32:22.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.861+0000 7f493b7fe640 1 --2- 172.21.15.67:0/2615548839 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4934079e00 0x7f493407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:22.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.861+0000 7f493b7fe640 1 -- 172.21.15.67:0/2615548839 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f49400bd470 con 0x7f494c1076a0 2024-08-31T05:32:22.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.861+0000 7f494a59c640 1 --2- 172.21.15.67:0/2615548839 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4934079e00 0x7f493407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:22.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.862+0000 7f494a59c640 1 --2- 172.21.15.67:0/2615548839 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4934079e00 0x7f493407c2c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f493c005fd0 tx=0x7f493c009500 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:22.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:22.866+0000 7f493b7fe640 1 -- 172.21.15.67:0/2615548839 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4940084da0 con 0x7f494c1076a0 2024-08-31T05:32:23.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:23.087+0000 7f4950d95640 1 -- 172.21.15.67:0/2615548839 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) -- 0x7f494c109c10 con 0x7f494c1076a0 2024-08-31T05:32:23.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:23.088+0000 7f493b7fe640 1 -- 172.21.15.67:0/2615548839 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v36) ==== 107+0+5323 (secure 0 0 0) 0x7f4940088f10 con 0x7f494c1076a0 2024-08-31T05:32:23.090 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:23.091 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":14,"btime":"2024-08-31T05:18:34:116850+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24307,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2383176383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2383176383},{"type":"v1","addr":"172.21.15.73:6825","nonce":2383176383}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:18:33.086400+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14554},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14554":{"gid":14554,"name":"cephfs.smithi067.tskvpt","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6827/2961844124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2961844124},{"type":"v1","addr":"172.21.15.67:6827","nonce":2961844124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14566":{"gid":14566,"name":"cephfs.smithi067.beqeql","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.67:6829/1181644963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":1181644963},{"type":"v1","addr":"172.21.15.67:6829","nonce":1181644963}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14554,"qdb_cluster":[14554]},"id":1}]} 2024-08-31T05:32:23.091 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 14 2024-08-31T05:32:23.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:23.091+0000 7f4950d95640 1 -- 172.21.15.67:0/2615548839 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4934079e00 msgr2=0x7f493407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:23.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:23.091+0000 7f4950d95640 1 --2- 172.21.15.67:0/2615548839 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4934079e00 0x7f493407c2c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f493c005fd0 tx=0x7f493c009500 comp rx=0 tx=0).stop 2024-08-31T05:32:23.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:23.091+0000 7f4950d95640 1 -- 172.21.15.67:0/2615548839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c1076a0 msgr2=0x7f494c197c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:23.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:23.091+0000 7f4950d95640 1 --2- 172.21.15.67:0/2615548839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c1076a0 0x7f494c197c50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4940031460 tx=0x7f4940004530 comp rx=0 tx=0).stop 2024-08-31T05:32:23.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:23.091+0000 7f4950d95640 1 -- 172.21.15.67:0/2615548839 shutdown_connections 2024-08-31T05:32:23.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:23.091+0000 7f4950d95640 1 --2- 172.21.15.67:0/2615548839 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f4934079e00 0x7f493407c2c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:23.091+0000 7f4950d95640 1 --2- 172.21.15.67:0/2615548839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f494c1076a0 0x7f494c197c50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:23.091+0000 7f4950d95640 1 --2- 172.21.15.67:0/2615548839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c1016a0 0x7f494c197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:23.091+0000 7f4950d95640 1 -- 172.21.15.67:0/2615548839 >> 172.21.15.67:0/2615548839 conn(0x7f494c0fd3a0 msgr2=0x7f494c0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:23.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:23.091+0000 7f4950d95640 1 -- 172.21.15.67:0/2615548839 shutdown_connections 2024-08-31T05:32:23.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:23.091+0000 7f4950d95640 1 -- 172.21.15.67:0/2615548839 wait complete. 2024-08-31T05:32:23.381 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:23 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2615548839' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 14, "format": "json"} : dispatch 2024-08-31T05:32:23.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:23 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2615548839' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 14, "format": "json"} : dispatch 2024-08-31T05:32:23.775 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 15 2024-08-31T05:32:24.038 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:24.277 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:24 smithi067 ceph-mon[99941]: pgmap v361: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:24.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:24 smithi073 ceph-mon[71452]: pgmap v361: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.503+0000 7f2acc907640 1 -- 172.21.15.67:0/246311618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac81076a0 msgr2=0x7f2ac8107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.503+0000 7f2acc907640 1 --2- 172.21.15.67:0/246311618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac81076a0 0x7f2ac8107a80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009880 tx=0x7f2ab802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.503+0000 7f2acc907640 1 -- 172.21.15.67:0/246311618 shutdown_connections 2024-08-31T05:32:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.503+0000 7f2acc907640 1 --2- 172.21.15.67:0/246311618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ac81016a0 0x7f2ac8101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.503+0000 7f2acc907640 1 --2- 172.21.15.67:0/246311618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac81076a0 0x7f2ac8107a80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.503+0000 7f2acc907640 1 -- 172.21.15.67:0/246311618 >> 172.21.15.67:0/246311618 conn(0x7f2ac80fd3a0 msgr2=0x7f2ac80ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.503+0000 7f2acc907640 1 -- 172.21.15.67:0/246311618 shutdown_connections 2024-08-31T05:32:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.503+0000 7f2acc907640 1 -- 172.21.15.67:0/246311618 wait complete. 2024-08-31T05:32:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.504+0000 7f2acc907640 1 Processor -- start 2024-08-31T05:32:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.504+0000 7f2acc907640 1 -- start start 2024-08-31T05:32:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.504+0000 7f2acc907640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ac81016a0 0x7f2ac8074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.504+0000 7f2acc907640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac81076a0 0x7f2ac80747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.504+0000 7f2acc907640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac810eb50 con 0x7f2ac81076a0 2024-08-31T05:32:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.504+0000 7f2acc907640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac810e9d0 con 0x7f2ac81016a0 2024-08-31T05:32:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.504+0000 7f2ac5d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac81076a0 0x7f2ac80747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.504+0000 7f2ac5d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac81076a0 0x7f2ac80747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58188/0 (socket says 172.21.15.67:58188) 2024-08-31T05:32:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.504+0000 7f2ac5d9b640 1 -- 172.21.15.67:0/1457759253 learned_addr learned my addr 172.21.15.67:0/1457759253 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.504+0000 7f2ac659c640 1 --2- 172.21.15.67:0/1457759253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ac81016a0 0x7f2ac8074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.505+0000 7f2ac5d9b640 1 -- 172.21.15.67:0/1457759253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ac81016a0 msgr2=0x7f2ac8074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.505+0000 7f2ac5d9b640 1 --2- 172.21.15.67:0/1457759253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ac81016a0 0x7f2ac8074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.505+0000 7f2ac5d9b640 1 -- 172.21.15.67:0/1457759253 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac8074d10 con 0x7f2ac81076a0 2024-08-31T05:32:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.505+0000 7f2ac5d9b640 1 --2- 172.21.15.67:0/1457759253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac81076a0 0x7f2ac80747d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000d8d0 tx=0x7f2ab000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.505+0000 7f2abf7fe640 1 -- 172.21.15.67:0/1457759253 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ab0017070 con 0x7f2ac81076a0 2024-08-31T05:32:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.505+0000 7f2abf7fe640 1 -- 172.21.15.67:0/1457759253 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ab0010460 con 0x7f2ac81076a0 2024-08-31T05:32:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.505+0000 7f2acc907640 1 -- 172.21.15.67:0/1457759253 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac8075000 con 0x7f2ac81076a0 2024-08-31T05:32:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.505+0000 7f2abf7fe640 1 -- 172.21.15.67:0/1457759253 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ab000f5f0 con 0x7f2ac81076a0 2024-08-31T05:32:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.505+0000 7f2acc907640 1 -- 172.21.15.67:0/1457759253 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac81a3bc0 con 0x7f2ac81076a0 2024-08-31T05:32:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.506+0000 7f2acc907640 1 -- 172.21.15.67:0/1457759253 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ac8102de0 con 0x7f2ac81076a0 2024-08-31T05:32:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.507+0000 7f2abf7fe640 1 -- 172.21.15.67:0/1457759253 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f2ab0009a30 con 0x7f2ac81076a0 2024-08-31T05:32:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.507+0000 7f2abf7fe640 1 --2- 172.21.15.67:0/1457759253 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ab4079e00 0x7f2ab407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.507+0000 7f2ac659c640 1 --2- 172.21.15.67:0/1457759253 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ab4079e00 0x7f2ab407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.507+0000 7f2abf7fe640 1 -- 172.21.15.67:0/1457759253 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f2ab009c910 con 0x7f2ac81076a0 2024-08-31T05:32:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.508+0000 7f2ac659c640 1 --2- 172.21.15.67:0/1457759253 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ab4079e00 0x7f2ab407c2c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80096c0 tx=0x7f2ab8031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:24.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.512+0000 7f2abf7fe640 1 -- 172.21.15.67:0/1457759253 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2ab00683f0 con 0x7f2ac81076a0 2024-08-31T05:32:24.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.736+0000 7f2acc907640 1 -- 172.21.15.67:0/1457759253 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) -- 0x7f2ac81048b0 con 0x7f2ac81076a0 2024-08-31T05:32:24.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.736+0000 7f2abf7fe640 1 -- 172.21.15.67:0/1457759253 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v36) ==== 107+0+5322 (secure 0 0 0) 0x7f2ab006ce10 con 0x7f2ac81076a0 2024-08-31T05:32:24.738 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:24.738 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":15,"btime":"2024-08-31T05:18:35:124059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":24307,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2383176383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2383176383},{"type":"v1","addr":"172.21.15.73:6825","nonce":2383176383}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:18:33.086400+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14554},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14554":{"gid":14554,"name":"cephfs.smithi067.tskvpt","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6827/2961844124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2961844124},{"type":"v1","addr":"172.21.15.67:6827","nonce":2961844124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14566":{"gid":14566,"name":"cephfs.smithi067.beqeql","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.67:6829/1181644963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":1181644963},{"type":"v1","addr":"172.21.15.67:6829","nonce":1181644963}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14554,"qdb_cluster":[14554]},"id":1}]} 2024-08-31T05:32:24.739 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2024-08-31T05:32:24.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.739+0000 7f2acc907640 1 -- 172.21.15.67:0/1457759253 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ab4079e00 msgr2=0x7f2ab407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:24.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.739+0000 7f2acc907640 1 --2- 172.21.15.67:0/1457759253 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ab4079e00 0x7f2ab407c2c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80096c0 tx=0x7f2ab8031400 comp rx=0 tx=0).stop 2024-08-31T05:32:24.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.739+0000 7f2acc907640 1 -- 172.21.15.67:0/1457759253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac81076a0 msgr2=0x7f2ac80747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:24.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.739+0000 7f2acc907640 1 --2- 172.21.15.67:0/1457759253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac81076a0 0x7f2ac80747d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000d8d0 tx=0x7f2ab000dd90 comp rx=0 tx=0).stop 2024-08-31T05:32:24.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.739+0000 7f2acc907640 1 -- 172.21.15.67:0/1457759253 shutdown_connections 2024-08-31T05:32:24.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.739+0000 7f2acc907640 1 --2- 172.21.15.67:0/1457759253 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2ab4079e00 0x7f2ab407c2c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:24.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.739+0000 7f2acc907640 1 --2- 172.21.15.67:0/1457759253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ac81076a0 0x7f2ac80747d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:24.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.739+0000 7f2acc907640 1 --2- 172.21.15.67:0/1457759253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ac81016a0 0x7f2ac8074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:24.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.739+0000 7f2acc907640 1 -- 172.21.15.67:0/1457759253 >> 172.21.15.67:0/1457759253 conn(0x7f2ac80fd3a0 msgr2=0x7f2ac80fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:24.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.739+0000 7f2acc907640 1 -- 172.21.15.67:0/1457759253 shutdown_connections 2024-08-31T05:32:24.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:24.739+0000 7f2acc907640 1 -- 172.21.15.67:0/1457759253 wait complete. 2024-08-31T05:32:25.411 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:25 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/1457759253' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 15, "format": "json"} : dispatch 2024-08-31T05:32:25.413 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 16 2024-08-31T05:32:25.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:25 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/1457759253' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 15, "format": "json"} : dispatch 2024-08-31T05:32:25.670 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.157+0000 7efe7268d640 1 -- 172.21.15.67:0/1718935622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe6c1016a0 msgr2=0x7efe6c101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.157+0000 7efe7268d640 1 --2- 172.21.15.67:0/1718935622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe6c1016a0 0x7efe6c101b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efe60009880 tx=0x7efe6002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.157+0000 7efe7268d640 1 -- 172.21.15.67:0/1718935622 shutdown_connections 2024-08-31T05:32:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.157+0000 7efe7268d640 1 --2- 172.21.15.67:0/1718935622 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe6c1016a0 0x7efe6c101b00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.157+0000 7efe7268d640 1 --2- 172.21.15.67:0/1718935622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe6c1076a0 0x7efe6c107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:26.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.157+0000 7efe7268d640 1 -- 172.21.15.67:0/1718935622 >> 172.21.15.67:0/1718935622 conn(0x7efe6c0fd3c0 msgr2=0x7efe6c0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.157+0000 7efe7268d640 1 -- 172.21.15.67:0/1718935622 shutdown_connections 2024-08-31T05:32:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.157+0000 7efe7268d640 1 -- 172.21.15.67:0/1718935622 wait complete. 2024-08-31T05:32:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.158+0000 7efe7268d640 1 Processor -- start 2024-08-31T05:32:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.158+0000 7efe7268d640 1 -- start start 2024-08-31T05:32:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.158+0000 7efe7268d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe6c1016a0 0x7efe6c074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.158+0000 7efe7268d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe6c1076a0 0x7efe6c0747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.158+0000 7efe7268d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c10eb50 con 0x7efe6c1016a0 2024-08-31T05:32:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.158+0000 7efe7268d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c10e9d0 con 0x7efe6c1076a0 2024-08-31T05:32:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.158+0000 7efe6bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe6c1016a0 0x7efe6c074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.158+0000 7efe6bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe6c1016a0 0x7efe6c074290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58214/0 (socket says 172.21.15.67:58214) 2024-08-31T05:32:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.158+0000 7efe6bfff640 1 -- 172.21.15.67:0/3650024903 learned_addr learned my addr 172.21.15.67:0/3650024903 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.158+0000 7efe6b7fe640 1 --2- 172.21.15.67:0/3650024903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe6c1076a0 0x7efe6c0747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:26.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.159+0000 7efe6bfff640 1 -- 172.21.15.67:0/3650024903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe6c1076a0 msgr2=0x7efe6c0747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.159+0000 7efe6bfff640 1 --2- 172.21.15.67:0/3650024903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe6c1076a0 0x7efe6c0747d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.159+0000 7efe6bfff640 1 -- 172.21.15.67:0/3650024903 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe6c074d10 con 0x7efe6c1016a0 2024-08-31T05:32:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.159+0000 7efe6bfff640 1 --2- 172.21.15.67:0/3650024903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe6c1016a0 0x7efe6c074290 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00d8d0 tx=0x7efe5c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.159+0000 7efe697fa640 1 -- 172.21.15.67:0/3650024903 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe5c017030 con 0x7efe6c1016a0 2024-08-31T05:32:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.159+0000 7efe697fa640 1 -- 172.21.15.67:0/3650024903 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe5c004020 con 0x7efe6c1016a0 2024-08-31T05:32:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.159+0000 7efe7268d640 1 -- 172.21.15.67:0/3650024903 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe6c075000 con 0x7efe6c1016a0 2024-08-31T05:32:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.159+0000 7efe697fa640 1 -- 172.21.15.67:0/3650024903 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe5c0047a0 con 0x7efe6c1016a0 2024-08-31T05:32:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.159+0000 7efe7268d640 1 -- 172.21.15.67:0/3650024903 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe6c1a3be0 con 0x7efe6c1016a0 2024-08-31T05:32:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.160+0000 7efe7268d640 1 -- 172.21.15.67:0/3650024903 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe6c102de0 con 0x7efe6c1016a0 2024-08-31T05:32:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.161+0000 7efe697fa640 1 -- 172.21.15.67:0/3650024903 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7efe5c0041d0 con 0x7efe6c1016a0 2024-08-31T05:32:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.161+0000 7efe697fa640 1 --2- 172.21.15.67:0/3650024903 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efe54079e40 0x7efe5407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.161+0000 7efe697fa640 1 -- 172.21.15.67:0/3650024903 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7efe5c018070 con 0x7efe6c1016a0 2024-08-31T05:32:26.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.161+0000 7efe6b7fe640 1 --2- 172.21.15.67:0/3650024903 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efe54079e40 0x7efe5407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:26.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.162+0000 7efe6b7fe640 1 --2- 172.21.15.67:0/3650024903 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efe54079e40 0x7efe5407c300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efe6c075d20 tx=0x7efe60031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:26.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.166+0000 7efe697fa640 1 -- 172.21.15.67:0/3650024903 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efe5c064160 con 0x7efe6c1016a0 2024-08-31T05:32:26.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.388+0000 7efe7268d640 1 -- 172.21.15.67:0/3650024903 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) -- 0x7efe6c101b00 con 0x7efe6c1016a0 2024-08-31T05:32:26.390 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:26 smithi067 ceph-mon[99941]: pgmap v362: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.389+0000 7efe697fa640 1 -- 172.21.15.67:0/3650024903 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v36) ==== 107+0+4469 (secure 0 0 0) 0x7efe5c0682d0 con 0x7efe6c1016a0 2024-08-31T05:32:26.390 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:26.391 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"btime":"2024-08-31T05:29:01:473183+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":24307,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2383176383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2383176383},{"type":"v1","addr":"172.21.15.73:6825","nonce":2383176383}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:29:00.475526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14554},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14554":{"gid":14554,"name":"cephfs.smithi067.tskvpt","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6827/2961844124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2961844124},{"type":"v1","addr":"172.21.15.67:6827","nonce":2961844124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14554,"qdb_cluster":[14554]},"id":1}]} 2024-08-31T05:32:26.391 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 16 2024-08-31T05:32:26.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.391+0000 7efe7268d640 1 -- 172.21.15.67:0/3650024903 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efe54079e40 msgr2=0x7efe5407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.391+0000 7efe7268d640 1 --2- 172.21.15.67:0/3650024903 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efe54079e40 0x7efe5407c300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efe6c075d20 tx=0x7efe60031400 comp rx=0 tx=0).stop 2024-08-31T05:32:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.391+0000 7efe7268d640 1 -- 172.21.15.67:0/3650024903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe6c1016a0 msgr2=0x7efe6c074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.391+0000 7efe7268d640 1 --2- 172.21.15.67:0/3650024903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe6c1016a0 0x7efe6c074290 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00d8d0 tx=0x7efe5c00dd90 comp rx=0 tx=0).stop 2024-08-31T05:32:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.391+0000 7efe7268d640 1 -- 172.21.15.67:0/3650024903 shutdown_connections 2024-08-31T05:32:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.391+0000 7efe7268d640 1 --2- 172.21.15.67:0/3650024903 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7efe54079e40 0x7efe5407c300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.391+0000 7efe7268d640 1 --2- 172.21.15.67:0/3650024903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe6c1076a0 0x7efe6c0747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.391+0000 7efe7268d640 1 --2- 172.21.15.67:0/3650024903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe6c1016a0 0x7efe6c074290 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.391+0000 7efe7268d640 1 -- 172.21.15.67:0/3650024903 >> 172.21.15.67:0/3650024903 conn(0x7efe6c0fd3c0 msgr2=0x7efe6c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.391+0000 7efe7268d640 1 -- 172.21.15.67:0/3650024903 shutdown_connections 2024-08-31T05:32:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:26.391+0000 7efe7268d640 1 -- 172.21.15.67:0/3650024903 wait complete. 2024-08-31T05:32:26.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:26 smithi073 ceph-mon[71452]: pgmap v362: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:27.083 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 16 2024-08-31T05:32:27.084 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 17 2024-08-31T05:32:27.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:27 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3650024903' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-08-31T05:32:27.344 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:27.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:27 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3650024903' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-08-31T05:32:27.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.756+0000 7fea355ec640 1 -- 172.21.15.67:0/2826088250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea30103170 msgr2=0x7fea3010b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:27.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.756+0000 7fea355ec640 1 --2- 172.21.15.67:0/2826088250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea30103170 0x7fea3010b660 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fea18009880 tx=0x7fea1802a530 comp rx=0 tx=0).stop 2024-08-31T05:32:27.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.756+0000 7fea355ec640 1 -- 172.21.15.67:0/2826088250 shutdown_connections 2024-08-31T05:32:27.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.756+0000 7fea355ec640 1 --2- 172.21.15.67:0/2826088250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea30103170 0x7fea3010b660 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.756+0000 7fea355ec640 1 --2- 172.21.15.67:0/2826088250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea30102850 0x7fea30102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.756+0000 7fea355ec640 1 -- 172.21.15.67:0/2826088250 >> 172.21.15.67:0/2826088250 conn(0x7fea300fc270 msgr2=0x7fea300fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:27.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.756+0000 7fea355ec640 1 -- 172.21.15.67:0/2826088250 shutdown_connections 2024-08-31T05:32:27.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.756+0000 7fea355ec640 1 -- 172.21.15.67:0/2826088250 wait complete. 2024-08-31T05:32:27.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.757+0000 7fea355ec640 1 Processor -- start 2024-08-31T05:32:27.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.757+0000 7fea355ec640 1 -- start start 2024-08-31T05:32:27.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.758+0000 7fea355ec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea30102850 0x7fea3019d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.758+0000 7fea355ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea30103170 0x7fea3019d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.758+0000 7fea355ec640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fea3010eb60 con 0x7fea30102850 2024-08-31T05:32:27.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.758+0000 7fea355ec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fea3010e9e0 con 0x7fea30103170 2024-08-31T05:32:27.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.758+0000 7fea2effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea30102850 0x7fea3019d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.758+0000 7fea2effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea30102850 0x7fea3019d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58232/0 (socket says 172.21.15.67:58232) 2024-08-31T05:32:27.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.758+0000 7fea2effd640 1 -- 172.21.15.67:0/2441247364 learned_addr learned my addr 172.21.15.67:0/2441247364 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:27.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.758+0000 7fea2e7fc640 1 --2- 172.21.15.67:0/2441247364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea30103170 0x7fea3019d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.758+0000 7fea2effd640 1 -- 172.21.15.67:0/2441247364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea30103170 msgr2=0x7fea3019d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:27.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.758+0000 7fea2effd640 1 --2- 172.21.15.67:0/2441247364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea30103170 0x7fea3019d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.758+0000 7fea2effd640 1 -- 172.21.15.67:0/2441247364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3019dfe0 con 0x7fea30102850 2024-08-31T05:32:27.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.758+0000 7fea2effd640 1 --2- 172.21.15.67:0/2441247364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea30102850 0x7fea3019d3f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fea2000cc60 tx=0x7fea2000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:27.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.758+0000 7fea27fff640 1 -- 172.21.15.67:0/2441247364 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea2000ce10 con 0x7fea30102850 2024-08-31T05:32:27.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.759+0000 7fea27fff640 1 -- 172.21.15.67:0/2441247364 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea2000f910 con 0x7fea30102850 2024-08-31T05:32:27.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.759+0000 7fea355ec640 1 -- 172.21.15.67:0/2441247364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea301976d0 con 0x7fea30102850 2024-08-31T05:32:27.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.759+0000 7fea27fff640 1 -- 172.21.15.67:0/2441247364 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea20018ae0 con 0x7fea30102850 2024-08-31T05:32:27.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.759+0000 7fea355ec640 1 -- 172.21.15.67:0/2441247364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea30197c30 con 0x7fea30102850 2024-08-31T05:32:27.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.760+0000 7fea355ec640 1 -- 172.21.15.67:0/2441247364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea3006ab40 con 0x7fea30102850 2024-08-31T05:32:27.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.760+0000 7fea27fff640 1 -- 172.21.15.67:0/2441247364 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fea20018ca0 con 0x7fea30102850 2024-08-31T05:32:27.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.761+0000 7fea27fff640 1 --2- 172.21.15.67:0/2441247364 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fea1c079e00 0x7fea1c07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.761+0000 7fea27fff640 1 -- 172.21.15.67:0/2441247364 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7fea2009d060 con 0x7fea30102850 2024-08-31T05:32:27.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.761+0000 7fea2e7fc640 1 --2- 172.21.15.67:0/2441247364 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fea1c079e00 0x7fea1c07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.761+0000 7fea2e7fc640 1 --2- 172.21.15.67:0/2441247364 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fea1c079e00 0x7fea1c07c2c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fea301986f0 tx=0x7fea18031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:27.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.765+0000 7fea27fff640 1 -- 172.21.15.67:0/2441247364 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fea20014030 con 0x7fea30102850 2024-08-31T05:32:27.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.991+0000 7fea355ec640 1 -- 172.21.15.67:0/2441247364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) -- 0x7fea30102c30 con 0x7fea30102850 2024-08-31T05:32:27.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.992+0000 7fea27fff640 1 -- 172.21.15.67:0/2441247364 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v36) ==== 107+0+5310 (secure 0 0 0) 0x7fea20064a30 con 0x7fea30102850 2024-08-31T05:32:27.993 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:27.994 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":17,"btime":"2024-08-31T05:29:02:488038+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":24307,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2383176383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2383176383},{"type":"v1","addr":"172.21.15.73:6825","nonce":2383176383}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34318,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/57850643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":57850643},{"type":"v1","addr":"172.21.15.67:6829","nonce":57850643}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:29:00.475526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14554},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14554":{"gid":14554,"name":"cephfs.smithi067.tskvpt","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6827/2961844124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2961844124},{"type":"v1","addr":"172.21.15.67:6827","nonce":2961844124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14554,"qdb_cluster":[14554]},"id":1}]} 2024-08-31T05:32:27.994 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 17 2024-08-31T05:32:27.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.994+0000 7fea355ec640 1 -- 172.21.15.67:0/2441247364 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fea1c079e00 msgr2=0x7fea1c07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:27.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.994+0000 7fea355ec640 1 --2- 172.21.15.67:0/2441247364 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fea1c079e00 0x7fea1c07c2c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fea301986f0 tx=0x7fea18031400 comp rx=0 tx=0).stop 2024-08-31T05:32:27.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.994+0000 7fea355ec640 1 -- 172.21.15.67:0/2441247364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea30102850 msgr2=0x7fea3019d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:27.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.994+0000 7fea355ec640 1 --2- 172.21.15.67:0/2441247364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea30102850 0x7fea3019d3f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fea2000cc60 tx=0x7fea2000a620 comp rx=0 tx=0).stop 2024-08-31T05:32:27.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.994+0000 7fea355ec640 1 -- 172.21.15.67:0/2441247364 shutdown_connections 2024-08-31T05:32:27.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.994+0000 7fea355ec640 1 --2- 172.21.15.67:0/2441247364 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fea1c079e00 0x7fea1c07c2c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.994+0000 7fea355ec640 1 --2- 172.21.15.67:0/2441247364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea30103170 0x7fea3019d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.994+0000 7fea355ec640 1 --2- 172.21.15.67:0/2441247364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea30102850 0x7fea3019d3f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.994+0000 7fea355ec640 1 -- 172.21.15.67:0/2441247364 >> 172.21.15.67:0/2441247364 conn(0x7fea300fc270 msgr2=0x7fea30108cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:27.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.994+0000 7fea355ec640 1 -- 172.21.15.67:0/2441247364 shutdown_connections 2024-08-31T05:32:27.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:27.994+0000 7fea355ec640 1 -- 172.21.15.67:0/2441247364 wait complete. 2024-08-31T05:32:28.285 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:28 smithi067 ceph-mon[99941]: pgmap v363: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:28.285 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:28 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2441247364' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-08-31T05:32:28.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:28 smithi073 ceph-mon[71452]: pgmap v363: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:28.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:28 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2441247364' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-08-31T05:32:28.610 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-08-31T05:32:28.610 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 18 2024-08-31T05:32:28.871 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.369+0000 7fd42ddd5640 1 -- 172.21.15.67:0/228665962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd428102860 msgr2=0x7fd428102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.369+0000 7fd42ddd5640 1 --2- 172.21.15.67:0/228665962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd428102860 0x7fd428102c40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd418009880 tx=0x7fd41802a530 comp rx=0 tx=0).stop 2024-08-31T05:32:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.369+0000 7fd42ddd5640 1 -- 172.21.15.67:0/228665962 shutdown_connections 2024-08-31T05:32:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.369+0000 7fd42ddd5640 1 --2- 172.21.15.67:0/228665962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd428103180 0x7fd42810b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.369+0000 7fd42ddd5640 1 --2- 172.21.15.67:0/228665962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd428102860 0x7fd428102c40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.369+0000 7fd42ddd5640 1 -- 172.21.15.67:0/228665962 >> 172.21.15.67:0/228665962 conn(0x7fd4280fc2c0 msgr2=0x7fd4280fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.369+0000 7fd42ddd5640 1 -- 172.21.15.67:0/228665962 shutdown_connections 2024-08-31T05:32:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.369+0000 7fd42ddd5640 1 -- 172.21.15.67:0/228665962 wait complete. 2024-08-31T05:32:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.369+0000 7fd42ddd5640 1 Processor -- start 2024-08-31T05:32:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.369+0000 7fd42ddd5640 1 -- start start 2024-08-31T05:32:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd42ddd5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd428102860 0x7fd42819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd42ddd5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd428103180 0x7fd42819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd42ddd5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd42810ebf0 con 0x7fd428103180 2024-08-31T05:32:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd42ddd5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd42810ea70 con 0x7fd428102860 2024-08-31T05:32:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd426ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd428103180 0x7fd42819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd426ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd428103180 0x7fd42819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37522/0 (socket says 172.21.15.67:37522) 2024-08-31T05:32:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd426ffd640 1 -- 172.21.15.67:0/2869025276 learned_addr learned my addr 172.21.15.67:0/2869025276 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd4277fe640 1 --2- 172.21.15.67:0/2869025276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd428102860 0x7fd42819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd426ffd640 1 -- 172.21.15.67:0/2869025276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd428102860 msgr2=0x7fd42819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd426ffd640 1 --2- 172.21.15.67:0/2869025276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd428102860 0x7fd42819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd426ffd640 1 -- 172.21.15.67:0/2869025276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd428197700 con 0x7fd428103180 2024-08-31T05:32:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd426ffd640 1 --2- 172.21.15.67:0/2869025276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd428103180 0x7fd42819db70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00b370 tx=0x7fd41c00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd424ff9640 1 -- 172.21.15.67:0/2869025276 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd41c015020 con 0x7fd428103180 2024-08-31T05:32:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd424ff9640 1 -- 172.21.15.67:0/2869025276 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd41c011af0 con 0x7fd428103180 2024-08-31T05:32:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd42ddd5640 1 -- 172.21.15.67:0/2869025276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4281979f0 con 0x7fd428103180 2024-08-31T05:32:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd424ff9640 1 -- 172.21.15.67:0/2869025276 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd41c010d60 con 0x7fd428103180 2024-08-31T05:32:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.370+0000 7fd42ddd5640 1 -- 172.21.15.67:0/2869025276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd428197f50 con 0x7fd428103180 2024-08-31T05:32:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.372+0000 7fd42ddd5640 1 -- 172.21.15.67:0/2869025276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd42806a830 con 0x7fd428103180 2024-08-31T05:32:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.372+0000 7fd424ff9640 1 -- 172.21.15.67:0/2869025276 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fd41c018020 con 0x7fd428103180 2024-08-31T05:32:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.373+0000 7fd424ff9640 1 --2- 172.21.15.67:0/2869025276 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd410079e00 0x7fd41007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.373+0000 7fd4277fe640 1 --2- 172.21.15.67:0/2869025276 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd410079e00 0x7fd41007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:29.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.373+0000 7fd424ff9640 1 -- 172.21.15.67:0/2869025276 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7fd41c09c370 con 0x7fd428103180 2024-08-31T05:32:29.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.373+0000 7fd4277fe640 1 --2- 172.21.15.67:0/2869025276 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd410079e00 0x7fd41007c2c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd4180096c0 tx=0x7fd418031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:29.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.377+0000 7fd424ff9640 1 -- 172.21.15.67:0/2869025276 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd41c01f020 con 0x7fd428103180 2024-08-31T05:32:29.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.596+0000 7fd42ddd5640 1 -- 172.21.15.67:0/2869025276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) -- 0x7fd428198c30 con 0x7fd428103180 2024-08-31T05:32:29.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.597+0000 7fd424ff9640 1 -- 172.21.15.67:0/2869025276 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v36) ==== 107+0+4445 (secure 0 0 0) 0x7fd41c063d40 con 0x7fd428103180 2024-08-31T05:32:29.599 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:29.599 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":18,"btime":"2024-08-31T05:29:05:236967+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":24307,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2383176383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2383176383},{"type":"v1","addr":"172.21.15.73:6825","nonce":2383176383}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34318,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/57850643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":57850643},{"type":"v1","addr":"172.21.15.67:6829","nonce":57850643}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:29:05.236963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T05:32:29.599 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 18 2024-08-31T05:32:29.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.599+0000 7fd42ddd5640 1 -- 172.21.15.67:0/2869025276 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd410079e00 msgr2=0x7fd41007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:29.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.599+0000 7fd42ddd5640 1 --2- 172.21.15.67:0/2869025276 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd410079e00 0x7fd41007c2c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd4180096c0 tx=0x7fd418031400 comp rx=0 tx=0).stop 2024-08-31T05:32:29.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.599+0000 7fd42ddd5640 1 -- 172.21.15.67:0/2869025276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd428103180 msgr2=0x7fd42819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:29.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.599+0000 7fd42ddd5640 1 --2- 172.21.15.67:0/2869025276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd428103180 0x7fd42819db70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00b370 tx=0x7fd41c00b830 comp rx=0 tx=0).stop 2024-08-31T05:32:29.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.599+0000 7fd42ddd5640 1 -- 172.21.15.67:0/2869025276 shutdown_connections 2024-08-31T05:32:29.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.599+0000 7fd42ddd5640 1 --2- 172.21.15.67:0/2869025276 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fd410079e00 0x7fd41007c2c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:29.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.599+0000 7fd42ddd5640 1 --2- 172.21.15.67:0/2869025276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd428103180 0x7fd42819db70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:29.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.599+0000 7fd42ddd5640 1 --2- 172.21.15.67:0/2869025276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd428102860 0x7fd42819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:29.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.599+0000 7fd42ddd5640 1 -- 172.21.15.67:0/2869025276 >> 172.21.15.67:0/2869025276 conn(0x7fd4280fc2c0 msgr2=0x7fd428108c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:29.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.600+0000 7fd42ddd5640 1 -- 172.21.15.67:0/2869025276 shutdown_connections 2024-08-31T05:32:29.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:29.600+0000 7fd42ddd5640 1 -- 172.21.15.67:0/2869025276 wait complete. 2024-08-31T05:32:29.898 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:29 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2869025276' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-08-31T05:32:29.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:29 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2869025276' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-08-31T05:32:30.202 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-08-31T05:32:30.203 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 19 2024-08-31T05:32:30.459 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:30.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:30 smithi067 ceph-mon[99941]: pgmap v364: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:30.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.915+0000 7f715217c640 1 -- 172.21.15.67:0/2537348341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714c106660 msgr2=0x7f714c106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:30.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.915+0000 7f715217c640 1 --2- 172.21.15.67:0/2537348341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714c106660 0x7f714c106a40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f713c009880 tx=0x7f713c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.915+0000 7f715217c640 1 -- 172.21.15.67:0/2537348341 shutdown_connections 2024-08-31T05:32:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.915+0000 7f715217c640 1 --2- 172.21.15.67:0/2537348341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f714c1005b0 0x7f714c100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.915+0000 7f715217c640 1 --2- 172.21.15.67:0/2537348341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714c106660 0x7f714c106a40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.915+0000 7f715217c640 1 -- 172.21.15.67:0/2537348341 >> 172.21.15.67:0/2537348341 conn(0x7f714c0fc270 msgr2=0x7f714c0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.915+0000 7f715217c640 1 -- 172.21.15.67:0/2537348341 shutdown_connections 2024-08-31T05:32:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.915+0000 7f715217c640 1 -- 172.21.15.67:0/2537348341 wait complete. 2024-08-31T05:32:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.916+0000 7f715217c640 1 Processor -- start 2024-08-31T05:32:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.916+0000 7f715217c640 1 -- start start 2024-08-31T05:32:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.916+0000 7f715217c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f714c1005b0 0x7f714c1976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.916+0000 7f715217c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714c106660 0x7f714c197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.916+0000 7f715217c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f714c10da50 con 0x7f714c106660 2024-08-31T05:32:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.916+0000 7f715217c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f714c10d8d0 con 0x7f714c1005b0 2024-08-31T05:32:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.916+0000 7f714affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714c106660 0x7f714c197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.916+0000 7f714affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714c106660 0x7f714c197c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37540/0 (socket says 172.21.15.67:37540) 2024-08-31T05:32:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.916+0000 7f714affd640 1 -- 172.21.15.67:0/2552726924 learned_addr learned my addr 172.21.15.67:0/2552726924 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.916+0000 7f714b7fe640 1 --2- 172.21.15.67:0/2552726924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f714c1005b0 0x7f714c1976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.916+0000 7f714affd640 1 -- 172.21.15.67:0/2552726924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f714c1005b0 msgr2=0x7f714c1976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.916+0000 7f714affd640 1 --2- 172.21.15.67:0/2552726924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f714c1005b0 0x7f714c1976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.916+0000 7f714affd640 1 -- 172.21.15.67:0/2552726924 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714c19bfb0 con 0x7f714c106660 2024-08-31T05:32:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.917+0000 7f714affd640 1 --2- 172.21.15.67:0/2552726924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714c106660 0x7f714c197c20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f713400d8d0 tx=0x7f713400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.917+0000 7f7148ff9640 1 -- 172.21.15.67:0/2552726924 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7134017070 con 0x7f714c106660 2024-08-31T05:32:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.917+0000 7f7148ff9640 1 -- 172.21.15.67:0/2552726924 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7134010460 con 0x7f714c106660 2024-08-31T05:32:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.917+0000 7f715217c640 1 -- 172.21.15.67:0/2552726924 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714c19c2a0 con 0x7f714c106660 2024-08-31T05:32:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.917+0000 7f7148ff9640 1 -- 172.21.15.67:0/2552726924 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f713400f5f0 con 0x7f714c106660 2024-08-31T05:32:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.917+0000 7f715217c640 1 -- 172.21.15.67:0/2552726924 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f714c19c830 con 0x7f714c106660 2024-08-31T05:32:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.918+0000 7f715217c640 1 -- 172.21.15.67:0/2552726924 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f714c101cd0 con 0x7f714c106660 2024-08-31T05:32:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.919+0000 7f7148ff9640 1 -- 172.21.15.67:0/2552726924 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f7134009a30 con 0x7f714c106660 2024-08-31T05:32:30.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.919+0000 7f7148ff9640 1 --2- 172.21.15.67:0/2552726924 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7138079e00 0x7f713807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.919+0000 7f7148ff9640 1 -- 172.21.15.67:0/2552726924 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f713409c9c0 con 0x7f714c106660 2024-08-31T05:32:30.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.919+0000 7f714b7fe640 1 --2- 172.21.15.67:0/2552726924 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7138079e00 0x7f713807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.920+0000 7f714b7fe640 1 --2- 172.21.15.67:0/2552726924 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7138079e00 0x7f713807c2c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f713c0096c0 tx=0x7f713c004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:30.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:30.924+0000 7f7148ff9640 1 -- 172.21.15.67:0/2552726924 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7134064330 con 0x7f714c106660 2024-08-31T05:32:30.949 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:30 smithi073 ceph-mon[71452]: pgmap v364: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:31.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:31.143+0000 7f715217c640 1 -- 172.21.15.67:0/2552726924 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) -- 0x7f714c19cae0 con 0x7f714c106660 2024-08-31T05:32:31.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:31.144+0000 7f7148ff9640 1 -- 172.21.15.67:0/2552726924 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v36) ==== 107+0+4456 (secure 0 0 0) 0x7f71340684a0 con 0x7f714c106660 2024-08-31T05:32:31.146 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:31.146 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":19,"btime":"2024-08-31T05:29:05:244360+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2383176383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2383176383},{"type":"v1","addr":"172.21.15.73:6825","nonce":2383176383}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34318,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/57850643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":57850643},{"type":"v1","addr":"172.21.15.67:6829","nonce":57850643}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:29:05.244347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24299":{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":0,"incarnation":19,"state":"up:replay","state_seq":2,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T05:32:31.146 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 19 2024-08-31T05:32:31.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:31.147+0000 7f715217c640 1 -- 172.21.15.67:0/2552726924 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7138079e00 msgr2=0x7f713807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:31.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:31.147+0000 7f715217c640 1 --2- 172.21.15.67:0/2552726924 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7138079e00 0x7f713807c2c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f713c0096c0 tx=0x7f713c004f30 comp rx=0 tx=0).stop 2024-08-31T05:32:31.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:31.147+0000 7f715217c640 1 -- 172.21.15.67:0/2552726924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714c106660 msgr2=0x7f714c197c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:31.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:31.147+0000 7f715217c640 1 --2- 172.21.15.67:0/2552726924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714c106660 0x7f714c197c20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f713400d8d0 tx=0x7f713400dd90 comp rx=0 tx=0).stop 2024-08-31T05:32:31.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:31.147+0000 7f715217c640 1 -- 172.21.15.67:0/2552726924 shutdown_connections 2024-08-31T05:32:31.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:31.147+0000 7f715217c640 1 --2- 172.21.15.67:0/2552726924 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f7138079e00 0x7f713807c2c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:31.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:31.147+0000 7f715217c640 1 --2- 172.21.15.67:0/2552726924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f714c106660 0x7f714c197c20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:31.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:31.147+0000 7f715217c640 1 --2- 172.21.15.67:0/2552726924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f714c1005b0 0x7f714c1976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:31.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:31.147+0000 7f715217c640 1 -- 172.21.15.67:0/2552726924 >> 172.21.15.67:0/2552726924 conn(0x7f714c0fc270 msgr2=0x7f714c104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:31.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:31.147+0000 7f715217c640 1 -- 172.21.15.67:0/2552726924 shutdown_connections 2024-08-31T05:32:31.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:31.147+0000 7f715217c640 1 -- 172.21.15.67:0/2552726924 wait complete. 2024-08-31T05:32:31.772 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:31 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2552726924' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-08-31T05:32:31.803 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-08-31T05:32:31.804 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 20 2024-08-31T05:32:31.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:31 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2552726924' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-08-31T05:32:32.061 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.496+0000 7f3929ecd640 1 -- 172.21.15.67:0/63206681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39241076a0 msgr2=0x7f3924107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.496+0000 7f3929ecd640 1 --2- 172.21.15.67:0/63206681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39241076a0 0x7f3924107a80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3914009880 tx=0x7f391402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.496+0000 7f3929ecd640 1 -- 172.21.15.67:0/63206681 shutdown_connections 2024-08-31T05:32:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.496+0000 7f3929ecd640 1 --2- 172.21.15.67:0/63206681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39241016a0 0x7f3924101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.496+0000 7f3929ecd640 1 --2- 172.21.15.67:0/63206681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39241076a0 0x7f3924107a80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.496+0000 7f3929ecd640 1 -- 172.21.15.67:0/63206681 >> 172.21.15.67:0/63206681 conn(0x7f39240fd3a0 msgr2=0x7f39240ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:32.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.497+0000 7f3929ecd640 1 -- 172.21.15.67:0/63206681 shutdown_connections 2024-08-31T05:32:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.497+0000 7f3929ecd640 1 -- 172.21.15.67:0/63206681 wait complete. 2024-08-31T05:32:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.497+0000 7f3929ecd640 1 Processor -- start 2024-08-31T05:32:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.497+0000 7f3929ecd640 1 -- start start 2024-08-31T05:32:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.498+0000 7f3929ecd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39241016a0 0x7f3924197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.498+0000 7f3929ecd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39241076a0 0x7f3924197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.498+0000 7f3929ecd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f392410eb50 con 0x7f39241016a0 2024-08-31T05:32:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.498+0000 7f3929ecd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f392410e9d0 con 0x7f39241076a0 2024-08-31T05:32:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.498+0000 7f39237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39241016a0 0x7f3924197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.498+0000 7f39237fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39241016a0 0x7f3924197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37562/0 (socket says 172.21.15.67:37562) 2024-08-31T05:32:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.498+0000 7f39237fe640 1 -- 172.21.15.67:0/4259338778 learned_addr learned my addr 172.21.15.67:0/4259338778 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.498+0000 7f3922ffd640 1 --2- 172.21.15.67:0/4259338778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39241076a0 0x7f3924197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.498+0000 7f39237fe640 1 -- 172.21.15.67:0/4259338778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39241076a0 msgr2=0x7f3924197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.498+0000 7f39237fe640 1 --2- 172.21.15.67:0/4259338778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39241076a0 0x7f3924197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.498+0000 7f39237fe640 1 -- 172.21.15.67:0/4259338778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3924198340 con 0x7f39241016a0 2024-08-31T05:32:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.498+0000 7f39237fe640 1 --2- 172.21.15.67:0/4259338778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39241016a0 0x7f3924197750 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3914031460 tx=0x7f39140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.499+0000 7f3920ff9640 1 -- 172.21.15.67:0/4259338778 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f391403f070 con 0x7f39241016a0 2024-08-31T05:32:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.499+0000 7f3929ecd640 1 -- 172.21.15.67:0/4259338778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392419c080 con 0x7f39241016a0 2024-08-31T05:32:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.499+0000 7f3920ff9640 1 -- 172.21.15.67:0/4259338778 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3914004cf0 con 0x7f39241016a0 2024-08-31T05:32:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.499+0000 7f3920ff9640 1 -- 172.21.15.67:0/4259338778 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3914035030 con 0x7f39241016a0 2024-08-31T05:32:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.499+0000 7f3929ecd640 1 -- 172.21.15.67:0/4259338778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392419c5b0 con 0x7f39241016a0 2024-08-31T05:32:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.500+0000 7f3929ecd640 1 -- 172.21.15.67:0/4259338778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3924102de0 con 0x7f39241016a0 2024-08-31T05:32:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.500+0000 7f3920ff9640 1 -- 172.21.15.67:0/4259338778 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f3914042070 con 0x7f39241016a0 2024-08-31T05:32:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.501+0000 7f3920ff9640 1 --2- 172.21.15.67:0/4259338778 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f390c079e00 0x7f390c07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.501+0000 7f3920ff9640 1 -- 172.21.15.67:0/4259338778 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f39140bd4f0 con 0x7f39241016a0 2024-08-31T05:32:32.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.501+0000 7f3922ffd640 1 --2- 172.21.15.67:0/4259338778 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f390c079e00 0x7f390c07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.501+0000 7f3922ffd640 1 --2- 172.21.15.67:0/4259338778 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f390c079e00 0x7f390c07c2c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3918005e10 tx=0x7f3918005da0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:32.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.505+0000 7f3920ff9640 1 -- 172.21.15.67:0/4259338778 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3914084ec0 con 0x7f39241016a0 2024-08-31T05:32:32.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.735+0000 7f3929ecd640 1 -- 172.21.15.67:0/4259338778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) -- 0x7f39241048b0 con 0x7f39241016a0 2024-08-31T05:32:32.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.736+0000 7f3920ff9640 1 -- 172.21.15.67:0/4259338778 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v36) ==== 107+0+5303 (secure 0 0 0) 0x7f391408d370 con 0x7f39241016a0 2024-08-31T05:32:32.738 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:32.739 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"btime":"2024-08-31T05:29:11:250300+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2383176383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2383176383},{"type":"v1","addr":"172.21.15.73:6825","nonce":2383176383}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34318,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/57850643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":57850643},{"type":"v1","addr":"172.21.15.67:6829","nonce":57850643}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:29:05.244347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24299":{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":0,"incarnation":19,"state":"up:replay","state_seq":2,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T05:32:32.739 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 20 2024-08-31T05:32:32.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.738+0000 7f3929ecd640 1 -- 172.21.15.67:0/4259338778 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f390c079e00 msgr2=0x7f390c07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.738+0000 7f3929ecd640 1 --2- 172.21.15.67:0/4259338778 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f390c079e00 0x7f390c07c2c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3918005e10 tx=0x7f3918005da0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.738+0000 7f3929ecd640 1 -- 172.21.15.67:0/4259338778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39241016a0 msgr2=0x7f3924197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.738+0000 7f3929ecd640 1 --2- 172.21.15.67:0/4259338778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39241016a0 0x7f3924197750 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3914031460 tx=0x7f39140048f0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.738+0000 7f3929ecd640 1 -- 172.21.15.67:0/4259338778 shutdown_connections 2024-08-31T05:32:32.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.738+0000 7f3929ecd640 1 --2- 172.21.15.67:0/4259338778 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f390c079e00 0x7f390c07c2c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.738+0000 7f3929ecd640 1 --2- 172.21.15.67:0/4259338778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39241076a0 0x7f3924197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.738+0000 7f3929ecd640 1 --2- 172.21.15.67:0/4259338778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39241016a0 0x7f3924197750 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.738+0000 7f3929ecd640 1 -- 172.21.15.67:0/4259338778 >> 172.21.15.67:0/4259338778 conn(0x7f39240fd3a0 msgr2=0x7f39240fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:32.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.739+0000 7f3929ecd640 1 -- 172.21.15.67:0/4259338778 shutdown_connections 2024-08-31T05:32:32.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:32.739+0000 7f3929ecd640 1 -- 172.21.15.67:0/4259338778 wait complete. 2024-08-31T05:32:32.749 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:32 smithi067 ceph-mon[99941]: pgmap v365: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:32.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:32 smithi073 ceph-mon[71452]: pgmap v365: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:33.342 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-08-31T05:32:33.342 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 21 2024-08-31T05:32:33.598 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:33.841 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:33 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/4259338778' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-08-31T05:32:33.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:33 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/4259338778' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-08-31T05:32:34.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.064+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/3416020169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f38100b80 msgr2=0x7f2f38106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:34.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.064+0000 7f2f3d6bd640 1 --2- 172.21.15.67:0/3416020169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f38100b80 0x7f2f38106360 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009880 tx=0x7f2f2002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:34.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.064+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/3416020169 shutdown_connections 2024-08-31T05:32:34.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.064+0000 7f2f3d6bd640 1 --2- 172.21.15.67:0/3416020169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f38100b80 0x7f2f38106360 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:34.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.064+0000 7f2f3d6bd640 1 --2- 172.21.15.67:0/3416020169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f381001d0 0x7f2f381005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:34.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.064+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/3416020169 >> 172.21.15.67:0/3416020169 conn(0x7f2f38076f80 msgr2=0x7f2f38077390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:34.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.064+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/3416020169 shutdown_connections 2024-08-31T05:32:34.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.064+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/3416020169 wait complete. 2024-08-31T05:32:34.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.064+0000 7f2f3d6bd640 1 Processor -- start 2024-08-31T05:32:34.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.064+0000 7f2f3d6bd640 1 -- start start 2024-08-31T05:32:34.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.065+0000 7f2f3d6bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f381001d0 0x7f2f3819d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:34.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.065+0000 7f2f3d6bd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f38100b80 0x7f2f3819d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:34.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.065+0000 7f2f3d6bd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3810eb60 con 0x7f2f381001d0 2024-08-31T05:32:34.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.065+0000 7f2f3d6bd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3810e9e0 con 0x7f2f38100b80 2024-08-31T05:32:34.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.065+0000 7f2f36ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f381001d0 0x7f2f3819d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:34.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.065+0000 7f2f36ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f381001d0 0x7f2f3819d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37574/0 (socket says 172.21.15.67:37574) 2024-08-31T05:32:34.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.065+0000 7f2f36ffd640 1 -- 172.21.15.67:0/188757433 learned_addr learned my addr 172.21.15.67:0/188757433 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:34.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.065+0000 7f2f2ffff640 1 --2- 172.21.15.67:0/188757433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f38100b80 0x7f2f3819d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.065+0000 7f2f36ffd640 1 -- 172.21.15.67:0/188757433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f38100b80 msgr2=0x7f2f3819d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.065+0000 7f2f36ffd640 1 --2- 172.21.15.67:0/188757433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f38100b80 0x7f2f3819d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.065+0000 7f2f36ffd640 1 -- 172.21.15.67:0/188757433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f381975d0 con 0x7f2f381001d0 2024-08-31T05:32:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.065+0000 7f2f2ffff640 1 --2- 172.21.15.67:0/188757433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f38100b80 0x7f2f3819d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:32:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.065+0000 7f2f36ffd640 1 --2- 172.21.15.67:0/188757433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f381001d0 0x7f2f3819d410 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800d6f0 tx=0x7f2f2800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.065+0000 7f2f34ff9640 1 -- 172.21.15.67:0/188757433 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f28017070 con 0x7f2f381001d0 2024-08-31T05:32:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.066+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/188757433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f381978c0 con 0x7f2f381001d0 2024-08-31T05:32:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.066+0000 7f2f34ff9640 1 -- 172.21.15.67:0/188757433 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f2800de00 con 0x7f2f381001d0 2024-08-31T05:32:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.066+0000 7f2f34ff9640 1 -- 172.21.15.67:0/188757433 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f28004bb0 con 0x7f2f381001d0 2024-08-31T05:32:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.066+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/188757433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f38197e50 con 0x7f2f381001d0 2024-08-31T05:32:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.067+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/188757433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f38069580 con 0x7f2f381001d0 2024-08-31T05:32:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.067+0000 7f2f34ff9640 1 -- 172.21.15.67:0/188757433 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f2f28004e60 con 0x7f2f381001d0 2024-08-31T05:32:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.068+0000 7f2f34ff9640 1 --2- 172.21.15.67:0/188757433 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2f24079e00 0x7f2f2407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.068+0000 7f2f2ffff640 1 --2- 172.21.15.67:0/188757433 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2f24079e00 0x7f2f2407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:34.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.068+0000 7f2f34ff9640 1 -- 172.21.15.67:0/188757433 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f2f2809c660 con 0x7f2f381001d0 2024-08-31T05:32:34.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.068+0000 7f2f2ffff640 1 --2- 172.21.15.67:0/188757433 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2f24079e00 0x7f2f2407c2c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2f20000c00 tx=0x7f2f200095f0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:34.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.073+0000 7f2f34ff9640 1 -- 172.21.15.67:0/188757433 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2f28064030 con 0x7f2f381001d0 2024-08-31T05:32:34.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.300+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/188757433 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) -- 0x7f2f38109c40 con 0x7f2f381001d0 2024-08-31T05:32:34.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.301+0000 7f2f34ff9640 1 -- 172.21.15.67:0/188757433 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v36) ==== 107+0+5308 (secure 0 0 0) 0x7f2f280681a0 con 0x7f2f381001d0 2024-08-31T05:32:34.304 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:34.304 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"btime":"2024-08-31T05:29:13:606682+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2383176383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2383176383},{"type":"v1","addr":"172.21.15.73:6825","nonce":2383176383}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34318,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/57850643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":57850643},{"type":"v1","addr":"172.21.15.67:6829","nonce":57850643}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:29:13.556481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24299":{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":0,"incarnation":19,"state":"up:reconnect","state_seq":162,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T05:32:34.304 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 21 2024-08-31T05:32:34.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.304+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/188757433 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2f24079e00 msgr2=0x7f2f2407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:34.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.304+0000 7f2f3d6bd640 1 --2- 172.21.15.67:0/188757433 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2f24079e00 0x7f2f2407c2c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2f20000c00 tx=0x7f2f200095f0 comp rx=0 tx=0).stop 2024-08-31T05:32:34.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.304+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/188757433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f381001d0 msgr2=0x7f2f3819d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:34.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.304+0000 7f2f3d6bd640 1 --2- 172.21.15.67:0/188757433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f381001d0 0x7f2f3819d410 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800d6f0 tx=0x7f2f2800dbb0 comp rx=0 tx=0).stop 2024-08-31T05:32:34.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.304+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/188757433 shutdown_connections 2024-08-31T05:32:34.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.304+0000 7f2f3d6bd640 1 --2- 172.21.15.67:0/188757433 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2f24079e00 0x7f2f2407c2c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:34.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.304+0000 7f2f3d6bd640 1 --2- 172.21.15.67:0/188757433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f38100b80 0x7f2f3819d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:34.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.304+0000 7f2f3d6bd640 1 --2- 172.21.15.67:0/188757433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f381001d0 0x7f2f3819d410 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:34.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.304+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/188757433 >> 172.21.15.67:0/188757433 conn(0x7f2f38076f80 msgr2=0x7f2f380fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:34.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.304+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/188757433 shutdown_connections 2024-08-31T05:32:34.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:34.304+0000 7f2f3d6bd640 1 -- 172.21.15.67:0/188757433 wait complete. 2024-08-31T05:32:34.938 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:34 smithi067 ceph-mon[99941]: pgmap v366: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:34.938 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:34 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/188757433' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-08-31T05:32:34.938 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:32:34.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:34 smithi073 ceph-mon[71452]: pgmap v366: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:34.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:34 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/188757433' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-08-31T05:32:34.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:32:34.966 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-08-31T05:32:34.966 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 22 2024-08-31T05:32:35.219 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.696+0000 7f2251534640 1 -- 172.21.15.67:0/3300791147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f224c106660 msgr2=0x7f224c106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.696+0000 7f2251534640 1 --2- 172.21.15.67:0/3300791147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f224c106660 0x7f224c106a40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f223c009c20 tx=0x7f223c02a970 comp rx=0 tx=0).stop 2024-08-31T05:32:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.696+0000 7f2251534640 1 -- 172.21.15.67:0/3300791147 shutdown_connections 2024-08-31T05:32:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.696+0000 7f2251534640 1 --2- 172.21.15.67:0/3300791147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c1005b0 0x7f224c100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.696+0000 7f2251534640 1 --2- 172.21.15.67:0/3300791147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f224c106660 0x7f224c106a40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.696+0000 7f2251534640 1 -- 172.21.15.67:0/3300791147 >> 172.21.15.67:0/3300791147 conn(0x7f224c0fc2f0 msgr2=0x7f224c0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.696+0000 7f2251534640 1 -- 172.21.15.67:0/3300791147 shutdown_connections 2024-08-31T05:32:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.696+0000 7f2251534640 1 -- 172.21.15.67:0/3300791147 wait complete. 2024-08-31T05:32:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.696+0000 7f2251534640 1 Processor -- start 2024-08-31T05:32:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.697+0000 7f2251534640 1 -- start start 2024-08-31T05:32:35.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.697+0000 7f2251534640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c1005b0 0x7f224c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:35.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.697+0000 7f2251534640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f224c106660 0x7f224c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:35.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.697+0000 7f2251534640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f224c10da70 con 0x7f224c106660 2024-08-31T05:32:35.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.697+0000 7f2251534640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f224c10d8f0 con 0x7f224c1005b0 2024-08-31T05:32:35.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.697+0000 7f224a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f224c106660 0x7f224c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:35.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.697+0000 7f224a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f224c106660 0x7f224c198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37596/0 (socket says 172.21.15.67:37596) 2024-08-31T05:32:35.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.697+0000 7f224a7fc640 1 -- 172.21.15.67:0/2373027411 learned_addr learned my addr 172.21.15.67:0/2373027411 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:35.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.697+0000 7f224affd640 1 --2- 172.21.15.67:0/2373027411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c1005b0 0x7f224c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:35.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.697+0000 7f224a7fc640 1 -- 172.21.15.67:0/2373027411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c1005b0 msgr2=0x7f224c198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:35.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.697+0000 7f224a7fc640 1 --2- 172.21.15.67:0/2373027411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c1005b0 0x7f224c198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:35.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.697+0000 7f224a7fc640 1 -- 172.21.15.67:0/2373027411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224c1990c0 con 0x7f224c106660 2024-08-31T05:32:35.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.697+0000 7f224a7fc640 1 --2- 172.21.15.67:0/2373027411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f224c106660 0x7f224c198ac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f223400d6f0 tx=0x7f223400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:35.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.698+0000 7f2243fff640 1 -- 172.21.15.67:0/2373027411 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2234017070 con 0x7f224c106660 2024-08-31T05:32:35.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.698+0000 7f2243fff640 1 -- 172.21.15.67:0/2373027411 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f223400de00 con 0x7f224c106660 2024-08-31T05:32:35.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.698+0000 7f2243fff640 1 -- 172.21.15.67:0/2373027411 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2234004bb0 con 0x7f224c106660 2024-08-31T05:32:35.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.698+0000 7f2251534640 1 -- 172.21.15.67:0/2373027411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f224c1993b0 con 0x7f224c106660 2024-08-31T05:32:35.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.698+0000 7f2251534640 1 -- 172.21.15.67:0/2373027411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f224c1a19b0 con 0x7f224c106660 2024-08-31T05:32:35.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.699+0000 7f2251534640 1 -- 172.21.15.67:0/2373027411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f224c101cd0 con 0x7f224c106660 2024-08-31T05:32:35.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.699+0000 7f2243fff640 1 -- 172.21.15.67:0/2373027411 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f2234004e60 con 0x7f224c106660 2024-08-31T05:32:35.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.700+0000 7f2243fff640 1 --2- 172.21.15.67:0/2373027411 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2238079e00 0x7f223807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:35.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.700+0000 7f2243fff640 1 -- 172.21.15.67:0/2373027411 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f223409c5b0 con 0x7f224c106660 2024-08-31T05:32:35.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.700+0000 7f224affd640 1 --2- 172.21.15.67:0/2373027411 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2238079e00 0x7f223807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:35.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.700+0000 7f224affd640 1 --2- 172.21.15.67:0/2373027411 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2238079e00 0x7f223807c2c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f223c009430 tx=0x7f223c03c040 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:35.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.704+0000 7f2243fff640 1 -- 172.21.15.67:0/2373027411 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f224c1993b0 con 0x7f224c106660 2024-08-31T05:32:35.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.925+0000 7f2251534640 1 -- 172.21.15.67:0/2373027411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) -- 0x7f224c108a80 con 0x7f224c106660 2024-08-31T05:32:35.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.926+0000 7f2243fff640 1 -- 172.21.15.67:0/2373027411 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v36) ==== 107+0+5305 (secure 0 0 0) 0x7f22340680f0 con 0x7f224c106660 2024-08-31T05:32:35.929 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:35.929 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":22,"btime":"2024-08-31T05:29:14:608306+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2383176383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2383176383},{"type":"v1","addr":"172.21.15.73:6825","nonce":2383176383}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34318,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/57850643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":57850643},{"type":"v1","addr":"172.21.15.67:6829","nonce":57850643}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:29:13.611264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24299":{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":0,"incarnation":19,"state":"up:rejoin","state_seq":163,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T05:32:35.929 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 22 2024-08-31T05:32:35.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.928+0000 7f2251534640 1 -- 172.21.15.67:0/2373027411 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2238079e00 msgr2=0x7f223807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:35.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.928+0000 7f2251534640 1 --2- 172.21.15.67:0/2373027411 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2238079e00 0x7f223807c2c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f223c009430 tx=0x7f223c03c040 comp rx=0 tx=0).stop 2024-08-31T05:32:35.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.928+0000 7f2251534640 1 -- 172.21.15.67:0/2373027411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f224c106660 msgr2=0x7f224c198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:35.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.928+0000 7f2251534640 1 --2- 172.21.15.67:0/2373027411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f224c106660 0x7f224c198ac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f223400d6f0 tx=0x7f223400dbb0 comp rx=0 tx=0).stop 2024-08-31T05:32:35.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.928+0000 7f2251534640 1 -- 172.21.15.67:0/2373027411 shutdown_connections 2024-08-31T05:32:35.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.928+0000 7f2251534640 1 --2- 172.21.15.67:0/2373027411 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f2238079e00 0x7f223807c2c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:35.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.928+0000 7f2251534640 1 --2- 172.21.15.67:0/2373027411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f224c106660 0x7f224c198ac0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:35.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.928+0000 7f2251534640 1 --2- 172.21.15.67:0/2373027411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c1005b0 0x7f224c198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:35.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.928+0000 7f2251534640 1 -- 172.21.15.67:0/2373027411 >> 172.21.15.67:0/2373027411 conn(0x7f224c0fc2f0 msgr2=0x7f224c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:35.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.929+0000 7f2251534640 1 -- 172.21.15.67:0/2373027411 shutdown_connections 2024-08-31T05:32:35.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:35.929+0000 7f2251534640 1 -- 172.21.15.67:0/2373027411 wait complete. 2024-08-31T05:32:36.522 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-08-31T05:32:36.522 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 23 2024-08-31T05:32:36.789 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:37.061 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:36 smithi067 ceph-mon[99941]: pgmap v367: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:37.061 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:36 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:32:37.062 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:36 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/2373027411' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-08-31T05:32:37.062 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:36 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:32:37.062 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:36 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:32:37.062 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:36 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:32:37.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:36 smithi073 ceph-mon[71452]: pgmap v367: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:36 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:32:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:36 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/2373027411' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-08-31T05:32:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:36 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:32:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:36 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:32:37.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:36 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:32:37.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.270+0000 7f00a2302640 1 -- 172.21.15.67:0/138139856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f009c1005c0 msgr2=0x7f009c100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:37.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.270+0000 7f00a2302640 1 --2- 172.21.15.67:0/138139856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f009c1005c0 0x7f009c100a40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0090009880 tx=0x7f009002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:37.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.270+0000 7f00a2302640 1 -- 172.21.15.67:0/138139856 shutdown_connections 2024-08-31T05:32:37.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.270+0000 7f00a2302640 1 --2- 172.21.15.67:0/138139856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f009c1005c0 0x7f009c100a40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:37.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.270+0000 7f00a2302640 1 --2- 172.21.15.67:0/138139856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f009c106650 0x7f009c106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:37.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.270+0000 7f00a2302640 1 -- 172.21.15.67:0/138139856 >> 172.21.15.67:0/138139856 conn(0x7f009c0fc2e0 msgr2=0x7f009c0fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:37.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.270+0000 7f00a2302640 1 -- 172.21.15.67:0/138139856 shutdown_connections 2024-08-31T05:32:37.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.270+0000 7f00a2302640 1 -- 172.21.15.67:0/138139856 wait complete. 2024-08-31T05:32:37.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.271+0000 7f00a2302640 1 Processor -- start 2024-08-31T05:32:37.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.271+0000 7f00a2302640 1 -- start start 2024-08-31T05:32:37.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.271+0000 7f00a2302640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f009c1005c0 0x7f009c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:37.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.271+0000 7f00a2302640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f009c106650 0x7f009c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:37.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.271+0000 7f00a2302640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f009c10da80 con 0x7f009c1005c0 2024-08-31T05:32:37.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.271+0000 7f00a2302640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f009c10d900 con 0x7f009c106650 2024-08-31T05:32:37.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.271+0000 7f009bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f009c1005c0 0x7f009c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:37.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.272+0000 7f009bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f009c1005c0 0x7f009c198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37622/0 (socket says 172.21.15.67:37622) 2024-08-31T05:32:37.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.272+0000 7f009bfff640 1 -- 172.21.15.67:0/3039452046 learned_addr learned my addr 172.21.15.67:0/3039452046 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:37.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.272+0000 7f009b7fe640 1 --2- 172.21.15.67:0/3039452046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f009c106650 0x7f009c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:37.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.272+0000 7f009bfff640 1 -- 172.21.15.67:0/3039452046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f009c106650 msgr2=0x7f009c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:37.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.272+0000 7f009bfff640 1 --2- 172.21.15.67:0/3039452046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f009c106650 0x7f009c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:37.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.272+0000 7f009bfff640 1 -- 172.21.15.67:0/3039452046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009c199070 con 0x7f009c1005c0 2024-08-31T05:32:37.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.272+0000 7f009bfff640 1 --2- 172.21.15.67:0/3039452046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f009c1005c0 0x7f009c198530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c8f0 tx=0x7f008c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:37.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.272+0000 7f00997fa640 1 -- 172.21.15.67:0/3039452046 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f008c0079b0 con 0x7f009c1005c0 2024-08-31T05:32:37.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.272+0000 7f00997fa640 1 -- 172.21.15.67:0/3039452046 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f008c0054e0 con 0x7f009c1005c0 2024-08-31T05:32:37.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.272+0000 7f00a2302640 1 -- 172.21.15.67:0/3039452046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f009c199360 con 0x7f009c1005c0 2024-08-31T05:32:37.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.272+0000 7f00997fa640 1 -- 172.21.15.67:0/3039452046 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f008c004dd0 con 0x7f009c1005c0 2024-08-31T05:32:37.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.272+0000 7f00a2302640 1 -- 172.21.15.67:0/3039452046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f009c1a1960 con 0x7f009c1005c0 2024-08-31T05:32:37.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.273+0000 7f00a2302640 1 -- 172.21.15.67:0/3039452046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f009c101d00 con 0x7f009c1005c0 2024-08-31T05:32:37.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.274+0000 7f00997fa640 1 -- 172.21.15.67:0/3039452046 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f008c005020 con 0x7f009c1005c0 2024-08-31T05:32:37.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.275+0000 7f00997fa640 1 --2- 172.21.15.67:0/3039452046 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0084079da0 0x7f008407c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:37.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.275+0000 7f009b7fe640 1 --2- 172.21.15.67:0/3039452046 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0084079da0 0x7f008407c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:37.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.275+0000 7f00997fa640 1 -- 172.21.15.67:0/3039452046 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f008c09c9c0 con 0x7f009c1005c0 2024-08-31T05:32:37.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.275+0000 7f009b7fe640 1 --2- 172.21.15.67:0/3039452046 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0084079da0 0x7f008407c260 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f009c06aaa0 tx=0x7f0090031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:37.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.279+0000 7f00997fa640 1 -- 172.21.15.67:0/3039452046 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f009c199360 con 0x7f009c1005c0 2024-08-31T05:32:37.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.502+0000 7f00a2302640 1 -- 172.21.15.67:0/3039452046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) -- 0x7f009c1a1c70 con 0x7f009c1005c0 2024-08-31T05:32:37.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.503+0000 7f00997fa640 1 -- 172.21.15.67:0/3039452046 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v36) ==== 107+0+5314 (secure 0 0 0) 0x7f008c014030 con 0x7f009c1005c0 2024-08-31T05:32:37.506 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:37.506 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":23,"btime":"2024-08-31T05:29:15:613831+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2383176383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2383176383},{"type":"v1","addr":"172.21.15.73:6825","nonce":2383176383}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34318,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/57850643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":57850643},{"type":"v1","addr":"172.21.15.67:6829","nonce":57850643}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:29:15.613825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24299":{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":0,"incarnation":19,"state":"up:active","state_seq":164,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24299,"qdb_cluster":[24299]},"id":1}]} 2024-08-31T05:32:37.507 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 23 2024-08-31T05:32:37.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.505+0000 7f00a2302640 1 -- 172.21.15.67:0/3039452046 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0084079da0 msgr2=0x7f008407c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:37.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.505+0000 7f00a2302640 1 --2- 172.21.15.67:0/3039452046 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0084079da0 0x7f008407c260 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f009c06aaa0 tx=0x7f0090031400 comp rx=0 tx=0).stop 2024-08-31T05:32:37.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.505+0000 7f00a2302640 1 -- 172.21.15.67:0/3039452046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f009c1005c0 msgr2=0x7f009c198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:37.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.505+0000 7f00a2302640 1 --2- 172.21.15.67:0/3039452046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f009c1005c0 0x7f009c198530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c8f0 tx=0x7f008c00cdb0 comp rx=0 tx=0).stop 2024-08-31T05:32:37.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.505+0000 7f00a2302640 1 -- 172.21.15.67:0/3039452046 shutdown_connections 2024-08-31T05:32:37.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.505+0000 7f00a2302640 1 --2- 172.21.15.67:0/3039452046 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0084079da0 0x7f008407c260 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.505+0000 7f00a2302640 1 --2- 172.21.15.67:0/3039452046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f009c106650 0x7f009c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.505+0000 7f00a2302640 1 --2- 172.21.15.67:0/3039452046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f009c1005c0 0x7f009c198530 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.505+0000 7f00a2302640 1 -- 172.21.15.67:0/3039452046 >> 172.21.15.67:0/3039452046 conn(0x7f009c0fc2e0 msgr2=0x7f009c0fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.506+0000 7f00a2302640 1 -- 172.21.15.67:0/3039452046 shutdown_connections 2024-08-31T05:32:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:37.506+0000 7f00a2302640 1 -- 172.21.15.67:0/3039452046 wait complete. 2024-08-31T05:32:38.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:37 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3039452046' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-08-31T05:32:38.169 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-08-31T05:32:38.169 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 24 2024-08-31T05:32:38.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:37 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3039452046' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-08-31T05:32:38.425 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:38.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.947+0000 7f3cbe86e640 1 -- 172.21.15.67:0/1231802757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb8106660 msgr2=0x7f3cb8106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:38.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.947+0000 7f3cbe86e640 1 --2- 172.21.15.67:0/1231802757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb8106660 0x7f3cb8106a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009880 tx=0x7f3ca802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:38.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.947+0000 7f3cbe86e640 1 -- 172.21.15.67:0/1231802757 shutdown_connections 2024-08-31T05:32:38.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.947+0000 7f3cbe86e640 1 --2- 172.21.15.67:0/1231802757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb81005b0 0x7f3cb8100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:38.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.947+0000 7f3cbe86e640 1 --2- 172.21.15.67:0/1231802757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb8106660 0x7f3cb8106a40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:38.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.947+0000 7f3cbe86e640 1 -- 172.21.15.67:0/1231802757 >> 172.21.15.67:0/1231802757 conn(0x7f3cb80fc2f0 msgr2=0x7f3cb80fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:38.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.947+0000 7f3cbe86e640 1 -- 172.21.15.67:0/1231802757 shutdown_connections 2024-08-31T05:32:38.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.947+0000 7f3cbe86e640 1 -- 172.21.15.67:0/1231802757 wait complete. 2024-08-31T05:32:38.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.948+0000 7f3cbe86e640 1 Processor -- start 2024-08-31T05:32:38.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.948+0000 7f3cbe86e640 1 -- start start 2024-08-31T05:32:38.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.948+0000 7f3cbe86e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb81005b0 0x7f3cb8102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:38.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.948+0000 7f3cbe86e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb8106660 0x7f3cb8102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:38.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.948+0000 7f3cbe86e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb810da70 con 0x7f3cb81005b0 2024-08-31T05:32:38.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.948+0000 7f3cbe86e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb810d8f0 con 0x7f3cb8106660 2024-08-31T05:32:38.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.948+0000 7f3cb7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb81005b0 0x7f3cb8102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:38.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.948+0000 7f3cb7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb81005b0 0x7f3cb8102220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41534/0 (socket says 172.21.15.67:41534) 2024-08-31T05:32:38.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.948+0000 7f3cb7fff640 1 -- 172.21.15.67:0/3280629173 learned_addr learned my addr 172.21.15.67:0/3280629173 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:38.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.948+0000 7f3cb77fe640 1 --2- 172.21.15.67:0/3280629173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb8106660 0x7f3cb8102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:38.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.949+0000 7f3cb7fff640 1 -- 172.21.15.67:0/3280629173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb8106660 msgr2=0x7f3cb8102760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:38.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.949+0000 7f3cb7fff640 1 --2- 172.21.15.67:0/3280629173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb8106660 0x7f3cb8102760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:38.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.949+0000 7f3cb7fff640 1 -- 172.21.15.67:0/3280629173 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb8102ca0 con 0x7f3cb81005b0 2024-08-31T05:32:38.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.949+0000 7f3cb7fff640 1 --2- 172.21.15.67:0/3280629173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb81005b0 0x7f3cb8102220 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8004f90 tx=0x7f3ca80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:38.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.949+0000 7f3cb57fa640 1 -- 172.21.15.67:0/3280629173 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ca803f070 con 0x7f3cb81005b0 2024-08-31T05:32:38.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.949+0000 7f3cb57fa640 1 -- 172.21.15.67:0/3280629173 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ca8004c70 con 0x7f3cb81005b0 2024-08-31T05:32:38.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.949+0000 7f3cbe86e640 1 -- 172.21.15.67:0/3280629173 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb8102f30 con 0x7f3cb81005b0 2024-08-31T05:32:38.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.949+0000 7f3cb57fa640 1 -- 172.21.15.67:0/3280629173 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ca8035030 con 0x7f3cb81005b0 2024-08-31T05:32:38.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.949+0000 7f3cbe86e640 1 -- 172.21.15.67:0/3280629173 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb81a3a80 con 0x7f3cb81005b0 2024-08-31T05:32:38.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.950+0000 7f3cbe86e640 1 -- 172.21.15.67:0/3280629173 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb8101cd0 con 0x7f3cb81005b0 2024-08-31T05:32:38.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.951+0000 7f3cb57fa640 1 -- 172.21.15.67:0/3280629173 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f3ca8042070 con 0x7f3cb81005b0 2024-08-31T05:32:38.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.951+0000 7f3cb57fa640 1 --2- 172.21.15.67:0/3280629173 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3ca0079e00 0x7f3ca007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:38.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.951+0000 7f3cb57fa640 1 -- 172.21.15.67:0/3280629173 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f3ca80bd3d0 con 0x7f3cb81005b0 2024-08-31T05:32:38.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.951+0000 7f3cb77fe640 1 --2- 172.21.15.67:0/3280629173 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3ca0079e00 0x7f3ca007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:38.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.952+0000 7f3cb77fe640 1 --2- 172.21.15.67:0/3280629173 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3ca0079e00 0x7f3ca007c2c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8103cb0 tx=0x7f3cac00b390 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:38.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:38.956+0000 7f3cb57fa640 1 -- 172.21.15.67:0/3280629173 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3ca8088f10 con 0x7f3cb81005b0 2024-08-31T05:32:39.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:38 smithi067 ceph-mon[99941]: pgmap v368: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:39.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:39.178+0000 7f3cbe86e640 1 -- 172.21.15.67:0/3280629173 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) -- 0x7f3cb81a3d30 con 0x7f3cb81005b0 2024-08-31T05:32:39.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:39.179+0000 7f3cb57fa640 1 -- 172.21.15.67:0/3280629173 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v36) ==== 107+0+4473 (secure 0 0 0) 0x7f3ca808d930 con 0x7f3cb81005b0 2024-08-31T05:32:39.185 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:39.185 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":24,"btime":"2024-08-31T05:29:24:749485+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2383176383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2383176383},{"type":"v1","addr":"172.21.15.73:6825","nonce":2383176383}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:29:15.613825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24299":{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":0,"incarnation":19,"state":"up:active","state_seq":164,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24299,"qdb_cluster":[24299]},"id":1}]} 2024-08-31T05:32:39.186 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 24 2024-08-31T05:32:39.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:39.181+0000 7f3cbe86e640 1 -- 172.21.15.67:0/3280629173 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3ca0079e00 msgr2=0x7f3ca007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:39.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:39.181+0000 7f3cbe86e640 1 --2- 172.21.15.67:0/3280629173 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3ca0079e00 0x7f3ca007c2c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8103cb0 tx=0x7f3cac00b390 comp rx=0 tx=0).stop 2024-08-31T05:32:39.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:39.181+0000 7f3cbe86e640 1 -- 172.21.15.67:0/3280629173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb81005b0 msgr2=0x7f3cb8102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:39.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:39.181+0000 7f3cbe86e640 1 --2- 172.21.15.67:0/3280629173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb81005b0 0x7f3cb8102220 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8004f90 tx=0x7f3ca80048f0 comp rx=0 tx=0).stop 2024-08-31T05:32:39.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:39.181+0000 7f3cbe86e640 1 -- 172.21.15.67:0/3280629173 shutdown_connections 2024-08-31T05:32:39.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:39.181+0000 7f3cbe86e640 1 --2- 172.21.15.67:0/3280629173 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f3ca0079e00 0x7f3ca007c2c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:39.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:39.181+0000 7f3cbe86e640 1 --2- 172.21.15.67:0/3280629173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb8106660 0x7f3cb8102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:39.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:39.181+0000 7f3cbe86e640 1 --2- 172.21.15.67:0/3280629173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3cb81005b0 0x7f3cb8102220 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:39.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:39.181+0000 7f3cbe86e640 1 -- 172.21.15.67:0/3280629173 >> 172.21.15.67:0/3280629173 conn(0x7f3cb80fc2f0 msgr2=0x7f3cb8069b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:39.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:39.181+0000 7f3cbe86e640 1 -- 172.21.15.67:0/3280629173 shutdown_connections 2024-08-31T05:32:39.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:39.181+0000 7f3cbe86e640 1 -- 172.21.15.67:0/3280629173 wait complete. 2024-08-31T05:32:39.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:38 smithi073 ceph-mon[71452]: pgmap v368: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:39.867 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-08-31T05:32:39.868 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 25 2024-08-31T05:32:40.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:39 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3280629173' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-08-31T05:32:40.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:39 smithi067 ceph-mon[99941]: pgmap v369: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:40.122 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:40.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:39 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3280629173' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-08-31T05:32:40.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:39 smithi073 ceph-mon[71452]: pgmap v369: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:40.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.588+0000 7f95fd972640 1 -- 172.21.15.67:0/2436683379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f8106670 msgr2=0x7f95f8106a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:40.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.588+0000 7f95fd972640 1 --2- 172.21.15.67:0/2436683379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f8106670 0x7f95f8106a50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009880 tx=0x7f95e802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:40.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.588+0000 7f95fd972640 1 -- 172.21.15.67:0/2436683379 shutdown_connections 2024-08-31T05:32:40.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.588+0000 7f95fd972640 1 --2- 172.21.15.67:0/2436683379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f81005c0 0x7f95f8100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:40.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.588+0000 7f95fd972640 1 --2- 172.21.15.67:0/2436683379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f8106670 0x7f95f8106a50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:40.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.588+0000 7f95fd972640 1 -- 172.21.15.67:0/2436683379 >> 172.21.15.67:0/2436683379 conn(0x7f95f80fc2c0 msgr2=0x7f95f80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:40.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.588+0000 7f95fd972640 1 -- 172.21.15.67:0/2436683379 shutdown_connections 2024-08-31T05:32:40.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.588+0000 7f95fd972640 1 -- 172.21.15.67:0/2436683379 wait complete. 2024-08-31T05:32:40.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.589+0000 7f95fd972640 1 Processor -- start 2024-08-31T05:32:40.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.589+0000 7f95fd972640 1 -- start start 2024-08-31T05:32:40.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.589+0000 7f95fd972640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f81005c0 0x7f95f8198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:40.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.589+0000 7f95fd972640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f8106670 0x7f95f8198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:40.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.589+0000 7f95fd972640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f95f810da80 con 0x7f95f8106670 2024-08-31T05:32:40.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.589+0000 7f95fd972640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f95f810d900 con 0x7f95f81005c0 2024-08-31T05:32:40.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.589+0000 7f95f67fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f8106670 0x7f95f8198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:40.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.589+0000 7f95f67fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f8106670 0x7f95f8198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41552/0 (socket says 172.21.15.67:41552) 2024-08-31T05:32:40.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.589+0000 7f95f67fc640 1 -- 172.21.15.67:0/210674066 learned_addr learned my addr 172.21.15.67:0/210674066 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:40.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.590+0000 7f95f6ffd640 1 --2- 172.21.15.67:0/210674066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f81005c0 0x7f95f8198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:40.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.590+0000 7f95f67fc640 1 -- 172.21.15.67:0/210674066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f81005c0 msgr2=0x7f95f8198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:40.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.590+0000 7f95f67fc640 1 --2- 172.21.15.67:0/210674066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f81005c0 0x7f95f8198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:40.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.590+0000 7f95f67fc640 1 -- 172.21.15.67:0/210674066 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f81990c0 con 0x7f95f8106670 2024-08-31T05:32:40.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.590+0000 7f95f67fc640 1 --2- 172.21.15.67:0/210674066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f8106670 0x7f95f8198ac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00c8f0 tx=0x7f95ec00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:40.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.590+0000 7f95fc970640 1 -- 172.21.15.67:0/210674066 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95ec0079b0 con 0x7f95f8106670 2024-08-31T05:32:40.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.590+0000 7f95fd972640 1 -- 172.21.15.67:0/210674066 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f81993b0 con 0x7f95f8106670 2024-08-31T05:32:40.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.590+0000 7f95fc970640 1 -- 172.21.15.67:0/210674066 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f95ec0054e0 con 0x7f95f8106670 2024-08-31T05:32:40.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.590+0000 7f95fc970640 1 -- 172.21.15.67:0/210674066 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95ec004dd0 con 0x7f95f8106670 2024-08-31T05:32:40.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.590+0000 7f95fd972640 1 -- 172.21.15.67:0/210674066 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f81a19b0 con 0x7f95f8106670 2024-08-31T05:32:40.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.591+0000 7f95fd972640 1 -- 172.21.15.67:0/210674066 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f8101ce0 con 0x7f95f8106670 2024-08-31T05:32:40.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.592+0000 7f95fc970640 1 -- 172.21.15.67:0/210674066 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f95ec005020 con 0x7f95f8106670 2024-08-31T05:32:40.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.592+0000 7f95fc970640 1 --2- 172.21.15.67:0/210674066 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f95e0079da0 0x7f95e007c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:40.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.593+0000 7f95fc970640 1 -- 172.21.15.67:0/210674066 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f95ec09cd70 con 0x7f95f8106670 2024-08-31T05:32:40.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.593+0000 7f95f6ffd640 1 --2- 172.21.15.67:0/210674066 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f95e0079da0 0x7f95e007c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:40.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.593+0000 7f95f6ffd640 1 --2- 172.21.15.67:0/210674066 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f95e0079da0 0x7f95e007c260 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f95e8000c00 tx=0x7f95e8004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:40.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.596+0000 7f95fc970640 1 -- 172.21.15.67:0/210674066 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f95f81993b0 con 0x7f95f8106670 2024-08-31T05:32:40.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.826+0000 7f95fd972640 1 -- 172.21.15.67:0/210674066 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) -- 0x7f95f8100a20 con 0x7f95f8106670 2024-08-31T05:32:40.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.826+0000 7f95fc970640 1 -- 172.21.15.67:0/210674066 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v36) ==== 107+0+5317 (secure 0 0 0) 0x7f95ec014030 con 0x7f95f8106670 2024-08-31T05:32:40.829 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:40.829 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"btime":"2024-08-31T05:29:27:766655+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2383176383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2383176383},{"type":"v1","addr":"172.21.15.73:6825","nonce":2383176383}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34354,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/352208921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":352208921},{"type":"v1","addr":"172.21.15.67:6829","nonce":352208921}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:29:15.613825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24299":{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":0,"incarnation":19,"state":"up:active","state_seq":164,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24299,"qdb_cluster":[24299]},"id":1}]} 2024-08-31T05:32:40.830 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 25 2024-08-31T05:32:40.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.829+0000 7f95fd972640 1 -- 172.21.15.67:0/210674066 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f95e0079da0 msgr2=0x7f95e007c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:40.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.829+0000 7f95fd972640 1 --2- 172.21.15.67:0/210674066 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f95e0079da0 0x7f95e007c260 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f95e8000c00 tx=0x7f95e8004f30 comp rx=0 tx=0).stop 2024-08-31T05:32:40.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.829+0000 7f95fd972640 1 -- 172.21.15.67:0/210674066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f8106670 msgr2=0x7f95f8198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:40.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.829+0000 7f95fd972640 1 --2- 172.21.15.67:0/210674066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f8106670 0x7f95f8198ac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00c8f0 tx=0x7f95ec00cdb0 comp rx=0 tx=0).stop 2024-08-31T05:32:40.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.829+0000 7f95fd972640 1 -- 172.21.15.67:0/210674066 shutdown_connections 2024-08-31T05:32:40.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.829+0000 7f95fd972640 1 --2- 172.21.15.67:0/210674066 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f95e0079da0 0x7f95e007c260 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:40.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.829+0000 7f95fd972640 1 --2- 172.21.15.67:0/210674066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95f8106670 0x7f95f8198ac0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:40.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.829+0000 7f95fd972640 1 --2- 172.21.15.67:0/210674066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f81005c0 0x7f95f8198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:40.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.829+0000 7f95fd972640 1 -- 172.21.15.67:0/210674066 >> 172.21.15.67:0/210674066 conn(0x7f95f80fc2c0 msgr2=0x7f95f80fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:40.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.829+0000 7f95fd972640 1 -- 172.21.15.67:0/210674066 shutdown_connections 2024-08-31T05:32:40.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:40.829+0000 7f95fd972640 1 -- 172.21.15.67:0/210674066 wait complete. 2024-08-31T05:32:41.179 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:40 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/210674066' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-08-31T05:32:41.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:40 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/210674066' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-08-31T05:32:41.482 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-08-31T05:32:41.483 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 26 2024-08-31T05:32:41.738 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:42.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:41 smithi073 ceph-mon[71452]: pgmap v370: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:42.249 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:41 smithi067 ceph-mon[99941]: pgmap v370: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:42.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.330+0000 7f1611124640 1 -- 172.21.15.67:0/1972750993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c1016a0 msgr2=0x7f160c101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:42.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.330+0000 7f1611124640 1 --2- 172.21.15.67:0/1972750993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c1016a0 0x7f160c101b00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1600009880 tx=0x7f160002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:42.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.330+0000 7f1611124640 1 -- 172.21.15.67:0/1972750993 shutdown_connections 2024-08-31T05:32:42.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.330+0000 7f1611124640 1 --2- 172.21.15.67:0/1972750993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c1016a0 0x7f160c101b00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:42.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.330+0000 7f1611124640 1 --2- 172.21.15.67:0/1972750993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f160c1076a0 0x7f160c107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:42.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.330+0000 7f1611124640 1 -- 172.21.15.67:0/1972750993 >> 172.21.15.67:0/1972750993 conn(0x7f160c0fd380 msgr2=0x7f160c0ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:42.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.330+0000 7f1611124640 1 -- 172.21.15.67:0/1972750993 shutdown_connections 2024-08-31T05:32:42.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.330+0000 7f1611124640 1 -- 172.21.15.67:0/1972750993 wait complete. 2024-08-31T05:32:42.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.331+0000 7f1611124640 1 Processor -- start 2024-08-31T05:32:42.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.331+0000 7f1611124640 1 -- start start 2024-08-31T05:32:42.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.331+0000 7f1611124640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c1016a0 0x7f160c197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:42.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.331+0000 7f1611124640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f160c1076a0 0x7f160c197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:42.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.331+0000 7f1611124640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f160c10eb50 con 0x7f160c1016a0 2024-08-31T05:32:42.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.331+0000 7f1611124640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f160c10e9d0 con 0x7f160c1076a0 2024-08-31T05:32:42.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.331+0000 7f160ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c1016a0 0x7f160c197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:42.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.331+0000 7f160ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c1016a0 0x7f160c197730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41574/0 (socket says 172.21.15.67:41574) 2024-08-31T05:32:42.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.331+0000 7f160ad9d640 1 -- 172.21.15.67:0/831289817 learned_addr learned my addr 172.21.15.67:0/831289817 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:42.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.332+0000 7f160a59c640 1 --2- 172.21.15.67:0/831289817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f160c1076a0 0x7f160c197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:42.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.332+0000 7f160ad9d640 1 -- 172.21.15.67:0/831289817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f160c1076a0 msgr2=0x7f160c197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:42.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.332+0000 7f160ad9d640 1 --2- 172.21.15.67:0/831289817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f160c1076a0 0x7f160c197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:42.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.332+0000 7f160ad9d640 1 -- 172.21.15.67:0/831289817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c19c000 con 0x7f160c1016a0 2024-08-31T05:32:42.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.332+0000 7f160ad9d640 1 --2- 172.21.15.67:0/831289817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c1016a0 0x7f160c197730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00d8d0 tx=0x7f15fc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:42.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.332+0000 7f15f3fff640 1 -- 172.21.15.67:0/831289817 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15fc017070 con 0x7f160c1016a0 2024-08-31T05:32:42.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.332+0000 7f1611124640 1 -- 172.21.15.67:0/831289817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160c19c2f0 con 0x7f160c1016a0 2024-08-31T05:32:42.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.332+0000 7f15f3fff640 1 -- 172.21.15.67:0/831289817 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f15fc010460 con 0x7f160c1016a0 2024-08-31T05:32:42.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.332+0000 7f15f3fff640 1 -- 172.21.15.67:0/831289817 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15fc00f5f0 con 0x7f160c1016a0 2024-08-31T05:32:42.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.332+0000 7f1611124640 1 -- 172.21.15.67:0/831289817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f160c19c880 con 0x7f160c1016a0 2024-08-31T05:32:42.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.333+0000 7f1611124640 1 -- 172.21.15.67:0/831289817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f160c102de0 con 0x7f160c1016a0 2024-08-31T05:32:42.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.334+0000 7f15f3fff640 1 -- 172.21.15.67:0/831289817 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f15fc009a30 con 0x7f160c1016a0 2024-08-31T05:32:42.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.335+0000 7f15f3fff640 1 --2- 172.21.15.67:0/831289817 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f15f4079e00 0x7f15f407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:42.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.335+0000 7f15f3fff640 1 -- 172.21.15.67:0/831289817 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f15fc09c8b0 con 0x7f160c1016a0 2024-08-31T05:32:42.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.335+0000 7f160a59c640 1 --2- 172.21.15.67:0/831289817 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f15f4079e00 0x7f15f407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:42.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.335+0000 7f160a59c640 1 --2- 172.21.15.67:0/831289817 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f15f4079e00 0x7f15f407c2c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f160c0ff980 tx=0x7f1600031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:42.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.340+0000 7f15f3fff640 1 -- 172.21.15.67:0/831289817 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f15fc0683f0 con 0x7f160c1016a0 2024-08-31T05:32:42.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.562+0000 7f1611124640 1 -- 172.21.15.67:0/831289817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) -- 0x7f160c198a90 con 0x7f160c1016a0 2024-08-31T05:32:42.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.563+0000 7f15f3fff640 1 -- 172.21.15.67:0/831289817 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v36) ==== 107+0+4470 (secure 0 0 0) 0x7f15fc06ce10 con 0x7f160c1016a0 2024-08-31T05:32:42.566 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:42.567 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":26,"btime":"2024-08-31T05:29:40:246924+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34354,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/352208921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":352208921},{"type":"v1","addr":"172.21.15.67:6829","nonce":352208921}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:29:15.613825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24299":{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":0,"incarnation":19,"state":"up:active","state_seq":164,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24299,"qdb_cluster":[24299]},"id":1}]} 2024-08-31T05:32:42.567 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 26 2024-08-31T05:32:42.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.565+0000 7f1611124640 1 -- 172.21.15.67:0/831289817 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f15f4079e00 msgr2=0x7f15f407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:42.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.565+0000 7f1611124640 1 --2- 172.21.15.67:0/831289817 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f15f4079e00 0x7f15f407c2c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f160c0ff980 tx=0x7f1600031400 comp rx=0 tx=0).stop 2024-08-31T05:32:42.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.565+0000 7f1611124640 1 -- 172.21.15.67:0/831289817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c1016a0 msgr2=0x7f160c197730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:42.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.565+0000 7f1611124640 1 --2- 172.21.15.67:0/831289817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c1016a0 0x7f160c197730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00d8d0 tx=0x7f15fc00dd90 comp rx=0 tx=0).stop 2024-08-31T05:32:42.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.565+0000 7f1611124640 1 -- 172.21.15.67:0/831289817 shutdown_connections 2024-08-31T05:32:42.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.565+0000 7f1611124640 1 --2- 172.21.15.67:0/831289817 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f15f4079e00 0x7f15f407c2c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:42.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.565+0000 7f1611124640 1 --2- 172.21.15.67:0/831289817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f160c1076a0 0x7f160c197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:42.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.565+0000 7f1611124640 1 --2- 172.21.15.67:0/831289817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f160c1016a0 0x7f160c197730 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:42.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.565+0000 7f1611124640 1 -- 172.21.15.67:0/831289817 >> 172.21.15.67:0/831289817 conn(0x7f160c0fd380 msgr2=0x7f160c0fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:42.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.565+0000 7f1611124640 1 -- 172.21.15.67:0/831289817 shutdown_connections 2024-08-31T05:32:42.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:42.566+0000 7f1611124640 1 -- 172.21.15.67:0/831289817 wait complete. 2024-08-31T05:32:43.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:42 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/831289817' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-08-31T05:32:43.196 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:42 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/831289817' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-08-31T05:32:43.224 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-08-31T05:32:43.225 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 27 2024-08-31T05:32:43.483 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:44.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.979+0000 7f35bb480640 1 -- 172.21.15.67:0/2095835911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35b41016a0 msgr2=0x7f35b4101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:44.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.979+0000 7f35bb480640 1 --2- 172.21.15.67:0/2095835911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35b41016a0 0x7f35b4101b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009880 tx=0x7f35a402a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:44.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.979+0000 7f35bb480640 1 -- 172.21.15.67:0/2095835911 shutdown_connections 2024-08-31T05:32:44.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.979+0000 7f35bb480640 1 --2- 172.21.15.67:0/2095835911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35b41016a0 0x7f35b4101b00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:44.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.979+0000 7f35bb480640 1 --2- 172.21.15.67:0/2095835911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35b41076a0 0x7f35b4107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:44.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.980+0000 7f35bb480640 1 -- 172.21.15.67:0/2095835911 >> 172.21.15.67:0/2095835911 conn(0x7f35b40fd3a0 msgr2=0x7f35b40ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:44.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.980+0000 7f35bb480640 1 -- 172.21.15.67:0/2095835911 shutdown_connections 2024-08-31T05:32:44.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.980+0000 7f35bb480640 1 -- 172.21.15.67:0/2095835911 wait complete. 2024-08-31T05:32:44.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.980+0000 7f35bb480640 1 Processor -- start 2024-08-31T05:32:44.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.980+0000 7f35bb480640 1 -- start start 2024-08-31T05:32:44.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35bb480640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35b41016a0 0x7f35b4197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:44.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35bb480640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35b41076a0 0x7f35b4197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:44.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35bb480640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f35b410eb70 con 0x7f35b41076a0 2024-08-31T05:32:44.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35bb480640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f35b410e9f0 con 0x7f35b41016a0 2024-08-31T05:32:44.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35b8a1b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35b41076a0 0x7f35b4197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:44.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35b8a1b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35b41076a0 0x7f35b4197c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41588/0 (socket says 172.21.15.67:41588) 2024-08-31T05:32:44.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35b8a1b640 1 -- 172.21.15.67:0/3810463317 learned_addr learned my addr 172.21.15.67:0/3810463317 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:44.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35b921c640 1 --2- 172.21.15.67:0/3810463317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35b41016a0 0x7f35b4197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:44.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35b8a1b640 1 -- 172.21.15.67:0/3810463317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35b41016a0 msgr2=0x7f35b4197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:44.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35b8a1b640 1 --2- 172.21.15.67:0/3810463317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35b41016a0 0x7f35b4197710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:44.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35b8a1b640 1 -- 172.21.15.67:0/3810463317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b419bfe0 con 0x7f35b41076a0 2024-08-31T05:32:44.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35b8a1b640 1 --2- 172.21.15.67:0/3810463317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35b41076a0 0x7f35b4197c50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f35a4031460 tx=0x7f35a40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:44.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35aa7fc640 1 -- 172.21.15.67:0/3810463317 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35a403f070 con 0x7f35b41076a0 2024-08-31T05:32:44.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35aa7fc640 1 -- 172.21.15.67:0/3810463317 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f35a40035f0 con 0x7f35b41076a0 2024-08-31T05:32:44.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35bb480640 1 -- 172.21.15.67:0/3810463317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b419c270 con 0x7f35b41076a0 2024-08-31T05:32:44.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35aa7fc640 1 -- 172.21.15.67:0/3810463317 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35a4035030 con 0x7f35b41076a0 2024-08-31T05:32:44.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.981+0000 7f35bb480640 1 -- 172.21.15.67:0/3810463317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b419c7a0 con 0x7f35b41076a0 2024-08-31T05:32:44.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.983+0000 7f35bb480640 1 -- 172.21.15.67:0/3810463317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b4102de0 con 0x7f35b41076a0 2024-08-31T05:32:44.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.983+0000 7f35aa7fc640 1 -- 172.21.15.67:0/3810463317 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f35a4042070 con 0x7f35b41076a0 2024-08-31T05:32:44.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.983+0000 7f35aa7fc640 1 --2- 172.21.15.67:0/3810463317 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f35a0079e00 0x7f35a007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:44.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.984+0000 7f35aa7fc640 1 -- 172.21.15.67:0/3810463317 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f35a40bd360 con 0x7f35b41076a0 2024-08-31T05:32:44.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.984+0000 7f35b921c640 1 --2- 172.21.15.67:0/3810463317 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f35a0079e00 0x7f35a007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:44.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.984+0000 7f35b921c640 1 --2- 172.21.15.67:0/3810463317 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f35a0079e00 0x7f35a007c2c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f35b0005fd0 tx=0x7f35b000b390 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:44.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:43.988+0000 7f35aa7fc640 1 -- 172.21.15.67:0/3810463317 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f35a4088ea0 con 0x7f35b41076a0 2024-08-31T05:32:44.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:43 smithi073 ceph-mon[71452]: pgmap v371: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:44.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:44.210+0000 7f35bb480640 1 -- 172.21.15.67:0/3810463317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) -- 0x7f35b4109c10 con 0x7f35b41076a0 2024-08-31T05:32:44.214 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:43 smithi067 ceph-mon[99941]: pgmap v371: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:44.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:44.211+0000 7f35aa7fc640 1 -- 172.21.15.67:0/3810463317 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v36) ==== 107+0+5317 (secure 0 0 0) 0x7f35a408d8c0 con 0x7f35b41076a0 2024-08-31T05:32:44.214 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:44.215 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"btime":"2024-08-31T05:29:43:262254+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34354,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/352208921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":352208921},{"type":"v1","addr":"172.21.15.67:6829","nonce":352208921}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2489979765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2489979765},{"type":"v1","addr":"172.21.15.73:6825","nonce":2489979765}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:29:15.613825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24299":{"gid":24299,"name":"cephfs.smithi073.kfbmeo","rank":0,"incarnation":19,"state":"up:active","state_seq":164,"addr":"172.21.15.73:6827/1624245945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1624245945},{"type":"v1","addr":"172.21.15.73:6827","nonce":1624245945}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24299,"qdb_cluster":[24299]},"id":1}]} 2024-08-31T05:32:44.215 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 27 2024-08-31T05:32:44.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:44.214+0000 7f35bb480640 1 -- 172.21.15.67:0/3810463317 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f35a0079e00 msgr2=0x7f35a007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:44.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:44.214+0000 7f35bb480640 1 --2- 172.21.15.67:0/3810463317 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f35a0079e00 0x7f35a007c2c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f35b0005fd0 tx=0x7f35b000b390 comp rx=0 tx=0).stop 2024-08-31T05:32:44.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:44.214+0000 7f35bb480640 1 -- 172.21.15.67:0/3810463317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35b41076a0 msgr2=0x7f35b4197c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:44.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:44.214+0000 7f35bb480640 1 --2- 172.21.15.67:0/3810463317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35b41076a0 0x7f35b4197c50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f35a4031460 tx=0x7f35a40045e0 comp rx=0 tx=0).stop 2024-08-31T05:32:44.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:44.214+0000 7f35bb480640 1 -- 172.21.15.67:0/3810463317 shutdown_connections 2024-08-31T05:32:44.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:44.214+0000 7f35bb480640 1 --2- 172.21.15.67:0/3810463317 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f35a0079e00 0x7f35a007c2c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:44.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:44.214+0000 7f35bb480640 1 --2- 172.21.15.67:0/3810463317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35b41076a0 0x7f35b4197c50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:44.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:44.214+0000 7f35bb480640 1 --2- 172.21.15.67:0/3810463317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35b41016a0 0x7f35b4197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:44.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:44.214+0000 7f35bb480640 1 -- 172.21.15.67:0/3810463317 >> 172.21.15.67:0/3810463317 conn(0x7f35b40fd3a0 msgr2=0x7f35b40fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:44.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:44.214+0000 7f35bb480640 1 -- 172.21.15.67:0/3810463317 shutdown_connections 2024-08-31T05:32:44.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:44.214+0000 7f35bb480640 1 -- 172.21.15.67:0/3810463317 wait complete. 2024-08-31T05:32:44.941 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-08-31T05:32:44.942 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 28 2024-08-31T05:32:45.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:44 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3810463317' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-08-31T05:32:45.199 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:45.320 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:44 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3810463317' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-08-31T05:32:45.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.697+0000 7f062dfa2640 1 -- 172.21.15.67:0/2375481023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0628100fc0 msgr2=0x7f0628105010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:45.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.697+0000 7f062dfa2640 1 --2- 172.21.15.67:0/2375481023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0628100fc0 0x7f0628105010 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0610009880 tx=0x7f061002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.698+0000 7f062dfa2640 1 -- 172.21.15.67:0/2375481023 shutdown_connections 2024-08-31T05:32:45.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.698+0000 7f062dfa2640 1 --2- 172.21.15.67:0/2375481023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0628100fc0 0x7f0628105010 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.698+0000 7f062dfa2640 1 --2- 172.21.15.67:0/2375481023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0628100610 0x7f06281009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.698+0000 7f062dfa2640 1 -- 172.21.15.67:0/2375481023 >> 172.21.15.67:0/2375481023 conn(0x7f06280fc0b0 msgr2=0x7f06280fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.698+0000 7f062dfa2640 1 -- 172.21.15.67:0/2375481023 shutdown_connections 2024-08-31T05:32:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.698+0000 7f062dfa2640 1 -- 172.21.15.67:0/2375481023 wait complete. 2024-08-31T05:32:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.698+0000 7f062dfa2640 1 Processor -- start 2024-08-31T05:32:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.699+0000 7f062dfa2640 1 -- start start 2024-08-31T05:32:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.699+0000 7f062dfa2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0628100610 0x7f0628069a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.699+0000 7f062dfa2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0628100fc0 0x7f0628069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.699+0000 7f062dfa2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f062810d870 con 0x7f0628100610 2024-08-31T05:32:45.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.699+0000 7f062dfa2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f062810d6f0 con 0x7f0628100fc0 2024-08-31T05:32:45.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.699+0000 7f062cfa0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0628100610 0x7f0628069a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.699+0000 7f062cfa0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0628100610 0x7f0628069a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41604/0 (socket says 172.21.15.67:41604) 2024-08-31T05:32:45.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.699+0000 7f062cfa0640 1 -- 172.21.15.67:0/3048080211 learned_addr learned my addr 172.21.15.67:0/3048080211 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:45.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.699+0000 7f0627fff640 1 --2- 172.21.15.67:0/3048080211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0628100fc0 0x7f0628069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.699+0000 7f062cfa0640 1 -- 172.21.15.67:0/3048080211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0628100fc0 msgr2=0x7f0628069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:45.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.699+0000 7f062cfa0640 1 --2- 172.21.15.67:0/3048080211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0628100fc0 0x7f0628069f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.699+0000 7f062cfa0640 1 -- 172.21.15.67:0/3048080211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0628073f90 con 0x7f0628100610 2024-08-31T05:32:45.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.700+0000 7f062cfa0640 1 --2- 172.21.15.67:0/3048080211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0628100610 0x7f0628069a40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f061800d8d0 tx=0x7f061800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.700+0000 7f0625ffb640 1 -- 172.21.15.67:0/3048080211 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0618017070 con 0x7f0628100610 2024-08-31T05:32:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.700+0000 7f062dfa2640 1 -- 172.21.15.67:0/3048080211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062806a520 con 0x7f0628100610 2024-08-31T05:32:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.700+0000 7f0625ffb640 1 -- 172.21.15.67:0/3048080211 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0618010460 con 0x7f0628100610 2024-08-31T05:32:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.700+0000 7f0625ffb640 1 -- 172.21.15.67:0/3048080211 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f061800f5f0 con 0x7f0628100610 2024-08-31T05:32:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.700+0000 7f062dfa2640 1 -- 172.21.15.67:0/3048080211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06281ac370 con 0x7f0628100610 2024-08-31T05:32:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.701+0000 7f062dfa2640 1 -- 172.21.15.67:0/3048080211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0628101af0 con 0x7f0628100610 2024-08-31T05:32:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.702+0000 7f0625ffb640 1 -- 172.21.15.67:0/3048080211 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f0618009a30 con 0x7f0628100610 2024-08-31T05:32:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.702+0000 7f0625ffb640 1 --2- 172.21.15.67:0/3048080211 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0614079e00 0x7f061407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.702+0000 7f0625ffb640 1 -- 172.21.15.67:0/3048080211 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f061809c8b0 con 0x7f0628100610 2024-08-31T05:32:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.702+0000 7f0627fff640 1 --2- 172.21.15.67:0/3048080211 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0614079e00 0x7f061407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.703+0000 7f0627fff640 1 --2- 172.21.15.67:0/3048080211 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0614079e00 0x7f061407c2c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f062806f610 tx=0x7f0610031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:45.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.707+0000 7f0625ffb640 1 -- 172.21.15.67:0/3048080211 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f06180683f0 con 0x7f0628100610 2024-08-31T05:32:45.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.929+0000 7f062dfa2640 1 -- 172.21.15.67:0/3048080211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) -- 0x7f062806f2f0 con 0x7f0628100610 2024-08-31T05:32:45.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.930+0000 7f0625ffb640 1 -- 172.21.15.67:0/3048080211 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v36) ==== 107+0+4448 (secure 0 0 0) 0x7f061806ce10 con 0x7f0628100610 2024-08-31T05:32:45.932 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:45.932 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":28,"btime":"2024-08-31T05:29:52:952077+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34354,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/352208921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":352208921},{"type":"v1","addr":"172.21.15.67:6829","nonce":352208921}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2489979765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2489979765},{"type":"v1","addr":"172.21.15.73:6825","nonce":2489979765}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:29:52.952072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T05:32:45.932 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 28 2024-08-31T05:32:45.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.932+0000 7f062dfa2640 1 -- 172.21.15.67:0/3048080211 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0614079e00 msgr2=0x7f061407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:45.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.932+0000 7f062dfa2640 1 --2- 172.21.15.67:0/3048080211 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0614079e00 0x7f061407c2c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f062806f610 tx=0x7f0610031400 comp rx=0 tx=0).stop 2024-08-31T05:32:45.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.932+0000 7f062dfa2640 1 -- 172.21.15.67:0/3048080211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0628100610 msgr2=0x7f0628069a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:45.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.932+0000 7f062dfa2640 1 --2- 172.21.15.67:0/3048080211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0628100610 0x7f0628069a40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f061800d8d0 tx=0x7f061800dd90 comp rx=0 tx=0).stop 2024-08-31T05:32:45.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.932+0000 7f062dfa2640 1 -- 172.21.15.67:0/3048080211 shutdown_connections 2024-08-31T05:32:45.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.933+0000 7f062dfa2640 1 --2- 172.21.15.67:0/3048080211 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f0614079e00 0x7f061407c2c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.933+0000 7f062dfa2640 1 --2- 172.21.15.67:0/3048080211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0628100fc0 0x7f0628069f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.933+0000 7f062dfa2640 1 --2- 172.21.15.67:0/3048080211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0628100610 0x7f0628069a40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.933+0000 7f062dfa2640 1 -- 172.21.15.67:0/3048080211 >> 172.21.15.67:0/3048080211 conn(0x7f06280fc0b0 msgr2=0x7f06280fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:45.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.933+0000 7f062dfa2640 1 -- 172.21.15.67:0/3048080211 shutdown_connections 2024-08-31T05:32:45.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:45.933+0000 7f062dfa2640 1 -- 172.21.15.67:0/3048080211 wait complete. 2024-08-31T05:32:46.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:45 smithi073 ceph-mon[71452]: pgmap v372: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:46.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:45 smithi067 ceph-mon[99941]: pgmap v372: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:46.525 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-08-31T05:32:46.525 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 29 2024-08-31T05:32:46.781 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:47.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:46 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3048080211' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-08-31T05:32:47.223 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:46 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3048080211' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-08-31T05:32:47.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.221+0000 7f8e42c40640 1 -- 172.21.15.67:0/1483188981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c106660 msgr2=0x7f8e3c106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.221+0000 7f8e42c40640 1 --2- 172.21.15.67:0/1483188981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c106660 0x7f8e3c106a40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009880 tx=0x7f8e3002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.221+0000 7f8e42c40640 1 -- 172.21.15.67:0/1483188981 shutdown_connections 2024-08-31T05:32:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.221+0000 7f8e42c40640 1 --2- 172.21.15.67:0/1483188981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e3c1005b0 0x7f8e3c100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.221+0000 7f8e42c40640 1 --2- 172.21.15.67:0/1483188981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c106660 0x7f8e3c106a40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.221+0000 7f8e42c40640 1 -- 172.21.15.67:0/1483188981 >> 172.21.15.67:0/1483188981 conn(0x7f8e3c0fc2f0 msgr2=0x7f8e3c0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.221+0000 7f8e42c40640 1 -- 172.21.15.67:0/1483188981 shutdown_connections 2024-08-31T05:32:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.221+0000 7f8e42c40640 1 -- 172.21.15.67:0/1483188981 wait complete. 2024-08-31T05:32:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.222+0000 7f8e42c40640 1 Processor -- start 2024-08-31T05:32:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.222+0000 7f8e42c40640 1 -- start start 2024-08-31T05:32:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.222+0000 7f8e42c40640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e3c1005b0 0x7f8e3c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.222+0000 7f8e42c40640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c106660 0x7f8e3c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.222+0000 7f8e42c40640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c10da70 con 0x7f8e3c106660 2024-08-31T05:32:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.222+0000 7f8e42c40640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c10d8f0 con 0x7f8e3c1005b0 2024-08-31T05:32:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.222+0000 7f8e3bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c106660 0x7f8e3c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.222+0000 7f8e3bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c106660 0x7f8e3c198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41618/0 (socket says 172.21.15.67:41618) 2024-08-31T05:32:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.222+0000 7f8e3bfff640 1 -- 172.21.15.67:0/1235642262 learned_addr learned my addr 172.21.15.67:0/1235642262 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.222+0000 7f8e409dc640 1 --2- 172.21.15.67:0/1235642262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e3c1005b0 0x7f8e3c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.223+0000 7f8e3bfff640 1 -- 172.21.15.67:0/1235642262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e3c1005b0 msgr2=0x7f8e3c198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.223+0000 7f8e3bfff640 1 --2- 172.21.15.67:0/1235642262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e3c1005b0 0x7f8e3c198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.223+0000 7f8e3bfff640 1 -- 172.21.15.67:0/1235642262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3c1990c0 con 0x7f8e3c106660 2024-08-31T05:32:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.223+0000 7f8e409dc640 1 --2- 172.21.15.67:0/1235642262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e3c1005b0 0x7f8e3c198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:32:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.223+0000 7f8e3bfff640 1 --2- 172.21.15.67:0/1235642262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c106660 0x7f8e3c198ac0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800d6f0 tx=0x7f8e2800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.223+0000 7f8e39ffb640 1 -- 172.21.15.67:0/1235642262 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e28017070 con 0x7f8e3c106660 2024-08-31T05:32:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.223+0000 7f8e42c40640 1 -- 172.21.15.67:0/1235642262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3c1993b0 con 0x7f8e3c106660 2024-08-31T05:32:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.223+0000 7f8e39ffb640 1 -- 172.21.15.67:0/1235642262 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e2800de00 con 0x7f8e3c106660 2024-08-31T05:32:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.223+0000 7f8e39ffb640 1 -- 172.21.15.67:0/1235642262 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e28004bb0 con 0x7f8e3c106660 2024-08-31T05:32:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.223+0000 7f8e42c40640 1 -- 172.21.15.67:0/1235642262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e3c1a19b0 con 0x7f8e3c106660 2024-08-31T05:32:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.224+0000 7f8e42c40640 1 -- 172.21.15.67:0/1235642262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e3c101cd0 con 0x7f8e3c106660 2024-08-31T05:32:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.225+0000 7f8e39ffb640 1 -- 172.21.15.67:0/1235642262 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f8e28004e60 con 0x7f8e3c106660 2024-08-31T05:32:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.225+0000 7f8e39ffb640 1 --2- 172.21.15.67:0/1235642262 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e2c079e00 0x7f8e2c07c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.225+0000 7f8e409dc640 1 --2- 172.21.15.67:0/1235642262 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e2c079e00 0x7f8e2c07c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.225+0000 7f8e39ffb640 1 -- 172.21.15.67:0/1235642262 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f8e2809c660 con 0x7f8e3c106660 2024-08-31T05:32:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.226+0000 7f8e409dc640 1 --2- 172.21.15.67:0/1235642262 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e2c079e00 0x7f8e2c07c2c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8e30000c00 tx=0x7f8e30004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.230+0000 7f8e39ffb640 1 -- 172.21.15.67:0/1235642262 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8e3c1993b0 con 0x7f8e3c106660 2024-08-31T05:32:47.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.450+0000 7f8e42c40640 1 -- 172.21.15.67:0/1235642262 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) -- 0x7f8e3c108a80 con 0x7f8e3c106660 2024-08-31T05:32:47.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.450+0000 7f8e39ffb640 1 -- 172.21.15.67:0/1235642262 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v36) ==== 107+0+4459 (secure 0 0 0) 0x7f8e28064030 con 0x7f8e3c106660 2024-08-31T05:32:47.452 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:47.452 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"btime":"2024-08-31T05:29:52:957323+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/352208921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":352208921},{"type":"v1","addr":"172.21.15.67:6829","nonce":352208921}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2489979765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2489979765},{"type":"v1","addr":"172.21.15.73:6825","nonce":2489979765}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:29:52.957311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":0,"incarnation":29,"state":"up:replay","state_seq":1,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T05:32:47.453 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 29 2024-08-31T05:32:47.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.452+0000 7f8e42c40640 1 -- 172.21.15.67:0/1235642262 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e2c079e00 msgr2=0x7f8e2c07c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:47.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.452+0000 7f8e42c40640 1 --2- 172.21.15.67:0/1235642262 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e2c079e00 0x7f8e2c07c2c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8e30000c00 tx=0x7f8e30004f30 comp rx=0 tx=0).stop 2024-08-31T05:32:47.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.452+0000 7f8e42c40640 1 -- 172.21.15.67:0/1235642262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c106660 msgr2=0x7f8e3c198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:47.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.452+0000 7f8e42c40640 1 --2- 172.21.15.67:0/1235642262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c106660 0x7f8e3c198ac0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800d6f0 tx=0x7f8e2800dbb0 comp rx=0 tx=0).stop 2024-08-31T05:32:47.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.453+0000 7f8e42c40640 1 -- 172.21.15.67:0/1235642262 shutdown_connections 2024-08-31T05:32:47.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.453+0000 7f8e42c40640 1 --2- 172.21.15.67:0/1235642262 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f8e2c079e00 0x7f8e2c07c2c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:47.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.453+0000 7f8e42c40640 1 --2- 172.21.15.67:0/1235642262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e3c106660 0x7f8e3c198ac0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:47.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.453+0000 7f8e42c40640 1 --2- 172.21.15.67:0/1235642262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e3c1005b0 0x7f8e3c198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:47.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.453+0000 7f8e42c40640 1 -- 172.21.15.67:0/1235642262 >> 172.21.15.67:0/1235642262 conn(0x7f8e3c0fc2f0 msgr2=0x7f8e3c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:47.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.453+0000 7f8e42c40640 1 -- 172.21.15.67:0/1235642262 shutdown_connections 2024-08-31T05:32:47.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:47.453+0000 7f8e42c40640 1 -- 172.21.15.67:0/1235642262 wait complete. 2024-08-31T05:32:48.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:47 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/1235642262' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-08-31T05:32:48.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:47 smithi067 ceph-mon[99941]: pgmap v373: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:48.147 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-08-31T05:32:48.148 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 30 2024-08-31T05:32:48.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:47 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/1235642262' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-08-31T05:32:48.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:47 smithi073 ceph-mon[71452]: pgmap v373: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:48.402 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.864+0000 7f1221b5c640 1 -- 172.21.15.67:0/856510547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f121c1076a0 msgr2=0x7f121c107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.864+0000 7f1221b5c640 1 --2- 172.21.15.67:0/856510547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f121c1076a0 0x7f121c107a80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f120c009880 tx=0x7f120c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.864+0000 7f1221b5c640 1 -- 172.21.15.67:0/856510547 shutdown_connections 2024-08-31T05:32:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.864+0000 7f1221b5c640 1 --2- 172.21.15.67:0/856510547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c1016a0 0x7f121c101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.864+0000 7f1221b5c640 1 --2- 172.21.15.67:0/856510547 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f121c1076a0 0x7f121c107a80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.864+0000 7f1221b5c640 1 -- 172.21.15.67:0/856510547 >> 172.21.15.67:0/856510547 conn(0x7f121c0fd3a0 msgr2=0x7f121c0ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.864+0000 7f1221b5c640 1 -- 172.21.15.67:0/856510547 shutdown_connections 2024-08-31T05:32:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.864+0000 7f1221b5c640 1 -- 172.21.15.67:0/856510547 wait complete. 2024-08-31T05:32:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.865+0000 7f1221b5c640 1 Processor -- start 2024-08-31T05:32:48.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.865+0000 7f1221b5c640 1 -- start start 2024-08-31T05:32:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.865+0000 7f1221b5c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f121c1016a0 0x7f121c074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.865+0000 7f1221b5c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c1076a0 0x7f121c0747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.865+0000 7f1221b5c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f121c10eb50 con 0x7f121c1016a0 2024-08-31T05:32:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.865+0000 7f1221b5c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f121c10e9d0 con 0x7f121c1076a0 2024-08-31T05:32:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.865+0000 7f121b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f121c1016a0 0x7f121c074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.865+0000 7f121b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f121c1016a0 0x7f121c074290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42272/0 (socket says 172.21.15.67:42272) 2024-08-31T05:32:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.865+0000 7f121b7fe640 1 -- 172.21.15.67:0/683261673 learned_addr learned my addr 172.21.15.67:0/683261673 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.866+0000 7f121affd640 1 --2- 172.21.15.67:0/683261673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c1076a0 0x7f121c0747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.866+0000 7f121b7fe640 1 -- 172.21.15.67:0/683261673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c1076a0 msgr2=0x7f121c0747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.866+0000 7f121b7fe640 1 --2- 172.21.15.67:0/683261673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c1076a0 0x7f121c0747d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.866+0000 7f121b7fe640 1 -- 172.21.15.67:0/683261673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121c074d10 con 0x7f121c1016a0 2024-08-31T05:32:48.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.866+0000 7f121affd640 1 --2- 172.21.15.67:0/683261673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c1076a0 0x7f121c0747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:32:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.866+0000 7f121b7fe640 1 --2- 172.21.15.67:0/683261673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f121c1016a0 0x7f121c074290 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f120c031460 tx=0x7f120c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.866+0000 7f1218ff9640 1 -- 172.21.15.67:0/683261673 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f120c03f070 con 0x7f121c1016a0 2024-08-31T05:32:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.866+0000 7f1218ff9640 1 -- 172.21.15.67:0/683261673 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f120c0035f0 con 0x7f121c1016a0 2024-08-31T05:32:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.866+0000 7f1221b5c640 1 -- 172.21.15.67:0/683261673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f121c074fa0 con 0x7f121c1016a0 2024-08-31T05:32:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.866+0000 7f1218ff9640 1 -- 172.21.15.67:0/683261673 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f120c035030 con 0x7f121c1016a0 2024-08-31T05:32:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.866+0000 7f1221b5c640 1 -- 172.21.15.67:0/683261673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f121c1a3b40 con 0x7f121c1016a0 2024-08-31T05:32:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.867+0000 7f1221b5c640 1 -- 172.21.15.67:0/683261673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f121c102de0 con 0x7f121c1016a0 2024-08-31T05:32:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.868+0000 7f1218ff9640 1 -- 172.21.15.67:0/683261673 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f120c042070 con 0x7f121c1016a0 2024-08-31T05:32:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.868+0000 7f1218ff9640 1 --2- 172.21.15.67:0/683261673 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1204079e00 0x7f120407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.868+0000 7f1218ff9640 1 -- 172.21.15.67:0/683261673 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f120c0bd410 con 0x7f121c1016a0 2024-08-31T05:32:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.868+0000 7f121affd640 1 --2- 172.21.15.67:0/683261673 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1204079e00 0x7f120407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:48.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.869+0000 7f121affd640 1 --2- 172.21.15.67:0/683261673 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1204079e00 0x7f120407c2c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f12100058c0 tx=0x7f1210005850 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:48.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:48.873+0000 7f1218ff9640 1 -- 172.21.15.67:0/683261673 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f120c084de0 con 0x7f121c1016a0 2024-08-31T05:32:49.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:49.094+0000 7f1221b5c640 1 -- 172.21.15.67:0/683261673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) -- 0x7f121c101b00 con 0x7f121c1016a0 2024-08-31T05:32:49.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:49.095+0000 7f1218ff9640 1 -- 172.21.15.67:0/683261673 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v36) ==== 107+0+5307 (secure 0 0 0) 0x7f120c088f50 con 0x7f121c1016a0 2024-08-31T05:32:49.097 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:49.097 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":30,"btime":"2024-08-31T05:30:02:776964+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/352208921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":352208921},{"type":"v1","addr":"172.21.15.67:6829","nonce":352208921}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2489979765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2489979765},{"type":"v1","addr":"172.21.15.73:6825","nonce":2489979765}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44335,"name":"cephfs.smithi073.kfbmeo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/668223470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":668223470},{"type":"v1","addr":"172.21.15.73:6827","nonce":668223470}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:30:02.122155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":0,"incarnation":29,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T05:32:49.097 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 30 2024-08-31T05:32:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:49.097+0000 7f1221b5c640 1 -- 172.21.15.67:0/683261673 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1204079e00 msgr2=0x7f120407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:49.097+0000 7f1221b5c640 1 --2- 172.21.15.67:0/683261673 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1204079e00 0x7f120407c2c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f12100058c0 tx=0x7f1210005850 comp rx=0 tx=0).stop 2024-08-31T05:32:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:49.097+0000 7f1221b5c640 1 -- 172.21.15.67:0/683261673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f121c1016a0 msgr2=0x7f121c074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:49.097+0000 7f1221b5c640 1 --2- 172.21.15.67:0/683261673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f121c1016a0 0x7f121c074290 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f120c031460 tx=0x7f120c0045e0 comp rx=0 tx=0).stop 2024-08-31T05:32:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:49.097+0000 7f1221b5c640 1 -- 172.21.15.67:0/683261673 shutdown_connections 2024-08-31T05:32:49.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:49.097+0000 7f1221b5c640 1 --2- 172.21.15.67:0/683261673 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1204079e00 0x7f120407c2c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:49.097+0000 7f1221b5c640 1 --2- 172.21.15.67:0/683261673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f121c1076a0 0x7f121c0747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:49.097+0000 7f1221b5c640 1 --2- 172.21.15.67:0/683261673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f121c1016a0 0x7f121c074290 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:49.097+0000 7f1221b5c640 1 -- 172.21.15.67:0/683261673 >> 172.21.15.67:0/683261673 conn(0x7f121c0fd3a0 msgr2=0x7f121c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:49.097+0000 7f1221b5c640 1 -- 172.21.15.67:0/683261673 shutdown_connections 2024-08-31T05:32:49.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:49.097+0000 7f1221b5c640 1 -- 172.21.15.67:0/683261673 wait complete. 2024-08-31T05:32:49.445 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:49 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/683261673' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-08-31T05:32:49.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:49 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/683261673' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-08-31T05:32:49.808 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-08-31T05:32:49.808 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 31 2024-08-31T05:32:50.062 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:50.434 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:50 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:32:50.434 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:50 smithi067 ceph-mon[99941]: pgmap v374: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:50.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:50 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:32:50.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:50 smithi073 ceph-mon[71452]: pgmap v374: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:50.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.514+0000 7f1122864640 1 -- 172.21.15.67:0/2217941584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f111c1005c0 msgr2=0x7f111c100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:50.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.514+0000 7f1122864640 1 --2- 172.21.15.67:0/2217941584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f111c1005c0 0x7f111c100a20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1110009880 tx=0x7f111002a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:50.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.515+0000 7f1122864640 1 -- 172.21.15.67:0/2217941584 shutdown_connections 2024-08-31T05:32:50.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.515+0000 7f1122864640 1 --2- 172.21.15.67:0/2217941584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f111c1005c0 0x7f111c100a20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:50.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.515+0000 7f1122864640 1 --2- 172.21.15.67:0/2217941584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f111c106670 0x7f111c106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:50.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.515+0000 7f1122864640 1 -- 172.21.15.67:0/2217941584 >> 172.21.15.67:0/2217941584 conn(0x7f111c0fc2c0 msgr2=0x7f111c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:50.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.515+0000 7f1122864640 1 -- 172.21.15.67:0/2217941584 shutdown_connections 2024-08-31T05:32:50.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.515+0000 7f1122864640 1 -- 172.21.15.67:0/2217941584 wait complete. 2024-08-31T05:32:50.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.515+0000 7f1122864640 1 Processor -- start 2024-08-31T05:32:50.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.515+0000 7f1122864640 1 -- start start 2024-08-31T05:32:50.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f1122864640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f111c1005c0 0x7f111c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:50.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f1122864640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f111c106670 0x7f111c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:50.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f1122864640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f111c10da60 con 0x7f111c1005c0 2024-08-31T05:32:50.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f1122864640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f111c10d8e0 con 0x7f111c106670 2024-08-31T05:32:50.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f111bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f111c1005c0 0x7f111c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:50.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f111bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f111c1005c0 0x7f111c1984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42280/0 (socket says 172.21.15.67:42280) 2024-08-31T05:32:50.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f111bfff640 1 -- 172.21.15.67:0/1357272234 learned_addr learned my addr 172.21.15.67:0/1357272234 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:50.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f111b7fe640 1 --2- 172.21.15.67:0/1357272234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f111c106670 0x7f111c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:50.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f111bfff640 1 -- 172.21.15.67:0/1357272234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f111c106670 msgr2=0x7f111c198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:50.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f111bfff640 1 --2- 172.21.15.67:0/1357272234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f111c106670 0x7f111c198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:50.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f111bfff640 1 -- 172.21.15.67:0/1357272234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c199050 con 0x7f111c1005c0 2024-08-31T05:32:50.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f111bfff640 1 --2- 172.21.15.67:0/1357272234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f111c1005c0 0x7f111c1984c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f110c00d8d0 tx=0x7f110c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:50.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f11197fa640 1 -- 172.21.15.67:0/1357272234 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f110c017070 con 0x7f111c1005c0 2024-08-31T05:32:50.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f11197fa640 1 -- 172.21.15.67:0/1357272234 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f110c010460 con 0x7f111c1005c0 2024-08-31T05:32:50.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f1122864640 1 -- 172.21.15.67:0/1357272234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111c1a1530 con 0x7f111c1005c0 2024-08-31T05:32:50.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f11197fa640 1 -- 172.21.15.67:0/1357272234 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f110c00f5f0 con 0x7f111c1005c0 2024-08-31T05:32:50.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.516+0000 7f1122864640 1 -- 172.21.15.67:0/1357272234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f111c1a1930 con 0x7f111c1005c0 2024-08-31T05:32:50.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.517+0000 7f1122864640 1 -- 172.21.15.67:0/1357272234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f111c101ce0 con 0x7f111c1005c0 2024-08-31T05:32:50.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.518+0000 7f11197fa640 1 -- 172.21.15.67:0/1357272234 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f110c009a30 con 0x7f111c1005c0 2024-08-31T05:32:50.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.519+0000 7f11197fa640 1 --2- 172.21.15.67:0/1357272234 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1104079e40 0x7f110407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:50.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.519+0000 7f11197fa640 1 -- 172.21.15.67:0/1357272234 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f110c09c890 con 0x7f111c1005c0 2024-08-31T05:32:50.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.519+0000 7f111b7fe640 1 --2- 172.21.15.67:0/1357272234 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1104079e40 0x7f110407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:50.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.519+0000 7f111b7fe640 1 --2- 172.21.15.67:0/1357272234 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1104079e40 0x7f110407c300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f111c06aae0 tx=0x7f1110004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:50.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.523+0000 7f11197fa640 1 -- 172.21.15.67:0/1357272234 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f110c0642e0 con 0x7f111c1005c0 2024-08-31T05:32:50.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.743+0000 7f1122864640 1 -- 172.21.15.67:0/1357272234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) -- 0x7f111c02d6a0 con 0x7f111c1005c0 2024-08-31T05:32:50.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.744+0000 7f11197fa640 1 -- 172.21.15.67:0/1357272234 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v36) ==== 107+0+5304 (secure 0 0 0) 0x7f110c068450 con 0x7f111c1005c0 2024-08-31T05:32:50.746 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:50.746 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":31,"btime":"2024-08-31T05:30:03:784613+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/352208921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":352208921},{"type":"v1","addr":"172.21.15.67:6829","nonce":352208921}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2489979765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2489979765},{"type":"v1","addr":"172.21.15.73:6825","nonce":2489979765}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44335,"name":"cephfs.smithi073.kfbmeo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/668223470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":668223470},{"type":"v1","addr":"172.21.15.73:6827","nonce":668223470}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:30:02.787412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":0,"incarnation":29,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-31T05:32:50.747 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 31 2024-08-31T05:32:50.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.746+0000 7f1122864640 1 -- 172.21.15.67:0/1357272234 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1104079e40 msgr2=0x7f110407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:50.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.746+0000 7f1122864640 1 --2- 172.21.15.67:0/1357272234 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1104079e40 0x7f110407c300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f111c06aae0 tx=0x7f1110004f30 comp rx=0 tx=0).stop 2024-08-31T05:32:50.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.746+0000 7f1122864640 1 -- 172.21.15.67:0/1357272234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f111c1005c0 msgr2=0x7f111c1984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:50.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.746+0000 7f1122864640 1 --2- 172.21.15.67:0/1357272234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f111c1005c0 0x7f111c1984c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f110c00d8d0 tx=0x7f110c00dd90 comp rx=0 tx=0).stop 2024-08-31T05:32:50.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.746+0000 7f1122864640 1 -- 172.21.15.67:0/1357272234 shutdown_connections 2024-08-31T05:32:50.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.746+0000 7f1122864640 1 --2- 172.21.15.67:0/1357272234 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1104079e40 0x7f110407c300 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:50.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.746+0000 7f1122864640 1 --2- 172.21.15.67:0/1357272234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f111c106670 0x7f111c198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:50.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.746+0000 7f1122864640 1 --2- 172.21.15.67:0/1357272234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f111c1005c0 0x7f111c1984c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:50.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.746+0000 7f1122864640 1 -- 172.21.15.67:0/1357272234 >> 172.21.15.67:0/1357272234 conn(0x7f111c0fc2c0 msgr2=0x7f111c0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:50.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.747+0000 7f1122864640 1 -- 172.21.15.67:0/1357272234 shutdown_connections 2024-08-31T05:32:50.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:50.747+0000 7f1122864640 1 -- 172.21.15.67:0/1357272234 wait complete. 2024-08-31T05:32:51.401 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-08-31T05:32:51.401 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 32 2024-08-31T05:32:51.424 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:51 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/1357272234' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-08-31T05:32:51.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:51 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/1357272234' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-08-31T05:32:51.657 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.097+0000 7fa463afe640 1 -- 172.21.15.67:0/2884409461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45c1031f0 msgr2=0x7fa45c10b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.097+0000 7fa463afe640 1 --2- 172.21.15.67:0/2884409461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45c1031f0 0x7fa45c10b6e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa450009880 tx=0x7fa45002a530 comp rx=0 tx=0).stop 2024-08-31T05:32:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.097+0000 7fa463afe640 1 -- 172.21.15.67:0/2884409461 shutdown_connections 2024-08-31T05:32:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.097+0000 7fa463afe640 1 --2- 172.21.15.67:0/2884409461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45c1031f0 0x7fa45c10b6e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.097+0000 7fa463afe640 1 --2- 172.21.15.67:0/2884409461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa45c1028d0 0x7fa45c102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.097+0000 7fa463afe640 1 -- 172.21.15.67:0/2884409461 >> 172.21.15.67:0/2884409461 conn(0x7fa45c0fc2f0 msgr2=0x7fa45c0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.097+0000 7fa463afe640 1 -- 172.21.15.67:0/2884409461 shutdown_connections 2024-08-31T05:32:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.097+0000 7fa463afe640 1 -- 172.21.15.67:0/2884409461 wait complete. 2024-08-31T05:32:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.097+0000 7fa463afe640 1 Processor -- start 2024-08-31T05:32:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.097+0000 7fa463afe640 1 -- start start 2024-08-31T05:32:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa463afe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa45c1028d0 0x7fa45c197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa463afe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45c1031f0 0x7fa45c197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa463afe640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c10eb80 con 0x7fa45c1031f0 2024-08-31T05:32:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa463afe640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c10ea00 con 0x7fa45c1028d0 2024-08-31T05:32:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa461099640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45c1031f0 0x7fa45c197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa461099640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45c1031f0 0x7fa45c197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42298/0 (socket says 172.21.15.67:42298) 2024-08-31T05:32:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa461099640 1 -- 172.21.15.67:0/1310172231 learned_addr learned my addr 172.21.15.67:0/1310172231 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa46189a640 1 --2- 172.21.15.67:0/1310172231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa45c1028d0 0x7fa45c197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa461099640 1 -- 172.21.15.67:0/1310172231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa45c1028d0 msgr2=0x7fa45c197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa461099640 1 --2- 172.21.15.67:0/1310172231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa45c1028d0 0x7fa45c197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa461099640 1 -- 172.21.15.67:0/1310172231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45c19bfd0 con 0x7fa45c1031f0 2024-08-31T05:32:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa461099640 1 --2- 172.21.15.67:0/1310172231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45c1031f0 0x7fa45c197c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa450004f90 tx=0x7fa4500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa45affd640 1 -- 172.21.15.67:0/1310172231 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa45003f070 con 0x7fa45c1031f0 2024-08-31T05:32:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa463afe640 1 -- 172.21.15.67:0/1310172231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa45c19c260 con 0x7fa45c1031f0 2024-08-31T05:32:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.098+0000 7fa463afe640 1 -- 172.21.15.67:0/1310172231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa45c19c790 con 0x7fa45c1031f0 2024-08-31T05:32:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.099+0000 7fa45affd640 1 -- 172.21.15.67:0/1310172231 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa450004c70 con 0x7fa45c1031f0 2024-08-31T05:32:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.099+0000 7fa45affd640 1 -- 172.21.15.67:0/1310172231 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa450035030 con 0x7fa45c1031f0 2024-08-31T05:32:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.099+0000 7fa463afe640 1 -- 172.21.15.67:0/1310172231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa448005290 con 0x7fa45c1031f0 2024-08-31T05:32:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.100+0000 7fa45affd640 1 -- 172.21.15.67:0/1310172231 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fa450042070 con 0x7fa45c1031f0 2024-08-31T05:32:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.101+0000 7fa45affd640 1 --2- 172.21.15.67:0/1310172231 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa444079e40 0x7fa44407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.101+0000 7fa45affd640 1 -- 172.21.15.67:0/1310172231 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7fa4500bd180 con 0x7fa45c1031f0 2024-08-31T05:32:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.101+0000 7fa46189a640 1 --2- 172.21.15.67:0/1310172231 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa444079e40 0x7fa44407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.101+0000 7fa46189a640 1 --2- 172.21.15.67:0/1310172231 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa444079e40 0x7fa44407c300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa454005fd0 tx=0x7fa45400b390 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:52.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.105+0000 7fa45affd640 1 -- 172.21.15.67:0/1310172231 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa450088d40 con 0x7fa45c1031f0 2024-08-31T05:32:52.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.327+0000 7fa463afe640 1 -- 172.21.15.67:0/1310172231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) -- 0x7fa448005580 con 0x7fa45c1031f0 2024-08-31T05:32:52.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.328+0000 7fa45affd640 1 -- 172.21.15.67:0/1310172231 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v36) ==== 107+0+5313 (secure 0 0 0) 0x7fa45008d760 con 0x7fa45c1031f0 2024-08-31T05:32:52.330 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:52.330 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":32,"btime":"2024-08-31T05:30:04:791588+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/352208921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":352208921},{"type":"v1","addr":"172.21.15.67:6829","nonce":352208921}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2489979765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2489979765},{"type":"v1","addr":"172.21.15.73:6825","nonce":2489979765}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44335,"name":"cephfs.smithi073.kfbmeo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/668223470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":668223470},{"type":"v1","addr":"172.21.15.73:6827","nonce":668223470}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:30:04.791578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34322,"qdb_cluster":[34322]},"id":1}]} 2024-08-31T05:32:52.330 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 32 2024-08-31T05:32:52.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.330+0000 7fa463afe640 1 -- 172.21.15.67:0/1310172231 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa444079e40 msgr2=0x7fa44407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:52.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.330+0000 7fa463afe640 1 --2- 172.21.15.67:0/1310172231 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa444079e40 0x7fa44407c300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa454005fd0 tx=0x7fa45400b390 comp rx=0 tx=0).stop 2024-08-31T05:32:52.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.330+0000 7fa463afe640 1 -- 172.21.15.67:0/1310172231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45c1031f0 msgr2=0x7fa45c197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:52.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.330+0000 7fa463afe640 1 --2- 172.21.15.67:0/1310172231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45c1031f0 0x7fa45c197c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa450004f90 tx=0x7fa4500048f0 comp rx=0 tx=0).stop 2024-08-31T05:32:52.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.330+0000 7fa463afe640 1 -- 172.21.15.67:0/1310172231 shutdown_connections 2024-08-31T05:32:52.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.330+0000 7fa463afe640 1 --2- 172.21.15.67:0/1310172231 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa444079e40 0x7fa44407c300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:52.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.330+0000 7fa463afe640 1 --2- 172.21.15.67:0/1310172231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa45c1031f0 0x7fa45c197c40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:52.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.330+0000 7fa463afe640 1 --2- 172.21.15.67:0/1310172231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa45c1028d0 0x7fa45c197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:52.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.330+0000 7fa463afe640 1 -- 172.21.15.67:0/1310172231 >> 172.21.15.67:0/1310172231 conn(0x7fa45c0fc2f0 msgr2=0x7fa45c103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:52.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.330+0000 7fa463afe640 1 -- 172.21.15.67:0/1310172231 shutdown_connections 2024-08-31T05:32:52.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:52.330+0000 7fa463afe640 1 -- 172.21.15.67:0/1310172231 wait complete. 2024-08-31T05:32:52.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:52 smithi073 ceph-mon[71452]: pgmap v375: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:52.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:52 smithi067 ceph-mon[99941]: pgmap v375: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:52.999 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-08-31T05:32:52.999 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 33 2024-08-31T05:32:53.296 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:53.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:53 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/1310172231' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-08-31T05:32:53.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:53 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/1310172231' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-08-31T05:32:53.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.754+0000 7fe375bbc640 1 -- 172.21.15.67:0/1508545400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe370103180 msgr2=0x7fe37010b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:53.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.754+0000 7fe375bbc640 1 --2- 172.21.15.67:0/1508545400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe370103180 0x7fe37010b670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe364009880 tx=0x7fe36402a530 comp rx=0 tx=0).stop 2024-08-31T05:32:53.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.754+0000 7fe375bbc640 1 -- 172.21.15.67:0/1508545400 shutdown_connections 2024-08-31T05:32:53.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.754+0000 7fe375bbc640 1 --2- 172.21.15.67:0/1508545400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe370103180 0x7fe37010b670 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:53.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.754+0000 7fe375bbc640 1 --2- 172.21.15.67:0/1508545400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe370102860 0x7fe370102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:53.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.754+0000 7fe375bbc640 1 -- 172.21.15.67:0/1508545400 >> 172.21.15.67:0/1508545400 conn(0x7fe3700fc2c0 msgr2=0x7fe3700fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:53.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.754+0000 7fe375bbc640 1 -- 172.21.15.67:0/1508545400 shutdown_connections 2024-08-31T05:32:53.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.754+0000 7fe375bbc640 1 -- 172.21.15.67:0/1508545400 wait complete. 2024-08-31T05:32:53.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.755+0000 7fe375bbc640 1 Processor -- start 2024-08-31T05:32:53.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.755+0000 7fe375bbc640 1 -- start start 2024-08-31T05:32:53.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe375bbc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe370102860 0x7fe37019d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:53.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe375bbc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe370103180 0x7fe37019d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:53.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe375bbc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe37010eb90 con 0x7fe370102860 2024-08-31T05:32:53.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe375bbc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe37010ea10 con 0x7fe370103180 2024-08-31T05:32:53.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe36f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe370102860 0x7fe37019d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:53.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe36f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe370102860 0x7fe37019d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42310/0 (socket says 172.21.15.67:42310) 2024-08-31T05:32:53.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe36f7fe640 1 -- 172.21.15.67:0/980932001 learned_addr learned my addr 172.21.15.67:0/980932001 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:53.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe36effd640 1 --2- 172.21.15.67:0/980932001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe370103180 0x7fe37019d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:53.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe36f7fe640 1 -- 172.21.15.67:0/980932001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe370103180 msgr2=0x7fe37019d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:53.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe36f7fe640 1 --2- 172.21.15.67:0/980932001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe370103180 0x7fe37019d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:53.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe36f7fe640 1 -- 172.21.15.67:0/980932001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3701975c0 con 0x7fe370102860 2024-08-31T05:32:53.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe36f7fe640 1 --2- 172.21.15.67:0/980932001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe370102860 0x7fe37019d400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe36000e970 tx=0x7fe36000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:53.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe36cff9640 1 -- 172.21.15.67:0/980932001 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe36000cac0 con 0x7fe370102860 2024-08-31T05:32:53.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe36cff9640 1 -- 172.21.15.67:0/980932001 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe3600054e0 con 0x7fe370102860 2024-08-31T05:32:53.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe375bbc640 1 -- 172.21.15.67:0/980932001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3701978b0 con 0x7fe370102860 2024-08-31T05:32:53.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.756+0000 7fe36cff9640 1 -- 172.21.15.67:0/980932001 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe360010430 con 0x7fe370102860 2024-08-31T05:32:53.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.757+0000 7fe375bbc640 1 -- 172.21.15.67:0/980932001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe370197e10 con 0x7fe370102860 2024-08-31T05:32:53.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.757+0000 7fe375bbc640 1 -- 172.21.15.67:0/980932001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe37006a830 con 0x7fe370102860 2024-08-31T05:32:53.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.758+0000 7fe36cff9640 1 -- 172.21.15.67:0/980932001 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fe360004e80 con 0x7fe370102860 2024-08-31T05:32:53.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.759+0000 7fe36cff9640 1 --2- 172.21.15.67:0/980932001 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe358079e00 0x7fe35807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:53.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.759+0000 7fe36effd640 1 --2- 172.21.15.67:0/980932001 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe358079e00 0x7fe35807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:53.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.759+0000 7fe36cff9640 1 -- 172.21.15.67:0/980932001 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7fe36009d0a0 con 0x7fe370102860 2024-08-31T05:32:53.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.759+0000 7fe36effd640 1 --2- 172.21.15.67:0/980932001 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe358079e00 0x7fe35807c2c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe370198700 tx=0x7fe364031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:53.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.763+0000 7fe36cff9640 1 -- 172.21.15.67:0/980932001 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe360064a70 con 0x7fe370102860 2024-08-31T05:32:53.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.985+0000 7fe375bbc640 1 -- 172.21.15.67:0/980932001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) -- 0x7fe370105d00 con 0x7fe370102860 2024-08-31T05:32:53.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.986+0000 7fe36cff9640 1 -- 172.21.15.67:0/980932001 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v36) ==== 107+0+5313 (secure 0 0 0) 0x7fe360068be0 con 0x7fe370102860 2024-08-31T05:32:53.988 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:53.988 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":33,"btime":"2024-08-31T05:30:10:060254+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/352208921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":352208921},{"type":"v1","addr":"172.21.15.67:6829","nonce":352208921}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2489979765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2489979765},{"type":"v1","addr":"172.21.15.73:6825","nonce":2489979765}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44335,"name":"cephfs.smithi073.kfbmeo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/668223470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":668223470},{"type":"v1","addr":"172.21.15.73:6827","nonce":668223470}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:30:09.063617+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34322,"qdb_cluster":[34322]},"id":1}]} 2024-08-31T05:32:53.988 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 33 2024-08-31T05:32:53.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.988+0000 7fe375bbc640 1 -- 172.21.15.67:0/980932001 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe358079e00 msgr2=0x7fe35807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:53.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.988+0000 7fe375bbc640 1 --2- 172.21.15.67:0/980932001 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe358079e00 0x7fe35807c2c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe370198700 tx=0x7fe364031400 comp rx=0 tx=0).stop 2024-08-31T05:32:53.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.988+0000 7fe375bbc640 1 -- 172.21.15.67:0/980932001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe370102860 msgr2=0x7fe37019d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.988+0000 7fe375bbc640 1 --2- 172.21.15.67:0/980932001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe370102860 0x7fe37019d400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe36000e970 tx=0x7fe36000ed70 comp rx=0 tx=0).stop 2024-08-31T05:32:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.988+0000 7fe375bbc640 1 -- 172.21.15.67:0/980932001 shutdown_connections 2024-08-31T05:32:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.988+0000 7fe375bbc640 1 --2- 172.21.15.67:0/980932001 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe358079e00 0x7fe35807c2c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.988+0000 7fe375bbc640 1 --2- 172.21.15.67:0/980932001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe370103180 0x7fe37019d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.988+0000 7fe375bbc640 1 --2- 172.21.15.67:0/980932001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe370102860 0x7fe37019d400 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.988+0000 7fe375bbc640 1 -- 172.21.15.67:0/980932001 >> 172.21.15.67:0/980932001 conn(0x7fe3700fc2c0 msgr2=0x7fe370108cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.988+0000 7fe375bbc640 1 -- 172.21.15.67:0/980932001 shutdown_connections 2024-08-31T05:32:53.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:53.988+0000 7fe375bbc640 1 -- 172.21.15.67:0/980932001 wait complete. 2024-08-31T05:32:54.296 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:54 smithi067 ceph-mon[99941]: pgmap v376: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:54.296 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:54 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/980932001' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-08-31T05:32:54.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:54 smithi073 ceph-mon[71452]: pgmap v376: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:32:54.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:54 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/980932001' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-08-31T05:32:54.606 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-08-31T05:32:54.607 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 34 2024-08-31T05:32:54.866 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:55.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.321+0000 7fa42baa5640 1 -- 172.21.15.67:0/595854295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4241005b0 msgr2=0x7fa424100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:55.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.321+0000 7fa42baa5640 1 --2- 172.21.15.67:0/595854295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4241005b0 0x7fa424100a10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa418009880 tx=0x7fa41802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:55.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.321+0000 7fa42baa5640 1 -- 172.21.15.67:0/595854295 shutdown_connections 2024-08-31T05:32:55.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.321+0000 7fa42baa5640 1 --2- 172.21.15.67:0/595854295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4241005b0 0x7fa424100a10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:55.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.321+0000 7fa42baa5640 1 --2- 172.21.15.67:0/595854295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa424106660 0x7fa424106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.321+0000 7fa42baa5640 1 -- 172.21.15.67:0/595854295 >> 172.21.15.67:0/595854295 conn(0x7fa4240fc2f0 msgr2=0x7fa4240fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.321+0000 7fa42baa5640 1 -- 172.21.15.67:0/595854295 shutdown_connections 2024-08-31T05:32:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.321+0000 7fa42baa5640 1 -- 172.21.15.67:0/595854295 wait complete. 2024-08-31T05:32:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.322+0000 7fa42baa5640 1 Processor -- start 2024-08-31T05:32:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.322+0000 7fa42baa5640 1 -- start start 2024-08-31T05:32:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.322+0000 7fa42baa5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4241005b0 0x7fa424102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.322+0000 7fa42baa5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa424106660 0x7fa424102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.322+0000 7fa42baa5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa42410da70 con 0x7fa424106660 2024-08-31T05:32:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.322+0000 7fa42baa5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa42410d8f0 con 0x7fa4241005b0 2024-08-31T05:32:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.322+0000 7fa429040640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa424106660 0x7fa424102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.322+0000 7fa429040640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa424106660 0x7fa424102760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42330/0 (socket says 172.21.15.67:42330) 2024-08-31T05:32:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.322+0000 7fa429040640 1 -- 172.21.15.67:0/45392322 learned_addr learned my addr 172.21.15.67:0/45392322 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.322+0000 7fa429841640 1 --2- 172.21.15.67:0/45392322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4241005b0 0x7fa424102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.322+0000 7fa429040640 1 -- 172.21.15.67:0/45392322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4241005b0 msgr2=0x7fa424102220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.322+0000 7fa429040640 1 --2- 172.21.15.67:0/45392322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4241005b0 0x7fa424102220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.322+0000 7fa429040640 1 -- 172.21.15.67:0/45392322 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa424102ca0 con 0x7fa424106660 2024-08-31T05:32:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.323+0000 7fa429040640 1 --2- 172.21.15.67:0/45392322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa424106660 0x7fa424102760 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa418004f90 tx=0x7fa4180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.323+0000 7fa422ffd640 1 -- 172.21.15.67:0/45392322 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa41803f070 con 0x7fa424106660 2024-08-31T05:32:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.323+0000 7fa422ffd640 1 -- 172.21.15.67:0/45392322 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa418004ac0 con 0x7fa424106660 2024-08-31T05:32:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.323+0000 7fa42baa5640 1 -- 172.21.15.67:0/45392322 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa424102f30 con 0x7fa424106660 2024-08-31T05:32:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.323+0000 7fa422ffd640 1 -- 172.21.15.67:0/45392322 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa418035030 con 0x7fa424106660 2024-08-31T05:32:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.323+0000 7fa42baa5640 1 -- 172.21.15.67:0/45392322 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4241a3bb0 con 0x7fa424106660 2024-08-31T05:32:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.324+0000 7fa42baa5640 1 -- 172.21.15.67:0/45392322 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa424101cd0 con 0x7fa424106660 2024-08-31T05:32:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.324+0000 7fa422ffd640 1 -- 172.21.15.67:0/45392322 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fa418042070 con 0x7fa424106660 2024-08-31T05:32:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.325+0000 7fa422ffd640 1 --2- 172.21.15.67:0/45392322 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa40c079e40 0x7fa40c07c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.325+0000 7fa429841640 1 --2- 172.21.15.67:0/45392322 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa40c079e40 0x7fa40c07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.325+0000 7fa422ffd640 1 -- 172.21.15.67:0/45392322 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7fa4180bd310 con 0x7fa424106660 2024-08-31T05:32:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.326+0000 7fa429841640 1 --2- 172.21.15.67:0/45392322 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa40c079e40 0x7fa40c07c300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa414005fd0 tx=0x7fa414009500 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.330+0000 7fa422ffd640 1 -- 172.21.15.67:0/45392322 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa418084d60 con 0x7fa424106660 2024-08-31T05:32:55.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.555+0000 7fa42baa5640 1 -- 172.21.15.67:0/45392322 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) -- 0x7fa4241a3e60 con 0x7fa424106660 2024-08-31T05:32:55.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.555+0000 7fa422ffd640 1 -- 172.21.15.67:0/45392322 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v36) ==== 107+0+5312 (secure 0 0 0) 0x7fa418088ed0 con 0x7fa424106660 2024-08-31T05:32:55.557 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:55.557 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-08-31T05:30:11:064939+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi067.beqeql","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6829/352208921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":352208921},{"type":"v1","addr":"172.21.15.67:6829","nonce":352208921}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2489979765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2489979765},{"type":"v1","addr":"172.21.15.73:6825","nonce":2489979765}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44335,"name":"cephfs.smithi073.kfbmeo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/668223470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":668223470},{"type":"v1","addr":"172.21.15.73:6827","nonce":668223470}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:30:10.068982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34322,"qdb_cluster":[34322]},"id":1}]} 2024-08-31T05:32:55.558 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-08-31T05:32:55.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.559+0000 7fa42baa5640 1 -- 172.21.15.67:0/45392322 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa40c079e40 msgr2=0x7fa40c07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:55.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.559+0000 7fa42baa5640 1 --2- 172.21.15.67:0/45392322 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa40c079e40 0x7fa40c07c300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa414005fd0 tx=0x7fa414009500 comp rx=0 tx=0).stop 2024-08-31T05:32:55.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.559+0000 7fa42baa5640 1 -- 172.21.15.67:0/45392322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa424106660 msgr2=0x7fa424102760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:55.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.559+0000 7fa42baa5640 1 --2- 172.21.15.67:0/45392322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa424106660 0x7fa424102760 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa418004f90 tx=0x7fa4180046c0 comp rx=0 tx=0).stop 2024-08-31T05:32:55.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.559+0000 7fa42baa5640 1 -- 172.21.15.67:0/45392322 shutdown_connections 2024-08-31T05:32:55.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.559+0000 7fa42baa5640 1 --2- 172.21.15.67:0/45392322 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fa40c079e40 0x7fa40c07c300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:55.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.559+0000 7fa42baa5640 1 --2- 172.21.15.67:0/45392322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa424106660 0x7fa424102760 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:55.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.559+0000 7fa42baa5640 1 --2- 172.21.15.67:0/45392322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4241005b0 0x7fa424102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:55.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.559+0000 7fa42baa5640 1 -- 172.21.15.67:0/45392322 >> 172.21.15.67:0/45392322 conn(0x7fa4240fc2f0 msgr2=0x7fa424069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:55.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.559+0000 7fa42baa5640 1 -- 172.21.15.67:0/45392322 shutdown_connections 2024-08-31T05:32:55.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:55.559+0000 7fa42baa5640 1 -- 172.21.15.67:0/45392322 wait complete. 2024-08-31T05:32:55.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:55 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/45392322' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-08-31T05:32:55.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:55 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/45392322' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-08-31T05:32:56.210 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 35 2024-08-31T05:32:56.467 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:56.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:56 smithi067 ceph-mon[99941]: pgmap v377: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.928+0000 7fe60ffaf640 1 -- 172.21.15.67:0/1225372533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6081016a0 msgr2=0x7fe608101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.928+0000 7fe60ffaf640 1 --2- 172.21.15.67:0/1225372533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6081016a0 0x7fe608101b00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009880 tx=0x7fe5f802a4a0 comp rx=0 tx=0).stop 2024-08-31T05:32:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.928+0000 7fe60ffaf640 1 -- 172.21.15.67:0/1225372533 shutdown_connections 2024-08-31T05:32:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.928+0000 7fe60ffaf640 1 --2- 172.21.15.67:0/1225372533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6081016a0 0x7fe608101b00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:56.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.928+0000 7fe60ffaf640 1 --2- 172.21.15.67:0/1225372533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6081076a0 0x7fe608107a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.928+0000 7fe60ffaf640 1 -- 172.21.15.67:0/1225372533 >> 172.21.15.67:0/1225372533 conn(0x7fe6080fd3a0 msgr2=0x7fe6080ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.928+0000 7fe60ffaf640 1 -- 172.21.15.67:0/1225372533 shutdown_connections 2024-08-31T05:32:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.928+0000 7fe60ffaf640 1 -- 172.21.15.67:0/1225372533 wait complete. 2024-08-31T05:32:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.929+0000 7fe60ffaf640 1 Processor -- start 2024-08-31T05:32:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.929+0000 7fe60ffaf640 1 -- start start 2024-08-31T05:32:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.929+0000 7fe60ffaf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6081016a0 0x7fe608197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.929+0000 7fe60ffaf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6081076a0 0x7fe608197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.929+0000 7fe60ffaf640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe60810eb50 con 0x7fe6081076a0 2024-08-31T05:32:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.929+0000 7fe60ffaf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe60810e9d0 con 0x7fe6081016a0 2024-08-31T05:32:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.929+0000 7fe60d54a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6081076a0 0x7fe608197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:56.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.929+0000 7fe60d54a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6081076a0 0x7fe608197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42356/0 (socket says 172.21.15.67:42356) 2024-08-31T05:32:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.929+0000 7fe60d54a640 1 -- 172.21.15.67:0/3878271915 learned_addr learned my addr 172.21.15.67:0/3878271915 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.929+0000 7fe60d54a640 1 -- 172.21.15.67:0/3878271915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6081016a0 msgr2=0x7fe608197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.929+0000 7fe60dd4b640 1 --2- 172.21.15.67:0/3878271915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6081016a0 0x7fe608197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.930+0000 7fe60d54a640 1 --2- 172.21.15.67:0/3878271915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6081016a0 0x7fe608197740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.930+0000 7fe60d54a640 1 -- 172.21.15.67:0/3878271915 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60819c010 con 0x7fe6081076a0 2024-08-31T05:32:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.930+0000 7fe60dd4b640 1 --2- 172.21.15.67:0/3878271915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6081016a0 0x7fe608197740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:32:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.930+0000 7fe60d54a640 1 --2- 172.21.15.67:0/3878271915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6081076a0 0x7fe608197c80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8031460 tx=0x7fe5f80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.930+0000 7fe5feffd640 1 -- 172.21.15.67:0/3878271915 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe5f803f070 con 0x7fe6081076a0 2024-08-31T05:32:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.930+0000 7fe60ffaf640 1 -- 172.21.15.67:0/3878271915 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60819c2a0 con 0x7fe6081076a0 2024-08-31T05:32:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.930+0000 7fe5feffd640 1 -- 172.21.15.67:0/3878271915 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe5f8004cf0 con 0x7fe6081076a0 2024-08-31T05:32:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.930+0000 7fe5feffd640 1 -- 172.21.15.67:0/3878271915 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe5f8035030 con 0x7fe6081076a0 2024-08-31T05:32:56.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.930+0000 7fe60ffaf640 1 -- 172.21.15.67:0/3878271915 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60819c7d0 con 0x7fe6081076a0 2024-08-31T05:32:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.931+0000 7fe60ffaf640 1 -- 172.21.15.67:0/3878271915 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe608102de0 con 0x7fe6081076a0 2024-08-31T05:32:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.932+0000 7fe5feffd640 1 -- 172.21.15.67:0/3878271915 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fe5f8042070 con 0x7fe6081076a0 2024-08-31T05:32:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.932+0000 7fe5feffd640 1 --2- 172.21.15.67:0/3878271915 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe5f4079e00 0x7fe5f407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:56.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.932+0000 7fe5feffd640 1 -- 172.21.15.67:0/3878271915 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7fe5f80bd4f0 con 0x7fe6081076a0 2024-08-31T05:32:56.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.932+0000 7fe60dd4b640 1 --2- 172.21.15.67:0/3878271915 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe5f4079e00 0x7fe5f407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:56.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.933+0000 7fe60dd4b640 1 --2- 172.21.15.67:0/3878271915 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe5f4079e00 0x7fe5f407c2c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe6040058c0 tx=0x7fe604005d30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:56.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:56.937+0000 7fe5feffd640 1 -- 172.21.15.67:0/3878271915 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe5f8084ec0 con 0x7fe6081076a0 2024-08-31T05:32:56.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:56 smithi073 ceph-mon[71452]: pgmap v377: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:57.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:57.158+0000 7fe60ffaf640 1 -- 172.21.15.67:0/3878271915 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) -- 0x7fe608198ad0 con 0x7fe6081076a0 2024-08-31T05:32:57.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:57.158+0000 7fe5feffd640 1 -- 172.21.15.67:0/3878271915 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v36) ==== 107+0+5319 (secure 0 0 0) 0x7fe608198ad0 con 0x7fe6081076a0 2024-08-31T05:32:57.160 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-08-31T05:32:57.160 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":35,"btime":"2024-08-31T05:30:11:070139+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44309,"name":"cephfs.smithi073.gsnhxi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6825/2489979765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2489979765},{"type":"v1","addr":"172.21.15.73:6825","nonce":2489979765}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44335,"name":"cephfs.smithi073.kfbmeo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6827/668223470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":668223470},{"type":"v1","addr":"172.21.15.73:6827","nonce":668223470}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:18:19.419969+0000","modified":"2024-08-31T05:30:11.070122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi067.tskvpt","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.67:6827/3864481333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3864481333},{"type":"v1","addr":"172.21.15.67:6827","nonce":3864481333}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34354":{"gid":34354,"name":"cephfs.smithi067.beqeql","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6829/352208921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":352208921},{"type":"v1","addr":"172.21.15.67:6829","nonce":352208921}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34322,"qdb_cluster":[34322]},"id":1}]} 2024-08-31T05:32:57.161 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 35 2024-08-31T05:32:57.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:57.161+0000 7fe60ffaf640 1 -- 172.21.15.67:0/3878271915 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe5f4079e00 msgr2=0x7fe5f407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:57.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:57.161+0000 7fe60ffaf640 1 --2- 172.21.15.67:0/3878271915 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe5f4079e00 0x7fe5f407c2c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe6040058c0 tx=0x7fe604005d30 comp rx=0 tx=0).stop 2024-08-31T05:32:57.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:57.161+0000 7fe60ffaf640 1 -- 172.21.15.67:0/3878271915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6081076a0 msgr2=0x7fe608197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:57.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:57.161+0000 7fe60ffaf640 1 --2- 172.21.15.67:0/3878271915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6081076a0 0x7fe608197c80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8031460 tx=0x7fe5f80048f0 comp rx=0 tx=0).stop 2024-08-31T05:32:57.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:57.161+0000 7fe60ffaf640 1 -- 172.21.15.67:0/3878271915 shutdown_connections 2024-08-31T05:32:57.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:57.161+0000 7fe60ffaf640 1 --2- 172.21.15.67:0/3878271915 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fe5f4079e00 0x7fe5f407c2c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:57.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:57.161+0000 7fe60ffaf640 1 --2- 172.21.15.67:0/3878271915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6081076a0 0x7fe608197c80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:57.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:57.161+0000 7fe60ffaf640 1 --2- 172.21.15.67:0/3878271915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6081016a0 0x7fe608197740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:57.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:57.161+0000 7fe60ffaf640 1 -- 172.21.15.67:0/3878271915 >> 172.21.15.67:0/3878271915 conn(0x7fe6080fd3a0 msgr2=0x7fe6080fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:57.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:57.161+0000 7fe60ffaf640 1 -- 172.21.15.67:0/3878271915 shutdown_connections 2024-08-31T05:32:57.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:57.161+0000 7fe60ffaf640 1 -- 172.21.15.67:0/3878271915 wait complete. 2024-08-31T05:32:57.894 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:57 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3878271915' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-08-31T05:32:57.925 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-31T05:32:57.937 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-31T05:32:57.937 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:32:57.937 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T05:32:57.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:57 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3878271915' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-08-31T05:32:57.957 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:32:57.958 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T05:32:58.014 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T05:32:58.310 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:32:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.795+0000 7f1bb414f640 1 -- 172.21.15.67:0/3170517989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac074c50 msgr2=0x7f1bac112170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.795+0000 7f1bb414f640 1 --2- 172.21.15.67:0/3170517989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac074c50 0x7f1bac112170 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009880 tx=0x7f1b9c02a530 comp rx=0 tx=0).stop 2024-08-31T05:32:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.795+0000 7f1bb414f640 1 -- 172.21.15.67:0/3170517989 shutdown_connections 2024-08-31T05:32:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.795+0000 7f1bb414f640 1 --2- 172.21.15.67:0/3170517989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac074c50 0x7f1bac112170 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.795+0000 7f1bb414f640 1 --2- 172.21.15.67:0/3170517989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bac074330 0x7f1bac074710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.795+0000 7f1bb414f640 1 -- 172.21.15.67:0/3170517989 >> 172.21.15.67:0/3170517989 conn(0x7f1bac0fd3a0 msgr2=0x7f1bac0ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.795+0000 7f1bb414f640 1 -- 172.21.15.67:0/3170517989 shutdown_connections 2024-08-31T05:32:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.795+0000 7f1bb414f640 1 -- 172.21.15.67:0/3170517989 wait complete. 2024-08-31T05:32:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.796+0000 7f1bb414f640 1 Processor -- start 2024-08-31T05:32:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.796+0000 7f1bb414f640 1 -- start start 2024-08-31T05:32:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.796+0000 7f1bb414f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac074330 0x7f1bac19dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:58.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.796+0000 7f1bb414f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bac074c50 0x7f1bac19e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:58.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.796+0000 7f1bb414f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac115180 con 0x7f1bac074330 2024-08-31T05:32:58.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.796+0000 7f1bb414f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac115000 con 0x7f1bac074c50 2024-08-31T05:32:58.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.797+0000 7f1bb1eeb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac074330 0x7f1bac19dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:58.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.797+0000 7f1bb1eeb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac074330 0x7f1bac19dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34908/0 (socket says 172.21.15.67:34908) 2024-08-31T05:32:58.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.797+0000 7f1bb1eeb640 1 -- 172.21.15.67:0/150027258 learned_addr learned my addr 172.21.15.67:0/150027258 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:32:58.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.797+0000 7f1bb16ea640 1 --2- 172.21.15.67:0/150027258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bac074c50 0x7f1bac19e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:58.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.797+0000 7f1bb1eeb640 1 -- 172.21.15.67:0/150027258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bac074c50 msgr2=0x7f1bac19e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:58.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.797+0000 7f1bb1eeb640 1 --2- 172.21.15.67:0/150027258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bac074c50 0x7f1bac19e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.797+0000 7f1bb1eeb640 1 -- 172.21.15.67:0/150027258 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bac1a2650 con 0x7f1bac074330 2024-08-31T05:32:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.797+0000 7f1bb1eeb640 1 --2- 172.21.15.67:0/150027258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac074330 0x7f1bac19dd80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800d6f0 tx=0x7f1ba800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.797+0000 7f1ba2ffd640 1 -- 172.21.15.67:0/150027258 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ba8017070 con 0x7f1bac074330 2024-08-31T05:32:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.797+0000 7f1ba2ffd640 1 -- 172.21.15.67:0/150027258 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1ba800de00 con 0x7f1bac074330 2024-08-31T05:32:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.797+0000 7f1bb414f640 1 -- 172.21.15.67:0/150027258 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bac1a2940 con 0x7f1bac074330 2024-08-31T05:32:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.797+0000 7f1ba2ffd640 1 -- 172.21.15.67:0/150027258 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ba8004bb0 con 0x7f1bac074330 2024-08-31T05:32:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.797+0000 7f1bb414f640 1 -- 172.21.15.67:0/150027258 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bac1a2ed0 con 0x7f1bac074330 2024-08-31T05:32:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.798+0000 7f1bb414f640 1 -- 172.21.15.67:0/150027258 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bac075a70 con 0x7f1bac074330 2024-08-31T05:32:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.799+0000 7f1ba2ffd640 1 -- 172.21.15.67:0/150027258 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7f1ba8004e60 con 0x7f1bac074330 2024-08-31T05:32:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.800+0000 7f1ba2ffd640 1 --2- 172.21.15.67:0/150027258 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1b98079e00 0x7f1b9807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.800+0000 7f1ba2ffd640 1 -- 172.21.15.67:0/150027258 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7f1ba809c5b0 con 0x7f1bac074330 2024-08-31T05:32:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.800+0000 7f1bb16ea640 1 --2- 172.21.15.67:0/150027258 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1b98079e00 0x7f1b9807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:58.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.800+0000 7f1bb16ea640 1 --2- 172.21.15.67:0/150027258 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1b98079e00 0x7f1b9807c2c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1bac104590 tx=0x7f1b9c031400 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:58.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:58.804+0000 7f1ba2ffd640 1 -- 172.21.15.67:0/150027258 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1ba80680f0 con 0x7f1bac074330 2024-08-31T05:32:58.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:58 smithi073 ceph-mon[71452]: pgmap v378: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:59.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:59.000+0000 7f1bb414f640 1 -- 172.21.15.67:0/150027258 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1bac19f0e0 con 0x7f1bac074330 2024-08-31T05:32:59.003 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:58 smithi067 ceph-mon[99941]: pgmap v378: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:32:59.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:59.001+0000 7f1ba2ffd640 1 -- 172.21.15.67:0/150027258 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 31 entries v95) ==== 81+0+1837 (secure 0 0 0) 0x7f1ba806cb10 con 0x7f1bac074330 2024-08-31T05:32:59.003 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3820732856 2024-09-01T05:20:23.461456+0000 2024-08-31T05:32:59.003 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:6827/1624245945 2024-09-01T05:29:52.951717+0000 2024-08-31T05:32:59.003 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/2838724829 2024-09-01T05:12:45.310890+0000 2024-08-31T05:32:59.003 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:0/2281964479 2024-09-01T05:22:03.579421+0000 2024-08-31T05:32:59.004 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/683720860 2024-09-01T05:20:23.461456+0000 2024-08-31T05:32:59.004 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:0/4068551783 2024-09-01T05:22:03.579421+0000 2024-08-31T05:32:59.004 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3624769860 2024-09-01T05:13:41.288702+0000 2024-08-31T05:32:59.004 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3782915644 2024-09-01T05:12:13.010409+0000 2024-08-31T05:32:59.004 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/4268636965 2024-09-01T05:12:45.310890+0000 2024-08-31T05:32:59.004 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3246639847 2024-09-01T05:12:13.010409+0000 2024-08-31T05:32:59.004 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/2323558682 2024-09-01T05:12:45.310890+0000 2024-08-31T05:32:59.004 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:0/2809375331 2024-09-01T05:22:03.579421+0000 2024-08-31T05:32:59.004 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/2323558682 2024-09-01T05:12:45.310890+0000 2024-08-31T05:32:59.004 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:6826/1624245945 2024-09-01T05:29:52.951717+0000 2024-08-31T05:32:59.004 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/2529430863 2024-09-01T05:12:45.310890+0000 2024-08-31T05:32:59.004 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/1741828555 2024-09-01T05:13:41.288702+0000 2024-08-31T05:32:59.004 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3787377150 2024-09-01T05:13:41.288702+0000 2024-08-31T05:32:59.005 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/2090251560 2024-09-01T05:20:23.461456+0000 2024-08-31T05:32:59.005 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/298845382 2024-09-01T05:20:23.461456+0000 2024-08-31T05:32:59.005 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6827/2961844124 2024-09-01T05:29:05.236681+0000 2024-08-31T05:32:59.005 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:0/2892020941 2024-09-01T05:22:03.579421+0000 2024-08-31T05:32:59.005 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:6828/1567621854 2024-09-01T05:22:03.579421+0000 2024-08-31T05:32:59.005 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/1741828555 2024-09-01T05:13:41.288702+0000 2024-08-31T05:32:59.005 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/4159467749 2024-09-01T05:12:13.010409+0000 2024-08-31T05:32:59.005 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:6829/1567621854 2024-09-01T05:22:03.579421+0000 2024-08-31T05:32:59.005 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/2090251560 2024-09-01T05:20:23.461456+0000 2024-08-31T05:32:59.005 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/1438563298 2024-09-01T05:20:23.461456+0000 2024-08-31T05:32:59.005 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/4159467749 2024-09-01T05:12:13.010409+0000 2024-08-31T05:32:59.005 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3326210547 2024-09-01T05:13:41.288702+0000 2024-08-31T05:32:59.005 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/743586046 2024-09-01T05:12:13.010409+0000 2024-08-31T05:32:59.006 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6826/2961844124 2024-09-01T05:29:05.236681+0000 2024-08-31T05:32:59.006 INFO:teuthology.orchestra.run.smithi067.stderr:listed 31 entries 2024-08-31T05:32:59.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:59.003+0000 7f1bb414f640 1 -- 172.21.15.67:0/150027258 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1b98079e00 msgr2=0x7f1b9807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:59.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:59.003+0000 7f1bb414f640 1 --2- 172.21.15.67:0/150027258 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1b98079e00 0x7f1b9807c2c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1bac104590 tx=0x7f1b9c031400 comp rx=0 tx=0).stop 2024-08-31T05:32:59.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:59.003+0000 7f1bb414f640 1 -- 172.21.15.67:0/150027258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac074330 msgr2=0x7f1bac19dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:59.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:59.003+0000 7f1bb414f640 1 --2- 172.21.15.67:0/150027258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac074330 0x7f1bac19dd80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800d6f0 tx=0x7f1ba800dbb0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:59.004+0000 7f1bb414f640 1 -- 172.21.15.67:0/150027258 shutdown_connections 2024-08-31T05:32:59.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:59.004+0000 7f1bb414f640 1 --2- 172.21.15.67:0/150027258 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7f1b98079e00 0x7f1b9807c2c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:59.004+0000 7f1bb414f640 1 --2- 172.21.15.67:0/150027258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bac074c50 0x7f1bac19e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:59.004+0000 7f1bb414f640 1 --2- 172.21.15.67:0/150027258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac074330 0x7f1bac19dd80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:59.004+0000 7f1bb414f640 1 -- 172.21.15.67:0/150027258 >> 172.21.15.67:0/150027258 conn(0x7f1bac0fd3a0 msgr2=0x7f1bac104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:59.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:59.004+0000 7f1bb414f640 1 -- 172.21.15.67:0/150027258 shutdown_connections 2024-08-31T05:32:59.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:32:59.004+0000 7f1bb414f640 1 -- 172.21.15.67:0/150027258 wait complete. 2024-08-31T05:32:59.681 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-08-31T05:32:59.681 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T05:32:59.699 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T05:32:59.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:32:59 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/150027258' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T05:33:00.005 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/mon.smithi067/config 2024-08-31T05:33:00.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:32:59 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/150027258' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T05:33:00.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.547+0000 7fb469369640 1 -- 172.21.15.67:0/166872659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4641005b0 msgr2=0x7fb464100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:00.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.547+0000 7fb469369640 1 --2- 172.21.15.67:0/166872659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4641005b0 0x7fb464100a10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009880 tx=0x7fb44c02a4a0 comp rx=0 tx=0).stop 2024-08-31T05:33:00.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.547+0000 7fb469369640 1 -- 172.21.15.67:0/166872659 shutdown_connections 2024-08-31T05:33:00.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.547+0000 7fb469369640 1 --2- 172.21.15.67:0/166872659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4641005b0 0x7fb464100a10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:00.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.547+0000 7fb469369640 1 --2- 172.21.15.67:0/166872659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb464106660 0x7fb464106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:00.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.547+0000 7fb469369640 1 -- 172.21.15.67:0/166872659 >> 172.21.15.67:0/166872659 conn(0x7fb4640fc2f0 msgr2=0x7fb4640fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:00.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.547+0000 7fb469369640 1 -- 172.21.15.67:0/166872659 shutdown_connections 2024-08-31T05:33:00.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.547+0000 7fb469369640 1 -- 172.21.15.67:0/166872659 wait complete. 2024-08-31T05:33:00.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.547+0000 7fb469369640 1 Processor -- start 2024-08-31T05:33:00.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.548+0000 7fb469369640 1 -- start start 2024-08-31T05:33:00.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.548+0000 7fb469369640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4641005b0 0x7fb464197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:00.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.548+0000 7fb469369640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb464106660 0x7fb464197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:00.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.548+0000 7fb469369640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb46410da70 con 0x7fb4641005b0 2024-08-31T05:33:00.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.548+0000 7fb469369640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb46410d8f0 con 0x7fb464106660 2024-08-31T05:33:00.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.548+0000 7fb462ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4641005b0 0x7fb464197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:00.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.548+0000 7fb462ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4641005b0 0x7fb464197670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34916/0 (socket says 172.21.15.67:34916) 2024-08-31T05:33:00.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.548+0000 7fb462ffd640 1 -- 172.21.15.67:0/3727183312 learned_addr learned my addr 172.21.15.67:0/3727183312 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-08-31T05:33:00.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.548+0000 7fb4627fc640 1 --2- 172.21.15.67:0/3727183312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb464106660 0x7fb464197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:00.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.548+0000 7fb462ffd640 1 -- 172.21.15.67:0/3727183312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb464106660 msgr2=0x7fb464197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:00.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.548+0000 7fb462ffd640 1 --2- 172.21.15.67:0/3727183312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb464106660 0x7fb464197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:00.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.548+0000 7fb462ffd640 1 -- 172.21.15.67:0/3727183312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46419bf40 con 0x7fb4641005b0 2024-08-31T05:33:00.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.549+0000 7fb462ffd640 1 --2- 172.21.15.67:0/3727183312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4641005b0 0x7fb464197670 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb45400cc60 tx=0x7fb45400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:00.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.549+0000 7fb45bfff640 1 -- 172.21.15.67:0/3727183312 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb45400ad30 con 0x7fb4641005b0 2024-08-31T05:33:00.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.549+0000 7fb469369640 1 -- 172.21.15.67:0/3727183312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46419c230 con 0x7fb4641005b0 2024-08-31T05:33:00.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.549+0000 7fb45bfff640 1 -- 172.21.15.67:0/3727183312 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb454005020 con 0x7fb4641005b0 2024-08-31T05:33:00.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.549+0000 7fb45bfff640 1 -- 172.21.15.67:0/3727183312 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb45400f640 con 0x7fb4641005b0 2024-08-31T05:33:00.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.549+0000 7fb469369640 1 -- 172.21.15.67:0/3727183312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb46419c7c0 con 0x7fb4641005b0 2024-08-31T05:33:00.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.550+0000 7fb469369640 1 -- 172.21.15.67:0/3727183312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb464101cd0 con 0x7fb4641005b0 2024-08-31T05:33:00.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.550+0000 7fb45bfff640 1 -- 172.21.15.67:0/3727183312 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) ==== 102030+0+0 (secure 0 0 0) 0x7fb4540051d0 con 0x7fb4641005b0 2024-08-31T05:33:00.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.551+0000 7fb45bfff640 1 --2- 172.21.15.67:0/3727183312 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb450079e00 0x7fb45007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:00.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.551+0000 7fb45bfff640 1 -- 172.21.15.67:0/3727183312 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6388+0+0 (secure 0 0 0) 0x7fb45409cc50 con 0x7fb4641005b0 2024-08-31T05:33:00.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.551+0000 7fb4627fc640 1 --2- 172.21.15.67:0/3727183312 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb450079e00 0x7fb45007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:00.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.552+0000 7fb4627fc640 1 --2- 172.21.15.67:0/3727183312 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb450079e00 0x7fb45007c2c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb4640ff860 tx=0x7fb44c004f30 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:00.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.556+0000 7fb45bfff640 1 -- 172.21.15.67:0/3727183312 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb454014030 con 0x7fb4641005b0 2024-08-31T05:33:00.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.756+0000 7fb469369640 1 -- 172.21.15.67:0/3727183312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb46419cad0 con 0x7fb4641005b0 2024-08-31T05:33:00.758 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:00 smithi067 ceph-mon[99941]: pgmap v379: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:00.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.756+0000 7fb45bfff640 1 -- 172.21.15.67:0/3727183312 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 31 entries v95) ==== 81+0+1837 (secure 0 0 0) 0x7fb454068790 con 0x7fb4641005b0 2024-08-31T05:33:00.758 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3820732856 2024-09-01T05:20:23.461456+0000 2024-08-31T05:33:00.758 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:6827/1624245945 2024-09-01T05:29:52.951717+0000 2024-08-31T05:33:00.758 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/2838724829 2024-09-01T05:12:45.310890+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:0/2281964479 2024-09-01T05:22:03.579421+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/683720860 2024-09-01T05:20:23.461456+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:0/4068551783 2024-09-01T05:22:03.579421+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3624769860 2024-09-01T05:13:41.288702+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3782915644 2024-09-01T05:12:13.010409+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/4268636965 2024-09-01T05:12:45.310890+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3246639847 2024-09-01T05:12:13.010409+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/2323558682 2024-09-01T05:12:45.310890+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:0/2809375331 2024-09-01T05:22:03.579421+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/2323558682 2024-09-01T05:12:45.310890+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:6826/1624245945 2024-09-01T05:29:52.951717+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/2529430863 2024-09-01T05:12:45.310890+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/1741828555 2024-09-01T05:13:41.288702+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3787377150 2024-09-01T05:13:41.288702+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/2090251560 2024-09-01T05:20:23.461456+0000 2024-08-31T05:33:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/298845382 2024-09-01T05:20:23.461456+0000 2024-08-31T05:33:00.760 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6827/2961844124 2024-09-01T05:29:05.236681+0000 2024-08-31T05:33:00.760 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:0/2892020941 2024-09-01T05:22:03.579421+0000 2024-08-31T05:33:00.760 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:6828/1567621854 2024-09-01T05:22:03.579421+0000 2024-08-31T05:33:00.760 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/1741828555 2024-09-01T05:13:41.288702+0000 2024-08-31T05:33:00.760 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/4159467749 2024-09-01T05:12:13.010409+0000 2024-08-31T05:33:00.760 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.73:6829/1567621854 2024-09-01T05:22:03.579421+0000 2024-08-31T05:33:00.760 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/2090251560 2024-09-01T05:20:23.461456+0000 2024-08-31T05:33:00.760 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/1438563298 2024-09-01T05:20:23.461456+0000 2024-08-31T05:33:00.760 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/4159467749 2024-09-01T05:12:13.010409+0000 2024-08-31T05:33:00.760 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3326210547 2024-09-01T05:13:41.288702+0000 2024-08-31T05:33:00.760 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/743586046 2024-09-01T05:12:13.010409+0000 2024-08-31T05:33:00.760 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6826/2961844124 2024-09-01T05:29:05.236681+0000 2024-08-31T05:33:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:listed 31 entries 2024-08-31T05:33:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.759+0000 7fb469369640 1 -- 172.21.15.67:0/3727183312 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb450079e00 msgr2=0x7fb45007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.759+0000 7fb469369640 1 --2- 172.21.15.67:0/3727183312 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb450079e00 0x7fb45007c2c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb4640ff860 tx=0x7fb44c004f30 comp rx=0 tx=0).stop 2024-08-31T05:33:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.759+0000 7fb469369640 1 -- 172.21.15.67:0/3727183312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4641005b0 msgr2=0x7fb464197670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.759+0000 7fb469369640 1 --2- 172.21.15.67:0/3727183312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4641005b0 0x7fb464197670 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb45400cc60 tx=0x7fb45400a620 comp rx=0 tx=0).stop 2024-08-31T05:33:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.759+0000 7fb469369640 1 -- 172.21.15.67:0/3727183312 shutdown_connections 2024-08-31T05:33:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.759+0000 7fb469369640 1 --2- 172.21.15.67:0/3727183312 >> [v2:172.21.15.67:6800/539581811,v1:172.21.15.67:6801/539581811] conn(0x7fb450079e00 0x7fb45007c2c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:00.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.759+0000 7fb469369640 1 --2- 172.21.15.67:0/3727183312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb464106660 0x7fb464197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:00.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.759+0000 7fb469369640 1 --2- 172.21.15.67:0/3727183312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4641005b0 0x7fb464197670 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:00.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.759+0000 7fb469369640 1 -- 172.21.15.67:0/3727183312 >> 172.21.15.67:0/3727183312 conn(0x7fb4640fc2f0 msgr2=0x7fb464069a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:00.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.759+0000 7fb469369640 1 -- 172.21.15.67:0/3727183312 shutdown_connections 2024-08-31T05:33:00.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-08-31T05:33:00.759+0000 7fb469369640 1 -- 172.21.15.67:0/3727183312 wait complete. 2024-08-31T05:33:00.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:00 smithi073 ceph-mon[71452]: pgmap v379: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:01.388 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-08-31T05:33:01.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:33:01.388 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-31T05:33:01.416 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T05:33:01.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:01 smithi067 ceph-mon[99941]: from='client.? 172.21.15.67:0/3727183312' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T05:33:01.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:01 smithi073 ceph-mon[71452]: from='client.? 172.21.15.67:0/3727183312' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T05:33:02.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:02 smithi073 ceph-mon[71452]: pgmap v380: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:03.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:02 smithi067 ceph-mon[99941]: pgmap v380: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:04.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:03 smithi073 ceph-mon[71452]: pgmap v381: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:04.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:03 smithi067 ceph-mon[99941]: pgmap v381: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:05.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:33:05.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:33:06.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:05 smithi073 ceph-mon[71452]: pgmap v382: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:06.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:05 smithi067 ceph-mon[99941]: pgmap v382: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:08.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:07 smithi073 ceph-mon[71452]: pgmap v383: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:08.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:07 smithi067 ceph-mon[99941]: pgmap v383: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:10.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:09 smithi073 ceph-mon[71452]: pgmap v384: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:10.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:09 smithi067 ceph-mon[99941]: pgmap v384: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:12.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:11 smithi073 ceph-mon[71452]: pgmap v385: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:11 smithi067 ceph-mon[99941]: pgmap v385: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:14.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:13 smithi073 ceph-mon[71452]: pgmap v386: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:14.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:13 smithi067 ceph-mon[99941]: pgmap v386: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:16.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:15 smithi073 ceph-mon[71452]: pgmap v387: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:15 smithi067 ceph-mon[99941]: pgmap v387: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:18.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:17 smithi073 ceph-mon[71452]: pgmap v388: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:18.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:17 smithi067 ceph-mon[99941]: pgmap v388: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:19.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:19 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:33:20.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:19 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:33:20.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:20 smithi073 ceph-mon[71452]: pgmap v389: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:21.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:20 smithi067 ceph-mon[99941]: pgmap v389: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:22.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:21 smithi073 ceph-mon[71452]: pgmap v390: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:22.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:21 smithi067 ceph-mon[99941]: pgmap v390: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:24.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:23 smithi073 ceph-mon[71452]: pgmap v391: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:24.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:23 smithi067 ceph-mon[99941]: pgmap v391: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:26.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:25 smithi073 ceph-mon[71452]: pgmap v392: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:26.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:25 smithi067 ceph-mon[99941]: pgmap v392: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:28.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:27 smithi073 ceph-mon[71452]: pgmap v393: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:28.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:27 smithi067 ceph-mon[99941]: pgmap v393: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:30.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:29 smithi067 ceph-mon[99941]: pgmap v394: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:30.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:29 smithi073 ceph-mon[71452]: pgmap v394: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:32.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:31 smithi073 ceph-mon[71452]: pgmap v395: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:32.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:31 smithi067 ceph-mon[99941]: pgmap v395: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:34.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:33 smithi073 ceph-mon[71452]: pgmap v396: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:33 smithi067 ceph-mon[99941]: pgmap v396: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:35.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:33:35.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:33:36.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:35 smithi073 ceph-mon[71452]: pgmap v397: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:36.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:35 smithi067 ceph-mon[99941]: pgmap v397: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:37.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:36 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:33:37.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:36 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:33:38.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:38 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:33:38.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:38 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:33:38.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:38 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:33:38.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:38 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:33:38.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:38 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:33:38.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:38 smithi073 ceph-mon[71452]: pgmap v398: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:38.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:38 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:33:38.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:38 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:33:38.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:38 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:33:38.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:38 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:33:38.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:38 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:33:38.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:38 smithi067 ceph-mon[99941]: pgmap v398: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:40.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:39 smithi073 ceph-mon[71452]: pgmap v399: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:40.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:39 smithi067 ceph-mon[99941]: pgmap v399: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:42.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:41 smithi073 ceph-mon[71452]: pgmap v400: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:42.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:41 smithi067 ceph-mon[99941]: pgmap v400: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:44.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:43 smithi073 ceph-mon[71452]: pgmap v401: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:43 smithi067 ceph-mon[99941]: pgmap v401: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:46.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:45 smithi073 ceph-mon[71452]: pgmap v402: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:46.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:45 smithi067 ceph-mon[99941]: pgmap v402: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:49.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:48 smithi067 ceph-mon[99941]: pgmap v403: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:49.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:48 smithi073 ceph-mon[71452]: pgmap v403: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:49.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:33:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:33:51.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:50 smithi067 ceph-mon[99941]: pgmap v404: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:51.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:50 smithi073 ceph-mon[71452]: pgmap v404: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:52.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:51 smithi073 ceph-mon[71452]: pgmap v405: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:52.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:51 smithi067 ceph-mon[99941]: pgmap v405: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:54.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:53 smithi073 ceph-mon[71452]: pgmap v406: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:54.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:53 smithi067 ceph-mon[99941]: pgmap v406: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:33:56.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:55 smithi067 ceph-mon[99941]: pgmap v407: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:56.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:55 smithi073 ceph-mon[71452]: pgmap v407: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:58.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:57 smithi073 ceph-mon[71452]: pgmap v408: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:33:58.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:57 smithi067 ceph-mon[99941]: pgmap v408: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:00.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:33:59 smithi067 ceph-mon[99941]: pgmap v409: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:00.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:33:59 smithi073 ceph-mon[71452]: pgmap v409: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:01 smithi073 ceph-mon[71452]: pgmap v410: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:02.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:01 smithi067 ceph-mon[99941]: pgmap v410: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:04.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:03 smithi073 ceph-mon[71452]: pgmap v411: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:04.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:03 smithi067 ceph-mon[99941]: pgmap v411: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:34:05.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:34:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:05 smithi073 ceph-mon[71452]: pgmap v412: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:06.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:05 smithi067 ceph-mon[99941]: pgmap v412: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:08.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:07 smithi073 ceph-mon[71452]: pgmap v413: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:08.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:07 smithi067 ceph-mon[99941]: pgmap v413: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:10.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:09 smithi073 ceph-mon[71452]: pgmap v414: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:10.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:09 smithi067 ceph-mon[99941]: pgmap v414: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:12.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:11 smithi073 ceph-mon[71452]: pgmap v415: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:11 smithi067 ceph-mon[99941]: pgmap v415: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:14.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:13 smithi073 ceph-mon[71452]: pgmap v416: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:13 smithi067 ceph-mon[99941]: pgmap v416: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:16.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:15 smithi073 ceph-mon[71452]: pgmap v417: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:16.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:15 smithi067 ceph-mon[99941]: pgmap v417: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:18.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:17 smithi073 ceph-mon[71452]: pgmap v418: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:18.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:17 smithi067 ceph-mon[99941]: pgmap v418: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:19.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:19 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:34:20.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:19 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:34:20.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:20 smithi073 ceph-mon[71452]: pgmap v419: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:21.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:20 smithi067 ceph-mon[99941]: pgmap v419: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:22.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:21 smithi073 ceph-mon[71452]: pgmap v420: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:22.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:21 smithi067 ceph-mon[99941]: pgmap v420: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:24.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:23 smithi073 ceph-mon[71452]: pgmap v421: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:24.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:23 smithi067 ceph-mon[99941]: pgmap v421: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:26.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:25 smithi073 ceph-mon[71452]: pgmap v422: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:26.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:25 smithi067 ceph-mon[99941]: pgmap v422: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:28.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:27 smithi073 ceph-mon[71452]: pgmap v423: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:28.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:27 smithi067 ceph-mon[99941]: pgmap v423: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:30.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:29 smithi073 ceph-mon[71452]: pgmap v424: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:30.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:29 smithi067 ceph-mon[99941]: pgmap v424: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:32.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:31 smithi073 ceph-mon[71452]: pgmap v425: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:32.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:31 smithi067 ceph-mon[99941]: pgmap v425: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:34.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:33 smithi073 ceph-mon[71452]: pgmap v426: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:33 smithi067 ceph-mon[99941]: pgmap v426: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:35.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:34:35.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:34:36.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:35 smithi073 ceph-mon[71452]: pgmap v427: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-08-31T05:34:36.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:35 smithi067 ceph-mon[99941]: pgmap v427: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-08-31T05:34:38.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:37 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:34:38.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:37 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:34:39.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:38 smithi067 ceph-mon[99941]: pgmap v428: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-08-31T05:34:39.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:38 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:34:39.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:38 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:34:39.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:38 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:34:39.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:38 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:34:39.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:38 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:34:39.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:38 smithi073 ceph-mon[71452]: pgmap v428: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-08-31T05:34:39.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:38 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:34:39.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:38 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:34:39.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:38 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:34:39.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:38 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:34:39.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:38 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:34:40.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:39 smithi073 ceph-mon[71452]: pgmap v429: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:40.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:39 smithi067 ceph-mon[99941]: pgmap v429: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:42.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:41 smithi067 ceph-mon[99941]: pgmap v430: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-08-31T05:34:42.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:41 smithi073 ceph-mon[71452]: pgmap v430: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-08-31T05:34:44.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:43 smithi073 ceph-mon[71452]: pgmap v431: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:44.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:43 smithi067 ceph-mon[99941]: pgmap v431: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:46.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:45 smithi073 ceph-mon[71452]: pgmap v432: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:46.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:45 smithi067 ceph-mon[99941]: pgmap v432: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:48.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:47 smithi073 ceph-mon[71452]: pgmap v433: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:48.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:47 smithi067 ceph-mon[99941]: pgmap v433: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:49.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:34:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:34:50.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:50 smithi073 ceph-mon[71452]: pgmap v434: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:51.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:50 smithi067 ceph-mon[99941]: pgmap v434: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:52.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:51 smithi073 ceph-mon[71452]: pgmap v435: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:52.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:51 smithi067 ceph-mon[99941]: pgmap v435: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:54.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:53 smithi073 ceph-mon[71452]: pgmap v436: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:54.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:53 smithi067 ceph-mon[99941]: pgmap v436: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:34:56.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:55 smithi073 ceph-mon[71452]: pgmap v437: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:56.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:55 smithi067 ceph-mon[99941]: pgmap v437: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:58.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:57 smithi073 ceph-mon[71452]: pgmap v438: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:34:58.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:57 smithi067 ceph-mon[99941]: pgmap v438: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:00.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:34:59 smithi073 ceph-mon[71452]: pgmap v439: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:00.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:34:59 smithi067 ceph-mon[99941]: pgmap v439: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:02.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:01 smithi067 ceph-mon[99941]: pgmap v440: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:01 smithi073 ceph-mon[71452]: pgmap v440: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:04.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:03 smithi073 ceph-mon[71452]: pgmap v441: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:04.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:03 smithi067 ceph-mon[99941]: pgmap v441: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:05.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:35:05.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:35:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:05 smithi073 ceph-mon[71452]: pgmap v442: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:06.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:05 smithi067 ceph-mon[99941]: pgmap v442: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:08.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:07 smithi073 ceph-mon[71452]: pgmap v443: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:08.489 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:07 smithi067 ceph-mon[99941]: pgmap v443: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:10.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:09 smithi073 ceph-mon[71452]: pgmap v444: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:10.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:09 smithi067 ceph-mon[99941]: pgmap v444: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:12.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:11 smithi073 ceph-mon[71452]: pgmap v445: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:11 smithi067 ceph-mon[99941]: pgmap v445: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:13 smithi073 ceph-mon[71452]: pgmap v446: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:13 smithi067 ceph-mon[99941]: pgmap v446: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:16.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:15 smithi073 ceph-mon[71452]: pgmap v447: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:15 smithi067 ceph-mon[99941]: pgmap v447: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:18.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:17 smithi073 ceph-mon[71452]: pgmap v448: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:18.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:17 smithi067 ceph-mon[99941]: pgmap v448: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:19.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:19 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:35:20.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:19 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:35:20.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:20 smithi073 ceph-mon[71452]: pgmap v449: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:21.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:20 smithi067 ceph-mon[99941]: pgmap v449: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:22.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:21 smithi073 ceph-mon[71452]: pgmap v450: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:22.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:21 smithi067 ceph-mon[99941]: pgmap v450: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:24.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:23 smithi073 ceph-mon[71452]: pgmap v451: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:24.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:23 smithi067 ceph-mon[99941]: pgmap v451: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:26.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:25 smithi073 ceph-mon[71452]: pgmap v452: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:26.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:25 smithi067 ceph-mon[99941]: pgmap v452: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:28.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:27 smithi073 ceph-mon[71452]: pgmap v453: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:28.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:27 smithi067 ceph-mon[99941]: pgmap v453: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:30.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:29 smithi073 ceph-mon[71452]: pgmap v454: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:30.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:29 smithi067 ceph-mon[99941]: pgmap v454: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:32.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:31 smithi073 ceph-mon[71452]: pgmap v455: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:32.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:31 smithi067 ceph-mon[99941]: pgmap v455: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:34.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:33 smithi073 ceph-mon[71452]: pgmap v456: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:33 smithi067 ceph-mon[99941]: pgmap v456: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:35:35.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:35:36.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:35 smithi073 ceph-mon[71452]: pgmap v457: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:36.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:35 smithi067 ceph-mon[99941]: pgmap v457: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:38.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:37 smithi073 ceph-mon[71452]: pgmap v458: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:38.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:37 smithi067 ceph-mon[99941]: pgmap v458: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:39.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:38 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:35:39.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:38 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:35:40.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:39 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:35:40.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:39 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:35:40.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:39 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:35:40.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:39 smithi073 ceph-mon[71452]: pgmap v459: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:40.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:39 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:35:40.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:39 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:35:40.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:39 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:35:40.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:39 smithi067 ceph-mon[99941]: pgmap v459: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:42.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:41 smithi073 ceph-mon[71452]: pgmap v460: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:42.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:41 smithi067 ceph-mon[99941]: pgmap v460: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:44.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:43 smithi073 ceph-mon[71452]: pgmap v461: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:43 smithi067 ceph-mon[99941]: pgmap v461: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:46.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:45 smithi073 ceph-mon[71452]: pgmap v462: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:46.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:45 smithi067 ceph-mon[99941]: pgmap v462: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:48.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:47 smithi073 ceph-mon[71452]: pgmap v463: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:48.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:47 smithi067 ceph-mon[99941]: pgmap v463: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:49.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:35:50.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:35:50.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:50 smithi073 ceph-mon[71452]: pgmap v464: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:51.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:50 smithi067 ceph-mon[99941]: pgmap v464: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:52.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:51 smithi073 ceph-mon[71452]: pgmap v465: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:52.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:51 smithi067 ceph-mon[99941]: pgmap v465: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:54.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:53 smithi073 ceph-mon[71452]: pgmap v466: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:54.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:53 smithi067 ceph-mon[99941]: pgmap v466: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:35:56.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:55 smithi073 ceph-mon[71452]: pgmap v467: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:56.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:55 smithi067 ceph-mon[99941]: pgmap v467: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:58.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:57 smithi073 ceph-mon[71452]: pgmap v468: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:35:58.261 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:57 smithi067 ceph-mon[99941]: pgmap v468: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:00.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:35:59 smithi073 ceph-mon[71452]: pgmap v469: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:00.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:35:59 smithi067 ceph-mon[99941]: pgmap v469: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:01 smithi073 ceph-mon[71452]: pgmap v470: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:02.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:01 smithi067 ceph-mon[99941]: pgmap v470: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:04.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:03 smithi073 ceph-mon[71452]: pgmap v471: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:04.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:03 smithi067 ceph-mon[99941]: pgmap v471: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:05.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:36:05.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:36:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:05 smithi073 ceph-mon[71452]: pgmap v472: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:06.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:05 smithi067 ceph-mon[99941]: pgmap v472: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:08.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:07 smithi073 ceph-mon[71452]: pgmap v473: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:08.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:07 smithi067 ceph-mon[99941]: pgmap v473: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:10.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:09 smithi073 ceph-mon[71452]: pgmap v474: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:10.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:09 smithi067 ceph-mon[99941]: pgmap v474: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:12.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:11 smithi073 ceph-mon[71452]: pgmap v475: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:11 smithi067 ceph-mon[99941]: pgmap v475: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:13 smithi073 ceph-mon[71452]: pgmap v476: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:13 smithi067 ceph-mon[99941]: pgmap v476: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:16.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:15 smithi073 ceph-mon[71452]: pgmap v477: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:15 smithi067 ceph-mon[99941]: pgmap v477: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:18.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:17 smithi073 ceph-mon[71452]: pgmap v478: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:18.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:17 smithi067 ceph-mon[99941]: pgmap v478: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:19.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:19 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:36:20.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:19 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:36:20.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:20 smithi073 ceph-mon[71452]: pgmap v479: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:21.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:20 smithi067 ceph-mon[99941]: pgmap v479: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:22.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:21 smithi073 ceph-mon[71452]: pgmap v480: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:22.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:21 smithi067 ceph-mon[99941]: pgmap v480: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:24.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:23 smithi067 ceph-mon[99941]: pgmap v481: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:24.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:23 smithi073 ceph-mon[71452]: pgmap v481: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:26.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:25 smithi073 ceph-mon[71452]: pgmap v482: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:26.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:25 smithi067 ceph-mon[99941]: pgmap v482: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:28.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:27 smithi073 ceph-mon[71452]: pgmap v483: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:28.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:27 smithi067 ceph-mon[99941]: pgmap v483: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:30.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:29 smithi073 ceph-mon[71452]: pgmap v484: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:30.226 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:29 smithi067 ceph-mon[99941]: pgmap v484: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:32.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:31 smithi073 ceph-mon[71452]: pgmap v485: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:32.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:31 smithi067 ceph-mon[99941]: pgmap v485: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:34.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:33 smithi073 ceph-mon[71452]: pgmap v486: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:33 smithi067 ceph-mon[99941]: pgmap v486: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:35.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:36:35.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:36:36.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:35 smithi073 ceph-mon[71452]: pgmap v487: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:36.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:35 smithi067 ceph-mon[99941]: pgmap v487: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:38.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:37 smithi073 ceph-mon[71452]: pgmap v488: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:38.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:37 smithi067 ceph-mon[99941]: pgmap v488: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:39.445 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:39 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:36:39.574 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:39 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:36:40.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:40 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:36:40.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:40 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:36:40.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:40 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:36:40.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:40 smithi073 ceph-mon[71452]: pgmap v489: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:40.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:40 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:36:40.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:40 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:36:40.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:40 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:36:40.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:40 smithi067 ceph-mon[99941]: pgmap v489: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:42.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:41 smithi073 ceph-mon[71452]: pgmap v490: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:42.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:41 smithi067 ceph-mon[99941]: pgmap v490: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:44.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:43 smithi073 ceph-mon[71452]: pgmap v491: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:44.223 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:43 smithi067 ceph-mon[99941]: pgmap v491: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:46.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:45 smithi073 ceph-mon[71452]: pgmap v492: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:46.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:45 smithi067 ceph-mon[99941]: pgmap v492: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:48.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:47 smithi073 ceph-mon[71452]: pgmap v493: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:48.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:47 smithi067 ceph-mon[99941]: pgmap v493: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:49.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:36:50.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:36:50.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:50 smithi073 ceph-mon[71452]: pgmap v494: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:51.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:50 smithi067 ceph-mon[99941]: pgmap v494: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:52.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:51 smithi073 ceph-mon[71452]: pgmap v495: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:52.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:51 smithi067 ceph-mon[99941]: pgmap v495: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:54.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:53 smithi073 ceph-mon[71452]: pgmap v496: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:54.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:53 smithi067 ceph-mon[99941]: pgmap v496: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:36:56.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:55 smithi073 ceph-mon[71452]: pgmap v497: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:56.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:55 smithi067 ceph-mon[99941]: pgmap v497: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:57.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:57 smithi073 ceph-mon[71452]: pgmap v498: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:36:58.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:57 smithi067 ceph-mon[99941]: pgmap v498: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:00.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:36:59 smithi073 ceph-mon[71452]: pgmap v499: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:00.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:36:59 smithi067 ceph-mon[99941]: pgmap v499: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:02.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:01 smithi073 ceph-mon[71452]: pgmap v500: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:02.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:01 smithi067 ceph-mon[99941]: pgmap v500: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:04.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:03 smithi073 ceph-mon[71452]: pgmap v501: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:04.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:03 smithi067 ceph-mon[99941]: pgmap v501: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:05.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:04 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:37:05.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:04 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:37:06.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:05 smithi073 ceph-mon[71452]: pgmap v502: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:06.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:05 smithi067 ceph-mon[99941]: pgmap v502: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:08.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:07 smithi073 ceph-mon[71452]: pgmap v503: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:08.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:07 smithi067 ceph-mon[99941]: pgmap v503: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:10.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:09 smithi073 ceph-mon[71452]: pgmap v504: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:10.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:09 smithi067 ceph-mon[99941]: pgmap v504: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:12.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:11 smithi073 ceph-mon[71452]: pgmap v505: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:12.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:11 smithi067 ceph-mon[99941]: pgmap v505: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:14.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:13 smithi073 ceph-mon[71452]: pgmap v506: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:14.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:13 smithi067 ceph-mon[99941]: pgmap v506: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:16.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:15 smithi073 ceph-mon[71452]: pgmap v507: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:16.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:15 smithi067 ceph-mon[99941]: pgmap v507: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:18.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:17 smithi073 ceph-mon[71452]: pgmap v508: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:18.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:17 smithi067 ceph-mon[99941]: pgmap v508: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:19.937 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:19 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:37:19.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:19 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:37:20.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:20 smithi073 ceph-mon[71452]: pgmap v509: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:21.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:20 smithi067 ceph-mon[99941]: pgmap v509: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:22.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:21 smithi073 ceph-mon[71452]: pgmap v510: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:22.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:21 smithi067 ceph-mon[99941]: pgmap v510: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:24.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:23 smithi073 ceph-mon[71452]: pgmap v511: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:24.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:23 smithi067 ceph-mon[99941]: pgmap v511: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:26.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:25 smithi073 ceph-mon[71452]: pgmap v512: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:26.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:25 smithi067 ceph-mon[99941]: pgmap v512: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:28.193 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:27 smithi073 ceph-mon[71452]: pgmap v513: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:28.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:27 smithi067 ceph-mon[99941]: pgmap v513: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:30.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:29 smithi073 ceph-mon[71452]: pgmap v514: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:30.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:29 smithi067 ceph-mon[99941]: pgmap v514: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:32.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:31 smithi073 ceph-mon[71452]: pgmap v515: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:32.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:31 smithi067 ceph-mon[99941]: pgmap v515: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:34.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:33 smithi073 ceph-mon[71452]: pgmap v516: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:34.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:33 smithi067 ceph-mon[99941]: pgmap v516: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:35.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:34 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:37:35.242 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:34 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:37:36.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:35 smithi073 ceph-mon[71452]: pgmap v517: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:36.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:35 smithi067 ceph-mon[99941]: pgmap v517: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:38.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:37 smithi073 ceph-mon[71452]: pgmap v518: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:38.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:37 smithi067 ceph-mon[99941]: pgmap v518: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:39.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:39 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:37:40.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:39 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:37:40.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:40 smithi073 ceph-mon[71452]: pgmap v519: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:40.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:40 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:37:40.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:40 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:37:40.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:40 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:37:41.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:40 smithi067 ceph-mon[99941]: pgmap v519: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:41.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:40 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:37:41.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:40 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:37:41.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:40 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' 2024-08-31T05:37:42.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:41 smithi073 ceph-mon[71452]: pgmap v520: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:42.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:41 smithi067 ceph-mon[99941]: pgmap v520: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:44.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:43 smithi073 ceph-mon[71452]: pgmap v521: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:44.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:43 smithi067 ceph-mon[99941]: pgmap v521: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:46.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:45 smithi073 ceph-mon[71452]: pgmap v522: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:46.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:45 smithi067 ceph-mon[99941]: pgmap v522: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:48.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:47 smithi073 ceph-mon[71452]: pgmap v523: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:48.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:47 smithi067 ceph-mon[99941]: pgmap v523: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:49.945 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:49 smithi073 ceph-mon[71452]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:37:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:49 smithi067 ceph-mon[99941]: from='mgr.24465 172.21.15.67:0/2937124744' entity='mgr.smithi067.hftacj' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-08-31T05:37:50.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:50 smithi067 ceph-mon[99941]: pgmap v524: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:50.946 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:50 smithi073 ceph-mon[71452]: pgmap v524: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:52.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:51 smithi073 ceph-mon[71452]: pgmap v525: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:52.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:51 smithi067 ceph-mon[99941]: pgmap v525: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:54.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:53 smithi073 ceph-mon[71452]: pgmap v526: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:54.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:53 smithi067 ceph-mon[99941]: pgmap v526: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:37:56.195 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:55 smithi073 ceph-mon[71452]: pgmap v527: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:56.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:55 smithi067 ceph-mon[99941]: pgmap v527: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:58.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:57 smithi073 ceph-mon[71452]: pgmap v528: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:37:58.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:57 smithi067 ceph-mon[99941]: pgmap v528: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-08-31T05:38:00.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:37:59 smithi073 ceph-mon[71452]: pgmap v529: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:38:00.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:37:59 smithi067 ceph-mon[99941]: pgmap v529: 65 pgs: 65 active+clean; 274 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-31T05:38:00.487 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-08-31T05:38:00.488 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-08-31T05:38:00.490 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-31T05:38:00.501 INFO:tasks.cephadm:Teardown begin 2024-08-31T05:38:00.502 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/cephadm.py", line 2374, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-08-31T05:38:00.503 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:38:00.537 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:38:00.571 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-31T05:38:00.571 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T05:38:00.597 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T05:38:00.629 INFO:tasks.cephadm:Stopping all daemons... 2024-08-31T05:38:00.629 INFO:tasks.cephadm.mon.smithi067:Stopping mon.smithi067... 2024-08-31T05:38:00.629 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi067 2024-08-31T05:38:00.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:38:00 smithi067 systemd[1]: Stopping Ceph mon.smithi067 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:38:01.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:38:00 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067[99937]: 2024-08-31T05:38:00.980+0000 7f60837af640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi067 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:38:01.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:38:00 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067[99937]: 2024-08-31T05:38:00.980+0000 7f60837af640 -1 mon.smithi067@0(leader) e2 *** Got Signal Terminated *** 2024-08-31T05:38:01.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:38:01 smithi067 podman[144403]: 2024-08-31 05:38:01.165177125 +0000 UTC m=+0.319882580 container died 25a28efbbd379664dba0dd56466a59918d1a2103c1aa3a2ba10ac69bbbb77e20 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2) 2024-08-31T05:38:01.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:38:01 smithi067 podman[144403]: 2024-08-31 05:38:01.679734189 +0000 UTC m=+0.834439678 container cleanup 25a28efbbd379664dba0dd56466a59918d1a2103c1aa3a2ba10ac69bbbb77e20 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:38:01.825 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Aug 31 05:38:01 smithi067 bash[144403]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi067 2024-08-31T05:38:02.110 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi067.service' 2024-08-31T05:38:02.161 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:38:02.161 INFO:tasks.cephadm.mon.smithi067:Stopped mon.smithi067 2024-08-31T05:38:02.161 INFO:tasks.cephadm.mon.smithi073:Stopping mon.smithi073... 2024-08-31T05:38:02.162 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi073 2024-08-31T05:38:02.446 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:38:02 smithi073 systemd[1]: Stopping Ceph mon.smithi073 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:38:02.800 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:38:02 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073[71448]: 2024-08-31T05:38:02.456+0000 7f59c556d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi073 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:38:02.800 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:38:02 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073[71448]: 2024-08-31T05:38:02.456+0000 7f59c556d640 -1 mon.smithi073@1(peon) e2 *** Got Signal Terminated *** 2024-08-31T05:38:02.800 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:38:02 smithi073 podman[106123]: 2024-08-31 05:38:02.497700853 +0000 UTC m=+0.143260978 container died 6be0f099986016cd654ee813dc12e1f9bc86197146a5699df1196bdac80d3cd0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-31T05:38:03.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:38:02 smithi073 podman[106123]: 2024-08-31 05:38:02.998767057 +0000 UTC m=+0.644327182 container cleanup 6be0f099986016cd654ee813dc12e1f9bc86197146a5699df1196bdac80d3cd0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2) 2024-08-31T05:38:03.196 INFO:journalctl@ceph.mon.smithi073.smithi073.stdout:Aug 31 05:38:02 smithi073 bash[106123]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-mon-smithi073 2024-08-31T05:38:03.431 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@mon.smithi073.service' 2024-08-31T05:38:03.478 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:38:03.478 INFO:tasks.cephadm.mon.smithi073:Stopped mon.smithi073 2024-08-31T05:38:03.478 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-31T05:38:03.478 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.0 2024-08-31T05:38:03.794 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:38:03 smithi067 systemd[1]: Stopping Ceph osd.0 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:38:04.075 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:38:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0[109157]: 2024-08-31T05:38:03.791+0000 7ff1bf43f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:38:04.075 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:38:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0[109157]: 2024-08-31T05:38:03.791+0000 7ff1bf43f640 -1 osd.0 95 *** Got signal Terminated *** 2024-08-31T05:38:04.075 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:38:03 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0[109157]: 2024-08-31T05:38:03.791+0000 7ff1bf43f640 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:38:09.575 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:38:09 smithi067 podman[144539]: 2024-08-31 05:38:09.297192879 +0000 UTC m=+5.618521651 container died aab0516dcbfab12abe2b7c05eb1a4ec6290118f14afd436b27504b54ec9c24bd (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-08-31T05:38:10.037 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:38:09 smithi067 podman[144539]: 2024-08-31 05:38:09.776048005 +0000 UTC m=+6.097376776 container cleanup aab0516dcbfab12abe2b7c05eb1a4ec6290118f14afd436b27504b54ec9c24bd (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.1) 2024-08-31T05:38:10.037 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:38:09 smithi067 bash[144539]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0 2024-08-31T05:38:10.325 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:38:10 smithi067 podman[144557]: 2024-08-31 05:38:10.036104771 +0000 UTC m=+0.734540973 container remove aab0516dcbfab12abe2b7c05eb1a4ec6290118f14afd436b27504b54ec9c24bd (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:38:10.699 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:38:10 smithi067 podman[144644]: 2024-08-31 05:38:10.261990976 +0000 UTC m=+0.016128076 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:38:10.699 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:38:10 smithi067 podman[144644]: 2024-08-31 05:38:10.378922013 +0000 UTC m=+0.133059145 container create f128d4cf5c47fdc8db19ecf422d59df7b9ff0f2fc3a6d2e7e937b21a82c70fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.1, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-31T05:38:10.699 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:38:10 smithi067 podman[144644]: 2024-08-31 05:38:10.589699442 +0000 UTC m=+0.343836532 container init f128d4cf5c47fdc8db19ecf422d59df7b9ff0f2fc3a6d2e7e937b21a82c70fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True) 2024-08-31T05:38:10.699 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:38:10 smithi067 podman[144644]: 2024-08-31 05:38:10.593181912 +0000 UTC m=+0.347319009 container start f128d4cf5c47fdc8db19ecf422d59df7b9ff0f2fc3a6d2e7e937b21a82c70fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-31T05:38:10.699 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:38:10 smithi067 podman[144644]: 2024-08-31 05:38:10.69794153 +0000 UTC m=+0.452078634 container attach f128d4cf5c47fdc8db19ecf422d59df7b9ff0f2fc3a6d2e7e937b21a82c70fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-08-31T05:38:11.075 INFO:journalctl@ceph.osd.0.smithi067.stdout:Aug 31 05:38:10 smithi067 podman[144644]: 2024-08-31 05:38:10.788102436 +0000 UTC m=+0.542239529 container died f128d4cf5c47fdc8db19ecf422d59df7b9ff0f2fc3a6d2e7e937b21a82c70fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-31T05:38:11.598 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.0.service' 2024-08-31T05:38:11.642 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:38:11.642 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-31T05:38:11.642 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-31T05:38:11.642 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.1 2024-08-31T05:38:11.865 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:38:11 smithi067 systemd[1]: Stopping Ceph osd.1 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:38:12.325 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:38:11 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1[114537]: 2024-08-31T05:38:11.988+0000 7fc6ec81b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:38:12.325 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:38:11 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1[114537]: 2024-08-31T05:38:11.988+0000 7fc6ec81b640 -1 osd.1 95 *** Got signal Terminated *** 2024-08-31T05:38:12.325 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:38:11 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1[114537]: 2024-08-31T05:38:11.988+0000 7fc6ec81b640 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:38:17.767 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:38:17 smithi067 podman[144748]: 2024-08-31 05:38:17.490879879 +0000 UTC m=+5.622214751 container died fa9e3fb20c5e4540fae31e2a12dd821af6aac322c18d37b452395cfdf7c643a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-31T05:38:18.076 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:38:17 smithi067 podman[144748]: 2024-08-31 05:38:17.855812278 +0000 UTC m=+5.987147148 container cleanup fa9e3fb20c5e4540fae31e2a12dd821af6aac322c18d37b452395cfdf7c643a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-31T05:38:18.076 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:38:17 smithi067 bash[144748]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1 2024-08-31T05:38:18.441 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:38:18 smithi067 podman[144775]: 2024-08-31 05:38:18.115571661 +0000 UTC m=+0.624101876 container remove fa9e3fb20c5e4540fae31e2a12dd821af6aac322c18d37b452395cfdf7c643a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:38:18.695 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:38:18 smithi067 podman[144864]: 2024-08-31 05:38:18.343304064 +0000 UTC m=+0.016282331 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:38:18.695 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:38:18 smithi067 podman[144864]: 2024-08-31 05:38:18.449754327 +0000 UTC m=+0.122732589 container create cece1086f2c51bf34afcd053cf888bf9b2da602729bb73b36306003b210f54c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.1) 2024-08-31T05:38:18.695 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:38:18 smithi067 podman[144864]: 2024-08-31 05:38:18.694292285 +0000 UTC m=+0.367270548 container init cece1086f2c51bf34afcd053cf888bf9b2da602729bb73b36306003b210f54c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-31T05:38:19.075 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:38:18 smithi067 podman[144864]: 2024-08-31 05:38:18.697785416 +0000 UTC m=+0.370763681 container start cece1086f2c51bf34afcd053cf888bf9b2da602729bb73b36306003b210f54c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-08-31T05:38:19.075 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:38:18 smithi067 podman[144864]: 2024-08-31 05:38:18.794138365 +0000 UTC m=+0.467116627 container attach cece1086f2c51bf34afcd053cf888bf9b2da602729bb73b36306003b210f54c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-08-31T05:38:19.075 INFO:journalctl@ceph.osd.1.smithi067.stdout:Aug 31 05:38:18 smithi067 podman[144864]: 2024-08-31 05:38:18.889232229 +0000 UTC m=+0.562210504 container died cece1086f2c51bf34afcd053cf888bf9b2da602729bb73b36306003b210f54c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-1-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:38:19.565 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.1.service' 2024-08-31T05:38:19.605 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:38:19.606 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-31T05:38:19.606 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-31T05:38:19.606 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.2 2024-08-31T05:38:19.825 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:38:19 smithi067 systemd[1]: Stopping Ceph osd.2 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:38:20.325 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:38:19 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2[120196]: 2024-08-31T05:38:19.984+0000 7fe580a85640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:38:20.325 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:38:19 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2[120196]: 2024-08-31T05:38:19.984+0000 7fe580a85640 -1 osd.2 95 *** Got signal Terminated *** 2024-08-31T05:38:20.325 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:38:19 smithi067 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2[120196]: 2024-08-31T05:38:19.984+0000 7fe580a85640 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:38:25.645 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:38:25 smithi067 podman[144969]: 2024-08-31 05:38:25.362444911 +0000 UTC m=+5.521063407 container died a62abe735da2df29470dae42e4a1e18dd1af41676f3d6cf13c705480bbe9a4a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:38:26.037 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:38:25 smithi067 podman[144969]: 2024-08-31 05:38:25.7347879 +0000 UTC m=+5.893406387 container cleanup a62abe735da2df29470dae42e4a1e18dd1af41676f3d6cf13c705480bbe9a4a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.1) 2024-08-31T05:38:26.037 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:38:25 smithi067 bash[144969]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2 2024-08-31T05:38:26.325 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:38:26 smithi067 podman[144985]: 2024-08-31 05:38:26.036283252 +0000 UTC m=+0.667085272 container remove a62abe735da2df29470dae42e4a1e18dd1af41676f3d6cf13c705480bbe9a4a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1) 2024-08-31T05:38:26.691 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:38:26 smithi067 podman[145072]: 2024-08-31 05:38:26.275794795 +0000 UTC m=+0.016496899 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:38:26.691 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:38:26 smithi067 podman[145072]: 2024-08-31 05:38:26.403931164 +0000 UTC m=+0.144633270 container create 7ceccc33abd02ab038d08c64866073857016161293dfdb36a01c7f03f9326f97 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-31T05:38:26.691 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:38:26 smithi067 podman[145072]: 2024-08-31 05:38:26.614577433 +0000 UTC m=+0.355279546 container init 7ceccc33abd02ab038d08c64866073857016161293dfdb36a01c7f03f9326f97 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:38:26.691 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:38:26 smithi067 podman[145072]: 2024-08-31 05:38:26.617909262 +0000 UTC m=+0.358611369 container start 7ceccc33abd02ab038d08c64866073857016161293dfdb36a01c7f03f9326f97 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1) 2024-08-31T05:38:26.691 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:38:26 smithi067 podman[145072]: 2024-08-31 05:38:26.689674936 +0000 UTC m=+0.430377053 container attach 7ceccc33abd02ab038d08c64866073857016161293dfdb36a01c7f03f9326f97 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-31T05:38:27.074 INFO:journalctl@ceph.osd.2.smithi067.stdout:Aug 31 05:38:26 smithi067 podman[145094]: 2024-08-31 05:38:26.848217873 +0000 UTC m=+0.016679165 container died 7ceccc33abd02ab038d08c64866073857016161293dfdb36a01c7f03f9326f97 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-08-31T05:38:27.425 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.2.service' 2024-08-31T05:38:27.465 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:38:27.465 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-31T05:38:27.465 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-31T05:38:27.466 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.3 2024-08-31T05:38:27.753 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:27 smithi073 systemd[1]: Stopping Ceph osd.3 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:38:28.195 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:27 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[79562]: 2024-08-31T05:38:27.751+0000 7f6eb4683640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:38:28.196 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:27 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[79562]: 2024-08-31T05:38:27.751+0000 7f6eb4683640 -1 osd.3 95 *** Got signal Terminated *** 2024-08-31T05:38:28.196 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:27 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[79562]: 2024-08-31T05:38:27.751+0000 7f6eb4683640 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:38:30.195 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:29 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[79562]: 2024-08-31T05:38:29.743+0000 7f6eacc66640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:04.648491+0000 front 2024-08-31T05:38:04.648608+0000 (oldest deadline 2024-08-31T05:38:29.348430+0000) 2024-08-31T05:38:31.195 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:30 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[79562]: 2024-08-31T05:38:30.745+0000 7f6eacc66640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:04.648491+0000 front 2024-08-31T05:38:04.648608+0000 (oldest deadline 2024-08-31T05:38:29.348430+0000) 2024-08-31T05:38:31.946 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:31 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[79562]: 2024-08-31T05:38:31.743+0000 7f6eacc66640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:04.648491+0000 front 2024-08-31T05:38:04.648608+0000 (oldest deadline 2024-08-31T05:38:29.348430+0000) 2024-08-31T05:38:31.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:31 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:38:31.581+0000 7fa1972dc640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:03.114273+0000 front 2024-08-31T05:38:03.114356+0000 (oldest deadline 2024-08-31T05:38:31.314612+0000) 2024-08-31T05:38:32.446 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:31 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:31.975+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:32.946 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:32 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3[79562]: 2024-08-31T05:38:32.750+0000 7f6eacc66640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:04.648491+0000 front 2024-08-31T05:38:04.648608+0000 (oldest deadline 2024-08-31T05:38:29.348430+0000) 2024-08-31T05:38:32.946 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:32 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:38:32.535+0000 7fa1972dc640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:03.114273+0000 front 2024-08-31T05:38:03.114356+0000 (oldest deadline 2024-08-31T05:38:31.314612+0000) 2024-08-31T05:38:33.217 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:32 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:32.944+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:33.480 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:33 smithi073 podman[106248]: 2024-08-31 05:38:33.215748587 +0000 UTC m=+5.556543710 container died 9f4ce308ec1dcf61de8fa1db5822898fe0908782ed36414ec24722beea5726f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_BRANCH=HEAD) 2024-08-31T05:38:33.746 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:33 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:38:33.539+0000 7fa1972dc640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:03.114273+0000 front 2024-08-31T05:38:03.114356+0000 (oldest deadline 2024-08-31T05:38:31.314612+0000) 2024-08-31T05:38:33.746 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:33 smithi073 podman[106248]: 2024-08-31 05:38:33.560029847 +0000 UTC m=+5.900824978 container cleanup 9f4ce308ec1dcf61de8fa1db5822898fe0908782ed36414ec24722beea5726f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.1) 2024-08-31T05:38:33.746 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:33 smithi073 bash[106248]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3 2024-08-31T05:38:34.157 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:33 smithi073 podman[106263]: 2024-08-31 05:38:33.744632224 +0000 UTC m=+0.521316433 container remove 9f4ce308ec1dcf61de8fa1db5822898fe0908782ed36414ec24722beea5726f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:38:34.158 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:33 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:33.906+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:34.441 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:34 smithi073 podman[106358]: 2024-08-31 05:38:34.059083845 +0000 UTC m=+0.015992468 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:38:34.441 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:34 smithi073 podman[106358]: 2024-08-31 05:38:34.180899495 +0000 UTC m=+0.137808117 container create e8f50e8c0de08efa094e89cc99281612052bf36e64f89f5e3a9478535e026882 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:38:34.441 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:34 smithi073 podman[106358]: 2024-08-31 05:38:34.440102693 +0000 UTC m=+0.397011309 container init e8f50e8c0de08efa094e89cc99281612052bf36e64f89f5e3a9478535e026882 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:38:34.695 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:34 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:38:34.546+0000 7fa1972dc640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:03.114273+0000 front 2024-08-31T05:38:03.114356+0000 (oldest deadline 2024-08-31T05:38:31.314612+0000) 2024-08-31T05:38:34.696 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:34 smithi073 podman[106358]: 2024-08-31 05:38:34.443605425 +0000 UTC m=+0.400514045 container start e8f50e8c0de08efa094e89cc99281612052bf36e64f89f5e3a9478535e026882 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:38:34.696 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:34 smithi073 podman[106358]: 2024-08-31 05:38:34.540096991 +0000 UTC m=+0.497005618 container attach e8f50e8c0de08efa094e89cc99281612052bf36e64f89f5e3a9478535e026882 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.1) 2024-08-31T05:38:34.696 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 31 05:38:34 smithi073 podman[106358]: 2024-08-31 05:38:34.632083668 +0000 UTC m=+0.588992284 container died e8f50e8c0de08efa094e89cc99281612052bf36e64f89f5e3a9478535e026882 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:38:35.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:34 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:34.894+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:35.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.3.service' 2024-08-31T05:38:35.301 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:38:35.301 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-31T05:38:35.302 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-31T05:38:35.302 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.4 2024-08-31T05:38:35.575 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:35 smithi073 systemd[1]: Stopping Ceph osd.4 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:38:35.859 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:35 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:38:35.572+0000 7fa1972dc640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:03.114273+0000 front 2024-08-31T05:38:03.114356+0000 (oldest deadline 2024-08-31T05:38:31.314612+0000) 2024-08-31T05:38:35.859 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:35 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:38:35.621+0000 7fa19ecf9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:38:35.859 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:35 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:38:35.621+0000 7fa19ecf9640 -1 osd.4 95 *** Got signal Terminated *** 2024-08-31T05:38:35.859 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:35 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:38:35.621+0000 7fa19ecf9640 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:38:36.195 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:35 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:35.856+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:36.865 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:36 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:38:36.558+0000 7fa1972dc640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:03.114273+0000 front 2024-08-31T05:38:03.114356+0000 (oldest deadline 2024-08-31T05:38:31.314612+0000) 2024-08-31T05:38:37.195 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:36 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:36.864+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:37.899 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:37 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:38:37.516+0000 7fa1972dc640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:03.114273+0000 front 2024-08-31T05:38:03.114356+0000 (oldest deadline 2024-08-31T05:38:31.314612+0000) 2024-08-31T05:38:38.195 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:37 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:37.896+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:38.863 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:38 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:38:38.482+0000 7fa1972dc640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:03.114273+0000 front 2024-08-31T05:38:03.114356+0000 (oldest deadline 2024-08-31T05:38:31.314612+0000) 2024-08-31T05:38:39.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:38 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:38.861+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:39.695 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:39 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:38:39.434+0000 7fa1972dc640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:03.114273+0000 front 2024-08-31T05:38:03.114356+0000 (oldest deadline 2024-08-31T05:38:31.314612+0000) 2024-08-31T05:38:40.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:39 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:39.813+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:40.780 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:40 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:38:40.482+0000 7fa1972dc640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:03.114273+0000 front 2024-08-31T05:38:03.114356+0000 (oldest deadline 2024-08-31T05:38:31.314612+0000) 2024-08-31T05:38:40.780 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:40 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4[84588]: 2024-08-31T05:38:40.482+0000 7fa1972dc640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2024-08-31T05:38:14.115949+0000 front 2024-08-31T05:38:14.115936+0000 (oldest deadline 2024-08-31T05:38:40.015766+0000) 2024-08-31T05:38:41.196 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:40 smithi073 podman[106461]: 2024-08-31 05:38:40.962831002 +0000 UTC m=+5.443731906 container died 5f02556c012ddb8fa371a9b907eaaca66b278cdd77dc2f15df356bcb96fcab5a (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=) 2024-08-31T05:38:41.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:40 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:40.777+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:41.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:40 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:40.777+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2024-08-31T05:38:12.337076+0000 front 2024-08-31T05:38:12.337105+0000 (oldest deadline 2024-08-31T05:38:39.937665+0000) 2024-08-31T05:38:41.641 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:41 smithi073 podman[106461]: 2024-08-31 05:38:41.313989361 +0000 UTC m=+5.794890274 container cleanup 5f02556c012ddb8fa371a9b907eaaca66b278cdd77dc2f15df356bcb96fcab5a (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:38:41.642 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:41 smithi073 bash[106461]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4 2024-08-31T05:38:41.945 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:41 smithi073 podman[106478]: 2024-08-31 05:38:41.640255112 +0000 UTC m=+0.673311608 container remove 5f02556c012ddb8fa371a9b907eaaca66b278cdd77dc2f15df356bcb96fcab5a (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1) 2024-08-31T05:38:41.946 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:41 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:41.763+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:41.946 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:41 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:41.763+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2024-08-31T05:38:12.337076+0000 front 2024-08-31T05:38:12.337105+0000 (oldest deadline 2024-08-31T05:38:39.937665+0000) 2024-08-31T05:38:42.311 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:41 smithi073 podman[106570]: 2024-08-31 05:38:41.89063471 +0000 UTC m=+0.015711962 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:38:42.311 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:41 smithi073 podman[106570]: 2024-08-31 05:38:41.9995719 +0000 UTC m=+0.124649149 container create 6a8443fd348218b6a6fb1d51d556740229ba48301fa67815a70ffef15c5a9dd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-31T05:38:42.311 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:42 smithi073 podman[106570]: 2024-08-31 05:38:42.227054064 +0000 UTC m=+0.352131314 container init 6a8443fd348218b6a6fb1d51d556740229ba48301fa67815a70ffef15c5a9dd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-31T05:38:42.312 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:42 smithi073 podman[106570]: 2024-08-31 05:38:42.230312094 +0000 UTC m=+0.355389350 container start 6a8443fd348218b6a6fb1d51d556740229ba48301fa67815a70ffef15c5a9dd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, ceph=True) 2024-08-31T05:38:42.312 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:42 smithi073 podman[106570]: 2024-08-31 05:38:42.310298093 +0000 UTC m=+0.435375357 container attach 6a8443fd348218b6a6fb1d51d556740229ba48301fa67815a70ffef15c5a9dd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD) 2024-08-31T05:38:42.696 INFO:journalctl@ceph.osd.4.smithi073.stdout:Aug 31 05:38:42 smithi073 podman[106570]: 2024-08-31 05:38:42.415144098 +0000 UTC m=+0.540221347 container died 6a8443fd348218b6a6fb1d51d556740229ba48301fa67815a70ffef15c5a9dd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T05:38:43.007 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:42 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:42.773+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:43.007 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:42 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:42.773+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2024-08-31T05:38:12.337076+0000 front 2024-08-31T05:38:12.337105+0000 (oldest deadline 2024-08-31T05:38:39.937665+0000) 2024-08-31T05:38:43.024 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.4.service' 2024-08-31T05:38:43.063 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:38:43.063 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-31T05:38:43.064 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-31T05:38:43.064 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.5 2024-08-31T05:38:43.385 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:43 smithi073 systemd[1]: Stopping Ceph osd.5 for 5fd95148-6757-11ef-bcd4-c7b262605968... 2024-08-31T05:38:43.385 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:43 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:43.383+0000 7f8478ed9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:38:43.385 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:43 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:43.383+0000 7f8478ed9640 -1 osd.5 95 *** Got signal Terminated *** 2024-08-31T05:38:43.386 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:43 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:43.383+0000 7f8478ed9640 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:38:44.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:43 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:43.784+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:44.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:43 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:43.784+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2024-08-31T05:38:12.337076+0000 front 2024-08-31T05:38:12.337105+0000 (oldest deadline 2024-08-31T05:38:39.937665+0000) 2024-08-31T05:38:45.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:44 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:44.739+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:45.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:44 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:44.739+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2024-08-31T05:38:12.337076+0000 front 2024-08-31T05:38:12.337105+0000 (oldest deadline 2024-08-31T05:38:39.937665+0000) 2024-08-31T05:38:46.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:45 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:45.730+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:46.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:45 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:45.730+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2024-08-31T05:38:12.337076+0000 front 2024-08-31T05:38:12.337105+0000 (oldest deadline 2024-08-31T05:38:39.937665+0000) 2024-08-31T05:38:47.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:46 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:46.765+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:47.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:46 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:46.765+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2024-08-31T05:38:12.337076+0000 front 2024-08-31T05:38:12.337105+0000 (oldest deadline 2024-08-31T05:38:39.937665+0000) 2024-08-31T05:38:48.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:47 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:47.761+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-08-31T05:38:08.336452+0000 front 2024-08-31T05:38:08.336465+0000 (oldest deadline 2024-08-31T05:38:31.236385+0000) 2024-08-31T05:38:48.196 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:47 smithi073 ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5[89608]: 2024-08-31T05:38:47.761+0000 7f84714bc640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2024-08-31T05:38:12.337076+0000 front 2024-08-31T05:38:12.337105+0000 (oldest deadline 2024-08-31T05:38:39.937665+0000) 2024-08-31T05:38:49.086 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:48 smithi073 podman[106675]: 2024-08-31 05:38:48.809934199 +0000 UTC m=+5.533061533 container died 530ae5c5d1ac1c23295d5858d10f361af082aec089a59e0b247f777f3cc4e45e (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-31T05:38:49.350 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:49 smithi073 podman[106675]: 2024-08-31 05:38:49.183538123 +0000 UTC m=+5.906665411 container cleanup 530ae5c5d1ac1c23295d5858d10f361af082aec089a59e0b247f777f3cc4e45e (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-31T05:38:49.350 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:49 smithi073 bash[106675]: ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5 2024-08-31T05:38:49.695 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:49 smithi073 podman[106691]: 2024-08-31 05:38:49.451340145 +0000 UTC m=+0.634238558 container remove 530ae5c5d1ac1c23295d5858d10f361af082aec089a59e0b247f777f3cc4e45e (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:38:50.039 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:49 smithi073 podman[106778]: 2024-08-31 05:38:49.67692204 +0000 UTC m=+0.015777252 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:38:50.040 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:49 smithi073 podman[106778]: 2024-08-31 05:38:49.811088977 +0000 UTC m=+0.149944174 container create 795e9a2cd01f516cc1c3eefb66e6fce6211a48d94915e32aced4017d0f77d4eb (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-31T05:38:50.040 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:50 smithi073 podman[106778]: 2024-08-31 05:38:50.038599027 +0000 UTC m=+0.377454227 container init 795e9a2cd01f516cc1c3eefb66e6fce6211a48d94915e32aced4017d0f77d4eb (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:38:50.445 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:50 smithi073 podman[106778]: 2024-08-31 05:38:50.041952147 +0000 UTC m=+0.380807353 container start 795e9a2cd01f516cc1c3eefb66e6fce6211a48d94915e32aced4017d0f77d4eb (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-31T05:38:50.446 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:50 smithi073 podman[106778]: 2024-08-31 05:38:50.121789277 +0000 UTC m=+0.460644477 container attach 795e9a2cd01f516cc1c3eefb66e6fce6211a48d94915e32aced4017d0f77d4eb (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.1, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-31T05:38:50.446 INFO:journalctl@ceph.osd.5.smithi073.stdout:Aug 31 05:38:50 smithi073 podman[106778]: 2024-08-31 05:38:50.237997742 +0000 UTC m=+0.576852948 container died 795e9a2cd01f516cc1c3eefb66e6fce6211a48d94915e32aced4017d0f77d4eb (image=quay.ceph.io/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-5fd95148-6757-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1) 2024-08-31T05:38:50.858 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5fd95148-6757-11ef-bcd4-c7b262605968@osd.5.service' 2024-08-31T05:38:50.898 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:38:50.898 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-31T05:38:50.898 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T05:38:51.108 INFO:teuthology.orchestra.run.smithi067.stdout:Deleting cluster with fsid: 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:38:56.171 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi067.stderr:ceph-fuse[64465]: fuse finished with error 0 and tester_r 0 2024-08-31T05:39:16.545 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T05:39:16.747 INFO:teuthology.orchestra.run.smithi073.stdout:Deleting cluster with fsid: 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:39:31.601 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:39:31.635 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:39:31.663 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-31T05:39:32.007 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881343/remote/smithi067/crash 2024-08-31T05:39:32.020 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T05:39:32.050 INFO:teuthology.orchestra.run.smithi067.stderr:tar: /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T05:39:32.050 INFO:teuthology.orchestra.run.smithi067.stderr:tar: Error is not recoverable: exiting now 2024-08-31T05:39:32.052 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881343/remote/smithi073/crash 2024-08-31T05:39:32.054 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T05:39:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:tar: /var/lib/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T05:39:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:tar: Error is not recoverable: exiting now 2024-08-31T05:39:32.080 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-31T05:39:32.080 DEBUG:teuthology.orchestra.run.smithi067:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-08-31T05:39:32.129 INFO:tasks.cephadm:Compressing logs... 2024-08-31T05:39:32.130 DEBUG:teuthology.orchestra.run.smithi067:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T05:39:32.172 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T05:39:32.194 INFO:teuthology.orchestra.run.smithi067.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.0.log 2024-08-31T05:39:32.194 INFO:teuthology.orchestra.run.smithi067.stderr:: No such file or directory 2024-08-31T05:39:32.194 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.1.log 2024-08-31T05:39:32.194 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mds.cephfs.smithi067.beqeql.log 2024-08-31T05:39:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mon.smithi067.log 2024-08-31T05:39:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.1.log: /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mds.cephfs.smithi067.beqeql.log: gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T05:39:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-client.ceph-exporter.smithi067.log 2024-08-31T05:39:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mon.smithi067.log: /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T05:39:32.196 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-client.ceph-exporter.smithi067.log: /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mgr.smithi067.hftacj.log 2024-08-31T05:39:32.198 INFO:teuthology.orchestra.run.smithi073.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T05:39:32.198 INFO:teuthology.orchestra.run.smithi073.stderr:: No such file or directory 2024-08-31T05:39:32.198 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.4.log 2024-08-31T05:39:32.198 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T05:39:32.198 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-client.ceph-exporter.smithi073.log 2024-08-31T05:39:32.198 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T05:39:32.199 INFO:teuthology.orchestra.run.smithi067.stderr: 94.0% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-client.ceph-exporter.smithi067.log.gz 2024-08-31T05:39:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mon.smithi073.log 2024-08-31T05:39:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-client.ceph-exporter.smithi073.log: /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.5.log 2024-08-31T05:39:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mon.smithi073.log: gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T05:39:32.201 INFO:teuthology.orchestra.run.smithi073.stderr: 84.9%/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.5.log: -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T05:39:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mds.cephfs.smithi073.kfbmeo.log 2024-08-31T05:39:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mgr.smithi073.zfoyxd.log 2024-08-31T05:39:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mds.cephfs.smithi073.kfbmeo.log: /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.log: 94.1% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-client.ceph-exporter.smithi073.log.gz 2024-08-31T05:39:32.203 INFO:teuthology.orchestra.run.smithi067.stderr: 91.5% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T05:39:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mds.cephfs.smithi067.tskvpt.log 2024-08-31T05:39:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T05:39:32.204 INFO:teuthology.orchestra.run.smithi073.stderr: 91.7% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T05:39:32.204 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mds.cephfs.smithi073.gsnhxi.log 2024-08-31T05:39:32.204 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mgr.smithi073.zfoyxd.log: gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.3.log 2024-08-31T05:39:32.204 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T05:39:32.205 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mds.cephfs.smithi073.gsnhxi.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-08-31T05:39:32.214 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T05:39:32.216 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mgr.smithi067.hftacj.log: /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mds.cephfs.smithi067.tskvpt.log: gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.2.log 2024-08-31T05:39:32.219 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.1.log: 91.1% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T05:39:32.219 INFO:teuthology.orchestra.run.smithi073.stderr: 92.9% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mds.cephfs.smithi073.gsnhxi.log.gz 2024-08-31T05:39:32.219 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.cephadm.log: 86.4% 91.1% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T05:39:32.219 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T05:39:32.231 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.2.log: -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T05:39:32.231 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-08-31T05:39:32.231 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T05:39:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.log: 88.7%gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T05:39:32.247 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.log: -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T05:39:32.257 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mgr.smithi073.zfoyxd.log.gz 2024-08-31T05:39:32.325 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/cephadm.log: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T05:39:32.616 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mgr.smithi067.hftacj.log.gz 2024-08-31T05:39:32.657 INFO:teuthology.orchestra.run.smithi073.stderr: 92.5% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mon.smithi073.log.gz 2024-08-31T05:39:33.495 INFO:teuthology.orchestra.run.smithi067.stderr: 90.4% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mon.smithi067.log.gz 2024-08-31T05:39:37.020 INFO:teuthology.orchestra.run.smithi067.stderr: 93.7% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.2.log.gz 2024-08-31T05:39:37.119 INFO:teuthology.orchestra.run.smithi073.stderr: 93.7% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.5.log.gz 2024-08-31T05:39:37.445 INFO:teuthology.orchestra.run.smithi073.stderr: 93.8% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.4.log.gz 2024-08-31T05:39:37.595 INFO:teuthology.orchestra.run.smithi073.stderr: 93.7% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.3.log.gz 2024-08-31T05:39:38.437 INFO:teuthology.orchestra.run.smithi073.stderr: 94.9% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mds.cephfs.smithi073.kfbmeo.log.gz 2024-08-31T05:39:38.445 INFO:teuthology.orchestra.run.smithi067.stderr: 93.7% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.0.log.gz 2024-08-31T05:39:39.285 INFO:teuthology.orchestra.run.smithi067.stderr: 93.8% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-osd.1.log.gz 2024-08-31T05:39:47.206 INFO:teuthology.orchestra.run.smithi067.stderr: 94.9% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mds.cephfs.smithi067.beqeql.log.gz 2024-08-31T05:39:47.380 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-08-31T05:39:47.380 INFO:teuthology.orchestra.run.smithi073.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-08-31T05:39:47.382 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-08-31T05:39:47.382 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m15.195s 2024-08-31T05:39:47.382 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m36.391s 2024-08-31T05:39:47.382 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m1.090s 2024-08-31T05:39:49.089 INFO:teuthology.orchestra.run.smithi067.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-08-31T05:41:20.978 INFO:teuthology.orchestra.run.smithi067.stderr: 93.0% -- replaced with /var/log/ceph/5fd95148-6757-11ef-bcd4-c7b262605968/ceph-mds.cephfs.smithi067.tskvpt.log.gz 2024-08-31T05:41:20.979 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-08-31T05:41:20.979 INFO:teuthology.orchestra.run.smithi067.stderr:real 1m48.795s 2024-08-31T05:41:20.979 INFO:teuthology.orchestra.run.smithi067.stderr:user 2m35.297s 2024-08-31T05:41:20.980 INFO:teuthology.orchestra.run.smithi067.stderr:sys 0m4.544s 2024-08-31T05:41:20.980 INFO:tasks.cephadm:Archiving logs... 2024-08-31T05:41:20.980 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881343/remote/smithi067/log 2024-08-31T05:41:20.981 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T05:41:43.611 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881343/remote/smithi073/log 2024-08-31T05:41:43.612 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T05:41:48.936 INFO:tasks.cephadm:Removing cluster... 2024-08-31T05:41:48.937 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 --force 2024-08-31T05:41:49.148 INFO:teuthology.orchestra.run.smithi067.stdout:Deleting cluster with fsid: 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:41:49.558 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5fd95148-6757-11ef-bcd4-c7b262605968 --force 2024-08-31T05:41:49.762 INFO:teuthology.orchestra.run.smithi073.stdout:Deleting cluster with fsid: 5fd95148-6757-11ef-bcd4-c7b262605968 2024-08-31T05:41:50.037 INFO:tasks.cephadm:Removing cephadm ... 2024-08-31T05:41:50.037 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T05:41:50.054 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T05:41:50.070 INFO:tasks.cephadm:Teardown complete 2024-08-31T05:41:50.071 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-31T05:41:50.082 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-08-31T05:41:50.083 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-31T05:41:50.083 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T05:41:50.096 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T05:41:50.187 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-31T05:41:50.201 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-31T05:41:50.201 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T05:41:50.204 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T05:41:50.216 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-08-31T05:41:50.218 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-08-31T05:41:50.220 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T05:41:50.221 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-08-31T05:41:50.221 INFO:teuthology.orchestra.run.smithi067.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 -174us[ -165us] +/- 44ms 2024-08-31T05:41:50.221 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 +120us[ +130us] +/- 62ms 2024-08-31T05:41:50.221 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +136us[ +136us] +/- 62ms 2024-08-31T05:41:50.221 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:41:50.222 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T05:41:50.222 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-08-31T05:41:50.222 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 -177us[ -178us] +/- 44ms 2024-08-31T05:41:50.222 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 +121us[ +119us] +/- 62ms 2024-08-31T05:41:50.222 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 +135us[ +133us] +/- 62ms 2024-08-31T05:41:50.222 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:41:50.223 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-31T05:41:50.234 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-31T05:41:50.234 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-31T05:41:50.257 DEBUG:teuthology.orchestra.run.smithi067:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T05:41:50.328 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T05:41:50.388 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T05:41:50.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:41:50.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T05:41:50.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:41:50.444 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-31T05:41:50.457 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-31T05:41:50.473 INFO:teuthology.task.internal:Duration was 2110.233724 seconds 2024-08-31T05:41:50.474 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-31T05:41:50.513 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-31T05:41:50.513 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T05:41:50.516 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T05:41:50.552 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T05:41:50.555 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T05:41:50.873 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-31T05:41:50.874 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2024-08-31T05:41:50.874 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T05:41:50.934 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-08-31T05:41:50.935 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T05:41:50.960 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-31T05:41:50.960 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T05:41:50.977 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T05:41:51.026 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-31T05:41:51.027 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T05:41:51.044 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T05:41:51.664 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-31T05:41:51.677 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-31T05:41:51.677 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T05:41:51.702 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T05:41:51.728 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-31T05:41:51.742 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T05:41:51.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T05:41:51.765 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2024-08-31T05:41:51.793 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-08-31T05:41:51.823 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T05:41:51.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:41:51.842 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T05:41:51.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:41:51.878 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-31T05:41:51.890 INFO:teuthology.task.internal:Transferring archived files... 2024-08-31T05:41:51.892 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881343/remote/smithi067 2024-08-31T05:41:51.892 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T05:41:51.937 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881343/remote/smithi073 2024-08-31T05:41:51.938 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T05:41:51.972 INFO:teuthology.task.internal:Removing archive directory... 2024-08-31T05:41:51.972 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T05:41:51.975 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T05:41:52.022 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-31T05:41:52.035 INFO:teuthology.task.internal:Not uploading archives. 2024-08-31T05:41:52.035 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-31T05:41:52.058 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-31T05:41:52.059 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T05:41:52.061 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T05:41:52.073 INFO:teuthology.orchestra.run.smithi067.stdout: 262217 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Aug 31 05:41 /home/ubuntu/cephtest 2024-08-31T05:41:52.073 INFO:teuthology.orchestra.run.smithi067.stdout: 531102 4 d--------- 2 ubuntu ubuntu 4096 Aug 31 05:18 /home/ubuntu/cephtest/mnt.0 2024-08-31T05:41:52.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:41:52.075 INFO:teuthology.orchestra.run.smithi067.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-08-31T05:41:52.075 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-08-31T05:41:52.075 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi067 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-08-31T05:41:52.076 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-31T05:41:52.092 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-31T05:41:52.127 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-08-31T05:41:52.130 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2110.2337238788605 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_mchangir@teuthology status: fail success: false 2024-08-31T05:41:52.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T05:41:52.224 INFO:teuthology.run:FAIL